JP4462368B2 - Music playback device and music playback program - Google Patents

Description

  The present invention relates to a music playback device and a music playback program for playing back music data.

When music data stored in a storage unit or the like is reproduced, the music data is usually reproduced as it is.
Then, information related to the contents of the music, for example, information such as the genre of the music, performance time, whether the music contains a phrase preferred by the user, and what part configuration is reproduced. It was acquired by listening to music.

A technique for analyzing a music signal to determine the music genre and correcting the surround sound field in a hall simulation mode corresponding to the genre is described in Patent Document 1.
JP-A-8-37700

As described above, since the user listens to and interprets the music to be played back in order to know what the music data stored in the storage unit or the like is, the interpretation of the contents of the music Needed experience and time.
In addition, what was described in the said patent document 1 performs comprehensive sound field setting according to a music genre, and it is difficult to know the content of a music by this.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a music playback device that enables efficient interpretation of music.

In order to achieve the above object, a music reproducing apparatus of the present invention stores storage means for storing music data including sequence data or audio data as performance information, reproducing means for reproducing the music data, and output from the reproducing means. Sound image localization processing means for performing sound image localization processing based on a control signal for a musical sound signal to be played, a localization control table in which the content of the music and a corresponding localization method are defined, and performance information of the music data Analyzing means for acquiring information related to the contents of the music by directly analyzing sequence data or audio data, and a localization method corresponding to the information acquired by the analyzing means from the localization control table , wherein the entire music is The method of localization, the method of moving the localization in a specific section of the music, the localization according to the composition part of the music How to arrange the or the division of the orientation in the middle of a song, acquires the localization method is any method of performing coupling, sends control information for executing the constant position method to the sound image localization processing unit means It has.
The localization control table defines the contents of music and the priority of localization methods corresponding to the contents.
Furthermore, the analysis means determines the presence or absence of a specific phrase.
Furthermore, it has a means to memorize | store the information regarding the content of the music acquired by the said analysis means matched with the music data .
Still further, the music reproducing program of the present invention includes a storage means for storing music data including sequence data or audio data as performance information, a reproducing means for reproducing the music data, and a musical sound signal output from the reproducing means. A music playback program in a music playback device having sound image localization processing means for performing sound image localization processing on the basis of a control signal, and a localization control table in which the contents of the music and the corresponding localization method are defined, comprising: To the information acquired by the analysis means from the localization control table, and the analysis means for acquiring information relating to the contents of the music by directly analyzing the sequence data or audio data which is the performance information of the music data a corresponding localization method, a method of localizing the entire song, particular in music The method of moving the localization in the interval, a method of placing by dividing the localization in accordance with the component of the music, or to obtain a localization method is any method of performing division of the localization in the middle of the music, the binding, the It is operated as means for sending control information for executing the localization method to the sound image localization processing means.

According to such a music playback device and music playback program of the present invention, efficient music interpretation can be performed by reflecting the analysis result of the musical sound in the localization of the sound image of the stereophonic sound. In other words, only the same hearing as before, the time for one playback is the same, but additional information by localization is added, so if the user knows the meaning of the localization method in advance, Various information related to the contents of the song (song genre, performance time, presence / absence of a favorite phrase, part, etc.) can be easily known.
This is convenient when listening to various songs after receiving a large amount of music distribution.

FIG. 1 is a functional block diagram showing a main configuration of an embodiment of a music reproducing device according to the present invention. The music reproducing device of the present invention can be applied to various devices such as a mobile terminal such as a mobile phone, a portable music player, and a personal computer having an AV function. FIG. 1 shows a mobile terminal such as a mobile phone. It shows a case.
In FIG. 1, 10 is a music playback device (mobile terminal), 11 is a control unit (CPU) for controlling the overall operation of the music playback device 10, 12 is a memory composed of ROM and RAM for storing various control programs and data, 13 Is a music information storage unit that stores music data, 14 is a timer that outputs various timing signals, 15 is a music analysis unit that acquires information about the contents from music data stored in the music information storage unit 13, and 16 is A display control unit 17 for displaying various information on the display unit 21; a performance control unit 17 that reproduces performance information included in the music data stored in the music information holding unit 13 and outputs it to the speaker 22; 18 is an operation unit for inputting an operation signal from the operation unit 23, 19 is a communication unit, 20 is an antenna, 21 is a display unit such as a liquid crystal display unit, and 22 is at least two. A speaker (or headphones) capable of reproducing the performance information from the performance control unit 17 in three dimensions, 23 is an operation device such as operation keys for inputting various operation information, and 24 is a bus for transferring various data. is there.

The music data stored in the music information holding unit 13 is basically data including performance information (sequence data) such as SMF (Standard MIDI File), SMAF (Synthetic music Mobile Application Format), but audio data ( MP3 (MPEG Audio Layer-3), AAC (MPEG-2 Audio AAC (Advanced Audio Coding)) and other audio compression format data). The music data may be originally stereo or 3D audio format data, or may be completely monaural data.
Further, the music analysis unit 15 may be realized by software processing by the CPU 11.
Further, the performance control unit 17 is a sound source unit capable of reproducing the music data, and includes an FM sound source, a WT (Wave Table) sound source, a decoder such as an MP3 decoder, or a composite sound source thereof.

FIG. 2 is a diagram showing an overall configuration of a system to which the music reproducing apparatus which is the mobile terminal described in FIG. 1 is connected.
In this figure, 1, 2 and 3 are the mobile terminals 10 shown in FIG. 1, and can be connected to a large-scale network 5 such as the Internet via the base station 4. Distribution servers 6 and 7 are connected to the large-scale network 5, and the mobile terminals 1 to 3 download music data from the distribution server 6 or 7, and the music information holding unit 13 (FIG. 1). And can be played back using the performance controller 17.

FIG. 3 is a diagram showing a detailed configuration of the performance control unit 17.
In the performance controller 17, 31 is a first interface circuit connected to the bus 24, and 32 is a first FIFO in which performance information (sequence data) input through the first interface circuit 31 is stored. (First in first out) buffer 33 is a sequencer that receives performance information via first buffer 32 and outputs event data to sound source 34 at a timing specified by duration data in the performance information. A sound source for generating a corresponding musical sound based on performance information (event data) supplied from the sequencer 33, and 35 for the musical sound signal input from the sound source 34 or the musical sound signal from the MP3 decoder 38 to be described later. 1 for a sound image localization control signal (3D control signal) input via the interface circuit 31 A sound image localization processing circuit for performing a sound image localization processing Zui (3D circuit).
Reference numeral 36 denotes a second interface circuit connected to the bus 24, and reference numeral 37 denotes a second interface for storing audio compression format data (MP3 data in this example) supplied via the second interface circuit 36. A FIFO buffer 38 is an MP3 decoder that decodes MP3 data supplied from the second buffer 37 and outputs the decoded data to the sound image localization processing circuit 35.
Reference numeral 39 denotes an A / D converter (DAC) that converts the digital audio signal output from the sound image localization processing circuit 35 into an analog signal. The output signal of the DAC 39 is amplified and output from the stereo speaker 22. Will be.

FIG. 4 is a block diagram showing a configuration example of the sound image localization processing circuit 35.
As illustrated, the sound image localization processing circuit 35 includes an FIR filter 41 provided between the first input signal ch1 and the output Lout of the L channel, and an FIR provided between the second input signal ch2 and Lout. The filter 42 includes an FIR filter 43 provided between the ch1 and the R channel output Rout, and an FIR filter 44 provided between the ch2 and Rout. Then, a filter coefficient (HRTF: head related transfer function) prepared in advance corresponding to the position where the sound image is to be arranged is set in the FIR filters 41 to 44, so that an arbitrary position (three-dimensional) around the listener can be obtained. ) To make it sound like it ’s coming out. Here, HRTF (Head Related Transfer Function) is a transfer function that represents the transfer characteristics of sound from the sound source to the eardrum of the listener, and the time error and frequency characteristics that reach both ears for the person to judge the sound image. It contains information such as.
Although FIG. 4 shows a case where the input is two channels, it is possible to change the configuration of one channel or more channels. Localization can be performed independently for each channel. For example, in FIG. 4, the virtual sound source position can be independently arranged in each channel such that ch1 is on the right and ch2 is on the front.

  In the music reproducing device 10 configured as described above, when the reproduction of the music stored in the music information holding unit 13 is instructed by the operation of the operation unit 23 or the like, the music analysis unit 15 displays the music data. Then, the CPU 11 acquires information on the contents of the music, and the CPU 11 starts reproduction of the music by a localization method determined according to the acquired information on the contents of the music. In this way, efficient music interpretation can be achieved by reflecting the music analysis result in the localization of the stereophonic sound image.

Here, as a method for acquiring information related to the contents of the music, (1) a method for acquiring from the attribute information attached to the music data, and (2) a method for analyzing and acquiring performance information of the music data or the audio data itself. There are two ways.
(1) Music Data Attached Information For example, various information such as genre name, artist name, creation date and time can be stored in the content info chunk of the SMAF file. Information can be acquired. Also, attribute information storing various information may be attached to the audio data file, and information such as genre can be acquired from this attribute information.
The SMAF file can contain addresses corresponding to sections such as A melody, B melody, and chorus, and a melody, rhythm, etc. can be designated for each channel. If these pieces of information are stored, it is possible to obtain information on the composition of the performance.
(2) Analysis of performance information When a music playback instruction is given, the music analysis unit 15 searches the entire sequence data or audio data, and extracts a performance time, a high frequency phrase, and the like by a predetermined algorithm. Then, the information is sent to the CPU 11.
Once the information is acquired, it is stored in association with the music data, and the information is used for the next playback.

  As a localization method, (A) the music itself (the whole music) is localized, (B) the localization of a specific section (phrase or part) of the music is moved, and (C) a constituent part of the music (section, part, There are various methods in which the localization is divided and arranged according to the specific part), and (D) the localization is divided and combined in the middle of the music.

By combining the information related to the content of the music acquired by the information acquisition method and the localization method described above, various information related to the music can be expressed. These examples will be described with reference to FIG.
(A) of FIG. 5 is a figure which shows the case where the music itself (the whole music) is localized. In this example, the localization is placed to the right of the listener.
For example, genre information such as enka and J-POP is acquired from the attribute information attached to the music data, and enka is played to the right, J-POP is right 45 °, ROCK is right, etc. To do.
Alternatively, performance information is directly analyzed by the music analysis unit 15 and, for example, if the performance time is 30 seconds or less, it is right, if it is 30 seconds or more and 1 minute or less, it is front, and if it is more, it is right Determine the localization.
In addition, a frequently used phrase is extracted from the performance information, and a database storing the correspondence information between the performance information classification information and the phrase is used to search the classification information using the extracted phrase as a key, and according to the retrieved classification information. To determine the localization (genre analysis). For example, if the most frequently used phrase is “♪: de, ♪: le, ♪: mi”, the localization is set to the right.
Furthermore, based on the user's past usage information, it is analyzed whether or not the user's preference is close, and the preference level is evaluated. For example, a frequently used item used by the user in the past is used as a measure of preference. If it can be determined that the genre “Enka” is preferred by the user, the performance information of the Enka is played with the localization on the right (preference analysis).
In this way, music analysis results and attached attribute information can be reflected in the localization when playing music.

(B) of FIG. 5 is a figure which shows the example in the case of moving the localization of the specific part (phrase or part) of a music. In this case, for the reproduction of a specific phrase or for a specific part, the sound image position is moved around the listener as shown in the figure. As a result, the time information of the musical sound can be reflected in the localization movement.
For example, the localization is moved using attribute information attached to the music data. This clearly shows that the phrase is now a specific phrase. When composition information of performance information such as repetition of a specific phrase is attached, the localization of the part including the phrase is made to circulate in the performance time of each phrase section. For parts that do not have a specific phrase and are not repeated, the panning is made from the beginning to the end of the performance.
Alternatively, performance information is directly analyzed to obtain time information and composition information of performance information. For example, the repetition state of a specific phrase is analyzed for each part, and when the composition of performance information can be analyzed by the phrase, the localization is rotated at a constant speed as described above. In addition, even if it is not a pure circular motion, if it is a symmetrical activation that allows the user to recognize the movement state and be aware of the time transition state, it can be any circle, ellipse, regular polygon, solid, etc. Something like that.

FIG. 5C is a diagram showing an example of the case where the localization is divided and arranged in the constituent parts of the music.
When composition information is attached to music data, the information is used to acquire information for dividing the localization. Alternatively, performance information is directly analyzed to obtain performance configuration information.
For example, (1) A melody is placed on the right, B melody on the left, and rust on the front (Example 1). Alternatively, (2) the rhythm part is placed on the right and the melody part is placed on the left (example 2). Further, (3) a similar phrase can be set to the right, a random phrase can be set to the left, and (4) in the synergisticity of the chord, the cooperative part can be set to the right, the non-consonant part can be set to the left, and so on.
In this way, the composition information of the musical sound can be reflected in the localization division.

(D) of FIG. 5 is a figure which shows the example in the case of dividing or combining a localization in the middle of a music.
In this case, time is expressed by the timing of division and combination while moving the localization. For example, as shown in the figure, sound images that have been separated into left and right during fade-in are combined and placed on the front, and divided into left and right during fade-out. In this way, by dividing / combining the localization at the fade-in / out portion, it can be seen how long the performance is to end. In other words, time information can be expressed by combining from localization division.
When composition information (for example, fade-in / fade-out timing information) is attached to the music data, the information is directly used to obtain information for dividing or combining the localization. Also, performance information is directly analyzed to obtain performance configuration information.
In this way, time can be expressed at the timing of division and combination while moving the localization.

Next, the processing executed by the CPU 11 in order to perform the above-described processing will be described with reference to the localization control table shown in FIG. 6 and the flowchart shown in FIG.
FIG. 6 is a diagram showing an example of the localization control table. As shown in this figure, the localization control table defines the contents of the music acquired by analyzing the music, the localization method and priority corresponding to the contents. ing. The localization control table is stored in the music information holding unit 13 or the memory 12, and the CPU 11 refers to the localization control table according to the contents of the music analyzed by the music analysis unit 15. The localization method is determined. The content of the localization control table can be arbitrarily changed by the user using the operation device 23 or the like. Thereby, since the user can set the localization method by himself, the most suitable localization or the localization preferred by the user can be automatically performed.
In the example shown in FIG. 6, as the first priority, it is defined that when there is a specific phrase (phrases 1 and 2), the localization of the phrase is moved (rounded). It is defined that the panning is set to the right or left according to the genre (enka, J-POP) as the priority of the genre. It is defined that the localization is divided into right, front, and left according to (rhythm part, melody part, other part).

FIG. 7 is a flowchart showing a flow of processing executed by the CPU 11.
When the music data stored in the music information holding unit 13 is designated by the user and the reproduction is instructed, the CPU 11 instructs the music analysis unit 15 to analyze the music data, and the content of the music is stored in the music. The information regarding is acquired (step S1). As described above, this analysis includes (1) a method of acquiring from attribute information attached to music data, and (2) a method of analyzing performance information and acquiring information on the contents of the music. There are streets, and information about the contents of the music (genre, information about the composition of the performance, performance time, whether or not a predetermined phrase is included, etc.) is acquired by either or both of them.
Next, the CPU 11 determines whether or not the information representing the content of the song acquired in step S1 is information defined in the localization control table (step S2).
As a result, when the information recorded in the localization control table is acquired, the music data of the song is sequentially sent to the performance control unit 17 to start the reproduction (step S3), and the localization is performed. A 3D control signal for executing the localization method defined in the control table is sent to the sound image localization processing circuit 35 (step S4). Steps S3 and S4 are repeated until the end of the music, and the reproduction of the music is completed.
On the other hand, as a result of the determination in step S2, if it is determined that the information set in the localization control table has not been acquired, normal music data without performing localization control according to the content of the music Is reproduced (steps S6 and S7).
In this way, with reference to the localization control table, the music can be reproduced with a localization according to the content of the music, and the user can easily interpret the music.

Note that the localization method based on the information related to the contents of each piece of music is shown in FIG. 5 as an example, and is not limited to this, and any localization information can be set.
Various information for controlling localization, for example, all or part of the localization control table in FIG. 6 may be attached to the music data and transmitted to other similar terminals via the communication unit 19 or the like. The transmitted terminal can play music with the same localization.

It is a block diagram which shows the structure of the portable terminal which is one Embodiment of the music reproduction apparatus of this invention. It is a figure which shows the structure of the whole system in which the portable terminal shown in FIG. 1 is used. It is a figure which shows the structure of the performance control part in the music reproduction apparatus of this invention. It is a block diagram which shows the structure of a sound image localization processing circuit. It is a figure which shows the example of the localization method, (A) is an example which localizes a music itself, (B) is an example which moves the localization of a phrase or a part, (C) is divided | segmented and arrange | positioned by the component part of a music (D) is a figure which shows the example which divides or couple | bonds a localization in the middle of a music. It is a figure which shows an example of a localization control table. It is a flowchart which shows the flow of the process performed by CPU11.

Explanation of symbols

  10: Music playback device, 11: Control unit (CPU), 12: Memory, 13: Music information holding unit, 14: Timer, 15: Music analysis unit, 16: Display control unit, 17: Performance control unit, 18: Operation Unit: 19: communication unit, 20: antenna, 21: display unit, 22: speaker, 23: controller, 31, 36: interface circuit, 32, 37: FIFO buffer, 33: sequencer, 34: sound source, 35: sound image Localization processing circuit, 38: decoder, 39: D / A converter, 41-44: FIR filter

Claims (5)

Storage means for storing music data including sequence data or audio data as performance information;
Playing means for playing the music data;
Sound image localization processing means for performing sound image localization processing on the basis of a control signal for the musical sound signal output from the reproduction means;
A localization control table in which the content of the music and the corresponding localization method are defined;
Analyzing means for acquiring information related to the contents of the music by directly analyzing sequence data or audio data which is performance information of the music data;
According to the localization method corresponding to the information acquired from the localization control table by the analysis means, the method of localizing the entire music, the method of moving the localization in a specific section in the music, the constituent parts of the music The sound image localization processing means obtains a localization method which is either a method of dividing and arranging the localization or a method of dividing and combining the localization in the middle of the music, and the control information for executing the localization method And a music playback device.   The music reproducing apparatus according to claim 1, wherein the localization control table defines the contents of the music and the priority of the localization method corresponding to the contents.   The music reproducing apparatus according to claim 1, wherein the analyzing unit is configured to determine the presence or absence of a specific phrase.   The music reproducing apparatus according to any one of claims 1 to 3, further comprising means for storing information relating to the contents of the music acquired by the analyzing means in association with the music data. Storage means for storing music data including sequence data or audio data as performance information, playback means for playing back the music data, and sound image localization processing based on a control signal for a musical sound signal output from the playback means A music playback program in a music playback device having sound image localization processing means to perform, and a localization control table in which the content of the music and the corresponding localization method are defined,
Information obtained by the analysis means from the localization control table, and analysis means for obtaining information relating to the contents of the music by directly analyzing sequence data or audio data which is performance information of the music data, and a computer A localization method corresponding to the above, a method of localizing the entire music, a method of moving the localization in a specific section in the music, a method of dividing and arranging the localization according to the constituent parts of the music, or in the middle of the music A music reproduction program that acquires a localization method , which is one of the methods for performing localization and division, and operates as means for sending control information for executing the localization method to the sound image localization processing means .

Images