JP2006301890A - Music management system and music management method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a music management system comprising a music registration device and a portable terminal connectable thereto and a music management method that select a group of pieces of music according to an impression and a user's preference associated with each piece of music. <P>SOLUTION: The portable terminal generates user preference data reflecting a user's preferences generated as pieces of music are reproduced, and when connected to the music registration device, transfers the generated user preference data to the music registration device. The music registration device extracts impression data based on human sensibility from each music data, and according to the impression data extracted from each music data and the user preference data sent from the portable terminal, selects pieces of music to be transferred to the portable terminal from the pieces of music recorded in the music registration device. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a music registration apparatus that stores input music data in a music database, and a portable terminal that is configured to be connectable to the music registration apparatus and that has a terminal music database to which music data stored in the music database is transferred. In particular, the present invention relates to a music management system and a music management method for selecting a group of music based on an impression level associated with each music and a user's preference level.

  In recent years, a large-capacity storage means such as an HDD has been developed, and a large amount of music data can be stored in the large-capacity storage means. Searching for a large amount of music data stored in a large-capacity storage means is generally performed using bibliographic data such as artist names, music titles, and other keywords. This is not suitable when it is not possible to take into account the emotions of a music piece and there is a possibility that a music piece with a different impression will be searched, and it is desired to search for a music piece with a similar impression when listening.

  Therefore, in order to make it possible to search for the music desired by the user based on the subjective impression of the music, the user's subjective requirements for the music desired to be searched are input, quantified and output, and the output , A predicted impression value obtained by quantifying the impression of the music to be searched is calculated, and a music database storing an acoustic value of a plurality of music and an impression value obtained by quantifying the impression of the music is calculated using the calculated predicted impression value as a key. There has been proposed an apparatus for searching for desired music based on a subjective image of a user's music by searching (for example, see Patent Document 1).

  However, in the prior art, since the impression value obtained by converting the physical characteristics of the music is searched based on the predicted impression value obtained by quantifying the input of the user's subjective requirements, the search condition is set by the user as a search condition. The input items of the subjective requirements that are input are aggregated, and there is a problem that it is not possible to implement a search for music data with high accuracy based on the subjective requirements.

On the other hand, there is a problem that the burden on the user increases in the way of thinking based on the user's memory when selecting music that meets the conditions.
JP 2002-278547 A

  The present invention has been made in view of such problems, and the object of the present invention is based on impression degree data determined by human sensibility, and further reflects the user's preference and is highly accurate. The object is to provide a music management system and a music management method with less burden.

In order to solve the above problems, the present invention has the following configurations.
The gist of the invention according to claim 1 of the present invention is that a music registration device that stores input music data and a music registration device that is connectable to the music registration device and that is selected by the music registration device at the time of connection. A music management system including a portable terminal that transfers and stores the preference data, and the portable terminal generates preference data generation means for generating user preference data that reflects a user's preference status that is generated along with a music playback operation; , And a preference data transfer means for transferring the generated user preference data to the music registration device when connected to the music registration device, and the music registration device receives a human Means for extracting impression degree data determined by sensitivity, the impression degree data extracted from each piece of music data, and user preference data transmitted from the portable terminal; Based, in music management system characterized by comprising and a music selecting means for selecting a music to be transferred to the mobile terminal from the music recorded in the music registration device.

  The gist of the invention according to claim 2 of the present invention is that the user preference data generation means includes means for counting the number of music reproduction operations in the portable terminal. It is in the music management system described.

  In addition, the gist of the invention according to claim 3 of the present invention is that the user preference data generation means counts the number of times the music is played back on the mobile terminal, and the time element based on the date or date when each playback was performed. The music management system according to claim 1, further comprising means for storing

  The gist of the invention according to claim 4 of the present invention is that the music selection means includes means for setting the user preference data as a threshold. In the music management system described in the section.

  The gist of the invention according to claim 5 of the present invention is that the music selection means includes means for performing interpolation processing according to the degree of approximation of the impression degree based on preference data generated by the mobile terminal. It exists in the music management system of any one of Claims 1 thru | or 4 characterized by the above-mentioned.

  The gist of the invention according to claim 6 of the present invention is that a music registration device that stores input music data in a music database, and the music registration device that is connectable to the music registration device and that is stored in the music database. A music management system comprising a mobile terminal having a terminal music database to which music data is transferred, wherein the music registration device includes feature data extraction means for extracting physical characteristic data from the input music data; Based on the impression degree data conversion means for converting the feature data extracted by the feature data extraction means into impression degree data determined by human sensitivity, and the impression degree data converted by the impression degree data conversion means Mapping the input music data to a music map divided into a plurality of subspaces to which coordinates are assigned, The music mapping means for creating a search table comprising the coordinates of the partial space and the music data arranged in the partial space, and the music mapping means created by the music mapping means together with the music data stored in the music database Music data transmission means for transferring a search table to the mobile terminal, and the mobile terminal stores the music data and the search table transferred from the music data transmission means of the music registration device in the terminal music database. Music data receiving means to be stored, terminal operation means for receiving an instruction input for representative song search specifying a representative song, and searching the search table based on the representative song specified by the terminal operation means to obtain a predetermined number of The music search means for specifying the music data, and searched by the music search means Voice output means for outputting recorded music data, preference data counting means for counting user preference data reflected by the user of the voice output operation, and preference data transmission means for transferring preference data to the music registration device; Furthermore, the music registration device receives preference data from the mobile terminal and stores the preference data in the music database, impression degree data and preference data associated with each music And a music selection means for selecting a certain group based on the music management system.

  According to a seventh aspect of the present invention, there is provided a music management system including a portable terminal configured to be connectable to the music registration apparatus that stores input music data, wherein the portable terminal The user preference data reflecting the user preference state generated along with the reproduction operation is generated, and when the music registration device is connected, the generated user preference data is transferred to the music registration device, and the music The registration device is configured based on the impression recorded by the human sensibility extracted from each piece of the input music data and the user preference data transmitted from the portable terminal, from the music recorded in the music registration device. In the music management method, music to be transferred to the portable terminal is selected.

  The music management system and the music management method according to the present invention provide information for searching from a portable terminal to a music registration apparatus in a music registration apparatus in a system that performs a search based on a mapped music map using impression degree data. By transferring preference data, it is possible to perform accurate music selection according to the user's preference, and it is possible to save time and effort to select a representative song without inputting or selecting a representative song again. Yes, you can achieve efficient music selection. In addition, when including preference over time in the preference data to be transferred, the music registration device can cope with changes in the user's temporal psychology such as “getting tired”, which cannot be handled only by “impression”, In addition, the degree of satisfaction can be increased, and a variety of music selections can be performed as expected by bringing time elements into the preference data.

  In addition, not only music with a history of music selection, but also music without a history on the map of music with history of music selection, the user's preference is reflected by giving and processing considerable preference data. Can select music with high accuracy.

  In addition, in a mobile terminal, since advanced processing is performed by a music registration device, it is possible to obtain accurate search preference data by simply transferring preference data that has been processed after music data transfer. Search more accurately on the terminal.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of an embodiment of a music management system according to the present invention, and FIG. 2 is a front view showing a configuration of the mobile terminal shown in FIG.
In this embodiment, referring to FIG. 1, the music registration device 10 and the portable terminal 30 are connected by a data transmission path 23 such as a USB, and the portable terminal 30 is separated from the music registration device 10 and is carried. It has a configuration that can.
The music registration apparatus 10 is an information processing apparatus that operates under program control such as a personal computer. Referring to FIG. 1, a music data input unit 11, a compression processing unit 12, a feature data extraction unit 13, and impression degree data. Conversion unit 14, music database 15, music mapping unit 16, music map storage unit 17, music search unit 18, PC operation unit 19, PC display unit 20, transmission / reception unit 21, and audio output unit 22 It consists of.

The music data input unit 11 has a function of reading a storage medium in which music data such as a CD and a DVD is stored. The music data input unit 11 inputs music data from a storage medium such as a CD and a DVD, and extracts a compression processing unit 12 and feature data. To the unit 13. You may comprise so that the music data (delivery data) via networks, such as the internet, other than storage media, such as CD and DVD, may be input. When compressed music data is input, the compressed music data is decompressed and output to the feature data extraction unit 13.
The compression processing unit 12 converts the music data input from the music data input unit 11 into MP3 or ATRAC (Adaptive Transform Acoustic) at the time of music registration.
The compressed music data is stored in the music database 15 together with bibliographic data such as artist names and music titles.

The feature data extraction unit 13 extracts feature data composed of fluctuation information from the music data input from the music data input unit 11 and outputs the extracted feature data to the impression degree data conversion unit 14.
The impression degree data conversion unit 14 converts the feature data input from the feature data extraction unit 13 into impression degree data determined by human sensitivity using a hierarchical neural network that has been learned in advance. The impression level data is output to the music mapping unit 16, and the feature data input from the feature data extraction unit 13 and the converted impression level data are associated with the music data and registered in the music database 15.

The music database 15 is a large-capacity storage unit such as an HDD, and the music data and bibliographic data compressed by the compression processing unit 12, the feature data extracted by the feature data extraction unit 13, and the impression degree data conversion unit 14. Is stored in association with the impression degree data converted by.
The music mapping unit 16 maps the music data to a music map that is an arbitrary space based on the impression data input from the impression data conversion unit 14, and the music map in which the music data is mapped is stored in the music map storage unit 17. A search table for searching for music data mapped to the music map is created and stored, and the created search table is stored in the music database 15.

The music map storage unit 17 is a large-capacity storage unit such as an HDD, and stores a music map to which music data is mapped by the music mapping unit 16.
The music search unit 18 searches the music database 15 based on the bibliographic data from the PC operation unit 19, displays the search result on the PC display unit 20, and plays music based on the representative music selected by the PC operation unit 19. The map storage unit 17 is searched, and the representative song search result is displayed on the PC display unit 20 and stored in the song database 15 as a search list.
The PC operation unit 19 is input means such as a keyboard and a mouse, and inputs search conditions for searching for music data stored in the music database 15 and the music map storage unit 17 and selects music data to be output to the portable terminal 30. Input to be made

The PC display unit 20 is a display unit such as a liquid crystal display, for example, displays the mapping status of the song data stored in the song map storage unit 17, and the song data stored in the song database 15 and the song map storage unit 17. The search conditions for searching for music, the searched music data (search results), etc. are displayed.
The transmission / reception unit 21 is configured to be connectable to the transmission / reception unit 31 of the portable terminal 30 through a data transmission path 23 such as a USB, and corresponds to the music data stored in the music database 15 and the music data. The neuron coordinates in the impression degree data and the music map, the search table, and the search list are output to the transmission / reception unit 31 of the mobile terminal 30.
The audio output unit 22 is an audio player that decompresses and reproduces music data stored in the music database 15.

  The portable terminal 30 is an audio playback device such as a portable audio having a large capacity storage means such as an HDD. Referring to FIG. 1, a transmission / reception unit 31, a terminal music database 32, a music search unit 33, and a terminal operation Unit 34, terminal display unit 35, audio output unit 36, and number counter unit 37.

The transmission / reception unit 31 is configured to be connectable to the transmission / reception unit 21 of the music registration device 10 via a data transmission path 23 such as a USB, and the music data input from the transmission / reception unit 21 of the music registration device 10 is used as the terminal music. Store in the database 32.
The terminal song database 32 is a large-capacity storage unit such as an HDD, and the song data stored in the song database 15, impression degree data corresponding to the song data, the coordinates of neurons in the song map, a search table, The search list is stored.
The music search unit 33 searches the terminal music database 32 based on the bibliographic data from the terminal operation unit 34, displays the search result on the terminal display unit 35, and based on the representative music specified by the terminal operation unit 34. The search table is searched, and the search result is displayed on the terminal display unit 35.

The terminal operation unit 34 is an input unit for performing input related to the reproduction of music data. Referring to FIG. 2, input for selecting music data to be reproduced, input for selecting a search method, input for volume control, and the like are performed. It consists of a cross key 341 and an enter key 342 for performing an input for instructing output of the selected music data, an input for instructing execution of the selected search method, and the like.
The terminal display unit 35 is a display unit such as a liquid crystal display, for example, and displays search conditions for searching for music data stored in the terminal music database 32 and displays searched music data (search results). .
The audio output unit 36 is an audio player that decompresses and reproduces music data that is compressed and stored in the terminal music database 32.

The number counter unit 37 is a means for counting the history of preferences shown to the mobile terminal 30 by the user, and is executed by a program registered in advance for a microcomputer that controls the terminal operation of the mobile terminal 30.
First, impression data used in the present embodiment will be described in detail together with a music registration operation in the music registration apparatus 10 with reference to FIGS. 3 to 7.

  FIG. 3 is a flowchart for explaining the music registration operation in the music registration device 10 shown in FIG. 1, and FIG. 4 is a flowchart for explaining the feature data extraction operation in the feature data extraction unit shown in FIG. 5 is an explanatory diagram showing an example of a hierarchical neural network used in the impression degree data conversion unit shown in FIG. 1, and FIG. 6 is an example of a music map in which the music mapping unit shown in FIG. 1 maps music data. FIG. 7 is a diagram showing an example of a search table stored in the music database shown in FIG.

A storage medium storing music data such as CD and DVD is set in the music data input section 11 and music data is input from the music data input section 11 (step A1).
The compression processing unit 12 compresses the music data input from the music data input unit 11 (step A2), and stores the compressed music data in the music database 15 together with the bibliographic data such as artist name and music name (step A3). .
The feature data extraction unit 13 extracts feature data including fluctuation information from the music data input from the music data input unit 11 (step A4).

  With reference to FIGS. 3 to 4, the feature data extraction operation in the feature data extraction unit 13 is performed when music data is input to the music data input unit 11 from a music playback device such as a CD player or a network such as the Internet (steps). B1) The music data input unit 11 downsamples the music data input to the music data input unit 11 from 44.1 kHz to 22.05 kHz for the purpose of speeding up, and the downsampled music data is a feature data extraction unit. 13 is output.

  Next, the feature data extraction unit 13 performs FFT processing for a certain frame length from a predetermined data analysis start point (30 s from the beginning of the song) of the song data, and calculates a power spectrum (step B2). ). In the present embodiment, the tempo period is extracted as the tempo of the music, which is one of the feature data, and the sampling period is set to 22 .2 assuming that the tempo period is in the range of 0.3 to 1 s. It was configured to perform 1024-point FFT processing on music data at 05 kHz. That is, the frame length for performing the FFT processing is set to 1024 / 22.05 kHz≈46 ms, which is shorter than the minimum value of the tempo cycle in the assumed music.

  Next, the feature data extraction unit 13 sets frequency bands of Low (0 to 200 Hz), Middle (200 to 600 Hz), and High (600 to 11050 Hz) in advance, and the power of the three bands of Low, Middle, and High. The spectrum is integrated, the average power is calculated (step B3), and it is determined whether or not the number of frames for which the processing operations of steps B2 to B3 have been performed has reached a predetermined set value (2048) (step B4). ) If the number of frames that have undergone the processing operations in steps B2 to B3 has not reached a predetermined set value, the data analysis start point is shifted (step B5) while the processing in steps B2 to B3 is performed. Repeat the operation. As a result, the processing operations of step B2 to step B3 are performed for a set value of a predetermined number of frames, and time series data of average power in the Low, Middle, and High3 bands can be respectively obtained. In this embodiment, the analysis time length is 60 s, the data analysis start point is shifted by 60 s * 22.05 kHz / 2048≈646 points, and FFT processing is performed to obtain time series data of 2048 points and 60 s average power. Configured to create.

  Next, the feature data extraction unit 13 performs FFT on the time series data of the average power of Low, Middle, and High calculated by the processing operations of Step B2 to Step B5, and calculates fluctuation information (Step B6). In the present embodiment, 2048-point FFT processing is performed on the time series data of the average power stored in the average power storage unit 44.

Next, the feature data extraction unit 13 calculates an approximate straight line in a graph with the horizontal axis as the logarithmic frequency and the vertical axis as the logarithmic power spectrum from the FFT analysis results at Low, Middle, and High by the least square method or the like (step B7). ), The inclination of the approximate straight line and the Y intercept of the approximate straight line are obtained (step B8), and the slope and Y intercept of the approximate straight line in each of Low, Middle, and High are extracted as feature data.
Further, the feature data extraction unit 13 calculates, as difference information, the difference between the fluctuation information calculated in Step B6 and the approximate straight line calculated by the step approximate straight line calculation unit 45 in the FFT analysis result in Low (Step B9). By analyzing the difference information calculated based on a predetermined logic, the tempo cycle is determined (step B10), the determined tempo is extracted as feature data, and approximate straight lines in each of Low, Middle, and High Are output to the impression degree data conversion unit 14 together with the inclination and the Y intercept.

Next, referring to FIG. 3, the impression degree data conversion unit 14 is a hierarchical type composed of an input layer (first layer), an intermediate layer (n-th layer), and an output layer (N-th layer) as shown in FIG. By inputting the feature data extracted by the feature data extraction unit 13 into the input layer (first layer) using a neural network, impression level data is output from the output layer (Nth layer), that is, the feature data is converted into the impression level. The data is converted into data (step A5), the impression degree data output from the output layer (Nth layer) is output to the music mapping unit 16, and the feature data input from the feature data extraction unit 13 and the output layer ( The impression degree data output from the (Nth layer) is stored in the music database 15 together with the music data. Note that the connection weight value w of each neuron in the intermediate layer (nth layer) is learned in advance by the evaluator. In the case of this embodiment, the feature data input to the input layer (first layer), that is, the feature data items extracted by the feature data extraction unit 13 are Low, Middle, High as described above. There are seven items, the slope of the approximate straight line and the Y-intercept and the tempo, and the evaluation items of the impression degree data are “bright and dark”, “clear and dark” judged by human sensitivity, Three items of “Intense and Calm” were set, and each evaluation item was set so as to be expressed by a seven-step evaluation. Accordingly, the number of neurons L ₁ in the input layer (first layer) is 7, and the number of neurons L _{N in} the output layer (Nth layer) is 3, and the intermediate layer (nth layer: n = 2). ,..., N-1) is set appropriately.

  The music mapping unit 16 maps the music data input from the music data input unit 11 to a corresponding portion of the music map stored in the music map storage unit 17 (step A6). The music map which is an arbitrary space used for the mapping operation in the music mapping unit 16 is divided into a plurality of partial spaces, and the music data is arranged in any of the plurality of partial spaces. As the music map, for example, a self-organizing map (SOM) in which neurons are regularly arranged in two dimensions (9 * 9 square in the example shown in FIG. 6) can be used. A neuron corresponds to multiple subspaces.

  In this embodiment, a two-dimensional SOM in which neurons are arranged in a square of 100 * 100 is used as a music map, and coordinates (1, 1) to (100, 100) are assigned to each neuron of the music map. The music mapping unit 16 creates a search table for searching for music data mapped to the music map, and uses the created search table as a music database. 15 and the coordinates of the neuron in which the music data is arranged are stored in the music database 15 together with the music data. The search table is for searching for the corresponding neuron and specifying the music data arranged in the searched neuron. As shown in FIG. 7, the coordinates of each neuron in the music map and each neuron It is composed of arranged music data (numbers specifying music data, etc.). In this embodiment, a two-dimensional SOM in which neurons are arranged in a square is used as the music map. However, the arrangement of neurons may be a rectangle or a honeycomb, and a three-dimensional SOM is used. You may do it.

Furthermore, in the present embodiment, the preference table includes a data set in which the number of times of reproduction of the corresponding music is added to each coordinate of the impression map, and a three-dimensional mountain with an altitude that increases according to the number of times the user has heard. Consider a model that resembles an image.
FIG. 8A is an example schematically showing a continuous preference table. The coordinates of the impression map were made to correspond to the xy plane, and the number of user preferences was taken in the z-axis direction. If this model is compared to a mountain, a certain altitude in the z-axis direction is determined, and contour lines are considered. The music corresponding to a portion higher than the reference is preferred by the user, and the higher the higher the preference, the higher the preference. By using the continuous preference table, it is possible to change the reference value in the z-axis direction as a parameter, and to select a group of music groups above and below the contour line. The continuous preference table is created by interpolation processing in the music registration device 10 based on the discrete preference table (see FIG. 8B) obtained by the mobile terminal 30. This will be described in more detail below.

8A and 8B are three-dimensional representations of the search table shown in FIG. 7 with the coordinates in the xy plane and the number of preferences in the z-axis direction. In particular, FIG. 8A corresponds to the search table after the interpolation process, and FIG. 8B corresponds to the search table before the interpolation process.
FIG. 9 is an example of a flowchart for explaining the operation when the music registration device 10 and the mobile terminal 30 shown in FIG. 1 are connected.
After receiving the user's automatic music selection execution instruction, the music registration device 10 confirms the connection with the portable terminal 30 (step G1). When the mobile terminal 30 can confirm the connection with the music registration device 10 (step G2), the user can obtain the data of the discrete preference table, which is the history data of the preference shown by the user on the mobile terminal 30, and the free capacity value of the terminal music database 32. It outputs to the transmission / reception part 21 of the music registration apparatus 10 from the transmission / reception part 31 (step G3).

The music registration device 10 stores the input discrete preference table data in the music database 15 (step G4). Further, the preference table data is interpolated with respect to each coordinate on the impression map in consideration of the Euclidean distance between neurons of the music map for a portion where there is no user preference history (step G5).
In the music registration device 10, the search table is rearranged in the order of preference evaluation values based on the interpolated continuous preference table (step G 6), and then a preference for selecting a song to be transmitted to the mobile terminal 30. The evaluation value threshold is determined in consideration of the free capacity value of the terminal music database 32 that has received the evaluation value first (step G7). When the threshold is determined, the selected music data and the continuous preference table are output from the transmission / reception unit 21 to the portable terminal 30 (step G8). In this way, based on the continuous preference table, the search table is rearranged in the order of preference evaluation values, and the preference evaluation value threshold is controlled as a parameter as a selection criterion, thereby providing a means for selecting a certain piece of music. it can.

The portable terminal 30 updates the data in the terminal music database 32 to the music data input by the transmission / reception unit 31 and the continuous preference table (step G9).
Next, the storage format of the discrete preference table for the coordinates on the impression map will be described.
FIG. 8B shows an example of a storage format of the discrete preference table for the coordinates on the impression map in the mobile terminal 30 shown in FIG.
For each coordinate on the impression map, a cumulative value of the number of times the corresponding music is played is stored. In the example of FIG. 8B, at the time of data acquisition, the cumulative value of the number of reproductions of the corresponding music is divided by date. This is to make it possible to recreate a preference table that takes into account temporal transition later.

Furthermore, by analyzing the temporal characteristics of the preference data to be transferred, the music registration device 10 and the mobile terminal 30 are not able to deal with “impression level” alone, such as “I'm tired of listening” or “Long time”. Responding to temporal psychological changes, satisfaction can be increased for each unique user. Bringing time elements into preference data has the effect of making it possible to perform a variety of music selections as expected.
A preference point counting operation in the mobile terminal 30 will be described. FIG. 10 is an example of a flowchart for explaining a preference point counting operation in the mobile terminal 30.

  The portable terminal 30 checks the user's song playback instruction (step H1), and when there is an instruction, acquires the impression MAP coordinates (x, y) of the song from the TOC information (step H2) and starts playing the song. (Step H3). While the music is being played back, it is checked whether there is a user's music interruption instruction. If there is an interruption instruction, the music reproduction is terminated. If there is no music interruption instruction at a predetermined time (step H4), the terminal music database 32 is displayed. The preference point data is read (step H5), and the preference point value for the coordinates (x, y) on the impression map corresponding to the music being reproduced is added and updated (point H6). When the reproduction of the designated music is finished, it is checked whether or not the next music is reproduced continuously (step H7). When the next music is scheduled in the playlist or the like, the process from step H2 onward is similarly performed on the next music. If there is no schedule for the next music, the music playback operation is terminated.

In the above example, the example in which the number of times that the user likes the music is added in the music playback time is shown as an example, and the present invention is not limited to this example. When a skip operation assigned to the 30 cross key 341 is instructed, there are various methods for counting the preference points, such as subtracting the preference point value, assuming that the user does not like the music. Conceivable.
Next, the details of the preference point calculation process in the mobile terminal 30 will be described. Referring to FIG. 8B, in this embodiment, the number of times that the music of each coordinate is selected is recorded for each date, and the number of times distributed by date for each coordinate is accumulated, The value is obtained and recorded in the data area for the number of preferences. By processing in this way, the amount of preference data to be transferred from the portable terminal 30 to the music registration device 10 can be reduced.

If there is no limit on the amount of preference data to be transferred, all preference data recorded for each date may be transferred. FIG. 11 is an example of a detailed flowchart of the discrete preference table interpolation processing in the music registration device 10. As an example, we showed that the algorithm is simplified and obeys the following conditions:
(1) The impression map has a resolution of x = (0 to N-1) and y = (0 to N-1).
(2) The preference point at the virtual end of the impression map is zero. That is, z (0, y) = 0 and z (x, 0) = 0.
(3) For a certain coordinate (x, y), the average of z (x, y) in the coordinate and the surrounding nine coordinates is obtained as z ′ (x, y).

Since it is a system that can apply the concept of distance between songs on the song map, it is not limited to songs with a history of selected songs, but also equivalent to songs without history in the neighborhood of songs with a selected history By assigning and processing the preference data, it is possible to perform accurate music selection in accordance with the user's preference.
Here, although the same weight is used for each coordinate, various other types of weights such as an average of z (x, y) in the coordinate and the surrounding 25 coordinates, or a different weighting for each coordinate are used. An interpolation method can be considered. Interpolation effect can be enhanced by increasing the number of samples or increasing the order, etc., but using any of them, a representative song search that the degree of impression is approximate for songs that are close to each other on the map The same effect is reflected.

In addition, the interpolation process can further enhance the interpolation effect by increasing the number of samples or increasing the order, etc., but in this embodiment such advanced processing of preference data is performed by the music registration device 10, It is only necessary to receive only the processing result of the preference data along with the data transfer, and the mobile terminal side has an effect that it can operate without impairing the battery life.
Note that, unlike the mobile terminal 30, the music registration device 10 is generally considered to have less power restrictions, so there is no particular problem.

FIG. 12 is an explanatory diagram for explaining a data configuration example of music data, a search table, and a search list in the music registration device 10 and the mobile terminal 30 shown in FIG.
In the music database 15 of the music registration device 10, as shown in FIG. 12, music data, feature data corresponding to the music data (extracted by the feature data extraction unit 13), impression degree data (impression degree data conversion unit 14). And the coordinates of neurons in the music map (mapped by the music mapping unit 16), a search table (created by the music mapping unit 16), and a search list (searched by the music search unit 18). The music data, impression degree data corresponding to the music data, the coordinates of neurons in the music map, a search table, and a search list are transferred to the terminal music database 32 of the terminal 30. The preference data is stored in the search table in association with the coordinates in both the music registration device 10 and the portable terminal 30, and in the present embodiment, the above-mentioned continuous preference table is used for music selection or music search. Is done.

  The music search operation in the music registration apparatus 10 is as follows. FIG. 13 is a flowchart for explaining a music search operation in the music registration device 10 shown in FIG. 1, and FIG. 14 is a diagram showing an example of a search condition input screen displayed on the PC display unit shown in FIG. 15 is a diagram showing an example of a condition search result display screen displayed on the PC display unit shown in FIG. 1. FIG. 16 is an example of a representative song search result display screen displayed on the PC display unit shown in FIG. 17 is a diagram showing an example of a music list display screen displayed on the PC display unit shown in FIG. 1, and FIG. 18 is a music map display displayed on the PC display unit shown in FIG. It is a figure which shows the example of a screen.

  The music search unit 18 displays a search condition input screen 51 for inputting search conditions on the PC display unit 20, and accepts user input from the PC operation unit 19. As shown in FIG. 14, the search condition input screen 51 includes a bibliographic data input area 511 for inputting bibliographic data as a search condition, a search execution button 512 for instructing execution of a search, an all-music list display button 513, It comprises a map display button 514 and an automatic music selection execution display button 515. In this embodiment, a desired method can be selected from four types of music selection methods. The user inputs bibliographic data as a search condition from the PC operation unit 19 (step F1) and clicks the search execution button 512 to instruct the music search unit 18 to search based on the bibliographic data.

Further, the music search unit 18 searches the music database 15 based on the bibliographic data input from the PC operation unit 19 (step F2), and a condition search result display screen 52 for displaying the condition search result is displayed on the PC display unit 20. Display (step F3). Referring to FIG. 15, the conditional search result display screen 52 includes a representative song selection area 521 for selecting a representative song from the condition search results, and a representative song search execution button 522 for instructing a search based on the selected representative song. And a registration button 523 for registering a condition search result as a search list.
The user selects a representative song from the search results displayed in the representative song selection area 521 (step F4), and clicks the representative song search execution button 522 to search for the song based on the representative song. To instruct. When the registration button 523 is clicked at this time, the music search unit 18 stores the condition search results displayed in the search result display area 52 in the music database 15 as a search list.

The music search unit 18 searches the music database 15 based on the selected representative music, thereby specifying the coordinates of a neuron (hereinafter referred to as a representative neuron) in which the representative music is arranged in the music map (step F5). ).
Further, the music search unit 18 sets 0 to the variable n (step F6), and by referring to the search table shown in FIG. 7 stored in the music map storage unit 17, from the representative neuron specified in step F5. The music data arranged in the neuron of the distance n is searched (step F7), and it is determined whether or not the number of searched music is greater than or equal to a predetermined search number (step F8).

If the number of songs searched in step F8 is less than the predetermined search number, the song search unit 18 increments the variable n (step F9), returns to step F7, and returns the number of songs searched. Steps F7 and F8 are repeated until is equal to or greater than the predetermined number of searches.
On the other hand, when the number of songs searched in step F8 is equal to or greater than the predetermined number of searches, the music search unit 18 narrows down the searched music data to a predetermined number of searches (step F10) A representative song search result display screen 53 for displaying the narrowed down music data as a representative song search result is displayed on the PC display unit 20 (step F11). Referring to FIG. 16, the representative song search result display screen 53 includes an output song selection area 531 for selecting song data to be output, and an output button 532 for instructing output of the selected song data.

Further, the search of the music data searched in step F10 is performed by using the feature vector of the representative neuron or the impression degree data converted by the impression data conversion unit 14 of the representative music as the input vector _xj, and the impression of the searched music data. Assuming that the degree data is the search target vector X _j , the search target vector X _j close to the input vector x _j , that is, the one having a small Euclidean distance ‖X _j −x _j ‖ is sequentially searched up to a predetermined search number. Is called.
Further, when the registration button 532 is clicked, the music search unit 18 stores the condition search results displayed in the search result display area 53 as a search list in the music database 15 (step F12).

When the music list display button 513 is clicked on the search condition input screen 51, the music search unit 18 displays a music list display screen 54 that displays a music list of all stored music data on the PC display unit 20. Display. Referring to FIG. 17, the song list display screen 54 is a representative song selection area 541 for selecting a representative song from the song list of all song data, and a representative song search execution button for instructing a search based on the selected representative song. 542.
When the user selects a representative song from the song list displayed in the representative song selection area 541 (step F4) and clicks the representative song search execution button 542, a search based on the selected representative song is performed. Instructed by the unit 18, the music search operation in steps F5 to F12 is performed.

In the present embodiment, since the music registration device 10 includes user preference data, when a representative song is selected from the song list (step F4), a song with a high preference is given priority. By doing so, the frequency with which the music that the user wants to select is displayed at an early stage can be improved, and the representative music can be selected efficiently.
When the music map display button 514 is clicked on the search condition input screen 51, the music search unit 18 causes the PC display unit 20 to display a music map display screen 55 that displays the music map neurons as points. Referring to FIG. 18, the music map display screen 55 includes a neuron selection area 551 for selecting a neuron as a search center and a map search execution button 552 for instructing a search based on the selected neuron.

When the user selects a neuron as a search center from the neurons displayed in the neuron selection area 551 and clicks the map search execution button 552, the neuron is selected instead of the representative neuron specified in step F5. A search based on the neuron selected in the region 551 is instructed to the music search unit 18, and the music search operation in steps F 6 to F 12 is performed thereafter.
In the neuron selection area 551, only the neuron where the music data is arranged is displayed, and when the cursor is moved to the neuron where the music is mapped, the music data of the music data arranged in the neuron where the cursor is located A name pop-up display 553 is performed.

When the automatic music selection execution button 515 is clicked on the search condition input screen 51, the music search unit 18 gives priority to the music with a strong user preference according to the free space of the terminal music database 32 of the mobile terminal 30. Automatically selects the best songs as long as the capacity is not exceeded.
Here, the operation of automatic music selection in the present embodiment will be described in more detail below. Referring to FIG. 8A, as a model of preference data, the coordinates of the impression map are associated with the xy plane, and the user's preference count is taken in the z-axis direction. If this model is compared to a mountain, a certain altitude in the z-axis direction is determined, and contour lines are considered. The music corresponding to a portion higher than the reference is preferred by the user, and the higher the higher the preference, the higher the preference. Since it is a system that can apply the concept of distance between songs on the song map, it is not limited to songs with a history of selected songs, but also equivalent to songs without history in the neighborhood of songs with a selected history By assigning and processing the preference data, it is possible to perform accurate music selection in accordance with the user's preference. By using the continuous preference table, it is possible to change the reference value in the z-axis direction as a parameter, and to select a group of music groups above and below the contour line.

  Simply searching with a representative song only allows local selection of music on the impression map, and only about 10 songs can be selected at a time. Therefore, when a large number of songs are selected and transferred to the portable terminal 30 that can store hundreds to thousands of songs, the user must designate a number of representative songs. Also, simply selecting a song based on the number of times of preference for music is not preferable because it would abandon the music that is potentially preferred. On the other hand, according to the present embodiment, since the user can obtain the representative song using the preference history data shown on the portable terminal 30, the labor of selecting and inputting the representative song depending on the user's memory can be saved. There is an effect that the burden on the user at the time of selection can be reduced.

  In particular, with regard to the automatic music selection operation when the automatic music selection execution button 515 is clicked, as described above, when the reference value in the z-axis direction is determined, the music group above the contour line and the music group below the contour line respectively. Since a group of groups can be selected, for example, the total number of data capacities of songs above the contour line can be calculated. Therefore, there is a method of selecting music suitable for transfer by changing the reference value in the z-axis direction as a parameter so that the total number of the data capacity is maximized within a range not exceeding the known mobile terminal 30 data free capacity. Thus, there is almost no burden on the user at the time of processing, and an efficient music selection reflecting the user's preference can be performed.

  In the music registration device 10 and the portable terminal 30, there is a scene where the music data needs to be erased due to storage capacity restrictions or the like. In other words, when passive music selection is performed, it is not of a character that can be listed based on the user's memory as in the case of representative song search. For example, it is similar to being able to shine a bright spotlight but not a dark spotlight. In the present embodiment, based on the preference data, calculation processing is performed from the relationship of the distance on the impression map, the preference evaluation values are quantified and ordered, and a certain group is selected by comparing with a predetermined reference value. As a result, it is possible to determine quickly and rationally without relying excessively on the user's memory by deleting the group whose preference evaluation value is below the reference value.

In addition, in the portable terminal 30, when it becomes necessary to delete the data in the terminal music database 32 with reference to the data of the sent continuous preference table, from the music with the low preference evaluation value of the continuous preference table. Deletion candidates should be determined or returned in order. In the conventional method of using simple preference history data as it is, the above-described potentially favorite music cannot be distinguished and is to be deleted. This operation may be performed after disconnecting from the music registration device 10.
FIG. 19 is a display example on the terminal display unit for explaining the music search operation in the mobile terminal 30.

  When the mobile terminal 30 is turned on by a power key (not shown), the music search unit 33 uses “bibliographic data search”, “search by impression degree data”, “search by search list” as a method of searching for music data to be reproduced. A search method selection screen 351 for selecting one of “search” is displayed on the terminal display unit 35, and the user selects a search method displayed on the search method selection screen 351 with the up and down keys of the cross key, and presses the enter key. Pressing 342 instructs the music search unit 33 to search for music data based on the selected search method.

  When “search by bibliographic data” is selected on the search method selection screen 351, the music search unit 33 selects a list display for selecting one of “artist”, “album”, and “title”. The screen 352 is displayed on the terminal display unit 35, and the user selects one of “artist”, “album”, and “title” displayed on the list display selection screen 352 with the up and down keys of the cross key, and the enter key 342. By pressing, the music search unit 33 is instructed to display the selected list.

  When “artist” or “album” is selected on the list display selection screen 352, the music search unit 33 searches for the artist name or album name from the bibliographic data corresponding to all music data stored in the terminal music database 32. And an artist / album list screen 353 for displaying a list of artist names or album names is displayed on the terminal display unit 35. The user selects either the artist name or album name displayed on the artist / album list screen 353 with the up / down arrow keys and presses the enter key 342 to search for music based on the artist name or album name. The music search unit 33 searches the terminal music database 32 based on the selected artist name or album name, and displays a title list of the corresponding music data on the terminal display unit 35 as a search result screen 354. To do. When “title” is selected on the list display selection screen 352, the music search unit 33 reads the titles corresponding to all the music data stored in the terminal music database 32 and searches the read title list. The result screen 354 is displayed on the terminal display unit 35.

When “Search by impression degree data” is selected on the search method selection screen 351, the music search unit 33 displays an impression degree data input screen 355 for inputting impression degree data as a search condition on the terminal display unit 35. The user selects the value of each item of the impression degree data with the up / down / left / right directions of the cross key and presses the enter key 342 to instruct the music search unit 33 to perform a search based on the impression degree data. When the search based on the impression degree data is instructed, the music search unit 33 searches the music data stored in the terminal music database 32 based on the impression degree data input as the search condition, and the searched music data The title list is displayed on the terminal display unit 35 as a search result screen 354. Music retrieval data based on the input impression data as a search condition, with the input vector x _j the input impression data as a search condition, corresponding to all music data stored in the terminal song database 32 Each impression degree data is set as a search target vector m _i (t) εR ^n, and a predetermined number is searched from the one having a smaller Euclidean distance ‖x _j −m _i ‖. Note that R indicates the number of evaluation stages of each evaluation item of impression degree data, and n indicates the number of items of impression degree data.

  In addition, in the portable terminal 30, since the preference data for search which added the process according to the distance between music on a music map can be obtained, in addition to the list display of the search result screen 354, for example, FIG. The map of the three-dimensional expression as shown in Fig. 2 is displayed, and the position of the listed music on the three-dimensional expression map is displayed in an easy-to-understand manner for the user, so that the search can be performed with higher accuracy.

  If “search by search list” is selected on the search method selection screen 351, the music search unit 33 uses the search list list 356 as a search list list stored in the terminal music database 32, and the terminal display unit 35. The user selects one of the search lists displayed on the search list list screen 356 with the up and down keys of the cross key and presses the enter key 342 to display the display of the selected search list. The music search unit 33 displays the title list of the selected search list on the terminal display unit 35 as a search result screen 354.

  When the right side of the cross key 341 is pressed while the search result screen 354 is displayed, the music search unit 33 sends the music data corresponding to the title list on which the search result screen 354 is displayed from the terminal music database 32. Sequentially read out, and the read music data is output to the audio output unit 22 for audio output. When the search result screen 354 is displayed and the left of the cross key 341 is pressed after selecting one of the titles with the up and down keys of the cross key 341, the music search unit 33 selects the selected title. Only the music data corresponding to is read from the terminal music database 32, and the read music data is output to the audio output unit 22 for audio output.

  Further, when the search result screen 354 is displayed and one of the titles is selected with the up and down keys of the cross key 341 and then the enter key 342 is pressed, the music search unit 33 selects the selected title. A representative song search as a representative song is performed, and the representative song search result is displayed on the terminal display unit 35 as a search result screen 354. The representative music search performed by the music search unit 33 is performed based on the neuron coordinates and the search table stored in the terminal music database 32, and the representative music search performed by the music search unit 18 of the music registration apparatus 10 described above. The procedure is the same as the song search.

Further, regarding the music transferred to the mobile terminal 30, for example, even if a specific music is played intensively for a certain period and is not viewed by nearby music on the impression map, the present embodiment According to the above, music in the vicinity on the impression map continues to be transferred to the mobile terminal 30 without leaking, and when a particular music becomes tired of listening at a certain time, it matches the user's preference from among the music in the vicinity You can quickly choose alternative songs. That is, it is possible to search with high accuracy without leaking a song that is potentially preferred compared to simple preference history data.
If the designated music is played, the preference point value for the coordinates (x, y) on the impression map corresponding to the music being played in the terminal music database 32 is added and updated as described above, and the music is registered. When the device 10 and the mobile terminal 30 are connected, the data is transferred as a discrete preference table.

  As described above, according to the present embodiment, in the music registration device 10, the user receives the transfer of the preference history data shown on the mobile terminal 30, and the accuracy based on the representative song search using the preference data. High music selection. Furthermore, since the user can obtain the representative song using the preference history data shown on the mobile terminal 30, it is possible to save the user from having to select and input the representative song depending on the user's memory, and to reduce the burden on the user at the time of selection. There is an effect. In addition, since it is a system that can apply the concept of distance between songs on the song map, it is not limited to songs with a history of selected songs, but also songs without history on the map of songs with a selected history. In addition, by assigning and processing considerable preference data, it is possible to select music with high accuracy in accordance with the user's preference.

  In addition, since the mobile terminal 30 can obtain the search preference data that is processed according to the distance between songs on the song map, for example, the particular song is played back intensively for a certain period and is displayed on the impression map. Even in a state in which the neighboring music is not viewed, according to this embodiment, the neighboring music on the impression map continues to be transferred to the mobile terminal 30 without leaking, and a certain music can be tired of hearing at some time. Then, it is possible to quickly select an alternative song that suits the user's preference from nearby songs. That is, it is possible to select music with high accuracy without leaking a song that is potentially preferred compared to simple preference history data.

Furthermore, by analyzing the temporal characteristics of the preference data to be transferred, the music registration device 10 and the mobile terminal 30 are not able to deal with “impression level” alone, such as “I'm tired of listening” or “Long time”. Responding to temporal psychological changes, satisfaction can be increased for each unique user. Bringing time elements into preference data has the effect of making it possible to perform a variety of music selections as expected.
In addition, the interpolation process can further enhance the interpolation effect by increasing the number of samples or increasing the order, etc., but in this embodiment such advanced processing of preference data is performed by the music registration device 10, Only the processing result of the preference data needs to be received together with the data transfer, and the mobile terminal 30 can be operated without deteriorating the battery life.

  In addition, in the music registration device 10 or the mobile terminal 30, in a scene where erasure of music data is necessary due to storage capacity restrictions, etc., calculation processing is performed based on the relationship between distances on the impression map based on preference data. Since the evaluation values are digitized and ordered, and a certain group is selected by comparing with the set reference value, it is excessively stored in the user's memory by deleting the group whose preference evaluation value is below the reference value Make decisions quickly and reasonably without reliance.

  Note that the present invention is not limited to the above-described embodiments, and it is obvious that the embodiments can be appropriately changed within the scope of the technical idea of the present invention. In addition, the number, position, shape, and the like of the constituent members are not limited to the above-described embodiment, and can be set to a suitable number, position, shape, and the like in practicing the present invention. In each figure, the same numerals are given to the same component.

It is a block diagram which shows the structure of embodiment of the music management system which concerns on this invention. It is a front view which shows the structure of the portable terminal shown in FIG. It is a flowchart for demonstrating the music registration operation | movement in the music registration apparatus shown in FIG. It is a flowchart for demonstrating the feature data extraction operation | movement in the feature data extraction part shown in FIG. It is explanatory drawing which shows the hierarchical neural network example used by the impression degree data conversion part shown in FIG. It is explanatory drawing which shows the example of a music map which a music mapping part shown in FIG. 1 maps music data. It is a figure which shows the example of a search table memorize | stored in the music database shown in FIG. It is an example of the preservation | save format of the preference table with respect to the coordinate on the impression map in the portable terminal shown in FIG. It is an example of the flowchart for demonstrating the operation | movement at the time of connecting the music registration apparatus and portable terminal which are shown in FIG. It is an example of the flowchart for demonstrating the preference point count operation | movement in the portable terminal shown in FIG. It is an example of the detailed flowchart of the interpolation process of the preference table in the music registration apparatus shown in FIG. It is explanatory drawing for demonstrating the data structural example of the music data in the music registration apparatus shown in FIG. 1, and a portable terminal, a search table, and a search list. It is a flowchart for demonstrating the music search operation | movement in the music registration apparatus shown in FIG. It is a figure which shows the example of a search condition input screen displayed on the PC display part shown in FIG. It is a figure which shows the example of a condition search result display screen displayed on the PC display part shown in FIG. It is a figure which shows the example of a representative music search result display screen displayed on the PC display part shown in FIG. It is a figure which shows the example of a music list display screen displayed on the PC display part shown in FIG. It is a figure which shows the example of a music map display screen displayed on the PC display part shown in FIG. It is a figure which shows the example of a display in the terminal display part of the portable terminal shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Music registration apparatus 11 Music data input part 12 Compression processing part 13 Feature data extraction part 14 Impression degree data conversion part 15 Music database 16 Music mapping part 17 Music map memory | storage part 18 Music search part 19 PC operation part 20 PC display part 21 Transmission / reception Unit 22 audio output unit 23 data transmission path 30 portable terminal 31 transmission / reception unit 32 terminal music database 33 music search unit 34 terminal operation unit 35 terminal display unit 36 audio output unit 37 number counter unit

Claims (7)

A music management system comprising: a music registration device that stores input music data; and a portable terminal that is configured to be connectable to the music registration device and transfers and stores music data selected by the music registration device when connected Because
The mobile terminal generates the user preference data generated when connecting the preference data generating means for generating user preference data reflecting the user's preference status generated along with the music playback operation and the music registration device. And a preference data transfer means for transferring to the music registration device,
The music registration device includes: means for extracting impression degree data determined by human sensibility from the input music data; the impression data extracted from each music data; and a user transmitted from the portable terminal A music management system comprising music selection means for selecting music to be transferred to the mobile terminal from music recorded in the music registration device based on preference data.   The music management system according to claim 1, wherein the user preference data generation means includes means for counting the number of music reproduction operations in the portable terminal.   The user preference data generation means includes means for counting the number of music reproduction operations in the portable terminal and storing a time element based on the date or date when each reproduction was performed. Item 2. The music management system according to Item 1.   The music management system according to any one of claims 1 to 3, wherein the music selection means includes means for setting the user preference data as a threshold.   The music selection means includes means for performing interpolation processing according to the degree of approximation of the impression degree based on preference data generated by the portable terminal. The music management system according to item. From a music registration device for storing input music data in a music database, and a portable terminal configured to be connectable to the music registration device and having a terminal music database to which the music data stored in the music database is transferred A music management system
The music registration device includes: feature data extraction means for extracting physical feature data from the input music data; and impression degree data for judging the feature data extracted by the feature data extraction means based on human sensitivity An impression degree data converting means for converting to music, and a music map obtained by dividing the input music data into a plurality of partial spaces to which coordinates are assigned based on the impression degree data converted to the impression degree data converting means The music mapping means for creating a search table comprising the coordinates of the partial space and the music data arranged in the partial space, and the music mapping means together with the music data stored in the music database Music data transmission means for transferring the search table created by the mobile terminal to the portable terminal.
The portable terminal includes a song data receiving unit that stores the song data and the search table transferred from the song data transmission unit of the song registration apparatus in the terminal song database, and a representative song search instruction that specifies a representative song. A terminal operating means for receiving an input; a music searching means for searching the search table based on the representative song specified by the terminal operating means to specify a predetermined number of the music data; Voice output means for outputting the music data as voice, preference data counting means for counting user preference data reflected by the user of the voice output operation, and preference data transmission means for transferring the preference data to the music registration device. And
Furthermore, the music registration device is based on preference data receiving means for receiving preference data from the mobile terminal and storing it in the music database, impression degree data associated with each song, and the preference data. A music management system comprising music selection means for selecting a certain unit. In a music management system including a portable terminal configured to be connectable with the music registration device that stores input music data,
The portable terminal generates user preference data that reflects a user's preference state generated along with a music playback operation, and the generated user preference data is stored in the music registration device when connected to the music registration device. Forward to
The music registration device is recorded in the music registration device based on impression degree data determined by human sensibility extracted from each input music data and user preference data transmitted from the mobile terminal. A music management method comprising selecting music to be transferred from a music to the portable terminal.

Images