JP4759281B2 - Information processing apparatus, information processing method, information processing program, and recording medium on which information processing program is recorded - Google Patents

Description

The present invention relates to an information processing apparatus that recognizes the tune of music data, an information processing method, an information processing program, and a recording medium on which the information processing program is recorded.

  2. Description of the Related Art Conventionally, an audio information providing apparatus that reproduces audio information such as music is known (see, for example, Patent Document 1). The audio information providing apparatus described in Patent Document 1 includes a storage unit, a feature determination unit, an impression coordinate value list acquisition unit, a playback device, and the like.

  The storage means stores information such as audio information. When the storage means stores new audio information, the feature determination unit calculates the playback time of the stored audio information, and automatically extracts musical features such as the tempo of the music, chord progression, instrument configuration, etc. in the audio information To do. And the impression coordinate value of audio information is calculated using these musical features. Here, the feature coordinate value is a coordinate value of a coordinate system representing subjective features of audio information such as “bright”, “violent”, “exhilarating”, and “sharp”. Further, the feature determination unit causes the storage means to store the feature coordinate value of the audio information and the related information indicating the reproduction time together with the audio information. The impression coordinate value list acquisition unit acquires an impression coordinate value list in which impression coordinate values suitable for the user's image are arranged in time series in order to provide continuous audio information suitable for the user's image. To do. The playback device plays back a set of audio information according to the order shown in the impression coordinate value list. As a result, the audio information that the user wants to listen to according to his / her mood is designated by a feature such as “bright”, and the audio information corresponding to the designated feature is continuously reproduced. .

JP2003-15666 (right column on page 6-left column on page 9)

  However, in the configuration as described in Patent Document 1 described above, only one musical feature is associated with audio information having a variety of features. There is a possibility that a portion different from the musical feature is included. For this reason, the problem that there is a possibility that a portion that does not match the user's mood may be reproduced is an example.

In view of the above-described problems, the present invention provides an information processing apparatus, an information processing method, an information processing program, and a recording medium on which an information processing program is recorded that can recognize the tone of music data satisfactorily. One purpose.

According to one aspect of the present invention, a data obtaining unit for obtaining music data, a characteristic of recognizing recognition means the tune of the music data, the tune is in the music data based on the melody recognized by the characteristic recognizing means Section recognition means for recognizing different parts, and section characteristic information generation means for generating section characteristic information by associating the characteristic information related to the music tone in the part of the music data with the section specifying information for specifying the position of the part. The characteristic recognition means, when the data acquisition means obtains the music data, generates music tone point information relating to the music tone point in which at least one music tone degree corresponding to the reproduction time of the music data is quantified, and the section The recognizing means is a change in which the tone point recognized by the characteristic recognizing means changes throughout the reproduction time. Wherein recognizes the location tune an information processing apparatus characterized by recognizing a different part.

The invention according to claim 11, the computing means An information processing method for generating a predetermined information about the music data, acquires the music data, recognizes the tune of the music data, on the basis of the said melody recognizes the music tone different part of the song data, the characteristic information on the tune in part of the melody data to generate segment characteristic information in association with the section identifying information for identifying the position of said part, said computing means, said music When the data is acquired, the music tone point information related to the music tone point in which at least one music tone degree corresponding to the playback time of the music data is quantified is generated, and the change position where the generated music tone point changes throughout the playback time is determined. It is an information processing method characterized by recognizing and recognizing parts having different tunes .

According to a twelfth aspect of the present invention , there is provided an information processing program that causes a computing means to function as the information processing apparatus of the present invention .

A thirteenth aspect of the present invention is an information processing program that causes an arithmetic means to execute the information processing method of the present invention .

The invention according to claim 14 is a recording medium on which an information processing program according to the present invention is recorded so that the information processing program can be read by an arithmetic means.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The present embodiment exemplifies a music playback system including a music playback device having the information processing apparatus of the present invention, the system having a configuration for recognizing the tone of music data and reproducing and outputting the music data. Explain . Their to, the following describes the interval between change position for changing the tune of the characteristics of the music data is referred to as a part. FIG. 1 is a block diagram showing a schematic configuration of a music playback system according to an embodiment of the present invention. FIG. 2 is a schematic diagram showing a schematic configuration of a playlist. FIG. 3 is a block diagram showing the internal configuration of the processing unit of the music playback device. FIG. 4 is a diagram illustrating an example of the tone of a song. FIG. 5 is a diagram illustrating an example of a playlist screen. FIG. 6 is a diagram illustrating an example of a playback screen.

[Configuration of music playback system]
In FIG. 1, reference numeral 100 denotes a music playback system. The music reproduction system 100 is a system that recognizes the tune of music data for each of a plurality of parts and appropriately reproduces the music data based on the recognized tune. The music playback system 100 includes an audio output device 200, a music playback device 300, and the like.

  The audio output device 200 includes, for example, sounding means such as a speaker (not shown). The audio output device 200 is connected to the music reproducing device 300 so that various information can be transmitted and received, and reproduces and outputs the music data transmitted from the music reproducing device 300 as sound from the sound generation means. Note that, for example, in the case where the music playback system 100 is provided in a vehicle as a moving body, the audio output device 200 includes a speaker as a sound generation means such as an instrument panel portion, a door portion, a rear dashboard portion, etc. For example, it may be configured to be respectively disposed on the left and right sides of the front part and the rear part in the space.

  The music reproducing device 300 is a vehicle-mounted type, a portable type, a PDA (Personal Digital Assistant), a mobile phone, a PHS (Personal Handyphone System), a desktop personal computer, a portable personal computer or the like mounted on a vehicle. The music reproducing device 300 recognizes the music tone of the music data in association with each part, and appropriately reproduces the music data based on the recognized music tone. The music reproducing device 300 includes an input unit 310, a touch panel 320 as a display unit, a music data storage unit 330 as a content data storage unit, a memory 340, a processing unit 350 as a calculation unit, and the like. ing.

  The input unit 310 includes various operation buttons (not shown), operation knobs, and the like that are arranged so that an input operation can be performed facing the front of the case body. And the input part 310 outputs various information to the process part 350 as an input signal by the input operation of setting matters, such as the setting of the operation content of the music reproduction apparatus 300, for example, and makes it set it. In addition, as the input unit 310, any configuration capable of setting and inputting various setting items such as an input operation using a touch panel provided on the touch panel 320 and an input operation using voice can be exemplified.

  The touch panel 320 displays a video signal transmitted as an image signal from the processing unit 350. The touch panel 320 recognizes the position touched by the user, for example, and outputs the position information to the processing unit 350. The touch panel 320 includes a display unit (not shown), a sensor unit, a signal output unit, and the like. In addition, this touch panel 320 is arrange | positioned in the front side of the dashboard which is not shown in figure, for example of the structure which provides the music reproduction system 100 in the vehicle as a moving body.

  The display unit displays a video based on the video signal output from the processing unit 350, a playlist screen 600 described later, a playback screen 700 described later, and the like. Examples of the display unit include a liquid crystal display panel, an organic EL (Electro Luminescence) panel, a PDP (Plasma Display Panel), a CRT (Cathode-Ray Tube), an FED (Field Emission Display), and an electrophoretic display panel. And the display surface of a display part is covered with the translucent member with strong intensity | strength, such as glass and a plastic, and being hard to be damaged.

  The sensor part is provided in the translucent member which covers the display surface of a display part. When the user touches the translucent member, the sensor unit detects the touched position and recognizes the coordinate position. As a configuration of the sensor unit, for example, a transparent film is covered on the translucent member, and a so-called resistive film type sensor configured by wiring an electric circuit in a gap between the translucent member and the film, Examples include, but are not limited to, a capacitance sensor that detects changes in the capacitance of the surface of the translucent member.

  The signal output unit outputs the coordinates of the contact position detected by the sensor unit to the processing unit 350 as a contact coordinate signal. The coordinates transmitted here may be coordinates relating to the absolute position of the contact position on the display unit, or may be a relative position of the contact position as viewed from the entire display unit.

  The music data storage means 330 stores the individual music data so that they can be read out appropriately. Examples of the music data storage means 330 include a configuration including a drive and a driver that are readable and stored in various recording media such as a magnetic disk such as an HD, an optical disk such as a CD and a DVD, and a memory card.

  The individual music data is information related to one music. The music individual data has a table structure in which music data as content data, music content information, and the like are configured as one data structure. Note that the music individual data may be composed only of music data. The music data is data used when the music is played back, and is recorded in a format capable of playing back music such as MIDI (Musical Instrument Digital Interface), WAVE, or MPEG (Moving Picture Experts Group). . The music content information is information relating to the music reproduced by the music data, that is, information relating to the music title, the performer, the reproduction time, the genre, and the like.

  The memory 340 relates to setting items input by the input unit 310, for example, various pieces of information acquired or generated by the processing unit 350 such as the music related information 500 as shown in FIG. Data, audio data, image data, various programs developed on an OS (Operating System) that controls the operation of the entire music reproducing device 300, and the like are stored. As the memory 340, it is desirable to use a memory having a configuration that retains memory even when the power is suddenly turned off due to a power failure, for example, a flash memory. Note that the memory 340 may be configured to include a drive, a driver, and the like that are readable and stored in a recording medium such as an HD, a DVD, or an optical disk.

  The music related information 500 is information related to the music data stored in the music data storage means 330. The music related information 500 is configured by associating at least one piece of music individual information 510 as one data structure.

  The individual music information 510 is information relating to predetermined music data stored in the music data storage means 330. The music individual information 510 is configured by associating music data specifying information 511, genre information 513, at least one part information 514 as section characteristic information, and the like as one data structure.

  The music data specifying information 511 is information for specifying predetermined music data stored in the music data storage means 330. As this music data specific information 511, the file name of the music data memorize | stored in the music data storage means 330, the information regarding a music name, etc. can be illustrated.

  The genre information 513 is information relating to the genre of music data specified by the music data specifying information 511. Here, examples of the genre include “kayokyoku”, “folk song”, “pops”, “rock”, “jazz”, “classic”, and the like.

  The part information 514 is information related to the tone and content associated with a predetermined part among a plurality of parts of the music data specified by the music data specifying information 511. This part information 514 includes part specifying information 514A as section specifying information, music tone point information 514B as characteristic information, characteristic degree information, and overall characteristic degree information, music tone information 514C as characteristic information, and keyword information 514D. The rust flag information 514E as the feature section information is associated with one data structure.

  The part specifying information 514A is information for specifying the position of a predetermined part in the music data specified by the music data specifying information 511. That is, in the part specifying information 514A, the leading edge position of the part and the trailing edge position of the part are described as the elapsed playback time from the leading edge position of the music data.

  The music tone point information 514B is information related to music tone points of a plurality of music tones corresponding to the playback time in the part specified by the part specifying information 514A. Here, the tune point is, for example, each tune element such as a chord element such as a music chord corresponding to the playback time, a tempo element such as BPM (Beat Par Minute) or time signature of the music, and a volume element such as the volume of the music. It is the point which expressed numerically. The chord is a chord played by one musical instrument or a chord composed of single notes played by a plurality of musical instruments, and examples thereof include C major (C) and C minor (Cm). . Note that the tune point information 514B includes tune points in tunes such as “bright”, “sad”, “good”, “quiet”. Also, each music tone point is set to any one of 0 to 100 points, for example, based on each standard music tone.

  The tune information 514C is information on the most representative tune and the maximum volume among the parts specified by the part specifying information 514A. Here, the representative music tone is a music tone in which the sum of the music tone points is the maximum among the sum of the music tone points in the music tone point information 514B in the part specified by the part specifying information 514A. It is described by. That is, for example, in the part specified by the part specifying information 514A, the sum of the music tone points in each music tone point information 514B is 30 points for “bright”, 0 points for “sad”, and 50 points for “good”. When “quiet” is 30 points, the typical tune in this part is “good”. The maximum volume is the volume of the part where the volume level is maximum in the part specified by the part specifying information 514A.

  The keyword information 514D is information regarding keywords in the part specified by the part specifying information 514A. Here, the keyword is, for example, a part in which the user is specified by the part specifying information 514A, such as “I love”, “Nostalgic”, “Energetic”, “Crying”, “Relax”, “Uplift”, etc. This is a word that indicates the subjective and emotional impression of the part. This keyword information 514D is described in a text format, for example.

  The rust flag information 514E is flag information indicating whether the part is a so-called rust part in the music data. Here, the chorus is the most representative and exciting subject part of the entire music, and is a part that characterizes the music data. This rust can be exemplified by, for example, a part that is repeated most frequently in a music piece or a part that has the largest number of musical instrument configurations related to the performance of the music piece. Specifically, the rust flag information 514E indicates that the part specified by the part specifying information 514A is rust if it is 1, and indicates that it is not rust if it is 0.

  The playlist is, for example, a list of at least one piece of music that is selectively associated with a user's preference, or sold or distributed as a so-called album and associated by a performer or producer. The playlist is configured by associating playlist name information, at least one registered song information, and the like as one data structure. The playlist name information is information relating to the name of a predetermined playlist. The registered song information is information in which the content of the song data specifying information 511 in the song related information 500 is described.

  The processing unit 350 is connected to various input / output ports (not shown) such as a key input port to which the input unit 310 is connected, a display port to which the touch panel 320 is connected, a music storage port to which the music data storage unit 330 is connected, and a memory 340. A memory port, a sound generation port to which the audio output device 200 is connected, and the like. As shown in FIG. 3, the processing unit 350 includes an input recognition unit 351, a data acquisition unit, a characteristic recognition unit, a characteristic recognition unit 352 that functions as a section recognition unit, and a section characteristic information generation unit. And music related information generation means 353 that functions as section keyword information generation means, reproduction processing means 354, overall characteristic degree recognition means, overall characteristic output control means, and screen generation means 355 that functions as section characteristic display control means , Clocking means 356, and the like.

  The input recognition unit 351 recognizes requests for various processes in the music playback system 100 from the input signal transmitted from the input unit 310. Further, the input recognition unit 351 acquires a contact coordinate signal output from the signal output unit of the touch panel 320, and recognizes requests for various processes in the music reproduction system 100 based on the acquired contact coordinate signal. Specifically, the input recognizing unit 351 generates, as a request for recognition, a generation request for generating the music individual information 510 of predetermined music data and a music tone setting for changing the setting of the music information 514C of the predetermined part. A request for setting a keyword for changing the setting of keyword information 514D for a predetermined part, a request for setting a genre for changing the setting of genre information 513 for predetermined music data, and a play for generating a playlist. Recognize list generation requests.

  Further, the input recognition means 351 includes a reproduction request for reproducing predetermined music data or a predetermined part of predetermined music data, a feeling play request for continuously reproducing parts of a predetermined music tone, A feeling digest play request for continuously reproducing a part having a predetermined musical tone among the parts to be recognized is recognized.

  Further, the input recognizing means 351 selects a music tone skip request for reproducing any part before or after the part currently being played back, and a part having the same tone as the rear end part of the music data currently being played back. A bookmark request for playing back the song data to play the song data at the tip, a stop request to stop playing the specified song data, a display request to display the given playlist, etc. Recognize

  The characteristic recognizing unit 352 acquires predetermined music data stored in the music data storage unit 330. Specifically, when the generation recognizing request for generating the music individual information 510 of the predetermined music data is recognized by the input recognizing means 351, the characteristic recognizing means 352 is the music for which the music individual information 510 is generated. Data is recognized from the music data storage means 330. And about the recognized music data, the information for specifying music data and the information regarding the genre of music data are recognized. That is, the characteristic recognizing means 352 recognizes information for specifying music data such as a music name from the music content information corresponding to the predetermined music data recorded in the music data storage means 330, and the genre of the music data Recognize information about.

  And the characteristic recognition means 352 recognizes at least one music tone of the acquired music data. Specifically, when the characteristic recognizing means 352 recognizes music data for which the individual music information 510 is to be generated, at least one corresponding to the reproduction time of the music from the predetermined music data recorded in the music data storage means 330. Recognize one tone. Then, the data related to various musical tones serving as the reference stored in the memory 340 is recognized. Further, by comparing the tune of the recognized music data with various tunes serving as a reference, for example, the tune point of the music data as shown in FIG. 4 is recognized. That is, the tone points for “bright” and “sad” as shown in FIGS. 4A and 4B are recognized from chord elements such as chords and chord progressions. As a method of recognizing the tone point from the chord element of the music, a method of recognizing a chord by appropriately performing a calculation based on a reference waveform corresponding to each frequency of 12 scales and a digitized waveform of the music However, it is not limited to this. Also, the tune points for “good” and “quiet” as shown in FIG. 4C and FIG. 4D are tempo elements such as BPM and time signature of the music, and the volume of the music. Recognize from the volume element. As a method for recognizing the BPM of this song, for example, a method of differentiating the volume envelope obtained from the waveform of the song and recognizing the BPM from the interval between positions where the differentiated value is equal to or greater than the threshold can be exemplified. Not limited.

  Further, the characteristic recognizing means 352 recognizes the part of the music data based on the music tone point of the recognized music data. Specifically, when the characteristic recognizing means 352 recognizes the tone point of each tone as shown in, for example, FIG. recognize. Further, based on the time counted by the time measuring means 356 described later, the music tone change position is recognized as the elapsed playback time from the leading end of the music data. Then, a section between the change positions of any of the music tones is recognized as a part, and the leading end position of the predetermined part and the rear end position of the part are recognized. That is, for example, when the characteristic recognizing means 352 recognizes a part from the tone point of each tone as shown in FIG. Recognize from the key points of the sad melody shown in). The region II, the region III, and the region IV are recognized from the tone points of the bright tone shown in FIG. The region V is recognized from the tune point of any tune shown in FIG.

  Furthermore, the characteristic recognizing means 352 recognizes the most representative music tone and maximum volume among the predetermined parts. Specifically, when the characteristic recognizing means 352 recognizes at least one part of the music data, the characteristic recognizing means 352 calculates the total sum of the music tone points of each music tone in the predetermined part, and corresponds to the music tone point at which the total value becomes the maximum. Recognize that the tune is the most representative tune in a given part. Then, for all recognized parts, the representative tone of each part is recognized. That is, for example, in the predetermined part, the characteristic recognizing means 352 has 30 points for the sum of the tone points for the “bright” tone, 0 points for the sum of the tone points for the “sad” tone, and the tone point for the “good” tone. When the total sum of the music is 50 points and the sum of the music points of the “quiet” music tone is 30 points, it is recognized that the representative music tone in this part is “good”. Further, the characteristic recognizing means 352 recognizes the maximum sound volume in each part.

  Further, the characteristic recognizing means 352 recognizes whether or not a predetermined part is chorus among at least one part of the music data. Specifically, when recognizing at least one part of the music data, the characteristic recognizing means 352 recognizes parts that are similar to each other based on the music tone points recognized in each part. Then, for example, it is recognized that the most frequently repeated part in the music is a part characterizing the music data, that is, a part that becomes a chorus.

  The music related information generating unit 353 generates at least one part information 514. Specifically, when the characteristic recognizing unit 352 recognizes the position of a predetermined part of the music data, the music related information generating unit 353 generates part specifying information 514A describing the position of this part. Then, the music tone point information 514B describing the music tone points for at least one music tone of the music data recognized by the characteristic recognizing means 352 is generated. Further, tune information 514C is generated based on the typical tune recognized by the characteristic recognition means 352. Further, based on the music tone setting request to change the setting of the music tone information 514C of the predetermined part recognized by the input recognition unit 351, the music tone information 514C is generated.

  Further, the music related information generation unit 353 generates the keyword information 514D based on the keyword setting request recognized by the input recognition unit 351. Further, when the characteristic recognizing means 352 recognizes that the predetermined part is a rust part, it generates rust flag information 514E incorporating flag information “1” indicating that the part is a rust part. To do. On the other hand, when the characteristic recognizing unit 352 recognizes that the predetermined part is not a chorus part, it generates chorus flag information 514E incorporating flag information “0” indicating that the part is not a chorus part. Then, the music related information generating means 353 includes part information 514A, music tone point information 514B, music tone information 514C, keyword information 514D, and chorus flag information 514E associated with each other as one data structure. Is generated.

  Then, the music related information generating unit 353 generates the music related information 500. Specifically, when the music-related information generating unit 353 generates at least one part information 514 for predetermined music data that is a target of the generation request of the music individual information 510, the music data recognized by the characteristic recognizing unit 352 is used. The music data identification information 511 is generated based on the information for identifying the music data. Also, genre information 513 is generated based on information related to the genre of the music data recognized by the characteristic recognition means 352. The music related information generating unit 353 generates music individual information 510 configured by associating music data specifying information 511, genre information 513, at least one part information 514, and the like as one data structure. Further, the music related information generation unit 353 incorporates the newly generated music individual information 510 into the music related information 500, that is, generates music related information 500 and stores it in the memory 340.

  Furthermore, the music related information generation unit 353 generates a playlist. Specifically, the music related information generation unit 353 generates playlist name information based on the playlist generation request recognized by the input recognition unit 351, and based on the music data specifying information 511 in the music related information 500. To generate at least one registered music piece information. Then, a playlist is generated by associating playlist name information, at least one registered song information, and the like as one data structure. Then, the generated playlist is stored in the memory 340.

  The reproduction processing unit 354 functions when reproducing music data. The reproduction processing unit 354 includes a keyword content search unit, a different characteristic section recognition unit, a rear end characteristic recognition unit, a content end search unit, a reproduction target recognition unit 354A that functions as a specific content search unit, and a reproduction control unit 354B. And.

  When the input recognition unit 351 recognizes a reproduction request to reproduce the predetermined music data or the predetermined part of the predetermined music data, the reproduction target recognition unit 354A recognizes the content data to be reproduced or the predetermined content data. Recognize specific parts of Specifically, the reproduction target recognition unit 354A is stored in the memory 340 when the input recognition unit 351 recognizes a reproduction request for reproducing predetermined music data or a predetermined part of the predetermined music data. Based on the part information 514 in the music related information 500, predetermined music data, music data of a predetermined genre, predetermined parts of predetermined music data, parts of a predetermined music tone, parts corresponding to predetermined keywords, etc. Search for. Then, a predetermined part of the predetermined music data and the predetermined music data is recognized as a reproduction target.

  Further, when the input recognition unit 351 recognizes a feeling play request, the reproduction target recognition unit 354A recognizes a part having a predetermined musical tone as a reproduction target. Specifically, when the input recognition unit 351 recognizes the feeling play request, the reproduction target recognition unit 354A stores the music data having a part associated with the music tone information 514C of a specific music tone as the music data storage unit 330. Search from. That is, the music individual information 510 associated with the music tone information 514 </ b> C including the specific music tone is searched from the music individual information 510 incorporated in the music related information 500. Then, all the parts including the searched specific music tone are recognized as reproduction targets.

  Further, when the feeling recognition play request is recognized by the input recognizing unit 351, the reproduction target recognizing unit 354A recognizes a part having a predetermined tune tone as a reproduction target among the parts that become chorus. In other words, when the input recognition unit 351 recognizes the feeling digest play request, the reproduction target recognition unit 354A stores the music data including the chorus part associated with the music tone information 514C of a specific music tone as music data storage means. Search from 330. That is, the part information 514 corresponding to the part in which the flag of the chorus flag information 514E is set to “1” is searched from the music individual information 510 incorporated in the music related information 500, and further, the part that becomes the searched chorus The part information 514 associated with the tune information 514C including the specific tune is searched. Then, all of the parts having a predetermined musical tone among the searched parts to be rusted are recognized as reproduction targets.

  Further, when the input recognition unit 351 recognizes the music tone skip request, the reproduction target recognition unit 354A recognizes any part before or after the part currently being reproduced as a reproduction target. Specifically, when the input recognition unit 351 recognizes a tune step request to play the part preceding the part currently being played back, the playback target recognition unit 354A recognizes the part before the part currently being played back. The part identification information 514A corresponding to is recognized, and this part is recognized as a reproduction target. In addition, when the input recognition unit 351 recognizes a tune step request to reproduce the part after the part currently being reproduced, the reproduction target recognition unit 354A corresponds to the part after the part currently being reproduced. The part identification information 514A is recognized, and this part is recognized as a reproduction target.

  Further, when the input recognition unit 351 recognizes the reproduction request by the input recognition unit 351, the reproduction target recognition unit 354A reproduces the representative musical tone that is substantially the same as the representative musical tone in the rear end part of the currently reproduced musical piece data. The music data held in the top part of the data is recognized as the next reproduction target. Specifically, when the input recognition unit 351 recognizes a shiritori reproduction request, the reproduction target recognition unit 354A recognizes the tune information 514C associated with the rear end part of the currently reproduced music data. Then, the music individual information 510 corresponding to the music data substantially the same as the representative music tone of the rear end part recognized by the representative music tone of the music tone information 514C associated with the leading part is randomly selected from the music related information 500. Search for. Furthermore, the retrieved music data is recognized as a target to be reproduced immediately after the reproduction of the currently reproduced music data is completed. Note that the reproduction target recognition unit 354A continues to recognize the next reproduction target until the input recognition unit 351 recognizes the stop request.

  The reproduction control unit 354B controls the reproduction target recognized by the reproduction target recognition unit 354A so that it can be reproduced. Specifically, in the reproduction control unit 354B, the input recognition unit 351 recognizes the request to reproduce the music data, and the reproduction target recognition unit 354A further determines the predetermined music data or the predetermined part to be reproduced. When recognized, the music data corresponding to the reproduction object recognized by the reproduction object recognition means 354A or a predetermined part is reproduced. That is, the reproduction control unit 354B causes the music data storage unit 330 to read out music data or a predetermined part corresponding to the reproduction target recognized by the reproduction target recognition unit 354A. Then, the music data or the predetermined part read by the music data storage unit 330 is appropriately processed, and the processed music data or the predetermined part is output to the audio output device 200. When the input recognition unit 351 recognizes a stop request, the playback control unit 354B causes the music data storage unit 330 to stop reading the music data or the predetermined part, and causes the audio output device 200 to store the music data or the predetermined data. Stop part output.

  In addition, the reproduction control unit 354B recognizes the reproduction target recognition unit 354A when the reproduction target recognition unit 354A recognizes a part having a predetermined musical tone as the reproduction target based on the feeling play request recognized by the input recognition unit 351. The music data parts corresponding to all the reproduction targets are continuously reproduced. Then, the reproduced music data is output to the audio output device 200. Note that the reproduction control unit 354B repeatedly reproduces all reproduction objects continuously until the input recognition unit 351 recognizes a stop request.

  Then, based on the feeling digest play request recognized by the input recognition unit 351, the reproduction control unit 354B recognizes a part having a predetermined tune tone as a reproduction target among the parts to be reproduced by the reproduction target recognition unit 354A. Part of music data corresponding to all reproduction objects recognized by the reproduction object recognition means 354A is continuously reproduced. Then, the reproduced music data is output to the audio output device 200. Note that the reproduction control unit 354B repeatedly reproduces all reproduction objects continuously until the input recognition unit 351 recognizes a stop request.

  Further, the reproduction control unit 354B, based on the music tone skip request recognized by the input recognition unit 351, recognizes that the reproduction target recognition unit 354A recognizes any part before or after the part currently being reproduced as a reproduction target. The reproduction of the part corresponding to the reproduction object recognized by the reproduction object recognition means 354A is started instead of the inside part. That is, when the reproduction target recognition unit 354A recognizes the part preceding the part currently being reproduced as a reproduction target, the part preceding the part currently being reproduced is determined based on the part specifying information 514A recognized by the reproduction target recognition unit 354A. Playback is started and output to the audio output device 200. On the other hand, when the reproduction target recognition unit 354A recognizes the part after the part currently being reproduced as a reproduction target, the part after the part currently being reproduced is determined based on the part specifying information 514A recognized by the reproduction target recognition unit 354A. Playback is started and output to the audio output device 200.

  Further, the reproduction control unit 354B, after the reproduction target recognition unit 354A recognizes the next reproduction target based on the shiritori reproduction request recognized by the input recognition unit 351, after the reproduction of the currently reproduced music data is completed. The next reproduction target recognized by the reproduction target recognition unit 354A is reproduced. Specifically, the reproduction control means 354B is currently reproducing predetermined music data, and the reproduction target recognition means 354A is a representative music that is substantially the same as the representative music tone of the rear part in the music data currently being reproduced. The music data having the music tone at the front end of the music data is recognized as the next reproduction target. Then, when the reproduction of the music data being reproduced is finished, the reproduction control unit 354B starts reproduction of the music data to be reproduced next recognized by the reproduction target recognition unit 354A. The reproduction control unit 354B continuously repeats this process until the input recognition unit 351 recognizes a stop request.

  When the input recognition unit 351 recognizes a predetermined playlist display request, the screen generation unit 355 displays the requested predetermined playlist. Specifically, the screen generation unit 355 specifies a playlist to be displayed from the playlist stored in the memory 340 based on a predetermined playlist display request recognized by the input recognition unit 351. The music data specifying information 511 corresponding to the registered music information associated with the playlist name information of the specified playlist is searched from the music related information 500 and recognized. Further, based on each of the at least one music tone point information 514B associated with the recognized music data specifying information 511, the overall music tone points as the overall characteristic degree information for each piece of music data corresponding to the recognized music data specifying information 511 Recognize

  That is, the screen generation unit 355 recognizes at least one piece of music tone point information 514B associated with the predetermined piece of music data specifying information 511 among the recognized piece of music data specifying information 511. Then, from the recognized music tone point information 514B, a music tone point for a brighter music tone, a music tone point for a sad music tone, a music tone point for a good music tone, and a music tone point for a quiet music tone are recognized. Further, the respective music tone points recognized in all the parts of the predetermined music data are added for each music tone point to recognize the four overall music tone points corresponding to the four types of music tone. Then, for each piece of music data registered in the playlist, four overall tone points are recognized for each piece of music data. Furthermore, the four overall tone points recognized for each piece of music data are included in, for example, a playlist screen 600 as shown in FIG.

  Here, the playlist screen 600 will be described with reference to FIG. The playlist screen 600 is a screen that displays a list of song names of the song data registered in the playlist, four overall tone points, and the like. The playlist screen 600 includes a playlist name area 610, a music tone point item area 620, an individual music information area 630, and the like. Note that the playlist screen 600 can also be applied when searching for a part having a predetermined tune, searching for a part including a predetermined keyword, searching for music data of a predetermined genre, and the like.

  The playlist name area 610 is an area provided in the upper part of the screen, and the playlist name is displayed based on the playlist name information recognized by the screen generating means 355. The music tone point item area 620 is a plurality of rectangular areas arranged in parallel along the screen row direction in the center of the screen, and displays the music title name of each music tone. The music tone point item area 620 includes a bright area 621, a sad area 622, a smooth area 623, and a quiet area 624. The bright area 621 is a display area for the overall tone point of a bright tone. The sad area 622 is a display area for the whole music tone point of the sad music tone. The area 623 with a good twist is a display area for the whole tone point of a song with a good twist. The quiet area 624 is a display area for the entire music tone point of a quiet music tone.

  The individual music information area 630 is a long rectangular area extending along the screen row direction in the center of the screen, and is provided in parallel in the screen row direction by the number of music data registered in the specified playlist. It is done. In the individual music information area 630, various pieces of information of each music data registered in the playlist are displayed. The individual music information area 630 includes a music title area 631, a bright music tone point area 632, a sad music tone point area 633, a good music tone point area 634, and a quiet music tone point area 635. They are arranged in a line along the row direction.

  The song title area 631 is arranged on the left side of the individual song information area 630 in the screen row direction, and displays the title name of each song data registered in the playlist based on the song data specifying information 511. The bright music tone point area 632 is provided at a position corresponding to the bright area 621, and the overall music tone points of the bright music tone are displayed based on the music tone point information 514B associated with the music data specifying information 511. The sad music tone point area 633 is provided at a position corresponding to the sad area 622, and the overall music tone points of the sad music tone are displayed based on the music tone point information 514B associated with the music data specifying information 511. The melody point area 634 having a good flare is provided at a position corresponding to the area 623 having a good flare, and based on the tune point information 514B associated with the music data specifying information 511, the overall tune point of the tune having a good flare is displayed. The The quiet music tone point area 635 is provided at a position corresponding to the quiet area 624, and based on the music tone point information 514 </ b> B associated with the music data specifying information 511, the overall music tone point with a good music tone is displayed. The bright tone point area 632, the sad tone point area 633, the good tone point area 634, and the quiet tone point area 635 display numerical values corresponding to the overall tone points of each tone. In this state, a long rectangle whose long side corresponds to the entire music tone point is displayed.

  In addition, when the input recognition unit 351 recognizes a reproduction request for predetermined music data, the screen generation unit 355 controls part information associated with a predetermined part in the predetermined music data being reproduced under the control of the reproduction control unit 354B. 514 is output on the touch panel 320. Then, the reproduction position information related to the reproduction position of the music data is displayed on the touch panel 320 in an output form corresponding to the music tone of the music tone information 514C associated with the part including the playback position. That is, the screen generation unit 355 generates, for example, a reproduction screen 700 as shown in FIG.

  Here, the reproduction screen 700 will be described with reference to FIG. The playback screen 700 is a screen displayed when playing back predetermined music data, and also functions as a setting screen for setting various information of a predetermined part being played back. The reproduction screen 700 includes a first reproduction music display area 710, a second reproduction music display area 720, a current reproduction position area 725, a setting area 730, and a music tone skip area 740. Note that the playback screen 700 is also used during playback by a feeling play request, playback by a feeling digest play request, playback by a shiritori playback request, and the like.

  The first reproduction music display area 710 is an area provided at the upper part of the screen, and displays various information about the music data being reproduced. The first reproduction music display area 710 includes a title area 711, a music tone area 712, and a reproduction time area 713. The title area 711 is an area provided on the left side of the upper part of the screen, and displays the title name of the music data being played based on the music data specifying information 511. The music tone area 712 is an area provided in parallel with the title area 711 on the left side of the upper part of the screen, and a representative music tone of the part being reproduced is displayed based on the music tone information 514C. The reproduction time area 713 is an area provided on the right side of the upper part of the screen, and displays the current reproduction time based on the time information measured by the time measuring means 356 described later.

  The second reproduction music display area 720 is a long rectangular area that is provided substantially in the center of the screen and has a long length extending in the screen row direction. The second playback music display area 720 is displayed in a time table in which various pieces of information about the music data being played are arranged in order of playback time. In the second reproduction music display area 720, a title area 721, a music tone area 722, a keyword area 723 as section position information, and a genre area 724 are provided.

  The title area 721 is a long rectangular area provided in the upper part of the second reproduction music display area 720, and the title name of the music data being reproduced is displayed based on the music data specifying information 511. The music tone area 722 is a long rectangular area provided in parallel below the title area 721. Based on the music tone information 514C, the representative music tones in a plurality of parts of the music data are arranged in the order of playback time. Displayed side by side. The keyword area 723 is an elongated rectangular area provided in parallel below the music tone area 722, and the keywords in a plurality of parts of the music data are displayed in order of reproduction time based on the keyword information 514D. Is done. The genre area 724 is a long rectangular area provided in parallel below the keyword area 723, and the genre of the music data being reproduced is displayed based on the genre information 513.

  The current playback position area 725 is an area that is provided above the second playback music display area 720 and has an arrow formed on one end side of a substantially rectangular frame. The current playback position area 725 is a display showing the current playback position. Based on the time information timed by the time measuring unit 356 described later, the current playback position area 725 is associated with the playback time of the music data from the end of the music data. It is displayed in a state of moving in the direction toward the part. The current playback position area 725 is displayed in a form indicating a part in which a representative music tone of the part currently being played in the music tone area 722 and a keyword of the part currently being played in the keyword area 723 are displayed. . Further, in the substantially rectangular frame of the current playback position area 725, the maximum volume is displayed based on the music tone information 514C, and the current playback time is based on the time information measured by the clock means 356 described later. Is displayed.

  The setting area 730 is an area of a substantially long rectangular shape provided on the lower side of the screen and having a long length extending in the screen row direction. The setting area 730 includes a music tone setting area 731, a keyword setting area 732, and a genre setting area 733. Note that when the user selects, that is, touches, a part corresponding to any display in the setting area 730 on the display surface of the touch panel 320, a contact coordinate signal is output from the signal output unit of the touch panel 320 to the input recognition unit 351. The Further, the input recognition unit 351 recognizes a setting request for setting various information of a predetermined part being reproduced based on the contact coordinate signal.

  The music tone setting area 731 is a long rectangular area provided in the upper part of the setting area 730, and is a display for setting a representative music tone of the currently reproduced part to a predetermined music tone. In the music tone setting area 731, a plurality of music tones are displayed. When the user touches any display on the display surface of the touch panel 320, the input recognition unit 351 has the music tone information 514 </ b> C of a predetermined part being reproduced. Recognizes the music tone setting request to change the setting. Based on the music tone setting request, the music related information generating unit 353 changes the music tone information 514C of a predetermined part, and the screen generating unit 355 changes the display of the music tone region 712 and the music tone region 722.

  The keyword setting area 732 is a long rectangular area provided approximately in the middle of the setting area 730, and is a display for setting a predetermined keyword in association with the part of the music data currently being reproduced. In the keyword setting area 732, a plurality of keywords are displayed. When the user touches any display on the display surface of the touch panel 320, the input recognizing unit 351 causes the keyword information of a predetermined part being reproduced. A keyword setting request for setting 514D is recognized. Then, based on the keyword setting request, the music related information generating unit 353 generates keyword information 514D of a predetermined part, and the screen generating unit 355 changes the display of the keyword area 723.

  The genre setting area 733 is a long rectangular area provided in the lower part of the setting area 730, and is a display for changing the genre of the music data currently being reproduced. In the genre setting area 733, a plurality of types of genres are displayed. When the user touches any display on the display surface of the touch panel 320, the input recognition unit 351 causes the genre information of the music data being reproduced. The genre setting request to change the setting of 513 is recognized. Based on the genre setting request, the music related information generating unit 353 generates genre information 513 of predetermined music data, and the screen generating unit 355 changes the display of the genre area 724.

  The music tone skip area 740 is provided on the lower side of the screen, and includes a music tone advance button 741 and a music tone pre-return button 742. The music tone advance button 741 is a display for reproducing the part after the part currently being reproduced. The music tone pre-return button 742 is a display for reproducing the part before the part currently being reproduced. Then, when the user touches the display of either the music tone advance button 741 or the music tone pre-return button 742 on the display surface of the touch panel 320, the input recognition unit 351 reproduces any part before or after the part currently being reproduced. Recognize the request to skip the tune.

  The time measuring means 356 measures time based on a reference pulse such as an internal clock, for example, and generates time information regarding the time measured.

[Operation of music data recording / playback system]
Next, the operation of the music playback system 100 will be described as appropriate based on the drawings.

(Music individual information generation process)
First, as an operation of the music playback system 100, content recording processing will be described with reference to FIG. FIG. 7 is a flowchart showing the operation of the music individual information generation process.

  When generation of the music individual information 510 of predetermined music data is requested by an input operation from the user in a state where the music reproduction system 100 is on and waiting for input from the user, input recognition is performed. The means 351 recognizes the generation request for the music individual information 510 of the predetermined music data based on the input signal transmitted from the input unit 310. Then, the characteristic recognizing means 352 acquires predetermined music data based on the request for the process of generating the music individual information 510 recognized by the input recognizing means 351 (step S101). Further, by recognizing the tune of the acquired music data and comparing the recognized tune with the reference tune, for example, a tune point of the music data as shown in FIG. 4 is recognized (step S102). Further, the characteristic recognizing means 352 recognizes a plurality of parts based on the recognized music tone points (step S103), and recognizes the number N of the parts (step S104). Then, it recognizes that the identification number K for identifying the predetermined part is 1 (K = 1), that is, recognizes that the part information 514 is generated for the leading part in the predetermined music data (step S105).

  Thereafter, the music-related information generating unit 353 generates part specifying information 514A for the tip part based on the time information generated by the time measuring unit 356 (step S106). Further, the music related information generating means 353 generates music tone point information 514B based on the music tone points in this part recognized by the characteristic recognition means 352 (step S107), and generates music tone information 514C (step S107). S108).

  Thereafter, the input recognition unit 351 recognizes whether or not a keyword setting request has been made (step S109). When the keyword setting request is recognized by the input recognition unit 351, the music related information generation unit 353 generates the keyword information 514D based on the recognized keyword setting request (step S110). Further, the characteristic recognizing means 352 recognizes whether or not the currently recognized part is rust (step S111). On the other hand, in step S109, when the input recognition unit 351 recognizes that no keyword setting request has been made, the characteristic recognition unit 352 performs the process of step S111.

  In step S111, if the characteristic recognition unit 352 recognizes that the currently recognized part is chorus, the music related information generation unit 353 includes the chorus flag information in which the flag information set to “1” is incorporated. 514E is generated (step S112). On the other hand, in step S111, when the characteristic recognition unit 352 recognizes that the currently recognized part is not rust, the music related information generation unit 353 includes the climax flag information 514E in which the flag information set to “0” is incorporated. Is generated (step S113). Then, the music related information generating means 353 includes part information 514A, music tone point information 514B, music tone information 514C, keyword information 514D, and chorus flag information 514E associated with each other as one data structure. Is generated.

  Thereafter, the music tone recognizing means determines whether or not the identification number K is equal to the number of parts N (step S114). It is recognized that the addition (K = K + 1) processing, that is, generation of the part information 514 of the next part is generated (step S115). Thereafter, the music related information generating unit 353 performs the process of step S106.

  On the other hand, when it is recognized in step S114 that the identification number K is equal to the number of parts N by the music tone recognition means, that is, when it is recognized that the part information 514 has been generated for all parts of the predetermined music data, The information generation unit 353 generates the music individual information 510 (step S116). In other words, music data specifying information 511 and genre information 513 are generated, and music data specifying information 511, genre information 513, at least one part information 514, and the like are associated with each other as one data structure. Individual information 510 is generated. Further, the music related information generating unit 353 incorporates the newly generated music individual information 510 into the music related information 500.

(Playlist display processing)
Next, as an operation of the music reproduction system 100, a playlist display process will be described with reference to FIG. FIG. 8 is a flowchart showing the operation of the playlist display process.

  In a state where the music playback system 100 is on and waiting for input from the user, when the display of a predetermined playlist is requested by an input operation from the user, the input recognizing unit 351 includes the input unit 310. Based on the input signal transmitted from, a display request for a predetermined playlist is recognized. Then, the screen generation unit 355 identifies a playlist to be displayed from the playlists stored in the memory 340 based on the playlist display request recognized by the input recognition unit 351 (step S201). The registered music number M, which is the number of music data registered in the play list, is recognized (step S202). Thereafter, the screen generation unit 355 displays, for example, the playlist screen 600 shown in FIG. 5 on the touch panel 320 (step S203). That is, a bright area 621, a sad area 622, a good area 623, and a quiet area 624 in the playlist name area 610 and the music tone point item area 620 are displayed.

  Furthermore, the screen generation means 355 recognizes the identification number P for identifying the music individual information 510 of the predetermined music data to be displayed on the playlist as 1 (P = 1), that is, registered in the specified playlist. The music individual information 510 of the first music data is recognized (step S204). Then, the screen generation means 355 displays the song name of the first song in the song title area 631 in the individual song information area 630 (step S205). Then, the bright music tone point area 632 displays the bright music tone point of the first music, that is, the overall music tone points for the bright music tone (step S206). Further, the sad point of the first music, that is, the total music point for the sad music is displayed in the sad music point area 633 (step S207). Further, the overall tone point for the point where the first song has a good score, that is, a song tone with a good score is displayed in the tone point area 634 where the score is good (step S208). Further, the quiet music tone point area 635 displays the overall music tone points for the quiet music key, that is, the quiet music tone (step S209).

  Then, the screen generating means 355 determines whether or not the identification number P is equal to the registered music number M (step S210). 1 is added (P = P + 1), that is, the music individual information 510 of the second music data registered in the specified playlist is recognized (step S211). Thereafter, the screen generation unit 355 performs the process of step S205. On the other hand, if it is recognized in step S210 that the identification number P is equal to the number of registered songs M by the music tone recognition means, the process is terminated.

(Reproduction processing)
Next, as an operation of the music playback system 100, music data playback processing will be described with reference to FIG. FIG. 9 is a flowchart showing the operation of the music data reproduction process.

  In a state where the music playback system 100 is on and waiting for an input from the user, when the playback of predetermined music data is requested by an input operation from the user, the input recognizing unit 351 causes the input unit 310 to input. Based on the input signal transmitted from the, a reproduction request for predetermined music data is recognized. The reproduction target recognition unit 354A recognizes the reproduction target, that is, recognizes the individual music information 510 corresponding to the music data to be reproduced based on the reproduction request recognized by the input recognition unit 351 (step S301). ).

  Then, when the reproduction target is recognized by the reproduction target recognition unit 354A, the screen generation unit 355 generates, for example, a reproduction screen 700 shown in FIG. 6 based on the music individual information 510 recognized by the reproduction target recognition unit 354A. It is displayed on the touch panel 320 (step S302). Further, the reproduction control means 354B reproduces predetermined music data based on the music individual information 510 recognized by the reproduction object recognition means 354A (step S303).

  During the reproduction of the music data, the screen generation means 355 displays the music tone of the part currently being reproduced in the music tone area 712 on the playback screen 700 in conjunction with the playback time, and displays the current playback time in the playback time area 713. . Further, the current playback position area 725 is displayed in a state of moving in the direction from the front end to the rear end of the music data in association with the playback time. Further, the maximum playback volume and the current playback time are displayed in the current playback position area 725.

  Then, during playback, the input recognition unit 351 recognizes whether or not a music tone skip request has been made (step S304). That is, when the user touches the display of either the music tone advance button 741 or the music tone pre-return button 742 on the display surface of the touch panel 320, the input recognition unit 351 reproduces any part before or after the part currently being reproduced. Recognize the request to skip the tune. When the input recognizing unit 351 recognizes that the music tone skip request has been made, the reproduction control unit 354B reproduces the next part or the previous part, that is, reproduces any part before or after the part currently being reproduced. (Step S305).

  Thereafter, during playback, the input recognition unit 351 recognizes whether or not a music tone setting request has been made (step S306). That is, when the user touches any display in the music tone setting area 731 displayed on the display surface of the touch panel 320, the input recognizing unit 351 changes the music tone information 514C of the predetermined part being reproduced. Recognize the setting request. On the other hand, in step S304, when the input recognition unit 351 recognizes that the music tone skip request is not made, the process of step S306 is performed. In step S306, if the input recognizing unit 351 recognizes that a music tone setting request has been made, the music tone is set (step S307). That is, based on the music tone setting request recognized by the input recognition unit 351, the music related information generation unit 353 changes the music tone information 514C of a predetermined part, and the screen generation unit 355 stores the music tone area 712 and the music tone area 722. Change the display.

  Thereafter, the input recognizing means 351 recognizes whether or not a keyword setting request has been made (step S308). That is, for example, when the touch panel 320 is a touch panel type, when the user touches any display in the keyword setting area 732 displayed on the display surface of the touch panel 320, the input recognition unit 351 causes the predetermined recognition during reproduction. A keyword setting request for setting the keyword information 514D of the part is recognized. On the other hand, in step S306, when the input recognition unit 351 recognizes that the music tone setting request is not made, the process of step S308 is performed.

  In step S308, if the input recognition unit 351 recognizes that a keyword setting request has been made, the keyword is set (step S309). That is, the music related information generation unit 353 changes the keyword information 514D corresponding to the part currently being reproduced based on the setting request, and at the same time, the screen generation unit 355 requests to display the keyword area 723 on the reproduction screen 700. Change based on. Then, the input recognition unit 351 recognizes whether or not a stop request has been made by an input operation from the user (step S310). On the other hand, in step S308, when the input recognition unit 351 recognizes that the music tone setting request has not been made, the process of step S310 is performed.

  In step S310, when the input recognizing unit 351 recognizes that a stop request has been made, the reproduction control unit 354B stops reproduction. On the other hand, if it is recognized in step S310 that the input recognition unit 351 has not made a stop request, the process of step S304 is performed.

(Feeling play process)
Next, as an operation of the music playback system 100, a feeling play process will be described. In a state where the music playback system 100 is on and waiting for input from the user, a feeling play is requested by an input operation from the user, and the input recognition unit 351 recognizes the feeling play request. When the input recognition unit 351 recognizes the feeling play request, the reproduction target recognition unit 354A recognizes a part having a predetermined musical tone as a reproduction target. Then, the reproduction control means 354B continuously reproduces all reproduction objects recognized by the reproduction object recognition means 354A. At this time, as described in the music data reproduction process shown in FIG. 9, the screen generation unit 355, for example, based on the music individual information 510 recognized by the reproduction target recognition unit 354A, for example, the reproduction screen 700 shown in FIG. Is displayed on the touch panel 320. Thereafter, when the input recognition unit 351 recognizes a stop request, the playback control unit 354B stops playback.

(Feeling digest play process)
Next, as an operation of the music playback system 100, a feeling digest play process will be described. In a state where the music playback system 100 is on and waiting for input from the user, a feeling digest play is requested by an input operation from the user, and the input recognition unit 351 recognizes the feeling digest play request. When the input recognition unit 351 recognizes the feeling digest play request, the reproduction target recognition unit 354A recognizes a part having a predetermined tune tone as a reproduction target among the parts to be rusted. Then, the reproduction control means 354B continuously reproduces the music data parts corresponding to all reproduction objects recognized by the reproduction object recognition means 354A. At this time, as described in the music data reproduction process shown in FIG. 9, the screen generation unit 355, for example, based on the music individual information 510 recognized by the reproduction target recognition unit 354A, for example, the reproduction screen 700 shown in FIG. Is displayed on the touch panel 320. Thereafter, when the input recognition unit 351 recognizes a stop request, the playback control unit 354B stops playback.

(Shiritori playback process)
Next, shiritori reproduction processing as the operation of the music reproduction system 100 will be described with reference to FIG. FIG. 10 is a flowchart showing the operation of the shiritori reproduction process.

  When the music playback system 100 is in a state of waiting for input from the user while the power is on, when the shiritori playback is requested by an input operation from the user and the input recognition means 351 recognizes the shiritori playback request, the playback target recognition means 354A recognizes the reproduction target (step S401). That is, the reproduction target recognition unit 354A, for example, randomly recognizes any piece of music data among a plurality of pieces of music data stored in the music data storage unit 330 as a reproduction target, and sets the reproduction target music data as the reproduction target music data. The corresponding music individual information 510 is recognized. Then, the reproduction control unit 354B reproduces the reproduction target recognized by the reproduction target recognition unit 354A, and outputs the music data reproduced from the audio output device 200 (step S402). At this time, the screen generation means 355 displays, for example, a reproduction screen 700 shown in FIG. 6 on the touch panel 320 based on the music individual information 510 recognized by the reproduction object recognition means 354A.

  During reproduction, the reproduction target recognition unit 354A recognizes the tune in the final part of the music data currently being reproduced based on the tune information 514C in the individual music information 510 (step S403). Then, the reproduction target recognizing unit 354A searches for music data having the same musical tone as the leading part of the music (step S404). That is, the reproduction target recognition unit 354A, based on the music tone information 514C in the music individual information 510, among the plurality of music data stored in the music data storage unit 330, The music data having the same musical tone as that of the final part is searched. Then, the reproduction target recognition unit 354A recognizes the next reproduction target, that is, recognizes any music data among the searched music data as a reproduction target at random, and the music corresponding to the music data to be reproduced. The individual information 510 is recognized. (Step S405).

  Thereafter, the input recognition unit 351 recognizes whether or not a stop request for stopping the reproduction of the music data has been made (step S406). When the stop request is recognized by the input recognition unit 351, the playback control unit 354B stops the shiritori playback. On the other hand, in step S406, when the input recognition unit 351 recognizes that the stop request is not made, the reproduction control unit 354B performs the process of step S402, that is, the next recognized by the reproduction target recognition unit 354A. Play the song data to be played.

[Effects of music playback system]
As described above, in the above embodiment, the music reproduction system 100 recognizes the tune of the music data recorded in the music data storage means 330 and recognizes the part of the music data based on this tune. And music related information generating means 353 for generating part information 514 by associating the music tone point information 514B and the music tone information 514C relating to the music tone in a predetermined part of the music data with the part specifying information 514A for specifying the position of the part, Yes. For this reason, it is possible to divide music data having various musical tunes into a plurality of parts and recognize the tunes for each part. Therefore, the music reproducing device 300 can recognize the music tone of the music data satisfactorily. For example, the music tone imaged by the user in the music data reproduced by designating the music tone that the user wants to listen to is provided. It is possible to prevent different parts from being included.

  And the characteristic recognition means 352 recognizes the change position where the music tone point of one music tone changes greatly throughout the whole music, for example, if it recognizes the music tone point of each music tone as shown in FIG. Then, the section between the change positions of any of the music tones is recognized as a part. For this reason, the part recognized by the characteristic recognizing means 352 is based on the changing position where the tone of music changes greatly, so that the difference between the parts in one piece of music data can be clarified. Therefore, an accurate search can be performed when searching for a part of a predetermined music tone among a plurality of music data stored in the music data storage means 330. The characteristic recognizing means 352 recognizes the change position of the tune based on the elapsed time from the leading end of the music data based on the time measured by the time measuring means 356, and the music related information generating means 353 recognizes the recognized change. The part specifying information 514A is generated based on the position. For this reason, it is possible to realize data processing with a simple configuration in which parts of music data are specified by time, and the efficiency of data processing can be improved.

  Further, when the characteristic recognizing means 352 recognizes at least one music tone of the music data, it recognizes data relating to various music tones that are stored in the memory 340 as a reference. Then, the music tone point of the music data is recognized by comparing the music tone of the recognized music data with the standard music tone. The music related information generation unit 353 generates music tone point information 514 </ b> B related to the music tone point for at least one music tone of the music data recognized by the characteristic recognition unit 352. Then, part information 514 configured by associating the part specifying information 514A and the music tone point information 514B as one data structure is generated. For this reason, since various tunes of music data are managed as tune points, various information processing based on the tune points can be realized, and applications of the music playback device 300 can be expanded. Furthermore, by managing each part and the music tone point in each part in association with each other, it is possible to simplify and improve the efficiency of information processing.

  Then, the screen generation unit 355 recognizes all the music tone points of the music data having at least one part based on the plurality of music tone point information 514B associated with the music data specifying information 511. Then, the music tone points in all parts of the music data are added for each music tone, and the overall music tone points of a plurality of music tones included in one music are recognized. Then, the recognized whole music tone points are included in a playlist screen 600 as shown in FIG. For this reason, it is not only possible to recognize what kind of tone is included in one piece of music data, but it is possible to visually grasp how much each tone is included. Therefore, the search efficiency when searching for desired music data can be improved, and the convenience for the user can be improved.

  In addition, the music related information generating unit 353 describes the representative tone of the setting requested when the input recognizing unit 351 recognizes the tone setting information for changing the setting of the tone information 514C of the predetermined part. Musical tone information 514C is generated, and part information 514 configured by associating part specifying information 514A and musical tone information 514C as one data structure is generated. For this reason, for example, when the user is listening to a predetermined part of predetermined music data, the typical music tone automatically recognized by the characteristic recognition means 352 and the music tone of the currently listening part are inconsistent. The user can change the setting of the representative tune of the currently listening part based on the tune of the currently listening part. Therefore, the typical tune of a predetermined part can be brought closer to the user's sensibility, and an accurate search can be realized even when searching for music data to be reproduced later by tune.

  Then, the reproduction control unit 354B generates the predetermined music data or the predetermined part based on the part information 514 based on the reproduction request for reproducing the predetermined music data or the predetermined part recognized by the input recognition unit 351. Let it play. For this reason, when music data is searched for and played back, for example, various playbacks can be realized such as searching and playing back by narrowing down conditions using a specific music tone, a specific keyword, a specific genre, and the like. Therefore, it is possible to realize reproduction of suitable music data that matches the user's mood.

  Further, when the input recognition unit 351 recognizes a reproduction request for predetermined music data, the screen generation unit 355 displays a reproduction screen 700 shown in FIG. For this reason, for example, when listening to predetermined music data, it is possible to visually recognize the tone of the currently reproduced part. In addition, by displaying in a state corresponding to the tone point of the currently playing part, various visual effects corresponding to the tone of the currently playing part can be realized. Therefore, the user can enjoy the music data currently being listened to both visually and auditorily.

  Then, the screen generation means 355 displays music tone information 514C associated with the part of the music data being played under the control of the playback control means 354B. In addition, a music tone setting area 731 for setting a typical music tone of a currently reproduced part to a predetermined music tone is displayed on the reproduction screen 700. Then, when the user touches any display in the music tone setting area 731 displayed on the display surface of the touch panel 320, the input recognizing unit 351 sets the music tone information 514C of the predetermined part being reproduced. Recognize setting requests. Then, the music related information generation unit 353 changes the music tone information 514C obtained by changing the music tone of the part being reproduced to a predetermined music tone based on the music tone setting input signal recognized by the input recognition unit 351 to the part specifying information 514A. The part information 514 is generated in association with each other. For this reason, when setting to change the representative tune of a predetermined part during reproduction of a predetermined part in the predetermined music data, the tune setting area 731 is displayed on the display surface of the touch panel 320, and this tune setting area When the user touches the display about one of the tunes in 731, the representative tune of the part being played is changed. Therefore, since the user can easily set the representative tone of the predetermined part on the screen of the touch panel 320 while listening to the predetermined part and watching the playback screen 700, the convenience of the user can be improved.

  Further, when the predetermined music data is being played under the control of the playback control means 354B, the screen generating means 355 displays the music tone information 514C associated with a plurality of parts of the predetermined music data on the playback screen 700. A music tone area 722 arranged in the order of playback time is displayed. At the same time, the current playback position area 725 is displayed in a state where the current playback position area 725 is moved in the direction from the front end to the rear end of the music data in correspondence with the playback time of the music data. For this reason, since the display showing the representative tune of each part is displayed side by side in the order of playback time, and the part currently being played back is indicated by the current playback position area 725, the part currently being played out of a plurality of parts. It is possible to easily grasp the representative tunes of the visual. In addition, when the user sets to change the representative tune of the part being played, by selecting any tune in the tune setting area 731 displayed on the same screen as the current playback position area 725, The typical tune of the part being played is changed. Therefore, since the user can surely understand which part is currently being reproduced, the user can set the part to be set without mistake when changing the representative tune.

  The music data storage means 330 stores a plurality of music data. The music related information generation unit 353 generates the keyword information 514D based on the keyword setting request recognized by the input recognition unit 351. Then, the reproduction target recognizing unit 354A plays music data having a part in which the predetermined keyword is set based on a request for searching for music data corresponding to the predetermined keyword recognized by the input recognizing unit 351. Search from the data storage means 330. Further, the reproduction control unit 354B reproduces a part in which a predetermined keyword is set in the music data searched by the reproduction target recognition unit 354A. For this reason, a keyword that is a subjective image of the user can be set in a predetermined part of predetermined music data in addition to the music tone automatically recognized by the characteristic recognition unit 352. Then, the user searches for a part associated with the “nostalgic” keyword, for example, among the parts in the plurality of music data stored in the music data storage means 330, and the user of various music data is nostalgic. Only the part you want can be played. Therefore, reproduction of music data that matches the user's preference can be realized.

  In addition, the screen generating means 355 includes a keyword setting area 732 for setting a predetermined keyword in association with the part of the currently reproduced music data, together with the second reproduced music display area 720 indicating the predetermined part currently being reproduced. Display. Further, when the user touches any display in the keyword setting area 732 displayed on the display surface of the touch panel 320, the input recognizing unit 351 sets the keyword information 514D of the predetermined part being reproduced. Recognize the setting request. Then, based on the keyword setting input signal recognized by the input recognition unit 351, the music related information generation unit 353 associates the keyword information 514D related to the predetermined keyword with the part specifying information 514A corresponding to the part being reproduced. Part information 514 is generated. For this reason, when setting a keyword of a part during playback of a predetermined part in predetermined music data, the keyword setting area 732 is displayed on the display surface of the touch panel 320, and any keyword in the keyword setting area 732 is displayed. When the user touches the display for, the keyword of the part being reproduced is set. Therefore, the user can easily set the keyword in the predetermined part on the screen of the touch panel 320 while listening to the predetermined part and watching the reproduction screen 700, so that the convenience of the user can be improved.

  Then, the screen generation means 355 displays the current playback position area 725 relating to the playback position of the music data on the playback screen 700 during the playback of the predetermined music data. In the substantially rectangular frame of the current playback position area 725, the maximum volume is displayed based on the tune information 514C, and the current playback time measured by the clock means 356 is displayed. For this reason, the user can visually grasp in advance how the maximum volume of the currently reproduced part is set. Then, for example, by appropriately adjusting the volume level of the speaker and the volume level currently being listened to by the user, an unexpected volume when the user views the maximum volume of the part being played back. You can prevent problems such as being surprised. Further, for example, in the case where the music playback system 100 is provided in a moving body such as a vehicle, when the driver views the part of the part being played that has the maximum volume, the driver is surprised by the unexpected volume and starts driving. Problems such as troubles can be prevented in advance. Further, it is possible to visually grasp which part of the music data currently being played back on the playback screen 700 and which time the current playback position is from the leading end of the music data are at a time. Therefore, when the user views the playback screen 700, the current playback status can be easily grasped, and convenience is improved.

  Further, when the input recognition unit 351 recognizes the music tone skip request, the reproduction target recognition unit 354A recognizes any part before or after the part currently being reproduced as a reproduction target. Then, when the reproduction target recognition unit 354A recognizes any part before or after the part currently being reproduced as a reproduction target, the reproduction control unit 354B changes to the part currently being reproduced and reproduces the reproduction recognized by the reproduction target recognition unit 354A. Start playing the part corresponding to the target. For this reason, when the user feels that the tune of the part of the music data currently being viewed does not suit his / her mood, for example, the user selects the tune key forward button 741 or the tune key previous return button 742 displayed on the playback screen 700. Thus, the parts before and after the part currently being reproduced can be reproduced. Therefore, it is possible to realize a playback method that skips playback in the tone of music data.

Furthermore, the music related information 500 includes music individual information 510 corresponding to a plurality of music data stored in the music data storage means 330. When the input recognition unit 351 recognizes the shiritori reproduction request, the reproduction target recognition unit 354A recognizes the tune information 514C associated with the rear end part of the currently reproduced music data. Then, the music individual information 510 corresponding to the music data substantially the same as the representative characteristic of the rear end part recognized by the representative characteristic of the music tone information 514C associated with the leading part is randomly selected from the music related information 500. Search for. Further, the retrieved music data is recognized as the next reproduction target to be reproduced immediately after the reproduction of the currently reproduced music data is completed. Then, when the reproduction of the music data being reproduced is finished, the reproduction control unit 354B starts reproduction of the music data to be reproduced next recognized by the reproduction target recognition unit 354A.
For this reason, for example, when a user listens to predetermined music data by requesting shiritori reproduction and the typical music tone at the rear end of the music data is, for example, “bright” music, the music to be reproduced next Since the data starts with a bright tone, you can enjoy listening to music data that you have heard many times. In addition, shiritori reproduction is continuously reproduced in a relay manner with the music tone at the leading end and rear end of the music data, so that reproduction of music data rich in change can be realized.

The music related information 500 includes music individual information 510 corresponding to a plurality of music data stored in the music data storage means 330. Then, when the input recognition unit 351 recognizes the feeling play request, the reproduction target recognition unit 354A includes music tone information 514C including a specific music tone from the music individual information 510 incorporated in the music related information 500. All the associated music individual information 510 is searched. Further, all the parts including the searched specific music tone are recognized as reproduction targets. Then, when the reproduction target recognizing unit 354A recognizes a part having a predetermined musical tone as a reproduction target, the reproduction control unit 354B continuously selects music data parts corresponding to all the reproduction targets recognized by the reproduction target recognition unit 354A. Reproduce.
For this reason, for example, when a user makes a feeling play request in a “quiet” tune, only a quiet part of a plurality of pieces of music data stored in the music data storage unit 330 is continuously reproduced. Reproduction that matches the mood of the user. Therefore, it is possible to prevent the music data reproduced by designating the music tone that the user wants to listen to from including a portion different from the music tone imagined by the user.

Further, the characteristic recognizing means 352 recognizes a chorus part among a plurality of parts of the music data. Then, the music related information generating unit 353 generates rust flag information 514E indicating whether or not the predetermined part is rust. Further, when the input recognition unit 351 recognizes the feeling digest play request, the reproduction target recognition unit 354A stores the music data including the chorus part associated with the music tone information 514C of a specific music tone as music data storage means. Search from 330. Then, all of the parts having a predetermined musical tone among the searched parts to be rusted are recognized as reproduction targets. Further, when the reproduction target recognition unit 354A recognizes the reproduction target, the reproduction control unit 354B continuously reproduces the music data parts corresponding to all the reproduction targets recognized by the reproduction target recognition unit 354A.
For this reason, for example, when a user makes a feeling digest play request with a “good sound” music tone, only a part with a good score is selected from the parts that become rust of a plurality of music data stored in the music data storage unit 330. Since it is continuously played back, playback that matches the user's mood can be realized. Therefore, since the part that is the climax that the user wants to listen to and becomes the most exciting in the music data is continuously played, the music data can be fully enjoyed.

  Further, the characteristic recognizing means 352 recognizes the tune of the music data as the content data, and recognizes a section having a different tune in the music data based on the recognized tune as a part. For this reason, compared to recognizing the characteristics of content data having a large data capacity such as image data, the music tone of the music data having a relatively small data capacity is recognized, so that a lot of time is spent on the process of recognizing the music tone. Can be prevented.

  Since the processing unit 350 is configured as a program using, for example, a CPU (Central Processing Unit) or the like, by installing the program, it is possible to easily obtain a configuration capable of recognizing the characteristics of the content data and use it. Enlargement is easy. Furthermore, by recording the program on a recording medium and allowing the processing unit 350, that is, the computer to read the program, it is possible to obtain a configuration in which the characteristics of the content data can be recognized well, and the program can be easily handled and used. Can be easily expanded. The calculation means in the present invention is not limited to a single computer, but a configuration in which a plurality of computers are combined in a network, an element such as a CPU or a microcomputer as described above, or a circuit on which a plurality of electronic components are mounted. Also includes substrates.

  The music related information 500 includes music individual information 510 corresponding to a plurality of music data stored in the music data storage means 330. When the input recognition unit 351 recognizes a reproduction request for reproducing music data having a part having a predetermined characteristic, the reproduction target recognition unit 354A recognizes a music having a part having a predetermined characteristic from the music related information 500. The music individual information 510 corresponding to the data is searched. For this reason, the user searches, for example, a “bright” tone part among the parts of the plurality of song data stored in the song data storage means 330, and reproduces only the bright tone part of various song data. can do. Therefore, it is possible to realize reproduction of music data that matches the user's mood.

  In the playlist screen 600, the individual music information area 630 is provided in parallel in the screen row direction by the number of pieces of music data registered in the specified playlist. The bright music tone point area 632, the sad music tone point area 633, the good music tone point area 634, and the quiet music tone point area 635 in the individual music information area 630 are the bright area 621 in the music tone point item area 620. The sad region 622, the smooth region 623, and the quiet region 624 are provided at corresponding positions. For this reason, in the playlist screen 600, since the overall music tone points in each music tone of each music data are displayed in an easily comparable state, the user can grasp the difference in music tone in each music data at a glance. it can.

  Furthermore, a plurality of types of genres are displayed in the genre setting area 733 on the playback screen 700. When the user touches any display on the display surface of the touch panel 320, the input recognition unit 351 causes the input recognition unit 351 to be playing back. The genre setting request for changing the genre information 513 of the music data is recognized. Based on the genre setting request, the music related information generating unit 353 generates genre information 513 of predetermined music data, and the screen generating unit 355 changes the display of the genre area 724. For this reason, for example, when the genre of the music data recognized by the characteristic recognizing means 352 is incorrect, or the genre of the music data recognized by the characteristic recognizing means 352 is set to a genre imaged by the user. In some cases, the user can arbitrarily set the genre of the music data, so the convenience can be improved.

  In addition, when the predetermined music data is being played under the control of the playback control means 354B, the screen generating means 355 has a keyword in a state corresponding to the positions of a plurality of parts of the predetermined music data being played on the playback screen 700. A region 723 is displayed. At the same time, the current playback position area 725 is displayed in a state where the current playback position area 725 is moved in the direction from the front end to the rear end of the music data in correspondence with the playback time of the music data. For this reason, since the display showing each part is displayed side by side in the order of the playback time, and the part currently being played back is indicated by the current playback position area 725, the part currently being played back among the plurality of parts can be easily visually confirmed. Can be caught. In addition, when the user sets a keyword for the part being played back, the user selects a keyword in the keyword setting area 732 displayed on the same screen as the current playback position area 725, so that the keyword for the part being played back is selected. Is set. Therefore, since the user can surely understand which part is currently being reproduced, the user can set the part to be set without making a mistake when setting the keyword.

  The current playback position area 725 is provided above the second playback music display area 720. Further, the current playback position area 725 moves in a direction from the front end to the rear end of the music data in correspondence with the playback time of the music data based on the time information timed by the clock means 356 described later. Is displayed. Further, in the substantially rectangular frame of the current reproduction position area 725, the current reproduction time measured by the time measuring means 356 is displayed. For this reason, it is possible to easily recognize which part of the entire music is the part currently being reproduced. Further, since the current playback position and the current playback time are displayed at substantially the same location, the current playback position and the current playback time can be recognized at a glance, and it is not necessary to move the line of sight at the time of confirmation.

  Furthermore, for example, in the case of a configuration in which the music playback system 100 is provided on a moving body such as a vehicle, it is not necessary for the driver to operate by hand if he / she requests playback while driving, so he is distracted during the operation. Such problems can be prevented, and continuous shiretori reproduction can be enjoyed. Further, for example, if a feeling play of a predetermined music tone is requested during driving, the driver does not need to operate by hand, and a part of a predetermined music tone in various music data can be enjoyed. At this time, for example, if a feeling play of “bright” music tone is requested, the driver feels bright and can perform good driving, and thus the effect of assisting the driver mentally can be realized. In addition, for example, if a feeling digest play of a predetermined music tone is requested during driving, the driver does not have to operate by hand, and it is possible to enjoy rusting of a predetermined music tone of various music data.

[Modification of Embodiment]
In addition, this invention is not limited to embodiment mentioned above, The deformation | transformation shown below is included in the range which can achieve the objective of this invention.

  In the present embodiment, the tune to be recognized by the characteristic recognition unit 352 is exemplified by a chord element, a tempo element, a volume element, and the like, but is not limited thereto. It can be set as the structure which recognizes a music element. In the case of such a configuration, it is possible to search for and reproduce, for example, a “many piano” part in the music data. The tunes recognized by the characteristic recognizing means 352 include four types of tunes of “bright”, “dark”, “good” and “quiet”. ”,“ Slow ”,“ Mysterious ”,“ Sound is loud ”,“ Sound is small ”,“ Heavy ”,“ Light ”,“ Intense ”,“ Song ”, etc. The music player 300 can perform various types of information processing as the number of tunes to be recognized increases.

  The characteristic recognizing means 352 recognizes a change position where the tone point of any tone in each tone changes greatly throughout the whole song, and sets a section between the change positions of any tone as a part. Although it was recognized, it is not limited to this. That is, for example, the characteristic recognizing unit 352 may recognize a change position of one tune and recognize a section between the change positions of one tune as a part. In the case of such a configuration, since the number of tunes to be recognized is one, the configuration can be simplified and information processing can be speeded up. Further, for example, the characteristic recognizing means 352 may be configured to recognize, as one part, a portion where the music tone point of a predetermined music tone exceeds a threshold value. In the case of such a configuration, since a portion of the tune to be recognized that exceeds the threshold value, that is, a portion having a remarkable characteristic is recognized as a part, for example, a “particularly bright” part or the like can be searched.

  Furthermore, the part identifying information 514 </ b> A generated by the music-related information generating unit 353 after the part is automatically recognized by the characteristic recognizing unit 352 may be changed by an operation input. For example, the part specifying information 514A is changed by moving the end of each part indicated by the music tone area 722 in the reproduction screen 700 by an operation input. Further, the configuration may be such that the part-to-part boundary shown in the music tone area 722 is deleted by operation input, or a new part is added by operation input. In such a configuration, for example, when the user requests to change the position of the part because the part recognized by the characteristic recognition unit 352 is not accurate, the position of the part can be set accurately. Therefore, accurate part setting can be realized.

  Moreover, although the characteristic recognition means 352 was set as the structure which recognizes a some music tone, it is not restricted to this. That is, for example, by recognizing only one melody from music data and ranking the melody points in several stages, for example, “bright part”, “slightly bright part”, “very bright part”, etc. It is good also as a structure which searches a part. Further, as shown in FIG. 4 and the like, it is assumed that there are a plurality of parts recognized by the characteristic recognition unit 352, but the present invention is not limited to this. That is, when the music data is a monotone music, only one part is recognized for one music data. Even in this case, the characteristic recognizing means 352 can recognize a plurality of tunes in one part.

  The characteristic recognizing means 352 recognizes the music tone point for at least one music tone of the music data recorded in the music data storage means 330, and for example, the music tone point is set from 0 to 100 points, but this is not restrictive. That is, the characteristic recognizing means 352 may be configured to recognize the music tone point as 0 to 10 points or a level over several stages. In such a configuration, the number of music tone points recognized by the characteristic recognizing means 352 can be reduced, so that information processing is simplified.

  In the present embodiment, the touch panel 320 is used as a means for displaying a video signal transmitted as an image signal from the processing unit 350. However, the touch panel 320 may not be used. In such a configuration, for example, a video signal transmitted as an image signal from the processing unit 350 may be displayed on a liquid crystal display panel or the like, and various configurations can be reduced in the entire music playback device 300. Manufacturing cost can be reduced.

  The screen generation unit 355 is configured to display the playlist screen 600 as shown in FIG. 5, but may be configured not to display the playlist screen 600. In such a configuration, the processing load on the processing unit 350 can be reduced, so that the processing speed can be improved.

  When the screen generating unit 355 displays the playlist screen 600 as shown in FIG. 5, all of the music data having a plurality of parts, respectively, based on the plurality of music tone point information 514 </ b> B associated with the music data specifying information 511. Recognize the melody point. And although it was set as the structure which adds the music tone point in all the parts of music data for every music tone, and recognizes the whole music tone point of the some music tone contained in one music, it is not restricted to this. That is, for example, the characteristic recognizing means 352 adds the tune points in all parts of the music data for each tune, and recognizes the overall tune points of a plurality of tunes included in one piece of music data. Further, an average music tone point is recognized as an absolute value obtained by dividing the overall music tone points of the plurality of music tones divided by the total playback time of the music data, and the average music tone points are recognized in the individual music information area 630 of the playlist screen 600. Each may be configured to display. In the case of such a configuration, when a plurality of music data is displayed on the playlist screen 600, the average music tone point as an absolute value is displayed in the individual music information area 630, so that it depends on the difference in the reproduction time of each music data. A significant difference in the overall music tone points can be eliminated. Further, the user can easily compare a plurality of music data.

  When the input recognition unit 351 recognizes a display request for a predetermined playlist, the screen generation unit 355 displays a playlist screen 600 as shown in FIG. 5 on the touch panel 320, for example. It is not limited to. That is, the screen generation means 355 may display a playlist screen 600A as shown in FIG. 11, for example, based on the whole music tone points. 11, the playlist screen 600A is obtained by changing the configuration of the music tone point item area 620 and the individual music information area 630 in the playlist screen 600 shown in FIG. The music tone point item area 620 includes an overall music tone area 625 and an overall keyword area 626, in addition to a bright area 621, a sad area 622, an area with a good twist 623, and a quiet area 624.

  “Overall melody” is displayed in the overall tune region 625, and “Overall keyword” is displayed in the overall keyword region 626. The individual music information area 630 includes an overall music tone area in addition to a music title area 631, a bright music tone point area 632, a sad music tone point area 633, a good music tone point area 634, and a quiet music tone point area 635. 636 and an entire keyword area 637. In the bright music tone point area 632, for example, several levels of bright faces are displayed based on the overall music tone points of the bright music tone. In the sad tune point area 633, for example, several stages of sad faces are displayed based on the overall tune point of the sad tune. In the melody point area 634 having a good flare, for example, a state in which several people run based on the overall tune point having a good flute is displayed. In the quiet music tone point area 635, for example, a state where several people are stationary is displayed based on the overall music tone point of the quiet music tone. The overall music tone area 636 displays, for example, the overall music tone in which the maximum music tone among the overall music tone points of the plurality of music tones in the predetermined music data is recognized as the representative music tone of the music data by the characteristic recognizing means 352. The In the entire keyword area 637, for example, among the keywords set in the plurality of parts of the predetermined music data by the characteristic recognizing means 352, a keyword having a high frequency of occurrence is recognized as a representative keyword of the music data. Keywords etc. are displayed.

  In the case of such a configuration, the music tone of each piece of music data is displayed as an animation, so that the user can visually understand the tone of the music data and can easily understand it. Also, since the overall music tone and overall keywords are displayed, it is possible to understand what the overall music data is. In addition, the display based on the whole music tone point of each music tone is not limited to the long rectangular shape shown in FIG. 5 or the animation display shown in FIG. 11, for example, it is displayed by the number of stars, or is color-coded for each music tone. Various display forms such as display can be adopted. Further, the entire music tone area 636 and the entire keyword area 637 may be displayed on the playlist screen 600 shown in FIG.

  When the user selects one of the tunes in the tune setting area 731 of the reproduction screen 700, a tune setting input signal for changing the setting of the tune information 514C of the predetermined part being reproduced is generated. Then, the music related information generation unit 353 changes the music tone information 514C obtained by changing the music tone of the part being reproduced to a predetermined music tone based on the music tone setting input signal recognized by the input recognition unit 351 to the part specifying information 514A. The part information 514 is generated in association with each other, but the present invention is not limited to this. That is, when changing the setting of the representative tune of the predetermined part of the predetermined music data, the setting is not limited to being performed on the playback screen 700, but is set by a predetermined setting menu in a state where the playback of the music data is stopped. It is good also as a structure to operate. Further, the screen generation means 355 may be configured not to display the playback screen 700. In the case of such a configuration, the processing speed can be improved because the processing in reproducing the music data can be reduced.

  Further, by touching any display in the music tone setting area 731, keyword setting area 732, and genre setting area 733 of the playback screen 700 displayed on the display surface of the touch panel 320, various information can be set. However, it is not limited to this. That is, a configuration may be adopted in which various types of information are set by performing an input operation using various operation buttons and knobs of the input unit 310 and moving a cursor displayed on the playback screen 700, for example. Even in such a configuration, it is possible to set music tone point information 514B and music tone information 514C for the part being played on the playback screen 700 being played.

  For example, the screen generation unit 355 displays the playback screen 700 shown in FIG. 6 on the touch panel 320, but the playback screen displayed during playback is not limited to this, and the information to be displayed and the display arrangement thereof can be freely set as appropriate. . That is, for example, the first playback music display area 710 includes a title area 711, a music tone area 712, and a playback time area 713. However, the present invention is not limited thereto, and only the title area 711 is displayed. Further, it may be configured to display more information. Further, for example, the second playback music display area 720 has a long rectangular shape with a long length extending in the screen row direction, but is not limited thereto, and may include at least a music tone area 722 and a keyword area 723. Any shape may be used as long as it has a shape.

  The current playback position area 725 is provided on the upper side of the second playback music display area 720 and is an area in which an arrow is formed on one end side of a substantially rectangular frame, but is not limited thereto. In other words, the current playback position area 725 can adopt any form as long as it can indicate the current playback position. Also, the information displayed in the substantially rectangular frame of the current playback position area 725 is not limited to the maximum volume and the current playback time, but displays information such as representative tunes and keywords of the part currently being played back. It may be configured. Further, the color of the part divided for each part of the music tone area 722 is displayed in a state corresponding to the representative music tone and music tone point of the part currently being played back, and the current playback position area 725 is displayed in accordance with this. A substantially rectangular frame to be displayed on the screen, characters to be displayed, and the like may be changed and displayed. In such a configuration, the color of the music tone area 722 and the current playback position area 725 is changed and displayed while reflecting the music tone currently being played back. At a glance.

Further, the setting area 730 is a substantially long rectangular area whose length extends in the screen row direction. However, the setting area 730 is not limited thereto, and may have at least a music tone setting area 731 and a keyword setting area 732. Any shape is acceptable. Further, the keyword setting area 732 is provided with a display unit that prompts the user to set a new keyword independently, and is not limited to the example of the keyword shown in FIG. can do. In the case of such a configuration, it is possible to set a keyword that more reflects the personal preferences of the user.

  Further, the screen generation means 355 may be configured as a reproduction screen 700A as shown in FIG. 12, for example, as the reproduction screen shown during reproduction. The reproduction screen 700A includes a first reproduction music display area 710 and a second reproduction music display area 720A. The first playback music display area 710 includes a title area 711 where the title of the music data being played back is displayed, and a playback time area 713 where the current playback time is displayed. In the second playback music display area 720A, a long rectangle in which the music tone points of a plurality of music tones and the long length of the currently playing portion of the predetermined music data are associated with the playback time is displayed. . In such a configuration, the long rectangle is displayed in real time in conjunction with the playback time based on the music tone points in a plurality of music tones, so the change in the music tone that fluctuates with the playback time can be captured visually. Can do. Therefore, it is possible to enjoy a display that changes in conjunction with music.

  The screen generation means 355 may be configured as a playback screen 700B as shown in FIG. 13, for example, as a playback screen shown during playback. The playback screen 700B shown in FIG. 13 is obtained by changing the configuration of the second playback music display area 720A in FIG. 12 to the second playback music display area 720B, and thus the description of the same configuration is omitted. In the second reproduction music display area 720B, a plurality of figures having a predetermined shape such as a triangle or a circle are displayed for each music tone of music data. These figures are displayed in association with the playback time in association with the playback time corresponding to the music tone points of a plurality of music tones in the part currently being played back in the predetermined music data. Even in such a configuration, the music tone points in a plurality of music tones in the currently listened music data are displayed on the screen in real time as the number of figures increases or decreases, so that the user can The change in the tune of the playback part can be captured visually. It is also possible to enjoy a display that changes in conjunction with music.

  The screen generation unit 355 may be configured as a reproduction screen 700C as shown in FIG. 14, for example, as a reproduction screen shown during reproduction. The playback screen 700B shown in FIG. 14 is obtained by changing the configuration of the second playback music display area 720A in FIG. 12 to the second playback music display area 720C, and thus the description of the same configuration is omitted. In the second reproduction music display area 720C, a shape in which the music tone points of each music tone of the currently playing music data are plotted on the coordinate axes corresponding to the music tone points and the respective plots are connected by a straight line is displayed. This shape is displayed in a state that changes in association with the reproduction time. Even in such a configuration, the music point in a plurality of music tones in the currently listened music data is displayed on the screen in real time due to the change in the shape of the figure, so that the user can The change in the tone of the song can be captured visually. It is also possible to enjoy a display that changes in conjunction with music. In FIG. 14, axes corresponding to four types of music tone points are displayed. However, by providing axes corresponding to more music tone points, more various displays can be realized.

  The screen generation means 355 may be configured as a reproduction screen 700D as shown in FIG. 15, for example, as a reproduction screen shown during reproduction. The playback screen 700D shown in FIG. 15 is obtained by changing the configuration of the second playback music display area 720A in FIG. 12 to the second playback music display area 720B, and thus the description of the same configuration is omitted. In the second reproduction music display area 720D, coordinate axes corresponding to each of the six types of music tone points are displayed. Here, as the six types of music, for example, “bright” music and “dark” music obtained from the chord component, “fast” music and “slow” music obtained from the tempo component, and “violent” obtained from the volume component “Tone” and “Quiet”. These tunes are in conflict with each other. In a three-dimensional coordinate space composed of these coordinate axes, a trajectory indicating a change in music tone point corresponding to the reproduction time of the music data being reproduced is displayed, and the current reproduction position is plotted. In such a configuration, the current playback position is shown moving on a trajectory arranged in a three-dimensional coordinate space, and how the tone changes throughout the music is displayed in three dimensions. Various expressions can be realized along with the playback of music. In addition, if the plot showing the current playback position is moved on the locus arranged in the coordinate space and the music data is played back from the position of the plot after the movement, the desired music tone portion of the music data can be reproduced. Can play. Therefore, the user can visually grasp the change in the tone of the current playback portion and can enjoy a display that changes in conjunction with the music.

  Note that the playback screen 700A shown in FIG. 12, the playback screen 700B shown in FIG. 13, the playback screen 700C shown in FIG. 14, the playback screen 700D shown in FIG. 15, and the playback screen shown in FIG. A setting area 730 in 700 may be provided. Even in the case of such a configuration, it is possible to set typical tunes and keywords of the part currently being reproduced.

  When the input recognition unit 351 recognizes the music tone skip request, the reproduction target recognition unit 354A recognizes any part before or after the part currently being reproduced as a reproduction target, but the present invention is not limited thereto. That is, for example, the reproduction target recognition unit 354A uses the input recognition unit 351 to change the tune tone skip request to a part that plays the leading part of the music data instead of the part currently being reproduced, or to reproduce the part that becomes a chorus. It may be configured to further add a request to the effect. In the case of such a configuration, it is possible to reproduce the leading part of the music data or the part that becomes a chorus instead of the part currently being reproduced, so that the convenience for the user can be improved.

  When the input recognition unit 351 recognizes the shiritori reproduction request, the reproduction target recognition unit 354A recognizes the tune information 514C associated with the rear end part of the currently reproduced music data. Then, the music individual information 510 corresponding to the music data substantially the same as the representative characteristic of the rear end part recognized by the representative characteristic of the music tone information 514C associated with the leading part is randomly selected from the music related information 500. Although it was set as the structure searched, it is not restricted to this. That is, for example, the reproduction target recognition unit 354A recognizes the music point at the end of the part in the music data being reproduced based on the music point information 514B. Then, a part having the same music tone point as the music tone point at the tip of the part is searched from the music related information 500 and recognized as the next reproduction target. Further, the reproduction control unit 354B may be configured to reproduce the next reproduction target part recognized by the reproduction target recognition unit 354A when the reproduction of the part currently being reproduced ends. In such a configuration, the music point at the end of the predetermined part of the predetermined music data is substantially the same as the music point at the front end of the predetermined part of the music data to be reproduced next. A predetermined part of different music data is reproduced while taking over the lingering tone. Therefore, the music reproducing device 300 can realize various reproductions, and the user can enjoy and listen to various music data.

  Also, in Shiritori playback, the representative tune in the rear end part of the currently playing music data and the representative tune in the front part of the music data to be played next are substantially the same, Not limited to this. When the reproduction target recognition unit 354A recognizes the music data to be reproduced next, the reproduction part recognition unit 354A uses the part of the representative music tone different from the representative music tone of the rear end part of the music data currently being reproduced as the leading part of the music data. It is good also as a structure which recognizes the music data which it has as a next reproduction | regeneration object. In such a configuration, the music tone at the rear end of the music data currently being listened to is different from the music tone at the front end of the next music data to be listened to, so that the user can change his mood.

  When the input recognition unit 351 recognizes the feeling play request, the reproduction target recognition unit 354A is associated with music tone information 514C including a specific music tone from the music individual information 510 incorporated in the music related information 500. However, the present invention is not limited to this. That is, for example, the feeling play request may be a feeling play request using a keyword. In such a configuration, the user can enjoy a feeling play with a desired keyword. The part information 514 may be provided with flag information indicating that a predetermined part is not subject to feeling play, and the reproduction target recognizing unit 354A appropriately searches for a feeling play target based on the flag information. . In the case of such a configuration, it is possible to prevent a feeling play to a part that the user does not like. Further, the reproduction target recognition unit 354A may be configured to search for the feeling play target, for example, only up to 10 parts from the music individual information 510 incorporated in the music related information 500. In such a configuration, the number of search targets is small, so that high-speed information processing can be realized.

  When the input recognition unit 351 recognizes the feeling digest play request, the reproduction target recognition unit 354A receives from the music data storage unit 330 music data including a part that becomes a chorus associated with the music tone information 514C of a specific music tone. I tried to search, but it is not limited to this. That is, for example, the feeling digest play request may be a feeling digest play request by a keyword. In such a configuration, the user can enjoy a feeling digest play with a desired keyword. Further, the part information 514 is provided with flag information indicating that the predetermined part is not subject to feeling digest play, and the reproduction target recognition unit 354A appropriately searches for the target of feeling digest play based on the flag information. Also good. In the case of such a configuration, it is possible to prevent feeling digest play even for parts that the user does not like. Further, the reproduction target recognizing unit 354A may be configured to search the feeling digest play target, for example, only up to 10 parts from the music individual information 510 incorporated in the music related information 500. In such a configuration, the number of search targets is small, so that high-speed information processing can be realized.

  Further, in the present embodiment, the processing unit 350 is configured to be able to perform any of reproduction based on a shiritori reproduction request, reproduction based on a feeling play request, and reproduction based on a feeling digest play request. Not limited to this. That is, the processing unit 350 is configured to be able to perform any one of reproduction based on a shiritori reproduction request, reproduction based on a feeling play request, and reproduction based on a feeling digest play request, or It can be set as the structure which does not implement reproduction | regeneration. In the case of such a configuration, the overall configuration of the processing unit 350 can be simplified, and the processing load on the processing unit 350 can be reduced. Any music data reproduction process and any display process shown in the present embodiment can be appropriately combined in any combination.

  In addition, the specific structure and procedure for carrying out the present invention can be appropriately changed to other structures and the like within a range in which the object of the present invention can be achieved.

[Effects of Embodiment]
As described above, in the above embodiment, the music reproduction system 100 recognizes the tune of the music data recorded in the music data storage means 330 and recognizes the part of the music data based on this tune. And music-related information generating means 353 for generating part information 514 by associating the music tone point information 514B and music tone information 514C relating to the music tone in the music data part with the part specifying information 514A for specifying the position of the part. For this reason, it is possible to divide music data having various musical tunes into a plurality of parts and recognize the tunes for each part. Therefore, the music reproducing device 300 can recognize the music tone of the music data satisfactorily. For example, the music tone imaged by the user in the music data reproduced by designating the music tone that the user wants to listen to is provided. It is possible to prevent different parts from being included. Further, since the characteristic recognizing means 352 recognizes the change position as the reproduction time from the leading end of the music data timed by the time measuring means 356, the data processing for specifying the part of the music data can be performed with a simple configuration. . Therefore, the efficiency of data processing can be improved.

It is a block diagram which shows schematic structure of the music reproduction system which concerns on one embodiment of this invention. It is a schematic diagram which shows schematic structure of the play list in this Embodiment. It is a block diagram which shows the internal structure of the process part of the music reproduction apparatus in this Embodiment. It is a figure which shows an example of the music tone of the music in this Embodiment. It is a figure which shows an example of the play list screen in this Embodiment. It is a figure which shows an example of the reproduction | regeneration screen in this Embodiment. It is a flowchart which shows operation | movement of the music separate information generation process in this Embodiment. It is a flowchart which shows the operation | movement of the play list display process in this Embodiment. It is a flowchart which shows the operation | movement of the reproduction | regeneration processing of the music data in this Embodiment. It is a flowchart which shows the operation | movement of the shiritori reproduction | regeneration processing in this Embodiment. It is a figure which shows the modification of a play list screen. It is a figure which shows the modification of a reproduction | regeneration screen. It is a figure which shows the modification of a reproduction | regeneration screen. It is a figure which shows the modification of a reproduction | regeneration screen. It is a figure which shows the modification of a reproduction | regeneration screen.

Explanation of symbols

300 Music Reproducing Device 320 with Information Processing Device 320 Touch Panel as Output Unit and Display Unit 330 Music Data Storage Unit 350 as Content Data Storage Unit Processing Unit 352 as Processing Unit with Information Processing Device Data Acquisition Unit, Characteristics Recognizing means and characteristic recognizing means 353 functioning as section recognizing means Section characteristic information generating means and music related information generating means 354A functioning as section keyword information generating means Keyword content searching means, different characteristic section recognizing means, rear end Reproduction target recognition means 354B that functions as characteristic recognition means, content edge search means, and specific content search means Playback control means 355 Functions as overall characteristic degree recognition means, overall characteristic output control means, and section characteristic display control means Screen generation means 514 Part information 514A as section characteristic information Part specification information 514B as section specification information Characteristic information, characteristic degree information, and music tone point information 514C as overall characteristic degree information tone information 514D as characteristic information Keyword information 514E As characteristic section information Rust flag information

Claims (14)

Data acquisition means for acquiring music data;
Characteristic recognition means for recognizing the tune of the music data;
Section recognition means for recognizing parts having different tunes in the music data based on the tunes recognized by the characteristic recognition means;
Section characteristic information generating means for generating section characteristic information by associating the characteristic information related to the music tone in the part of the music data with the section specifying information for specifying the position of the part ;
The characteristic recognizing unit, when acquiring the music data by the data acquiring unit, generates music tone point information relating to a music tone point in which the degree of at least one music key corresponding to the reproduction time of the music data is quantified,
The section recognizing means recognizes a part where the music tone is different by recognizing a change position where the music tone point recognized by the characteristic recognizing means changes throughout the reproduction time.
An information processing apparatus characterized by that.   The information processing apparatus according to claim 1,
  Comprising storage means for storing a plurality of pieces of data relating to different musical tones serving as the basis of the music data;
  When the music recognition data is acquired by the data acquisition means, the characteristic recognition means compares the music tone data stored in the storage means with a numerical value of the degree of at least one music tone corresponding to the reproduction time of the music data. Generate song point information about song points
  An information processing apparatus characterized by that.   The information processing apparatus according to claim 1 or 2,
  An overall characteristic degree recognizing means for recognizing the degree of the at least one music tone of the whole music data based on the music point information associated with each of the parts in the music data having at least one part; ,
  Overall characteristic output control means for causing the output means to output overall characteristic degree information related to the degree of the at least one music tone for the whole of the at least one music data;
  An information processing apparatus characterized by that.   An information processing apparatus according to any one of claims 1 to 3,
  The section characteristic information generating means is configured to change the characteristic information obtained by changing the tune of the predetermined part to the predetermined tune based on an input operation for setting the tune of the predetermined part to a predetermined tune. The section characteristic information is generated in association with specific information
  An information processing apparatus characterized by that.   An information processing apparatus according to any one of claims 1 to 4,
  Based on the input operation, a playback control means is provided for controlling the music data to be playable based on at least one section characteristic information of the music data.
  An information processing apparatus characterized by that.   The information processing apparatus according to claim 5,
  Content data storage means for storing the music data;
  Section keyword information generating means for generating the section characteristic information by associating keyword information related to the keyword with the section specifying information of the predetermined part based on an input operation for setting a keyword for the predetermined part,
  Keyword content search means for searching the music data having the part set with the keyword from the music data storage means based on an input operation for searching the music data corresponding to the predetermined keyword. Equipped,
  The reproduction control means reproduces the part in which the keyword is set in the music data searched by the keyword content search means.
  An information processing apparatus characterized by that.   An information processing apparatus according to claim 5 or 6, wherein
  Based on an input operation for playing a part having a different tone from the part being played under the control of the playback control means, the part associated with the characteristic information having a different tone from the part being played is recognized. It has characteristic section recognition means,
  The reproduction control means starts reproduction of the part recognized by the different characteristic section recognition means instead of the part being reproduced.
  An information processing apparatus characterized by that.   An information processing apparatus according to any one of claims 5 to 7,
  Content data storage means storing a plurality of the music data;
  Rear end characteristic recognizing means for recognizing the tone of the rear end part based on the characteristic information associated with the rear end part of the music data being played back under the control of the reproduction control means;
  Content end search for searching the music data from the content data storage means for the music data whose tone of the characteristic information associated with the leading part is substantially the same as the tone of the rear end part recognized by the rear end characteristic recognition means Means,
  The reproduction control means starts reproduction of the music data searched by the content edge search means when reproduction of the music data being reproduced ends.
  An information processing apparatus characterized by that.   An information processing apparatus according to any one of claims 5 to 8,
  Content data storage means storing a plurality of the music data;
  Based on an input operation for reproducing a part of a specific music tone, comprising specific content search means for searching music data having a part associated with the characteristic information of the specific music tone from the content data storage means,
  The reproduction control means continuously reproduces the part associated with the characteristic information of the specific music tone in the music data searched by the specific content search means.
  An information processing apparatus characterized by that.   The information processing apparatus according to claim 9,
  The section recognition means recognizes the part characterizing the music data,
  The section characteristic information generating means generates the section characteristic information by associating characteristic section information indicating that the music data is a part characterizing the music data with the section specifying information of the part characterizing the music data,
  The specific content search means includes music data including a part characterizing the music data associated with the characteristic information of the specific music key based on an input operation for reproducing a specific music key in the part characterizing the music data. Search from the content data storage means,
  The reproduction control means continuously reproduces the characterizing part in the music data searched by the specific content search means.
  An information processing apparatus characterized by that. An information processing method for generating predetermined information related to music data by a calculation means ,
Obtaining the music data;
Recognizing the tone of the song data;
Tune in the music data to recognize the different parts on the basis of the melody,
Generating section characteristic information by associating the characteristic information related to the music tone in the part of the music tone data with the section specifying information for specifying the position of the part ;
The computing means, upon obtaining the music data, generates music tone point information relating to music tone points in which at least one music tone degree corresponding to the reproduction time of the music data is quantified,
The melody points generated to recognize recognize and the melody is different parts changes position which varies throughout the playing time
An information processing method characterized by that. An information processing program for causing a calculation means to function as the information processing apparatus according to any one of claims 1 to 10 . An information processing program for causing an arithmetic means to execute the information processing method according to claim 11 . Recording medium recording the information processing program characterized by claim 12 or the information processing program according to claim 13 is readable recorded by the calculation means.

Images