JP2010114737A - Mobile terminal, beat position correcting method, and beat position correcting program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile terminal, a beat position correcting method and a beat position correcting program, by which a beat can be outputted at a highly accurate beat position even on a terminal deficient in specification by correcting beat position information. <P>SOLUTION: The mobile terminal 100 capable of correcting a beat position of music to be played includes: a database 101 for storing music data and beat position information corresponding to the music data; a music player 102 for reading out and playing music data; a beat position information control unit 104 for controlling the beat position information; and an input unit 108 for receiving input of a beat position from a user when playing music data. The beat position information control unit 104 corrects beat position information in which the inputted beat position is reflected. The beat position information can be corrected even on a terminal deficient in specification by reflecting the correction on the beat position inputted from the user and a beat can be outputted at a highly accurate beat position. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a portable terminal capable of outputting beats in conjunction with music reproduction, a beat position correcting method and a beat position correcting program using the portable terminal.

  Conventionally, a technique for realizing vibration-linked playback is known. For example, there is a ringtone reproduction technique in which vibration information is embedded in a content format (data) itself. The accuracy of the beat position information is required for such linked reproduction such as vibration. In the MIDI file, accurate beat position information is embedded, but most of the beat position information is manually assigned in advance, and the beat information cannot be added to a song desired by the user. On the other hand, it is possible to give a certain degree of highly accurate beat position information by automation.

Patent Document 1 proposes an apparatus that extracts a low-frequency component of music based on a music signal and generates vibration at a timing synchronized with the low-frequency component and the music to be reproduced when reproducing the music. The device described in Patent Literature 1 enables an increase in reproduction sound pressure in a low frequency range and generation of vibration synchronized with a low frequency range component at the time of an incoming call. In Patent Literature 2, a power spectrum change rate is calculated using FFT for a music waveform signal obtained from PCM data, and a place where it is estimated that a sound is generated is specified as beat information, etc. An apparatus for extracting beat information as an interval is disclosed. In Patent Document 3 and Non-Patent Document 1, a power spectrum is calculated by using FFT for a music waveform signal obtained from PCM data, and a beat position is estimated by using an autocorrelation function and a cross-correlation function. An apparatus is disclosed. Patent Document 4 describes a technique that uses time-series data as meta information with reference to a start position designated by a user.
JP 2005-236574 A JP 2007-199306 A JP 2007-33851 A JP 2007-248895 A Miguel Alonso, Bertrand David, and Gaё Richard. Tempo and beat estimation of musical signals. In Proc. Int. Symposium on Music Inf. Retriev (ISMIR), 2004.

  However, even if the beat position information given by automation is used, the accuracy is limited. For example, in the device of Patent Document 1, the low frequency range component and the vibration function are linked, but the rhythm that a person feels when listening to music is not necessarily synchronized with the low frequency range component. Some listeners may feel uncomfortable. On the other hand, the method described in Patent Document 4 provides highly accurate beat position information, but assumes the use of a PC, and is difficult to implement with an apparatus with poor specifications. On the other hand, it is possible to improve the accuracy by correcting the beat position information, but unlike the PC, it is possible to correct the beat position information by an operation on a portable terminal with a small expressive power such as a GUI. difficult.

  The present invention has been made in view of such circumstances, and a portable terminal capable of correcting beat position information and outputting a beat at a highly accurate beat position, even on a terminal with poor specifications, and beat position correction. It is an object to provide a method and a beat position correcting program.

  The present invention relates to a portable terminal that enables correction of beat position information obtained by an automatic beat position estimation technique or the like. The present invention solves the above-mentioned problem by preparing an interface for reading out information during reproduction and comparing the estimated beat position and the actual beat position while reproducing the information, and by preparing means for appropriately correcting the position. Specifically, the beat position information (meta information) and the music playback time are synchronously reproduced for the content to which the beat position information is added, and the beat position information and the output display means are synchronized, so that the user can obtain the beat position information. It is possible to make corrections and grants. The present invention has the following features.

  (1) A mobile terminal according to the present invention is a mobile terminal that enables correction of a beat position of a music to be played back, and a database that stores music data and beat position information associated with the music data, and the music A music playback unit that reads and plays data; a beat position information management unit that manages the beat position information; and an input unit that receives an input of a beat position from a user when the music data is played back, the beat position The information management unit is characterized in that the beat position information is corrected to reflect the input beat position.

  Thus, the portable terminal of the present invention corrects the beat position information by reflecting the beat position input from the user. Thereby, even on a terminal with poor specifications, the beat position information can be corrected and a beat can be output at a highly accurate beat position. The beat position refers to the time of a beat that is periodically engraved on the time axis for the reproduction of music. The beat position is mainly represented by the playback time from the beginning of the song.

  (2) Moreover, the portable terminal of this invention is further provided with the beat position information output part which outputs a beat with the beat position based on the said beat position information according to reproduction | regeneration of the said music data, It is characterized by the above-mentioned. . Thus, the user can manually correct the beat position while confirming whether or not the beat output is correct.

  (3) Moreover, the portable terminal of this invention is further provided with the time management part which manages the reproduction time from the music head of the said music data, The said beat position information output part is the reproduction time from the music head of the said music data The beat position information management unit recognizes the beat position based on the beat position information and outputs the beat, and the beat position information management unit reflects the beat position input by the user with the playback time from the beginning of the song data. The beat position information is corrected. Thereby, the beat position can be reflected in the beat position information with reference to the reproduction time from the beginning of the song.

  (4) Moreover, the portable terminal of the present invention further includes a beat position determination unit that determines whether or not the reproduction time from the beginning of the music data coincides with a specific beat position that is the latest unreachable beat position. And the beat position information output unit outputs a beat as having reached the specific beat position when the reproduction time from the beginning of the music data coincides with the specific beat position. . Thus, the portable terminal of the present invention determines arrival at the beat position one by one and outputs the beat. Thereby, a beat can be output efficiently.

  (5) Moreover, the portable terminal of this invention is further provided with the beat position estimation part which estimates the said specific beat position with reference to the said input beat position. Thereby, the beat position estimated during music reproduction is reflected with reference to the input beat position, and the music can be reproduced.

  (6) The portable terminal of the present invention further includes a beat position recording unit that records a beat position input by a user when the music data is reproduced, and the beat position information management unit reproduces the music data. Later, the beat position information is corrected to reflect the recorded beat position. Thereby, at the time of reproduction | regeneration of music data, the input beat position is not reflected in the beat output, but the beat position recorded after the music reproduction is finished can be reflected in the beat position information.

  (7) Moreover, the portable terminal of this invention compares the beat position input from the user with the peak position of the beat position detection function accompanying the music data, and whether the difference between the two is within a predetermined range. A beat position comparison unit for determining whether or not the difference between the two is within a predetermined range, and an input correction unit that corrects the beat position input by the user to a peak position. .

  (8) Also, the beat position correcting method of the present invention is a beat position correcting method that makes it possible to correct the beat position of the music to be played back, the step of reading out and playing back the music data, and the playback of the music data Sometimes, the method includes recording a beat position input from a user and correcting the beat position information to reflect the input beat position. Thereby, even on a terminal with poor specifications, the beat position information can be corrected and a beat can be output at a highly accurate beat position.

  (9) The beat position correcting program of the present invention is a beat position correcting program that enables correction of the beat position of the music to be played back, the process of reading and playing back the music data, and the playback of the music data Sometimes, a process of recording a beat position input from a user and a process of correcting the beat position information to reflect the input beat position are executed by a computer of a portable terminal. Thereby, even on a terminal with poor specifications, the beat position information can be corrected and a beat can be output at a highly accurate beat position.

  According to the present invention, even on a terminal with poor specifications, beat position information can be corrected and beats can be output at highly accurate beat positions. For example, the lack of accuracy of the beat position information obtained by the automatic beat position estimation technique can be compensated. Moreover, a flexible beat position information providing method can be provided to the user without requiring a PC.

  Next, embodiments of the present invention will be described with reference to the drawings. In order to facilitate understanding of the description, the same reference numerals are given to the same components in the respective drawings, and duplicate descriptions are omitted.

[Embodiment 1]
(Configuration of mobile device)
FIG. 1 is a block diagram illustrating a functional configuration of the mobile terminal 100. The mobile terminal 100 is a communicable portable terminal device such as a mobile phone or a PDA. The portable terminal 100 is characterized in that the stored music data can be reproduced and the beat position of the reproduced music can be corrected. As shown in FIG. 1, the mobile terminal 100 includes a database 101, a music playback unit 102, a beat position information management unit 104, a time management unit 105, a beat position determination unit 106, a beat position information output unit 107, an input unit 108, and a beat A position estimation unit 109 is provided.

  The database 101 stores music data (music content) and beat position information associated with the music data. The beat position information is, for example, a file of beat position information, and includes information for specifying the beat position. A plurality of databases may be provided as necessary. The beat position information is obtained by, for example, the following beat position detection process. First, music data in the set analysis section is extracted, and a short-time Fourier transform is applied to the input waveform to calculate a spectrogram in the input waveform. Then, a power function in time series is obtained from the spectrogram, a beat interval is calculated by an autocorrelation function, and a beat position is detected by calculating a beat position by a cross correlation function. The power function obtained at this time is a beat position detection function. As a result, even when the beat position cannot be input at the time assumed by the user due to insufficient specifications of the terminal or a minute delay of the user input, an accurate beat position can be input.

  The music playback unit 102 reads music data from the database 101 and plays it back. The music playback unit 102 passes necessary parameters such as the total playback time from the read music data to the time management unit 105 and plays back the music data. According to the music data to be reproduced obtained by the music reproducing unit 102, the music is reproduced.

  The beat position information management unit 104 manages beat position information. For example, the beat position information is corrected to reflect the input beat position. Thereby, it is possible to correct the beat position information automatically estimated even on a terminal with poor specifications, and to improve the accuracy. The beat position is specified by the reproduction time from the beginning of the song data, for example. The beat position information management unit 104 reads and holds beat position information from the database 101. Also, the synchronization with the reproduction time is managed, and the beat position information is corrected according to the instruction of the time management unit 105. The corrected beat position information is appropriately recorded in the database.

  The time management unit 105 manages the reproduction time from the beginning of the song data by using a timer. The time management unit 105 also holds the total playback time from the beginning of the song to the end of the song according to the parameters obtained from the song playback unit 102. The beat position determination unit 106 determines whether or not the reproduction time from the beginning of the music data matches the specific beat position that is the latest unreachable beat position.

  The beat position information output unit 107 outputs a beat at a beat position based on the beat position information in accordance with the reproduction of the music data. Thus, the user can manually correct the beat position while confirming whether or not the beat output is correct. The beat position information output unit 107 recognizes the beat position based on the beat position information on the basis of the reproduction time from the beginning of the music data, and outputs the beat. Specifically, the beat position information output unit 107 outputs a beat as having reached the specific beat position when it is determined that the reproduction time from the beginning of the music data matches the specific beat position. Thus, since the arrival at the beat position is determined one by one and the beat is output, the beat can be output efficiently.

  The beat position information output unit 107 generates a beat output at a timing instructed by the time management unit 105. The beat output refers to vibration ringing, screen output, and the like performed by synchronizing the music data to be reproduced and the beat position information.

  The input unit 108 receives an input of a beat position from the user when reproducing music data. The input unit 108 detects a user's button input and passes it to the music playback unit 102. Also, an instruction corresponding to the operation is transferred to the beat position information management unit 104 together with the reproduction time at that time. It is also possible to determine a plurality of key inputs and pass them to the music playback unit 102.

  The beat position estimation unit 109 estimates a specific beat position with reference to the input beat position. In particular, the estimation method is not limited. For example, an average beat interval is calculated from the three beat positions input immediately before, and a position obtained by adding the average beat interval calculated from the last reached beat position can be estimated as the specific beat position. The music can be reproduced while referring to the beat positions input in this manner and estimating the beat positions one after another.

(Mobile device operation)
Next, the operation of the mobile terminal 100 configured as described above will be described. FIG. 2 is a flowchart showing a characteristic operation of the mobile terminal 100. First, beat position information associated with the music data is read (step S1). The beat positions stored as the beat position information are m1, m2, m3,. Then, music data corresponding to the beat position information is read (step S2).

  Next, reproduction of the read music data is started (step S3). Simultaneously with the start of reproduction, a timer is activated to manage the music reproduction time from the beginning of the music (step S4). The playback time t from the beginning of the music data is mainly used for confirmation of the end of music playback and determination of beat output such as vibration and screen synchronization. Then, the first specific beat position M (1) is determined (step S5). The most recent unreachable specific beat position M (x) is set to M (1), M (2), M (3),. Is done.

  Next, the playback time from the beginning of the song is managed, and it is determined whether or not the song end time has been reached (step S6). Specifically, it is determined whether t = T. If it is determined that it is not yet the music end time, it is determined whether or not the playback time coincides with the specific beat position (whether or not t = M (x)) (step S7). If the playback time does not match the specific beat position, the process returns to step S6. If the playback time matches the specific beat position, the beat is output (step S8), and the process returns to step S6. If it is determined in step S6 that it is not the music end time, the reproduction of the music is terminated (step S9), and the operation is terminated.

  On the other hand, between the start of the timer (step S4) and the end of the music (step S9), the mobile terminal 100 performs the following operation in parallel. FIG. 3 is a flowchart showing operations performed by the mobile terminal 100 in parallel.

  First, it is determined whether or not it is the music end time (step T1). If it is determined that it is not the music end time, it is determined whether or not the beat position input button has been pressed (step T2). If it is determined that the button has not been pressed, the process returns to step T1. If it is determined that the button has been pressed, the specific beat position is estimated (step T3), and the specific beat position is updated to the estimated beat position (step T4). The updated specific beat position is also used in step S7. Then, the beat position information is updated by reflecting the updated specific beat position (step T5), and the process returns to step T1. If it is determined in step T1 that the music end time has been reached, the operation ends. In addition, said operation | movement is performed by making the portable terminal 100 run a program.

  In this way, it is possible to output beats in which the music data to be reproduced and the beat position information are synchronized. In addition, the user can check the beat position information by starting a timer when playing music data and managing the playback time of the music data. That is, the user can check the validity (accuracy) of the linkage between the beat position of the beat position information and the music to be played back by the beat output process. When the user wants to correct the linkage between the beat position information and the music data reproduction, the user can appropriately correct the beat position information of the music data being reproduced by pressing a button on the mobile terminal 100.

  Further, even when incorrect beat position information is given by an automatic beat position estimation technique having a problem with accuracy, the beat position information can be easily corrected by the mobile terminal 100 alone. In addition, the accuracy of the beat position that cannot be handled by the automatic beat position estimation technique can be improved. Furthermore, the usage of adding and deleting beat position information according to the user's sense is also possible.

[Embodiment 2]
(Configuration of mobile device)
In the above embodiment, the specific beat position is set by referring to the beat position input during music playback, so that the input beat position is reflected in the output beat position as needed. It is also possible to record the input beat position while correcting the beat position information based on the recorded beat position after the music is reproduced. FIG. 4 is a block diagram illustrating a functional configuration of the mobile terminal 200. As shown in FIG. 4, a beat position recording unit 209 is provided instead of the beat position estimating unit 109.

  The beat position recording unit 209 records the beat position input by the user when the music data is reproduced. Then, the beat position information management unit 104 corrects the beat position information to reflect the recorded beat position after the music data is reproduced. Thereby, at the time of reproduction | regeneration of music data, the beat position recorded after completion | finish of music reproduction | regeneration can be reflected on beat position information, without reflecting the input beat position on the output of a beat.

(Mobile device operation)
Next, the operation of the mobile terminal 200 configured as described above will be described. FIG. 5 is a flowchart showing a characteristic operation of the mobile terminal 200. First, beat position information is read (step P1), and music data corresponding to the beat position information is read (step P2). Next, reproduction of the read music data is started (step P3). A timer is started simultaneously with the start of reproduction (step P4). Then, the first specific beat position M (1) is determined (step P5).

  Next, the playback time from the beginning of the song is managed, and it is determined whether or not the song end time has been reached (step P6). If it is determined that it is not yet the music end time, it is determined whether or not the playback time matches the specific beat position (step P7). If the reproduction time does not coincide with the specific beat position, the process returns to step P6. If the playback time matches the specific beat position, the beat is output (step P8), the specific beat position is updated (step P9), and the process returns to step P6. The specific beat position is updated by referring to the beat position of the stored beat position information. Specifically, an addition process such as x = x + 1 is performed. If it is determined in step P6 that the music end time is reached, the reproduction of the music is terminated (step P10), and the operation is terminated.

  On the other hand, between the start of the timer (step P4) and the end of the music (step P10), the mobile terminal 200 performs the following operation in parallel. FIG. 6 is a flowchart showing operations performed by the mobile terminal 200 in parallel.

  First, it is determined whether or not it is the music end time (step R1). If it is determined that it is not the music end time, it is determined whether or not the beat position input button has been pressed (step R2). If it is determined that the button has not been pressed, the process returns to step R1. If it is determined that the button has been pressed, the input beat position is recorded (step R3), and the process returns to step R1. Unlike the mobile terminal 100, the specific beat position is updated in step P9. If it is determined in step R1 that the music end time has been reached, the beat position information is updated (step R4), and the operation ends.

[Embodiment 3]
In the above embodiment, the beat position input by the user is used as it is, and the beat position is estimated or the beat position is recorded. However, the input beat position is corrected and the beat position is estimated or the beat position is recorded. You may go. FIG. 7 is a block diagram illustrating a functional configuration of the mobile terminal 300 that corrects an input beat position using a function.

  As illustrated in FIG. 7, the mobile terminal 300 further includes a beat position comparison unit 301 and an input correction unit 302 in addition to the configuration of the mobile terminal 100 according to the first embodiment. The beat position comparison unit 301 compares the input beat position with the beat position detection function when the beat position information of the music data is estimated. Then, it is determined whether or not the difference between the beat position input from the user and the peak position of the beat position detection function accompanying the music data is within a predetermined range. When correcting the beat position input in this way, information on the beat position detection function is held, and the user input time and the peripheral strength of the beat position detection function are compared. For the beat position detection function, a beat position detection function obtained in advance during the beat position detection process is used. The beat position detection function may be attached to the music data as meta information, or may be calculated from the music data anew.

  The input correction unit 302 automatically corrects the input beat position to a position with high intensity. For example, it can be corrected to the peak position of the beat position detecting function. Thereby, even when the beat position cannot be input at the time assumed by the user due to insufficient specifications of the terminal or a minute delay of the user input, an accurate beat position can be input. An FFT power function or the like can also be used as the beat position detection function.

  Next, the operation of the mobile terminal 300 will be described. The operation of the mobile terminal 300 is in principle the same as the operation of the mobile terminal 100 according to the first embodiment, but in the series of operations corresponding to the input, the operations after the button is pressed and before the specific beat position is estimated are different. That is, when it is determined that the button is pressed, the portable terminal 300 compares the input beat position with the beat position detection function. Then, the input beat position is corrected using the comparison result. In this way, the specific beat position is estimated using the corrected beat position.

  Comparison between the input beat position and the beat position detection function and correction of the beat position will be described. FIG. 8 is a diagram conceptually showing the correction operation of the input beat position. As shown in FIG. 8, it is assumed that there is a difference between the input beat position and the peak position of the beat position detection function. At this time, the portable terminal 300 compares the user input time and the peripheral strength of the beat position detecting function, and if the difference between the input beat position and the peak position of the beat position detecting function is within a predetermined range, the portable terminal 300 is input. The beat position is automatically corrected to the peak position. The predetermined range is preferably 0.1 to 0.3 seconds, and particularly preferably 0.24 seconds or less. Usually, the range of the tempo of general music is 50 BPM or more and 250 BPM or less. Accordingly, since the beat interval at the upper limit of 250 BPM is 0.24 seconds, the standard minimum beat interval is 0.24 seconds. Using this standard minimum beat interval, the predetermined range can be set to 0.24 seconds.

  Note that the mobile terminal 300 reflects the beat position input during music playback on the position of the beat to be output, but records the input beat position during music playback and is recorded after music playback. The same applies to the case where the beat position information is corrected by the beat position. In that case, the portable terminal 200 according to the second embodiment further includes a beat position comparison unit 301 and an input correction unit 302, and corrects the beat position input in the operation from after the button is pressed to before the beat position is recorded.

3 is a block diagram illustrating a functional configuration of a mobile terminal according to Embodiment 1. FIG. 4 is a flowchart illustrating a characteristic operation of the mobile terminal according to the first embodiment. 4 is a flowchart illustrating a characteristic operation of the mobile terminal according to the first embodiment. It is a block diagram which shows the functional structure of the portable terminal which concerns on Embodiment 2. FIG. 10 is a flowchart illustrating a characteristic operation of the mobile terminal according to the second embodiment. 10 is a flowchart illustrating a characteristic operation of the mobile terminal according to the second embodiment. It is a block diagram which shows the functional structure of the portable terminal which concerns on Embodiment 3. FIG. It is a figure which shows notionally the correction | amendment operation | movement of the input beat position.

Explanation of symbols

100, 200, 300 Mobile terminal 101 Database 102 Music playback unit 104 Beat position information management unit 105 Time management unit 106 Beat position determination unit 107 Beat position information output unit 108 Input unit 109 Beat position estimation unit 209 Beat position recording unit 301 Beat position Comparison unit 302 Input correction unit

Claims (9)

A mobile terminal that enables correction of the beat position of the music to be played,
A database for storing song data and beat position information associated with the song data;
A music playback unit that reads and plays back the music data;
A beat position information management unit for managing the beat position information;
An input unit for receiving an input of a beat position from a user at the time of reproduction of the music data,
The mobile terminal characterized in that the beat position information management unit corrects the beat position information to reflect the input beat position.   The mobile terminal according to claim 1, further comprising: a beat position information output unit that outputs a beat at a beat position based on the beat position information in accordance with the reproduction of the music data. A time management unit for managing the playback time from the beginning of the music data;
The beat position information output unit recognizes the beat position based on the beat position information in the reproduction time from the beginning of the music data, and outputs a beat.
The beat position information management unit corrects the beat position information by reflecting a beat position input by a user with a reproduction time from the beginning of the music data. 2. The mobile terminal according to 2. It further comprises a beat position determination unit that determines whether or not the reproduction time from the beginning of the music data matches a specific beat position that is the latest unreachable beat position,
The beat position information output unit outputs a beat as having reached the specific beat position when a reproduction time from the beginning of the music data coincides with the specific beat position. 3. The mobile terminal according to 3.   The mobile terminal according to claim 4, further comprising a beat position estimation unit that estimates the specific beat position with reference to the input beat position. A beat position recording unit that records the beat position input by the user when the music data is reproduced;
6. The beat position information management unit corrects the beat position information to reflect the recorded beat position after reproduction of the music data. 6. Mobile device. Comparing the beat position input from the user with the peak position of the beat position detection function associated with the music data, and determining whether the difference between the two is within a predetermined range;
The input correction part which corrects the beat position input from the user to the peak position when the difference between the two is within a predetermined range, further comprising: The portable terminal as described in. A beat position correction method that enables correction of the beat position of a music to be played,
Reading and playing the music data; and
Recording the beat position input by the user when reproducing the music data;
Correcting the beat position information by reflecting the input beat position, and a beat position correcting method. A beat position correction program that enables correction of the beat position of the music to be played,
A process of reading and playing the music data;
A process of recording a beat position input by a user at the time of reproduction of the music data;
A beat position correcting program for causing a computer of a portable terminal to execute processing for correcting the beat position information by reflecting the input beat position.

Images