JP5060341B2 - Synchronized playback apparatus, automatic music remix system, synchronized playback method and synchronized playback program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To smoothly synchronize two kinds of audiovisual information being either voice information with periodicity or image information with periodicity during reproduction. <P>SOLUTION: The synchronous reproducing method for synchronizing two kinds of audiovisual information during reproduction includes at least: a step S4 for multiplying a periodic accent number BPM<SB>M</SB>per unit time of one kind of audiovisual information by a plurality of numerical values forming a monotone increasing sequence in a multiplication part; a step S5 for selecting a numerical value b<SB>opt</SB>the most approximate to a periodic accent number BPM<SB>O</SB>per unit time of the other kind of audiovisual information from the numerical value group obtained by the multiplication in a selection part; and a step S6 for outputting an optimum adjustment factor f<SB>opt</SB>obtained by dividing the periodic accent number BPM<SB>O</SB>per unit time of the other kind of audiovisual information by the b<SB>opt</SB>in a division part. <P>COPYRIGHT: (C)2009,JPO&amp;INPIT

Description

  The present invention relates to a technique for synchronizing two audiovisual information, which are either audio information having periodicity or video information having periodicity, during reproduction.

Conventionally, a technique for automatically remixing music is known. For example, in the technique disclosed in Japanese Patent Laid-Open No. 2001-243692 (Patent Document 1), the BPM (Beats Per Minute) information of the back music and the BPM information of the previous music in the two music pieces before and after the remix target. To match. Thereby, even if the user is not skilled in remixing music, it can be easily remixed. In addition, for example, the technique disclosed in Japanese translations of PCT publication No. 2004-527786 (patent document 2) vibrates a time signature candidate obtained by band-pass filtering of music signal frequency components in order to estimate the tempo of the music. The tempo is automatically extracted by matching the vessels. In addition, the detection tempo accuracy is increased by performing the remix by raising the frequency of the vibrator to a power of two. Further, the technique disclosed in Japanese Patent Application Laid-Open No. 2006-337914 (Patent Document 3) relates to a playback apparatus having an automatic music remix function. In this playback apparatus, an inter-music effect is inserted when performing music remixing based on acoustic features.
Japanese Patent Laid-Open No. 2001-243692 JP 2004-527786 A JP 2006-337914 A Alonso M.M. David B., et al. and Richard G. “Tempo and Beat Estimate of Musical Signals”, Proc. ISMIR 2004, pp. 158-163

  However, in Patent Document 1, remixing that matches BPM is performed. However, when the BPMs of the music to be remixed are greatly different, the music signal expansion / contraction operation for matching BPM greatly deteriorates the sound quality. There's a problem. Further, in Patent Document 2, BPM adjustment at the time of remixing after estimation of music tempo information needs to use the same method as Patent Document 1, and thus has the same problem. In Patent Document 3, music is not remixed in consideration of time-series tempo and beat information, so a comfortable remix as operated by a DJ cannot be obtained. Furthermore, the conventional technique has a problem that the operation burden on the user increases as the number of remixed music increases.

For example, assuming that the BPMs of the music pieces A and B are BPM _A and BPM _B , respectively, and the coefficient for adjusting the music tempo is f, in the conventional method, the following operation is performed. That is,
BPM _A = f × BPM _B (1) or
f × BPM _A = BPM _B (2),
The tempo of the music before and after the remix was adjusted by performing the operation that becomes. However, in the formulas (1) and (2), when remixing music with greatly different tempos, the degree of expansion / contraction of the music signal increases, and the sound quality deteriorates.

  The present invention has been made in view of such circumstances, and can synchronize two audiovisual information, which are either audio information having periodicity or video information having periodicity, smoothly during reproduction. It is an object of the present invention to provide a playback device, a music automatic remix system, a synchronized playback method, and a synchronized playback program.

(1) In order to achieve the above object, the present invention takes the following measures. That is, the synchronized playback apparatus of the present invention is a synchronized playback apparatus that synchronizes two audiovisual information, which is either audio information having periodicity or video information having periodicity, at the time of reproduction, and one audiovisual information unit. a multiplying section for multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per hour, from numerical value group obtained by the multiplication, periodic per unit time of the other audiovisual information a selection unit for selecting a number closest b _opt in such accents number BPM _O, periodic accents number BPM _O per unit time of the other audiovisual information, wherein b _opt in dividing and obtained optimum adjustment factor f a division unit that outputs _opt , and the one audiovisual information is reproduced by multiplying at least the optimum adjustment coefficient f _opt and at the same time the other viewing And a reproduction unit for reproducing the sense information.

In this way, the numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other audiovisual information is selected from the numerical value group obtained by multiplication, and the period per unit time of the other audiovisual information The optimal adjustment coefficient f _opt obtained by dividing the typical number of accents BPM _O by the b _opt is output and reproduced by multiplying the one audiovisual information by at least the optimal adjustment coefficient f _opt. Since the other audiovisual information is reproduced, the accent positions of both audiovisual information can be reproduced together. As a result, it is possible to reduce deterioration of audio or image quality when remixing audio-visual information having greatly different BPMs. In addition, it is possible to provide the viewer with remixed audiovisual information without a sense of incongruity. Further, since the positions of the accents of both audiovisual information are automatically adjusted, even an unskilled user can easily remix audiovisual information. Note that audiovisual information includes the concept of both audio information and video information. Therefore, according to the present invention, two audio information, two video information, and one audio information and one video information can be synchronized during reproduction as long as they have periodicity.

(2) The synchronized playback apparatus of the present invention is a synchronized playback apparatus that synchronizes two audiovisual information, which is either audio information having periodicity or video information having periodicity, at the time of reproduction, and one audiovisual a multiplying section for multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of information time, from said obtained group of numerical values by multiplying, per unit time of the other audiovisual information a selection unit for selecting a number closest _{b opt} to periodic accents number BPM _O of the periodic accents number BPM _O per unit of time the other audiovisual information, arithmetic mean _{BPM aim} of the _{b opt} and arithmetic mean calculation unit that calculates a, the arithmetic average _{BPM aim} outputs the optimal adjustment factor _{f OPTM} obtained by dividing by the _{b opt,} the phase Gapyeong A dividing unit for the BPM _aim outputting the other of the optimal adjustment factor f _OPTO obtained by dividing the periodic accents number BPM _O per unit time audiovisual information, at least the optimum adjustment relative to the one audiovisual information and play multiplied by the coefficient f _OPTM, therewith is characterized by and a reproduction unit for reproducing by multiplying at least the optimum adjustment factor f _OPTO to the other of audiovisual information at the same time.

In this way, the numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other audiovisual information is selected from the numerical value group obtained by multiplication, and the period per unit time of the other audiovisual information An arithmetic average BPM _aim between the number of typical accents BPM _O and the b _opt is calculated, and an optimum adjustment coefficient f _optM obtained by dividing the arithmetic average BPM _aim by the b _opt is output, and the additive outputs the optimum adjustment factor f _OPTO obtained by dividing the average BPM _aim at periodic accents number BPM _O per unit time of the other audio visual information, at least the optimum adjustment factor f with respect to the one audiovisual information _{Since reproduction} is performed by multiplying by _optM , it is possible to reproduce with the accent positions of both audiovisual information being matched. As a result, it is possible to reduce deterioration of audio or image quality when remixing audio-visual information having greatly different BPMs. Further, since both of the two pieces of audiovisual information are adjusted, it is possible to reduce deterioration in sound quality or image quality as compared with the case where only one of them is adjusted. In addition, it is possible to provide the viewer with remixed audiovisual information without a sense of incongruity. Further, since the positions of the accents of both audiovisual information are automatically adjusted, even an unskilled user can easily remix audiovisual information.

  (3) Further, in the synchronized playback apparatus of the present invention, the playback unit is characterized in that an adjustment coefficient to be multiplied with the audiovisual information is changed from 1 to an optimal adjustment coefficient as time passes.

  As described above, since the adjustment coefficient to be multiplied with the audiovisual information is changed from 1 to the optimal adjustment coefficient as time passes, the adjustment of the accent positions of the two audiovisual information is performed more than when the optimal adjustment coefficient is used. It is possible to reduce the uncomfortable feeling given to the viewer when performing.

  (4) Further, in the synchronized playback device of the present invention, the playback unit outputs the third audiovisual information having an accent with a period matching the accent period of the audiovisual information multiplied by the optimum adjustment coefficient. It is characterized by being played back simultaneously with information.

  As described above, since the third audiovisual information having an accent with a period that matches the accent period of the audiovisual information multiplied by the optimum adjustment coefficient is reproduced simultaneously with the audiovisual information, the position of the accent can be emphasized. it can. This makes it possible to reduce the sense of discomfort given to the viewer when adjusting the accent positions of the two audiovisual information.

  (5) Further, in the synchronized playback apparatus of the present invention, the playback unit starts playback of the other audiovisual information before the playback of the one audiovisual information is completed.

  Thus, since the reproduction of the other audiovisual information is started before the reproduction of one audiovisual information is completed, the accent positions of the two audiovisual information can be adjusted smoothly.

(6) Further, the synchronized playback apparatus of the present invention is a synchronized playback apparatus that performs processing between two pieces of music information, and for the effect sound I and the effect sound II selected in advance, per unit time of the effect sound I. The number of periodic accents BPM ₁ is multiplied by a plurality of numerical values forming a monotonically increasing number sequence to calculate a numerical value group I, and the number of periodic accents BPM ₂ per unit time of the effect sound II is calculated. A multiplication unit that multiplies a plurality of numerical values forming a monotonically increasing number sequence to calculate a numerical value group II, and the numerical value group I is closest to the periodic accent number BPM ₃ per unit time of the one piece of music information with selecting a numeric value _{b opt1,} from the numerical value group II, number closest to the cyclic accent number BPM ₄ per unit of said other music information time _{b op} A selection unit for selecting a _2, a periodic accents number BPM ₃ per unit of time said one of the music information, and outputs the optimal adjustment factor f _opt1 obtained by dividing by the b _opt1, the other songs A division unit that outputs an optimal adjustment coefficient f _opt2 obtained by dividing the number of periodic accents BPM ₄ per unit time of information by the b _opt2 , the one piece of music information, and the effect sound I _Is reproduced by multiplying the effect sound II by the optimum adjustment coefficient f _opt2, and is reproduced by multiplying the effect sound II by the optimum adjustment coefficient f _opt2. It is characterized by.

  As described above, since the tempo can be adjusted by the effect sounds I and II, the expansion / contraction operation of the music signal becomes unnecessary. As a result, the sound quality deterioration of the music is reduced. As a result, it is possible to reduce the sense of incongruity at the part where the music changes.

  (7) Also, in the synchronized playback device of the present invention, the characteristics of the effect sound I having the music feature amount closest to the music feature amount of one piece of music information and the music feature amount of the other piece of music information An effect sound selection unit that selects an effect sound II having the music feature amount having the closest similarity is further provided.

  As described above, since the effect sound having the music feature amount having the closest feature similarity to the music feature amount of the music information is selected, it is possible to reduce deterioration in sound quality and discomfort when remixing the music and the effect sound. It becomes possible.

  (8) Moreover, the music automatic remix system of the present invention includes a music database that stores a plurality of music data, a music selection unit that selects any two music data in response to a user operation, and claims 1 to Item 6. A synchronous playback device according to any one of Items 5 and an output unit that outputs music data played back by the synchronous playback device as sound.

Thus, the numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other music data is selected from the numerical value group obtained by multiplication, and the period per unit time of the other music data is selected. The optimal adjustment coefficient f _opt obtained by dividing the typical number of accents BPM _O by the b _opt is output and reproduced by multiplying the one piece of music data by at least the optimal adjustment coefficient f _opt. Since the other music data is reproduced, the accent positions of both music data can be reproduced together. As a result, it is possible to reduce voice deterioration when remixing music data having greatly different BPMs. Moreover, it becomes possible to provide the viewer with remixed music data without a sense of incongruity. Furthermore, since the positions of the accents of both music data are automatically adjusted, even an unskilled user can easily remix music data.

(9) Further, the synchronous playback method of the present invention is a synchronous playback method for synchronizing two audiovisual information, which is either audio information having periodicity or video information having periodicity, at the time of playback. a step of multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of time one audiovisual information, the selection unit, from the numerical value group obtained by the multiplication, the other of selecting a number closest b _opt to periodic accents number BPM _O per unit time audiovisual information, in the division portion, a cyclic accent number BPM _O per unit of the other audiovisual information time, and outputting an optimal adjustment factor f _opt obtained by dividing by the b _opt, in the reproduction unit, small relative to the one audiovisual information Both are characterized by comprising at least the steps of: playing by multiplying the optimum adjustment factor f _opt, therewith to reproduce the other audiovisual information at the same time.

In this way, the numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other audiovisual information is selected from the numerical value group obtained by multiplication, and the period per unit time of the other audiovisual information The optimal adjustment coefficient f _opt obtained by dividing the typical number of accents BPM _O by the b _opt is output and reproduced by multiplying the one audiovisual information by at least the optimal adjustment coefficient f _opt. Since the other audiovisual information is reproduced, the accent positions of both audiovisual information can be reproduced together. As a result, it is possible to reduce deterioration of audio or image quality when remixing audio-visual information having greatly different BPMs. In addition, it is possible to provide the viewer with remixed audiovisual information without a sense of incongruity. Further, since the positions of the accents of both audiovisual information are automatically adjusted, even an unskilled user can easily remix audiovisual information.

(10) The synchronized playback method of the present invention is a synchronized playback method for synchronizing two audiovisual information, which is either audio information having periodicity or video information having periodicity, at the time of playback. a step of multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of time one audiovisual information, the selection unit, from the numerical value group obtained by the multiplication, the other selecting a number closest b _opt to periodic accents number BPM _O per unit time of the audiovisual information, the arithmetic mean calculating section, periodic accent per unit time of the other audiovisual information BPM and _O, and calculating the arithmetic mean _{BPM aim} of the _{b opt,} in the division portion, wherein the arithmetic average _{BPM aim b o} It outputs the optimal adjustment factor f _OPTM obtained by dividing the _t, optimum adjustment coefficient obtained by dividing the arithmetic average BPM _aim at periodic accents number BPM _O per unit time of the other audio visual information a step of outputting f _optO , and in the reproduction unit, the one audiovisual information is reproduced by multiplying at least the optimum adjustment coefficient f _optM , and at the same time, at least the optimum adjustment coefficient f _optO for the other audiovisual information. And at least a step of reproducing by multiplying.

In this way, the numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other audiovisual information is selected from the numerical value group obtained by multiplication, and the period per unit time of the other audiovisual information An arithmetic average BPM _aim between the number of typical accents BPM _O and the b _opt is calculated, and an optimum adjustment coefficient f _optM obtained by dividing the arithmetic average BPM _aim by the b _opt is output, and the additive outputs the optimum adjustment factor f _OPTO obtained by dividing the average BPM _aim at periodic accents number BPM _O per unit time of the other audio visual information, at least the optimum adjustment factor f with respect to the one audiovisual information _{Since reproduction} is performed by multiplying by _optM , it is possible to reproduce with the accent positions of both audiovisual information being matched. As a result, it is possible to reduce deterioration of audio or image quality when remixing audio-visual information having greatly different BPMs. Further, since both of the two pieces of audiovisual information are adjusted, it is possible to reduce deterioration in sound quality or image quality as compared with the case where only one of them is adjusted. In addition, it is possible to provide the viewer with remixed audiovisual information without a sense of incongruity. Further, since the positions of the accents of both audiovisual information are automatically adjusted, even an unskilled user can easily remix audiovisual information.

(11) Further, the synchronous reproduction program of the present invention is loaded into a computer to synchronize reproduction that synchronizes two audiovisual information that is either audio information having periodicity or video information having periodicity at the time of reproduction. a program, a process of multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of time one audiovisual information, from the numerical value group obtained by the multiplication, the other a process of selecting a number closest b _opt to periodic accents number BPM _O per unit time audiovisual information, periodic accents number BPM _O per unit of the other audiovisual information time, divided by the b _opt multiply at least the optimum adjustment factor f _opt against optimal adjustment coefficient and outputting the f _opt, the one audiovisual information and And a process of reproducing the other audiovisual information at the same time.

In this way, the numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other audiovisual information is selected from the numerical value group obtained by multiplication, and the period per unit time of the other audiovisual information The optimal adjustment coefficient f _opt obtained by dividing the typical number of accents BPM _O by the b _opt is output and reproduced by multiplying the one audiovisual information by at least the optimal adjustment coefficient f _opt. Since the other audiovisual information is reproduced, the accent positions of both audiovisual information can be reproduced together. As a result, it is possible to reduce deterioration of audio or image quality when remixing audio-visual information having greatly different BPMs. In addition, it is possible to provide the viewer with remixed audiovisual information without a sense of incongruity. Further, since the positions of the accents of both audiovisual information are automatically adjusted, even an unskilled user can easily remix audiovisual information. Note that audiovisual information includes the concept of both audio information and video information. Therefore, according to the present invention, two audio information, two video information, and one audio information and one video information can be synchronized during reproduction as long as they have periodicity.

(12) Further, the synchronous reproduction program of the present invention is loaded into a computer, and synchronous reproduction that synchronizes two audiovisual information, which is either audio information having periodicity or video information having periodicity, at the time of reproduction. a program, a process of multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of time one audiovisual information, from the numerical value group obtained by the multiplication, the other a process of selecting a number closest b _opt to periodic accents number BPM _O per unit time audiovisual information, and periodic accents number BPM _O per unit of time the other audiovisual information, with the b _opt arithmetic average _BPM and processing of calculating the _aim, the arithmetic average _{BPM aim} the _b obtained by dividing the _opt optimum adjustment factor f It outputs the _PTM, and outputting the arithmetic average _{BPM aim} the other optimal adjustment factor _{f OPTO} obtained by dividing the periodic accents number BPM _O per unit time audiovisual information, the one And at least a _process of multiplying the audiovisual information by the optimal adjustment coefficient _foptM and simultaneously reproducing the audiovisual information by multiplying the other audiovisual information by the optimal adjustment coefficient _foptO. It is said.

In this way, the numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other audiovisual information is selected from the numerical value group obtained by multiplication, and the period per unit time of the other audiovisual information An arithmetic average BPM _aim between the number of typical accents BPM _O and the b _opt is calculated, and an optimum adjustment coefficient f _optM obtained by dividing the arithmetic average BPM _aim by the b _opt is output, and the additive outputs the optimum adjustment factor f _OPTO obtained by dividing the average BPM _aim at periodic accents number BPM _O per unit time of the other audio visual information, at least the optimum adjustment factor f with respect to the one audiovisual information _{Since reproduction} is performed by multiplying by _optM , it is possible to reproduce with the accent positions of both audiovisual information being matched. As a result, it is possible to reduce deterioration of audio or image quality when remixing audio-visual information having greatly different BPMs. Further, since both of the two pieces of audiovisual information are adjusted, it is possible to reduce deterioration in sound quality or image quality as compared with the case where only one of them is adjusted. In addition, it is possible to provide the viewer with remixed audiovisual information without a sense of incongruity. Further, since the positions of the accents of both audiovisual information are automatically adjusted, even an unskilled user can easily remix audiovisual information.

According to the present invention, a numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other audiovisual information is selected from the numerical value group obtained by multiplication, and per unit time of the other audiovisual information. Output the optimum adjustment coefficient f _opt obtained by dividing the periodic accent number BPM _O by the b _opt , reproduce the one audiovisual information by at least the optimum adjustment coefficient f _opt, and Since the other audiovisual information is reproduced at the same time, the accent positions of both audiovisual information can be reproduced together. As a result, it is possible to reduce deterioration of audio or image quality when remixing audio-visual information having greatly different BPMs. In addition, it is possible to provide the viewer with remixed audiovisual information without a sense of incongruity. Further, since the positions of the accents of both audiovisual information are automatically adjusted, even an unskilled user can easily remix audiovisual information.

(First embodiment)
Next, embodiments according to the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a synchronized playback apparatus according to the first embodiment of the present invention. The synchronized playback apparatus 1 synchronizes two audio information having periodicity, two video information having periodicity, or one audio information having periodicity and one video information having periodicity at the time of reproduction. In this specification, audio information having periodicity and video information having periodicity are referred to as “audiovisual information”. That is, in this specification, audiovisual information refers to either audio information having periodicity or video information having periodicity. BPM (Beats Per Minute) means the number of accents (number of beats) per minute. Accent (beat) refers to the strength of periodic voice in the case of voice information. In addition, in the case of video information, it is a periodically repeated video, for example, a video of a ball at the moment it touches the ground in a video where the ball is bouncing. The accent position (beat position) refers to the position of the accent (beat) on the time axis, that is, the time when the accent appears.

In synchronous playback device 1, multiplier 2, to the periodic accents number BPM _M per unit time of the first audiovisual information, multiplying the plurality of numbers forming a monotonically increasing sequence. As the “plural numerical values forming the monotonically increasing number sequence”, for example, a numerical value obtained by ^2c can be used, where c is an integer. In this case, if “c = −2, −1, 0, 1, 2”, 2 ^c can be obtained as “2 ^c = 0.25, 0.5, 1, 2, 4”. Multiplying unit 2, to the periodic accents number BPM _M per unit of time the first audiovisual information, thus multiplying the numerical value obtained in 2 ^c. Note that, here, ^2c is used as an example of “a plurality of numerical values forming a monotonically increasing number sequence”, but the present invention is not limited to this.

Selecting unit 3, the numerical value group obtained by multiplication in multiplication unit 2 selects the number closest b _opt to periodic accents number BPM _O per unit of the second audiovisual information time. For example, when a group of numerical values obtained by multiplication in the multiplication unit 2 is {b ₁ , b ₂ , b ₃ , b ₄ , b ₅ }, among these, the second audiovisual information per unit time The numerical value b _opt closest to the periodic accent number BPM _O is selected. In this case, the numerical value b _opt selected by the selection unit 3 is directly input to the division unit 4.

Divider 4, a periodic accents number BPM _O per unit time of the second audiovisual _information, and outputs the optimal adjustment factor _{f opt} obtained by dividing the _{b opt.} The reproduction unit 5 reproduces the first audiovisual information by multiplying at least the optimum adjustment coefficient f _opt and simultaneously reproduces the second audiovisual information. The arithmetic mean calculation unit 6 will be described later.

FIG. 2 is a flowchart showing the operation of the synchronized playback apparatus according to the first embodiment. Here, the audio / visual information will be described by taking periodic voice information, for example, music. This synchronized playback device does not match the BPM of the music, but pays attention to the beat position of the music, finds the optimum adjustment coefficient f _opt that minimizes the adjustment coefficient f of the two music, and based on this f _opt Adjust the song tempo. This makes it possible to perform remixing with reduced sound quality degradation of the music. Specifically, for example, in the case of combining the music of BPM 120 and the music of BPM 60, if the tempo is adjusted so that the music of BPM 60 becomes BPM 120, the sound quality deterioration becomes significant. In the present invention, remixing is possible without adjusting the tempo by paying attention to the beat position and considering the back beat of the BPM 60. Here, the reproduction of the audio signal with the accent positions of both pieces of audiovisual information is referred to as “tempo adjustment”.

In FIG. 2, music M and music O are selected (step S1). Here, the music for which tempo adjustment is performed is M, and the music for which tempo adjustment is not performed is O. Next, it is determined whether or not the BPM information is known (step S2). If it is not known, tempo analysis is performed (step S3). Here, the BPM of the music M obtained by performing the tempo analysis is BPM _M, and the BPM of the music O is BPM _O. On the other hand, if the BPM is known in step S2, the process proceeds to step S4.

Next, BPM _M is multiplied by ^2c . Here, “c = −2, −1, 0, 1, 2” is set, and a numerical value group G = {b1, b2, b3, b4, b5} is obtained (step S4). Then, to calculate the _{b opt} a value closest to BPM _O from numerical value group G (step S5). That is,
b _opt = 2 ^Copt × BPM _M

Next, an optimum tempo adjustment coefficient (optimum adjustment coefficient) f _opt is calculated (step S6). That is,
f _opt = BPM _O / b _opt .

  In the tempo analysis in step S3, for example, the BPM of the music M and the music O can be calculated using the tempo estimation method described in Non-Patent Document 1. It is also possible to use music metadata prepared in advance without using an existing tempo estimation method.

(Second Embodiment)
When calculating the optimum tempo adjustment coefficient (optimum adjustment coefficient) as described above, it is also possible to adjust both the first and second audiovisual information. In this case, the numerical value b _opt selected by the selection unit 3 in FIG. 1 is not input to the direct division unit 4 but is input to the arithmetic mean calculation unit 6. The arithmetic average calculation unit 6 calculates an arithmetic average BPM _aim between the periodic accent number BPM _O per unit time of the second audiovisual information and the b _opt selected by the selection unit 3. The division unit 4 outputs an optimal adjustment coefficient f _optM obtained by dividing the arithmetic average BPM _aim by b _opt , and calculates the arithmetic average BPM _aim as the number of periodic accents per unit time of the second audiovisual information. and outputs the optimal adjustment factor _{f OPTO} obtained by dividing the BPM _O. The reproduction unit 5 reproduces the first audiovisual information by multiplying at least the optimum adjustment coefficient f _optM and simultaneously reproduces the second audiovisual information by at least the optimum adjustment coefficient f _optO .

The operation of the synchronized playback apparatus according to the second embodiment can also be described with reference to the flowchart shown in FIG. In FIG. 2, first, the music M and the music O are selected (step S1). Here, the optimal tempo adjustment coefficient of the music piece M is f _optM and the optimal tempo adjustment coefficient of the music piece O is f _optO . The tempo in the playback unit 5 is set to BPM _aim . It is determined whether the BPM information is known (step S2). If it is not known, tempo analysis is performed (step S3). Here, the BPM of the music M obtained by performing the tempo analysis is BPM _M, and the BPM of the music O is BPM _O. On the other hand, if the BPM is known in step S2, the process proceeds to step S4.

Next, BPM _M is multiplied by ^2c . Here, “c = −2, −1, 0, 1, 2” is set, and a numerical value group G = {b1, b2, b3, b4, b5} is obtained (step S4). Then, to calculate the _{b opt} a value closest to BPM _O from numerical value group G (step S5). That is,
b _opt = 2 ^Copt × BPM _M

Next, the tempo BPM _aim in the reproducing unit 5 is obtained from the arithmetic average of b _opt and BPM _O, and the optimum tempo adjustment coefficient f _optM of the music piece M and the optimal tempo adjustment coefficient of the music piece O are _obtained (step S6). ). That is,
BPM _aim = (b _opt + BPM _O ) / 2,
f _optM = BPM _aim / b _opt ,
It is determined by the _{f optO = BPM aim / BPM O} .

By adjusting the tempo of the music piece M and the music piece O according to the f _optM and the f _optO obtained in this way, it is possible to reduce deterioration in sound quality as compared with the case of adjusting only the tempo of one of the music pieces.

  Note that the synchronized playback devices shown in the first and second embodiments can be applied not only to remixing of music but also to information having periodicity. A plurality of pieces of information having periodicity can be synchronized and reproduced. In this case, the above BPM information may be replaced with the period information and calculated as the optimum period adjustment coefficient. In Patent Literature 2, tempo estimation is performed by adding candidates obtained by multiplying tempo candidates by a power of 2, as in the present embodiment. It is not used as an index for performing BPM adjustment. Patent Document 2 proposes an interactive music playback device, but it is not a fully automatic remix. On the other hand, in this embodiment, since the back beat is automatically recognized from the BPM information of the music, it is possible to provide a remix with the least deterioration in sound quality.

(Third embodiment)
In the third embodiment, a music remix using an optimum tempo adjustment coefficient (optimum adjustment coefficient) will be described. By using the optimal tempo adjustment coefficient and the beat position information of the music, the music remix that matches the beat feeling of the music is realized. In the following description, the music for which tempo adjustment is performed is M, the music for which tempo adjustment is not performed is O, BPM information for both music is BPM _M , BPM _O , and beat position information is L _M = {l _M1 , l _M3 , l _M3 ,..., L _O = {l _O1 , l _O2 , l _O3,.

FIG. 3 is a flowchart showing a procedure of music remixing according to the third embodiment, and FIG. 4 is a diagram showing an overlapping section when two music pieces are remixed. FIG. 5 is a diagram showing a state of volume control. First, define the superimposition section T _M of the music with each other after the remix (step T1). Next, an optimum tempo adjustment coefficient f _opt is calculated, and a tempo modulation section T (T = f _opt × T _M ) is calculated (step T2). Next, a tempo modulation section T is extracted from the signal of the music piece M, and this is defined as E _M (t) (step T3).

Next, tempo adjustment (f _opt × BPM _M ) is performed on E _M (t) of the music piece M (step T4). E _M (t) of the tune-adjusted music M is set to E _Mm (t) (step T5). Further, the overlapping section _TM is extracted from the signal of the music piece O, and this is set as E _Om (t) (step T5). As a result, the beat position is adjusted. Next, start beat positions S _Mm and S _Om at E _Mm (t) and E _Om (t) are obtained from L _M and L _O (step T6). Next, volume control is performed (step T7), and S _Mm and S _Om are matched in time series to combine music M and music O (step T8).

  Here, at the time of combining music pieces in step T7, it is possible to remix music pieces smoothly by applying volume control such as crossfading. Volume control can be applied by multiplying a signal that gradually decreases the amplitude of the signal in the overlap period, as in the volume control function shown in FIG. Alternatively, a signal that gradually increases the amplitude of the signal may be multiplied.

(Fourth embodiment)
In the present embodiment, the third sound source is inserted in order to reduce a sense of incongruity at the portion where two music pieces overlap when adjusting the tempo. The third sound source may be a rhythm-only sound such as a drum sound, or may be a music piece. In this embodiment, a case where the next music starts before the previous music completely ends, that is, a case where two music pieces overlap each other will be described. An example in which the third sound source is played when the next music starts after the previous music has completely ended will be described later. FIG. 6 is a flowchart showing a procedure for inserting a third sound source in the fourth embodiment, and FIG. 7 is a diagram showing a state of a signal in which the third sound source is inserted at the beat position. FIG. 8 is a diagram showing a state of volume control for the third sound source and music. 6, first, defining a superimposition section T _M of the music with each other after the remix (step R1). Next, an optimal tempo adjustment coefficient f _opt is calculated, and a tempo modulation interval T (T = f _opt × T _M ) is calculated (step R2). Next, a tempo modulation section T is extracted from the signal of the music piece M, and this is defined as E _M (t) (step R3).

Next, tempo adjustment (f _opt × BPM _M ) is performed on E _M (t) of the music piece M (step R4). E _M (t) of the tune-adjusted music piece M is set to E _Mm (t) (step R5). Further, the overlapping section _TM is extracted from the signal of the music piece O, and this is set as E _Om (t) (step R5). Next, the beat position is adjusted. That is, start beat positions S _Mm and S _Om at E _Mm (t) and E _Om (t) are obtained from L _M and L _O (step R6). Next, the beat position information l _A of the music M and the music O is acquired in the overlapping section (step R7), and the third sound source is inserted at the position of l _A (step R8). FIG. 7 shows a state in which the third sound source (drum sound) is inserted into the beat positions l _A1 , l _A2 , l _A3,. Next, as shown in FIG. 8, volume control is performed (step R9). Specifically, the volume of the music M is gradually reduced and the volume of the drum sound source is gradually increased within the overlapping section. At the same time, the volume of the music O is gradually increased. The volume of the drum sound source is gradually lowered around the center of the overlapping section. Thereby, the music M and the music O are combined (step R10). According to the fourth embodiment, it is possible to reduce a sense of discomfort when remixing music.

(Fifth embodiment)
In the present embodiment, the tempo is gradually adjusted when the tempo adjustment is performed based on the tempo adjustment coefficient in step T4 of the third embodiment. FIG. 9 is a flowchart showing a procedure for gradually adjusting the tempo in the fifth embodiment, and FIG. 10 is a diagram showing a section for gradually adjusting the tempo. 9, firstly, to define a superimposing section T _M of the music with each other after remixing, the interval T _M1 is gradually adjust the tempo (step P1). Next, an optimum tempo adjustment coefficient f _opt is calculated, and a tempo modulation section T (T = f _opt × T _M ) is calculated (step P2). Next, a tempo modulation section T and a section T _M1 in which the tempo is gradually adjusted are extracted from the signal of the music piece M, and these are set as E _M (t) and E _M1 (t), respectively (step P3).

Next, with respect to _E M (t) of music M, performs the tempo adjustment _{(f opt} × BPM _M), to _E M tempo adjusted music M a (t) and _E Mm (t) (step P4 ). Next, to adjust E _M1 (t) from BPM _M to f _opt × BPM _M , the tempo adjustment coefficient f is gradually changed. Specifically, the tempo adjustment coefficient f is changed from 1 to f _opt , and (f _opt × BPM _M ) is sequentially calculated, so that the tempo adjustment is smoothly performed to _obtain E _Mm1 (t) (step) P5).

Specifically, as shown in FIG. 10, the tempo adjustment is performed by changing the tempo adjustment coefficient from 1 to f _{opt in} the interval of T _M1 . For example, when f _opt = 0.80 (sec) and T _M1 = 0.80 (sec), the tempo adjustment coefficient f is {1, 0.95, 0.90, 0.85, 0.80}. Change. And
In the interval of 0 to 2 seconds, f = 1.00,
In the interval of 2-4 seconds, f = 0.95,
In the interval of 4-6 seconds, f = 0.90,
In the section of 6-8 seconds, f = 0.85,
In the section of 8 to 10 seconds, the adjustment of f = 0.80 is performed.

Next, E _Mm (t) and E _Om (t) in the overlapping section are extracted (step P6), and the start beat positions S _Mm and S _Om are obtained from L _M and L _O (step P7). Next, S _Mm and S _Om are combined on the time series, and the music M and the music O are combined (step P8).

Thus, since the tempo adjustment coefficient f is changed from 1 to f _opt , it is possible to smoothly adjust the tempo with respect to the tempo determined by the optimum tempo adjustment coefficient. In particular, compared with the case where only the optimum tempo adjustment coefficient is used, the uncomfortable feeling due to the tempo adjustment is reduced.

(Sixth embodiment)
In this embodiment, at the time of adjusting the tempo, the third sound source is inserted in the present embodiment, as in the fourth embodiment, in order to reduce a sense of incongruity at the portion where two music pieces change. Also in the present embodiment, the third sound source may be a rhythm-only sound such as a drum sound, or may be a music piece. In the present embodiment, an example will be described in which the third sound source is played when the next music starts after the previous music is completely finished. In the present embodiment, the “music feature amount” representing the music feature will be described using, for example, a “music vector”. Further, the description will be made using “feature similarity” representing the degree of similarity of music features, for example, “cosine distance”.

FIG. 11 is a block diagram showing a schematic configuration of a synchronized playback apparatus according to the sixth embodiment. In the synchronized playback device 60, the effect sound selection unit 61 includes an effect sound I having a music vector with the closest cosine distance to the music vector of one music information (music A) and a music of the other music information (music B). The effect sound II having the music vector with the closest cosine distance to the vector is selected. The multiplication unit 62 calculates the numerical value group I by multiplying the periodic accent number BPM ₁ per unit time of the effect sound I by a plurality of numerical values forming a monotonically increasing number sequence. Further, the numerical value group II is calculated by multiplying the periodic accent number BPM ₂ per unit time of the effect sound II by a plurality of numerical values forming a monotonically increasing number sequence.

The selection unit 63 selects a numerical value b _opt1 closest to the periodic accent number BPM ₃ per unit time of one piece of music information (music A) from the numerical value group I. In addition, the numerical value b _opt2 closest to the periodic accent number BPM ₄ per unit time of the other music information (music B) is selected from the numerical value group II. The division unit 64 outputs the optimum adjustment coefficient f _opt1 obtained by dividing the periodic accent number BPM ₃ per unit time of one piece of music information (music A) by the b _opt1 . Also, periodic accents number BPM ₄ per unit time other music information (music B), and outputs the optimal adjustment factor _{f opt2} obtained by dividing the above _{b opt2.}

The reproduction unit 65 reproduces one piece of music information (music A), and multiplies the effect sound I simultaneously with the music A within a certain period before the music A ends by multiplying the effect adjustment I by the optimum adjustment coefficient f _opt1. Play sound I. Here, both are reproduced by using a cross-fade method. Thereby, the BPM _{1 of the} effect sound I can be matched with the BPM ₃ of the music piece A. Then, the reproduction unit 65 the music A is completed, during the reproduction of the effect sound I, the BPM ₁ of effect sound I, while adjusting the effect sound together as the BPM ₂ effect sound II matches, effect Start playing sound II. At that time, the reproduction of the effect sound I may be stopped, or both may be reproduced using a crossfade method. Next, the reproduction unit 65 reproduces the effect sound II by multiplying the optimum adjustment coefficient f _opt2 and reproduces the other music information (music B). Again, both are reproduced using the crossfade method. Thereby, the BPM ₂ of the effect sound II can be matched with the BPM ₄ of the music B. Next, the operation of the inter-music processing of the synchronized playback device according to the sixth embodiment will be described.

  FIG. 12 is a diagram illustrating a state of the inter-music processing according to the sixth embodiment. In the sixth embodiment, first, (1) the feature quantities of the previous and subsequent music pieces are acquired. That is, the BPM, beat position, and music vector of the music being played (music A) and the music to be played next (music B) are acquired. The music vector refers to a histogram obtained from the MFCC of music data using a tree vector quantization method (TreeQ). Here, it is assumed that the BPM and beat position are known. Next, (2) effect selection is performed. An effect sound with known BPM, beat position, and vector is prepared. Then, an effect (effect II) having a music vector having the closest cosine distance to the vector of music B is selected. Next, the effect (effect I) having the largest average cosine distance between the music A vector and the effect II vector is selected.

  Next, (3) the effect tempo is changed. That is, in the effect playback portion, the tempo of the effects I and II is changed so that the tempo gradually changes from the BPM of the music A to the BPM of the music B. Finally, (4) beat alignment is performed. Adjust the timing to insert the back sound source so that the beat positions of the overlapping sound sources are aligned. FIG. 12 shows the state of such inter-music processing. As shown in FIG. 12, music A is played back as effect I and effect II, and music B is connected in this order for continuous playback. The last part of music A, the first part of effect I, the last part of effect II, and the first part of music B are crossfade.

  In the present embodiment, an example in which only the effect sound is multiplied by the optimum adjustment coefficient is shown, but the present invention is not limited to this. As in each of the above-described embodiments, it is also possible to adopt a method of multiplying the music piece A and the music piece B by the optimum adjustment coefficient.

  According to the sixth embodiment, since the tempo can be adjusted by the effects I and II, the music signal expansion / contraction operation becomes unnecessary. As a result, the sound quality deterioration of the music is reduced.

(Seventh embodiment)
In the present embodiment, a music automatic remix system including the above-described synchronized playback device will be described. FIG. 13: is a block diagram which shows schematic structure of the music automatic remix system which concerns on 7th Embodiment. The automatic music remix system 110 includes a synchronized playback device 1, a music selection unit 111 that selects music, and a music database (DB) 112 that stores a plurality of music as music data.

  The music selection unit 111 receives a user operation and selects music to be remixed. For example, the music stored in the music database 112 or a list thereof is presented to the user. The user performs an operation for selecting one of the music pieces on the music selection unit 111. In addition, instead of the user selecting music directly, it is also possible to input the music atmosphere, for example, attribute information of music such as bright music and quiet music. In this case, it is possible to select the music to be remixed by comparing the input attribute information with the music meta information stored in the music database 112 or the like.

  The music database 112 stores music used in the present system and information related to music. For example, music data, music tempo information, music beat position information, and meta information attached to music are stored. The synchronized playback apparatus 1 performs remixing of the music selected by the music selection unit 111 by the method described in the above embodiments. In the synchronized playback device 1, the finally combined remix music signal is output as an audible sound by the speaker 113. It can also be output as a data file.

  In the music automatic remix system 110, the music tempo information and the music beat position information are already known.

(Eighth embodiment)
In the present embodiment, a mode in which the music tempo information and the music beat position information are unknown will be described. FIG. 14 is a block diagram showing a schematic configuration of a music automatic remix system according to the eighth embodiment. This automatic music remix system 120 includes the synchronized playback device 1, a music selection unit 111, and a music database 112, as in the seventh embodiment. Furthermore, a music acquisition / analysis unit 121 is provided. The music acquisition / analysis unit 121 acquires and analyzes the music stored in the music database 112 and stores the analysis result in the music information database 122. The music acquisition / analysis unit 121 analyzes the music tempo information, the music beat position information, and the like using the technology disclosed in Non-Patent Document 1, for example. In addition, music data, music information data, and the like stored in the music database 112 can be acquired and used for analysis.

  The music information database 122 stores information about music analyzed by the music acquisition / analysis unit 121. For example, data such as music tempo information and music beat position information is stored. It is also possible to store information in the music database 112 and music data.

  According to the present embodiment, even if the music tempo information and the music beat position information are unknown, these can be obtained based on the information stored in the music database 112.

It is a block diagram which shows schematic structure of the synchronous reproduction apparatus which concerns on 1st Embodiment. It is a flowchart which shows operation | movement of the synchronous reproduction apparatus which concerns on 1st and 2nd embodiment. It is a flowchart which shows the procedure of the music remix which concerns on 3rd Embodiment. It is a figure which shows the superimposition area at the time of remixing two music. It is a figure which shows the mode of volume control. It is a flowchart which shows the procedure which inserts the 3rd sound source in 4th Embodiment. It is a figure which shows the mode of the signal which inserted the 3rd sound source in the beat position. It is a figure which shows the mode of the volume control with respect to a 3rd sound source and a music. 14 is a flowchart showing a procedure for gradually adjusting the tempo in the fifth embodiment. It is a figure which shows the area which adjusts a tempo gradually. It is a block diagram which shows schematic structure of the synchronous reproduction apparatus which concerns on 6th Embodiment. It is a figure which shows the mode of the process between music concerning 6th Embodiment. It is a block diagram which shows schematic structure of the music automatic remix system which concerns on 7th Embodiment. It is a block diagram which shows schematic structure of the music automatic remix system which concerns on 8th Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Synchronous reproduction apparatus 2 Multiplication part 3 Selection part 4 Division part 5 Reproduction part 6 Arithmetic average calculation part 110 Music automatic remix system 111 Music selection part 112 Music database 113 Speaker 120 Music automatic remix system 121 Music acquisition and analysis part 122 Music information The database

Claims (11)

A synchronized playback device that synchronizes two pieces of music information during playback,
A multiplying section for multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of one of the music information time,
A selection unit for selecting a numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other music information from the numerical value group obtained by the multiplication;
A division unit for outputting an optimal adjustment coefficient f _opt obtained by dividing the periodic accent number BPM _O per unit time of the other music information by the b _opt ;
A reproduction unit that reproduces the one audiovisual information by multiplying at least the optimum adjustment coefficient f _opt and simultaneously reproduces the other audiovisual information ,
The synchronous playback apparatus characterized in that the playback unit changes an adjustment coefficient to be multiplied to the music information from 1 to an optimum adjustment coefficient with the passage of time when the one piece of music information is played back. A synchronized playback device that synchronizes two pieces of music information during playback,
A multiplying section for multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of one of the music information time,
A selection unit for selecting a numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other music information from the numerical value group obtained by the multiplication;
An arithmetic average calculating unit for calculating an arithmetic average BPM _aim of the periodic accent number BPM _O per unit time of the other music information and the b _opt ;
An optimal adjustment coefficient f _optM obtained by dividing the arithmetic mean BPM _aim by the b _opt is output, and the arithmetic mean BPM _aim is calculated as the periodic accent number BPM _O per unit time of the other music information. A division unit for outputting an optimum adjustment coefficient f _optO obtained by dividing by
A reproduction unit that reproduces the one audiovisual information by multiplying at least the optimum adjustment coefficient f _optM and simultaneously reproduces the other audiovisual information by multiplying the other audiovisual information by the optimum adjustment coefficient f _optO ,
The synchronous playback apparatus characterized in that the playback unit changes an adjustment coefficient to be multiplied to the music information from 1 to an optimal adjustment coefficient with the passage of time when the one or the other music information is played back. The playback unit plays back the third music information having an accent with a period that matches the period of the accent of the music information multiplied by the optimum adjustment coefficient simultaneously with each piece of music information. Or the synchronous reproduction apparatus of Claim 2. The reproduction unit, synchronized playback apparatus according to any one of claims 1 to 3, characterized in that the reproduction of the one music information starts reproduction of the other music information before exiting. A synchronized playback device that performs processing between two pieces of music information,
For the effect sound I and effect sound II selected in advance, the numerical value group I is calculated by multiplying the periodic accent number BPM ₁ per unit time of the effect sound I by a plurality of numerical values forming a monotonically increasing number sequence. And a multiplier for calculating a numerical value group II by multiplying a periodic accent number BPM ₂ per unit time of the effect sound II by a plurality of numerical values forming a monotonically increasing number sequence,
From the numerical value group I, the numerical value b _opt1 closest to the periodic accent number BPM ₃ per unit time of the one piece of music information is selected, and from the numerical value group II, the other piece of music information per unit time A selection unit for selecting a numerical value b _opt2 closest to the periodic accent number BPM ₄ ;
Periodic accents number BPM ₃ per unit of the one of the music information time, and outputs the optimal adjustment factor f _opt1 obtained by dividing by the b _opt1, periodic per unit time of the other music information A division unit that outputs an optimal adjustment coefficient f _opt2 obtained by dividing the number of accents BPM ₄ by the b _opt2 ;
The one piece of music information is reproduced, the effect sound I is reproduced by multiplying the optimum adjustment coefficient f _opt1 , the effect sound II is reproduced by multiplying the optimum adjustment coefficient f _opt2, and And a playback unit that plays back the other piece of music information. The effect sound I having the closest music feature quantity with the music feature quantity of one music information and the effect sound II having the closest music feature quantity with the music feature quantity of the other music information The synchronized playback apparatus according to claim 5 , further comprising an effect sound selection unit for selecting. A music database that stores multiple music data;
A music selection unit that selects any two music data triggered by a user operation;
A synchronized playback apparatus according to any one of claims 1 to 4 ,
An automatic music remix system, comprising: an output unit that outputs music data reproduced by the synchronous reproduction device as sound. A synchronized playback method that synchronizes two pieces of music information during playback,
In the multiplication unit, and a step of multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of time one audiovisual information,
A step of selecting a numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other music information from the numerical value group obtained by the multiplication in the selection unit;
A step of outputting an optimum adjustment coefficient f _opt obtained by dividing a periodic accent number BPM _O per unit time of the other music information by the b _opt in the division unit;
In the reproduction unit, at least it viewed including the steps of at least the reproduced by multiplying the optimum adjustment factor f _opt, therewith to reproduce the other audiovisual information at the same time, against the one audiovisual information,
A synchronous reproduction method characterized in that an adjustment coefficient to be multiplied with the music information is changed from 1 to an optimum adjustment coefficient with the passage of time when the one piece of music information is reproduced . A synchronized playback method that synchronizes two pieces of music information during playback,
In the multiplication unit, and a step of multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of time one of the music information,
A step of selecting a numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other music information from the numerical value group obtained by the multiplication in the selection unit;
In the arithmetic mean calculation unit, calculating the arithmetic mean BPM _aim of the periodic accent number BPM _O per unit time of the other music information and the b _opt ;
In the division unit, an optimal adjustment coefficient f _optM obtained by dividing the arithmetic average BPM _aim by the b _opt is output, and the arithmetic average BPM _aim is periodically _calculated per unit time of the other music information. _Outputting an optimum adjustment coefficient f _optO obtained by dividing by the number of accents BPM _O ;
In the reproduction unit, the one audiovisual information is reproduced by multiplying at least the optimum adjustment coefficient f _optM , and at the same time, the other audiovisual information is reproduced by multiplying at least the optimum adjustment coefficient f _optO ; at least look at including the,
A synchronous reproduction method characterized in that an adjustment coefficient to be multiplied with the music information is changed from 1 to an optimum adjustment coefficient with the passage of time when the music information of one or the other is reproduced. A synchronized playback program that synchronizes two pieces of music information during playback by being loaded on a computer,
A process of multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of one of the music information time,
A process of selecting a numerical value b _opt closest to the periodic accent number BPM _O per unit time of two pieces of music information of the other music piece from the numerical value group obtained by the multiplication;
A process of outputting the optimum adjustment coefficient f _opt by dividing the periodic accent number BPM _O per unit time of the other music information by the b _opt ;
At least viewed free play by multiplying at least the optimum adjustment factor f _opt, therewith a process for reproducing the other of audiovisual information at the same time, against the one audiovisual information,
A synchronous reproduction program characterized in that an adjustment coefficient to be multiplied with the music information is changed from 1 to an optimum adjustment coefficient with the passage of time when the one piece of music information is reproduced . A synchronized playback program that synchronizes two pieces of music information during playback by being loaded on a computer,
A process of multiplying a plurality of numerical values forming a monotonically increasing sequence against periodic accents number BPM _M per unit of one of the music information time,
A process of selecting a numerical value b _opt closest to the periodic accent number BPM _O per unit time of the other music information from the numerical value group obtained by the multiplication;
A process of calculating an arithmetic average BPM _aim of the periodic accent number BPM _O per unit time of the other music information and the b _opt ;
An optimal adjustment coefficient f _optM obtained by dividing the arithmetic mean BPM _aim by the b _opt is output, and the arithmetic mean BPM _aim is calculated as the periodic accent number BPM _O per unit time of the other music information. A process of outputting the optimum adjustment coefficient f _optO obtained by dividing by
The reproduced by multiplying at least the optimum adjustment factor f _OPTM to one audiovisual information, therewith at least seen including a process of reproducing by multiplying at least the optimum adjustment factor f _OPTO, against the other audiovisual information at the same time ,
A synchronous reproduction program characterized in that an adjustment coefficient to be multiplied with the music information is changed from 1 to an optimum adjustment coefficient with the passage of time when the music information of one or the other is reproduced.