JP2010165444A - Music playback controller, music playback system, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve a music performance without using the turn table not poor than the case of using a turn table for the music performance. <P>SOLUTION: When a disk jockey starts waving a performance operator 10L from a state in which both of performance operator 10L and 10R are not waved, a performance controlling section 44 of a performance controller 20 executes forward reproduction by output of a series of audio data in the tune data read out from a tune data memory 41 to a RAM 46 to a sound system 60 in the time-series order. Alternatively, when the disk jockey starts waving the performance operator 10R from the state in which both of performance operator 10L and 10R are not waved, the performance controlling section executes reverse reproduction by output of the series of audio data in the tune data to the sound system 60 in the reverse time-series order. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for supporting music performance by a disc jockey.

A music performance by a disc jockey is performed using one or a plurality of turntables (record players) and an audio facility that outputs the reproduced sound. Disc jockeys choose venues such as discos, clubs, and outdoor concerts that match the atmosphere of the venue and play them on the turntable while intermingling improvised lyrics and dialogue. Enliven the atmosphere.
Some disc jockeys perform music performances using personal computers with DJ support software instead of turntables. This disc jockey prepares music data in a file format such as MP3 (MPEG Audio Layer-3) in its own personal computer, and reproduces the music data while applying various sound effects through the operation of an operator. Patent Document 1 discloses a technique for supporting music performance using a personal computer by a disc jockey. When the performance sound picked up from the record by the turntable is input, the accompaniment adding device disclosed in Patent Document 1 detects the pitch and volume of the performance sound and generates an accompaniment sound that matches the pitch and volume. To do. Then, a synthesized sound obtained by mixing the performance sound and the accompaniment sound is generated in accordance with a predetermined quantization timing.

JP 2005-338602 A

Incidentally, scratching is one of the operations frequently performed by disc jockeys in music performance using a turntable. Scratching is an operation of producing a scratch sound as if the rhythm is engraved by rotating the record board directly with fingers and repeatedly playing the same part of the music in the front-rear direction. According to this scratch, it is possible to express a stimulating sound that cannot be expressed by other musical instruments. However, in the case of a music performance that does not use a turntable, there is a problem that a music performance similar to that in the case of using a turntable cannot be realized because it cannot operate like a scratch.
The present invention has been devised under such a background, and an object thereof is to realize a music performance that is not inferior to a music performance using a turntable without using a turntable.

The present invention is a storage means for storing song data, an acquisition means for acquiring a physical quantity indicating the behavior of an operator, and a means for reproducing the song data stored in the storage means, the acquisition means acquiring There is provided a music piece reproduction control device comprising reproduction control means for controlling the reproduction direction of the music piece data based on characteristics appearing in a physical quantity waveform.
In the present invention, the reproduction direction of the music data is controlled based on the feature appearing in the waveform of the physical quantity indicating the behavior of the operation element. Therefore, a disc jockey that uses this music playback control device expresses an exciting sound that cannot be expressed by other instruments by operating an operator that switches the playback direction of the music data. Music performance that is not inferior to music performance using can be realized.

It is a block diagram which shows the structure of the music reproduction system containing the music reproduction control apparatus which is 1st Embodiment of this invention. It is a figure which shows the relationship between the operation | movement which shakes a performance operator, and the mode of reproduction | regeneration of music data by the music reproduction control apparatus shown in FIG. . It is a flowchart which shows operation | movement of the music reproduction control apparatus shown in FIG. It is a flowchart which shows operation | movement of the music reproduction control apparatus shown in FIG. It is a block diagram which shows the structure of the music reproduction system containing the music reproduction control apparatus which is 2nd Embodiment of this invention. It is a figure which shows the relationship between the operation | movement which shakes a performance operator, and the mode of reproduction | regeneration of music data by the music reproduction control apparatus shown in FIG. It is a flowchart which shows operation | movement of the music reproduction control apparatus shown in FIG. It is a flowchart which shows operation | movement of the music reproduction control apparatus shown in FIG.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a music playback system including a music playback control device 20 according to the first embodiment of the present invention. This music playback system supports music performance by a disc jockey.
In FIG. 1, performance operators 10L and 10R are rod-like operators that a disc jockey grips with left and right hands, and performs operations such as shaking and twisting. The performance operator 10L includes an acceleration sensor 11L and a radio signal transmission unit 12L, and the performance operator 10R includes an acceleration sensor 11R and a radio signal transmission unit 12R.

The acceleration sensors 11L and 11R are means for detecting acceleration, which is a physical quantity indicating the behavior of the performance operators 10L and 10R when the performance operators 10L and 10R are shaken. More specifically, the acceleration sensor 11L detects the acceleration vector applied to the acceleration sensor 11L by decomposing it into the three detection axes x, y, and z directions, and detects the acceleration vector applied to the detection axes x, y, and z. Each analog signal indicating the acceleration component al _x , al _y , al _z in the direction or negative direction is output. The acceleration sensor 11R detects the acceleration vector applied to the acceleration sensor 11R by decomposing it into the three detection axes x, y, and z, and detects positive or negative acceleration components applied to the detection axes x, y, and z. Each analog signal indicating ar _x , ar _y , ar _z is output.

Radio signal transmission section 12L, for each sampling period of a predetermined time length (for example 5 ms), by digitizing samples analog signals outputted from the acceleration sensor 11L, acceleration component _{al x,} al y, the al _z It generates data indicating transmits acceleration component _{al x,} al y, the packet including data indicating al _z song reproduction control apparatus 20 via the radio section. Further, the radio signal transmission unit 12R samples and digitizes an analog signal output from the acceleration sensor 11R for each sampling period of a certain time length (for example, 5 ms), thereby digitizing the acceleration components ar _x , ar _y , ar. Data indicating _z is generated, and a packet including data indicating the acceleration components ar _x , ar _y , and ar _z is transmitted to the music reproduction control device 20 via the wireless section.

The music reproduction control device 20 includes an operation display unit 31, a radio signal reception unit 32, a control unit 30, and an interface 33.
The operation display unit 31 receives various instructions from the user and provides various information to the user.
The wireless signal receiving unit 32 receives packets transmitted from the performance operators 10L and 10R through the wireless section at a sampling period of a certain length of time (for example, 5 ms). Then, the radio signal receiving unit 32, an acceleration component _al x from the received packet from the performance operator _10L, al y, is taken out of the data indicating the al _z, acceleration component _ar x from the received packet from the performance operator 10R, ar Data indicating _y and ar _z is extracted, and the extracted data is delivered to the control unit 30.

The control unit 30 includes a song data storage memory 41, an acceleration acquisition unit 42, a ring buffer 43, and a playback control unit 44.
The song data storage memory 41 is a read-only memory that stores song data. The song data is data in which digital signals (referred to as “audio data”) obtained by sampling songs to be reproduced in a music performance are arranged in time series.

Acceleration obtaining unit 42, an acceleration component _al x from the radio signal receiving unit _32, al y, al _z and acceleration components _{ar x,} ar y, obtains the data indicating the ar _z, acceleration component _{al x, al y, al z} with obtaining the acceleration absolute value sal by substituting the following equation (1) to determine an acceleration absolute value sar by substituting acceleration component _{ar x,} ar y, the ar _z in equation (2). Each time the acceleration acquisition unit 42 obtains a pair of acceleration absolute values sal and sar, it advances the write destination address of the ring buffer 43 and writes the pair to the write destination address of the ring buffer 43.
sal = (al _x ² + al _y ² + al _z ² ) ^1/2 (1)
sar = (ar _x ² + ar _y ² + ar _z ² ) ^1/2 (2)

The reproduction control unit 44 includes a ROM 45, a RAM 46, and a CPU 47.
The ROM 45 is a read-only memory that stores the control program 50. The CPU 47 executes the control program 50 stored in the ROM 45 while using the RAM 46 as a work area. The control program 50 has a playback control function. The reproduction control function is a local peak (referred to as an “effective peak”) having an acceleration magnitude exceeding a threshold th _as from the acceleration waveforms of the acceleration absolute values sal and sar written in the ring buffer 43 by the acceleration acquisition unit 42. And a process of outputting the audio data sequence of the song data to the sound system 60 in time series order (referred to as “forward playback process”) and a process of outputting the audio data sequence to the sound system 60 in reverse time series order (“reverse” This is a function of executing “direction reproduction processing” while switching based on the detected content of the effective peak from the acceleration waveform.
The interface 33 is connected to a sound system 60 as sounding means. The sound system 60 receives audio data from the music playback control device 20 and converts it into an analog signal, a D / A converter 61 that amplifies the analog signal, and an analog signal that has been amplified by the amplifier 62 as sound. A sounding speaker 63 is provided.

The above is the configuration of the music playback system in the present embodiment. The music playback control device 20 in this music playback system detects the operation of the disc jockey shaking the performance operators 10L and 10R, and plays back the music data in the manner described below in accordance with the combination of the operations. 2A, 2B, 2C, and 2D show the time P at which the operations of the performance operators 10L and 10R are performed, and the manner in which the music data is reproduced when these operations are performed. The horizontal axis in these figures corresponds to time.
As shown in FIG. 2A, when the performance operator 10L is started from a state in which neither of the performance operators 10L and 10R is shaken, the music playback control device 20 performs normal playback (forward playback) of music data. ). Thereafter, the music playback control device 20 continues the normal playback as long as the performance operator 10L is swung at an interval shorter than a predetermined time T (for example, 3 seconds).
As shown in FIG. 2 (B), when the performance operator 10R is started to swing from the state where neither of the performance operators 10L and 10R is shaken, the music playback control device 20 performs reverse playback (reverse playback) of the music data. ). Thereafter, the playback control device 20 continues the reverse playback as long as the performance operator 10R is swung at intervals shorter than the predetermined time T.
As shown in FIG. 2 (C), when the performance operator 10R is started and then the performance operators 10L and 10R are continuously shaken after starting to swing the performance operator 10L, the music reproduction control device 20 first performs the operation. The normal reproduction that has been started is exclusively continued, and the normal operation that has been continued until the predetermined time T has elapsed after the swing of the performance operator 10L is first switched to reverse reproduction.
As shown in FIG. 2 (D), when the performance operator 10L is started and then the performance operator 10L is started and then both the performance operators 10L and 10R are continuously shaken, the music reproduction control device 20 first performs the operation. The reverse playback that has been started is continued exclusively, and after the predetermined time T has elapsed after the performance controller 10R has been swung first, the reverse playback that has been continued until then is switched to normal playback and played back.

Next, the operation of this embodiment will be described. In the present embodiment, the CPU 47 starts up a processing task for executing a series of processes shown in FIG. 3 and a processing task for executing a series of processes shown in FIG. When starting both these processing tasks, the CPU 47 reads the song data stored in the song data storage memory 41 to the RAM 46 and secures a part of the storage area of the RAM 46 as a read destination address storage area and a flag storage area. . The read destination address storage area is used as an area for storing a read destination address of music data in the RAM 46. The flag storage area is used as an area for storing the following two types of flags.
a. Normal playback flag This is a flag that is set to “on” during normal playback of music data and “off” during normal playback.
b. Reverse playback flag This is a flag that is set to “ON” while the song data is being played back in reverse and “OFF” while the song data is not played back in reverse.
The CPU 47 stores the address at which the first audio data of the song data in the RAM 46 is stored in the read destination address storage area, and after setting the two types of flags in the flag storage area to “off” as initial values, the acceleration absolute value Each time a pair of sal and sar is written into the ring buffer 43 by the acceleration acquisition unit 42, the processing tasks shown in FIGS. 3 and 4 are repeated in parallel.

In FIG. 3, the CPU 47 determines whether an effective peak has appeared in the waveform of the acceleration absolute value sal (S100). More specifically, when the acceleration absolute value sal exceeding the threshold th _sa is written in the ring buffer 43, the CPU 47 compares the acceleration absolute value sal exceeding the threshold th _sa with the acceleration absolute values sal before and after that. When the acceleration absolute value sal exceeding the threshold th _sa is larger than the acceleration absolute value sal before and after that, it is considered that an effective peak has appeared, and this is a feature that appears in the waveform.
If the CPU 47 determines in step S100 that an effective peak has appeared in the waveform of the acceleration absolute value sal (S100: Yes), the CPU 47 determines whether the reverse regeneration flag is “on” or “off” ( S110).

If the CPU 47 determines in step S110 that the reverse reproduction flag is “off” (S110: Yes), after starting the forward reproduction process (S120), the CPU 47 sets the normal reproduction flag to “on” (S130). . In the forward reproduction process in step S120, the CPU 47 searches the RAM 46 for an address stored in the read destination address storage area, and one series of audio data stored in an address after the address is stored in the RAM 46. The data are read out one by one and output to the D / A converter 61 of the sound system 60 via the interface 33.
After setting the normal reproduction flag “on”, the CPU 47 returns to step S100, and when the next pair of acceleration absolute values sal and sar is written in the ring buffer 43, the subsequent processing is repeated.

If the CPU 47 determines in step S100 that an effective peak does not appear in the waveform of the acceleration absolute value sal (S100: No), the elapsed time from when the previous effective peak appears in the waveform is a predetermined time T. (S140). If the CPU 47 determines in step S140 that the elapsed time since the last effective peak appeared in the waveform of the acceleration absolute value sal has exceeded the predetermined time T (S140: Yes), the CPU 47 stops the forward reproduction process ( After the normal playback flag is set to “OFF” (S160), the address of the RAM 46 that is the read destination of the audio data output immediately before the forward playback process is stopped is overwritten in the read destination address storage area (S170). ), The process returns to step S100.
If the CPU 47 determines in step S140 that the elapsed time from the time when the last effective peak appears does not exceed the predetermined time T (S140: No), the CPU 47 does not execute steps S150 to S170, but executes step S100. Return to.

In FIG. 4, the CPU 47 determines whether an effective peak has appeared in the waveform of the acceleration absolute value sar (S200). More specifically, when the acceleration absolute value sar exceeding the threshold th _sa is written in the ring buffer 43, the CPU 47 compares the acceleration absolute value sar exceeding the threshold th _sa with the acceleration absolute values sar before and after the acceleration. If the acceleration absolute value sar exceeding the threshold th _sa is larger than the acceleration absolute value sar before and after that, it is considered that an effective peak has appeared.
If the CPU 47 determines in step S200 that an effective peak has appeared in the waveform of the acceleration absolute value sar (S200: Yes), the CPU 47 determines whether the normal reproduction flag is “on” or “off” ( S210).

If the CPU 47 determines in step S210 that the normal reproduction flag is “off” (S210: Yes), after starting the reverse reproduction process (S220), the CPU 47 sets the reverse reproduction flag to “on” (S230). . In the backward reproduction process in step S220, the CPU 47 searches the RAM 46 for an address stored in the read destination address storage area, and one series of audio data stored in an address before the address is stored in the RAM 46. The data are read out one by one and output to the D / A converter 61 of the sound system 60 via the interface 33.
After the CPU 47 sets the reverse regeneration flag to “ON”, the process returns to step S200, and when the next pair of acceleration absolute values sal and sar is written in the ring buffer 43, the subsequent processing is repeated.

If the CPU 47 determines in step S200 that an effective peak has not appeared in the waveform of the acceleration absolute value sar (S200: No), the elapsed time since the previous effective peak appeared in the waveform is a predetermined time T. (S240). If the CPU 47 determines in step S240 that the elapsed time since the last effective peak appeared in the waveform of the acceleration absolute value sar has exceeded the predetermined time T (S240: Yes), the CPU 47 stops the reverse reproduction process ( After the reverse playback flag is set to “OFF” (S260), the address of the RAM 46 that is the read destination of the audio data output immediately before the reverse playback process is stopped is overwritten in the read destination address storage area (S270). ), The process returns to step S200.
If the CPU 47 determines in step S240 that the elapsed time from when the last effective peak appears does not exceed the predetermined time T (S240: No), the CPU 47 does not execute step S250 to step S270, but executes step S200. Return to.

  In the present embodiment described above, while the disc jockey keeps swinging the performance operator 10L held by the left hand, the music data is normally reproduced, and while the performance operator 10R held by the right hand is kept swinging, The song data is played back in reverse. Therefore, the disc jockey can express a stimulating sound that excites the atmosphere in the venue where the music performance is performed by alternately repeating the operation of shaking the performance operator 10L and the operation of shaking the performance operator 10R. . In addition, the movement that the disc jockey swings the performance controls 10L and 10R is a novel thing that cannot be seen in the music performance using the turntable, so this movement itself attracts viewers and creates an atmosphere in the venue. It can be raised more effectively.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to the drawings.
FIG. 5 is a block diagram showing a configuration of a music playback system including a music playback control device 20A according to the second embodiment of the present invention. In FIG. 5, the same reference numerals are given to parts common to the respective parts of the music reproduction control device 20 (FIG. 1) of the first embodiment.
In FIG. 5, a sound system 60A receives D / A converters 61L and 61R that receive audio data of two left and right channels from the music playback control device 20A and converts them into analog signals, and amplifiers 62L and 62R that amplify the analog signals. And speakers 63L and 63R for emitting analog signals amplified by the amplifiers 62L and 62R as sound.

Acceleration obtaining unit 42 of the music playback control unit 20A, a radio signal receiving unit 32 from the acceleration component _{al x, al y, al z} and acceleration components _{ar x,} ar y, obtains the data indicating the ar _z, acceleration component al _x , Al _y , al _z obtained by substituting acceleration absolute value sal and acceleration components ar _x , ar _y , ar _z into the above formula (2) by substituting into the above formula (1). absolute value sar, and writes the acceleration components _{ar x, ar y,} the set of ar _z to the write destination address of the ring buffer 43.

  The playback control unit 44 of the music playback control device 20A includes a ROM 45, a RAM 46, a CPU 47, a pitch shifter 51, multipliers 52L and 52R, and an adder 55. The pitch shifter 51 is a circuit that plays a role of imparting an acoustic effect (referred to as a “pitch shift effect”) that shifts the pitch to the high frequency side or the low frequency side to the reproduced sound obtained by normal reproduction or reverse reproduction of the music data. The pitch shifter 51 performs signal processing on the audio data output from the CPU 47 to shift the pitch to the high frequency side or the low frequency side, and outputs the audio data subjected to the signal processing. How much the pitch shifter 51 shifts the pitch of the audio data to the high frequency side or the low frequency side is determined according to the pitch shift parameter output from the CPU 47. Details will be described later.

  The multipliers 52L and 52R are circuits that play a role of adding an acoustic effect (referred to as “panning effect”) that biases the left and right volume balance to the left or right to the reproduced sound obtained by normal reproduction or reverse reproduction of the music data. is there. The multipliers 52L and 52R generate left and right channel audio data from the audio data output from the pitch shifter 51, perform signal processing for multiplying the left and right channel audio data by individual coefficients, and perform signal processing. Output audio data. The coefficient by which the multipliers 52L and 52R multiply the audio data is determined according to the panning coefficient parameter output from the CPU 47. Details will be described later.

The above is the configuration of the music playback system in the present embodiment. Similar to the music reproduction control device 20 in the first embodiment, the music reproduction control device 20A in this music reproduction system detects an operation in which the disc jockey swings the performance operators 10L and 10R. Then, an operation of shaking the performance operator 10L in an arbitrary direction at an interval shorter than a predetermined time T (for example, 3 seconds) is a basic operation, and according to a combination of the basic operation and the operation of shaking the performance operator 10R, The music data is reproduced in the following manner.
6 (A), 6 (B), 6 (C), and 6 (D) show the time P at which the operations of the performance operators 10L and 10R are performed, and the manner in which the music data is reproduced when these operations are performed. The horizontal axis in these figures corresponds to time.

As shown in FIG. 6A, the basic operation of the performance operator 10L is started from the state where neither of the performance operators 10L and 10R is shaken, and the performance operator 10R is detected by the acceleration sensor 11R while performing the basic operation. When it is shaken in the positive direction of the axis x, the music reproduction control device 20A starts normal reproduction of the music data. Thereafter, the music reproduction control device 20A continues normal reproduction as long as at least one of the performance operators 10L and 10R is swung in an arbitrary direction at intervals shorter than the predetermined time T.
As shown in FIG. 6B, the basic operation of the performance operator 10L is started from the state where neither of the performance operators 10L and 10R is shaken, and the performance operator 10R is detected by the acceleration sensor 11R while performing the basic operation. When it is shaken in the negative direction of the axis x, the music reproduction control device 20A starts reverse reproduction of the music data. Thereafter, as long as at least one of the performance operators 10L and 10R is swung in an arbitrary direction at intervals shorter than the predetermined time T, the music reproduction control device 20A continues the reverse reproduction.
As shown in FIG. 6C, after the normal reproduction or reverse reproduction of the music data is started, the performance operator 10R is made positive or negative on the detection axis y of the acceleration sensor 11R while performing the basic operation of the performance operator 10L. In the case of swinging in the direction, the music playback control device 20A gives a pitch shift effect to the playback sound of the music data from that time until the basic operation of the performance operator 10L stops.
As shown in FIG. 6D, after the normal reproduction or reverse reproduction of the music data is started, the performance operator 10R is made positive or negative on the detection axis z of the acceleration sensor 11R while performing the basic operation of the performance operator 10L. In the case of swinging in the direction, the music playback control device 20A gives a panning effect to the playback sound of the music data from that time until the basic operation of the performance operator 10L stops.

Next, the operation of this embodiment will be described. In the present embodiment, the CPU 47 starts up a processing task for executing a series of processes shown in FIG. 7 and a processing task for executing a series of processes shown in FIG. When starting both these processing tasks, the CPU 47 reads the song data stored in the song data storage memory 41 to the RAM 46 and secures a part of the storage area of the RAM 46 as a read destination address storage area and a flag storage area. . The usage of the read destination address storage area is the same as that of the storage area in the first embodiment. In the present embodiment, the following four types of flags are stored in the flag storage area.
a. Basic operation flag This is a flag that is set to “ON” while the basic operation is being performed, and is set to “OFF” while the basic operation is not being performed.
b. This is a flag that is set to “ON” during normal reproduction or reverse reproduction of music data and “OFF” while neither normal reproduction nor reverse reproduction is performed.
c. Pitch shift flag This is a flag that is set to “on” while the pitch shift effect is being applied to the playback sound of normal or reverse playback of song data, and “off” when the pitch shift effect is not being applied. is there.
d. Panning flag This is a flag that is set to “on” while a panning effect is applied to a playback sound obtained by normal reproduction or reverse reproduction of music data, and “off” while a panning effect is not applied.

The CPU 47 stores the address where the head audio data of the song data in the RAM 46 is stored in the read destination address storage area, and after setting the four types of flags in the flag storage area to “off” which is the initial value, the acceleration absolute value sal, sar, and every time the acceleration component _{ar x,} ar y, the set of ar _z are written to the ring buffer 43 by the acceleration obtaining unit 42, performed in parallel repetitive processing task shown in FIGS.

In FIG. 7, the CPU 47 determines whether an effective peak has appeared in the waveform of the acceleration absolute value sal (S300).
When the CPU 47 determines in step S300 that an effective peak has appeared in the waveform of the acceleration absolute value sal (S300: Yes), the CPU 47 sets the basic operation flag to “on” (S310), returns to step S300, and returns to absolute acceleration. When the next set of values sal, sar and acceleration components ar _x , ar _y , ar _z is written into the ring buffer 43, the following processing is performed. While the disc jockey is performing a basic operation that is an operation of swinging the performance operator 10L in an arbitrary direction, steps S300 to S310 in the processing task of FIG. 7 are repeated, and the basic operation flag is “ON”. to continue.

In FIG. 8, the CPU 47 determines whether the basic operation flag is “ON” or “OFF” (S400). If the CPU 47 determines in step S400 that the basic operation flag is “ON” (S400: Yes), the CPU 47 determines whether an effective peak appears in the waveform of the acceleration absolute value sar (S410).
If the disc jockey swings the performance operator 10R in either the positive or negative direction of the detection axes x, y, z while continuing the basic operation, the determination result in step S410 is “Yes”, and the basic If the performance operator 10R is not swung in any of the positive and negative directions of the detection axes x, y, and z although the operation is continued, the determination result in step S410 is “No”.
When the CPU 47 determines in step S410 that an effective peak has appeared in the waveform of the acceleration absolute value sar (S410: Yes), the CPU 47 determines whether the reproduction flag is “on” or “off” (S420). ).

If the CPU 47 determines in step S420 that the regeneration flag is “OFF” (S420: No), the CPU 47 reads the acceleration component ar _x at the effective peak that appears in the waveform of the acceleration absolute value sar from the ring buffer 43, and determines the acceleration. It is determined whether the absolute value of the component ar _x is larger than the threshold th _ar (S430).
If the CPU 47 determines in step S430 that the absolute value of the acceleration component ar _{x at} the effective peak is greater than the threshold th _ar (S430: Yes), the acceleration component ar _{x of the} forward reproduction process and the reverse reproduction process. Is started according to the direction of the sign (S440). More specifically, the CPU 47 starts the forward reproduction process when the sign of the acceleration component ar _x at the effective peak that appears in the acceleration absolute value sar is positive, and the reverse direction when the sign is negative. Start the playback process.

After starting the forward reproduction process or the reverse reproduction process, the CPU 47 turns the reproduction flag “ON” (S450), and returns to step S400.
If the CPU 47 determines in step S430 that the absolute value of the acceleration component ar _{x at} the effective peak is not greater than the threshold th _ar (S430: No), the process returns to step S400 without executing steps S440 and S450. .

Further, CPU 47 in step S420, if the regeneration flag is determined to be "ON" (S420: Yes), reads out the acceleration component ar _y in the effective peak appearing in the waveform of the acceleration absolute value sar from the ring buffer 43, It determines that the absolute value of the acceleration component ar _y is greater than the threshold value _{th ar} (S460).
CPU47 at step S460, if the absolute value of the acceleration component ar _y is determined to be greater than the threshold value _{th ar} (S460: Yes), starts the pitch shift effect imparting processing (S470).
More particularly, CPU 47 may shift the sign of the acceleration component ar _y in the effective peak if positive, which converts the absolute value of the acceleration component ar _y to the shift amount + s to the high frequency side of the pitch was converted A pitch shift parameter indicating the amount + s is output. Further, CPU 47, when the sign of the acceleration component ar _y in the effective peak is negative, the absolute value of the acceleration component ar _y in terms of the shift amount -s to the low frequency side of the pitch, in terms the shift amount - A pitch shift parameter indicating s is output. The pitch shift parameter output from the CPU 47 is input to the pitch shifter 51.

When the pitch shift parameter indicating the shift amount + s from the CPU 47 to the high frequency side is input from the CPU 47, the pitch shifter 51 shifts the pitch to the high frequency side by the amount indicated by the pitch shift parameter in the audio data output from the CPU 47 thereafter. Signal processing is performed, and audio data subjected to signal processing is output. Further, when the pitch shift parameter indicating the shift amount −s from the CPU 47 to the low frequency side is input to the pitch shifter 51, the pitch is reduced by the amount indicated by the pitch shift parameter in the audio data output from the CPU 47 thereafter. Signal processing for shifting to the frequency side is performed, and audio data subjected to signal processing is output. The output signal of the pitch shifter 51 is input from the multipliers 52L and 52R to the D / A converters 61L and 61R of the sound system 60 via the interface 33. Therefore, while the playback sound sound system pitch is shifted to the high frequency side than the original reproduced sound of the music data pitch shifting effect imparting process is performed when the sign of the acceleration component ar _y is positive 60 speakers 63L, sound is emitted from the 63R, while the pitch shift effect imparting processing when the sign of the acceleration component ar _y is negative is being performed, the original pitch than the reproduction sound is low frequency of the music data The reproduced sound shifted to the side is emitted from the speakers 63L and 63R of the sound system 60.

After starting the pitch shift effect applying process, the CPU 47 turns on the pitch shift flag (S480), and proceeds to the next step.
Further, CPU 47 in step S460, if the absolute value of the acceleration component ar _y is not greater than the threshold value _{th ar:} proceeds (S460 No), without executing the step S470 and step S480, to step .

Next, CPU 47 reads the acceleration component ar _z in the effective peak appearing in the waveform of the acceleration absolute value sar from the ring buffer 43, determines that or acceleration component ar _z is greater than the threshold value _{th ar} (S490).
If the CPU 47 determines in step S490 that the acceleration component ar _{z at} the effective peak is larger than the threshold th _ar (S490: Yes), the CPU 47 starts the panning effect applying process (S500). More specifically, when the sign of the acceleration component ar _{z at} the effective peak is positive, the CPU 47 calculates a coefficient c (0 ≦ c ≦ 1) proportional to the absolute value of the latest acceleration component ar _z. 0.0) and a panning coefficient parameter indicating the converted coefficient c is output. _If the sign of the latest acceleration component ar _z is negative, the CPU 47 converts the absolute value of the latest acceleration component ar _z into a coefficient c (0 ≦ c ≦ 1.0) that is inversely proportional to the magnitude thereof. The panning coefficient parameter indicating the converted coefficient c is output. The panning coefficient parameter output from the CPU 47 is input to the multiplier 52L and the adder 55.

The adder 55 outputs a numerical value obtained by subtracting the panning coefficient parameter from 1 to the multiplier 52R. When the panning coefficient parameter is input, the multipliers 52L and 52R perform signal processing for multiplying audio data input from the pitch shifter 51 by the coefficient c indicated by the panning coefficient parameter, and then perform the signal processing. Is output. The output signal of the multiplier 52L is input to the D / A converter 61L of the sound system 60, and the output signal of the multiplier 52R is input to the D / A converter 61R of the sound system 60. Therefore, in the panning effect imparting process in the case where the sign of the acceleration component ar _z is positive, the reproduction sound with the left and right channel volume balance biased to the left is emitted from the speakers 63L and 63R, and the sign of the acceleration component ar _z In the panning effect imparting process in the case where is negative, a reproduction sound in which the volume balance of the left and right two channels is biased to the right is emitted from the speakers 63L and 63R.

After starting the panning effect imparting process, the CPU 47 turns the panning flag “ON” (S510), and returns to step S400.
If the CPU 47 determines in step S490 that the absolute value of the acceleration component ar _z is not greater than the threshold th _ar (S490: No), the CPU 47 returns to step S400 without executing steps S500 and S510.

In FIG. 7, when the CPU 47 determines that an effective peak does not appear in the waveform of the acceleration absolute value sal (S300: No), the elapsed time from when the previous effective peak appears in the waveform of the acceleration absolute value sal. It is determined whether or not the predetermined time T has been exceeded (S320). CPU47 returns to step S300, when it determines with the elapsed time from the time of the last effective peak appearing not exceeding predetermined time T in step S320 (S320: No).
If the CPU 47 determines in step S320 that the elapsed time since the last effective peak appeared in the waveform of the acceleration absolute value sal exceeds the predetermined time T (S320: Yes), the basic operation flag is set to “off”. (S330).

Next, the CPU 47 determines whether the pitch shift flag is “ON” or “OFF” (S340).
If the CPU 47 determines in step S340 that the pitch shift flag is “ON” (S340: Yes), the CPU 47 stops the pitch shift effect applying process (S350), and then turns the pitch shift flag “OFF” (S360). ).
If the CPU 47 determines in step S340 that the pitch shift flag is “OFF” (S340: No), the CPU 47 proceeds to the next step without executing steps S350 and S360.

Next, the CPU 47 determines whether the panning flag is “ON” or “OFF” (S370).
If the CPU 47 determines in step S370 that the panning flag is “ON” (S370: Yes), the CPU 47 stops the panning effect applying process (S380), and then turns the panning flag “OFF” (S390).
After setting the panning flag “off”, the CPU 47 returns to step S300.
If the CPU 47 determines in step S370 that the panning flag is “OFF” (S370: No), the CPU 47 returns to step S300 without executing steps S380 and S390.

In FIG. 8, when the CPU 47 determines that the basic operation flag is “off” (S400: No), the elapsed time from the time when the last effective peak appears in the waveform of the acceleration absolute value sar is a predetermined time T. It is determined whether it has been exceeded (S520). If the disc jockey has not swung the performance operator 10L for a predetermined time T or more and the performance operator 10R has not swung for the predetermined time T or more, the process proceeds from step S400 to step S520, and the determination result in step S520 is “Yes”. Become. If the disc jockey has not swung the performance operator 10L for a predetermined time T or more but has swung the performance operator 10R, the process proceeds from step S400 to step S520, and the determination result in step S520 is “No”.
If the CPU 47 determines in step S520 that the elapsed time from the time when the last effective peak appears exceeds the predetermined time T (S520: Yes), the forward reproduction process or reverse reproduction started in step S440. The processing is stopped (S530), the reproduction flag is set to “OFF” (S540), and the address of the RAM 46 that is the read destination of the audio data output immediately before the stop of the forward reproduction process or the reverse reproduction process is read out address. After overwriting the storage area (S550), the process returns to step S400.

  In the present embodiment described above, an operation of continuously swinging the performance operator 10L in an arbitrary direction is a basic operation, and the disc jockey swings the performance operator 10R in the positive direction of the detection axis x while performing the basic operation. The music data is normally reproduced at the same time, and the music data is reversely reproduced when the music data is shaken in the negative direction of the detection axis x. Also, when the disc jockey swings the performance operator 10R in the positive or negative direction of the detection axis y while performing the basic operation, a pitch shift effect is given to the reproduced sound of the music data, and the positive or negative of the detection axis z When shaken in the negative direction, a panning effect is given to the playback sound of the song data. Therefore, it is possible to express a reproduction sound with a richer musical expression than the music reproduction control device 20 of the first embodiment.

(Other embodiments)
As mentioned above, although embodiment of this invention was described, this invention can have other embodiment. For example, it is as follows.
(1) In the first and second embodiments, a local peak having an acceleration magnitude exceeding the threshold value th _as in the waveform of the acceleration absolute values sal and sar is set _as an effective peak that is a feature that appears in the waveform, and music reproduction control is performed. The CPU 47 of the devices 20 and 20A uses the occurrence of an effective peak in the waveforms of the acceleration absolute values sal and sar as triggers to switch between normal reproduction and reverse reproduction and to add an acoustic effect to the reproduced sound. However, when a predetermined feature different from the local peak having the magnitude of acceleration exceeding the threshold th _as appears in the waveform of the absolute acceleration values sal and sar, the switching between normal reproduction and reverse reproduction and the An acoustic effect may be imparted to the reproduced sound. For example, when the disc jockey shakes the hand holding the performance operators 10L and 10R in a certain direction, a reverse reaction force is applied to the performance operators 10L and 10R immediately before a force in that direction is applied. Therefore, if the behavior of the performance operators 10L and 10R is due to the movement of the hand of the person holding the performance operators 10L and 10R, strictly speaking, there is a slight time difference Δt 2 in the waveforms of the acceleration absolute values sal and sar. Two local peaks should occur in succession. Therefore, the CPU 47 generates a local peak exceeding the threshold th _back (th _back <th _as ) in the waveform of the acceleration absolute values sal and sar, and generates a local peak exceeding the threshold th _as with a delay of Δt from the local peak. If this is the case, this may be detected as a feature of the waveform, and switching between normal reproduction and reverse reproduction, or adding an acoustic effect to the reproduced sound. According to this aspect, it is possible to recognize the difference between the behavior of the performance operators 10L and 10R due to the movement of the disc jockey's hand and the behavior that is not, and to realize a music performance that matches the intention of the disc jockey.

(2) In the second embodiment, the song playback control unit 20A, when the acceleration components ar _y in the effective peak is larger than the threshold value th _ar, pitch shifting effect imparted to the reproduced sound of the music data, the effective When the acceleration component ar _{z at the} peak was larger than the threshold th _ar , a panning effect was added to the reproduced sound of the music data. However, other types of sound effects such as reverb and distortion may be applied.

(3) In the first and second embodiments, the number of performance operators may be one, or may be three or more. When one performance operator is used, the music reproduction control devices 20 and 20A detect acceleration components a _x and a detected by decomposing acceleration vectors applied to the performance operators in the three detection axes x, y, and z directions. _{y 1} and a _z are acquired, and a positive local peak having a magnitude exceeding the threshold is present in the waveform of one of the three types of acceleration components a _x , a _y , and a _z (for example, acceleration component a _x ). The music data may be normally reproduced when it appears, and the music data may be reversely reproduced when a negative local peak whose size exceeds a threshold value appears. Furthermore, when a positive or negative local peak having a magnitude exceeding the threshold th appears in the waveform of the remaining one or two acceleration components, various acoustic effects may be given to the reproduced sound of the song data. In addition, when the number of performance operators is one, the music reproduction control devices 20 and 20A acquire an acceleration absolute value obtained by synthesizing an acceleration vector applied to the performance operator, and the waveform of the acceleration absolute value exceeds a threshold value. Each time a positive or negative local peak appears, the direction of music data playback may be controlled from normal playback to reverse playback, or from reverse playback to normal playback.

(4) In the first and second embodiments, sensors other than the acceleration sensors 11L and 11R such as a magnetic sensor, a gyro sensor, a pressure sensor, a tilt sensor, a speed sensor, and an amplitude sensor are used as the performance operators 10L and 10R. Built-in and triggered by the appearance of an effective peak in the physical quantity waveform indicating the behavior of the performance controller detected by the sensor, switching between normal playback and reverse playback and applying an acoustic effect to the playback sound May be.

(5) In the first and second embodiments, the song data stored in the song data storage memory 41 is data in which digital signals obtained by sampling songs to be reproduced in a music performance are arranged in time series. there were. However, MIDI data in which MIDI (Musical Instrument Digital Interface) events indicating the performance of a song to be played back in a music performance are arranged in chronological order may be played back as song data.

(6) In the first and second embodiments, the radio signal transmitters 12L and 12R are built in the performance operators 10L and 10R. However, the wireless signal transmitters 12L and 12R are built in a housing separate from the performance operators 10L and 10R, and the housing containing the wireless signal transmitters 12L and 12R is attached to the body of the disc jockey. May be.

(7) A program for realizing the same functions as those of the acceleration acquisition unit 42, the ring buffer 43, and the reproduction control unit 44 of the performance control devices 20 and 20A in the first and second embodiments is installed in a computer, and the computer May be operated as the performance control device 20. In this case, for example, the control program 50 may be installed in a mobile phone incorporating the acceleration sensors 11L and 11R and the sound source so that the casing of the mobile phone itself functions as a performance operator.

(8) In the second embodiment, the basic operation is an operation in which the performance operator 10L is shaken in an arbitrary direction at an interval shorter than a predetermined time T (for example, 3 seconds), and the basic operation and the performance operator 10R are shaken. Whether or not to execute forward reproduction processing, backward reproduction processing, pitch shift effect application processing, and panning effect application processing is determined according to the combination of operations. However, whether or not to perform the forward reproduction process and the reverse reproduction process is determined according to the operation of one of the performance operators 10L and 10R (for example, the performance operator 10L), and the pitch is determined according to the other operation. Whether to execute the shift effect applying process and the panning effect applying process may be determined. In this aspect, the CPU 47 of the performance control device 20A performs the following processing, for example. The CPU 47 starts the forward reproduction process when the performance operator 10L that has been in a stationary state is swung in the positive direction of the detection axis x of the acceleration sensor 11L, and reverses when it is swung in the negative direction of the detection axis x. Start the playback process. Then, after starting the forward reproduction process or the reverse reproduction process, the CPU 47 continues the reproduction process as long as the performance operator 10L is swung at intervals shorter than the predetermined time T. Further, the CPU 47 performs a pitch shift effect applying process when the performance operator 10R is swung in the positive or negative direction of the detection axis y of the acceleration sensor 11R during the forward reproduction process or the reverse reproduction process. . Further, the CPU 47 performs a panning effect applying process when the performance operator 10R is swung in the positive or negative direction of the detection axis z of the acceleration sensor 11R during the forward reproduction process or the reverse reproduction process.

(9) In the second embodiment, the swing of the size (specifically when the performance operators 10R is swung to the positive or negative direction of the detection axis y of the acceleration sensor 11R, the absolute acceleration component ar _y The pitch shift amount in the pitch shift effect applying process is determined according to the value. However, the shift amount may be determined according to the swing of the performance operator 10L. In this aspect, the CPU 47 of the performance control device 20A performs the following processing, for example. When the performance operator 10L in a stationary state is swung in the positive (negative) direction of the detection axis x of the acceleration sensor 11L, the CPU 47 calculates the absolute value | al _x | of the acceleration component al _x at that time as the RAM 46 And the forward reproduction process (reverse reproduction process) is started. Thereafter, when the performance operator 10R is swung in the positive (negative) direction of the detection axis y of the acceleration sensor 11R, the CPU 47 calculates the absolute value | al _x | of the acceleration component al _x stored in the RAM 46 as the pitch. The pitch shift parameter indicating the shift amount + s (−s) converted to the shift amount + s (−s) toward the high frequency side (low frequency side) is output to the pitch shifter 51.

DESCRIPTION OF SYMBOLS 10 ... Performance operator, 11 ... Acceleration sensor, 12 ... Radio signal transmission part, 20 ... Music reproduction control apparatus, 30 ... Control part, 31 ... Operation display part, 32 ... Radio signal reception part, 33 ... Interface, 41 ... Music Data storage memory 42 ... Acceleration acquisition unit 43 ... Ring buffer 44 ... Reproduction control unit 45 ... ROM 46 ... RAM 47 ... CPU 50 ... Control program 51 ... Pitch shifter 52 ... Multiplier 53 ... Addition 60 ... sound system, 61 ... D / A converter, 62 ... amplifier, 63 ... speaker.

Claims (7)

Storage means for storing song data;
An acquisition means for acquiring a physical quantity indicating the behavior of the operator;
Replay control means for replaying music data stored in the storage means, and for controlling the direction of replay of the music data based on features appearing in the waveform of the physical quantity obtained by the obtaining means. A music reproduction control device characterized by the above. The acquisition means acquires a plurality of types of physical quantities indicating the behavior of the operation element,
The reproduction control means reproduces the music piece data in the forward direction when a predetermined characteristic appears in the waveform of the first type of physical quantity among the plurality of types of physical quantities acquired by the acquisition means, and the acquisition means 2. The music piece reproduction control device according to claim 1, wherein when a predetermined characteristic appears in a waveform of a second type of physical quantity among a plurality of obtained types of physical quantity, the music piece data is reproduced in a reverse direction. .   The acquisition means, when a predetermined feature appears in a waveform of a third type of physical quantity among the plurality of types of physical quantity, gives a predetermined acoustic effect to the reproduced sound of the song data. Item 3. The music playback control device according to Item 2.   4. The music reproduction control apparatus according to claim 1, wherein the acquisition unit acquires acceleration applied to each of the plurality of operators as the plurality of types of physical quantities. 5.   The acquisition unit acquires an acceleration component obtained by resolving acceleration applied to each of the plurality of operators in a plurality of different axial directions as the plurality of types of physical quantities. The music reproduction control device according to item. A sensor that is built in the operator and detects acceleration applied to the operator;
Transmitting means for transmitting the acceleration detected by the sensor;
A music reproduction control device according to claim 4 or 5,
A music reproduction system comprising: a sound generation means for receiving a signal indicating a reproduction sound of music data from the music reproduction control device and generating a sound indicated by the signal. On the computer,
A program that realizes reproduction control means for reproducing the music data stored in the storage means, and for controlling the reproduction direction of the music data based on features appearing in the waveform of the physical quantity indicating the behavior of the operation element.

Images