JP6705409B2 - Music reproduction control device, music reproduction control method, and music reproduction control program - Google Patents

Description

The present invention relates to a music reproduction control device, a music reproduction control method, and a music reproduction control program.

2. Description of the Related Art Conventionally, it is known to notify a user of various operation information by a method such as light and vibration.
For example, Patent Document 1 discloses that, in an electronic musical instrument, a chair body communicatively connected to the musical instrument body vibrates when the user makes a mistake in playing the musical instrument, in response to the mistaken performance.
According to such a method, the performer can recognize an error in his/her performance by tactile sense.

By the way, recently, a device for performing playback control of music, such as a DJ controller, which allows users to easily enjoy a DJ (Disc Jockey) experience has been developed.
When performing remix work of music or outputting audio of remixed music by such a DJ controller or the like, it is necessary to match pitches of music to be connected so as not to cause unnatural connection of music.
Specifically, the sound of the turntable being played is output from the speaker for monitoring, while the sound of the other turntable is output from the headphones to match the pitch of each song and the timing of the start beat.

Such pitch matching is a basic technique indispensable for a DJ to naturally switch a plurality of music pieces, and is a real pleasure of DJ.
However, pitch matching is a fairly advanced technique of accurately listening to the pitch of each song and adjusting it while listening to a plurality of songs at the same time, and it is difficult for DJ beginners and the like to be frustrated because they cannot make good pitch adjustments. It often happens.
Therefore, for a user who is unfamiliar with pitch matching, it is desired to equip the device with a means for guiding the user's operation like the electronic musical instrument of Patent Document 1.

JP, 2008-39856, A

However, the music reproduction control device such as a DJ controller recognizes what is wrong with the user even when the music reproduction is performed when the music reproduction is performed with the pitch shifted as in the case where the electronic musical instrument is erroneously played. It is difficult to do and does not help to learn the technique of correct pitch matching.
For this reason, there is a risk that the user will not be able to successfully adjust the pitch indefinitely and will be frustrated. The same applies to operations for controlling the reproduction of music other than pitch adjustment, and it is difficult to accurately recognize the current reproduction state and perform the necessary instruction operation.

The present invention has been made in view of the above circumstances, and a music reproduction control device, a music reproduction control method, and a music reproduction control method capable of accurately recognizing a reproduction state of a music being reproduced and performing a necessary instruction operation. It is intended to provide a music reproduction control program.

In order to solve the above problems, the music reproduction control device of the present invention is a manipulator for a user to instruct a change in a music reproduction period or a phase, and a drive unit for causing the manipulator to physically move. And a control unit that changes a motion state of the operation unit by the drive unit according to a change in a reproduction cycle or a phase of the music piece according to an operation of the operation unit.

According to the present invention, it is possible to accurately recognize the reproduction state of the music being reproduced and perform the necessary instruction operation.

It is a typical block diagram which shows schematic structure of the music reproduction control apparatus and terminal device in this embodiment. It is a principal part block diagram which showed the control structure of the music reproduction control apparatus and terminal device which concern on this embodiment. It is explanatory drawing which shows the positional relationship between an operator and a vibration generation means. It is a flow chart which shows music reproduction control processing in this embodiment. It is explanatory drawing which showed typically the relationship between the crossfader voltage value (VCF) and the reproduction condition of each music.

An embodiment of a music reproduction control device according to the present invention will be described with reference to FIGS. 1 to 5.
It should be noted that the embodiments described below have various technically preferable limitations for implementing the present invention, but the scope of the present invention is not limited to the following embodiments and illustrated examples.

"overall structure"
FIG. 1 is a schematic configuration diagram of a DJ controller 1 which is a music reproduction control device according to the present embodiment and a terminal device 3 connected to the DJ controller 1.
In the present embodiment, a DJ controller 1 that controls the reproduction of music and a terminal device 3 that includes music sound source data and the like are connected to form a music reproduction system.

<<Structure of music reproduction control device>>
As described above, in the present embodiment, the case where the music reproduction control device is the DJ controller 1 will be described as an example.
The DJ controller 1 is an electronic device that can realize the same function as that of a conventional analog DJ table including two decks each having a turntable and a mixer by one device.

As shown in FIG. 1, the DJ controller 1 of the present embodiment is provided with a deck area DL on the left side and a deck area DR on the right side in FIG. 1 corresponding to two decks and a mixer in an analog DJ table. A mixer area Ma is between the two deck areas DL and DR.
As will be described later, the DJ controller 1 receives the music source data from the terminal device 3 and is capable of performing operations related to simultaneous reproduction of a plurality of music in parallel. The DR is an area corresponding to different music.
In the following description, an example is shown in which the deck area DL corresponds to the music A and the deck area DR corresponds to the music B.
Note that the DJ controller 1 is provided with a power button and operation buttons for performing various operations in addition to those shown in FIG. 1, but those not particularly related to the present embodiment are shown and described. Is omitted.

In the deck area DL, a left pitch fader 16 that adjusts the reproduction timing of the music A is provided as an operator who performs an operation related to the reproduction of the music.
In the present embodiment, the reproduction timing includes the reproduction pitch (musical speed, BPM (Beat Per Minute)), beat position, and the like. By aligning not only the pitch but also the heads of beats, it is possible to perform smooth switching without a sense of discomfort when switching the music to be output (reproduced) from the speaker 14 (see FIG. 3).
The left pitch fader 16 includes a knob 161 for adjusting the reproduction timing of the music A and a slide rail 162 for slidingly moving the knob 161. In the left pitch fader 16, for example, the reproduction pitch becomes faster as the knob 161 is slid upward in FIG. 1, and the reproduction pitch becomes slower as it is slid downward.
Further, in the deck region DR, a right pitch fader 17 for adjusting the reproduction timing of the music B is provided as an operator for performing an operation related to the reproduction of the music by the user.
The right pitch fader 17 includes a knob 171 that adjusts the reproduction timing of the music B and a slide rail 172 that slides the knob 171. Similar to the left pitch fader 16, the right pitch fader 17 is configured such that, for example, the playback pitch becomes faster as the knob 171 is slid upward, and the playback pitch becomes slower as it is slid downward. ..

Further, in the mixer area Ma, a cross fader 18 is provided as an operator for adjusting the volume balance of a plurality of music pieces.
The crossfader 18 includes a knob 181 that adjusts the volume balance between the music A and the music B, and a slide rail 182 that slides the knob 181.
In the present embodiment, the crossfader 18 has, for example, the volume of the music A becomes louder and the volume of the music B becomes smaller as the knob 181 is slid to the left in FIG. 1, and when the knob 181 moves to the left end. Only the music A is output.
On the contrary, as the knob 181 is slid to the right, the volume of the music B becomes louder and the volume of the music A becomes smaller. When the knob 181 moves to the right end, only the music B is output.
Further, when the position of the picking portion 181 is located substantially in the center of the slide rail 182, the music A and the music B are output with substantially the same volume.

As shown by a broken line in FIG. 1, a left vibrator that transmits vibrations to the knobs 161, 171, 181 near the left pitch fader 16, the right pitch fader 17, and the cross fader 18 and inside the DJ controller 1, respectively. 19, a right vibrator 20, and a cross vibrator 21 are provided.
The left vibrator 19, the right vibrator 20, and the cross vibrator 21 are vibration generating means for informing the user of the operation status of the manipulator by causing the manipulator to move. In the present embodiment, the manipulator is used. It is designed to generate vibration. As the left oscillator 19, the right oscillator 20, and the cross oscillator 21, for example, a vibration element such as a piezoelectric element (piezoelectric element) or a small actuator such as a motor is preferably applied.
In the present embodiment, the left oscillator 19, the right oscillator 20, and the cross oscillator 21 are respectively provided on the knobs 161, 171, 181 of the left pitch fader 16, the right pitch fader 17, and the cross fader 18, which are operators. It transmits vibration.
The configurations of the left vibrator 19, the right vibrator 20, and the cross vibrator 21 are not particularly limited as long as they can transmit vibration, and other than those exemplified above can be applied.
The left oscillator 19, the right oscillator 20, and the cross oscillator 21 are reproduction pitches of the music A and the music B adjusted by the left pitch fader 16 and the right pitch fader 17 under the control of the vibration control unit 113 described later. Vibration is generated in response to the reproduction timing of such as.

FIG. 2 is an explanatory view schematically showing the positional relationship between the cross fader 18 and the cross vibrator 21. Although FIG. 2 illustrates the cross fader 18 and the cross oscillator 21, the positional relationship between the right pitch fader 17 and the right oscillator 20, and the left pitch fader 16 and the left oscillator 19 is similar to this. Is.
As shown in FIG. 2, the substrate 5 is provided below the cross fader 18, and the cross vibrator 21 is arranged on the substrate 5 below the cross fader 18 or in the vicinity thereof.
The cross vibrator 21 may be arranged at a position where vibration is transmitted to the fingertip when the user's finger touches the knob 181 of the cross fader 18, and the specific arrangement is not limited to the illustrated example. ..

Further, in the present embodiment, the left oscillator 19, the right oscillator 20, and the cross oscillator 21, which are the vibration generating means, have the operation direction of the operator when the user performs an operation related to the reproduction of the music, that is, the left oscillator. The left pitch fader 16, the right pitch fader 17, and the cross fader 18 (these knob portions are arranged in a direction different from the direction in which the pitch fader 16, the right pitch fader 17, and the cross fader 18 (the knob portions 161, 171, 181) are operated. 161, 171, 181) is made to vibrate.
Specifically, for example, as shown in FIG. 2, when the knob 181 of the crossfader 18 which is an operator moves horizontally in the XY plane, the cross vibrator 21 which is vibration generating means. Causes the knob 181 to vibrate in the height direction (vertical direction) Z orthogonal to the XY plane.
As described above, by vibrating the manipulator in a direction different from the operation direction of the manipulator (the knob 181 of the crossfader 18 and the like), the user can more clearly feel the presence or absence of vibration and the strength.

<<Control configuration>>
FIG. 3 is a block diagram showing a main control configuration of the DJ controller 1 and the terminal device 3.
As shown in FIG. 3, the DJ controller 1 includes a control unit 11 and a storage unit 12.
In the present embodiment, the control unit 11 is composed of a processing IC such as an LSI or a CPU.
The storage unit 12 stores information necessary for the control unit 11 to realize various functions.
In the present embodiment, it is assumed that analysis information such as pitch information of music is output from the terminal device 3 (that is, analysis of music is not performed by the controller 11 on the DJ controller 1 side). is doing.
Further, it is assumed that various functions such as a multiplexer are mounted on the processing IC such as the LSI and the CPU.
The configuration of the control unit 11 is not limited to this, and for example, the control unit 11 may be configured by distributing various functions to a plurality of discrete ICs or the like. In this case, the control unit 11 can be constructed at a lower cost.

In the present embodiment, the control unit 11 functions as the reproduction state specifying unit 111, the fader information detecting unit 112, the vibration control unit 113, and the audio output control unit 114.
The reproduction state identification unit 111 is a reproduction state identification unit that obtains analysis information regarding music.
In the present embodiment, as described above, the music source data of each music is transmitted from the terminal device 3 to the DJ controller 1, and the reproduction state identifying unit 111 links the music source data. The analysis information including the attached reproduction timing (reproduction pitch, etc.) is acquired.
In addition, the reproduction state specifying unit 111, which is a reproduction state specifying unit, analyzes the music being reproduced while the DJ controller 1 is reproducing the music and acquires reproduction music analysis information. For example, the reproduction state identifying unit 111 acquires information regarding the reproduction timing of the music being reproduced as reproduction music analysis information.
When the user operates the left pitch fader 16 and the right pitch fader 17, which are the operators, the playback timing of the music being played is changed by the operation of the left pitch fader 16 and the right pitch fader 17. The reproduction state identifying unit 111 acquires such changes in the reproduction timing of the music being reproduced at any time.

In order for the reproduction state specifying unit 111, which is a reproduction state specifying unit, to specify the reproduction state of the music, information such as a melody, a chord and a bar included in the music data stored corresponding to the reproduction position is analyzed. The playback state may be specified by analyzing the MIDI data output corresponding to the playback location, and the playback status may be identified by analyzing the MIDI data output corresponding to the playback location. The reproduction state may be specified by analyzing the waveform data.

The fader information detection unit 112 detects operation state information of the left pitch fader 16, the right pitch fader 17, and the cross fader 18, that is, information such as the positions of the knobs 161, 171, 181.
For example, the crossfader 18 switches using a variable resistance, and the fader information detection unit 112 monitors the voltage division value (voltage value) by the variable resistance that changes by operating the knob 181. The position of the picking portion 181 is detected.
In the following embodiments, the partial pressure value (voltage value; AD value) of the crossfader 18 is also referred to as “VCF” (see FIGS. 4 and 5).

The vibration control unit 113 controls the left vibrator 19, the right vibrator 20, and the cross vibrator 21 that are vibration generating means according to the reproduction state of the music acquired by the reproduction state specifying unit 111 that is the reproduction state specifying unit. It is a vibration control means that outputs a control signal and controls the operation thereof.
In the present embodiment, the information regarding the reproduction timing of the music being reproduced is acquired by the reproduction state identifying unit 111, and the vibration control unit 113 causes the left vibrator 19 based on the reproduction timing of the music being reproduced. , And controls the operations of the right vibrator 20 and the cross vibrator 21.
For example, the vibration control unit 113 uses the left oscillator 19, the right oscillator 20, and the cross oscillator 21 for the left pitch fader 16 at a cycle corresponding to the reproduction timing of the music being reproduced acquired by the reproduction state specifying unit 111. , The right pitch fader 17 and the cross fader 18 (the knobs 161, 171, 181) are caused to change the presence or absence of vibration or the intensity of vibration. That is, for example, when the reproduction pitch of the music A operated by the left pitch fader 16 and the reproduction pitch of the music B operated by the right pitch fader 17 match, the left vibrator 19 and the right vibration are used. The child 20 may not be vibrated, or may be vibrated strongly when the reproduction timing is largely deviated.

In addition, in the present embodiment, the operator (for example, the crossfader 18) is configured to perform an operation related to the reproduction of a plurality of music pieces that are simultaneously reproduced, and the vibration control unit 113 reproduces the plurality of music pieces. The vibration generating means (for example, the cross vibrator 21) is controlled so as to vibrate the operator (for example, the knob 181 of the cross fader 18) according to the timing.
Further, in the present embodiment, a plurality of operators (for example, the left pitch fader 16 and the right pitch fader 17) that independently operate the reproduction timings of the plurality of songs are provided, and the vibration control unit 113 performs the plurality of operations. Each of the children (for example, the left pitch fader 16 and the right pitch fader 17) corresponds to the reproduction timing of the music (for example, the music A for the left pitch fader 16 and the music B for the right pitch fader 17) that is the operation target of each operator. The vibration generating means (for example, the left vibrator 19 and the right vibrator 20) is controlled so as to vibrate in a cycle.
Further, the vibration control unit 113 vibrates the plurality of left pitch faders 16, the right pitch faders 17, and the cross faders 18 (the knobs 161, 171, 181) according to the degree of deviation of the reproduction timing in the plurality of songs. The left oscillator 19, the right oscillator 20, and the cross oscillator 21 may be controlled so as to change at least one of the intensity, the cycle, and the direction.

Further, when one of the plurality of music pieces (for example, the music piece A) is in a state where the reproduced sound is output and the other music piece (for example, the music piece B) is in a state where the reproduced sound is muted, the vibration control unit 113 At least a vibration generating means (right vibration) for vibrating the operator (for example, the right pitch fader 17 or the cross fader 18) according to the information about the reproduction timing of the music (music B in this example) with the reproduction sound muted. The child 20 and the cross vibrator 21) may be controlled.
When the DJ switches the music, it is necessary to accurately match the pitch to the music whose reproduced sound is output by the switching, that is, the music which is currently muted (the music B in this example). By vibrating the manipulator (for example, the right pitch fader 17 or the cross fader 18) according to the information on the reproduction timing of the music (music B in this example), the user can be effectively warned about pitch matching. it can.
Further, for the crossfader 18 which is an operator for adjusting the volume balance of a plurality of music pieces, the vibration control unit 113 controls the operator (in accordance with the adjustment value of the volume balance at a cycle corresponding to the reproduction timing of any music piece). That is, the vibration generating means (that is, the cross vibrator 21) may be controlled so as to change whether or not the cross fader 18) is vibrated.
For example, in the example of the present embodiment, when the volume of the music A is high, the operator (that is, the cross fader 18) is operated at a cycle corresponding to the reproduction timing of the music A whose reproduction pitch is being operated by the left pitch fader 16. When the volume of the music B is high, the operator (that is, the crossfader 18) is vibrated in a cycle corresponding to the reproduction timing of the music B whose reproduction pitch is being operated by the right pitch fader 17. To do.

The audio output control unit 114 controls the audio output unit 13 to output music from the speaker 14 or the headphones 15.
The audio output control unit 114 responds to the operation by the left pitch fader 16, the right pitch fader 17, and the cross fader 18 to output music from the speaker 14 or the like via the audio output unit 13 (the music A or the music in this embodiment). The music B), the reproduction pitch and the volume of the music to be output are controlled.

In the present embodiment, the DJ controller 1 is connected to the terminal device 3 via the interface 22.
The terminal device 3 is, for example, a personal computer as shown in FIG.
The terminal device 3 is not limited to this, and may be a portable terminal device, a tablet terminal device, or the like.
The terminal device 3 includes a control unit 31, a storage unit 32, an interface 33 connected to the DJ controller 1, and the like.
The connection format between the DJ controller 1 and the terminal device 3 is not particularly limited. For example, wired connection may be made via USB or the like, or connection may be made by wireless communication of various standards.

The control unit 31 of the terminal device 3 collectively controls each unit of the device in cooperation with the system program 322 stored in the program storage area 321 of the storage unit 32.
Further, in the present embodiment, the music reproduction program 323 is stored in the program storage area 321. The music reproduction program 323 is an application program for performing music reproduction control in cooperation with the DJ controller 1.
Further, the storage unit 32 is provided with a music sound source data storage area 324 in which music sound source data, music analysis information associated with each music (for example, data regarding a reproduction timing including a reproduction pitch and the like), and the like are stored. Has been.

In the present embodiment, as described above, analysis of music is performed by the control unit 31 on the terminal device 3 side, and the music sound source data storage area 324 of the terminal device 3 stores the analysis information of the music source data of each music. It is stored with.
Musical sound source data and music analysis information are appropriately transmitted to the DJ controller 1 in response to a request from the DJ controller 1.

<Operation of music reproduction control device>
Next, the operation of the DJ controller 1 which is the music reproduction control device according to the present embodiment will be described.
FIG. 4 is a flowchart illustrating a music reproduction control process of the DJ controller 1 according to this embodiment.
As shown in FIG. 4, when performing the music reproduction control process of the DJ controller 1, the music set by the user in the deck area DL (for example, music A) and the music set by the user in the deck area DR (for example, music B) are arbitrary. The DJ controller 1 acquires the sound source data of the music selected by the user from the terminal device 3 (step S1).
The control unit 11 of the DJ controller 1 sets the music selected by the user in the deck area DL and the deck area DR, respectively (step S2). In the present embodiment, the music A is set in the left deck area DL, and the music B is set in the right deck area DR. Further, the reproduction state specifying unit 111 acquires information on the reproduction timing (reproduction pitch, etc.) of each music as the reproduction music analysis information (step S3).
Then, the control unit 11 sets the reproduction timing (pitch PL) of the music A in the deck area DL and the reproduction timing (pitch PR) of the music B in the deck area DR (step S4).
Further, the control unit 11 acquires the AD value (VCF) of the voltage value of the crossfader 18 (step S5).

The control unit 11 acquires the reproduction status of each music (the volume adjustment status of each music by the crossfader 18) based on the AD value (VCF) of the voltage value of the crossfader 18, and based on this, the vibration control unit. Reference numeral 113 controls the operations of the left vibrator 19, the right vibrator 20, and the cross vibrator 21.
FIG. 5 is an explanatory diagram that schematically shows the relationship between the voltage value (VCF) of the crossfader 18 and the reproduction status of each song.
In the crossfader 18 of the present embodiment, when the value of the variable resistance is the largest, the knob 181 moves to the left end of the slide rail 182. In this state, the volume of the music A in the deck area DL becomes MAX, and the deck The music B in the area DR is muted. On the contrary, when the value of the variable resistance is the smallest, the knob 181 has moved to the right end of the slide rail 182. In this state, the volume of the music B in the deck area DR becomes MAX and the music A in the deck area DL is muted. To be done. Further, when the knob 181 is located between the left end and the right end of the slide rail 182, the sound volumes of the music A and the music B are linearly increased and decreased, and when the slide rail 182 is positioned near the middle of the left end to the right end of the slide rail 182, The volumes of the music A and the music B are about the same.
The correspondence between the position of the knob 181 of the crossfader 18 and the change in the volume of the music A and the music B is not limited to this. For example, the volume of one of the songs is MAX up to a certain threshold, and when the knob 181 moves to a position exceeding the certain threshold, the volume of the one song is muted and the volume of the other song becomes MAX. May be associated with each other.

In FIG. 5, VTR is a threshold value used by the crossfader 18 to determine whether or not the volume of the song A in the deck area DL is above a certain level, and VTR is the volume of the song B in the deck area DR by the crossfader 18. It is a threshold value for determining whether or not it is equal to or more than a certain value.
As shown in FIG. 4, the vibration control unit 113 determines which one of the music A in the deck area DL and the music B in the deck area DR is mainly output by sound, that is, the VCF is equal to or more than the preset left threshold value VTR. It is determined whether or not (step S6).
When the VCF is equal to or higher than the threshold value VTR (step S6; YES), the vibration control unit 113 determines that the music A is mainly output as sound, and outputs the music A to the left vibrator 19 of the left pitch fader 16. A control signal for controlling to vibrate at a cycle corresponding to the reproduction timing (pitch PL) is generated, and the right vibrator 20 of the right pitch fader 17 vibrates at a cycle corresponding to the reproduction timing (pitch PR) of the music B. A control signal for controlling is generated, and a control signal for controlling the vibrator 21 for cross of the cross fader 18 to vibrate at a cycle corresponding to the reproduction timing (pitch PL) of the music A (step S7). Each control signal is output to the left vibrator 19, the right vibrator 20, and the cross vibrator 21.
As a result, the left vibrator 19 vibrates in a cycle corresponding to the reproduction timing (pitch PL) of the music A, and the right vibrator 20 vibrates in a cycle corresponding to the reproduction timing (pitch PR) of the music B for cross. The vibrator 21 vibrates at a cycle corresponding to the reproduction timing (pitch PL) of the music A (step S12).

On the other hand, when VCF is not equal to or higher than the threshold value VTR (step S6; NO), the vibration control unit 113 further determines whether or not VCF is equal to or lower than the preset right threshold value VTL (step S8).
When the VCF is equal to or lower than the threshold value VTL (step S8; YES), the vibration control unit 113 determines that the music B is mainly output as voice, and the music is output to the left transducer 19 of the left pitch fader 16. A control signal for controlling to vibrate at a cycle corresponding to the reproduction timing (pitch PL) of A is generated, and the right vibrator 20 of the right pitch fader 17 vibrates at a cycle corresponding to the reproduction timing (pitch PR) of the song B. And a control signal for controlling the cross vibrator 21 of the cross fader 18 to vibrate at a cycle corresponding to the reproduction timing (pitch PR) of the music B (step S9). ), and outputs each control signal to the left vibrator 19, the right vibrator 20, and the cross vibrator 21.
As a result, the left vibrator 19 vibrates in a cycle corresponding to the reproduction timing (pitch PL) of the music A, and the right vibrator 20 vibrates in a cycle corresponding to the reproduction timing (pitch PR) of the music B for cross. The vibrator 21 vibrates in a cycle corresponding to the reproduction timing (pitch PR) of the music A (step S12).

Further, when the VCF is neither above the threshold value VTR nor below the threshold value VTL (step S6; NO and step S8; NO), the vibration control unit 113 outputs the sound of the music A and the music B at the same volume. (Step S10), a control signal for controlling the left vibrator 19 of the left pitch fader 16 to vibrate at a cycle corresponding to the reproduction timing (pitch PL) of the music A is generated, and the right pitch fader 17 is controlled. A control signal for controlling the right vibrator 20 to vibrate at a cycle corresponding to the reproduction timing (pitch PR) of the music B is generated, and the cross vibrator 21 of the cross fader 18 reproduces the reproduction timing (pitch of the music B). PR) plus a control signal for controlling to vibrate at a cycle corresponding to a pitch PLR which is a reproduction timing (pitch PL) of the music A (step S11), and outputs each control signal to the left vibrator 19 and the right vibrator. 20 and outputs to the cross vibrator 21.
As a result, the left vibrator 19 vibrates in a cycle corresponding to the reproduction timing (pitch PL) of the music A, and the right vibrator 20 vibrates in a cycle corresponding to the reproduction timing (pitch PR) of the music B for cross. The vibrator 21 vibrates in a cycle corresponding to the reproduction timing (pitch PLR) of the music A and the music B (step S12). In this case, when the reproduction timing (pitch PR) of the music B and the reproduction timing (pitch PL) of the music A match, the knob 181 of the crossfader 18 vibrates in a cycle that is comfortable even if they overlap. If the reproduction timings of the both are deviated, the picking portion 181 vibrates in a cycle that causes a feeling of strangeness. Thus, the user can recognize that the reproduction timings of the music A and the music B are out of sync by the tactile sensation of vibration.

<<Effect of music playback control device>>
As described above, according to the present embodiment, the left vibrator 19 that is a vibration generating unit that vibrates each of the left pitch fader 16, the right pitch fader 17, and the cross fader 18 that are operators according to the reproduction state of the music. , And controls the operations of the right vibrator 20 and the cross vibrator 21.
Thus, the user can know the playback timing of the music A and the music B by sensing the vibration by the sense of touch, which is different from hearing and sight. Therefore, even a user who is unfamiliar with the pitch matching can intuitively and surely recognize the pitch of the music, and the pitch matching can be performed easily and smoothly.
Also, it is assumed that the site where the DJ works is surrounded by a plurality of sounds and there are many kinds of lighting, etc., but even in such a place, the vibration transmitted to the finger facilitates the reproduction timing (pitch, etc.) of the music. You can know.

Further, in the present embodiment, the reproduction state specifying unit 111 acquires information regarding the reproduction timing of the music being reproduced, and the vibration control unit determines the left vibrator 19, the right vibrator 20, and the cross vibration according to this information. The operation of the child 21 is controlled. For this reason, the user intuitively feels with the vibration that his/her finger adjusts the playback timing (pitch) adjustments made by operating the left pitch fader 16 and the right pitch fader 17, which are the operators. You can know it. As a result, the feeling of pitch matching can be gradually grasped, and the user can be expected to learn the pitch matching technique.

Further, in the present embodiment, the left oscillator 19, the right oscillator 20, and the cross oscillator 21, which are vibration generating means, are operators (a left pitch fader 16, a right oscillator) when a user performs an operation related to reproduction of music. The operation element is vibrated in a direction different from the operation direction of the pitch fader 17 and the cross fader 18). Therefore, the user can more clearly feel the vibration caused by the left vibrator 19, the right vibrator 20, and the cross vibrator 21.
Further, when performing an operation related to the reproduction of a plurality of music pieces (for example, music piece A and music piece B) that are simultaneously reproduced in parallel as in the present embodiment, the operation related to the music piece is performed according to the reproduction timing of each of the plurality of music pieces. Vibrate the actuator. Therefore, it is possible to appropriately notify the user of which piece of music the reproduction timing (pitch, etc.) of the reproduction operation of each piece of music is out of phase.

In addition, in the present embodiment, the crossfader 18 is provided as an operator for adjusting the volume balance of each music when a plurality of music are played back simultaneously in parallel, and the vibration control unit 113 controls the volume of the crossfader 18. Depending on the balance adjustment value (that is, the voltage value (VCF) of the crossfader 18 in the present embodiment), which musical piece reproduction timing is changed at which cycle the operator (crossfader 18) is vibrated. It is like this. Therefore, when switching between music pieces or connecting music pieces to each other, it is possible to appropriately perform the work while confirming the pitch by the vibration transmitted to the finger.

Further, when one of the plurality of music pieces is in a state in which the reproduced sound is output and the other music pieces are in a state in which the reproduced sound is muted, the vibration control unit 113 at least reproduces the reproduced sound in the muted state. When the vibration generating means (cross vibrator 21 or the like) is controlled so as to vibrate the operator (cross fader 18 or the like) in accordance with the information regarding the reproduction timing of, the reproduction is performed according to the vibration felt by the finger. When switching the music to be played, the playback timing (pitch) of the music of the switching destination can be adjusted, and the pitch can be adjusted easily.

<Modification>
Although the embodiments of the present invention have been described above, it is needless to say that the present invention is not limited to the embodiments and various modifications can be made without departing from the gist thereof.

For example, in the present embodiment, the case has been described as an example where the terminal device 3 is connected to the DJ controller 1 that is the music reproduction control device and the music analysis is performed by the terminal device 3. However, the music analysis is performed by the terminal. It is not limited to the device 3.
For example, the music may be analyzed in the reproduction state specifying unit 111 of the control unit 11 of the DJ controller 1.
In this case, the music reproduction control may be completed only by the DJ controller 1, and the terminal device 3 may not be provided.

Further, in the present embodiment, the case where the sound source data and the like of the music is stored in the storage unit 32 of the terminal device 3 is illustrated, but the storage location of the sound source data and the like that can be played back and controlled by the DJ controller 1 which is the music playback control device. Is not limited to this.
For example, the DJ controller 1 may be provided with a storage unit for storing the sound source data of the music, etc. In particular, the sound source data of the music is not stored, but is stored in an external server or the like via various networks as necessary. Alternatively, the stored data may be downloaded and used as the sound source data of the music. Further, the sound source data stored in a storage medium such as a USB memory, various cards and chips, or CD-ROM may be read into the storage unit 12 of the DJ controller 1 which is a music reproduction control device and used as the sound source data. ..
In this case, the control unit 11 of the DJ controller 1 may analyze the music regarding the downloaded sound source data of the music.

Further, in the present embodiment, the case where the reproduction control of the music is performed by using the sound source data in the digital format stored in the storage unit 32 of the terminal device 3 is exemplified, but the sound source is not limited to the digital one.
For example, in a DJ device or the like having a turntable that reproduces analog records, the music reproduction control device of the present invention may be applied to a mixer that mixes music and the like.
In this case, for example, the control unit of the music reproduction control device is provided with a functional unit that analyzes music for analog records, and is an operator in a cycle according to the reproduction timing (pitch) of the music based on the analysis result. Vibrate the knob of the crossfader.
As described above, when the present invention is applied, it is possible to adopt a configuration in which the manipulator is vibrated in accordance with the reproduction timing (pitch) of the music even when reproducing the analog record, which helps the learning of the pitch matching technique. You can
May be.

Further, the vibration control unit 113 vibrates the left vibrator 19, the right vibrator 20, and the cross vibrator 21, which are vibration generating means, depending on the reproduction timing of the music being reproduced acquired by the reproduction state specifying unit 111. You may not let me do it.
For example, when there is no pitch shift between two music pieces that require pitch matching, the user may be notified that the pitches match by not generating vibration.

Further, the vibration control unit 113 changes at least one of the strength, the cycle, and the direction in which the plurality of operators are vibrated according to the degree of deviation of the reproduction timing (pitch) between the two pieces of music that require pitch matching. Alternatively, the left oscillator 19, the right oscillator 20, and the cross oscillator 21, which are vibration generating means, may be controlled.
By changing the way of vibrating according to the degree of deviation of the reproduction timing (pitch) in this way, the user can intuitively feel the degree of deviation of the pitch and smoothly perform pitch matching.

Further, the vibration control unit 113 does not have to generate vibration at a constant rhythm. For example, the vibration control unit 113 increases the vibration only at the first beat of a 4-beat music, or at the first and third beats of a 4-beat music. Only the vibration is generated, and the vibration is not generated at the second beat and the fourth beat.
In order to smoothly switch between songs and perform remix work, it is important to find the beginning of the beat in addition to matching the pitch. It is easy to find the cue of.

The left oscillator 19, the right oscillator 20, and the cross oscillator 21, which are vibration generating means, cause some movement of the operators (the left pitch fader 16, the right pitch fader 17, the cross fader 18). It is only necessary to notify the user of the operation status of the operator, and is not necessarily limited to the one that causes “vibration”.
For example, the left oscillator 19, the right oscillator 20, and the cross oscillator 21 cause the operators (the left pitch fader 16, the right pitch fader 17, the cross fader 18) to move only once. Good.
If the manipulator moves even once, the user can intuitively know the reproduction timing (pitch or the like) of the music by tactile sense.

Further, in the present embodiment, the description is given of the notification of the reproduction timing (pitch or the like) of the music by the vibration by the vibration generating means, but the means for notifying the reproduction timing (pitch or the like) of the music is not limited to the vibration.
For example, a light emitting unit such as an LED may be provided to notify the reproduction timing (pitch or the like) of the music by blinking light.
Further, the means for notifying the reproduction timing (pitch etc.) of the music by such light may be used together with the method for notifying by the vibration of the vibration generating means of the present embodiment.
By notifying the reproduction timing (pitch, etc.) of the music in various ways by means other than sound such as vibration and light, the user can surely recognize the reproduction timing and the like, and the pitch can be adjusted smoothly.

Although some embodiments of the present invention have been described above, the scope of the present invention is not limited to the above-described embodiments, and includes the scope of the invention described in the claims and the equivalent scope thereof. ..
The inventions described in the scope of the claims attached first to the application for this application will be additionally described below. The claim numbers listed in the appendices are as defined in the claims initially attached to the application for this application.
[Appendix]
<Claim 1>
An operator for the user to perform operations related to music playback,
A reproduction state specifying means for specifying a reproduction state of the music during reproduction of the music;
Vibration generating means for informing the user of the operation status of the operator by causing the operator to move,
Vibration control means for controlling the operation of the vibration generating means in accordance with the reproduction state of the music identified by the reproduction state identifying means,
A music reproduction control device comprising:
<Claim 2>
2. The music reproduction control device according to claim 1, wherein the vibration generation unit notifies the user of the operation status of the operating element by causing the operating element to vibrate.
<Claim 3>
The music reproduction according to claim 1 or 2, wherein the reproduction state specifying means analyzes the music data corresponding to the reproduction position during reproduction of the music to specify the reproduction state of the music. Control device.
<Claim 4>
The reproduction state specifying means analyzes the music data corresponding to the reproduction position of the music, and acquires information on the reproduction timing of the music being reproduced as reproduction music analysis information,
4. The vibration control means controls the operation of the vibration generation means according to the information regarding the reproduction timing of the music being reproduced, which is acquired by the reproduction state specifying means. The music playback control device according to item 1.
<Claim 5>
The reproduction state specifying means analyzes the music data corresponding to the reproduction position of the music, and acquires information on the reproduction timing of the music being reproduced as reproduction music analysis information,
The vibration control means changes the presence or absence of motion or the strength of motion generated by the vibration generation means in the operation element in a cycle corresponding to the reproduction timing of the music being reproduced acquired by the reproduction state specifying means. The music reproduction control device according to any one of claims 1 to 4, which is characterized.
<Claim 6>
The vibration control means changes the presence or absence of a motion or the strength of the motion caused by the vibration generation means in the operator at a cycle and a phase corresponding to the reproduction timing of the music being reproduced acquired by the reproduction state specifying means. The music reproduction control device according to claim 4 or 5, characterized in that.
<Claim 7>
7. The vibration generating means operates the manipulator in a direction different from a motion direction of the manipulator when a user performs an operation related to reproduction of music. The music reproduction control device according to any one of claims.
<Claim 8>
The manipulator is for performing an operation relating to the reproduction of the plurality of music pieces which are simultaneously reproduced in parallel,
The said vibration control means controls the said vibration generation means so that the said operation element may be operated according to the reproduction|regeneration timing of the said some music, The any one of Claim 1 to 7 characterized by the above-mentioned. Music playback control device.
<Claim 9>
A plurality of operators for independently operating the reproduction timings of the plurality of songs,
The vibration control means controls the vibration generating means so that each of the plurality of operators is operated at a cycle corresponding to a reproduction timing of a music piece to be operated by each operator. 8. The music reproduction control device according to item 8.
<Claim 10>
The vibration control means controls the vibration generation means so as to change at least one of intensity, cycle, and direction in which the plurality of operators are operated according to the degree of deviation of the reproduction timing in the plurality of music pieces. The music reproduction control device according to claim 9.
<Claim 11>
One of the plurality of music pieces is in a state in which a reproduced sound is output, and the other music piece is in a state in which the reproduced sound is muted,
9. The vibration control means controls the vibration generation means so as to operate the manipulator at least in accordance with information about the reproduction timing of a music piece in which the reproduction sound is muted. 10. The music reproduction control device according to any one of 10.
<Claim 12>
Having an operator for adjusting the volume balance of the plurality of songs,
The vibration control means controls the vibration generation means so as to change which operation of the manipulator is operated in a cycle corresponding to a reproduction timing of which music according to the adjustment value of the volume balance. The music reproduction control device according to any one of claims 8 to 11.
<Claim 13>
A reproduction state specifying step of specifying a reproduction state of the music during reproduction of the music;
A vibration generating step of notifying the user of the operation status of the operator by causing the operator to perform an operation relating to the reproduction of the music by the user in accordance with the reproduction status of the music identified in the reproduction state specifying step; ,
A music reproduction control method comprising:
<Claim 14>
On the computer,
A reproduction state specifying function for specifying the reproduction state of the music during reproduction of the music,
A vibration generating function for notifying the user of the operating status of the operating element by causing the operating element that the user performs an operation relating to the reproduction of the musical piece to move in accordance with the reproducing state of the music identified by the reproduction state identifying function, ,
A computer-readable music reproduction control program for realizing the following.

1 DJ controller 3 Terminal device 11 Control unit 12 Storage unit 16 Left pitch fader 17 Right pitch fader 18 Cross fader 19 Left vibrator 20 Right vibrator 21 Cross vibrator 111 Play state specifying unit 112 Fader information detection unit 113 Vibration control Unit 114 Audio output control unit 324 Music source data storage area DL, DR Deck area Ma Mixer area

Claims (13)

An operator for instructing the user to change the cycle or phase of music playback,
A drive unit that causes the operator to physically move,
A control unit that changes the motion state of the operation member by the drive unit according to a change in the reproduction cycle or phase of the music piece according to the operation of the operation member,
A music reproduction control device equipped with. A manipulator for the user to change the playing state of music,
A drive unit that causes the operator to physically move,
During the reproduction of the music, the music data corresponding to the reproduction position is analyzed to specify the reproduction state of the music, and the operator by the drive unit is determined according to the change in the reproduction state of the specified music. A control unit that changes the movement state of
A music reproduction control device equipped with . A manipulator for the user to change the playing state of music,
A drive unit that causes the operator to physically move,
In accordance with a change in the reproduction state of the music by the operation of the operator, the user the to move the operating element in a direction different from the operation direction of the operator when performing the operation of changing the playback state of the music A control unit for controlling the drive unit ,
A music reproduction control device equipped with . A plurality of operating elements operated by the user each independently a reproduction timing of the plurality of songs,
A drive unit that causes a physical movement in each of the plurality of operators,
Each of the plurality of operating elements, and a control section for controlling the driving unit to move in a period corresponding to the reproduction timing of the music to be operated for each operator,
A music reproduction control device equipped with . A plurality of operators including a first operator and a second operator that independently operate the reproduction timings of the plurality of music pieces, and a third operator that performs an operation related to the reproduction of the plurality of music pieces that are simultaneously reproduced in parallel. And the operator
A drive unit that causes a physical movement in each of the plurality of operators,
In response to a change in the reproduction state of any one of the plurality of songs by the operation of the first operator or the second operator, the drive unit controls the first operator or the second operator. with changing the motion state, and a control section for controlling to move the third operating element according to reproduction timing of said plurality of music to be changed by the operation of the third operator,
A music reproduction control device equipped with . The drive unit includes a vibrator that vibrates the operator,
The control unit changes a vibration state of the operation element by the vibrator according to a change in a reproduction state of the music by an operation of the operation element,
The music reproduction control device according to any one of claims 1 to 5 . The control unit changes a cycle of vibration of the operation element by the vibrator or a direction of vibration in accordance with a change in a reproduction state of the music according to an operation of the operation element,
The music reproduction control device according to claim 6 . The music reproduction control device according to claim 1 , wherein the control unit changes a motion state of the operation element by the drive unit according to a cycle and a phase of a music being reproduced. The music according to claim 4 , wherein the control unit controls to change at least one of intensity, cycle, and direction of moving the plurality of operators according to a degree of deviation of reproduction timings of the plurality of music. Reproduction control device. One of the plurality of music pieces is in a state where the reproduced sound is output, and the other music piece is in a state where the reproduced sound is muted,
The music reproduction control device according to claim 5 , wherein the control unit controls at least the third operation element to move in accordance with information about the reproduction timing of the music in which the reproduction sound is muted. The third manipulator is a manipulator that adjusts the volume balance of the plurality of songs,
The music reproduction according to claim 5 , wherein the control unit controls to change which music reproduction timing is to move the third operating element in accordance with the volume balance adjustment value. Control device. The device
A process of changing the reproduction state of the music in response to an operation of an operator for instructing a change in the reproduction cycle or phase of the music by the user;
A process of identifying a change in the reproduction cycle or phase of the music in accordance with the operation of the operator,
A process of changing a motion state of the manipulator by a drive unit that causes the manipulator to physically move according to a change in a reproduction state of the identified music piece;
A music playback control method for executing the following. On the computer,
A process of changing the reproduction state of the music in response to an operation of an operator for instructing a change in the reproduction cycle or phase of the music by the user;
A process of identifying a change in the reproduction cycle or phase of the music in accordance with the operation of the operator,
A process of changing a motion state of the manipulator by a drive unit that causes the manipulator to physically move according to a change in a reproduction state of the identified music piece;
A music reproduction control program for executing.

Images