JP4203750B2 - Electronic music apparatus and computer program applied to the apparatus - Google Patents

Description

  The present invention relates to an electronic music apparatus capable of performing music in synchronization with reproduction of audio data representing music and a computer program applied to the apparatus.

Conventionally, performers often play musical instruments against the back of audio data playback sounds related to music recorded on CDs, DVDs, and the like. There is also known a technique of synchronously reproducing audio data related to music recorded on a CD, DVD, etc., and automatic performance data (MIDI data) representing the music (see Patent Document 1 below).
JP 2003-228368 A

  However, in the former prior art, it is difficult for a player who is not proficient in playing musical instruments to perform with the playback sound of audio data as a background. In the latter prior art, audio data and automatic performance data (MIDI data) are simply reproduced in synchronization, and the performer cannot participate in these reproductions.

  The present invention has been made to cope with the above-described problems, and an object of the present invention is to provide an electronic music apparatus that can be played back by a reproduced sound of audio data even by a beginner, and a computer program applied to the apparatus. It is to provide.

In order to achieve the above object, the present invention is characterized in that, in an electronic music device capable of reproducing audio data relating to music, a music data representing music, a mark or time code representing frame timing of the audio data Is stored at a time interval corresponding to one frame time of the audio data, a performance means for playing the music, and when the audio data is specified, the audio data is read from the head and the audio data The length of the pre-gap section is detected, and after waiting for the length of the detected pre-gap section from the time when playback of audio data is instructed, reading of the song data is started. The reading position of the song data is By means of a performance operator and a reading means for reading out the music data of the music corresponding to the audio data stored in the storage means and reproduced by changing to the position of the key or time code There is provided correction means for correcting performance data representing a performance using the read music data, and a musical tone signal corresponding to the corrected performance data is output simultaneously with a reproduction signal of audio data.

In this case, the amendments means, for example, the performance data representing the pitch of inadvertent player, and modify the performance data representing the wrong time, performance data representative of a musical sound player does not play Or can be configured to be added.

  According to the feature of the present invention, an accurate performance sound can be generated in synchronization with the reproduction of audio data even if the performer is not sufficiently proficient in the performance. Therefore, even a beginner can perform with the playback sound of the audio data as a background, and can enjoy rich performance music.

  Furthermore, the present invention is not limited to the invention related to the electronic music device, but can be implemented as a method invention and an invention related to a computer program applied to an electronic music device capable of reproducing audio data related to music. is there.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram schematically showing an electronic musical instrument as an electronic music apparatus to which the present invention is applied according to the embodiment. The electronic musical instrument includes a performance operator group 11, a setting operator group 12, a display device 13, a musical tone signal generation circuit 14, and an audio data reproduction circuit 15.

  The group of performance operators 11 is composed of a plurality of performance operators (for example, a plurality of keys) for designating the pitch of the generated musical sound, and the operation of each performance operator is detected by a detection circuit 17 connected to the bus 16. Is done. The setting operator group 12 includes a plurality of setting operators provided on the operation panel of the electronic musical instrument to instruct the operation mode of each part of the electronic musical instrument, and the operation of each setting operator is connected to the bus 16. It is detected by the detection circuit 18. The display 13 is composed of a liquid crystal display, a CRT, or the like, and displays characters, numbers, figures, and the like. The display content of the display 13 is controlled by a display control circuit 19 connected to the bus 16.

  The musical tone signal generation circuit 14 is connected to the bus 16, generates a musical tone signal based on performance data and various musical tone control data supplied under the control of the CPU 31 described later, and performs D / A conversion. Output to the mixer 20. Further, the musical tone signal generation circuit 14 is controlled by the musical tone control data, and an effect is also given to the generated musical tone signal. The audio data reproduction circuit 15 includes a D / A converter and the like, reproduces audio data described later in detail, and outputs an audio signal to the mixer 20. The mixer 20 mixes the musical tone signal from the musical tone signal generation circuit 14 and the audio signal from the audio data reproduction circuit 15 and outputs them to the sound system 21. The sound system 21 includes a speaker, an amplifier, and the like, and emits a sound corresponding to the mixed musical sound signal and audio signal.

  The electronic musical instrument includes a CPU 31, a timer 32, a ROM 33, and a RAM 34 that are connected to the bus 16 and constitute a microcomputer main body, and also includes an external storage device 35 and a communication interface circuit 36. The external storage device 35 includes various recording media such as a hard disk HD pre-installed in the electronic musical instrument, a compact disc CD that can be mounted on the electronic musical instrument, a flexible disk FD, and a drive unit for the recording media. Yes, a large amount of data and programs can be stored and read.

  In particular, in the present embodiment, the hard disk HD stores an audio reproduction program and music data reading program shown in FIG. 2, and a performance assist program shown in FIG. The hard disk HD also stores a plurality of pieces of music data representing music pieces. As shown in FIG. 4, each piece of music data is composed of a plurality of timing data and event data arranged in time series. The timing data determines the output timing of the event data, and may be data representing the relative time between adjacent event data or data representing the absolute time from the start timing of the music of each event data. Good. Each event data is chord data representing a chord in this embodiment, and this chord data is composed of root data representing a root tone and type data representing a chord type. This music data corresponds to a music piece of audio data, which will be described later, and its musical content is related to the music piece of the audio data. Specifically, chord data that matches or substantially matches the chord progression of the audio data is recorded as song data, and the tempo and length of the song data also match the audio data. These programs and song data are stored in advance on the hard disk HD, supplied to the hard disk HD from a compact disk CD, a flexible disk FD, etc., or from the outside via an external device 41 or a communication network 42 described later. It is supplied to HD.

  In this embodiment, audio data is supplied from a compact disc CD that is selectively loaded. The compact disc CD stores audio data representing musical instrument sounds or singing voices regarding one or a plurality of music pieces. This audio data will be described with reference to FIG. The compact disc CD includes a plurality of tracks, and each track includes a plurality of frames in which audio data is recorded. In each frame, 2352 bytes of audio data, that is, 16-bit audio data for 1/75 seconds sampled at 44.1 KHz is recorded. Also, audio data is not recorded in the first few frames of the plurality of frames of the first track, and a section in which these audio data are not recorded is called a pre-gap section (blank section). The song data is produced so that the length of the song data matches the length of the audio data after the pre-gap section.

  The communication interface circuit 36 can be connected to an external device 41 such as another electronic musical instrument or a personal computer, and the electronic musical instrument can communicate various programs and data with the external device 41. For example, a performance device such as a keyboard may be adopted as the external device 41, and performance information may be input from the external device 41 instead of or in addition to the performance by the performance operator group 11. Further, the communication interface circuit 36 can be connected to the outside via a communication network 42 such as the Internet, so that the electronic musical instrument can receive various programs and data from the outside, or can transmit to the outside. ing.

  Next, the operation of the embodiment configured as described above will be described. The performer attaches the compact disc CD on which the music desired to be reproduced is recorded to the electronic musical instrument and operates the setting operator group 12 to designate the music desired to be reproduced and instruct the reproduction. Further, the performer designates the song data of the same song as the designated song stored in the hard disk HD together with the designation of the song. Note that the designation of music related to audio data stored on the compact disc CD and the designation of music related to music data stored on the hard disk HD may be automatically performed in conjunction with each other.

  Thereafter, the CPU 31 executes the audio reproduction program of FIG. 2, controls the reading of the audio data related to the designated music piece from the compact disc CD, and reproduces the audio data in cooperation with the audio data reproduction circuit 15. In parallel with the execution of the audio reproduction program, the CPU 31 executes the music data reading program of FIG. 2 and starts reading the music data in synchronization with the reproduction of the audio data. Further, in parallel with the execution of the audio reproduction program and the song data read program, the CPU 31 also executes the performance assist program of FIG. 3 to correct the performance data by the performer using the read song data, A musical tone signal is generated in cooperation with the musical tone signal generation circuit 14. This performance data relates to a melody performance by a performer using the performance operator group 11, for example. Note that each of these programs may be executed by a plurality of CPUs 31.

  As described above, in this embodiment, the music data is read out and the performance data is corrected in synchronization with the reproduction of the audio data by the cooperation of the software processing by the program and the hardware circuit. Then, before describing such operations in detail using the program, the software processing and the processing realized by the hardware circuit will be described using the functional block diagram of FIG.

  In FIG. 6, an audio data storage unit P1 corresponds to a compact disc CD that stores audio data, and a song data storage unit P2 corresponds to a hard disk HD that stores song data. The audio data reproduction unit P3 corresponds to the processing of the audio reproduction program of FIG. 2 by the external storage device 35, the audio data reproduction circuit 15, and the CPU 31, reads out and reproduces the audio data, and supplies it to the mixer 20. The audio data reproducing unit P3 supplies synchronization information to the music data reading unit P4 based on the read audio data. The song data reading unit P4 corresponds to the processing of the song data reading program of FIG. 2 by the external storage device 35 and the CPU 31, and synchronizes the song data from the song data storage unit P2 with the reproduction of the audio data using the synchronization information. Is read out and supplied to the performance assistant P5. The performance assisting part P5 corresponds to the processing of the performance assisting program of FIG. 3 by the CPU 31, corrects the performance data by the performance operator group 11 in accordance with the supplied music data, and generates the musical sound signal from the modified performance data. A musical sound signal is generated by supplying to the circuit 14.

  Next, the operation of the above embodiment will be described in detail according to the functional block and the flowcharts of FIGS. As described above, when the audio data related to one piece of music recorded on the compact disc CD is designated by the setting operator group 12, the audio data reproducing unit P3 executes the audio reproducing program in step S10 of FIG. In step S11, the audio data of the designated music recorded on the compact disc CD is pre-read from the head, and the pre-gap length indicating the length of the pre-gap section (that is, included in the pre-gap section). The number of frames) is detected, and the detected pregap length is supplied to the music data reading unit P4 (see FIG. 7). Note that the pregap length is not limited to the one obtained by reading out the audio data, and the pregap length when the pregap length data representing the pregap length is included in the audio data recorded on the compact disc CD. Data may be read and used. In step S12, the player waits for a playback start instruction using the setting operator group 12 by the performer.

  When there is an instruction to start reproduction, the audio data reproducing unit P3 instructs the music data reading unit P4 to start (one of the synchronization information) in step S13, and the audio end data is obtained by the cyclic processing consisting of steps S14 to S17. Audio data is read until is read. During the reading of the audio data, a frame timing signal (one of the synchronization information) is output to the music data reading unit P4 for each frame timing by the processes of steps S14 and S15. This frame timing signal is output both in the pre-gap section and in the section where actual audio data is recorded. When the audio data to be reproduced starts to be read past the pre-gap section, the data for one frame is read out by the process of step S16, and the audio signals corresponding to the audio data are supplied to the mixer 20 in order. To do. Specifically, audio data for one frame read from the compact disc CD is converted into an audio signal by D / A conversion in the audio data reproduction circuit 15 and supplied to the mixer 20. When the audio end data is read, “Yes” is determined in step S17, and the execution of the audio reproduction program is ended.

  On the other hand, the song data reading unit P4 starts executing the song data reading program in step S20 in response to the start instruction from the audio data reading unit P3. In step S21, the frame timing signal supplied from the audio data reproducing unit P3 is counted by the processing in step S15 of the audio reproducing program, and the count value is obtained before the music data reading program is executed. The progress of the program is stopped until the time corresponding to the number of frames represented by the gap length input from the reproduction unit P3 is reached. When the count value reaches the time corresponding to the number of frames, that is, when the audio data playback unit P3 reads the actual audio data (see FIG. 7), the cyclic processing including steps S22 to S25 is started. This cyclic processing is continued until the music end data is read. If the music piece end data is read, the execution of the music piece data reading program is terminated in step S26.

  During the circulation process, the music data, that is, the event data (chord data in this embodiment) is read from the hard disk HD by the process of step S22, and the read event data is output to the performance assistant P5. In reading the event data, the read tempo count value sequentially counted up by the execution of a program (not shown) is compared with the timing data as time elapses (that is, as the music progresses), and is designated by the timing data. Event data is read sequentially at the timing. The tempo count value is composed of a bar count value for counting the number of bars, a beat count value for counting the number of beats in one bar, and a beat count value representing a minute timing within one beat, and is represented by song data. It is counted up according to the tempo of the recorded music (preset according to the tempo of the music in the audio data).

  Further, during the circulation process, the music data read timing is synchronously controlled by the processes of steps S23 and S24 each time the frame timing signal is output by the process of step S15 of the audio reproduction program (see FIG. 7). . Specifically, the tempo count value at the frame timing is calculated in advance using the resolution of the tempo of the music represented by the music data and the tempo count value (that is, the count value within the beat), and when the frame timing signal arrives The tempo count value is updated to the calculated value, and the music data read position is changed to a position corresponding to the updated tempo count value. To change the reading position of the music data, a mark or time code indicating the frame timing is embedded in the music data at 1/75 second intervals corresponding to one frame time, and the mark or time code is changed to the position of the mark or time code. It may be.

  During the execution of such an audio playback program and music data reading program, the performance assistant P5 repeatedly executes the performance assistant program of FIG. The execution of the performance assist program is started in step S30, and it is determined whether or not performance data is input in step S31. If any of the performance operators in the performance operator group 11 is not operated and no performance data is input, the performance assist program is temporarily terminated in step S34. On the other hand, when one of the performance operators in the performance operator group 11 is operated and performance data is input, the processes of steps S32 and S33 are executed.

  In step S32, the performance data is corrected using the chord data supplied from the music data reading unit P4 and is output to the musical tone signal generation circuit 14. Specifically, pitch data in performance data representing a pitch (pitch name) inappropriate for the chord represented by the supplied chord data is converted to a pitch representing a pitch (pitch name) appropriate for the chord. Change to high data. For example, it is assumed that the pitch data representing a pitch name other than the chord represented by the supplied chord data and the chord constituent musically related to the chord is inappropriate, Change to pitch data representing names. Further, in changing the pitch data, the pitch data may be changed in consideration of the timing at which the performance data is input. For example, in the case of strong beats, the pitch data representing the pitch names other than the constituent sounds of the chords represented by the supplied chord data is deemed inappropriate and changed to pitch data representing the pitch names in the constituent sounds of the chords. To do. This performance data changing process is not performed for all input performance data, but only performance data inappropriate for the supplied chord data is changed.

  Further, performance data representing the name of the chord represented by the chord data supplied from the music data reading unit P4 is added to the performance data representing the performance by the performance operator group 11, and the musical tone signal generating circuit 14 is added. May be output. Further, the timing of the performance data supplied to the performance auxiliary section P5 is changed using the timing of the chord data supplied from the music data reading section P4, and the performance data is supplied to the musical tone signal generation circuit 14. Good.

  The musical tone signal generation circuit 14 generates a musical tone signal corresponding to the musical performance data supplied from the music data reading unit P4, that is, a musical tone signal having a pitch represented by the pitch data in the musical performance data, and outputs the musical tone signal to the mixer 20. The mixer 20 mixes the musical sound signal with the audio signal from the audio data reproduction circuit 15 (audio data reproduction unit P3) described above. The mixed musical sound signal and audio signal are emitted via the sound system 21.

  As can be understood from the above description, the music data stored in the hard disk HD is reproduced by the processing of the music data reading unit P4 (steps S21 to S24 in FIG. 2) to reproduce the audio data stored in the compact data CD. Read synchronously. In addition, the performance data representing the performance operation by the performance operator group 11 is corrected by the processing of the performance auxiliary unit P5 (steps S31 to S33 in FIG. 3) so that it matches the music data using the read music data. Is done. As a result, according to the above-described embodiment, an accurate performance sound can be generated in synchronization with the reproduction of audio data even if the performer is not sufficiently proficient in the performance. Therefore, even a beginner can perform with the playback sound of the audio data as a background, and can enjoy rich performance music. In addition, since the music data is read in consideration of the pregap length of the audio data, it is possible to reproduce accurately in synchronization.

  Furthermore, in carrying out the present invention, the present invention is not limited to the above embodiment and its modifications, and various modifications can be made without departing from the object of the present invention.

  For example, in the above-described embodiment, the example in which the audio data is recorded on the compact disc CD and the computer program is recorded on the hard disk HD has been described. However, any audio data and computer program recording medium may be used, and in particular, audio data recorded on a DVD may be used. Also, the drive of the recording medium may be built in the electronic musical instrument according to the present embodiment or may be externally attached.

  Also, regarding the types of performance assistance, not only the performer's melody performance is assisted but also the performance of other parts such as accompaniment sound performance by the performer, or the simultaneous performance of multiple parts. May be. Alternatively, the performer may select a part that he / she wants to play, and the performance of the selected part may be assisted. Furthermore, the song data includes not only chord data but also automatic performance data related to other parts such as a melody, and the automatic performance data related to other parts is read out in synchronization with the audio data to assist performance. You may make it utilize. In particular, when using automatic performance data relating to a melody, the performance data by the performance operator group 11 is used only for designating the sounding timing, and the performance data representing the melody by the automatic performance data is used as the performance timing of the performance operator group 11. May be output to the musical tone signal generating circuit 14.

  Furthermore, in the above embodiment, an electronic musical instrument that employs a key as a performance operator has been described. However, instead of a key, a simple press switch, touch switch, or the like may be employed as a performance operator that designates a pitch. In addition, the present invention may be configured such that the performance operator group 11 is externally attached, and can be applied to other devices such as a personal computer other than an electronic musical instrument as long as audio data can be reproduced and music data can be read. it can.

1 is an overall block diagram of an electronic musical instrument according to an embodiment of the present invention. It is a flowchart which shows the audio reproduction program and song data read-out program which are performed with the said electronic musical instrument. It is a flowchart which shows the performance assistance program performed with the said electronic musical instrument. It is a figure which shows an example of the format of music data. It is a figure which shows an example of the format of audio data. It is a functional block diagram for demonstrating the performance assistance function of this invention. It is operation | movement explanatory drawing of reproduction | regeneration of audio data and reading of music data.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Performance operator group, 12 ... Setting operator group, 14 ... Music signal generation circuit, 15 ... Audio data reproduction circuit, 20 ... Mixer, 31 ... CPU, 35 ... External storage device, P1 ... Audio data storage part, P2 ... Music data storage unit, P3 ... Audio data reproduction unit, P4 ... Music data reading unit, P5 ... Performance auxiliary unit

Claims (2)

In an electronic music device capable of reproducing audio data related to music,
Storage means for storing song data, which is a song data representing a song, in which a mark or time code representing a frame timing of the audio data is embedded at a time interval corresponding to one frame time of the audio data;
A performance controller for playing music,
When the audio data is specified, the audio data is read from the head to detect the length of the pre-gap section of the audio data, and after waiting for the length of the detected pre-gap section from the start of audio data playback start, the music data is read. After that, every time a frame timing signal is output by reproduction of audio data, the reading position of the song data is changed to the position of the mark or time code, so that it is stored in the storage means and reproduced. Reading means for reading out song data of music corresponding to audio data in synchronization with reproduction of audio data;
Correction means for correcting performance data representing performance by the performance operator using the read music data;
An electronic music apparatus configured to output a musical sound signal corresponding to the corrected performance data simultaneously with a reproduction signal of the audio data. Audio data relating to music, comprising music data representing music and having stored therein music data in which marks or time codes representing frame timing of audio data are embedded at time intervals corresponding to one frame time of audio data In a computer program applied to an electronic music device capable of reproducing
When the audio data is specified, the audio data is read from the head to detect the length of the pre-gap section of the audio data. After that, every time a frame timing signal is output by reproduction of audio data, the reading position of the song data is changed to the position of the mark or time code, so that it is stored in the storage means and reproduced. Reading procedure for reading out song data of music corresponding to audio data in synchronization with playback of audio data;
A correction procedure for correcting performance data representing performance by the performance operator using the read music data;
A computer program for outputting a musical tone signal corresponding to the modified performance data from the electronic music apparatus simultaneously with a reproduction signal of the audio data.

Images