JP6102975B2 - Musical sound generation device, musical sound generation program, and electronic musical instrument - Google Patents

Description

  The present invention relates to a musical sound generating device, a musical sound generating program, and an electronic musical instrument in which musical sound data based on key depression and audio data cooperate.

  In electronic musical instruments, a so-called “automatic accompaniment” function is well known. In the automatic accompaniment function, automatic accompaniment pattern data of a predetermined music is stored, and the data are sequentially read according to a predetermined tempo to generate musical sounds constituting the automatic accompaniment. The performer presses a predetermined part (generally, a melody) at the timing specified in the music while listening to the automatic accompaniment, thereby generating the musical tone of the completed music.

  In the automatic accompaniment pattern, a musical tone corresponding to a constituent sound of a predetermined chord is generated at a sounding timing according to the accompaniment sequence indicated by the automatic accompaniment pattern. The automatic accompaniment pattern may also include obligato sounds and rhythm sounds that constitute the counter-melody of melody sounds.

  Such an automatic accompaniment has a sound generation form similar to the generation of a musical sound by a player's key operation. That is, a note-on event including the pitch and tone color is transmitted to the sound source unit at the sounding timing according to the accompaniment sequence, and the sound source unit follows the specified tone color data from the ROM storing the waveform data. By reading the waveform data at a predetermined speed, musical tone waveform data of a predetermined tone color and pitch is output.

  In such an electronic musical instrument having an automatic accompaniment function, the performer is not necessarily skilled in playing the music, and when the key cannot be pressed at the proper key pressing timing, or the wrong key is pressed. May end up. In such an electronic musical instrument disclosed in Patent Documents 1 and 2, the automatic accompaniment pattern is appropriately read out to prevent a situation in which only the accompaniment goes on without permission. .

JP 2000-206965 A JP 2007-114539 A Japanese Patent Laid-Open No. Sho 62-139588

  On the other hand, audio data from other audio equipment such as an audio player is accepted, or audio data obtained by sampling an audio signal from a microphone or the like is accepted, and both such audio data and musical tone waveform data emitted from a sound source unit are received. An electronic musical instrument that can be reproduced is proposed.

  For example, an apparatus can be considered in which audio data is reproduced as an automatic accompaniment and melody sound is converted to musical sound waveform data generated by a sound source unit based on a player's key operation. In this case, since the audio data is read at a predetermined sampling frequency, the audio data reading is controlled in accordance with the performance of the performer even when the performer cannot press the key at the proper key press timing. There was a problem that it was difficult.

  An object of the present invention is to provide a musical sound generating apparatus, a musical sound generating program, and an electronic musical instrument capable of realizing appropriate audio data reading according to a player's key operation when reproducing audio data as an automatic accompaniment. .

An object of the present invention is to provide music data including time data indicating pitches and sound generation timings of musical sounds constituting music, and storage means storing audio data which is accompaniment data of music related to the music data. Audio data reading means for reading the audio data according to the elapsed time based on the time information included in the data;
Based on the normal sound generation timing in the music data relating to the operation of the performance operators, the series in the future and and the nearest first zero-cross points when the sound generation timing of the normal, and jump detection means for detecting from said audio data ,
Operation determining means for determining whether or not the performance operator that generates a musical tone having a pitch corresponding to the sound generation timing has been operated before the sound generation timing indicated in the song data;
When it is determined by the operation determining means that the performance operator is not operated, the sound of the musical sound that is sounded among the zero cross points before the zero cross point, starting from the first zero cross point. A loop destination detection means for detecting a second zero cross point that is the same as or closest to the position of the end point of the section corresponding to the period matched to high and has the same phase as the first zero cross point;
Loop reading means for repeatedly reading out the audio data using a section between the second zero cross point and the first zero cross point as a loop section;
When it is determined by the operation determining means that the performance operator has been operated after reading is started by the loop reading means, it is in the future in the time series from the operation timing of the performance operator, and Jump source detection means for detecting a third zero cross point in phase with the operation timing of the performance operator from the audio data;
The audio data reading means is configured to cause audio data reading to jump from the detected third zero cross point to the detected first zero cross point, and thereafter to continue normal audio data reading. Control means for controlling;
This is achieved by a musical sound generator having

  ADVANTAGE OF THE INVENTION According to this invention, when reproducing audio data as an automatic accompaniment, it is possible to provide a musical sound generation device, a musical sound generation program, and an electronic musical instrument that can realize appropriate audio data reading in accordance with a player's key operation. It becomes.

FIG. 1 is a diagram showing an external appearance of an electronic musical instrument according to the present embodiment. FIG. 2 is a block diagram showing the configuration of the electronic musical instrument according to the embodiment of the present invention. FIG. 3 is a diagram showing an example of song data and its key press timing when song accompaniment is performed in the present embodiment. FIG. 4 is a diagram showing an example of song data and its key press timing when song accompaniment is performed in the present embodiment. FIG. 5 is a diagram showing an example of song data and its key press timing when song accompaniment is performed in the present embodiment. FIG. 6A is a diagram showing a data configuration example of song data according to the present embodiment, and FIG. 6B is a diagram showing an example of a register group storing data set in the course of processing. . FIG. 7A is a flowchart illustrating an example of a main flow executed in the electronic musical instrument according to the present embodiment, and FIG. 7B is a flowchart illustrating an example of cannabis interrupt processing according to the present embodiment. . FIG. 8 is a flowchart showing in more detail an example of keyboard processing according to the present embodiment. FIG. 9 is a flowchart showing an example of lesson keyboard processing according to the present embodiment. FIG. 10 is a flowchart showing an example of song processing according to this embodiment. FIG. 11 is a flowchart showing an example of the song start process according to the present embodiment. FIG. 12 is a flowchart showing an example of song tone reproduction processing according to the present embodiment. FIG. 13 is a flowchart showing an example of the loop point search process according to the present embodiment. FIG. 14 is a diagram for explaining an example of loop point detection according to the present embodiment. FIG. 15 is a flowchart showing an example of song audio playback processing according to the present embodiment. FIG. 16 is a flowchart showing an example of song audio playback processing according to the present embodiment. FIG. 17 is a flowchart showing an example of the sound source sound generation process according to the present embodiment. FIG. 18 shows an example of key press (note on) and key release (note off) timings and audio data in a music piece in the present embodiment. FIG. 19 is a diagram illustrating an example of audio data when the player performs a quick press. FIG. 20 is a diagram showing a data configuration example of song data according to another embodiment of the present invention. FIG. 21 is a flowchart illustrating an example of a loop point search process according to another embodiment.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a diagram showing an external appearance of an electronic musical instrument according to the present embodiment. As shown in FIG. 1, the electronic musical instrument 10 according to the present embodiment has a keyboard 11. In addition, on the upper part of the keyboard 11, a switch (see reference numerals 12 and 13) for specifying a timbre, starting / ending a song accompaniment according to audio data to be described later, various information relating to the music to be played, For example, it has a display unit 15 for displaying timbre, sheet music and the like. The electronic musical instrument 10 according to the present embodiment has, for example, 61 keys (C2 to C7).

  FIG. 2 is a block diagram showing the configuration of the electronic musical instrument according to the embodiment of the present invention. As shown in FIG. 2, the electronic musical instrument 10 according to the present embodiment includes a CPU 21, a ROM 22, a RAM 23, a sound system 24, a keyboard 11, an input interface (I / F) 14, a display unit 15, and the switch 11. A switch group 16 having 12 is provided.

  The CPU 21 follows the control of the entire electronic musical instrument 10, the detection of key pressing of the keyboard 11 and the operation of the switches constituting the switch group 16 (for example, see numerals 12 and 13 in FIG. 1), and the operation of the keys and switches. Various processes such as control of the sound system 24 and song accompaniment according to audio data are executed.

  The ROM 22 stores various processes to be executed by the CPU 21, such as switch operation, key depression of any key on the keyboard, tone generation according to the key depression, song accompaniment according to audio data, and the like. The ROM 22 stores a waveform data area for storing waveform data for generating musical tones of various tones such as piano, guitar, violin, guitar, trumpet, and clarinet, song data including keys to be pressed and key pressing timings. And a music data area in which audio data is stored. The RAM 23 stores a program read from the ROM 22 and data generated in the course of processing. Note that the RAM 23 also has an audio data area for storing audio data received from another acoustic device 30 via the input I / F 14. The audio data is, for example, PCM data sampled at a predetermined sampling frequency, and data values are sequentially stored from the start address of the audio data area.

  The input I / F 14 can be connected to another audio device 30 and can receive audio data from the other audio device 30. The audio data is stored in the audio data area of the RAM 23 by the CPU 21. The audio data is associated with the elapsed time from the data at the head address.

  The sound system 24 includes a sound source unit 26, an audio circuit 27, a speaker 28, and an audio data reproduction unit 29. For example, when the sound source unit 26 receives information about the depressed key or information about the automatic accompaniment pattern from the CPU 21, the sound source unit 26 reads predetermined waveform data from the waveform data area of the ROM 22, and generates musical tone data of a predetermined pitch. Generate and output. The sound source unit 26 can also output waveform data, particularly waveform data of percussion instrument sounds such as a snare drum, bass drum, and cymbal, as musical sound data. The audio data reproducing unit 29 reads out the audio data stored in the audio data area according to the sampling frequency and according to the elapsed time based on the time information included in the music data. Further, as will be described later, the audio data playback unit 29 can receive two loop points (loop source time and loop destination time) and perform loop playback of audio data between the loop points. The audio circuit 27 synthesizes the musical sound data and the audio data, and D / A converts and amplifies the synthesized data. Thereby, an acoustic signal is output from the speaker 28.

  FIGS. 3 to 5 are diagrams showing examples of song data and key pressing timing when song accompaniment is performed in the present embodiment. In FIG. 3, in the music data at the regular timing, after the first rest (time t0), the key is pressed (key-on), released after time t1 (1), and after time t2 (1). Next key press (key press time (t1 (2)) is to be made. In the actual key press operation (reference numeral 320), the first key press and the key release are appropriately performed. However, when t2 (1) has elapsed after the key release and the next key should be depressed at time T (see symbol 322), t2 '(<t2 (1)) has elapsed (see symbol 310). The next key depression is performed at time T ′ (see reference numeral 321), that is, the key depression is advanced by T−T ′ (= t2 (1) −t2 ′). Data reading needs to be accelerated by TT ′ (see reference numeral 311).

  Also in FIG. 4, in the actual key pressing operation (reference numeral 420), the first key pressing and key releasing are appropriately performed. However, in the example of FIG. 4, after the first key is released, the next key is not pressed even after t2 (1) has elapsed (see reference numeral 410). For example, as shown in FIG. 5, it is considered that the key is pressed at time T ″ (see reference numeral 521) after the time t ″ (> t2 (1)) has elapsed after the first key is released. In this case, the key depression is delayed by t ″ −t2 (1). Therefore, it is necessary to delay the reading of the music data by t ″ −t2 (1) (see reference numeral 512). In addition, at the time indicated by reference numeral 511, data at a new address of audio data cannot be read.

  In the present embodiment, as will be described later, the generation of a musical sound by pressing a key is a musical sound generated by the sound source unit 26. However, since song accompaniment is realized by reproducing audio data, FIG. 3 and FIG. As shown in FIG. 5, it is necessary to appropriately read out audio data when the key depression is advanced or delayed. In the present embodiment, appropriate reading is realized by a method as described later.

  FIG. 6A is a diagram showing a data configuration example of song data according to the present embodiment, and FIG. 6B is a diagram showing an example of a register group storing data set in the course of processing. . As shown in FIG. 6A, the music data 600 includes a time record indicating a time interval (see reference numerals 601, 603, and 605) and a note-on event record (reference numeral 602) including the pitch of the key to be pressed. And a note off event record (see reference numeral 604) including the pitch of the key to be released.

  The first time record stores the time t0 until the first key depression. This time t0 corresponds to the time of the intro of the music. The time t1 stored in the time record between the note-on event record and the note-off event record indicates the key pressing time. The time t2 stored in the time record between the note-off event record and the note-on event record indicates the time interval from when a key is released until the next key is pressed. ing.

  As shown in FIG. 6B, the register group 610 in the RAM 23 includes an elapsed time register, a time information register, a current pitch information register, a next pitch information register, a song elapsed time register, a correct flag, a status register, a loop. Has a playback flag. The elapsed time register stores a time elapsed between song processes. The time information register stores a time interval (Δt = t1 + t2) between note-on events. The pitch information included in the note-on event record is stored in the current pitch information register and the next pitch register. The song elapsed time register stores the elapsed time since the song was started. The status register stores the performance status of the electronic musical instrument 10.

  Hereinafter, processing executed in the electronic musical instrument 10 according to the present embodiment will be described. FIG. 7A is a flowchart showing an example of a main flow executed in the electronic musical instrument according to the present embodiment. FIG. 7B is a flowchart showing an example of timer interrupt processing according to the present embodiment. In the timer interrupt process, the counter values of the elapsed time counter and the song elapsed time counter, which are interrupt counters, are incremented at predetermined time intervals when the main flow shown in FIG. (Steps 711 and 712). In the timer interrupt process, the counter can be stopped by an instruction from the CPU 21.

  As shown in FIG. 7A, when the electronic musical instrument 10 is turned on, the CPU 21 of the electronic musical instrument 10 performs initial processing (initialization processing) including clearing and clearing of data in the RAM 23 and an image on the display unit 15. ) Is executed (step 701). When the initial process (step 701) ends, the CPU 21 detects each operation of the switches constituting the switch group 16 and executes a switch process for executing a process according to the detected operation (step 702).

  For example, in the switch process (step 702), operations of a tone color designation switch, a song data designation switch for song accompaniment, and a song playback switch are detected. For example, when the song playback switch is turned on, the CPU 21 stores a predetermined value in the status register in the register group 610. When the song playback switch is turned off, a value indicating the song playback off state is stored in the status register.

  When the switch process (step 702) ends, the CPU 21 executes a keyboard process (step 703). FIG. 8 is a flowchart showing in more detail an example of keyboard processing according to the present embodiment. In the keyboard process, the CPU 21 scans the keys on the keyboard 11 (step 801). An event (note-on or note-off) as a key scanning result is temporarily stored in the RAM 23. The CPU 21 refers to the key scanning result stored in the RAM 23 to determine whether or not there is a new event for a certain key (step 802). If it is determined Yes in step 802, the CPU 21 refers to the status register to determine whether the performance status is “song being played” (step 803).

  If it is determined YES in step 803, a lesson keyboard process is executed (step 804). On the other hand, if it is determined No in step 803, normal keyboard processing is executed (step 805). In step 805, the CPU 21 determines whether the key event is note-on (key press) or note-off (key release). If it is note-on, the CPU 21 generates a note-on event including information on the pitch of the pressed key and outputs it to the sound source unit 26. If the note is off, a note-off event including information on the pitch of the released key is generated and output to the sound source unit 26.

  Next, the lesson keyboard process (step 804) will be described. FIG. 9 is a flowchart showing an example of lesson keyboard processing according to the present embodiment. As shown in FIG. 9, the CPU 21 determines whether the key event is a new note-on (step 901). If it is determined Yes in step 901, the CPU 21 generates a note-on event including information on the pitch of the pressed key and outputs it to the sound source unit 26 (step 902). If NO is determined in step 901, a note-off event including pitch information of the key that has been released is generated and output to the sound source unit 26 (step 903). After step 903, the lesson keyboard processing ends.

  After step 902 is executed, the CPU 21 determines whether or not the pitch of the key for the new note-on coincides with that stored in the next pitch information register (step 904). If it is determined NO in step 904, the lesson keyboard process is terminated. If it is determined Yes in step 904, if it is determined Yes in step 904, the CPU 21 sets the correct answer flag in the register group to “1” (step 905). This correct answer flag is set to “1” when the key pressed by the player matches the key to be pressed next.

  Next, the CPU 21 determines whether or not the audio data as the song accompaniment data is currently being loop-reproduced (step 906). Whether the loop is being reproduced may be determined by checking whether the loop reproduction flag in the register group is “1”. If it is determined No in step 906, the CPU 21 searches for the jump source time corresponding to the fast press (step 907). If it is determined Yes in step 906, the CPU 21 determines the jump corresponding to the slow press. The original time is searched (step 908). The jump source time is a zero cross point of a predetermined phase (for example, the data value shifts from negative to positive) in the future in time series from the key pressing timing.

  When the keyboard process (step 703) is completed, the CPU 21 executes a song process (step 704). FIG. 10 is a flowchart showing an example of song processing according to this embodiment. As shown in FIG. 10, the CPU 21 refers to the status register to determine whether or not the performance status indicates “song is being played” (step 1001). When it is determined No in step 1004, the CPU 21 refers to the status register to determine whether the performance status indicates “song start” (step 1002). If it is determined No in step 1002, the song processing is terminated. If it is determined YES in step 1002, the CPU 21 executes a song start process (step 1003).

  FIG. 11 is a flowchart showing an example of the song start process according to the present embodiment. As shown in FIG. 11, the CPU 21 obtains the time t0 from the first record of the song data stored in the ROM 22 (step 1101). This time t0 is stored as initial time information Δt in the time information register in the register group. The CPU 21 acquires the note-on event from the record at the next address, and stores the pitch information included in the note-on event in the current pitch information register (step 1102). Further, the CPU 21 acquires a record of the next note-on event, and stores pitch information included in the next note-on event in the time pitch information register (step 1103).

  Further, the CPU 21 permits the operation of the song elapsed time counter by the timer interruption process, starts measuring the song elapsed time (step 1104), and instructs the audio data playback unit 29 to start the audio data playback (step 1105). ). Further, the CPU 21 stores information indicating “song being reproduced” as the performance status in the status register (step 1106).

  When it is determined Yes in step 1001, the CPU 21 executes a song tone reproduction process (step 1004). FIG. 12 is a flowchart showing an example of song tone reproduction processing according to the present embodiment. As shown in FIG. 12, the CPU 21 acquires the register value of the elapsed time register (step 1201). Next, the CPU 2 determines whether or not the time information Δt should be calculated (step 1202). If it is determined Yes in step 1202, the time t1 in the record next to the note-on event record and the time t2 in the record next to the record of the note-off event for the currently pressed key are obtained. The addition value t1 + t2 is added and stored in the time information register as time information Δt (step 1203). Note that the case where the time information Δt should be calculated in step 1202 is a case where the values of the current pitch information register and the next pitch information register are changed.

  Next, the CPU 21 calculates Δt−elapsed time (step 1204). In steps 1201 to 1204, it is determined whether the elapsed time from the previous key press (note-on) time has elapsed by Δt and the next key press (note-on) time has been reached. In step 1205, referring to the result in step 1204, if Δt has elapsed from the previous key pressing time (Yes in step 1205), the time to press the next key has been reached. This indicates that the key has not been pressed yet. Therefore, if it is determined Yes in step 1205, the CPU 21 executes a loop point search process (step 1206).

  FIG. 13 is a flowchart showing an example of the loop point search process according to the present embodiment. As shown in FIG. 13, the CPU 21 calculates a loop period which is the period of the pitch based on the current pitch information in the current pitch register (step 1301). This loop period is the basic period of the audio data loop. The CPU 21 searches the zero cross point retroactively from the currently reproduced address in the audio data (step 1302). The CPU 21 calculates an average period between zero cross points (step 1303). Here, the zero-cross points to be searched are all zero-cross points having the same phase. That is, if the first found zero cross point is a rising (crossing data value from negative to positive) zero cross point, all other found zero cross points are also rising zero cross points.

  The CPU 21 determines whether the absolute value of the difference between the loop period and the average period is within an allowable range (that is, smaller than a predetermined threshold) (step 1304). When it is determined No in step 1304, the CPU 21 searches the next zero cross point by going back in time series of the audio data (step 1302). On the other hand, if it is determined Yes in step 1304, the CPU 21 stores the zero cross point where the absolute value of the difference is within the allowable range in the RAM 23 as a loop destination point among the loop points of the audio data. (Step 1305). The loop point includes a loop destination point and a loop source point. In the present embodiment, the time (loop destination time) corresponding to the zero cross point is stored as information indicating the loop destination point. Further, as will be described later, in the present embodiment, the normal key pressing timing coincides with the zero cross point of a predetermined phase (rise, that is, the data value shifts from negative to positive). Therefore, the loop source point is a point corresponding to the regular key pressing timing. Therefore, in the present embodiment, time (loop source time) corresponding to the regular key pressing timing is stored as information indicating the loop source point.

  Thereafter, the CPU 21 sets the loop regeneration flag in the register group to “2” (step 1306). The loop playback flag indicates the loop playback state of the audio data, and the flag being “2” indicates the loop playback start state. In addition, the flag being “1” indicates a loop playback state, and the flag being “0” indicates a state in which loop playback is not being performed.

  FIG. 14 is a diagram for explaining an example of loop point detection according to the present embodiment. In FIG. 14, the note-off (key release) timing is indicated by reference numeral 1401, and the original next note-on (key pressing) timing is indicated by reference numeral 1402. The time from note-on of one key to the next note-on is Δt (see reference numeral 1400). Audio data as a song accompaniment is indicated by reference numeral 1400. Note that the pitch of the case where the key is already pressed and released (reference numeral 1401) is A4 = 440 Hz, and the loop period is about 2.27 msec.

  In FIG. 14, when the actual key depression is not performed at the next next note-on, the CPU 21 measures the period between the zero cross points (zero cross points of the same phase) of the audio data. In the first process, a set of zero cross points is identified retrospectively from the original note-on timing, and the average period of the waveform (see reference numeral 1411) between them is 2.22 msec. For example, in the present embodiment, if the threshold value related to the pitch of A4 is 0.01 msec, | 2.27-2.22 | ≧ threshold value, so it is determined No in step 1304 in FIG. In 1302, two sets of zero cross points are identified further back in time series.

  An average period (2.245 msec) of two waveforms (reference numerals 1411 and 1412) between them is calculated. Again, since | 2.27−2.245 | ≧ threshold, the process returns to step 1302 again. In step 1302, three sets of zero cross points are identified further back in time series. An average period (2.263 msec) of three waveforms (see reference numerals 1411 to 1413) between them is calculated. Again, since | 2.27-2.263 | ≧ threshold, the process returns to step 1302 again.

  In step 1302, four sets of zero cross points are identified further back in time series. An average period (2.27 msec) of four waveforms (see reference numerals 1411 to 1414) between them is calculated. Here, since | 2.27-2.27 | <threshold, it is determined Yes in step 1304, and a section (see reference numeral 1420) composed of four waveforms 1411 to 1414 is a loop section, and its start and end points ( Reference numerals 1422 and 1421) are loop points. In the present embodiment, the start point corresponds to the loop destination time, and the end point corresponds to the loop source time.

  In this way, a period of a waveform having a period that matches the pitch of the currently sounding musical tone is obtained, and by repeatedly reading out the waveform of the period, it is possible to output a song accompaniment sound that does not make the player feel uncomfortable. It becomes possible.

  When the song tone reproduction process (step 1004) is completed, the CPU 21 executes a song audio reproduction process (step 1005). 15 and 16 are flowcharts showing an example of the song audio playback process according to the present embodiment. As shown in FIG. 15, the CPU 21 determines whether or not the loop reproduction flag is “2” (step 1501). When the loop reproduction flag is “2”, it indicates that the loop reproduction start state is set. If it is determined YES in step 1501, the process proceeds to step 1611 in FIG. When it is determined No in step 1501, the CPU 21 determines whether or not the loop reproduction flag is “1” (step 1502). When the loop reproduction flag is “1”, it indicates that the loop reproduction state is set. If it is determined Yes in step 1502, the CPU 21 proceeds to step 1601 in FIG.

  When it is determined No in step 1502, that is, when the reproduction flag is “0” (when loop reproduction is not performed), the CPU 21 determines whether or not the correct flag is “1” (step 1). 1503). If it is determined No in step 1503, the song audio playback process is terminated. If it is determined Yes in step 1503, it indicates that the player has pressed the key to be pressed next (early pressed) earlier than the normal key pressing timing. In this case, the CPU 21 refers to the elapsed time counter to determine whether the jump source time has been reached (step 1504). If NO in step 1504, the song audio process is terminated.

  The jump source time is the latest zero cross point in the future in chronological order from the key pressing timing of the pressed key. Therefore, in this embodiment, it is possible to detect the zero cross point and smooth the seam of the audio data. If it is determined Yes in step 1504, the CPU 21 resets the correct answer flag to “0” (step 1505). Further, the CPU 21 updates the song elapsed time based on the jump source time (step 1506). That is, by matching the jump source time with the normal key pressing timing of the next key to be pressed corresponding to the jump destination time in the present embodiment, the joint is smooth and the player quickly presses the key. The corresponding audio data can be reproduced. Thereafter, the CPU 21 updates the current pitch information, time information Δt, and next pitch information with reference to the music data (steps 1507 to 1509).

  Next, the case where Yes is determined in step 1502 will be described. If it is determined Yes in step 1502, loop playback has already been performed. In this case, the CPU 21 determines whether or not the correct answer flag is “1” (step 1601). If it is determined No in step 1602, the song audio playback process is terminated.

  If it is determined Yes in step 1601, this indicates that the player has pressed the key to be pressed next later than the normal key pressing timing (slow pressing). If it is determined Yes in step 1601, the CPU 21 refers to the elapsed time counter to determine whether the jump source time has been reached (step 1602). If NO in step 1602, the song audio process is terminated. If it is determined Yes in step 1602, the CPU 21 resets the loop reproduction flag to “0” (step 1603). Thereafter, the processing of steps 1505 to 1509 is executed.

  Next, the case where No is determined in step 1501 will be described. If it is determined YES in step 1501, the CPU 21 outputs the two loop points (loop source time and loop destination time) set in step 1305 of FIG. 13 to the audio data reproducing unit 29 (step 1611). . In addition, the CPU 21 stops counting of the song elapsed time counter by the timer interrupt process (step 1612) and also stops counting of the elapsed time counter (step 1613). This is because during loop playback, audio data is loop-played between the loop source time and the loop destination time, and the music data itself does not progress. Further, the CPU 21 sets the loop reproduction flag to “1” (step 1614). Thereafter, the song audio playback process ends.

  When the song process (step 704) ends, the CPU 21 executes a sound source sound generation process (step 705). FIG. 17 is a flowchart showing an example of the sound source sound generation process according to the present embodiment. In the sound source sound generation process of FIG. 17, steps 1701 to 1712 are executed by the audio data reproducing unit 29 based on the instruction from the CPU 21 and the received information. In addition, step 1713 is executed by the sound source unit 26.

  As shown in FIG. 17, the audio data reproducing unit 29 determines whether or not the loop reproduction flag is “1” (step 1701). If it is determined No in step 1701, normal audio data is read out. That is, the audio data reproducing unit 29 determines whether or not the data read time according to the sampling rate has been reached (step 1702). If it is determined Yes in step 1702, the audio data reproducing unit 29 reads audio data based on the data read address of the audio data (step 1703) and outputs it to the audio circuit 27 (step 1704). Next, the audio data reproducing unit 29 advances the data read address in the audio data area (step 1705).

  If it is determined Yes in step 1701, the audio data reproducing unit 29 determines whether the data read address of the audio data has reached a value corresponding to the loop source time (step 1706). If it is determined Yes in step 1706, the audio data reproducing unit 29 changes the data read address to a value that responds to the jump time (step 1707). Note that the jump destination time is a time corresponding to the normal key pressing timing of the pressed key.

  Next, the audio data reproduction unit 29 determines whether or not the data read time according to the sampling rate has been reached (step 1708). If it is determined Yes in step 1708, the audio data reproducing unit 29 reads out the audio data based on the data read address of the audio data (step 1709), and multiplies it with the envelope that attenuates over time (step 1710). ). Thereafter, the audio data reproducing unit 29 outputs the multiplied audio data to the audio circuit 27 (step 1711). Further, the audio data reproducing unit 29 advances the data read address in the audio data area (step 1712).

  In this way, when normal audio data reproduction or audio data loop reproduction is performed, musical tone data sound generation processing by the sound source unit 26 is executed (step 1703). Of course, Steps 1701 to 1712 and Step 1713 may be executed in parallel. In the musical tone data sound generation process, if the sound source unit 26 has received a note-on event from the CPU 21, the tone waveform data according to the note-on event is read from the ROM 22 at a speed according to the pitch, and the read waveform is read out. The data is multiplied by a predetermined envelope, and the multiplied data is output to the audio circuit 27. If a note-off event is accepted from the CPU 21, the pitch data corresponding to the note-off event is silenced.

  When the sound source sound generation process (step 705) ends, the CPU 21 executes other processes (for example, image display on the display unit 15; step 706), and returns to step 702.

  FIG. 18 shows an example of the key press (note-on) and key release (note-off) timings and audio data in the present embodiment, and FIG. 19 shows the audio data when the player performs a quick press. It is a figure which shows an example. As shown in FIG. 18, in this embodiment, the key depression timing of the music data 1800 matches the zero cross point of the predetermined phase of the audio data 1810 (in this example, the data value shifts from negative to positive) in advance. (See symbols 1811 and 1812). In this example, the waveform between the key press at the first normal key press timing (see reference numeral 1811) and the key press at the next normal key press timing is defined by the zero cross point of the same phase. (Reference numeral 1821). Similarly, the waveform between the key pressing at the next normal key pressing timing and the next normal key pressing timing is also defined by the zero-cross point of the same phase. In the present embodiment, the regular key pressing timing is configured to coincide with the zero cross point of a predetermined phase of the audio data, but the present invention is not limited to this.

  In FIG. 19, the performer performs the first key depression at a timing earlier than the normal timing (see reference numeral 1911). In this case, in the audio data, the latest zero cross point in the future is found in time series from the key pressing timing by the performer (see reference numeral 1931). Therefore, at the zero cross point, a waveform (reference numeral 1941) between the key depression at the first regular key depression timing (see numeral 1811) and the key depression at the next regular key depression timing is connected. In FIG. 19, a waveform 1941 between timings 1931 and 1912 matches the waveform 1821 of FIG. 18, and a waveform 1942 between timings 1912 and 1913 matches the waveform 1822 of FIG.

  As described above, in this embodiment, when there is a fast press by the performer, a future and the latest zero cross point is found in the audio data in time series, from which the data value starts from zero. The audio data corresponding to the regular key pressing timing is spliced and reproduced. Therefore, even if there is a key depression earlier than the regular key depression timing, the audio data is read according to the early key depression, and the joint is smooth, so that unpleasant noise does not occur.

  If the player does not press the key at regular timing, the loop destination time (reference numeral 1422) and the loop original time (reference numeral 1421) while there is no key press, as described with reference to FIG. Audio data is played back in a loop. After that, when the user presses the key to be pressed, the normal key pressing of the pressed key from the jump source time corresponding to the nearest zero cross point in the future in chronological order from the key pressing timing. The read address of the audio data is switched at a jump destination time that is a time corresponding to the timing. Therefore, the audio data is read according to the slow key depression as in the case of the early depression, and the joint is smooth, so that unpleasant noise does not occur.

  In the present embodiment, the audio data is configured such that the normal key pressing timing of the key matches the zero-cross point of the predetermined phase of the audio data, but the present invention is not limited to this. . In this case, as the jump destination time, a zero-cross point of a predetermined phase that is in the future in the time series from the audio data corresponding to the normal key pressing timing of the key may be used.

  In the present embodiment, when it is determined that the key pressing timing is earlier than the tone generation timing specified in the song data, the CPU 21 performs one-time chronological order from the key pressing timing in the audio data. Find the first zero cross point at the nearest and predetermined phase. Further, based on the normal sound generation timing in the music data relating to the key depression operation, the second zero cross point of the nearest and predetermined phase in one direction in time series from the normal sound generation timing is found. The CPU 21 outputs the first zero cross point information and the second zero cross point information to the audio data reproduction unit 29. The audio data reproduction unit 29 jumps to read audio data from the first zero cross point to the second zero cross point, and thereafter continues to read normal audio data.

  As a result, even when a key is pressed quickly, audio data corresponding to the normal tone generation timing (key pressing timing) of the key press can be reproduced. It is possible to prevent a deviation from occurring during data reproduction. Also, by realizing reading of audio data in which zero-cross points having the same phase are connected, it is possible to prevent noise from occurring at the seam of the audio data.

  In the present embodiment, when the audio data reading is jumped from the first zero cross point to the second zero cross point, the CPU 21 updates and updates the elapsed time based on the normal sound generation timing. According to the elapsed time, the audio data reproducing unit 39 reads audio data. Therefore, it is possible to optimize the elapsed time even when the player presses quickly.

  Further, in the present embodiment, the CPU finds the first zero cross point that is in the future in the chronological order from the key pressing timing, and based on the normal sounding timing (key pressing timing), The second zero crossing point in the future in the chronological order is found from the pronunciation timing of. As the first zero-cross point, the transition from the first zero-cross point to the second zero-cross point can be appropriately performed while considering the processing time by finding the most recent one in the time series from the key press timing. realizable.

  In particular, in the present embodiment, a zero-cross point having a predetermined phase is located at a timing corresponding to the tone generation timing (key press timing) of the musical sound in the audio data. The CPU 21 detects a second zero cross point having a predetermined phase corresponding to the regular sounding timing (key pressing timing). Thereby, it becomes possible to easily detect the second key pressing timing.

  The present invention is not limited to the above embodiment. For example, in the embodiment described above, a plurality of loop waveforms whose average period approximates the loop period based on the pitch information (current pitch information) of the tone currently being generated are specified. However, the present invention is not limited to this. For example, if a chord name is added to the song data, the loop period based on the root note and the period of the loop waveform of the audio data are compared based on the chord name associated with the currently sounding tone. good.

  FIG. 20 is a diagram showing a data configuration example of song data according to another embodiment of the present invention. As shown in FIG. 20, in another embodiment, a record of code information (see reference numerals 2002 and 2012) is provided in association with each of the note-on events (see reference numerals 2001 and 2011) of the music data 2000. . The chord information includes information indicating root sounds, such as CM7, Cm7, Am7, and D7.

  FIG. 21 is a flowchart showing an example of the loop point search process according to the present embodiment. As shown in FIG. 21, the CPU 21 acquires chord information in the song data associated with the current pitch information in the current pitch register (step 2101). Next, the CPU 21 calculates a loop period, which is a period of the root sound, based on the root sound included in the chord information (step 2102). For example, if the chord information is AM7, Am7, and the root tone is A, for example, a loop period (4.5454 msec) based on A3 (220 KHz) is calculated. Here, considering the octave, a relatively low pitch is adopted as the root tone.

  Subsequent steps 2103 and 2104 are the same as steps 1302 and 1303 in FIG. Next, the CPU 21 determines whether the absolute value of the difference between the loop period and n times the average period (n = 1, 2, 4) is within an allowable range (that is, smaller than a predetermined threshold) (step 2105). ). Step 2105 considers the possibility that the audio data is a musical tone that is one octave and two octaves higher than the root tone.

  When it is determined No in step 2105, the CPU 21 searches the next zero cross point by going back in time series of the audio data (step 2103). When it is determined Yes in step 2105, the CPU 21 stores the zero cross point where the absolute value of the difference is within the allowable range in the RAM 23 as a loop destination point among the loop points of the audio data (step 2106). ) And a loop reproduction flag is set to “2” (step 2107).

  Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited to the above-described embodiments, and the invention described in the claims and the equivalents thereof are described in the present invention. Is included in the range. Hereinafter, the invention described in the scope of claims attached to the application of the present application will be added. Note that the item numbers of the claims described in the appendix correspond to the item numbers of the claims first attached to the application of the present application.

[Appendix]
According to the first aspect of the present invention, there is provided storage means for storing music data including time information indicating the pitch and tone generation timing of a musical sound constituting a music, and audio data which is accompaniment data of the music related to the music data. When,
Musical tone data generating means for generating musical tone data of a predetermined musical tone based on an operation of a performance operator arranged in parallel;
An audio data reproducing means for reading out the audio data according to an elapsed time based on time information included in the music data,
Jump destination detection for detecting from the audio data the first zero-cross point closest to the normal sound generation timing in one direction in time series based on the normal sound generation timing in the music data for the operation of the performance operator Means,
Operation determining means for determining whether or not the performance operator that generates a musical tone having a pitch corresponding to the sound generation timing has been operated before the sound generation timing indicated in the song data;
When it is determined by the operation determining means that the performance operator is not operated, the sound of the musical sound that is sounded among the zero cross points before the zero cross point, starting from the first zero cross point. A loop destination detecting means for detecting a second zero cross point existing at a position corresponding to an end point of a section proportional to a period matched to high;
Loop reading means for repeatedly reading out the audio data using a section between the second zero cross point and the first zero cross point as a loop section;
When it is determined by the operation determining means that the performance operator has been operated after reading is started by the loop reading means, the latest third one in one direction in time series from the operation timing of the performance operator. Jump source detection means for detecting the zero cross point of the audio data,
The audio data reproducing means is configured to cause the audio data read to jump from the detected third zero cross point to the detected first zero cross point, and thereafter to continue reading normal audio data. A musical tone generating device having control means for controlling.

  According to a second aspect of the present invention, when the audio data reproducing means jumps the reading of the audio data from the third zero cross point to the first zero cross point, the progress based on the normal sound generation timing. 2. The musical sound generating apparatus according to claim 1, wherein the musical sound generating apparatus is configured to update to time and to read out the audio data according to the updated elapsed time.

  According to a third aspect of the present invention, the jump source detecting means is configured to find a third zero cross point that is in the future and nearest in time series from the operation timing of the performance operator, and the jump destination detection The means is a musical sound generating device configured to detect the first zero cross point in the future in a time series from the normal sound generation timing based on the normal sound generation timing.

  According to a fourth aspect of the present invention, in the audio data, a zero-cross point having a predetermined phase is located at a timing corresponding to the tone generation timing of the musical sound, and the jump destination detection means corresponds to the regular tone generation timing. The musical tone generation apparatus according to claim 1, wherein a first zero cross point having a predetermined phase is detected.

According to a fifth aspect of the present invention, there is provided storage means for storing song data including time information indicating the pitch and tone generation timing of musical sounds constituting a song, and audio data which is accompaniment data of the song relating to the song data. And reading out the audio data according to the musical sound data generating means for generating musical sound data of a predetermined musical sound based on the operation of the performance operator arranged in parallel, and the elapsed time based on the time information included in the song data. An audio data reproducing means;
Jump destination detection for detecting from the audio data the first zero-cross point closest to the normal sound generation timing in one direction in time series based on the normal sound generation timing in the music data for the operation of the performance operator Steps,
An operation determination step for determining whether or not the performance operator for generating a musical tone having a pitch corresponding to the sound generation timing has been operated before the sound generation timing indicated in the song data;
When it is determined that the performance operator has not been operated, the cycle is consistent with the pitch of the tone being played out of the zero cross points before the zero cross point, starting from the first zero cross point. A loop destination detection step for detecting a second zero cross point existing at a position corresponding to the end point of the proportional section;
A loop reading step of repeatedly reading out the audio data with a section between the second zero cross point and the first zero cross point as a loop section;
When it is determined that the performance operator has been operated after reading is started by this loop reading step, the nearest third zero cross point in one direction in time series from the operation timing of the performance operator is obtained. , A jump source detecting step for detecting from the audio data;
The audio data reproducing means is configured to cause the audio data read to jump from the detected third zero cross point to the detected first zero cross point, and thereafter to continue reading normal audio data. Control steps to control;
Is a program for generating musical sounds.

DESCRIPTION OF SYMBOLS 10 Electronic musical instrument 11 Keyboard 12, 13 Switch 15 Display part 21 CPU
22 ROM
23 RAM
24 Sound System 25 Switch Group 26 Sound Source 27 Audio Circuit 28 Speaker 29 Audio Data Playback Unit

Claims (4)

Time information included in the song data from the storage means storing the song data including time information indicating the pitch and tone generation timing of the musical sound constituting the song and the accompaniment data of the song related to the song data Audio data reading means for reading the audio data according to the elapsed time based on
Based on the normal sound generation timing in the music data relating to the operation of the performance operators, the series in the future and and the nearest first zero-cross points when the sound generation timing of the normal, and jump detection means for detecting from said audio data ,
Operation determining means for determining whether or not the performance operator that generates a musical tone having a pitch corresponding to the sound generation timing has been operated before the sound generation timing indicated in the song data;
When it is determined by the operation determining means that the performance operator is not operated, the sound of the musical sound that is sounded among the zero cross points before the zero cross point, starting from the first zero cross point. A loop destination detection means for detecting a second zero cross point that is the same as or closest to the position of the end point of the section corresponding to the period matched to high and has the same phase as the first zero cross point;
Loop reading means for repeatedly reading out the audio data using a section between the second zero cross point and the first zero cross point as a loop section;
When it is determined by the operation determining means that the performance operator has been operated after reading is started by the loop reading means, it is in the future in the time series from the operation timing of the performance operator, and Jump source detection means for detecting a third zero cross point in phase with the operation timing of the performance operator from the audio data;
The audio data reading means is configured to cause audio data reading to jump from the detected third zero cross point to the detected first zero cross point, and thereafter to continue normal audio data reading. Control means for controlling;
A musical sound generating device having   The audio data reading means updates the elapsed time based on the normal sound generation timing when the audio data reading unit jumps from the third zero cross point to the first zero cross point, and the updated progress The musical sound generation apparatus according to claim 1, wherein the audio data is read according to time. Time information included in the song data from the storage means storing the song data including time information indicating the pitch and tone generation timing of the musical sound constituting the song and the accompaniment data of the song related to the song data An audio data reading means for reading the audio data according to the elapsed time based on
Based on the normal sound generation timing in the music data according to the operation of Starring Somisao Sakuko, jump destination detection step of the series in the future and and the nearest first zero-cross points when the sound generation timing of the normal, is detected from the audio data When,
An operation determination step for determining whether or not the performance operator for generating a musical tone having a pitch corresponding to the sound generation timing has been operated before the sound generation timing indicated in the song data;
When it is determined that the performance operator has not been operated, the cycle is consistent with the pitch of the tone being played out of the zero cross points before the zero cross point, starting from the first zero cross point. A loop destination detection step for detecting a second zero cross point that is the same as or closest to the position of the end point of the corresponding section and has the same phase as the first zero cross point;
A loop reading step of repeatedly reading out the audio data with a section between the second zero cross point and the first zero cross point as a loop section;
When it is determined that the performance operator has been operated after reading is started by the loop reading step, the performance operator is in the future in the chronological order from the operation timing of the performance operator. A jump source detection step of detecting a third zero cross point in phase with the operation timing of the audio data;
The audio data reading means is configured to cause audio data reading to jump from the detected third zero cross point to the detected first zero cross point, and thereafter to continue normal audio data reading. Control steps to control;
Music generation program that executes A performance controller,
A musical sound generating device according to claim 1;
Audio means for outputting an acoustic signal based on the musical sound data and audio data from the musical sound generating device;
Electronic musical instrument with

Images