JP4665664B2 - Sequence data generation apparatus and sequence data generation program - Google Patents

Description

  The present invention relates to an apparatus and a program for generating sequence data used for driving elements in conjunction with musical sounds.

In an electronic device having a music playback function such as a mobile phone, in order to improve amusement when playing music, the LED may blink or the vibrator may be vibrated in accordance with the timing of music notes (musical notes). . Here, in the case where the electronic device is to play a music piece by driving a sound source with performance data such as MIDI data, control of blinking of LED or the like is performed on note-on and note-off instruction information included in the performance data. Could be used. However, recent cellular phones and the like also provide a model in which music playback is performed by playing back audio stream data obtained by recording a performance instead of playing music by driving a sound source in this way. Yes. In this case, since the audio stream data is data representing a musical sound waveform and not directly representing note-on or note-off timing, it cannot be used for LED blinking control or the like. Therefore, in an apparatus that reproduces music using such audio stream data, in order to perform LED blinking control and the like, it is necessary to separately prepare data indicating the timing of music notes. Conventionally, there has been a technique disclosed in Patent Document 1 as a technique for extracting note timing from audio stream data. This technology divides audio stream data into frames of a certain time length, performs frequency analysis for each frame to obtain a spectrum, and detects the timing of notes by detecting discontinuity of the spectrum peak between frames. Is.
JP 2003-5744 A

  By the way, since the technique disclosed in Patent Document 1 described above detects the timing of a note based on the discontinuity of the spectrum peak, the sound stream audio stream data whose pitch changes clearly with the passage of time. Otherwise, there is a problem that it is difficult to detect the timing of the note from the audio stream data itself.

  The present invention has been made in view of the circumstances described above, and even when the processing target is music stream audio stream data whose pitch change is not clear, such as percussion instrument sound, the timing of the notes An object of the present invention is to provide a sequence data generation device and a sequence data generation program that can detect sequence and generate sequence data for driving elements such as LEDs and vibrators.

The present invention provides a frequency analysis means for sequentially obtaining frequency characteristics of each part from a start point to an end point of audio stream data indicating a waveform of a music piece or a part thereof, a range specifying means for specifying a frequency band and an amplitude range, Sequence data indicating the generation timing of a musical tone based on the detection result of detecting a period in which the frequency spectrum sequentially obtained by the frequency analysis means includes frequency spectrum and amplitude range designated by the range designation means. And a sequence data generation program for causing a computer to function as each means.
According to this invention, by designating appropriate frequency band and amplitude range by the range designating means, the tone generation timing is detected from the frequency characteristics of the audio stream data sequentially obtained by the frequency analyzing means, and sequence data is generated. be able to.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a sequence data generating apparatus according to an embodiment of the present invention. This sequence data generation apparatus is obtained by installing a sequence data generation program for generating sequence data from audio stream data in a computer such as a personal computer.

  In FIG. 1, a CPU 1 is a control center that controls each part of the sequence data generating apparatus. The ROM 2 is a read-only memory that stores a control program for controlling the basic operation of the sequence data generating device such as a loader. The display unit 3 is a device for displaying an operation state of the device and a message for the user. The operation unit 4 is a means for receiving commands and various types of information from the user, and includes various types of operators such as a keyboard and a mouse. The I / F (interface) group 5 exchanges data with a network interface for performing data communication with other devices via a network, and with an external storage medium such as a magnetic disk or a CD-ROM. It consists of a driver for performing. The HDD (hard disk device) 6 is a non-volatile storage device for storing information such as various programs and databases. The RAM 7 is a volatile memory used as a work area by the CPU 1. The CPU 1 loads a program in the HDD 6 into the RAM 7 and executes it in accordance with a command given via the operation unit 4. The sound system 8 is a device that outputs sound under the control of the CPU 1.

  Information stored in the HDD 6 includes a sequence data generation program and audio stream data to be processed. Here, the audio stream data is data obtained by sampling and encoding a musical sound waveform during music performance. The sequence data generation program is a program for extracting note information indicating a tone generation period from the audio stream data and generating sequence data including a series of note information. In a preferred embodiment, the sequence data generation program and the audio stream data are downloaded from a site in the Internet via an appropriate one in the I / F group 5 and installed in the HDD 6. In another aspect, the sequence data generating program and the audio stream data are traded in a state stored in a computer-readable storage medium such as a CD-ROM or MD. In this aspect, the sequence data generation program or audio stream data is read from the storage medium via an appropriate one in the I / F group 5 and installed in the HDD 6.

  FIG. 2 is a block diagram showing the processing contents of the sequence data generation program. As shown in this figure, the sequence data generation program includes each of windowing 11, FFT (Fast Fourier Transform) 12, power spectrum display 13, parameter setting 14 by rectangular designation, peak detection 15 within rectangle, and sounding time accumulation 16. Includes processing. In the windowing 11, the audio stream data to be processed is divided into frames having a fixed time length, and a window function is multiplied for each frame. In the FFT 12, for each frame, the audio stream data multiplied by the window function is subjected to FFT to obtain the frequency characteristics of the audio stream data. In the power spectrum display 13, the power spectrum that is the absolute value of the frequency characteristic of each frame obtained in the FFT 12 is displayed on the display unit 3 with the horizontal axis as the frequency axis and the vertical axis as the amplitude axis.

  FIG. 3 shows an example of a power spectrum displayed on the display unit 3 by the processing of the power spectrum display 13. A waveform such as a percussion instrument sound includes a power spectrum distributed over a wide frequency range, as shown in the example in the figure, but the amplitude of the power spectrum changes greatly from the start of sound generation to the end of sound generation. There is a characteristic power spectrum. The user confirms the power spectrum display on the display unit 3 and finds a frequency band and an amplitude area where such a characteristic power spectrum exists. In the parameter setting 14 by specifying a rectangle, the start point P1 and the end point P2 of the rectangular area where the characteristic power spectrum exists are displayed on the display screen of the display unit 3 on which the power spectrum is displayed by pointing the operation unit 4 with a mouse or the like. Let the user specify by operating the device. Then, in the parameter setting 14 by rectangle designation, as shown in FIG. 3, the rectangular area designated by the operation of the operation unit 4 is superimposed on the power spectrum, and the frequency band and the vertical direction indicated by the horizontal side of the rectangular area are displayed. The amplitude range indicated by the edge is received as a parameter.

  Each process of the detection of the peak in rectangle 15 and the sounding time accumulation 16 constitutes a process of extracting note information from the power spectrum of the audio stream data and generating sequence data. These processes can be executed by executing parameter setting 14 by specifying a rectangle and setting a frequency band and an amplitude band. In the in-rectangular peak detection 15, it is determined for each frame whether any of the power spectrum peaks obtained by the FFT 12 belongs to the frequency band and amplitude range obtained by the parameter setting 14. By repeating this determination for each frame, the start and end of the tone generation period are obtained. In sound generation time accumulation 16, the time during which the peak of the power spectrum is included in the frequency bandwidth and amplitude range is accumulated. By this accumulation, the length of the tone generation period is obtained. Then, note information indicating the start time and length of the tone generation period of the musical tone is obtained, and sequence data is constructed.

  Next, the operation of this embodiment will be described. FIG. 4 is a flowchart showing the processing contents of a routine corresponding to the parameter setting 14 by rectangle designation in FIG. 2 in the sequence data generation program. FIG. 5 is a flowchart showing the processing contents of a routine corresponding to the in-rectangular peak detection 15 and the sounding time accumulation 16 in FIG. 2 in the sequence data generation program. When the user instructs activation of the sequence data generation program by operating the operation unit 4, the CPU 1 loads the program from the HDD 6 to the RAM 7 and executes it. In the execution process of the sequence data generation program, the CPU 1 first starts executing the routine shown in FIG. First, the CPU 1 determines whether or not the power spectrum display window is active (step S101). When the result of this determination is “NO”, the CPU 1 repeats the same determination. Here, when selection of desired audio stream data in the HDD 6 is instructed by the operation of the operation unit 4, the CPU 1 loads the audio stream data from the HDD 6 to the work area in the RAM 7 according to the sequence data generation program. The windowing 11, FFT 12, and power spectrum display 13 in FIG. 2 are executed for the audio stream data in this work area. As a result, the power spectrum is displayed on the display unit 3. At this time, the audio stream data loaded in the work area of the RAM 7 may be reproduced by the sound system 8 so that the user can listen to the processing target.

  Various types of display of the power spectrum are conceivable. In the first aspect, a graph of a power spectrum with the horizontal axis representing frequency and the vertical axis representing amplitude is sequentially displayed for each frame. In this aspect, the user can observe the power spectrum graph changing over time. In order to facilitate the user's operation in the parameter setting 14 by the rectangle designation, after the display of the power spectrum of the last frame of the audio stream data is completed until the parameter setting 14 by the rectangle designation is completed, Returning to this frame, the windowing 11, the FFT 12, and the power spectrum display 13 may be repeatedly executed. In the second aspect, the image of the power spectrum graph obtained for each frame is overwritten in the video memory area in the RAM 7, and the image in the video memory area is displayed on the display unit 3. In this aspect, the user can observe on the display screen of the display unit 3 a graph of the power spectrum superimposed for all frames.

  When the power spectrum is displayed on the display unit 3, the user observes the power spectrum. When there is a characteristic power spectrum whose amplitude greatly changes with time, the user designates a rectangle surrounding the peak of the characteristic power spectrum by dragging the mouse of the operation unit 4. . The following processing is processing for accepting rectangular input by this mouse operation.

  First, the power spectrum is displayed, and when the determination result in step S101 is “YES” and the process proceeds to step S102, the CPU 1 determines whether or not the mouse button on the operation unit 4 has been pressed, and makes a positive determination. The same judgment is repeated until a result is obtained. When the mouse button is pressed and the determination result in step S102 is “YES”, the CPU 1 determines whether or not a rectangle is already displayed on the display unit 3 (step S103). When the determination result is “NO”, the CPU 1 stores the position coordinate of the cursor on the display screen when the mouse button is pressed as the position coordinate of the start point P1 (step S106). Next, the CPU 1 determines whether or not the mouse button has been released (step S107), and repeats the same determination until a positive determination result is obtained.

When the mouse button is released and the determination result in step S107 is “YES”, the CPU 1 stores the position coordinate of the cursor on the display screen when the mouse button is released as the position coordinate of the end point P2 ( Step S108). Next, the CPU 1 displays a rectangle whose diagonal is a straight line connecting the start point P1 and the end point P2 on the display unit 3 so as to overlap with the power spectrum (step S109). Then, the CPU 1 obtains an amplitude region corresponding to the vertical side of the displayed rectangle and a frequency bandwidth corresponding to the horizontal side, and sets it as a parameter for specifying the region from which the note information is to be extracted (step S110). Is returned to step S102 .

  In the present embodiment, the user can change the rectangle by operating the mouse while the rectangle is displayed on the display unit 3 as described above. The operation in that case will be described below. First, when the mouse button is pressed in a state where a rectangle is displayed, when the process proceeds to step S103 via step S102, the determination result in step S103 is “YES”, and the process proceeds to step S104. In step S104, the CPU 1 determines whether or not the cursor position when the mouse is pressed is on the side of the displayed rectangle. When the determination result is “NO”, the CPU 1 deletes the rectangular display on the display unit 3 (step S105) and stores the coordinates of the cursor position when the mouse is pressed as the coordinates of the start point P1 (step S105). S106). Thereafter, when the mouse is released, as in the case described above, steps S107 to S110 are sequentially executed to fix the rectangle, and the amplitude range corresponding to the vertical side of the rectangle and the frequency band corresponding to the horizontal side of the rectangle are used as parameters. Set. As described above, when a mouse operation indicating a position that is not on the side of the displayed rectangle is performed as the start point P1, the already displayed rectangle is deleted and treated as a new rectangle input.

On the other hand, when the cursor is positioned on the side of the displayed rectangle and the mouse button is pressed, when the process proceeds to step S104 via step S102 and step S103, the determination result in step S104 is “YES”. Proceed to step S111. In step S111, the CPU 1 determines whether or not the mouse button has been released, and repeats the same determination until a positive determination result is obtained. Then, when the mouse is released and the determination result in step S111 becomes “YES”, the CPU 1 moves the side of the rectangle confirmed by the mouse in step S104 according to the drag amount of the mouse, The rectangle after the movement of this side is displayed on the display unit 3 (step S112). Then, the process proceeds to step S110, and the CPU 1 obtains an amplitude region corresponding to the vertical side of the displayed rectangle and a frequency bandwidth corresponding to the horizontal side, and sets it as a parameter for specifying the region from which the note information is extracted. (Step S110), and the process returns to Step S102 .

  When the amplitude range corresponding to the vertical side of the rectangle and the frequency band corresponding to the horizontal side of the rectangle are set as described above, the routine shown in FIG. 5 can be executed. When the user inputs an instruction to generate sequence data by operating the operation unit 4, the CPU 1 executes a routine shown in FIG. In this routine, the audio stream data is processed in units of frames to generate sequence data including note events. First, the CPU 1 executes an initialization process, and sets the note-on flag NON to “0”, the frame counter FCNT to “0”, and the note-on period counter NL to “0” (step S201). Here, the note-on flag NON is a flag indicating whether the currently processed frame is in the note-on period (musical sound generation period) or the note-off period. The period is set to “0”. The frame counter FCNT is a counter that counts the number of frames processed when processing the audio stream data in units of frames. The count value of this counter is used as time information based on the start point of the audio stream data. The note-on period counter NL is a counter that counts the number of frames from the start of the note-on period to the end thereof.

  When the initialization process of step S201 is completed, the CPU 1 reads out audio stream data for one frame from the work area of the RAM 7, and executes each process of the windowing 11, the FFT 12, and the power spectrum display 13 in FIG. (Step S202). Next, the CPU 1 determines whether there are any peaks in the power spectrum obtained by the FFT 12 that fall within the frequency band and amplitude area of the currently set rectangular area (step S203). When the determination result is “NO”, the CPU 1 determines whether or not the note-on flag NON is “0” (step S204). If the determination result in step S204 is “YES”, the CPU 1 increases the frame counter FCNT by “1” (step S210). Next, the CPU 1 determines whether or not the current frame is the last frame of the audio stream data to be processed (step S211). If the determination result is “NO”, the process returns to step S202. Thereafter, the processes of steps S202, S203, S204, S210, and S211 are repeated.

  In the meantime, when the frame to be processed in step S202 shifts from that belonging to the note-off period to that belonging to the note-on period, the amplitude of the power spectrum obtained in step S202 increases. When the peak of the power spectrum obtained in step S202 falls within the currently set rectangular area, the determination result in step S203 is “YES”, and the process of the CPU 1 proceeds to step S207. In step S207, the CPU 1 determines whether or not the note-on flag NON is “1”. When the determination result is “NO”, that is, when there is a switch from the note-off period to the note-on period, the CPU 1 sets the note-on flag NON to “1” and the frame counter FCNT at that time point. Is stored as note-on start time data FS, and a note-on period counter NL is initialized to “0” (step S208). Next, the CPU 1 increments the note-on period counter NL by “1” (step S209) and sequentially executes the above-described steps S210 and S211. If the determination result in step S211 is “NO”, the process is stepped. Return to S202.

  As a result, the process proceeds to step S207 via steps S202 and S203. At this time, since the note-on flag NON is “1”, the determination result in step S207 is “YES”. Therefore, the CPU 1 sequentially executes steps S209, S210, and S211. If the determination result in step S211 is “NO”, the process returns to step S202. Thereafter, steps S202, S203, S207, S209, S210, and S211 are repeated.

In the meantime, when the frame to be processed in step S202 shifts from that belonging to the note-on period to that belonging to the note-off period, the amplitude of the power spectrum obtained in step S202 decreases. If the peak of the power spectrum obtained in step S202 goes outside the currently set rectangular area, the determination result in step S203 is “NO”, and the process of the CPU 1 proceeds to step S204. In step S204, the CPU 1 determines whether or not the note-on flag NON is “0”. Since the note-on flag NON is “1” at this time, the determination result in step S204 is “NO”, and the process of the CPU 1 proceeds to step S205. In step S205, the CPU 1 sets the note-on flag NON to “0”. Next, proceeding to step S206, the CPU 1 stores the note-on start time data FS and the note-on period counter NL at that time in the sequence data storage area set in the RAM 7 as note information (step S206). Next, the CPU 1 sequentially executes steps S210 and S211. If the determination result in step S211 is “NO”, the process returns to step S202.
Thereafter, the same operation is repeated, and this routine ends when the determination result in step S211 is "YES".

  Through the above processing, sequence data in which note information is arranged in time series is obtained in the RAM 7. This sequence data is supplied together with the original audio stream data to a user of an electronic device having a music playback function such as a mobile phone, the audio stream data is used for playback of music, and the sequence data is used for driving control of LEDs and vibrators. Audio data and sequence data may be stored in a storage medium by an appropriate device in the I / F group 5 and supplied to the user, or may be supplied to the user via an appropriate device in the I / F group 5. May be transmitted to the server and distributed to the user from there.

  As described above, according to the present embodiment, the power spectrum of the audio stream data is obtained by frequency analysis, the period during which the peak of the power spectrum falls within the designated frequency band and amplitude range is detected, and based on this detection result Since the sequence data is generated, it is possible to generate sequence data indicating the tone generation timing of a musical tone whose pitch change is not clear, such as a percussion instrument performance sound, from the audio stream data. Further, according to the present embodiment, the power spectrum obtained by frequency analysis is displayed with the horizontal axis as frequency and the vertical axis as amplitude, and a desired frequency band and amplitude range are displayed on this display screen by a pointing device such as a mouse. Since the designation is made, the user can find a frequency band and an amplitude range in which a characteristic power spectrum peculiar to the type of desired musical sound is generated, and can designate the range by a simple operation.

Although one embodiment of the present invention has been described above, other embodiments are possible for the present invention. For example:
(1) In the above embodiment, since the rectangular area is designated by the user by operating the mouse, both the upper limit and the lower limit of the amplitude area are obtained, the peak of the power spectrum is within the specified frequency band, and the amplitude A period that falls between the upper and lower limits of the range was detected. However, the upper limit of the amplitude range may be ignored, and a period in which the peak of the power spectrum is within the specified frequency band and is equal to or greater than the lower limit of the amplitude range may be detected and treated as a tone generation period.

(2) In the above embodiment, the sequence data including the information indicating the tone generation start time of the musical tone and the information indicating the duration of the pronunciation is generated. However, the sequence data includes the information indicating the pronunciation start time of the tone and indicates the duration of the pronunciation Sequence data that does not include information may be generated. Alternatively, in an electronic device such as a mobile phone that drives an LED or a vibrator according to sequence data, the drive start timing of the LED or the like is controlled by using only the information indicating the sound generation start time in the sequence data, and the drive is continued. For example, the user may freely set the time by operating the operator.

(3) In the above embodiment, when the windowing 11, the FFT 12, and the power spectrum display 13 can be executed at high speed, the audio stream data to be processed is sent to the sound system 8 to reproduce the music and synchronize with it. Thus, the windowing 11, the FFT 12, and the power spectrum display 13 for each frame of the audio stream data may be sequentially executed. According to this aspect, the user listens to the music reproduced by the sound system 8, finds a characteristic power spectrum that moves greatly as a desired musical sound such as a drum sound is generated, and the like. You can specify.

(4) The audio stream data used for specifying the rectangular area and the audio stream data used for generating the sequence data may be different data. That is, in order to easily perform parameter setting 14 by specifying a rectangle, a single tone audio stream data of various musical sounds such as a drum sound and a cymbal sound is prepared separately from the audio stream data to be processed. Then, the windowing 11, the FFT 12, the power spectrum display 13, and the parameter setting 14 by the rectangle designation are executed for those designated by the user. When the rectangular area is determined, the audio stream data of the desired music is processed, and the windowing 11, FFT 12, power spectrum display 13, in-rectangular peak detection 15, and pronunciation time accumulation 16 are executed. To do.

(5) In the above embodiment, one rectangular area is specified. However, it is recognized that a plurality of rectangular areas are specified, and detection of a period in which the peak of the power spectrum falls within each rectangular area and based on the detection result. Sequence data may be generated. According to this aspect, when the audio stream data of a song including a plurality of types of musical sounds is a processing target and the frequency band in which a characteristic power spectrum appears varies depending on the types of musical sounds, A rectangular area can be set for each type of musical sound, and sequence data corresponding to each musical sound can be generated. In this case, in a cellular phone or the like using sequence data, for example, the blinking control of the red LED is performed by the sequence data of the first musical tone, and the blinking control of the blue LED is performed by the sequence data of the second musical tone. Good.
(6) The windowing 11 and the FFT 12 may be executed by the CPU 1 by another device such as a DSP (digital signal processor).

It is a block diagram which shows the structure of the sequence data generation apparatus which is one Embodiment of this invention. It is a figure which shows the processing content of the sequence data generation program in the embodiment. It is a figure which shows the example of a display of the power spectrum in the same embodiment. It is a flowchart which shows the processing content of the routine for the parameter setting by the rectangle designation | designated in the embodiment. It is a flowchart which shows the processing content of the routine for the detection of the peak in a rectangle and the sounding time accumulation in the same embodiment.

Explanation of symbols

1 ... CPU, 2 ... ROM, 3 ... display unit, 4 ... operation unit, 5 ... I / F group, 6 ... HDD, 7 ... RAM, 8 ... sound system, 11 ... window Multiplication, 12... FFT, 13... Power spectrum display, 14... Parameter setting by rectangle specification, 15... Peak detection within rectangle, 16.

Claims (10)

Frequency analysis means for sequentially obtaining the frequency characteristics of each part from the start point to the end point of the audio stream data indicating the waveform of the music piece or a part thereof;
A range specifying means for specifying a region consisting of the frequency band and amplitude range according to operation of the operation unit performed by the user,
A period in which the peak of the power spectrum in the frequency characteristics sequentially obtained by the frequency analysis means is included in a region composed of the frequency band and the amplitude range designated by the range designation means is detected, and the generation timing of the musical sound is determined based on the detection result. And a sequence data generating means for generating sequence data representing the sequence data. The frequency analysis means sequentially obtains the frequency characteristics of the audio stream data for each frame,
The sequence data generating means detects a frame including a peak of a power spectrum in a frequency characteristic sequentially obtained for each frame by the frequency analyzing means in a region composed of a frequency band and an amplitude range specified by the range specifying means, The sequence data generating apparatus according to claim 1, wherein sequence data indicating a musical sound generation timing is generated by setting a frame including the peak as a note-on period. The range specifying means specifies a region composed of a frequency band and an amplitude region having only a lower limit without an upper limit in accordance with an operation of the operation unit. Sequence data generator. The range designating unit designates one or a plurality of regions consisting of a frequency band and an amplitude region according to an operation of an operation unit performed by a user,
The sequence data generation means includes a peak of a power spectrum in the frequency characteristics sequentially obtained by the frequency analysis means for each area when a plurality of areas consisting of frequency bands and amplitude areas are designated by the range designation means. 4. The sequence data generation device according to claim 1, wherein a plurality of sequence data each indicating a tone generation timing is generated based on the detection result. . Comprising display means for displaying a power spectrum in a frequency characteristic obtained by the frequency analysis means,
5. The pointing device according to claim 1, wherein the range designating unit includes a pointing device that designates a region composed of the frequency band and the amplitude region on a display screen of the power spectrum in the display unit. The sequence data generation device according to claim. 6. The sequence data generation apparatus according to claim 5, wherein the display means sequentially displays power spectra sequentially obtained by the frequency analysis means. 6. The sequence data generation apparatus according to claim 5, wherein the display means displays a power spectrum sequentially obtained by the frequency analysis means. The frequency analysis means sequentially obtains the frequency characteristics of the first audio stream data,
The display means displays a power spectrum in the frequency characteristics of the first audio stream data obtained by the frequency analysis means;
In accordance with the operation of the operation unit performed by the user by the range specifying unit, the region consisting of the frequency band and the amplitude region is specified on the display screen of the power spectrum of the first audio stream data in the display unit,
The frequency analysis means sequentially obtains the frequency characteristics of each part from the start point to the end point of the second audio stream data,
The sequence data generating means includes a peak of the power spectrum in the frequency characteristic of the second audio stream data sequentially obtained by the frequency analyzing means in the region consisting of the frequency band and the amplitude range designated by the range designating means. 8. The sequence data generating apparatus according to claim 5, wherein a period is detected, and sequence data indicating a musical sound generation timing is generated based on the detection result. Comprising a reproducing means for reproducing the audio stream data as sound,
The frequency analysis means obtains a frequency characteristic of the audio stream data in synchronization with the reproduction of the audio stream data by the reproduction means, and the display means displays a power spectrum in the frequency characteristic. The sequence data generation device according to any one of claims 1 to 8. Computer
Frequency analysis means for sequentially obtaining frequency characteristics of each part from the start point to the end point of the audio stream data indicating the waveform of the music piece or a part thereof;
A range specifying means for specifying a region composed of a frequency band and an amplitude region according to an operation of the operation unit performed by the user;
A period in which the peak of the power spectrum in the frequency characteristics sequentially obtained by the frequency analysis means is included in a region composed of the frequency band and the amplitude range designated by the range designation means is detected, and the generation timing of the musical sound is determined based on the detection result. A sequence data generation program that functions as a sequence data generation unit that generates sequence data indicating

Images