JP2003255939A - Device and program for phonetic material conversion - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device and a program for phonetic material conversion which can improve conversion efficiency. <P>SOLUTION: A video editing part 21 reproduces video data in a preview mode and a phonetic processing and reproduction part 22 processes phonetic material data at need before or during the reproduction of the video data, reproduces the processed phonetic material data at need in synchronism with the reproduction of the video data, and records processing parameters used for the processing of the phonetic material data in the phonetic material data. Then the phonetic material processing and reproduction part 22 and a soft sound source part 23 convert the phonetic material data, (i.e., MIDI data) wherein the processing parameters are recorded to an audio format that the video editing part 21 can add to the video data. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sound material conversion device and a sound material conversion program for processing sound material data in a MIDI file format and converting it into data in a predetermined audio format.

[0002]

2. Description of the Related Art Conventionally, sound material data (eg MI
There is a service that provides DI (Musical Instrument Digital Interface) music data, etc., and allows a user to access the website with a personal computer or the like and download the sound material data. There is also a data conversion device that converts sound material data into data in a predetermined audio format.

Further, conventionally, there is known a video editing apparatus capable of adding audio material data in audio format as background music (hereinafter referred to as "BGM") of video data.

[0004]

However, when the user adds the sound material data in the MIDI file format as the BGM of the video data, especially when the user does not like the sound material data as it is, the sound material data is converted into the sound material data by a MIDI sequencer or the like. On the other hand, perform the desired processing (for example, changing the part composition, tone color, volume, effect, tempo, pitch, etc.), save the processed sound material data in an arbitrary file, and use the data converter. The user is required to convert the sound material data stored in the arbitrary file into data in a predetermined audio format and add the converted audio format data to the video data by the video editing apparatus. This is troublesome because the process must be executed by a number of devices. Also, MIDI sequencers are generally multifunctional and
Although various processing of the sound material data in the DI file format can be freely performed, it is difficult for beginners to use it.

The present invention has been made in view of the above points, and an object of the present invention is to provide a sound material conversion device and a sound material conversion program capable of improving work efficiency even for a beginner.

[0006]

In order to achieve the above object, a sound material conversion apparatus according to claim 1 is a sound material data processing means for simply processing sound material data in a MIDI file format, And a conversion unit for converting the sound material data processed by the sound material data processing unit into data of a predetermined audio format.

A sound material converting apparatus according to a second aspect is the sound material converting apparatus according to the first aspect, wherein the sound material data processing means includes video data and cooperates with a video data reproducing means for reproducing the video data. The sound material data is processed by the sound material data processing means in synchronization with the reproduction of the video data.

According to a third aspect of the present invention, there is provided a sound material conversion program for causing a computer to execute the same operation as that of the sound material conversion apparatus according to the first aspect.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing a schematic hardware configuration of a sound material converting apparatus according to an embodiment of the present invention.

The sound material conversion apparatus according to the embodiment of the present invention is composed of, for example, a personal computer (PC) 1.

The PC1 is a C which controls the operation of the entire PC1.
The CPU 2 includes a PU 2, and the CPU 2 has a RAM 3, a ROM 4, and a MIDI interface (I
/ F) 5, an operation circuit 6, a display circuit 7, a tone generator circuit 8, an external storage device 9, a communication interface (I / F) 10 and a timer 11 are connected to each.

The RAM 3 temporarily stores various information relating to video data or sound material data and various data generated when the CPU 2 executes various programs. ROM
Reference numeral 4 denotes various programs and various data executed or referred to by the CPU 2 (for example, video data, video time data or title data which is characteristic data of the video data, video editing program, sound material processing / playback program and data). Format conversion processing program, etc.) is stored. The MIDI interface (I / F) 5 is an interface for connecting the electronic musical instrument 12 to the communication bus 17, and is used for communicating MIDI data between the electronic musical instrument 12 and the PC 1. The operation circuit 6 connects the operator 13 to the communication bus 17, and outputs the input data from the operator 13, such as a mouse or a keyboard, to the CPU 2 via the communication bus 17. The display circuit 7 connects the display device 14 to the communication bus 17, for example, video data and MIDI.
Various data such as sound material data made of data or image data corresponding to a reproduction player for reproducing these are output to the display device 14, and the display device 14 displays the various data output from the display circuit 7. The tone generator circuit 8 inputs the sound material data via the communication bus 17, and outputs a tone signal to the sound system 15 based on the sound material data. The sound system 15 generates this inputted musical tone signal. The timer 11 is used in various processes executed by the CPU 2.

The external storage device 9 stores various data such as video data and sample sound material data and various programs executed or referred to by the CPU 2, and performs the same function as the ROM 4. The CPU 2 reads various data and various programs stored in the external storage device 9 into the RAM 3 and executes processing, thereby performing the same operation as when the ROM 4 stores various data and various programs. be able to. Therefore, it is possible to easily add various programs or upgrade versions by replacing the external storage device 9.

The communication I / F 10 is wired or wirelessly connected to a network 16 such as the Internet or a commercial network.
It is connected to the server computer 18 and another PC 19 that function as a sound material data providing site via the. As a result, it becomes possible to download the sound material data from the server computer 18 and also download various data and various programs from the other PC 19.

The MIDI I / F5 is a dedicated MIDI
Not limited to those using I / F, RS232-C, USB
Or MIDI using general-purpose I / F such as IEEE1394
-The I / F may be configured. In this case, MI
Data other than DI data may be transmitted and received at the same time.

The hardware configuration of the server computer 18 that provides the sound material data to the PC 1 is the same as the hardware configuration of the PC 1 described above. However, since the server computer 18 is mainly intended to provide the sound material data to each user terminal such as the PC 1, the MIDI / I
/ F5, the tone generator circuit 8, the electronic musical instrument 12, and the sound system 15 may not be provided.

FIG. 2 is a block diagram showing the functional arrangement of the PC 1 and the server computer 18 shown in FIG.

The PC 1 includes a video editing unit 21 for editing and reproducing video data, a sound material processing / reproducing unit 22 for processing and reproducing sound material data, and a software sound source unit 23 for converting the data format of the sound material data. The server computer 18 is provided with a sound material database 25 having a large number of sound material data, and a search engine 24 for searching and extracting user-desired sound material data from the sound material database 25 according to an instruction from the PC 1. There is.

Video editing unit 21, sound material processing / playback unit 22
The software sound source unit 23 is a function realized by executing various programs included in the PC 1 by the hardware of the PC 1, and the sound material database 25 is a set of sound material data, and these data are searched by the search engine 2
4 is systematically configured (for example, for each music category) so that a search program for sound material data included in the server computer 18 can be executed by the hardware of the server computer 18. It is a function that is executed and realized.

The video editing section 21 is, specifically, the CPU 2
Reads the video editing program stored in the ROM 4 or the external storage device 9 into the RAM 3, and executes the ROM according to the instruction of the video editing program read into the RAM 3.
4 or the video data stored in the external storage device 9 is edited, and the display device 14 displays the video data before or after editing received via the display circuit 7.

The sound material processing / playback unit 22 is specifically,
The CPU 2 reads the sound material processing / playback program stored in the ROM 4 or the external storage device 9 into the RAM 3, and receives the sound received from the sound material database 25 according to the instruction of the sound material processing / playback program read into the RAM 3. The sound system 15 processes or reproduces the material data and visually displays the sound material data before or after the processing, which is received by the display device 14 via the display circuit 7.
Is realized by producing sound material data before or after processing received via the tone generator circuit 8.

The software tone generator 23 is specifically
The CPU 2 reads the musical tone waveform generation / data format conversion processing program stored in the ROM 4 or the external storage device 9 into the RAM 3, and according to the instruction of the musical tone waveform generation / data format conversion processing program read into the RAM 3, the sound material It is realized by generating a musical tone waveform or converting the data format based on the sound material data received from the database 25.

The search engine 24 is specifically a CPU
2 receives the search condition from the PC 1 via the communication I / F 10, reads the search program stored in the ROM 4 or the external storage device 9 into the RAM 3, and incorporates the received search condition into the search program. This is realized by executing a search process, extracting sound material data corresponding to the search condition from the sound material database 25, and transmitting the extracted sound material data to the PC 1 via the communication I / F 10.

The function of the system composed of the PC 1 and the server computer 18 configured as described above will be described below.

FIG. 3 shows a video editing unit 21, a sound material processing / playback unit 22, and a server computer 18 provided in the PC 1.
That is, it is a flowchart showing the main processing executed at the sound material providing site. The processing of the sound material providing site is mainly executed by the search engine 24.

First, when the user selects the video data to which the sound material data is added via the operator 13, the video editing section 21 determines the video data to be edited (step S30).
1) The video time data and the title data, which are the characteristic data of the video data, are acquired and supplied to the sound material processing / playback unit 22 (step S302), and the trial listening process is executed (step S307).

On the other hand, the sound material processing / playback unit 22 receives the feature data from the video editing unit 21, that is, the video time data and the title data, and uses the video time data and the title data as search conditions to reproduce the sound material. Access the providing site (step S303).

The sound material providing site receives the video time data and the title data from the sound material processing / playback unit 22 as search conditions, searches the sound material database 25 based on the search conditions, and matches the search conditions. The sound material data is extracted (step S304). A known technique is used as a method for extracting the sound material data.

Steps S303 and S30 described above
As shown in FIG. 4, the sound material processing / playback unit 22 automatically acquires the video feature data including the playback time of the video data and supplies it to the sound material providing site. You don't have to know the playback time,
The sound material data to be added to the video data can be efficiently acquired from the sound material providing site, and the work efficiency of video editing can be improved. The sound material processing / reproducing unit 22 may supply one of the reproduction time of the video data and the title to the sound material providing site.

Next, at the sound material providing site, step S
A list of the sound material data extracted in 304 is created, and the created sound material data list is processed as a sound material.
It is transmitted to the reproducing unit 22 (step S305), and the trial listening process is executed (step S307).

The sound material processing / playback unit 22 displays a list of sound material data received from the sound material providing site (step S306) and executes a trial listening process (step S30).
7).

In the trial listening process of step S307, the sound material processing / playback unit 22 instructs the sound material providing site to stream the sound material data, and the sound material providing site receives the sound material data and receives the sound material data. The sound material processing / playback unit 22 executes the stream playback of the sound material data delivered from the sound material providing site,
The video editing unit 21 reproduces the video data in synchronization with the stream reproduction, and the user listens to the sound material data while confirming the video data. A detailed description of the trial listening process will be given later with reference to FIG. Here, “stream distribution” means that the sound material providing site is the sound material processing / playback unit 22.
Is a technique for distributing data so that it can be stream-reproduced without downloading the sound material data file. Stream reproduction means sound material data distributed by the sound material processing / reproducing unit 22 from the sound material providing site. It is a technique of playing in real time without downloading.

In the trial listening process of step S307, when the user confirms the desired sound material data, the user designates the sound material data via the operator 13, and the sound material processing / playback unit 22 receives this designation and sounds. Instruct the material providing site to download the sound material data (step S30)
8).

The sound material providing site receives the download instruction of the sound material data from the sound material processing / playback unit 22,
The sound material data is distributed to the sound material processing / playback unit 22 (step S309), and a series of processing at the sound material providing site is ended.

The sound material processing / playback unit 22 receives the sound material data distributed from the sound material providing site, gives the received sound material data with an arbitrary file name, and saves it by designating an arbitrary storage location. Then, the processing / preview processing is executed (step S310) (step S311).

After executing the trial listening process in step S307, the video editing section 21 executes the processing / preview process (step S311).

In the processing / preview processing in step S311, the video editing unit 21 reproduces the video data in the preview mode, and the sound material processing / reproducing unit 22 reproduces the video data before or during the reproduction, if necessary. Step S31
The sound material data saved as 0 is processed, the sound material data processed as necessary is reproduced in synchronization with the reproduction of the video data, and the processing parameters used for processing the sound material data are set in the sound material data. To record. A detailed description of the processing / preview processing will be described later with reference to FIG.

After the processing / preview processing in step S311, the sound material processing / playback unit 22 executes MIDI to audio conversion processing (step S312).

In the MIDI-to-audio conversion process, the sound material data (ie, MI) in which the processing parameters are recorded by the sound material processing / playback unit 22 and the software sound source unit 23.
The DI data) is converted into an audio format that can be added to the video data by the video editing unit 21. A detailed description of the MIDI to audio conversion process will be given later with reference to FIG.

The sound material processing / playback unit 22 saves the sound material data converted into the audio format in an arbitrary file and notifies the video editing unit 21 of the fact (step S313), and the sound material processing / playback is performed. A series of processing in the unit 22 is completed.

The video editing unit 21 reads the file saved in step S313, adds the read file, that is, the sound material data converted into the audio format to the video data (step S314), and the video editing unit A series of processing in 21 is ended.

In the above-mentioned main processing, the sound material processing / playback unit 22 directly executes the display of the list of sound material data and the instruction of downloading, but the processing of separately executing the display function and the instruction output function like a web browser. A section,
You may make it perform the display of the list of sound material data, and the instruction | indication of download to this.

Further, the sound material processing / playback unit 22 saves the sound material data converted into the audio format in an arbitrary file (step S313), and the video editing unit 2
Although 1 has read the saved file, the sound material processing / playback unit 22 converts the sound material data into the audio format of the MIDI material by MIDI to audio conversion processing (step S312), and then converts the sound material data into the audio format. May be directly transmitted to the video editing unit 21 without being saved in a file.

FIG. 4 is a flowchart showing the trial listening process of step S307 in FIG.

First, the user specifies the position to which the sound material data is added in the video data via the operator 13, so that the video editing section 21 sets the position to which the sound material data is added (step S401). , The listening mode is set (step S402).

Next, the video editing section 21 accepts a reproduction instruction of the video data input via the operator 13 and notifies the sound material processing / reproducing section 22 of the instruction (step S403). The processing / reproduction unit 22 is
In response to the instruction from the video editing unit 21 in step S403, the sound material data specified in advance from the sound material data list displayed in step S306 in FIG. A stream distribution is instructed to the material providing site (step S408).

The sound material providing site receives the stream distribution instruction relating to the sound material data from the sound material processing / playback unit 22 in step S408, and executes the stream distribution of the sound material data corresponding to the instruction (step S41).
5).

When the stream distribution is executed by the sound material providing site, the sound material processing / playback unit 22 receives the sound material data from the sound material providing site and determines whether or not the stream can be played, that is, for a predetermined time. It is determined whether or not the sound material data has been accumulated (step S409). This determination is made in consideration of stream reproduction, that is, for the purpose of the sound material processing / reproducing unit 22 accumulating sound material data that does not interrupt the reproduced sound. The predetermined time is, for example, 5 seconds, but since the stream reproduction is influenced by the reproduction processing speed of the sound material data in the sound material processing / reproducing unit 22 and the communication speed of the network such as the Internet, the predetermined time is It is set by the sound material processing / playback unit 22. Further, since the stream reproduction is performed while receiving the subsequent data, the accumulation of the sound material data for the predetermined time does not mean that all the sound material data is accumulated.

As a result of the determination in step S409, when the sound material data for a predetermined time has been accumulated, the sound material processing / playback unit 22 instructs the video editing unit 21 to start playing the video data (step S410). ), The accumulated sound material data for a predetermined time and the sound material data continuously distributed from the sound material providing site are stream-reproduced so that the sound is not interrupted (step S411).

On the other hand, the video editing section 21 proceeds to step S41.
Receiving a reproduction start instruction from the sound material processing / reproducing unit 22 of 0, the reproduction of the video data is executed (step S404),
Whether or not to continue the reproduction of the video data is determined based on the reproduction stop instruction of the video data input via the operator 13 or the finite time length of the video data (step S4).
05).

As a result of the determination in step S409, if the video editing unit 21 continues to reproduce the video data, the process returns to step S404 to continue the reproduction of the video data, while the video editing unit 21 continues to reproduce the video data. If not, the reproduction of the video data is stopped (step S40).
6).

Next, the video editing section 21 processes the sound material
The reproduction unit 22 is instructed to stop the reproduction of the sound material data (step S407), the series of processes in the video editing unit 21 is ended, and the process returns to the main process of FIG.

After starting the stream reproduction of the sound material data, the sound material processing / reproducing unit 22 determines whether or not the reproduction stop instruction of the sound material data transmitted from the video editing unit 21 is received in step S407 (step S407). S412).

As a result of the determination in step S412, if the instruction to stop the reproduction of the sound material data is not received, the process returns to step S411, the stream reproduction of the sound material data is executed, and the reproduction of the sound material data is stopped. When the instruction is received, the stream reproduction of the sound material data is stopped (step S413).

Next, the sound material processing / playback unit 22 instructs the sound material providing site to stop the stream distribution of the sound material data (step S414), and ends the series of processing in the sound material processing / playback unit 22. Then, the process returns to the main process of FIG.

After starting the stream distribution of the sound material data, the sound material providing site receives the stream distribution stop instruction transmitted from the sound material processing / playback unit 22, and stops the stream distribution of the sound material data (step (S416), the series of processes in the sound material providing site is ended, and the process returns to the main process of FIG. In step S412, it is determined whether or not the sound material processing / playback unit 22 has received a playback stop instruction of the sound material data from the video editing unit 21. To determine whether the stop of the video data reproduction is detected. As a result, if the stop of the video data reproduction is not detected, the process returns to step S411 to detect the stop of the video data reproduction. If so, the process may proceed to step S413.

In the trial listening process described above, the sound material processing / playback unit 22 instructs the sound material providing site to stream the sound material data, and the sound material providing site receives the instruction to stream the sound material data. Stream distribution is performed, the sound material processing / playback unit 22 performs stream playback of the sound material data delivered from the sound material providing site, and the video editing unit 21 plays back the video data in synchronization with this stream playback. Run. Therefore, the user should confirm how the sound material data (for example, BGM) is added to the video data by stream reproduction before downloading the sound material data to add the video data. As a result, it is possible to improve the work efficiency of video editing (the file name specified when downloading and the destination to save are not necessary for stream playback, and the file when you do not like the result of the audition) (Erase work is not required.) Especially, since it is not the simple sound material data stream reproduction but the sound material data stream reproduction synchronized with the reproduction of the video data, the sound data The effect is that the relationship is very easy to understand.

Further, the sound material processing / reproducing unit 22 receives the reproduction instruction of the video data from the video editing unit 21, and instructs the sound material providing site to stream a predetermined sound material data to provide the sound material. When the sound material data stream-distributed from the site becomes stream-reproducible, the reproduction start permission of the video data is transmitted to the video editing unit 21 and the sound material data is stream-reproduced.
It is possible to surely reproduce the sound material data and the video data in synchronization with each other without starting the reproduction of the video data first.

Further, the sound material processing / reproducing unit 22 receives the instruction to stop the reproduction of the sound material data, stops the stream reproduction of the sound material data, and further performs the stream distribution of the sound material data to the sound material providing site. A stop is instructed, or the sound material processing / playback unit 22 accesses the video editing unit 21 to detect the stop of the playback of the video data, and the sound material data stream to the sound material providing site according to the detection result. Since the instruction to stop the distribution is given, the user does not need to issue each stop instruction to the video editing unit 21, the sound material processing / playback unit 22, and the sound material providing site.

In the trial listening process described above, when the sound material processing / playback unit 22 receives the playback stop instruction of the sound material data transmitted from the video editing unit 21, the stream playback of the sound material data is stopped, If the time length of the material data is shorter than the playback time of the video data in the video editing unit 21, the sound material providing site will output from the sound material processing / playback unit 22 when the stream distribution of the sound material data is completed. The stream distribution of the sound material data may be automatically stopped without receiving the stream distribution stop instruction. In the case of data with a small file size such as MIDI data, all the data is received and accumulated in the cache memory, then reproduction is started, and when the reproduction is finished, pseudo stream reproduction is performed which is erased from the cache memory. However, even in this case, since the file download is not necessary, the same effect as described above can be obtained.

FIG. 5 is a flowchart showing the processing / preview processing of step S311 in FIG.

First, the video editing section 21 sets the preview mode in the video editing program in accordance with the user's instruction input via the operator 13 (step S5).
01).

Next, the video editing unit 21 accepts a reproduction instruction of the video data inputted via the operator 13 and also indicates that the reproduction instruction of the video data is accepted.
The data is transmitted to the reproduction unit 22 (step S502).

The video editing unit 21 reproduces the video data (step S503), and reproduces the video data based on the reproduction stop instruction of the video data input through the operator 13 or the finite time length of the video data. It is determined whether or not to continue (step S504).

As a result of the determination in step S504, if the video editing unit 21 continues to reproduce the video data, the process returns to step S503 to continue the reproduction of the video data, while the video editing unit 21 continues to reproduce the video data. If not, the reproduction of the video data is stopped (step S50).
5).

Next, the video editing section 21 processes the sound material
The reproduction unit 22 is instructed to stop the reproduction of the sound material data (step S506), the series of processes in the video editing unit 21 is ended, and the process returns to the main process of FIG.

On the other hand, the sound material processing / playback unit 22 first
According to the processing instruction of the sound material data input via the operator 13, the processing of the sound material data saved in the file in step S310 of FIG. 3 is performed (step S50).
7). Specifically, this processing is for adjusting the parameters of the sound material data, and these parameters (hereinafter referred to as “processing parameters”) include, for example, part on / off, tone change, mixer, effect addition, tempo. It is composed of parameters that can easily modify the musical content of the sound material data such as change or pitch change. In this processing, M like a MIDI sequencer
Unlike advanced corrections such as correcting IDI events one by one, even beginners can easily process sound material data. If no processing instruction is input via the operator 13, the process of step S507 is canceled.

Next, the sound material processing / playback unit 22 receives the fact that the playback instruction of the video data transmitted from the video editing unit 21 is accepted, and the sound material data processed as necessary is processed. Play back (step S508). After that, during the reproduction of the sound material data, the processing of the sound material data being reproduced is performed, if necessary, as in step S507 (step S509).

Next, the sound material processing / playback unit 22 determines whether or not a sound material data playback stop instruction is received from the video editing unit 21 (step S510), and the sound material data playback stop instruction is received. If not, step S50
Returning to step 8, while continuing to reproduce the sound material data, when the reproduction stop instruction of the sound material data is received, the reproduction of the sound material data is stopped (step S511). In step S510, the sound material processing / playback unit 22 determines whether or not the playback stop instruction of the sound material data is received from the video editing unit 21. Access is made to determine whether or not the reproduction stop of the video data is detected. As a result, if the reproduction stop of the video data is not detected, the process returns to step S508 while the reproduction stop of the video data is detected. In this case, the process may proceed to step S511.

Finally, in step S507 or step S509, the sound material processing / playback unit 22 records the processing parameter adjusted as necessary in the sound material data (step S512), and the series of processing ends. Then, the process returns to the main process of FIG.

In the above-mentioned processing / preview processing, the video editing section 21 reproduces the video data in the preview mode, and the sound material processing / reproducing section 22 reproduces the audio data before or during the reproduction of the video data, if necessary. The material data is processed, the sound material data processed as necessary is reproduced in synchronization with the reproduction of the video data, and the processing parameters used for processing the sound material data are recorded in the sound material data. Therefore, the user can process the sound material data in real time while reproducing the video data, and can process the processed sound material data without waiting for the completion of the creation of the video data to which the sound material data is added. You can check the synchronized playback with the video data. Therefore, the user can confirm how the sound material data (for example, BGM) is added to the video data, so that the work efficiency of video editing can be improved. Also, the sound material processing / playback unit 2
In No. 2, since the processing can be performed during the reproduction of the sound material data, the work efficiency of video editing can be improved. Further, the sound material data before and after the processing may be compared and auditioned.

In the above-described processing / preview processing, when the sound material processing / reproducing unit 22 receives the reproduction stop instruction of the sound material data transmitted from the video editing unit 21, the reproduction of the sound material data is stopped. When the time length of the sound material data is shorter than the reproduction time of the video data in the video editing section 21, the sound material processing / reproducing section 22 receives the reproduction stop instruction of the sound material data transmitted from the video editing section 21. Before playing, the reproduction of the sound material data may be automatically stopped.

FIG. 6 is a flow chart showing the MIDI to audio conversion process of step S312 in FIG.

First, the sound material processing / playback unit 22 reads out the sound material data in which the processing parameters are recorded, that is, this MIDI data at a high speed while maintaining the relationship of the relative time of each event, and the MIDI data is read for each event by software. It is transmitted to the sound source unit 23 (step S601).

The software tone generator 23 generates audio waveform data based on the received MIDI data for each event, temporarily stores the generated audio waveform data in the buffer (RAM3), and stores it for a predetermined time (for example, 0 Each time the audio waveform data of 0.5 seconds) is stored, it is transmitted to the sound material processing / playback unit 22 (step S602). The buffer for temporarily storing the audio waveform data stores the audio waveform data sequentially generated in the vacant area by transmitting the audio waveform data to the sound material processing / playback unit 22.

The sound material processing / playback unit 22 sequentially internally records the audio waveform data for a predetermined time received from the software sound source unit 23 (step S603). Here, recording internally means that the software tone generator 23
It means that the audio waveform data received from the device is sounded, and that the sound that is emitted is not recorded but is recorded without sound.

Next, the sound material processing / playback unit 22 determines whether or not all the MIDI data to be converted have been read (step S604). If all the MIDI data have not been read, Is step S6
Returning to 01, while reading the MIDI data is continued, if the reading of all the MIDI data is completed, the audio waveform data internally recorded in step S603 can be handled by the video editing unit 21. It is possible to convert to a preset audio format (step S605), terminate the series of processes, and return to the main process of FIG.

In the MIDI-to-audio conversion processing described above, audio material data (ie MIDI data) in which processing parameters are recorded by the sound material processing / playback unit 22 and the software sound source unit 23 can be added to the video data by the video editing unit 21. As it is converted to a format, the sound material processing / playback unit 22 and software sound source unit 2
In 3, the processing of the sound material data to the conversion of the sound material data into the audio format can be executed all at once, and the work efficiency can be improved. Also, P
In addition to C1, it is not necessary to separately provide a conversion device for converting the audio format of the sound material data.

The sound material data provided by the sound material providing site described above is not limited to MIDI data, but may be audio format data. In that case, the MIDI to audio conversion process is unnecessary. Further, regarding the processing of the audio format data, it is possible to perform the effect addition, the tempo change or the pitch change processing, although the processing of the part on / off and the tone color change or the processing of the mixer cannot be performed.

When the sound material data is auditioned (when the sound material data is stream-played or when the sound material data is processed and then the video data is previewed), the video editing unit 21 starts the video reproduction. Alternatively, it may be performed in response to an instruction from the sound material processing / playback unit 22, although it is performed in response to an instruction to stop. That is, when the sound material data is stream-reproduced, when the sound material processing / reproducing unit 22 instructs the stream reproduction, the sound material providing site is instructed to stream the sound material, and the streamed sound material data is transmitted. When it becomes possible to reproduce, the video editing unit 21 is instructed to reproduce the video data. Further, when the sound material processing / playback unit 22 is instructed to stop the stream reproduction, the sound material providing site is instructed to stop the stream distribution and the video editing unit 21 is instructed to stop the reproduction of the video data. Further, when the sound material data is processed and then the video data is previewed, when the preview processing is instructed by the sound material processing / reproducing unit 22, the reproduction of the sound material data is started and the video editing unit 21 is started. Is instructed to reproduce the video data, and the sound material processing / reproducing unit 22 is instructed to stop the preview processing, the reproduction of the sound material data is stopped and the video editing unit 21 is instructed to stop the reproduction of the video data. It

In the above-mentioned processing of the sound material data, the parameters of the sound material data part on / off, tone color change, mixer, effect addition, tempo change and pitch change are adjusted. Not all of them may be provided, and at least one may be provided. Further, there may be processing types other than these. Regarding “tempo change”, which is one of the parameters, the tempo may be automatically changed so that the video reproduction time and the time length of the sound material data match. MI above
The DIto audio conversion process is performed by the sound material processing / playback unit 2
2 and the software sound source unit 23 cooperate with each other, but this function may be realized by the software sound source unit 23 alone.

The video editing unit 21 and the sound material processing / playback unit 22 are realized by executing separate programs on the CPU 2, but they are realized by executing one program on the CPU 2. Good.

In the sound material site, the charging processing may be executed when the sound material data is downloaded, and the charging processing may not be executed when the sound material data is streamed.

It is needless to say that the functions of the above-described embodiments can be realized by the form of a program which is software, and thereby the object of the present invention can be achieved.

Furthermore, a storage medium recording a program code of software for implementing the functions of the above-described embodiments is supplied to a system or apparatus, and the computer (or CPU2) of the system or apparatus is stored in the storage medium. Needless to say, the object of the present invention can be achieved by reading and executing the program code.

In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, C
D-ROM, CD-R, DVD-ROM, semiconductor memory, magnetic tape, non-volatile memory card, ROM, etc. can be used. Further, the program code may be supplied from another PC 19 via another electronic musical instrument 12 or the network 16.

[0089]

As described in detail above, according to the sound material conversion device of the first aspect and the sound material conversion program of the third aspect, the sound material data in the MIDI file format is easily processed. Since the processed sound material data is converted into the data of the predetermined audio format, the processing from the sound material data to the conversion of the audio material data into the audio format can be executed at once, and the working efficiency is improved. be able to.

According to the sound material conversion device of the second aspect,
Since the sound material data processed by the sound material data processing means is converted into the audio format in synchronization with the reproduction of the video data, the sound material data added to the video data can be efficiently processed.

[Brief description of drawings]

FIG. 1 is a block diagram showing a schematic hardware configuration of a sound material conversion device according to an embodiment of the present invention.

2 is a block diagram showing a functional configuration of a PC 1 and a server computer 18 in FIG.

FIG. 3 is a video editing unit 21 included in the PC 1 in FIG.
And sound material processing / playback unit 22 and server computer 1
8 is a flowchart showing the main processing executed at the sound material providing site.

FIG. 4 is a flowchart showing a trial listening process of step S307 in FIG.

FIG. 5 is a flowchart showing the processing / preview processing of step S311 in FIG.

FIG. 6 shows the MIDIt of step S312 in FIG.
It is a flow chart which shows o audio conversion processing.

[Explanation of symbols]

1 PC 2 CPU (video editing means, sound material data processing means, converting means, sound material data reproducing means) 3 RA
M 4 ROM 5 MIDI / I / F 6 Operation circuit 7 Display circuit 8 Sound source circuit 9 External storage device 1
0 Communication I / F

─────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] February 20, 2003 (2003.2.2)
0)

[Procedure Amendment 1]

[Document name to be amended] Statement

[Name of item to be amended] Claims

[Correction method] Change

[Correction content]

[Claims]

[Procedure Amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0006

[Correction method] Change

[Correction content]

[0006]

In order to achieve the above object, a sound material conversion apparatus according to claim 1 is a sound material data processing means for processing sound material data in a MIDI file format, and the sound material data processing. And a conversion means for converting the sound material data processed by the means into data of a predetermined audio format.

[Procedure 3]

[Document name to be amended] Statement

[Correction target item name] 0089

[Correction method] Change

[Correction content]

[0089]

As described in more detail, according to the present invention, according to claim 1, wherein the sound material conversion device and claim 3, wherein the sound material conversion program, the sound material data MIDI file format is pressurized Engineering, the Since the processed sound material data is converted into the data of a predetermined audio format, the processing from sound material data to the conversion of the audio material data into the audio format can be executed at once, thus improving the work efficiency. it can.

[Procedure amendment 4]

[Document name to be corrected] Drawing

[Name of item to be corrected] Fig. 4

[Correction method] Change

[Correction content]

[Figure 4]

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Toru Itayama             Yamaha stock, 10-1 Nakazawa-machi, Hamamatsu-shi, Shizuoka             In the company F term (reference) 5D378 GG11 MM41 QQ03 QQ38

Claims (3)

[Claims] 1. A sound material data processing unit for easily processing MIDI file format sound material data, and a conversion for converting the sound material data processed by the sound material data processing unit into predetermined audio format data. And a sound material conversion device. 2. The sound material data processing means is provided with video data and operates in cooperation with video data reproduction means for reproducing the video data, and the sound material data is reproduction of the video data. 2. The sound material conversion device according to claim 1, wherein the sound material data processing device is processed in synchronization with the sound material data processing device. 3. A sound material data processing procedure for simply processing the sound material data in the MIDI file format, and a sound processed by the sound material data processing procedure in a computer having the sound material data in the MIDI file format. A sound material conversion program, which executes a conversion procedure for converting material data into data of a predetermined audio format.