JP2006284796A - Musical sound signal transmitting terminal and musical sound signal receiving terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To transmit the performance sound of a non-MIDI musical instrument, by reducing the amount of information to be transferred so that the features of the performance sound will not be lost, and moreover, the delays in the performance sound will be small. <P>SOLUTION: In a musical sound signal transmitting terminal 1, sound production of a musical instrument is collected by a microphone 12 to be outputted as a musical sound signal, and rising of the musical sound signal outputted from the microphone 12 is detected. When the rising is detected, a control part 10 reads an attack time W from a non-volatile storage part 11b and starts a time counting and converts the musical sound signal into audio data. Next, the part 10 transmits sampled audio data to a terminal 2. When the attack time W is finished, the part 10 generates a MIDI signal including a parameter instructing the same pitch as in the audio data to transmit the MIDI signal to the terminal 2 instead of the audio data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technique for collecting performance sounds of musical instruments and transmitting / receiving them via a network.

A performance form called a net session in which an ensemble is performed via a network is becoming widespread. In this case, the sound of a natural musical instrument is generally converted into a digital signal and transmitted as audio data, or a MIDI (Musical Instrument Digital Interface) signal output from an electronic musical instrument is generally transmitted.
In Patent Document 1, in a system for performing music instruction, when communication between a teacher and students is performed, voice data collected by a microphone and musical instrument sound are communicated by audio data, and an electronic musical instrument performance is transmitted by a MIDI signal. We are communicating with.
JP 2003-255935 A

By the way, in the data transmission in the network, it is important to reduce the data amount in consideration of the problem of the processing speed of the terminal, the problem of the traffic increase or the network delay. In this case, the amount of data is overwhelmingly smaller when performing communication using MIDI signals than when performing communication using audio data.
However, since only an electronic musical instrument or a MIDI device can output a MIDI signal, it is only possible to communicate using audio data as disclosed in Patent Document 1 when attempting to transmit musical sounds of a natural musical instrument. It was. In addition, the sampling frequency of audio data can be lowered or the amount of data can be reduced by compression technology. In this case, however, the tone quality peculiar to natural instruments cannot be faithfully transmitted, and the tone quality is remarkably high. There was a problem of being lowered.

  The present invention has been made in view of the above-described circumstances. When transmitting a musical tone such as a natural musical instrument that cannot output a MIDI signal, a musical tone signal transmitting terminal capable of reducing the data amount while maintaining the quality of the musical tone is provided. The purpose is to provide.

  In order to solve the above-mentioned problems, the present invention provides an input means for outputting a musical sound emitted from a musical instrument as a musical sound signal when the musical sound is input, and a predetermined tone from the rising edge of the waveform for the musical sound signal output by the input means. An attack part extracting means for extracting the range of the musical sound signal output from the input means, a pitch detecting means for detecting the pitch of the musical sound signal output from the input means, A communication means for exchanging signals via a network, a pitch parameter for instructing the same pitch as the pitch detected by the pitch detection means, a sounding timing parameter for instructing an end point of the attack unit as a sounding sounding timing, and the above A mute timing parameter is generated that indicates the mute timing detected by the mute detection means as the mute timing. For the one tone input to the parameter generation means and the input means, the waveform signal extracted by the attack section extraction means is converted into waveform data and transmitted using the communication means, and the waveform data is transmitted. Subsequently, there is provided a musical sound signal transmitting terminal comprising transmission control means for transmitting the pitch parameter, sound generation timing parameter and mute timing parameter generated by the parameter generating means.

In a preferred aspect of the present invention, the predetermined portion in the attack extraction unit may be a predetermined section determined in advance from the rising edge of the waveform.
In another preferred aspect of the present invention, the attack extraction unit detects a time point when the waveform level falls below a predetermined amount from a peak at the time of rising as an attack end point, and attacks from the waveform rising to the attack end point. You may make it extract as a part.
In another preferable aspect of the present invention, the attack extraction unit may extract an interval from the rising of the waveform until the pitch detection unit detects the pitch as an attack unit.

In another preferred aspect of the present invention, the parameter generation means includes timbre parameter generation means for generating a timbre parameter for designating a timbre, and the transmission control means includes a pitch parameter, a sound generation timing parameter, and a mute timing parameter. In addition, the communication unit may transmit the timbre parameter instructed by the timbre parameter generation unit.
In a further preferred aspect of the present invention, the timbre parameter generating means may specify a timbre by analyzing a musical tone signal output from the input means and generate a timbre parameter indicating the timbre. .

In addition, the present invention provides a communication unit that transmits and receives signals via a network, a waveform reproduction unit that generates a musical sound signal based on waveform data received by the communication unit, and a pitch at which the communication unit indicates a pitch. When receiving the parameters, the sound generation timing parameter for instructing the sound generation timing, and the mute timing parameter for instructing the sound mute timing, sound source means for generating a music signal based on these parameters, and the waveform reproduction means And a reproduction control means for reproducing the musical sound signal generated by the sound source means following the reproduction of the musical sound signal generated by the sound source means.
In a preferred aspect of the present invention, when the communication means receives a timbre parameter indicating a timbre, the tone generator means may generate the musical tone signal based on a timbre based on the timbre parameter.
Further, in a further preferred aspect of the present invention, the reproduction control means starts reproduction of the musical tone signal generated by the sound source means before the reproduction of the waveform signal by the waveform reproduction means ends, and the reproduction of both overlaps. Cross fade processing may be performed during the period.

  A characteristic attack part sounds a musical tone based on actual waveform data (eg, audio data), and a sound other than the attack part is actually pronounced by a natural instrument by sounding based on a parameter (eg, MIDI data). It is possible to produce a musical tone that is close to the actual musical tone without detracting from the characteristics of the musical tone. In addition, the data transfer amount is significantly reduced.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(1) Configuration First, the overall configuration of the system according to the present embodiment will be described. FIG. 1 is a block diagram showing the overall configuration of the session system according to the present embodiment. As shown in the figure, this system is configured by connecting a terminal 1 and a terminal 2 via a communication network. Although more terminals are actually connected, only two terminals 1 and 2 are shown for simplicity of explanation.

  FIG. 2 is a diagram illustrating a configuration of the terminal 1. The terminal 1 collects the sound of a natural instrument such as an acoustic guitar AG and communicates it with other terminals via a network. In the figure, reference numeral 10 denotes a control unit such as a CPU (Central Processing Unit) which controls each part of the circuit via a BUS in accordance with a software program stored in the storage unit 11.

  Reference numeral 12 denotes a microphone for collecting musical sounds emitted by an instrument such as an acoustic guitar AG. The control unit 10 performs predetermined processing on the musical sound collected by the microphone 12 to generate digital audio data and MIDI format digital data. In the following description, for convenience of explanation, digital audio data is referred to as “audio data”, and MIDI format digital data is referred to as “MIDI data”.

  Reference numeral 13 denotes a communication unit having a communication interface and the like, which transmits audio data or MIDI data generated by the control unit 10 to the terminal 2 via the communication network in units of blocks under the control of the control unit 10. Reference numeral 14 denotes a time measuring unit, which measures time and outputs time information TI.

  Here, the configuration of the data block generated by the control unit 10 will be described with reference to FIG. As shown in the figure, the data block includes three pieces of information including a block identifier BI, time information TI, and data DA. The block identifier BI is an identifier indicating whether the data block is audio data or MIDI data. When the block identifier BI indicates audio data, the data DA indicates audio data. When the block identifier BI indicates MIDI data, the data DA indicates MIDI data. The time information TI is information generated by the time measuring unit 14 described above.

  As shown in FIG. 2, the storage unit 11 includes a volatile storage unit 11a and a nonvolatile storage unit 11b. The volatile storage unit 11a is, for example, a RAM (Random Access Memory), and is used as a work area by the control unit 10 operating according to various software programs. On the other hand, the non-volatile storage unit 11b is, for example, a ROM (Read Only Memory) or a hard disk, and stores software for causing the control unit 10 to realize functions specific to the terminal 1 according to the present invention. is there. As an example of software stored in the nonvolatile storage unit 11b, an OS software program for causing the control unit 10 to implement an OS (Operating System), and the generation processing and transmission processing of the audio data and MIDI data are controlled. There is software for causing the unit 10 to execute.

The nonvolatile storage unit 11b of the storage unit 11 stores an attack time W indicating the time width of the attack unit of the input instrument sound. Here, the attack time W will be described below with reference to FIG.
FIG. 4 is a graph showing an example of the waveform of the instrument sound collected by the microphone 12. In the figure, the horizontal axis represents time, and the vertical axis represents waveform amplitude. This figure shows a case where a musical sound is generated at time t ₁ and muted at time t ₃ . A certain interval (musical sound generated between time t ₁ and time t ₂ ) from the rising edge of the waveform is generally called an attack portion, and the waveform of this portion shows a characteristic of the tone color and how to play it. On the other hand, after that (musical sound generated between time t ₂ and time t ₃ ), the waveform of the sound becomes almost constant and gradually attenuates. It is known that the quality of such a waveform does not deteriorate much even if it is constructed electronically. In the present embodiment, a fixed attack time W is set as a period for extracting the attack part. In this case, the attack time varies slightly depending on the characteristics of the musical instrument and how it is played, but since it is a short time at the start of sound generation, there is no practical problem even if a fixed value is set.

  Next, the configuration of the terminal 2 will be described with reference to FIG. In the figure, reference numeral 20 denotes a control unit such as a CPU, which controls each part of the circuit via the BUS in accordance with a software program stored in the storage unit 21. Reference numeral 22 denotes a sound generation unit having an audio signal processing circuit such as a DSP (Digital signal processor) and a speaker, and causes a musical sound to be generated under the control of the control unit 20. A communication unit 23 having a communication interface receives a data block transmitted from the terminal 1 under the control of the control unit 20. Reference numeral 24 denotes a time measuring unit that generates a reference time for determining sound generation timing and the like.

  As shown in FIG. 5, the storage unit 21 includes a volatile storage unit 21a and a nonvolatile storage unit 21b. A timbre parameter TP is stored in the nonvolatile storage unit 21b. In the case of this embodiment, a parameter indicating the tone color of the acoustic guitar is stored. A sound source 25 generates a musical tone signal corresponding to the timbre indicated by the timbre parameter TP. This musical sound signal is supplied to the sound generator 22 where it is emitted as a musical sound.

(2) Operation Next, the operation of the session system according to the present embodiment will be described.
In the following, a case where the user of the terminal 1 plays the acoustic guitar AG (see FIG. 2) and this musical sound is transmitted to the terminal 2 is taken as an example. In the following description, it is assumed that the acoustic guitar AG is played with a single note.

(2-1) Operation of Terminal 1 FIG. 6 is a flowchart showing processing performed by the control unit 10 of the terminal 1. The microphone 12 collects the sound emitted from the acoustic guitar AG and outputs it as a musical sound signal. The control unit 10 analyzes the musical sound signal output from the microphone 12.
For this analysis, a general method called beat tracking is used, and a tone signal output from the microphone 12 is compared with a predetermined threshold value to detect the rising of the signal. Specifically, a high-pass filter is applied to the musical sound signal, and if the fluctuation width is larger than a predetermined threshold, it is recognized that the signal has risen and the attack part has started.
When the rising edge of the signal is detected, the determination in step SP1 is YES, and the control unit 10 reads the attack time W from the nonvolatile storage unit 11b and starts measuring time (step SP2), and the musical sound output from the microphone 12 A signal (analog signal) is converted into audio data at a predetermined sampling rate. Then, the sampled audio data is used as data DA, and data blocks are sequentially generated with the time information TI of the time measuring unit 14 at each sampling time. Then, the identification information BI of each data block generated in this way is transmitted as audio data from the communication unit 13 to the terminal 2 (step SP3). At the same time, the control unit 10 analyzes the audio data and starts pitch detection (step SP4).

When the measurement of the attack time W is completed and the determination in step SP5 is “YES”, the control unit 10 stops transmitting the data block of the audio data (step SP6), and designates the detected pitch as a note. Note-on MIDI data to be generated is generated, and a data block having the data DA as data DA is generated and transmitted from the communication unit 13 to the terminal 2 (step SP7). The time information TI output from the timer unit 14 is added to this data block, and the identification information BI indicating that it is MIDI is added. At this time, the time information TI to be added is a time attack the sounding start time period W is plus the time to end (see time t ₂ in FIG. 4).

Subsequently, the control unit 10 determines whether or not the musical sound waveform output from the microphone 12 has been muted (step SP8). If it is determined that the sound has been silenced (step SP8; YES), MIDI note-off data is generated, arranged in the data DA of the data block, and transmitted (step SP9). At this time, the generated note-off data indicates the same note as the note-on transmitted at time t ₂ , and the time information TI added to the note-off data is the time counting unit 14 at the time of silence detection. Is the time information TI output (see time t _{3 in} FIG. 4). On the other hand, if it is determined in step SP8 that the sound is not muted (step SP8; NO), the process waits until muting is detected.

In the series of processes described above, how one musical tone (single tone) is transmitted will be schematically described below. FIG. 7A is a graph showing an example of a waveform of audio data, which is the same as FIG. FIG. 7B illustrates audio data or MIDI data included in a data block transmitted at a time corresponding to FIG. 7A. In the drawing, D1 indicates audio data, and D2 Indicates MIDI data (note-on), and D3 indicates MIDI data (note-off). At time t ₁ in FIG. 7, when the performer of the terminal 1 starts sound generation using the acoustic guitar AG, the control unit 10 of the terminal 1 performs steps SP1 → SP2 → SP3 → SP4 → SP5 in FIG. Until the attack time W elapses, the audio data D1 is continuously transmitted and the pitch detection process is performed in parallel.
When the attack time W elapses (time t ₂ ), the processing of step SP6 and step SP7 in FIG. 6 is performed, and the MIDI data D2 including the note-on parameter is transmitted to the terminal 2. When the musical sound is muted at time t ₃ , MIDI data D 3 including a note-off parameter is transmitted to the terminal 2.

  As described above, since the highly reproducible audio data is transmitted for the attack part including many features of the musical sound and the MIDI data is transmitted for other parts than the attack part, the amount of data to be transmitted is significantly reduced.

(2-2) Operation of Terminal 2 Next, the operation of the terminal 2 will be described with reference to the drawings.
FIG. 8 is a flowchart showing processing performed by the terminal 2. When receiving a data block (including audio data or MIDI data) (step S51; YES), the control unit 20 of the terminal 2 determines a block identifier included in the block (step S52). If the block identifier BI is “audio”, it is determined that the data portion DA is audio data, and the audio data is sequentially supplied to the sound generation portion 22 at a timing based on the time information TI. The sound generation unit 22 generates a musical tone based on the supplied audio data (step S53). For example, when the audio data shown in FIG. 7B is received, during the period from time t ₁ to time t ₂ , a data block for each sampling timing sequentially transmitted from the terminal 1 is received and included therein. Musical sound is generated based on the audio data to be recorded. Thereby, the musical sound of the attack part of acoustic guitar AG is sounded with high sound quality based on audio data.
On the other hand, when the block identifier BI of the received data block is “MIDI”, the control unit 20 determines that the data unit DA is MIDI data, and generates a musical sound signal by the sound source 25 based on the MIDI data. The generated tone signal is supplied to the sound generator 22 (step S54). For example, in the case shown in FIG. 7B, when key-on MIDI data is received at time t ₂ , the timbre parameter TP stored in the storage unit 21 is added to the MIDI data and supplied to the sound source 25. . As a result, the sound source 25 generates a musical tone signal of the tone color of the guitar from the time corresponding to the time t ₂ , and this musical tone signal is supplied to the sound generation unit 22 to be sounded. In this case, the pitch to be played is the pitch of the note specified by the MIDI data. That is, the musical sound of the attack part based on the audio data is reproduced from time t ₁ to time t _2, and the musical sound from the MIDI sound source 25 is reproduced with the same pitch as that of the attack part from time t ₂ . Then, when the communication unit 23 receives the MIDI data D3 shown in FIG. 7B, the process proceeds from step S52 to S54, and the control unit 20 instructs the sound source 25 to mute. As a result, the sound generation by the sound source 25 that has been sounded from time t ₂ is stopped.

As described above, in the present embodiment, the characteristic attack portion sounds a musical tone based on actual audio data, and the portion other than the attack portion sounds based on MIDI data, whereby the terminal 2 is an acoustic guitar AG. It is possible to generate a musical sound that is close to the actual musical sound without impairing the characteristics of the musical sound that is actually generated.
Further, in the above-described embodiment, as the tone signal generated by the sound source 25, tone signals after the attack portion (signals from the decay portion, the sustain portion, etc.) may be generated from when the key-on is instructed (FIG. 4). Of DW2). This is because the waveform of the attack portion by the audio data is followed by a musical sound waveform by the MIDI data, so that the attack portion is not necessary for sound generation by the MIDI data. When a general MIDI sound source is used, a tone signal having an attack portion is generated when key-on is instructed. However, such a sound source may be used if there is no problem in hearing.

<Modification>
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. An example is shown below.

(Modification 1)
In the embodiment described above, the timbre parameter is not included in the MIDI data transmitted by the terminal 1, and the timbre of the musical tone signal generated by the sound source 25 is designated by the timbre parameter TP stored in the terminal 2. However, instead of this, the timbre parameter TP may be included in the MIDI data transmitted by the terminal 1. For example, as shown by a broken line in FIG. 2, a timbre selection unit 15 for selecting a timbre according to a user operation is provided, and when the control unit 10 generates MIDI data, the timbre selected by the timbre selection unit 15 is selected. The configuration is such that the parameter TP is added. Then, the MIDI data to which the timbre parameter TP is added is configured to be transmitted to the terminal 2, and the tone generator 25 of the terminal 2 receives the musical tone signal of the timbre indicated by the timbre parameter TP included in the transmitted MIDI data. To generate. Further, the control unit 10 of the terminal 1 is configured to specify a timbre by frequency-analyzing the musical tone signal output from the microphone 12 and transmit the timbre parameter TP corresponding to the specified timbre included in the MIDI signal. It may be configured.

(Modification 2)
In the embodiment described above, the length of the attack part is a fixed value (the attack time W stored in the storage unit 11), but the length of the attack part may be switched. For example, since the length of the attack part may differ depending on how to play, a plurality of attack times are stored in the non-volatile storage part 11b shown in FIG. 2, and this is randomly selected to change the attack time. You may make it have. Further, the intensity (velocity) of the musical sound may be detected from the amplitude of the musical sound signal output from the microphone 12, and the attack time in the nonvolatile storage unit 11b may be selected corresponding to this velocity.
Further, the period from the rise of the musical sound waveform until the pitch is detected may be specified as the length of the attack portion. This is effective when the pitch cannot be specified because the pitch fluctuates in the attack portion. Even in this case, since the pitch can be detected immediately after the attack portion is finished and the waveform is stabilized, the period detected as the attack portion is set to an excessively long period with respect to the actual attack portion. No unnatural musical sound is played back on the terminal 2.
Further, as another method for specifying the length of the attack portion, it is possible to specify the end point of the attack portion when the rate of change in the amplitude of the waveform falls below a predetermined threshold (when the waveform enters the stable region). Good. The detection method of the attack part is not limited to the above. For example, in the case of an instrument that is difficult to detect only by the amplitude of the attack part, a section in which the change of the frequency component is superior to the amplitude change is set as the attack part. Such a detection method may be used.

(Modification 3)
In the embodiment described above, the attack portion sounds a tone based on actual audio data, and the portion other than the attack portion sounds based on MIDI data. However, the audio data and MIDI data are cross-faded. Also good. For example, as indicated by a broken line in FIG. 2, the fade time W ′ (a time longer than the attack time W is set) is stored in the storage unit 11 of the terminal 1. Then, as shown in FIG. 7C, the control unit 10 of the terminal 1 continuously transmits the audio data D1 from the time t ₁ to the time t ₂ ′ when the fade time W ′ elapses. together, at time t ₂ when the attack time W elapses from the time t _1, and transmits the MIDI data D2 including a note-on parameter to the terminal 2.

FIG. 9 is a diagram illustrating a waveform of a musical sound generated by the terminal 2. In the figure, T1 indicates a waveform of a musical sound that is generated based on received MIDI data, and T2 indicates a waveform of a musical sound that is generated based on received audio data. . As shown, the sound source 25 of the terminal 2, between the time t ₂ to time t _3, and generates a musical tone signal based on the MIDI data D2 received. Further, during the period from time t ₁ to time t ₂ ′, a tone is generated based on the audio data received by the sound generation unit 22. At this time, the sound generator 22 of the terminal 2 reproduces the musical sound signal so that the musical sound based on the MIDI data fades in from the time t ₂ to the time t ₂ ′, while the musical sound based on the audio data fades out. Play a music signal. Then, sound is emitted by a tone signal obtained by synthesizing these two types of tone signals. In this way, the musical sound based on the MIDI data and the musical sound based on the audio data are generated by cross-fading and can be switched with a more natural feeling.

(Modification 4)
In the above-described embodiment, the velocity parameter is not included in the MIDI data transmitted from the terminal 1, but the control unit 10 of the terminal 1 detects the velocity from the amplitude of the tone signal output from the microphone 12. The velocity parameter may be included in the MIDI data transmitted by the terminal 1. In this case, the tone generator 25 of the terminal 2 generates a musical tone signal having a volume indicated by the velocity parameter included in the transmitted MIDI data.

(Modification 5)
The sound generation unit 22 of the terminal 2 may switch from sound generation based on MIDI data to sound generation using a previously stored waveform immediately before the musical sound is muted. In this case, since the sound near the mute is approximate for any musical tone, if one waveform is prepared, it can be used for musical tones of all pitches simply by converting the pitch according to the notes in the MIDI data. can do. Therefore, only one (or a small number) of waveforms are stored even when sound generation is performed using waveform data. Then, by switching the sound generation near mute to waveform data, the reverberation at the moment when the sound disappears can be made to have a taste like a natural musical instrument, and the sound quality can be further improved.

(Modification 6)
Further, in the sound source 25 of the terminal 2, the musical sounds generated by the normal MIDI data and the MIDI data in the above embodiment may be made different from each other. For example, as the identification information set in the block identifier BI of the data block shown in FIG. 3, “special MIDI” can be set in addition to “audio” and “MIDI” described in the above embodiment. Then, the terminal 1 sets the block identifier BI to “special MIDI” instead of “MIDI” set when transmitting the MIDI data in the above embodiment, and transmits the MIDI data.
Further, the sound source 25 of the terminal 2 stores waveform data 25a indicating the waveform of the musical tone as indicated by a broken line in FIG. The waveform data 25a includes waveform data DA1 (corresponding to DW1) of the attack part and waveform data DA2 (corresponding to DW2) in which the amplitude after the attack part is stable, as shown in FIG. .

When receiving the data whose block identifier BI is “MIDI”, the tone generator 25 of the terminal 2 generates a tone signal based on the waveform data DA1, and then generates a tone signal based on the waveform data DA2. Thus, by generating a musical tone signal using the waveform data DA1 of the attack portion, it is possible to generate a musical tone having an attack portion for normal MIDI data not accompanied by audio data.
On the other hand, when data having the block identifier BI of “special MIDI” is received, a tone signal is generated using only the waveform data DA2 without using the waveform data DA1 of the attack section. This is because a musical tone is generated based on actual audio data in the attack portion, and it is not necessary to generate a musical tone signal using the waveform data DA1 of the attack portion.

  When the terminal 2 receives MIDI data from the terminal 1 and also receives MIDI data from other terminals that do not have the characteristics of the present invention, the terminal 2 performs the above-described processing, The musical sound of the attack part can be expressed for both MIDI data.

(Modification 7)
The musical instrument used in the present invention is not limited to the acoustic guitar used in the above embodiment. For example, the present invention can be applied to an arbitrary musical instrument such as a percussion instrument such as a drum or a drum or a stringed instrument such as a piano.

(Modification 8)
In the above-described embodiment, an example in which a single sound is output from a musical instrument is taken as an example. However, the present invention can be applied to playing a chord without being limited to a single sound as long as a certain condition is satisfied. For example, in the case of guitar stroke performance, the attack part has the same timing for each string and the same period. Then, it is only necessary to identify and separate from a musical tone signal including a plurality of pitches output by the microphone 12 with respect to the pitch, generate MIDI data having notes corresponding to each pitch, and transmit the MIDI data to the terminal 2.

(Modification 9)
In the embodiment described above, the terminal 1 is used as the musical tone signal transmitting terminal and the terminal 2 is used as the musical tone signal receiving terminal. However, the terminal is provided with both functions of the transmitting side and the receiving side. A two-way session may be performed between them. For example, the terminal 1 in the above embodiment is provided with a sound source and a sound generation unit provided in the terminal 2 so that a musical sound based on received audio data or MIDI data is generated. If a plurality of terminals having such a configuration are used, each terminal generates audio data and MIDI data from the musical tone signal output from the microphone, transmits the data to other terminals, and receives audio data from other terminals. Alternatively, it is possible to generate a musical sound based on MIDI data, thereby enabling a bidirectional session between a plurality of terminals 1.

It is a block diagram which shows the whole structure of the system which concerns on this embodiment. It is a figure which shows the structure of the terminal 1 of the embodiment. It is a data block diagram of the data block which the control part 10 of the terminal 1 of the embodiment produces | generates. It is the figure which showed an example of the waveform of audio data by the graph. It is a figure which shows the structure of the terminal 2 of the embodiment. It is a flowchart which shows the process which the terminal 1 of the embodiment performs. It is the figure which showed an example of the waveform of audio data by the graph. It is a flowchart which shows the process which the terminal 2 of the embodiment performs. It is the figure which showed an example of the tone waveform based on the waveform and MIDI data of audio data.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Terminal, 2 ... Terminal, 10, 20 ... Control part, 11, 21 ... Memory | storage part, 12 ... Microphone, 22 ... Sound generation part, 13, 23 ... Communication part, 14, 24 ... Timekeeping part, AG ... Acoustic guitar.

Claims (9)

An input means for outputting a musical sound emitted from a musical instrument as a musical sound signal;
Attack part extraction means for extracting a predetermined range from the rising edge of the waveform as an attack part for the musical sound signal output by the input means;
Pitch detecting means for detecting the pitch of the musical sound signal output by the input means;
Mute detection means for detecting a mute time point of the musical sound signal output by the input means;
A communication means for transmitting and receiving signals via a network;
A pitch parameter indicating the same pitch as the pitch detected by the pitch detecting means, a sounding timing parameter indicating the end time of the attack section as a sounding sounding timing, and a sounding time point detected by the sounding detecting means are indicated as a sounding timing. Parameter generating means for generating a mute timing parameter;
For one musical sound input to the input means, the waveform signal extracted by the attack extraction means is converted into waveform data and transmitted using the communication means, and the parameter generation is performed following transmission of the waveform data. And a transmission control means for transmitting the pitch parameter, sound generation timing parameter, and mute timing parameter generated by the means.   2. The musical tone signal transmitting terminal according to claim 1, wherein the predetermined portion in the attack extraction unit is a predetermined section determined in advance from the rising edge of the waveform.   The attack extraction unit detects a time point when the level of the waveform falls below a predetermined amount from a peak at the time of rising as an attack end point, and extracts from the rise of the waveform to the attack end point as an attack unit. The musical tone signal transmitting terminal according to 1.   2. The musical tone signal transmitting terminal according to claim 1, wherein the attack extraction unit extracts an interval from the rise of the waveform until the pitch detection unit detects the pitch as an attack unit.   The parameter generation means includes a timbre parameter generation means for generating a timbre parameter for designating a timbre, and the transmission control means is instructed by the timbre parameter generation means in addition to the pitch parameter, the sound generation timing parameter and the mute timing parameter. 5. The musical tone signal transmitting terminal according to claim 1, wherein the timbre parameter is also transmitted to the communication means.   6. A musical tone signal transmitting terminal according to claim 5, wherein said timbre parameter generating means specifies a timbre by analyzing a musical tone signal output from said input means, and generates a timbre parameter indicating the timbre. A communication means for transmitting and receiving signals via a network;
Waveform reproducing means for generating a musical sound signal based on the waveform data received by the communication means;
When the communication means receives a pitch parameter for instructing a pitch, a sound generation timing parameter for instructing the sound generation timing of a musical sound, and a mute timing parameter instructing the sound muffling timing of the music sound, a musical sound signal is generated based on these parameters. Sound source means to generate,
A musical tone signal receiving terminal comprising: a reproduction control unit that reproduces the musical tone signal generated by the sound source unit following the reproduction of the musical tone signal generated by the waveform reproducing unit.   8. The musical tone signal receiving terminal according to claim 7, wherein, when the communication means receives a timbre parameter indicating a timbre, the tone generator generates the musical tone signal based on a timbre based on the timbre parameter. .   The reproduction control unit starts reproduction of a musical sound signal generated by the sound source unit before the reproduction of the waveform signal by the waveform reproduction unit is completed, and performs cross-fade processing in a period in which both reproductions overlap. The musical tone signal receiving terminal according to claim 7 or 8.

Images