JP2830997B2 - Music performance information transmission method, music performance information transmitting device, and music performance information receiving device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION [Industrial Application Field] The present invention places a musical instrument of the same type as a musical performance information transmitting side on a musical performance information receiving side, and directly drives music by electrically driving the musical instrument. The present invention relates to a music performance information transmission method, a music performance information transmission device, and a music performance information reception device suitable for reproduction. That is, the present invention relates to a music performance information transmission method that encodes performance sound information collected from a performance instrument on the transmission side and supplies the encoded performance information to the reproduction performance instrument on the reception side. Another aspect of the present invention relates to a music performance information transmitting device that encodes performance sound information collected from a performance instrument and supplies the encoded performance information to a playback performance instrument on the receiving side. Furthermore, the present invention relates to a music performance information receiving apparatus for receiving music performance information encoded on a transmission side based on performance sound information collected from a performance instrument. SUMMARY OF THE INVENTION The present invention is for reproducing a music performance using a musical instrument at a place different from the place where the performance was performed. , Called performance sound information)
Packetization is performed and distributed and transmitted using a broadcast transmission line or an associated digital transmission line. At the receiving end, the previously packetized information is decoded, and the musical instrument is electrically driven based on the packetized information. To reproduce. That is, in the present invention, a musical instrument for obtaining performance sound information, an encoder for compressively encoding and packetizing the performance sound information, a broadcast transmission line for distributing and transmitting data or a digital transmission line associated therewith, Using a decoder that decodes the received data into the original performance sound information and an instrument that reproduces the performance based on the decoded performance sound information, a certain music performance is performed at a place different from the place where the performance was performed. Reproduce. [Related Art] Conventionally, as a system for transmitting and receiving this kind of music performance information, an additional sound transmission system for teletext, an automatic musical instrument performance system, and the like are known. However, the above additional sound transmission system has a drawback that performance information is not sufficiently transmitted, and the transmission code is not a multi-tone code, so that the code compression efficiency is poor and the number of multi-tones is limited. There are drawbacks such as no conversion. Also,
The above-mentioned musical instrument automatic performance system has drawbacks such as poor code compression efficiency and limited to individual use. Further, when the performance sound information of the musical instrument is extracted from the musical instrument being played and another musical instrument is played based on the information, as shown in FIG. 6, the MIDI standard ("MIDI-1,0 standard" MIDI) An online real-time transmission system according to Standards Council 59.5.10) is used. However, such a configuration has the drawbacks that the data capacity is very large and exchangeability is lacking. FIG. 7 and FIG. 8 are diagrams for explaining a conventional teletext encoding / decoding process. Here, a case where the music to be transmitted is composed of five simultaneous sounds is shown. That is, as shown in FIG. 7, the music information composed of five monophonic strings is decomposed into five small parts having a fixed duration. Then, as shown in FIG. 8, "SMP" (start position of each partial code) and "EPT" (end position of each partial code) are added before and after the data of each small portion.
These codes are sequentially joined to form the entire code. In the decoding process, the decoding is performed all at once until all the codes of the respective small parts are completed. However, in such a method, it is necessary to divide into a single sound sequence. The encoding cannot be started until after the performance. Decoding cannot be performed until it is determined that all data has been received. That is, since the number of all transmitted small parts is not declared in advance, the end of the performance cannot be determined until the last end code is received. Such disadvantages were observed. [Problems to be Solved by the Invention, Object of the Invention] In view of the above points, it is an object of the present invention to interrupt performance sound information obtained from a performance musical instrument at any time and encode it in small parts. Another object of the present invention is to provide a music performance information transmission method, a music performance information transmitting device, and a music performance information receiving device that can reproduce an actual performance with a small delay time. [Means for Solving the Problems] In order to achieve the above object, the present invention according to claim 1 is characterized in that the transmitting side encodes performance sound information collected from a performance musical instrument, and encodes the performance sound information on the receiving side. In the method for transmitting music performance information supplied to the reproduction performance musical instruments, the performance sound information is decomposed into N pieces of music parts (N = 1, 2,...). The first consisting of sound
Part: for example a piano and a second part consisting of two sounds: for example a guitar. That is, the number of parts is 2 (N = 2). ) Each of the music parts is interrupted at an arbitrary time interval and divided into small sections, and for one or more tones included in the small sections of each of the music parts, the pitch of each tone ( P), the intensity (I), and the length (T) of the sound, and the timing information component (t) which is the time difference information between the information components of the sound between the tones is obtained. ... See FIG. 2) The information component of the sound and the timing information component included in each of the small sections of each of the music parts, and interruption position time information (表 す) indicating an interruption position for forming the small section. .. Corresponding to the IPT in FIG. 5 are sequentially arranged in time series for each of the small sections, and the small section data signals of each music part (..., “SMP, 1, ~, IPT "), and each subsection The small-segment data signals of all music parts are arranged in the order of the music parts, and the small-segment music data signals (..., “SMP, 1,..., IPT, SMP,
2,..., IPT, SMP, 3,..., IPT "), and the transmission data signals are formed by arranging the subsection music data signals in chronological order in the subsection. .. See FIG. 3) The transmission data signal is transmitted to a data transmission path, and
.. (See FIG. 1) On the receiving side of the transmission data signal, the performance sound information is reproduced by decoding for each data of the small section and supplied to the reproduced performance instrument (see FIG. 1). ). According to a second aspect of the present invention, there is provided a music performance information transmitting apparatus for encoding performance sound information collected from a performance instrument and supplying the encoded performance information to a playback performance instrument on the receiving side. Decomposing means for decomposing into music parts (N = 1, 2,...); Interruption means for interrupting each of the music parts at an arbitrary time interval to divide into small sections; Of one or a plurality of tones included in the subsection, a sound information component representing a pitch (P), an intensity (I), and a length (T) of each tone is obtained, and Performance information extracting means for obtaining a timing information component (t) that is a time difference information between information components of the sound between the information component and the timing information component of the sound included in each small section of each music part; And said The interruption position time information indicating the interruption position for forming the section is sequentially arranged in time series for each of the small sections to form a small section data signal of each music part. Are arranged in the order of the music part to form a subsection music data signal, and the subsection music data signals are arranged in time series in the order of the subsection to form a transmission data signal. And an output unit for transmitting a signal to a data transmission path. Further, the present invention described in claim 3 is a device for receiving music performance information encoded on a transmission side based on performance sound information collected from a performance instrument, wherein: (N = 1, 2,...), Divided into small sections by interrupting each of the music parts at an arbitrary time interval, and included in the small sections of each of the music parts. For one or a plurality of tones, a sound information component representing the pitch (P), intensity (I), and length (T) of the sound in each tone is obtained, and the information component of the sound between each tone is obtained. A timing information component (t), which is a time difference information between the music part, and a sound information component and the timing information component included in each small section of each music part, and an interruption position for forming the small section. Suspend position time to represent And the information is sequentially arranged in time series for each of the small sections to form small section data signals of each music part, and further, the small section data signals of all music parts in each small section are arranged in the order of music parts. A receiving means for forming a subsection music data signal, receiving a transmission data signal formed by arranging the subsection music data signals in chronological order in the subsection, and sequentially decoding the received data of the subsection; And reproducing means for reproducing the performance sound information and supplying the reproduced performance information to the reproduced performance instrument. [Example] Hereinafter, this example will be described in detail with reference to the drawings. The block diagram shown in FIG. 1 shows one embodiment of a music performance information transmission system to which the present invention is applied. Here, 2 is a musical instrument, 4 is a compression encoding device, 6 is a packetizing device, 8 is a transmission line data channel, 10 is a storage medium, 12 is a network switching system, 14 is a packet decoding device, 16 is a decoding and expanding device,
18 is a storage device and 20 is a musical instrument. In this system, the performance performed by a certain musical instrument 2 is
For example, in accordance with the MIDI standard or the like, the performance sound information is taken out, compression-encoded by the compression-encoding device 4, and packetized by the packetizing device 6. Alternatively, the data is transmitted to a data transmission path such as the network switching system 12. On the receiving side, the packets are selected by the packet decoding device 14, the data is assembled, and the compressed code is decoded by the decoding and expanding device 16, thereby restoring the original performance sound information. As a method of playing a musical instrument from the restored performance sound information, it is preferable to perform the method via, for example, an interface based on the MIDI standard. FIG. 2 is a diagram showing a process of the compression encoding described above. As shown in the figure, from each piece of performance sound information, a pitch information P, a length T, a playing strength I, and time information (timing) t representing the playing time are represented by the playing information. Take out as. Here, the time information (timing) t for representing the performance time is the difference information between the previous performance time and the current performance time (the difference between the previous performance time and the time when the previous performance sound information was collected). ). FIG. 2 illustrates a case where “Tone 1” and “Tone 2” are generated in an overlapping manner, and then “Tone 2” and “Tone 3” are generated in an overlapping manner. According to the method described above, it is possible to obtain chord strings even when three or more sounds occur simultaneously. In other words, it can be said that the performance of multiple sounds is encoded as multiple sounds. As shown in FIG. 3, the performance information includes sound information (pitch P, length T, intensity I) and time information (timing) t.
Are transmitted alternately for each musical instrument. Here, these pieces of performance information are collected for one section (for example, for one piece of music), and identification data is added thereto. In addition, accompanying data indicating a player, a song name, and the like are added together with the identification data, and data for performing transmission management is added together with the identification data. Next, these signals are equally divided into data of a certain length,
The packet identification data and the packet control data are added to each of them to compose each packet. On the receiving side, a necessary packet is extracted by referring to the packet identification data obtained via the transmission path. Then, by referring to the transmission management data from these packets, one (or a plurality) of packets having the required performance information is extracted, and the performance information for one section is obtained. On the receiving side, the time information (timing) of the performance information for one section is integrated and converted into time information. Then, generation of sound is controlled at each obtained time, and the performance is performed. Next, the above-described encoding and decoding processes will be described in more detail. FIG. 4 and FIG. 5 are diagrams showing an example of an encoding / decoding processing process and obtained codes according to the present embodiment. In the example shown in FIG. 4, the case of a performance in which five sounds occur simultaneously is shown. Here, an example is shown in which a small part (first part) caused by simultaneous occurrence of three sounds using a piano or the like and a small part (second part) caused by simultaneous occurrence of two sounds using a guitar or the like are illustrated. is there. That is, each piece of performance sound information (see FIG. 2) obtained from a played instrument is divided into arbitrary small sections, and each piece of performance sound information is encoded. The break of this small section is specified by an interruption code (IPT, IMC shown in FIG. 5). The fifth
In the code illustrated in the figure, N = 1, 2, 3,... Increases as a number for specifying each part (each partial code), but in FIG. 4, when N = 1, 2 ( That is, the first by piano
And the second part with a guitar). On the receiving side, decoding becomes possible upon completion of reception of all data in each small section, and reproduction of performance sound information is performed. During this time,
The code of the next section is received, and decoding is performed subsequently to the code received earlier. Thus, the performance sound information can be transmitted with a relatively small delay time. Note that the division of the small section is normally performed at regular intervals, but in the present embodiment, an arbitrary time can be set. Further, in a packet transmission path such as a data channel, since each data shares the transmission path with each other, transmission cannot be performed at a desired transmission time, and some delay may be required. In such a case, a margin shown in FIG. 4 is provided to prevent the reproduced music from overtaking the transmission code. Therefore, even if a transmission delay occurs due to an interruption from other sources, it is possible to perform appropriate music reproduction on the receiving side. The time settings of the small section and the margin described above are appropriately determined so as to conform to the actual operation mode. As described above, in the present embodiment, the performance using multiple sounds is encoded with multiple sounds as it is in comparison with the conventional method. It has a format in which the number of decompositions of the small part code is declared in advance. Each partial code is arbitrarily interrupted and encoded for each section. In order to clarify the control on the receiving side, a break code of music code and identification data are provided. Effects of Embodiment According to one embodiment of the present invention, the following effects can be obtained. Without using a speaker, it is possible to provide a performance of an actual musical instrument by broadcasting. The amount of data can be reduced to about 1/100 by compression encoding compared to the case where MIDI standard information is played as it is. A plurality of musical instruments can be played simultaneously with a reduced delay time. Performance sound information can also be transmitted over a packet-type data broadcast transmission line such as a satellite broadcast data channel or a discontinuous transmission line such as a packet-switched data network. Information (music title, performer, composer name, etc.) accompanying the music performance can be displayed on the receiving side. In addition to transmission by a broadcast system and a wired communication system, the present invention can be used in a storage medium, and exchange between them can be realized. [Effects of the Invention] As described above, according to the present invention, the performance sound information obtained from the performance musical instrument is interrupted at any time and encoded for each small portion, so that the actual performance can be performed with less delay time than the conventional method. Can be reproduced.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram showing an embodiment of a music performance information transmission system to which the present invention is applied, FIG. 2 is a diagram for explaining a compression encoding process, and FIG. FIG. 4 is a diagram showing an example of a packet configuration, FIG. 4 is a diagram showing an encoding / decoding process according to this embodiment, FIG. 5 is a diagram showing an example of codes used in this embodiment, and FIG. FIG. 7 is a block diagram showing a conventional known encoding / decoding process, and FIG. 8 is a diagram showing an example of a conventionally known code. . 2 Musical instrument 4 Compression coding device 6 Packetization device 8 Data channel transmission channel 10 Storage medium 12 Network switching system 14 Packet decoding device 16 … Decryption / expansion device, 18… Storage device, 20… Musical instrument.

   ────────────────────────────────────────────────── ─── Continuation of front page       (56) References JP-A-60-264145 (JP, A)                 JP-A-59-28282 (JP, A)                 JP-A-59-206896 (JP, A)

Claims (1)

(57) [Claims] In a music performance information transmission method for encoding performance sound information collected from a performance instrument on a transmission side and supplying the encoded performance information to a reproduction performance instrument on a reception side, the performance performance information includes N (N = 1, 2,...) Decompose into music parts, interrupt each of the music parts at arbitrary time intervals and divide into small sections, and for one or a plurality of tones included in the small sections of each of the music parts, A sound information component representing a pitch (P), a strength (I), and a length (T) of a sound is obtained, and a timing information component (t) which is time difference information between the sound information components between the tones. The information component and the timing information component of the sound included in each small section of each music part, and the interruption position time information indicating the interruption position for forming the small section, for each of the small sections Chronologically The small section data signal of each music part is sequentially arranged to form a small section data signal, and the small section data signals of all music parts in each small section are arranged in the order of music parts to form a small section music data signal. The data signals are arranged in time series in the order of small sections to form a transmission data signal, the transmission data signal is transmitted to a data transmission path, and the reception side of the transmission data signal decodes each data of the small section. And reproducing the performance sound information and supplying the reproduced performance information to the reproduced performance instrument. 2. In a music performance information transmitting apparatus for encoding performance sound information collected from a performance instrument and supplying the encoded performance information to a playback performance instrument on the receiving side, the performance performance information is divided into N (N = 1, 2,...) Music parts. Decomposing means for decomposing; interrupting means for interrupting each of the music parts at an arbitrary time interval to divide into small sections; and for one or a plurality of tones included in the small sections of each of the music parts, A sound information component representing a pitch (P), a strength (I), and a length (T) of a sound in each tone is obtained, and timing information as time difference information between the sound information components in each tone is obtained. Performance information extracting means for obtaining a component (t); an information component and a timing information component of the sound included in each subsection of each music part; and an interruption position representing an interruption position for forming the subsection. The time information is sequentially arranged in time series for each of the small sections to form small section data signals of each music part, and further, the small section data signals of all music parts in each small section are arranged in the order of music parts. An output means for forming a transmission data signal by arranging the transmission data signal in time series in the order of the subsections, and forming the transmission data signal on a data transmission path. A music performance information transmitting device, comprising: 3. An apparatus for receiving music performance information encoded on a transmission side based on performance sound information collected from a performance instrument, wherein the performance sound information is decomposed into N (N = 1, 2,...) Music parts. And interrupting each of the music parts at arbitrary time intervals to divide the music parts into small sections, and for one or a plurality of tones included in the small sections of each of the music parts, the pitch of each tone (P), intensity (I), and length (T), and a timing information component (t) which is a time difference information between the information components of the sound between the tones. The information component and the timing information component of the sound included in each small section of each music part, and the interruption position time information indicating the interruption position for forming the small section are chronologically recorded for each of the small sections. Arranged in order A small section data signal of the music part is formed, and further, the small section data signals of all the music parts in each small section are arranged in order of the music part to form a small section music data signal. Receiving means for receiving transmission data signals formed in chronological order in the order of: and reproducing the performance sound information by sequentially decoding the received data of the small section and supplying the reproduced performance information to the reproduction performance musical instrument. Means for receiving music performance information.