JP2016200712A - Concert device, concert system, and method and program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a concert device etc., reducing a feeling of discomfort resulting from a delay time on a network by a different method from prior art.SOLUTION: A concert device is arranged at a first place so as to actualize a concert by a first player at the first place and a second player at a second place different from the first place through a network. The concert device includes a biological signal acquisition part which acquires biological information corresponding to a biological signal generated as the first player intends to act to generate a sound beating out of rhythm, and a transmission part which transmits biological information to the second place through the network and then transmits musical sound information corresponding to a sound generated by a motion of the biological information, and stimulation corresponding to the biological information is represented to the second player earlier at the second place than when a sound corresponding to musical sound information is reproduced.SELECTED DRAWING: Figure 2

Description

  The present invention provides an ensemble apparatus, an ensemble system, and a method for realizing an ensemble between a first performer at a first point and a second performer at a second point different from the first point via a network. And the program.

  Patent Document 1 is known as a prior art of an ensemble system that realizes an ensemble between a first performer at a first point and a second performer at a second point different from the first point via a network. ing. In remote co-starring, collaboration (co-starring) becomes difficult due to the delay time on the network. However, in Patent Document 1, the round trip delay of communication between two points before the musical sound is output from the performance operation at each point. By causing a delay of about half of the time, in other words, by sharing the round trip delay time at each point, the player feels uncomfortable at each point.

JP 2007-178860 A

  However, in the related art, a delay of about half of the round-trip delay time of communication between the two points occurs between the performance operation and the output of the musical tone, so that the player may feel uncomfortable.

  An object of the present invention is to provide an ensemble apparatus, an ensemble system, a method thereof, and a program for reducing a sense of incongruity based on a delay time on a network by a method different from the prior art.

  In order to solve the above-described problem, according to one aspect of the present invention, the ensemble apparatus is connected to the first player at the first point and the second point different from the first point via the network. Arranged at the first point to achieve an ensemble with two performers. The ensemble apparatus includes a biological signal acquisition unit that acquires biological information corresponding to a biological signal generated due to the first player's intention to make a movement that generates a rhythmic sound, and a network. A transmitter that transmits biological information to the second point and then transmits musical information corresponding to the sound generated by the movement of the biological signal. At the second point, the sound corresponding to the musical information is reproduced. The stimulus corresponding to the biometric information is presented to the second player earlier than the second player.

  In order to solve the above problems, according to another aspect of the present invention, the ensemble system is located at a second point different from the first point and the first player at the first point via the network. Realize an ensemble with a second performer. The ensemble system includes a biological signal acquisition unit that acquires biological information corresponding to a biological signal generated due to the first player's intention to make a movement that generates a rhythmic sound, and a network. A first ensemble apparatus including: a transmitting unit that transmits biological information to a second point, and then transmits musical sound information corresponding to a sound generated by the movement of the biological signal; and receives the biological information; A second ensemble apparatus including a receiving unit that receives information and a presentation unit that presents a stimulus to the second player based on the biological information;

  In order to solve the above-mentioned problems, according to another aspect of the present invention, the ensemble method is located at a second point different from the first point and the first player at the first point via the network. Realize an ensemble with a second performer. The ensemble method is a biological signal acquisition step in which the biological signal acquisition unit acquires biological information corresponding to the biological signal generated due to the first player's intention to generate a rhythmic sound. A first transmission step in which the transmission unit transmits the biological information to the second point via the network; and a sound acquisition step in which the sound acquisition unit acquires the musical sound information corresponding to the sound generated by the movement by the biological signal. And a second transmission step in which the transmission unit transmits the musical sound information to the second point via the network, and at the second point, the biological information is obtained earlier than the sound corresponding to the musical sound information is reproduced. A stimulus corresponding to is presented to the second player.

In order to solve the above-mentioned problem, according to another aspect of the present invention, the ensemble method includes a first ensemble apparatus arranged at the first point and a second ensemble arranged at a second point different from the first point. The ensemble between the first performer at the first point and the second performer at the second point is realized via the network using the double ensemble device. In the ensemble method, the first ensemble apparatus acquires biological information corresponding to the biological signal generated due to the first player's intention to make a movement that generates a rhythmic sound. A first transmission step in which the first ensemble device transmits biological information to the second point via the network, a first reception step in which the second ensemble device receives the biological information, and a second ensemble device A presentation step of presenting a stimulus to the second player based on the biological information, a sound acquisition step in which the first ensemble apparatus acquires musical tone information corresponding to a sound generated by a movement of the biological signal, and a first ensemble apparatus A second transmission step of transmitting the musical tone information to the second point via the network, a second reception step of the second ensemble device receiving the musical tone information,
The second ensemble apparatus includes a reproduction step of reproducing a sound based on the musical sound information.

  According to the present invention, it is possible to reduce a sense of incongruity based on a delay time on a network by a method different from that of the prior art.

FIG. 1A is a diagram showing a round-trip delay time of communication on a network and timings of musical sounds obtained at a first point and a second point (A sound is generated simultaneously with a performance at the first point). FIG. 1B is a diagram showing the round trip delay time of communication on the network and the timing of the musical sound obtained at the first point and the second point (the A sound is simultaneously reproduced with the B sound at the first point). FIG. 2A is a diagram showing timing of stimulation and musical sound when the ensemble system of the first embodiment is used (A sound is generated simultaneously with performance at the first point). FIG. 2B is a diagram showing the timing of stimulation and musical sound when the ensemble system of the first embodiment is used (A sound is simultaneously reproduced with B sound at the first point). The figure which shows the timing of a stimulus and a musical sound at the time of using the ensemble system of 1st embodiment. The functional block diagram of the ensemble system which concerns on 1st embodiment. The figure which shows the example of the processing flow of the ensemble system which concerns on 1st embodiment. FIG. 6A is a diagram showing the timing of stimulation and musical sound when the ensemble system according to the modification of the first embodiment is used (A sound is generated simultaneously with performance at the first point). FIG. 26 is a diagram showing the timing of stimulation and musical sound when the ensemble system according to the modification of the first embodiment is used (A sound is simultaneously reproduced with B sound at the second point).

  Hereinafter, embodiments of the present invention will be described. In the drawings used for the following description, constituent parts having the same function and steps for performing the same process are denoted by the same reference numerals, and redundant description is omitted.

<Points of first embodiment>
First, the basic principle of this embodiment will be described. FIG. 1 shows that when the required time (transmission delay) for the forward path from the first point to the second point is, for example, 20 ms and the required time (transmission delay) for the return path is, for example, 180 ms, It is the figure which showed the timing of the musical sound obtained at the 1st point and the 2nd point when performing the operation | movement which presses a keyboard once). That is, it represents the round trip delay time of communication on the network.

  When a player at the first point (hereinafter also referred to as “first player”) plays the musical instrument α at time ta and makes an A sound, at the second point far away, 20 ms after the required time for the outbound route. The sound A of the musical instrument α is reproduced at time tb. The player at the second point (hereinafter also referred to as “second player”) can play the instrument β in accordance with the A sound and produce the B sound. However, when performance information based on the performance at the second point is sent to the first point, the B sound is reproduced at the first point at time tc 200 ms after time ta (FIG. 1A). Therefore, if the musical sound (A sound) based on the operation is generated at the timing when the first performer performs the performance operation, the musical sound (A sound and B sound) played at the first point is not mixed in synchronization.

  In order to synchronize the A sound based on the performance at time ta with the B sound at the first point, a musical sound (A sound) must be generated 200 ms after the performance operation. In this case, the first performer feels a great sense of incongruity because the timing difference between his performance and the musical sound (sound A) based on the performance is large (FIG. 1B).

  Therefore, in the present embodiment, at the second point, the second player is notified that the musical sound (sound A) is output at a timing tf earlier than the musical sound (sound A) is output (see FIG. 2). . In this embodiment, the second player is notified by presenting a stimulus different from the musical sound (sound A). If the music continues to be played at a predetermined time interval after the stimulus, the second performer starts timing (between time tf and less than time tb) earlier than the timing tb when the music (sound A) is actually played. It is considered that the musical sound (A sound) is played at the timing of As a result, the second player plays the musical instrument β at the illusionary timing (timing th earlier than the timing tb at which the musical sound (A sound) is actually reproduced) to produce the B sound. At the second point, the timing of the A sound and the B sound is different, but the second player can obtain a sense of performing with the above illusion. On the other hand, at the first point, the timings ta and ti of the A sound and the B sound are different, but the error is smaller than in the case of FIG. 1A, and the first player can obtain a sense of performing. In order to synchronize the A sound based on the performance at the time ta with the B sound at the first point, the musical sound (A sound) may be reproduced after the performance operation (see FIG. 2B). In that case, the timing difference between the performance performance of the player and the musical sound (sound A) based on the performance is smaller than in the case of FIG. 1B, and the uncomfortable feeling can be reduced. Although not shown, similarly, in order to synchronize the B sound based on the performance at the time th with the A sound at the second point, the musical sound (B sound) may be reproduced at the timing tb after the performance operation. Even if the above-mentioned illusion does not occur in the second performer, it will be explained that the musical sound is reproduced at a predetermined time interval after the stimulation, and in accordance with the rhythm of the stimulation (faster than the A sound is reproduced) By instructing to play the instrument β (at timing), the same effect can be obtained.

  In the present embodiment, the myoelectric potential generated when the first performer performs a performance operation is used to notify that the musical sound is output at an earlier timing than the musical sound is output. This is because a myoelectric potential is generated by the movement of the muscle corresponding to the performance operation several hundred ms before the musical sound generated by the performance operation is obtained (550 ms in the example of FIG. 2).

  As shown in FIG. 3, the first player may be informed that the musical sound (B sound) is output at a timing tg earlier than the musical sound (B sound) is output at the first point. With such a configuration, it is possible to reduce the sense of incongruity by playing each instrument so that the performers are synchronized with each other at an earlier timing than the actual playback sound, with the illusion that the performers are synchronized with each other.

<Ensemble system 1>
FIG. 4 is a functional block diagram of the ensemble system 1 according to the first embodiment, and FIG. 5 shows a processing flow thereof.

  The ensemble system 1 includes R ensemble apparatuses 100-r, and the R ensemble apparatuses 100-r can be connected via the communication line 10. R is any integer of 2 or more, and r = 1, 2,. This embodiment demonstrates the case where an ensemble is performed between ensemble apparatus 100-p and ensemble apparatus 100-q. Here, p and q are 1, 2,..., R, respectively, and p ≠ q. Note that the ensemble apparatus 100-p is arranged at the first point, the first player is at the first point, and the ensemble apparatus 100-q is arranged at the second point different from the first point. It is assumed that there is a second performer at the second point. The ensemble system 1 realizes an ensemble between the first performer and the second performer.

  The ensemble apparatus 100-r includes a biological signal acquisition unit 110-r, a sound acquisition unit 120-r, a transmission unit 130-r, a reproduction unit 140-r, a presentation unit 150-r, and a reception unit 160-r.

<Biological signal acquisition unit 110-p>
The biological signal acquisition unit 110-p of the ensemble apparatus 100-p acquires biological information corresponding to the biological signal generated due to the intention of the first performer to generate a rhythmic sound. (S1). The transmission unit 130-p transmits the biological information to the ensemble apparatus 100-q at the second point via the communication line 10 (S2).

  For example, the information corresponding to the myoelectric potential regarding the timing of the performance acquired from the part moved by the person involved in the ensemble mainly to engrave the rhythm is used as the biological signal. The reason corresponding to the myoelectric potential is that, as described above, the myoelectric potential is generated at an earlier time (several hundred ms before, 550 ms in the example of FIG. 2) than the sound is generated by the movement of the muscle. For example, it is desirable that the part for acquiring the myoelectric potential is a part that is deeply involved in the movement that generates a rhythmic sound. For example, if the first performer is a drum performer, it is the second arm, and if it is a piano performer, the left arm is the forearm. Note that myopotentials of a plurality of channels may be acquired instead of one channel. For example, if the performer is a drum performer, the electromyogram measurement electrodes may be attached to the antagonistic muscles of the second arm if there is one channel, and the antagonistic muscles and active muscles of the second arm if there are multiple channels. In the case of a piano player, the left arm's forearm is one channel (for example, one of a plurality of locations that move in response to the finger moving when playing the keyboard), and the left hand's forearm is multiple channels. The myoelectric potential measuring electrode may be attached to the whole (for example, any two or more of a plurality of locations that move corresponding to the finger that moves when playing the keyboard). In short, it is only necessary to attach an electrode to the muscle for engraving the rhythm.

  When acquiring myoelectric potentials of a plurality of channels, addition or difference between channels may be sent. For example, when acquiring the myoelectric potentials of the antagonist's upper arm and the main muscle of the drum performer, the timing of hitting the drum can be obtained more accurately by sending the difference in myoelectric potential. Further, when acquiring the myoelectric potential of the entire forearm of the left hand of the piano player, the keystroke timing of each finger can be handled as one timing by sending the sum of the obtained myoelectric potentials.

  In addition, in order to reduce the transmission amount, at least one of the myoelectric potential, the difference and the sum thereof is not sent as it is, but the spike amount per unit time (the myoelectric potential, the difference and the sum thereof has a threshold value). The number of peaks exceeded) may be transmitted. In addition, in order to obtain the spike amount per unit time, it is necessary to accumulate myoelectric potential, which causes a delay. This delay is caused by the time when the musical sound is generated by the performance operation and the muscle movement corresponding to the performance operation. Since it is sufficiently smaller than the interval (for example, interval te-ta in the case of FIG. 2) with the time at which the potential is generated, it is possible to notify that the musical sound is output at an earlier timing than the musical sound is output. It is.

  For example, the biosignal acquisition unit 110-p includes a known myoelectric potential measurement device, and uses the myoelectric potential that is the measurement result to (1) as it is, (2) in the case of multiple channels, the difference in myoelectric potential And (3) At least one of spike amounts per unit time of (1) or (2) is acquired as biological information.

<Presentation part 150-q>
The receiving unit 160-q of the ensemble apparatus 100-q receives the biological information (S3). At this time, even when a delay of several tens of ms occurs when transmitting the biological information from the first point to the second point, the sound A at the first point is not received when the biological information arrives at the second player side. There is time to spare so that it does not occur.

  The presentation unit 150-q of the ensemble apparatus 100-q presents a stimulus to the second player based on the biological information (S4).

  As a presentation method, from biological information ((1) myoelectric potential itself, (2) difference and sum of multiple myoelectric potentials, (3) (1) or (2) spike amount per unit time) Take out the timing information and display it in rhythm. The timing information is, for example, information indicating the timing at which the amount of spike of the electromyogram exceeds a threshold value.

  Also, as a method of rhythm display, for example, (1) flash or pendulum synchronized with timing is presented visually, (2) tactile presentation by vibration synchronized with timing, or ( 3) A method such as a metronome sound that can be presented auditorially with a sound different from the A sound is conceivable. For example, the presentation unit 150 includes a device such as an LED or a display for presenting a light stimulus if visually presented, and a vibrator or the like for presenting a tactile stimulus if presented visually. If the device is included and is presented auditorily, a signal corresponding to a sound different from the A sound may be output to the reproduction unit 140-q. Moreover, (4) You may present by functional electrical stimulation. For example, it implement | achieves by FES (Functional Electrical Stimulation) (refer patent document 1). At this time, the strength of functional electrical stimulation may be set as appropriate. For example, it is possible to just feel a tingling electrical stimulation, or an electrical stimulation that moves the muscle itself.

  In other words, at the second point, at least one of a visual stimulus, a tactile stimulus, and an auditory stimulus corresponding to the biological information is generated at the second point by the presenting unit 150-q before the sound corresponding to the musical tone information is reproduced. The second player is presented in accordance with the rhythm (this rhythm is a rhythm corresponding to the performance of α or the myoelectric potential resulting from the performance). Or the functional electrical stimulation corresponding to biometric information is shown to a 2nd player according to a rhythm.

  The rhythm may be transmitted by directly displaying myoelectric information as a display method. By visually displaying the waveform as it is, the time for data processing can be saved and the delay can be further reduced. Further, the length of the bar may be changed in conjunction with the spike amount.

  If the timing for presenting the stimulus is too early even when the transmission delay is taken into account (if the stimulus is presented too early and it becomes difficult to match the rhythm of the song), a delay may be added. For example, the timing at which biological information is transmitted by the ensemble apparatus 100-p may be delayed, or the timing at which stimulation is presented by the ensemble apparatus 100-q may be delayed.

<Sound acquisition unit 120-p>
The sound acquisition unit 120-p of the ensemble apparatus 100-p acquires musical tone information corresponding to the sound generated by the movement due to the biological signal (S5). The transmitting unit 130-p of the ensemble apparatus 100-p transmits musical tone information to the ensemble apparatus 100-q at the second point via the communication line 10 (S6).

  For example, a microphone may be used as the sound acquisition unit 120-p, and a microphone output signal (sound collection signal) may be used as musical sound information. Further, an electronic musical instrument may be used as the sound acquisition unit 120-p, and an output signal of the electronic musical instrument may be used as musical sound information. In addition, the information corresponding to the output signal, for example, the analog output signal, the digital output signal, the output signal in the frequency domain, and the output signal, not the output signal itself of the microphone or the electronic musical instrument, can be obtained by encoding with known speech encoding. A code or the like may be used as musical tone information.

<Reproducing unit 140-q>
The receiving unit 160-q of the ensemble apparatus 100-q receives musical tone information (S7). The reproduction unit 140-q of the ensemble apparatus 100-q reproduces a sound based on the musical sound information (S8). For example, a speaker is used as the reproducing unit 140-q. Note that the B sound of the musical instrument β played by the second player may be acquired by the sound acquisition unit 120-q and reproduced from the reproduction unit 140-q. In this case, the reproduction timing may be during performance of the musical instrument β (see FIG. 2A) or may be delayed in accordance with the reproduction of the A sound. In addition, what is necessary is just to implement | achieve the mixing method of A sound and B sound, and the method of delaying B sound by the method similar to a prior art (for example, refer patent document 1).

  In addition, when sending musical tone information from the ensemble apparatus 100-q to the ensemble apparatus 100-p, the ensemble shown in FIG. 3 can be realized by performing the same processing.

  In order to make the time interval from when the stimulus is presented to when the musical sound is reproduced constant, it is desirable that the communication line 10 has a constant communication delay.

<Effect>
With the above configuration, it is possible to reduce a sense of incongruity based on the delay time on the network by a method different from the conventional technique.

<Modification>
In the present embodiment, information corresponding to the myoelectric potential is used as the biological information. However, the biometric information is generated based on at least one activity of the motor cortex, the pyramidal tract, and the muscle related to the timing of engraving the rhythm of the performance of the first player. Information corresponding to the biological signal may be used. In short, it is only necessary to obtain a biological signal corresponding to the performance operation before the musical sound generated by the performance is obtained. For example, instead of the myoelectric potential, a myomogram measured by a myomometer that changes in accordance with muscle activity may be used as the biological information. Moreover, the same effect as this embodiment can be acquired from the information corresponding to the biological signal generated based on the activity of the motor cortex or the cone path that sends a signal to the muscle.

  In the present embodiment, the performer has been described as playing an instrument. However, the performer generally means anything related to an ensemble. "Performer" is a concept that includes, for example, vocals that sing without using instruments, conductors that do not produce sound but swing conductors to the song, and dancers that dance to the rhythm and tempo of the song, In other words, it means something that performs some action with other performers according to the rhythm and tempo of the song. For example, by attaching an electrode to the vocal abdominal muscles or the arm of a conductor to acquire myoelectric potential, it is possible to obtain a biological signal that is generated due to the intention of making a movement that generates a rhythmic sound. it can.

  The essential components of the transmitting-side ensemble device 100-p are the biological signal acquisition unit 110-p, the transmission units 130-p and 160-p, and the sound acquisition unit 120-p and the playback unit 140-p are provided by separate devices. It may be realized. For example, a microphone or an electronic musical instrument and a speaker may be connected to the ensemble apparatus 100-p. On the other hand, the essential configuration of the reception-side ensemble apparatus 100-q is a presentation unit 150-q, a reception unit 160-q, and a transmission unit 130-p, and the sound acquisition unit 120-q and the reproduction unit 140-q are separate devices. May be realized.

  Note that the second player may perform in accordance with the stimulus presented by the presentation unit 150-q. At this time, the timing for presenting the stimulus is delayed as follows. Delay time d = (timing at which sound A is generated−timing at which myoelectric potential is generated (ta−te in the example of FIG. 2A)) − round-trip delay time of communication on the network ((tf−te) in the example of FIG. 2A + (Ti-th)), and at the first point, the biological information is transmitted after the delay time d has elapsed since the biological information was acquired, or at the second point, only the delay time d after the biological information was received. The stimulus is presented after the passage (see FIG. 6A). With such a configuration, when playing in accordance with the stimulus at the second point, the first player can play the musical instrument α along with the reproduction of the B sound at the first point. It is possible to reduce a person's uncomfortable feeling. In addition, what is necessary is just to set suitably whether B sound is output with the performance of the musical instrument (beta) in a 2nd point (FIG. 6A), or is output together with the reproduction | regeneration of A sound (FIG. 6B). In any case, since the second player only needs to perform in accordance with the stimulus, the uncomfortable feeling can be reduced.

  The present invention is not limited to the above-described embodiments and modifications. For example, the various processes described above are not only executed in time series according to the description, but may also be executed in parallel or individually as required by the processing capability of the apparatus that executes the processes. In addition, it can change suitably in the range which does not deviate from the meaning of this invention.

<Program and recording medium>
In addition, various processing functions in each device described in the above embodiments and modifications may be realized by a computer. In that case, the processing contents of the functions that each device should have are described by a program. Then, by executing this program on a computer, various processing functions in each of the above devices are realized on the computer.

  The program describing the processing contents can be recorded on a computer-readable recording medium. As the computer-readable recording medium, for example, any recording medium such as a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory may be used.

  The program is distributed by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Further, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its storage unit. When executing the process, this computer reads the program stored in its own storage unit and executes the process according to the read program. As another embodiment of this program, a computer may read a program directly from a portable recording medium and execute processing according to the program. Further, each time a program is transferred from the server computer to the computer, processing according to the received program may be executed sequentially. Also, the program is not transferred from the server computer to the computer, and the above-described processing is executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by the execution instruction and result acquisition. It is good. Note that the program includes information provided for processing by the electronic computer and equivalent to the program (data that is not a direct command to the computer but has a property that defines the processing of the computer).

  In addition, although each device is configured by executing a predetermined program on a computer, at least a part of these processing contents may be realized by hardware.

Claims (10)

An ensemble device arranged at the first point in order to realize an ensemble between the first player at the first point and a second player at a second point different from the first point via a network. Because
A biological signal acquisition unit that acquires biological information corresponding to a biological signal generated due to the first player intending to make a movement that generates a rhythmic sound;
A transmitter that transmits the biological information to the second point via the network, and then transmits musical sound information corresponding to the sound generated by the movement of the biological signal,
At the second point, a stimulus corresponding to the biological information is presented to the second player earlier than the sound corresponding to the musical sound information is reproduced.
Ensemble device. The ensemble apparatus according to claim 1,
The biological information is information corresponding to a biological signal generated based on the activity of at least one of the motor area, the cone path, and the muscle related to the timing of engraving the rhythm of the performance of the first player.
Ensemble device. An ensemble apparatus according to claim 2, wherein
The biometric information is information corresponding to the myoelectric potential related to the timing of the performance acquired from the part that the person involved in the ensemble moves mainly to cut the rhythm.
Ensemble device. An ensemble apparatus according to claim 3, wherein
The myoelectric potential is the myoelectric potential of the antagonistic muscle of the second arm when the first player is a drum player, and the myoelectric potential of the left forearm when the first player is a piano player.
Ensemble device. An ensemble system for realizing an ensemble between a first player at a first point and a second player at a second point different from the first point, via a network,
A biological signal acquisition unit that acquires biological information corresponding to a biological signal generated due to the first player intending to make a movement that generates a rhythmic sound;
A first ensemble apparatus comprising: a transmitter that transmits the biological information to the second point via the network, and then transmits musical sound information corresponding to the sound generated by the movement of the biological signal;
A receiver that receives the biological information and then receives the musical sound information;
Based on the biological information, a presentation unit that presents a stimulus to the second player,
A second ensemble apparatus including a reproduction unit for reproducing the sound based on the musical sound information;
Ensemble system. The ensemble system according to claim 5,
The presenting unit has a visual stimulus, a tactile stimulus corresponding to the biological information, or an auditory stimulus different from the sound corresponding to the musical sound information earlier than the reproducing unit reproduces the sound corresponding to the musical sound information. Present at least one of them to the second player according to the rhythm,
Ensemble system. The ensemble system according to claim 5,
The presenting unit presents a functional electrical stimulus corresponding to the biological information to the second player in accordance with the rhythm earlier than the reproducing unit reproduces a sound corresponding to the musical sound information.
Ensemble system. An ensemble method for realizing an ensemble between a first performer at a first point and a second performer at a second point different from the first point via a network,
A biological signal acquisition step in which the biological signal acquisition unit acquires biological information corresponding to the biological signal generated due to the intention of the first player to make a movement that generates a rhythmic sound;
A transmission unit that transmits the biological information to the second point via the network;
A sound acquisition step in which the sound acquisition unit acquires musical sound information corresponding to the sound generated by the movement of the biological signal;
A transmission unit including a second transmission step of transmitting the musical sound information to the second point via the network;
At the second point, a stimulus corresponding to the biological information is presented to the second player earlier than the sound corresponding to the musical sound information is reproduced.
Ensemble method. A first performer at the first point via a network using a first ensemble device located at the first point and a second ensemble device located at a second point different from the first point. And an ensemble method for realizing an ensemble with the second performer at the second point,
A biosignal acquisition step for acquiring biometric information corresponding to a biosignal generated by the first ensemble device intended to make a movement of the first performer to generate a rhythmic sound; and
A first transmission step in which the first ensemble apparatus transmits the biological information to the second point via the network;
A first receiving step in which the second ensemble apparatus receives the biological information;
The second ensemble device presenting a stimulus to the second player based on the biological information;
A sound acquisition step in which the first ensemble apparatus acquires musical sound information corresponding to a sound generated by the movement of the biological signal;
A second transmission step in which the first ensemble apparatus transmits the musical tone information to the second point via the network;
A second receiving step in which the second ensemble apparatus receives the musical tone information;
The second ensemble apparatus includes a reproduction step of reproducing the sound based on the musical sound information;
Ensemble method.   The program for functioning a computer as an ensemble apparatus in any one of Claims 1-4.

Images