KR20210108715A - Apparatus and method for providing joint performance based on network - Google Patents

Abstract

The present invention relates to an apparatus and method for providing a joint performance based on a network. A server for providing the joint performance of a plurality of player devices connected through a network according to the present invention includes an accompaniment sound source from each of the plurality of player devices through the network, a communication part that receives individual performance data synthesized from high-frequency beats and player sound sources in real time; a synchronization part for performing synchronization correction by synchronizing the high-frequency beats included in each of the received plurality of individual performance data; and a sound source synthesis part for generating joint performance data by mixing the plurality of player sound sources based on the synchronized high-frequency beats.

Description

Apparatus and method for providing joint performance based on network

The present invention relates to an apparatus and method for providing a joint performance based on a network that provides a live joint performance of remote performers online in real time.

In an orchestra or choir, all performers and singers must play simultaneously in the same space so that various tones can harmonize without dissonance. However, there is a limitation that a plurality of performers from a distance must all gather in the same space at the same time.

On the other hand, in order to escape from the above restrictions, remote players each transmit their own songs and musical instrument performance sound files to a sound source synthesis device through a network, and the sound source synthesizer converts a plurality of individual sound source files into one completed joint performance sound source. You may consider making a file and presenting it to the audience. When remote performers transmit their entire individual sound source files to a sound source synthesis device, the sound source synthesizer downloads and stores a plurality of individual sound source files, and synchronizes and plays back the stored individual sound source files as one complete joint performance sound source. can be made into a file.

However, considering the above method on the premise that it is performed in real time, various problems are encountered. First, when remote players transmit individual sound source data through a network, each network path is different. Accordingly, in a network environment that changes in real time, the arrival time of each individual sound source data to the sound source synthesizing apparatus changes in real time. In addition, since the performance of the apparatuses for recording the performance sound source is different, the delay time generated during the recording process is also different.

Therefore, it is not easy for the sound source synthesis device to provide the joint performance sound source data online in real time without dissonance. Accordingly, in order to provide a live joint performance of remote performers online in real time, a method for synthesizing a plurality of individual sound source data transmitted through a network in real time without dissonance is required.

The present invention provides a network-based joint performance that provides live joint performances of remote players online in real time by synthesizing a plurality of player sound sources transmitted through a network in sync with high-frequency beats in real time and reproducing the synthesized sound sources in real time and to provide a method therefor.

The server according to one aspect of the present invention is a server that provides a joint performance of a plurality of player devices connected through a network, and individual performances in which an accompaniment sound source, a high frequency beat, and a player sound source are synthesized from each of the plurality of player devices through the network A communication unit for receiving data in real time, a synchronization unit for performing synchronization correction by synchronizing the high-frequency beats included in each of the received plurality of individual performance data, and the plurality of individual performance data based on the synchronized high-frequency beats and a sound source synthesizing unit for generating joint performance data by mixing the plurality of player sound sources included in the , wherein the high-frequency bit includes a frequency bit of an inaudible frequency band.

The server further comprises an accompaniment generator for generating accompaniment data by synthesizing a plurality of the high-frequency beats with the accompaniment sound source at a predetermined period, and the communication unit transmits the accompaniment data to the plurality of player devices when the joint performance starts. You can stream at the same time.

The communication unit may stream the joint performance data generated by the sound source synthesis unit to an output device.

The synchronization unit may perform real-time synchronization correction by synchronizing the high-frequency bits corresponding to the corresponding time points whenever a period of the high-frequency bits arrives.

The synchronization unit temporarily stores a plurality of individual performance data that have been received until all of the plurality of individual performance data constituting the joint performance data are received, and stores the previously received individual performance data in the high-frequency beat included in the last reached individual performance data. Synchronization correction may be performed by synchronizing high-frequency beats included in a plurality of received individual performance data.

According to another aspect of the present invention, there is provided a method in which a server provides a joint performance of a plurality of player devices connected through a network, the method comprising: generating accompaniment data by synthesizing a plurality of high-frequency beats in an accompaniment sound source at a predetermined period; Simultaneously streaming the accompaniment data to the plurality of player devices through the network when a performance starts Step, determining whether the synchronization of the high-frequency beats included in the plurality of individual performance data is matched, and performing synchronization correction by matching the synchronization of the high-frequency bits included in each of the plurality of individual performance data according to the determination result and generating joint performance data by mixing the plurality of player sound sources included in the plurality of individual performance data based on the synchronized high-frequency beats.

The high-frequency bit may include a frequency bit of an inaudible frequency band.

The step of performing the synchronization correction includes temporarily storing a plurality of individual performance data that have been received until all of the plurality of individual performance data constituting the joint performance data are received and included in the finally reached individual performance data. Synchronization correction may be performed by synchronizing the high-frequency beats included in the plurality of individual performance data received in advance with the high-frequency beats.

The determining whether the high-frequency bits are synchronized may include determining whether the high-frequency bits are synchronized with the corresponding time point whenever a period of the high-frequency beats arrives.

The generating of the joint performance data may include streaming the generated joint performance data to an output device.

According to the present invention, by synchronizing each of a plurality of high-frequency beats and synthesizing a plurality of individual performance data, it is possible to accurately and quickly synchronize a plurality of player sound sources.

The present invention can provide live joint performances of discord-free distance performers online in real time.

The present invention can save time and money required for a plurality of players to move to a designated place for a joint performance.

1 is a diagram illustrating a network-based joint performance system according to an embodiment.
FIG. 2 is a block diagram illustrating the function of the server of FIG. 1 .
3 is a view for explaining a cause of delay in arrival of individual performance data transmitted through a network according to an embodiment.
4 is a view for comparing and explaining arrival delay states of a plurality of individual performance data transmitted through a network according to an embodiment.
5 is a view for explaining the generation of joint performance data after initial synchronization of a plurality of individual performance data according to an embodiment.
6 is a view for explaining the generation of joint performance data after real-time synchronization of a plurality of individual performance data while a joint performance is in progress, according to an embodiment.
7 is a flowchart illustrating a network-based joint performance method according to an embodiment.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but identical or similar components are given the same and similar reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "module" and/or "part" for the components used in the following description are given or mixed in consideration of the ease of writing the specification only, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in this specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number, such as first, second, etc., may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When a component is referred to as being “connected” or “connected” to another component, it is understood that the other component may be directly connected or connected to the other component, but other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that no other element is present in the middle.

In the present application, terms such as "comprises" or "have" are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

1 is a diagram illustrating a network-based joint performance system according to an embodiment.

Referring to FIG. 1 , a network-based joint performance system 1 includes a plurality of player devices 100a, 100b, ..., 100n, a server 200 and an output device 300 .

The joint performance system 1 broadcasts the individual performances of a plurality of performers in a remote location such as LA, Busan, and France as one joint performance through a network. The joint performance system 1 includes a plurality of player devices 100a, 100b, ..., 100n connected by a network, a server 200, and an output device 300, and includes accompaniment data, individual performance data and joint performance data to be described below. Performance data can be transmitted and received in real time through the network.

The network includes, but is not limited to, a 5G network capable of transmitting accompaniment data converted into a digital signal, individual performance data, and joint performance data at high speed and ultra-low latency. The network includes a mobile communication network such as an LTE network that conforms to various communication protocols supporting digital music/video data transmission, the Internet, a public telephone network, and the like.

Each of the plurality of player devices 100a, 100b, ..., 100n generates individual performance data by mixing a sound source of a player who plays a song or musical instrument in accordance with the accompaniment data transmitted from the server 200 with the accompaniment data. Then, each of the plurality of player devices (100a, 100b, ..., 100n) feeds back the generated individual performance data to the server 200 in real time. In this case, the sound source of the performer is not limited to the sound source itself, and may include a performance image including the sound source of the performer.

In Figure 1, the plurality of player devices (100a, 100b, ..., 100n) each may be located at a distance from each other, such as LA, Busan, France where the player is. For example, each of the plurality of player devices 100a, 100b, ..., 100n includes a receiver for receiving accompaniment data, a speaker for transmitting the received accompaniment data to the player, and a player when singing/playing according to the accompaniment data transmitted by the player. A synthesizer that receives a sound source (for example, a song, musical instrument performance, etc.) of may include wealth.

The server 200 streams the joint performance data by mixing a plurality of individual performance data transmitted in real time after synchronization correction. For example, the server 200 may perform a real-time synchronization based on a high-frequency beat included in the accompaniment data, so that individual performances of a plurality of performers at a distance may be broadcast live as one joint performance.

The output device 300 reproduces and outputs the joint performance data transmitted from the server 200 in real time. For example, the output device 300 may include a TV installed in a concert hall, a public place, or a home, a mobile communication terminal, and various display devices connected to a network.

FIG. 2 is a block diagram illustrating the function of the server of FIG. 1 , FIG. 3 is a diagram illustrating a cause of delay in arrival of individual performance data transmitted through a network according to an embodiment, and FIG. 4 is an embodiment according to an embodiment. It is a view for explaining and comparing the arrival delay state of a plurality of individual performance data transmitted through a network, and FIG. 5 is a view for explaining the generation of joint performance data after initial synchronization of a plurality of individual performance data according to an embodiment, 6 is a view for explaining the generation of joint performance data after real-time synchronization of a plurality of individual performance data during a joint performance according to an embodiment.

Referring to FIG. 2 , the server 200 includes a communication unit 210 , an accompaniment generation unit 220 , a synchronization unit 230 , and a sound source synthesis unit 240 .

The communication unit 210 enables wireless communication in a network located between the server 200 and the plurality of player devices 100a, 100b, ..., 100n, and the server 200 and the output device 300 to accompany data and joint performances. It may include modules that can transmit data or receive individual performance data. For example, the communication unit 210 may include a mobile communication module (eg, 5G, LTE, etc.), a wireless Internet module, and a short-range communication module.

The communication unit 210 simultaneously streams the accompaniment data to the plurality of player devices 100a, 100b, ..., 100n through the network when the joint performance starts. The communication unit 210 receives the individual performance data from each of the plurality of player devices 100a, 100b, ..., 100n in real time while the joint performance is in progress and transmits it to the synchronization unit 230 . In addition, the communication unit 210 streams the joint performance data generated by the sound source synthesis unit 240 to the output device 300 while the joint performance is in progress.

The accompaniment generator 220 generates accompaniment data by synthesizing a plurality of high-frequency beats in an accompaniment sound source for a joint performance at a predetermined period. Referring to FIG. 3, the accompaniment generator 220 synthesizes a plurality of high-frequency bits (bit1, bit2, ..., bitN) from the beginning to the end of the accompaniment sound source in a predetermined period (eg, 1 ms) to synthesize the accompaniment data AD: Accompaniment data) can be created.

High-frequency beats are synthesized into the accompaniment data to synchronize a plurality of individual performance data when generating joint performance data. When the joint performance starts, each of the plurality of player devices 100a, 100b, ..., 100n generates individual performance data by mixing the player's sound source with the same accompaniment data AD. Accordingly, if the player's sound sources included in the plurality of individual performance data are mixed by matching the syncs (SYNC) of a plurality of periodically synthesized high-frequency beats, the sound sources of the performers can also achieve a single harmony without delay. For example, the high-frequency beat includes a frequency beat of a 30,000 Hz band that is greater than or equal to an audible frequency (20 to 20,000 Hz), thereby reducing inconvenience to a player who sings or plays an instrument while listening to the accompaniment of the song.

1 and 3, individual performance data (VRF: video recording file) is transmitted to the server 200 in real time due to differences in the network environment and the performance of the plurality of player devices 100a, 100b, ..., 100n In the process, a first delay (①), a second delay (②), and a third delay (③) may occur.

Specifically, the accompaniment generator 220 streams the accompaniment data AD to the plurality of player devices 100a, 100b, ..., 100n simultaneously through the communication unit 210 when the joint performance starts. However, the accompaniment data AD may have different paths reaching each of the plurality of player devices 100a, 100b, ..., 100n, resulting in a first delay (①) according to the network environment. In addition, since the performance or state of each of the plurality of player devices 100a, 100b, ..., 100n is different, a second delay (②) may occur in the process of mixing the player's sound source with the accompaniment data. Thereafter, even in the process in which the individual performance data VRF is transmitted to the server 200 , a third delay (③) may occur depending on the network environment. Therefore, in order to achieve harmony between the sound sources of a plurality of players as one joint performance sound source (concert, chorus, orchestra, etc.), a plurality of individual performance data transmitted in real time from each of the plurality of player devices 100a, 100b, ..., 100n Synchronization is required before mixing (mixing) into one joint performance data.

The synchronization unit 230 performs an initial synchronization correction to synchronize the first high-frequency beats of the plurality of individual performance data. Each of the plurality of individual performance data includes an accompaniment sound source, a high-frequency beat, and a player sound source. The player sound source may include various sound sources such as songs and musical instrument performances of each of the plurality of players.

For example, the synchronization unit 230 temporarily stores a plurality of individual performance data previously received until the last individual performance data constituting the joint performance data is received, and the first high frequency beat of the last individual performance data reached. The sync (SYNC) of the first high-frequency beats of the plurality of individual performance data previously received at (bit1) is matched.

Referring to FIG. 4 , based on the Estimated Time of Arrive (ETA), the first individual performance data (A) is 3ms, the second individual performance data (B) is 12ms, and the third individual performance data (C) ) is assumed to arrive with a delay of 8 ms, and the fourth individual performance data (D) is delayed by 0 ms.

4 and 5, the synchronization unit 230 is the first to fourth individual performance data (A, B, C, D) of the first high-frequency beat ( The first synchronization correction is performed by synchronizing the first high-frequency bits (bit1) of the first, third, and fourth individual performance data (A, C, D) to bit1). For example, the synchronization unit 230 stores the first, third, and fourth individual performance data (A, C, D) in the buffer until the second individual performance data (B) arrives, and the second individual performance data (B) is When the data (B) arrives, the first to fourth individual performance data (A, B, C, D) is synchronized with the first high-frequency bits (bit1) of each to perform the initial synchronization correction.

The synchronization unit 230 repeatedly performs synchronization correction for synchronizing the high-frequency bits of the plurality of individual performance data whenever the period of the high-frequency beat arrives even after the synchronization correction for the first high-frequency beat. For example, the synchronizer 230 temporarily stores a plurality of previously received individual performance data until all of the plurality of individual performance data corresponding to the corresponding time point are received whenever a period of a high-frequency beat arrives, and finally Synchronize the high-frequency beats of the plurality of individual performance data that have already been received with the high-frequency beats of the individual performance data that have reached .

Referring to FIG. 6 , after synchronization correction corresponding to the first high frequency bit bit1 to the third high frequency bit bit3 is performed, for example, first to second high frequency bits corresponding to the fourth high frequency bit bit4 are performed. It is assumed that the fourth individual performance data D among the 4 individual performance data A, B, C, and D arrives at the end with a predetermined time delay. The synchronization unit 230 temporarily stores the first, second, and third individual performance data (A, B, C) corresponding to the fourth high-frequency beat (bit4), and the time when the fourth individual performance data (D) arrives Sync (SYNC) of the fourth high frequency bit (bit4) to perform real-time synchronization correction.

The sound source synthesizing unit 240 generates joint performance data by mixing a plurality of individual performance data corresponding to the high-frequency beat at the time based on the synchronized high-frequency beats. For example, the sound source synthesizing unit 240 receives a plurality of individual performance data in which the high-frequency beats are synchronized in real time from the synchronizer 230, and based on the synchronized high-frequency beat, a plurality of individual performance data included in the plurality of individual performance data are synchronized. It creates joint performance data in real time by mixing the performer's sound source.

Referring to FIG. 5 , the sound source synthesizer 240 is a player sound source included in each of the first to fourth individual performance data A, B, C, and D corresponding to the first to fourth individual performance data A, B, C, D based on the synchronized first high-frequency bits bit1 by mixing to create Joint Performance Data (JPD). Referring to FIG. 6 , the sound source synthesizer 240 is a player included in each of the first to fourth individual performance data (A, B, C, D) corresponding to the synchronized fourth high-frequency bits (bit4). By mixing sound sources, joint performance data (JPD) is generated in real time. Then, sound sources of a plurality of players from the beginning to the end of the joint performance may be broadcast in harmony as one joint performance sound source without delay.

7 is a flowchart illustrating a network-based joint performance method according to an embodiment.

The server 200 is connected to a plurality of player devices (100a, 100b, ..., 100n) and the output device 300 through a network to transmit and receive various data in real time. The network includes, but is not limited to, a 5G network capable of transmitting accompaniment data converted into a digital signal, individual performance data, and joint performance data at high speed and ultra-low latency. The network includes a mobile communication network such as an LTE network that conforms to various communication protocol standards supporting digital music/video data transmission, the Internet, and a public telephone network.

Referring to FIG. 7 , first, when a joint performance starts, the server 200 simultaneously streams accompaniment data to a plurality of player devices 100a, 100b, ..., 100n through a network (S100).

In step S100, the server 200 generates accompaniment data for the joint performance by synthesizing a plurality of high-frequency beats at a predetermined period in the accompaniment sound source for the joint performance. Referring to FIG. 3 , the server 200 may generate accompaniment data (AD) by synthesizing a plurality of high-frequency bits from the beginning to the end of the accompaniment sound source at a predetermined period (eg, 1 ms). For example, the high-frequency beat includes a frequency beat of a 30,000 Hz band that is greater than or equal to an audible frequency (20 to 20,000 Hz), thereby reducing inconvenience to a player who sings or plays an instrument while listening to the accompaniment of the song.

In step S100, the server 200 simultaneously streams the accompaniment data to the plurality of player devices 100a, 100b, ..., 100n through the network when the joint performance starts. At this time, each of the plurality of player devices 100a, 100b, ..., 100n generates individual performance data by mixing the player's sound source with the accompaniment data AD, and feeds back the generated individual performance data to the server 200 in real time. . Since distant players play a song or musical instrument according to the sound source of the same accompaniment data AD, the sound sources of a plurality of players included in the individual performance data form harmony at a point corresponding to the high-frequency beat.

Next, the server 200 receives a plurality of individual performance data from each of the plurality of player devices (100a, 100b, ..., 100n) in real time through the network (S110). Each of the plurality of individual performance data includes an accompaniment sound source, a high-frequency beat, and each player sound source. The player sound source may include a sound source such as a song or musical instrument performance of each of a plurality of players.

1 and 3, individual performance data (VRF: video recording file) is transmitted to the server 200 in real time due to differences in the network environment and the performance of the plurality of player devices 100a, 100b, ..., 100n In the process, a first delay (①), a second delay (②), and a third delay (③) may occur.

Specifically, the server 200 simultaneously streams the accompaniment data AD through the communication unit 210 to the plurality of player devices 100a, 100b, ..., 100n when the joint performance starts. However, the accompaniment data AD may have different paths reaching each of the plurality of player devices 100a, 100b, ..., 100n, resulting in a first delay (①) according to the network environment. In addition, since the performance or state of each of the plurality of player devices 100a, 100b, ..., 100n is different, a second delay (②) may occur in the process of mixing the player's sound source with the accompaniment data. Thereafter, even in the process in which the individual performance data VRF is transmitted to the server 200 , a third delay (③) may occur depending on the network environment. Therefore, in order to achieve harmony between the sound sources of a plurality of players as one joint performance sound source (concert, chorus, orchestra, etc.), a plurality of individual performance data transmitted in real time from each of the plurality of player devices 100a, 100b, ..., 100n Synchronization is required before mixing (mixing) into one joint performance data.

Next, the server 200 determines whether the synchronization of the high-frequency beats included in the plurality of individual performance data matches each time the high-frequency beat cycle arrives ( S120 ).

Next, if the synchronization of the high-frequency beats does not match (S120, No), the server 200 performs synchronization correction by synchronizing the high-frequency bits of the plurality of individual performance data (S130).

For example, the server 200 temporarily stores a plurality of previously received individual performance data until the last individual performance data constituting the joint performance data is received, and stores the first high-frequency bit of the last individual performance data. Synchronization correction may be performed by matching the first high-frequency beats of the plurality of individual performance data received in advance.

The server 200 may repeatedly perform synchronization correction for synchronizing the high-frequency bits of a plurality of individual performance data whenever the period of the high-frequency beat arrives, even after the synchronization correction for the first high-frequency beat. For example, the synchronization unit 230 temporarily stores a plurality of individual performance data previously received until all of the plurality of individual performance data corresponding to the corresponding time point are received whenever a period of a high-frequency beat arrives, and finally Synchronize the high-frequency beats of the plurality of individual performance data that have already been received with the high-frequency beats of the individual performance data that have reached .

Next, if the synchronization of the high-frequency beats coincide (S120, Yes) or synchronization correction is performed in step S130, the server 200, based on the synchronized high-frequency beats, a plurality of players included in the individual performance data. The joint performance data is generated in real time by mixing the sound source, and the generated joint performance data is streamed to the output device 300 (140).

Next, the server 200 determines whether the reception of individual performance data from the plurality of player devices 100a, 100b, ..., 100n is finished (S150).

When the reception of the individual performance data is finished (S150, Yes), the server 200 stops streaming the joint performance data to the output device 300 . If the reception of the individual performance data is not finished (S150, No), the server 200 repeats from step S120 whenever the period of the high-frequency beat arrives.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements by those of ordinary skill in the art to which the present invention pertains are also rights of the present invention. belong to the scope

Claims (10)

A server that provides a joint performance of a plurality of player devices connected through a network,
A communication unit that receives, in real time, individual performance data in which an accompaniment sound source, a high-frequency beat, and a player sound source are synthesized from each of the plurality of player devices through a network;
A synchronization unit for performing synchronization correction by synchronizing the high-frequency beats included in each of the received plurality of individual performance data, and
and a sound source synthesizing unit for generating joint performance data by mixing the plurality of player sound sources included in the plurality of individual performance data based on the synchronized high-frequency bits,
The high-frequency bit includes a frequency bit of an inaudible frequency band,
server. According to claim 1,
Further comprising an accompaniment generator for generating accompaniment data by synthesizing a plurality of the high-frequency beats with the accompaniment sound source at a predetermined period,
The communication unit,
Streaming the accompaniment data to the plurality of player devices simultaneously when the joint performance starts,
server. According to claim 1,
The communication unit,
Streaming the joint performance data generated by the sound source synthesis unit to an output device,
server. 4. The method of claim 3,
The synchronization unit,
Whenever the period of the high-frequency bits arrives, real-time synchronization correction is performed by synchronizing the high-frequency bits corresponding to the corresponding time point,
server. 5. The method of claim 4,
The synchronization unit,
Until all of the plurality of individual performance data constituting the joint performance data are received, the previously received plurality of individual performance data is temporarily stored, and the plurality of previously received individual performance data is added to the high-frequency beat included in the last reached individual performance data. Synchronization correction is performed by synchronizing high-frequency beats included in individual performance data.
server. A method in which a server provides a joint performance of a plurality of player devices connected through a network, the method comprising:
generating accompaniment data by synthesizing a plurality of high-frequency beats with an accompaniment sound source at a predetermined period;
simultaneously streaming the accompaniment data to the plurality of player devices through the network when the joint performance starts;
Receiving in real time individual performance data in which a player sound source is synthesized with the accompaniment data from each of the plurality of player devices through the network;
determining whether synchronization of high-frequency beats included in the received plurality of individual performance data matches;
performing synchronization correction by synchronizing the high-frequency beats included in each of the plurality of individual performance data according to the determination result; and
Comprising the step of generating joint performance data by mixing the plurality of player sound sources included in the plurality of individual performance data based on the synchronized high-frequency beats,
Way. 7. The method of claim 6,
The high-frequency beat is
comprising a frequency bit of an inaudible frequency band,
Way. 7. The method of claim 6,
The step of performing the synchronization correction comprises:
Until all of the plurality of individual performance data constituting the joint performance data are received, the previously received plurality of individual performance data is temporarily stored, and the plurality of previously received individual performance data is added to the high-frequency beat included in the last reached individual performance data. Synchronization correction is performed by synchronizing high-frequency beats included in individual performance data.
Way. 9. The method of claim 8,
The step of determining whether the synchronization of the high-frequency bits coincides,
Each time the period of the high-frequency beat arrives, it is determined whether the synchronization of the high-frequency bits corresponding to the corresponding time point coincides,
Way. 7. The method of claim 6,
The step of generating the joint performance data includes:
Streaming the generated joint performance data to an output device,
Way.

Images