JP4219234B2 - Karaoke system, music performance communication device, and performance synchronization method - Google Patents

Description

  The present invention relates to a duet / choral karaoke control system in multiple locations, and more specifically, duet / choral karaoke control in multiple locations where users at remote locations in multiple locations can share video / audio signals of both spaces. Regarding the method.

  There is a desire for remote karaoke users to exchange each other's songs, videos, etc. over a network.

  In response to these demands, a video / audio distribution service transmission / reception system has already been proposed in which content such as karaoke is provided from an information terminal management server to a large number of information terminals via a network.

For example,
JP-A-2002-366169 is exemplified.

  However, it is difficult to perform duet and choral karaoke among users at remote locations in many locations, and remote users cannot share video / audio signals of both spaces. ) Etc., it was difficult to communicate video / audio signals with each other at many sites. On the other hand, it has been difficult to search for a specific partner using the IP multicast technology that allows video and audio signals to be shared at many sites. For this reason, it has been difficult to realize karaoke duets and choral music.

  Conventionally, when another user sings using the music performance of a user at a remote location, when the sound acquired by the microphone on the other user side reaches the user on the music performance side again, Due to the delay, it is difficult for the user on the music performance side to hear the sound of the original performance and the performance of the remote place, and it is difficult to hear.

  This invention solves the above-mentioned subject, and the invention according to claim 1 is a storage means for storing karaoke data including telop information, a performance means for performing performance using the karaoke data, and The telop display means for extracting telop information from karaoke data and displaying the telop, and the performance means are controlled to advance the performance, and the telop display means is controlled to change the color of the telop according to the progress of the performance. A plurality of music performance communication devices comprising performance progression control means and communication means for connecting to a communication network are connected to the communication network by the communication means, and each of the music performance communication devices connects the communication network. Whether or not the music performance communication device is performing the karaoke data. A first performance monitoring means for judging, a synchronization signal generating means for generating a synchronization signal for synchronizing with the performance of the other music performance communication device when the performance is being performed, and the communication network via the communication network Synchronization signal transmitting means for transmitting the generated synchronization signal to another music performance communication device, and the synchronization signal generating means generates the synchronization signal at the time when the color change of the telop is completed, The synchronization signal transmitting means transmits the generated synchronization signal to the other music performance communication device via the communication network, and the other music performance communication device is transmitted from the one music performance communication device. Synchronization signal receiving means for receiving the synchronization signal, and second performance monitoring means for extracting the current performance position when the synchronization signal is received, further comprising: Performance Progression control means is characterized in that to match the extracted current performance position on the basis of the synchronization signal to the synchronization position.

  As described above, according to the first aspect of the present invention, one music performance communication device generates a synchronization signal at a time when the color change of the telop is completed, and another music performance communication device generates the synchronization signal. Since the current performance position is configured to match the synchronization position based on the tune, it is possible to synchronize the performance at the end time instead of the telop color, that is, the time when the user is not singing, and it is possible to perform duet and chorus without a sense of incongruity There is an effect of becoming.

  In addition, according to the present invention, each user sends a feature information signal from the music performance communication device separately from the video / audio signal in order to mutually register and search duets and choral partners on the communication network, Because it has a communication means that can receive the signal to each other and find the duet partner and choral partner that you want, the user does not need special operation to search for the duet partner, choral partner, Even when the other party has already started singing, it is possible to search for users from other remote locations in the middle of the song according to certain conditions and participate.

  In order to enable duet and choral karaoke at multiple locations in a remote location, the present invention connects a plurality of music performance communication devices and an information management server to a communication network, and allows multiple users at remote locations to It is a karaoke control system that can participate in performance and singing at the same time. For example, by using the present invention, a separate space for singing such as a karaoke box is connected, and conventionally it can only be enjoyed by users in the same box. You can enjoy a duet or chorus with other karaoke boxes or singers at overseas bases.

  The karaoke control system according to the embodiment, as shown in FIG. 1, is an IP multicast using multicast and unicast bridge technology in order to enable duet / choral karaoke at other sites in a remote place which is the main object of the present invention. An information management server 12 is connected to an environmental two-way broadband wireless / wired communication network (Internet, local area network, LAN) 10, and multiple users such as private homes / stores, studios, offices, etc. are connected to the communication network 10. Are connected via a broadband line 16 or the like. In addition, a user's (user) mobile phone, PDA terminal, and the like incorporating a camera / microphone, a speaker, a display, and the like are connected to the communication network 10 via a base station.

FIG. 2 shows the configuration of the music performance communication apparatus 14 to which the present invention is applied. As shown in FIG. 2, the music performance communication device 14 includes a CPU 22, a ROM 24, a RAM 26, an HDD 28, a network interface 30, a video output unit 35, a video capture 38, an audio output unit 41, a sound source unit 42, an audio input unit 45, A remote control input unit 48, a TV monitor 36 in the video output unit 35, a video camera 39 in the video capture 38, a speaker 43 in the audio output unit 41, and a microphone 46 in the audio input unit 45, respectively. The remote controller 49 can be connected to the music performance communication device 14 by connecting.
Accordingly, the music performance communication device 14 exchanges video / audio signal streams, control signals, and the like between the music performance communication devices 14 via the communication network 10 and the broadband line 16.

  In addition, the other music performance communication device 14 is provided in a karaoke box, a private house / store, a studio, an office, or the like.

  FIG. 3 is a functional block diagram showing an embodiment of the present invention. The music performance communication device 14 has video input means 225 for capturing the video of the user. The video input means 225 corresponds to the video camera 39 and the video capture 38 in FIG.

  The video output means 226 for outputting the video of the music performance communication device 14 corresponds to the TV monitor 36 and the video output unit 35. The video stream input / output means 222 has video signal processing and data blocking functions, and is realized by arithmetic processing by the CPU 22, ROM 24 and RAM 26. Further, it has a transmission condition designating unit 220 for controlling the video stream input / output unit 222 and changing the amount of transmission data to be output to the network 10.

  The voice input unit 229 corresponds to the microphone 46 and the voice input unit 45 in FIG. 2 and inputs the user's voice. The sound received by the music performance communication device 14 is output by the sound output means 230 corresponding to the speaker 43 and the sound output unit 41 of FIG. The audio stream input / output means 228 has functions of acoustic signal processing and blocking.

  In order to realize the karaoke function of the music performance communication device 14, the music performance communication device 14 includes karaoke information selection means 202, telop display means 203, performance progress control means 205, and performance means 207. The karaoke information selection means 202 takes out the designated karaoke data from the HDD 28 that stores the karaoke data shown in FIG. The telop display means 203 takes out the telop from the RAM 26 and displays it on the video output means 226. The performance means 207 corresponds to the sound source unit 42 in FIG. 2, performs a performance using karaoke data, and outputs it as a performance sound by the audio output means 230. The performance progress control means 205 controls the telop display means 203 and the performance means 207 in order to realize karaoke performance. Furthermore, it has timing means 201 for managing timing control and time of the entire music performance communication apparatus.

  Further, the music performance communication device 14 has a communication means 238 which is a network interface 30 for connecting to the communication network 10. A video stream signal and an audio signal stream signal for exchanging user's video and audio signals are input to and output from the communication network 10 using the communication unit 238.

  Since each music performance communication device 14 connected to the communication network 10 operates in synchronism, it has a function of synchronizing the performance. The performance monitoring means 209, the synchronization signal generating means 232, the synchronization signal / response signal are provided. The input / output means 235, the synchronization response signal generation means 212, and the synchronization means 211 are configured.

  Furthermore, in the use of each music performance communication device, in order to prevent the user from feeling uncomfortable due to the delay or loss of the signal generated by the communication in the performance or singing video and audio transmission, delay monitoring means 236 and loss rate monitoring means 237.

  Further, a feature information input / output means 214 for selecting and connecting a user who wants to perform a duet or chorus out of a plurality of users who use the music performance communication device 14 connected to a remote place at multiple points, a feature It has information display means 215, feature information management means 216, and feature information transmission / reception means 218.

  The operation of the music performance communication device 14 will be described with reference to FIG. 3, FIG. 1, and FIG. In FIG. 3, the music performance communication device 14 uses the video input / output means 225 to input and output the video of the user who wants to perform a duet or karaoke between users at multiple remote locations. Input and output. The input user image is output to the TV monitor 36 through the image output means 226 as a user image after the CPU 22 performs arithmetic processing. At the same time, the video of the user is converted into a video stream by the video stream input / output means 222 and sent to the communication network 10 via the broadband line 16 by the communication means 238.

  On the other hand, the video stream of another user video sent from the other music performance communication device 14 connected to the communication network 10 to the communication means 238 via the broadband line 16 or the like is converted into a video by the arithmetic processing of the CPU 22. It is displayed by the video output means 226 via the stream input / output means 222.

  In addition, voice such as a user's song is input by the voice input means 229. The input audio is divided into designated blocks by the audio stream input / output means 228 by the arithmetic processing of the CPU 22, and as an audio signal stream via the broadband line 16 by the communication means 238 in the same manner as the video stream. It is sent to the communication network 10.

Also, the other user's acoustic signal stream sent from the other music performance communication device 14 to the communication means 238 via the broadband line 16 is output by the audio stream input / output means 228 by the arithmetic processing of the CPU 22. The sound is output from the speaker 43 via the means 230.
With the above functions, the music performance communication device 14 realizes video / audio sharing of users at remote locations.

The music performance communication device 14 takes out karaoke data from the HDD 28 by the karaoke information selection means 202 as a karaoke device, performs the performance by the performance means 207, and outputs the performance sound by the voice output means 230. At the time of performance, the telop display means 203 takes out telop information from the karaoke data taken out by the karaoke information selection means 202 and displays the telop on the TV monitor 36 through the video output means 226. The performance progress control means 205 controls the performance means 207 to advance the performance, and simultaneously controls the telop display means 203 to change the color of the telop and display it on the video output means 226.
With the above functions, a karaoke function is realized by displaying a telop as the performance progresses and changing the color of the telop.

In addition, the music performance communication device 14 includes a performance monitoring means 209, a synchronization signal generation means 232, and synchronization as synchronization means for synchronizing the performances of the music performance communication devices 14 with each other for comfortable singing. The signal / response signal input means 235 and the synchronization means 211 are provided, and the synchronization signal generated by the synchronization signal generation means 232 based on the information of the performance monitoring means 209 is transmitted via the synchronization signal / response signal input means 235. The data is output from the communication means 238 to the communication network 10 and transmitted to another music performance communication device 14 that is a duet / choral partner.
When the synchronization signal is received from the communication means 238 via the synchronization signal / response signal input means 235, the performance progress control means 205 is controlled by the synchronization means 211 and connected to the communication network 10 for duet / choral. The performance of the music performance communication device 14 performing the synchronization is performed. The time measuring means 201 is used for managing these timings.

  Further, the music performance communication device 14 is provided with a delay monitoring means 236 for minimizing the delay of audio signal streams and data loss generated in the communication network 10 and the broadband line 16 in order to realize a comfortable duet / chorus. A synchronization response signal is generated by using the synchronization response signal generation unit 212 based on the output of the defect rate monitoring unit 237, and the reception status of the acoustic signal stream is determined by the synchronization signal / response signal input / output unit 235 and the communication unit 238. Is transmitted to the other music performance communication device 14 that is transmitting. When a synchronization signal including the reception status of the acoustic signal stream is received via the communication means 238 and the synchronization signal / response signal input / output means 235, the transmission condition designating means 220 is controlled by the synchronization means 211, and the video input means The video information input from 225 is converted into an appropriate block by the video stream input / output means 222, thereby realizing a reduction in the delay and loss rate of the audio signal stream.

  In addition, the music performance communication device 14 includes a feature information input unit 214, a feature information display unit 215, and a feature information management unit 216 for performing duets and chorusing with users at remote locations. The singing partner is determined by communicating with another music performance communication apparatus 14 via the communication means 238 by means 218.

Next, an embodiment of using the music performance communication device 14 will be described with reference to FIGS.
FIG. 6 is an example of a singing screen displayed on the TV monitor 36 when a duet or chorus is performed using the music performance communication device 14, and the music performance communication captured by the video camera 39. The video of the user of the device 14 is displayed as a confirmation video 110 and is sent to the communication network 10 and sent to another music performance communication device 14. In addition, other singer videos received by the other music performance communication device 14 are displayed as a plurality of singer videos 104 together with confirmation videos 110 taken by the video camera 39.

The status display unit 101 displays that the song is being sung, the song information display unit 102 displays the song name and song selection number of the song, and the telop display unit 103 displays the telop necessary for karaoke. To do.
Due to the above display, a video space of a plurality of singers using a plurality of music performance communication devices 14 is shared, thereby enabling a duet or chorusing that does not make many locations conscious of at remote locations.

  FIG. 7 is an example of a wish list screen for searching for a singing partner. As a result of a user (recruiter) registering a song to be sung using the remote controller 49 which is the feature information input means 214, duet or choral Display a list of other users (applicants) who applied for registration. On the singing applicant list screen, an applicant information section 106 where applicants and parts are displayed, an applicant video 105, and the like are displayed.

  A user who uses these screens and FIG. 8 and is connected to the music performance communication device A used by a user (recruiter) searching for a singing partner via the communication network 10 and applies for recruitment of recruiters. The operation of the music performance communication device B used by (the applicant) will be described.

  First, the recruiter inputs the music selection number and part (feature information) of the song to be duet to the music performance communication device 14 by the feature information input means 214. The music performance communication apparatus A retains the characteristic information for a certain period of time and sends the characteristic information signal 1 (recruitment signal) to the communication network 10 via the broadband line 16 by the communication means 238 using the characteristic information transmission / reception means 218. To do.

  When the other music performance communication apparatus B connected to the communication network 10 receives this recruitment signal, the feature information display means 215 sends it to the video output means 226 via the communication means 238 and the feature information transmission / reception means 218. The singing applicant list screen is displayed. The information on the singing applicant list screen displays information on a plurality of applicants (recruiters). This information is discarded and deleted from the screen if there is no application within a certain period of time. The music performance communication device B returns the characteristic information signal 2 (application signal) to the music performance communication device A by inputting the same music selection number and selecting the displayed terminal number for this screen display.

  The music performance communication apparatus A waits for an application signal that is an application for the recruitment signal after sending the recruitment signal, but discards the stored feature information if there is no response for a certain period of time. When an application signal is received within a certain time, a singer application list screen is displayed.

  When the recruiter selects a partner who wants to sing from the application list screen, the music performance communication device A sends a characteristic information signal 3 (establishment signal) to the music performance communication device B and is selected on the singer application screen. Display the mark. The music performance communication device A serves as a master device for transmitting a performance synchronization signal.

When the music performance communication device B receives the establishment signal, the music performance communication device B displays a mark on a display corresponding to the music performance communication device A in the list of singing applicants to indicate that it has been selected. Subsequently, the music performance communication device B sends a time setting signal for setting the time to the music performance communication device A. The music performance communication device A, which is the master device that has received the time setting signal, transmits a time setting confirmation signal including time information to the music performance communication device B.
When the music performance communication device B receives the time setting confirmation signal, the music performance communication device B sends a preparation completion signal indicating that the singing can be started to the music performance communication device A, and the singing preparation is completed.

  When the music performance communication device A receives the preparation completion signal, the music performance communication device A starts a performance for singing and sends a synchronization signal for transmitting the performance start to the music performance communication device B. When the music performance communication device B receives a synchronization signal indicating the start of performance, the music performance communication device B starts performance and synchronizes performance.

  When the performance is started, the music performance communication device A and the music performance communication device B output the video / audio signal stream input by the video camera 39 and the microphone 46 to the TV monitor 36 and the speaker 43 of the other party. Thus, the video and audio of each other singer are shared. During the performance, synchronization signals are also sent at regular intervals to synchronize the performance of the communication device.

When the performance for singing is finished, a performance end signal is sent from the music performance communication device A to the music performance communication device B, so that the performance of the mutual music performance communication is finished and the greeting that the singer greets The screen is replaced for a certain time. On the greeting screen, the video / audio signal streams may be exchanged in the same manner as when singing. When the exchange of the greeting screen is completed, the music performance communication devices A and B are disconnected.
This completes a series of duet operations. In this description, an example of a duet has been described, but the same operation is performed by selecting a plurality of singing applicants even in the case of chorus.

The operation | movement which participates in a song from the middle of a performance is demonstrated using FIG.
The music performance communication device D of the user who desires to sing transmits the characteristic information signal 1 to the communication network 10. When the music performance communication apparatus A connected to the communication network 10 receives the characteristic information signal 1, it checks whether the music performance communication apparatus A has already played a music corresponding to the music selection number included therein. When not being played, the singing applicant list screen is displayed. When already being played (when singing with another music performance communication device), the characteristic information signal 4 is sent to the music performance communication device D. Send.

  The music performance communication apparatus D that has received the characteristic information signal 4 displays information on the music performance communication apparatus A and the like that has returned a response to the transmitted characteristic information signal on the singing applicant list screen. When the user of the music performance communication device D selects a singing partner who is the user of the music performance communication device A, the music performance communication device D sends the characteristic information signal 2 to the music performance communication device A. And send it out.

  An interruption request is displayed on the singing screen of the music performance communication apparatus A, which is a user who is singing, and “replace with the current singing partner” or “sing together” to the displayed interrupting partner. "Cannot sing (reject singing)" can be selected. When the displayed interrupt partner is selected, the characteristic information signal 5 is sent to the music performance communication device D.

  On the screen of the music performance communication device D that has received the characteristic information signal 5, the user of the music performance communication device A indicates that the music performance communication device D wants to sing, and a time setting signal is displayed. Is sent to the music performance communication apparatus A. When the music performance communication device A receives the time setting signal, it sends a time confirmation signal including time information to the music performance communication device D, and sets the time of the music performance communication device D. When the music performance communication device D is ready, the music performance communication device D sends a preparation completion signal to the music performance communication device A and receives the video / audio signal stream of the music performance communication device A.

The music performance communication apparatus A used by the user who is singing does not generate a synchronization signal after receiving the preparation completion signal until a synchronization signal generation position which is a performance break position.
Thereby, on the music performance communication device D side, since the singing is not started until the synchronization signal is received, the participation in the singing is after the reception of the synchronization signal, so that participation without a sense of incongruity becomes possible.
The subsequent operation is the same as in FIG.

  FIG. 4 is a flowchart of a process using a synchronization signal system in which a performance start time and an ongoing performance position are synchronized with each other in order to allow a plurality of users at a remote location to perform, perform chorus, and duet simultaneously. It is. The process in which the music performance communication apparatus A and the music performance communication apparatus B synchronize performances at remote locations will be described with reference to FIG.

  In the music performance communication apparatuses A and B, each means shown in FIG. 3 such as the performance monitoring means 209 is stored in the storage means (ROM 24, RAM 26, HDD 28, etc.). First, it is determined whether or not the music performance is started using the performance monitoring means 209 (S150). If the performance is started, the synchronization signal generating means 232, the synchronization signal / response signal input are input to the music performance communication apparatus B. The output means 235 is used to transmit a synchronization signal informing the start of performance (S151). If it is not at the start of performance, it is determined whether the performance is currently being performed (S130). If it is determined in step S130 that the performance is not being performed, the process ends, and the state determination in step S150 is performed again. In step S130, if the performance is being performed, the synchronization position is extracted from the performance monitoring unit 209 (S132), and the synchronization signal is transmitted by the synchronization signal generation unit 232 and the synchronization signal / response signal input / output unit 235 (S134). Communication of synchronization signals between the music performance communication apparatuses A and B is performed via the network interface 30, the broadband line 16, and the communication network 10 of each music performance communication apparatus.

  After transmitting the synchronization signal in steps S151 and S134, the music performance communication apparatus A waits for a synchronization response signal from the music performance communication apparatus B (S136). When the synchronization response signal is received, the synchronization status is displayed on the screen. (S138) After the processing of the music performance communication apparatus A is once completed, the process again proceeds to the process of the processing S150 of the music performance communication apparatus A. If the synchronization response signal is not received in the process S136 for a certain period of time, the process of the music performance communication apparatus A is once terminated, and then the process again proceeds to the process of the process S150 of the music performance communication apparatus A.

  On the other hand, the music performance communication device B determines whether or not the music is currently being played (S140). If it is determined in step S140 that the performance is not being performed, the state before the performance is recognized, and reception of a synchronization signal from the music performance communication device A is awaited (S155). If the synchronization signal is not received for a certain period of time, the processing of the music performance communication device B ends and returns to the first process S140 again. In the process S155, when the synchronization signal is received, the performance start time is set by the timing means 201 and the performance progress control means 205 (S157), and the performance is started by the performance means 207 (S159).

  Similarly, when it is determined in the process S140 that the performance is being performed, the reception of the synchronization signal from the music performance communication apparatus A is awaited during the performance (S142). When the synchronization signal is not received, the process ends and the process proceeds to the first process S140 of the music performance communication device B again. If a synchronization signal is received in step S142, the performance monitoring means 209 extracts the current performance position (S143). The synchronization means 211 and the performance progress control means 205 adjust the current performance position to the synchronization position (S146), and the synchronization response signal generation means 212 creates a synchronization response signal based on the result, and the synchronization signal / response signal input / output means. Through 235, a synchronization response signal is transmitted to the music performance communication apparatus A (S148). Finally, the synchronization status is displayed on the screen (S149), and the process S140 of the music performance communication device B is performed again.

  A process for detecting the synchronization position by the performance monitoring means 209 will be described with reference to FIG. While the musical performance is being performed by the performance means 207, the telop display means 203 intermittently displays the telop of the lyrics, and the color of the telop changes as the lyrics progress. While the telop is displayed, it is the place where the user is singing. Therefore, the synchronization signal is generated by the synchronization signal generating means 232 at the end time instead of the telop color, so that the performance is performed at the time when the user is not singing. Can be synchronized. Also, users at remote locations can synchronize singing from the start position of the first lyrics after the synchronization signal is generated.

  In FIG. 5, in the karaoke control system of the present invention, it is possible for a plurality of users at a remote location to simultaneously perform, chorus, and duet. A process for giving priority to the delivery of the audio signal stream over the other video signal streams and feature signals will be described so that the communication packet loss ratio) and delay do not increase.

  Each means such as the performance monitoring means shown in FIG. 3 is stored in the storage means (ROM 24, RAM 26, HDD 28) of the music performance communication devices A and B. In order to deliver the audio signal stream with priority over the other video signal streams and feature signals between the music performance communication device A and the music performance communication device B, first, in the music performance communication device A, Whether or not the performance is being performed is performed using the performance monitoring means 209. If it is not playing, the process ends, and it is monitored again using the performance monitoring means 209 whether or not it is playing (S100).

  When the music performance communication apparatus A starts playing, first, a counter for the number of received blocks of streaming video and audio signals is initialized (S101), and a block reception from the music performance communication apparatus B is waited. When there is a block reception from the music performance communication device B (S103), a video / audio signal block reception process is performed (S104), and the number of received blocks is measured (a block number counter is added) (S106). On the other hand, when there is no block reception, a synchronization signal from the music performance communication apparatus B is waited (S107). Here, the signal communication between the music performance communication devices A and B and the transmission and reception of streaming of video and audio signals are performed via the network interface 30, the broadband line 16, and the communication network 10 of each music performance communication device.

  Next, when the music performance communication device A receives the synchronization signal from the music performance communication device B, a synchronization signal reception process is performed (S109). In the synchronization signal reception process, the total number of blocks to be received after sending the previous synchronization signal and the time information in the synchronization signal are extracted from the received synchronization signal. If the synchronization signal is not received, it waits for the block reception in S103 again.

  After the synchronization signal reception process (S109), the music performance communication apparatus A calculates the data loss rate / delay (S111). Here, “data loss rate = number of received blocks / total number of blocks” is defined, and “delay time = time when synchronization signal is received−time information in synchronization signal” is defined.

  As a result of calculation of the defect rate, it is determined whether or not the defect rate exceeds a specified value using the defect rate monitoring means 237 (S113). If the defect rate exceeds the specified value, the synchronization response means 212 is used. Then, the video stream data amount restriction signal (synchronization response signal) is transmitted to the music performance communication apparatus B (S118), and once the process is completed, the process S100 is performed again.

  On the other hand, as a result of the delay calculation, the delay monitoring unit 236 is used to determine whether or not the delay exceeds the specified value (S115). Is transmitted to the music performance communication apparatus B (S118), the process is once completed, and the process S100 is performed again.

  If the loss rate and the delay are less than the specified value, a normal response is made to the music performance communication device B (S116), a synchronization signal is transmitted, and the process S100 is performed again.

  The music performance communication device B first uses the performance monitoring means 209 to determine whether or not it is currently being performed. If it is not playing, the process is ended, and it is monitored again using the performance monitoring means 209 whether or not it is playing (S120).

  When the performance is started, the music performance communication device B transmits a video / sound streaming block to the music performance communication device A (S122). It is determined whether or not a predetermined number of block transmissions have been performed during transmission of video / audio signal streaming blocks (S124). If the predetermined number is reached, synchronization signal generating means 232, synchronization signal / response signal input / output A synchronization signal is transmitted to the music performance communication apparatus A using the means 235 and the communication means 235 (S126).

  As a synchronization response signal for the synchronization signal transmitted from the music performance communication device B, the music performance communication device A sends a normal response or a data amount limit signal of the video stream through the synchronization signal / response signal input / output means 235 and the communication means 238. Then, the music performance communication device B receives the signal (S128).

  It is determined whether or not the received synchronization signal is a normal response signal (S130). If the received response is a normal response, the process ends and the process S120 is performed again. If it is not a normal response signal, it is determined as a data amount restriction signal of the video stream, and the data amount restriction (such as lowering the frame rate) of the video stream is performed by the transmission condition designating unit 220 (S131).

  In this description, the defect rate / delay detection operation is performed using a synchronization signal. However, as another method, the number of blocks and time information at the time of signal transmission are added to each block signal of video and audio signal streaming. By doing so, there is a method for detecting the defect rate / delay.

  In the above, an example of the operation of the system for realizing a duet / chorus in which a plurality of remote users using the music performance communication device 14 connected to the bidirectional broadband communication network has been described. The present invention can be modified and implemented within the scope of the claims.

FIG. 4 is a schematic diagram of a duet / choral karaoke control system in multiple locations according to the present invention. These are block diagrams which show the structure of the music performance communication apparatus in an example of this invention. These are functional block diagrams which show operation | movement of this invention. These are the flowcharts which show the performance synchronization means of this invention. FIG. 5 is a flowchart for calculating and controlling a data loss rate and a delay according to the present invention. These are the expanded block diagrams which show the screen structure during a song. These are the expanded block diagrams which show the selection screen of a singing applicant. These are explanatory drawings showing screen transition and signal transmission / reception in use of the music performance communication device of the present invention. These are explanatory drawings showing screen transition and signal transmission / reception in the participation procedure from the middle of the performance. These are timing diagrams explaining the detection of the synchronization position by the performance monitoring means.

Explanation of symbols

10 communication network;
12 Information management server;
14 Music performance communication device (A, B, C, D);
16 Broadband line

Claims (4)

Storage means for storing karaoke data including telop information;
Performance means for performing performance using the karaoke data;
Telop display means for extracting telop information from the karaoke data and displaying the telop;
A performance progress control means for controlling the performance means to advance the performance, and controlling the telop display means to change the color of the telop in accordance with the progress of the performance;
A communication means for connecting to a communication network;
A plurality of music performance communication devices connected to the communication network by the communication means, and the music performance communication devices communicate with each other via the communication network,
One of the music performance communication devices is:
First performance monitoring means for determining whether or not the karaoke data is being played;
Synchronization signal generating means for generating a synchronization signal for synchronizing with the performance of the other music performance communication device when the performance is in progress;
Synchronization signal transmitting means for transmitting the generated synchronization signal to the other music performance communication device via the communication network;
Further comprising
The synchronization signal generation means generates the synchronization signal at a time when the color change of the telop is completed, and the synchronization signal transmission means transmits the generated synchronization signal to the other music performance communication device via the communication network. Send a signal,
The other music performance communication device is:
Synchronization signal receiving means for receiving the synchronization signal transmitted from the one music performance communication device;
Second performance monitoring means for extracting a current performance position when the synchronization signal is received;
Further comprising
The performance progress control means of the other music performance communication device adjusts the extracted current performance position to the synchronization position based on the synchronization signal. It is the said 1 music performance communication apparatus with which the karaoke system of Claim 1 is equipped,
Music comprising the storage means, the performance means, the telop display means, the performance progress control means, the communication means, the first performance monitoring means, the synchronization signal generation means, and the synchronization signal transmission means Performance communication device. The other music performance communication device provided in the karaoke system according to claim 1,
A music performance communication apparatus comprising the storage means, the performance means, the telop display means, the performance progress control means, the communication means, the synchronization signal reception means, and the second performance monitoring means. Storage means for storing karaoke data including telop information by the storage means ;
Performance means for performing performance using the karaoke data by performance means ;
Telop display means for taking out telop information from the karaoke data by the telop display means and displaying the telop ;
A performance progression control means for advancing the performance by the performance progress control means and changing the color of the telop in accordance with the progress of the performance ,
A communication means connected to the communication network by a communication means ;
A performance synchronization method in a karaoke system in which a plurality of music performance communication devices are connected to the communication network, and the music performance communication devices communicate with each other via the communication network,
The performance synchronization method is
Whether it is playing the karaoke data, and the first performance monitoring step Ru is determined according to one of the musical performance communication device,
A synchronization signal generating step of generating a synchronization signal by the one music performance communication device to synchronize with the performance of the other music performance communication device when the performance is in progress;
A synchronization signal transmitting step which Ru is transmitting the generated synchronization signal to the other music playing communication apparatus through the communication network by the one of the music playing communication device,
Including
In the synchronization signal generation step , the synchronization signal is generated at a time when the color change of the telop is completed, and in the synchronization signal transmission step , the generated synchronization signal is transmitted to the other signal via the communication network. Send to music performance communication device,
Further, the performance synchronization method includes:
A synchronization signal receiving step of Ru is received by the other music playing communication device the synchronization signal transmitted from the one of the music playing communication device,
When the synchronizing signal is received, a second performance monitoring step of Ru current performance position is extracted by the other music playing communication device,
A synchronous alignment step of match to the synchronization position by the other music playing communication unit the extracted current performance position based on the synchronization signal,
Starring Kanade synchronous way to comprising a.