JP2011191357A - Karaoke system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a Karaoke system by which Karaoke is enjoyed with a favorite singer any time through a network. <P>SOLUTION: A singing sound of the singer is uploaded beforehand as a sound data (a singing file), together with synchronization information of Karaoke performance. In the synchronization information, at least tempo and volume information in a Karaoke musical piece performed at recording time of the sound data is indicated. The Karaoke device in which the singing file is downloaded reproduces the singing file, while performing Karaoke with the tempo and volume indicated by the synchronization information. By performing synchronized reproduction in this way, Karaoke is enjoyed with the favorite singer any time through a network. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a karaoke system including a karaoke apparatus and a center connected via a network.

  Conventionally, a karaoke system that performs duet singing via a network has been proposed (see, for example, Patent Document 1). In the karaoke system of Patent Document 1, it is possible to refer to a profile of a partner who performs a duet singing, and when a request for a duet song is made, the singing sound of the other party is downloaded in real time, and a duet singing with a favorite partner between remote locations is also possible. Can enjoy.

JP 2005-17736 A

  However, even through the network, if the other party does not exist in front of the karaoke device in real time, he could not enjoy karaoke with his favorite party.

  Then, this invention aims at providing the karaoke system which can enjoy karaoke with a favorite singer anytime via a network.

  The karaoke system of the present invention comprises a server and a karaoke performance terminal connected via a network. The server includes a storage unit that stores voice data of the singer and synchronization information between the singing sound of the singer and the karaoke performance sound. The karaoke performance terminal is configured to download the audio data and the synchronization information from the server, reproduce the audio data, and perform a karaoke performance based on the downloaded synchronization information, and collect sound. Sound collecting means; and sound emitting means for emitting sound based on the sound data reproduced by the performance means and sound collected by the sound collecting means.

  In this way, the singer's singing sound is stored in the server as voice data together with the synchronization information of the karaoke performance sound in advance, and the singer's singing sound can be synchronized with the downloaded karaoke device at any time via the network. You can enjoy karaoke together. For example, if the voice data is a recording of the singing voice of the original singer, a duet song can be performed together with the original singer. In addition to the duet song, it is also possible to have the original singer in charge of the chorus part. If you record your own song in advance, you can enjoy a duet song with yourself.

  Note that the synchronization information describes at least tempo and volume information in the karaoke music piece played at the time of recording the audio data. Therefore, a karaoke performance synchronized with the singing sound is performed regardless of the location and timing of reproduction.

  The audio data may be composed of a plurality of audio data, and the synchronization information may include information indicating the reproduction timing of each of the plurality of audio data. For example, in the case of a duet song, the singer sings a duet part and the time zone for singing is determined in one song, so the song file can be divided into a plurality of songs. In this case, karaoke performance that is synchronized with the singing sound can be performed by recording information indicating the passage of time from the start of performance or delta time in the synchronization information, and reproducing each song file with reference to this information during reproduction. Can do.

  The performance means may include a tempo control means for changing the performance tempo, and the playback speed of the audio data may be changed according to the change of the performance tempo. In this case, the voice signal of the singing sound is divided into time-axis waveforms for each sampling period, a new time-axis waveform is generated by combining a plurality of time-axis waveforms, and a new time-axis waveform is synthesized between the original time-axis waveforms. By inserting the waveform, it is possible to extend the time axis while maintaining the pitch of the singing sound (when the audio data is compressed, the synthesized new time axis waveform is replaced). If an insertion process is performed every other sampling, it can be expanded by a factor of 2 (reproduction speed 1/2), and if an insertion process is performed every other sampling, it can be expanded by a factor of 1.5.

  Further, the download means may download the voice data and the synchronization information from the server when the billing process for the voice data designated by the user is performed. By interlocking with the billing system, incentives can be given to the singer.

  According to this invention, it is possible to enjoy karaoke together with a favorite singer at any time via the network.

It is a block diagram which shows the structure of a karaoke system. It is a block diagram which shows the structure of a karaoke apparatus. It is a figure which shows the structure of various data. It is a block diagram which shows the structure of a center. It is the figure which showed the example of the list of the song files displayed on WEB. It is a flowchart explaining the operation | movement at the time of song file registration. It is a flowchart explaining the operation | movement at the time of a duet delivery.

  FIG. 1 is a diagram showing a configuration of a duet distribution karaoke system. The duet distribution karaoke system includes a center (server) 1 and a plurality of karaoke stores 3 connected via a network 2 such as the Internet. Each karaoke store 3 is provided with a relay device 5 such as a router connected to the network 2 and a plurality of karaoke devices 7 connected to the network 2 via the relay device 5. The relay device 5 is installed in a management room of a karaoke store. A plurality of karaoke apparatuses 7 are installed in each private room (karaoke box).

  The duet distribution karaoke system is to record a voice sung by a certain singer in the karaoke device 7 and upload it to the center 1 as a singing file in advance. Then, the center 1 delivers a singing file from the center 1 in response to a request from each karaoke device 7, and the karaoke device 7 that made the request reproduces the singing file and performs a karaoke performance in synchronization with the singing file. Will sing along with the voice of the singer. Hereinafter, each structure and operation | movement for implement | achieving a duet delivery karaoke system are demonstrated.

  FIG. 2 is a block diagram showing the configuration of the karaoke apparatus. The karaoke apparatus 7 includes a CPU 11 that controls the operation of the entire apparatus, and various components connected to the CPU 11. Connected to the CPU 11 are a RAM 12, HDD 13, network interface (I / F) 14, operation unit 15, A / D converter 17, sound source 18, mixer (effector) 19, decoder 22 such as MPEG, and display processing unit 23. ing.

  The HDD 13 stores music data for playing karaoke music, video data for displaying a background video on the monitor 24, and the like. Video data stores both moving images and still images. In the RAM 12, which is a work memory, an area for reading out the operation program of the CPU 11 and an area for reading out music data for playing karaoke music are set.

  The CPU 11 functionally has a built-in sequencer. The sequencer is a program that reads music data stored in the HDD 13 and executes karaoke performance. As shown in FIG. 3A, the music data includes a header in which a music number is written, a musical sound track in which performance MIDI data is written, a guide melody track in which MIDI data for guide melody is written, It consists of a lyric track in which lyric MIDI data is written, a back chorus playback timing, a chorus track in which audio data to be played back is written, and the like. The sequencer controls the sound source 18 based on the data of the musical tone track and the guide melody track, and generates the musical tone of the karaoke song. The sequencer reproduces the back chorus audio data (encoded data such as MP3 attached to the music data) at the timing designated by the chorus track. Further, the sequencer synthesizes the character pattern of the lyrics in synchronism with the progress of the song based on the lyrics track, converts the character pattern into a video signal, and inputs it to the display processing unit 23.

  The sound source 18 forms a musical sound signal (digital audio signal) according to data (note event data) input from the CPU 11 by processing of the sequencer. The formed tone signal is input to the mixer 19.

  The mixer 19 gives effects such as echo to the musical sound signal generated by the sound source 18, the chorus sound, and the singing voice signal of the singer input from the microphone 16 via the A / D converter 17. Mix the signal.

  Further, the mixer 19 mixes the voice signal generated by the CPU 11 and the singing voice signal of the singer input from the microphone 16 via the A / D converter 17 during the duet distribution operation.

  Each mixed digital audio signal is input to a sound system (SS) 20. The sound system 20 includes a D / A converter and a power amplifier, converts an input digital signal into an analog signal, amplifies it, and emits sound from the speaker 21. The effect that the mixer 19 gives to each audio signal and the balance of mixing are controlled by the CPU 11.

  The CPU 11 reads the video data stored in the HDD 13 and reproduces the background video and the like in synchronism with the generation of musical sounds by the sequencer and the generation of the lyrics telop. The video data of the moving image is encoded in the MPEG format. The CPU 11 inputs the read video data to the decoder 22. The decoder 22 converts the input MPEG data into a video signal and inputs it to the display processing unit 23. In addition to the video signal of the background video, the text processing pattern of the lyrics telop is input to the display processing unit 23. The display processing unit 23 synthesizes a lyrics telop or the like on the video signal of the background video by using the OSD and outputs it to the monitor 24. The monitor 24 displays the video signal input from the display processing unit 23.

  The operation unit 15 includes various key switches provided on the operation panel surface of the karaoke device 7 and a remote controller connected via infrared communication or the like. The operation unit 15 accepts various user operations and provides operation information according to operation modes. Input to the CPU 11. The operation unit 15 receives a request for music, a recording of a singing sound (registration operation), a request for duet distribution, and the like.

  When the singer who wants to release the singing sound performs the singing sound registration operation and the tune designation with the operation unit 15, the CPU 11 performs the karaoke performance of the designated tune, and the A / D converter 17 from the microphone 16. A singing file is generated based on the singer's singing voice signal input via the network I / F 14 and uploaded to the center 1 via the network I / F 14. The singing file is generated as encoded data such as MP3. At this time, CPU11 produces | generates the synchronous information which shows matching of the karaoke song and song file which performed, and uploads with a song file.

  FIG. 3B is a diagram illustrating an example of synchronization information, and FIG. 3C is a diagram illustrating an example of a song file. As shown in FIG. 5B, the synchronization information includes a header, tempo information, volume information (Vol.), And timing information (tempo change amount). The header includes a song number, a song name, a file name of a song file to be associated, and the like. The song number is data in common format with the song number assigned to the song data of each karaoke song (information indicating alphanumeric characters), and the song number designated by the singer at the time of registration operation is transcribed. The tempo information is information indicating the performance tempo of the music designated by the singer during the registration operation, and designates the stepping speed of the sequencer. If the singer does not specify or change the tempo during the registration operation, the standard tempo of the music data is transcribed as it is. The volume information is information indicating the volume of the song specified by the singer during the registration operation (the volume of the music track). The timing information is information indicating the timing of the tempo change (elapsed time from the start of performance) when the singer changes the tempo during singing. By referring to the timing information indicating the tempo change, the performance tempo is changed in the middle of the music during the subsequent reproduction.

  As shown in FIG. 3C, the singing file includes a header and singing voice data. At least the file name is described in the header, and is associated with the header of the synchronization information. If the encoding format is MP3, the header may be recorded as an ID3 tag.

  The synchronization information and the song file as described above are uploaded to the center 1 and can be distributed to each karaoke apparatus 7. In addition, the singer can input his profile, a message, etc. using the operation part 15, and can upload it as singer information.

  When the CPU 11 of the karaoke apparatus 7 reproduces each song file distributed from the center 1, the song data of the designated song number is read with reference to the synchronization information of each song file, and the tempo described in the synchronization information. , Perform karaoke with volume. Thereby, the karaoke performance at the time of recording can be reproduced, and a user can perform a duet song according to the reproduced singing sound and the played musical sound.

  Note that the singing file shown in FIG. 3C is a recording of all voices (voices collected by the microphone 16) from the start to the end of the performance of the karaoke song. In this case, with the start of karaoke performance, synchronized playback can be performed by outputting an audio signal based on the singing file. In particular, in the case of a duet song, the singer performs a duet part singing in one song. Since the time zone for performing singing is limited, as shown in FIG. 3E, it is also possible to divide a song file of one song into a plurality of song files. In this case, as shown in FIG. 3D, as information indicating the reproduction timing of each song file in the synchronization information, information indicating the passage of time from the start of performance, or the delta time between song files (the first song file is The time from the start of performance) is described, and at the time of reproduction, the CPU 11 may reproduce each song file with reference to the timing information of the synchronization information. At this time, the synchronization information may be configured as MIDI data (expansion track of music data) in order to unify the implementation with the music data, and may be in a format readable by the sequencer. In this case, since the singing sound is not recorded during the time period when the singing is not performed, the data capacity of the singing file can be reduced, and the uploading and downloading time can be shortened.

  Next, FIG. 4 is a block diagram showing the configuration of the center 1. The center 1 includes a CPU 31 that controls the operation of the entire center, and various configurations connected to the CPU 31. A RAM 32, HDD 33, and network interface (I / F) 34 are connected to the CPU 31.

  HDD33 has recorded the singing file uploaded from each karaoke apparatus 7, synchronous information, and singer information. The HDD 33 stores an operation program for the CPU 31. The CPU 31 develops the operation program in the RAM 32 and performs various processes.

  For example, the CPU 31 performs reception data processing for recording the song file, synchronization information, and singer information received from each karaoke device 7 via the network I / F 34 in the HDD 33. Moreover, CPU31 produces | generates the HTML file which edits each singer information and displays a list, and performs the WEB display process displayed on the karaoke apparatus 7 as a WEB page.

  FIG. 5 is a diagram showing an example of a list of song files displayed as a WEB page. As shown in the figure, each song file is displayed in a list on the WEB page with items such as a file name (or song number), a song name, a profile entered by the singer during the registration operation, and a message. Also, the popularity (download count) of each song file is displayed. The number of downloads of each singing file is recorded in the HDD 33 and is counted up when each karaoke device 7 is made to download the singing file. When the user selects each item, the list can be sorted in ascending order or descending order. The user of each karaoke apparatus 7 (user who requests duet distribution) can select a singer who performs a duet by referring to this list.

  When the user selects a song file displayed on the WEB page using the karaoke device 7, the CPU 11 makes a request for duet distribution. The request is executed when, for example, information indicating a song file name is transmitted to the center 1. The CPU 31 of the center 1 retrieves and reads the received song file name from the HDD 33 and performs a process of causing the karaoke device 7 to download the corresponding song file and synchronization information.

  At this time, the center 1 may perform charging processing in conjunction with a predetermined charging system. After charging a predetermined amount to the user who made the request, the karaoke device 7 is made to download the song file and the synchronization information. In this case, since the singer can receive a reward every time the singing file is downloaded, it is possible to give an incentive to the singer in conjunction with the billing system.

  The karaoke apparatus 7 that has downloaded the song file and the synchronization information decodes the song file by the CPU 11 and reproduces the song sound. Also, the music data of the music number described in the synchronization information is read, and the performance of the karaoke music is executed by the sequencer according to the tempo and volume information described in the synchronization information. When timing information indicating a tempo change is described, the performance tempo is changed in the middle of the music according to the timing information. The audio signal based on the performance of the karaoke song and the audio signal of the reproduced singing file are simultaneously output to the mixer 19 for synchronous reproduction. The user can perform a duet singing according to the synchronized karaoke performance, and can perform a duet singing with the singer selected on the WEB page.

  Thus, the karaoke system of this embodiment can enjoy karaoke with a favorite singer anytime via a network. For example, if an original singer's voice is recorded as a singing file, a duet singing can be performed together with the original singer. In addition to a duet song, if the singing file is stored as a voice of singing a chorus part, it is possible to have the original singer take charge of the chorus part and enjoy karaoke. When playing back karaoke by playing back chorus attached to music data, it is possible to charge for free, and when playing back chorus sung by the original singer and performing karaoke performance, it is possible to charge. Also, if you record your own song sound in advance, you can enjoy a duet song with yourself.

  The above operation will be described with reference to a flowchart. FIG. 6 is a flowchart showing the operation during the registration operation. FIG. 7 is a flowchart showing the operation during duet distribution.

  First, as shown in FIG. 6, when a singer who wants to release a singing sound performs an operation for registering a singing sound and specifying a song with the operation unit 15, the CPU 11 receives the registration operation (s 11). At this time, the CPU 11 also accepts input of a singer's profile, message, and the like from the operation unit 15.

  When the CPU 11 accepts the registration operation, it reads out the designated music data and performs a karaoke performance (s12), and sings based on the singing voice signal of the singer input from the microphone 16 via the A / D converter 17. A file is generated (s13). Also, synchronization information is generated based on the song number, tempo, volume, etc. of the played song (s14). CPU11 uploads the produced | generated song file and synchronous information to the center 1 when performance of a music is complete | finished (s15). The center 1 records the uploaded song file and the synchronization information in the HDD 33 (s16). In this way, the song file of the singer is registered in the center 1. The CPU 31 of the center 1 updates the HTML file using each singer information of the uploaded song file, and updates the WEB page accessed by the karaoke device 7 (s17).

  Next, as shown in FIG. 7, in order to refer to the list of singers who can perform duet singing, the user who requests duet distribution makes a request to display a song file (s21). This display request is transmitted to the center 1, and the center 1 accepts WEB display (s22). The CPU 31 of the center 1 performs a WEB display process for transferring the HTML file to the karaoke apparatus 7 (s23). The WEB page based on the HTML file transferred from the center 1 is displayed on the monitor 24 of the karaoke apparatus 7 (s24). In this way, the list of singing files shown in FIG. 5 is displayed on the monitor 24 of the karaoke apparatus 7.

  The user selects a singer who performs a duet song by referring to the list of singing files displayed on the monitor 24, and makes a duet song distribution request (s25). The CPU 11 extracts the file name of the song file selected by the user from the HTML file and notifies the center 1 of it. Thereby, a delivery request is received (s26).

  Then, charging processing is performed in the center 1 (or charging server or the like) and the karaoke device 7 (s27, s28), and when the charging processing is completed, the CPU 31 of the center 1 reads the corresponding song file and synchronization information from the HDD 33, and karaoke The device 7 is downloaded (s29). At this time, the CPU 31 of the center 1 counts up the number of downloads of the downloaded song file (s30).

  The CPU 11 of the karaoke apparatus 7 downloads the singing file and the synchronization information from the center 1 (s31), and holds them in the HDD 13 (or RAM 12). And CPU11 encodes a song file and produces | generates the audio | voice signal of the song sound based on a song file. Then, the music data of the music number described in the synchronization information is read from the HDD 13, the music data is sequenced according to the tempo and volume described in the synchronization information, and the sound source 18 is controlled. When timing information indicating a tempo change is described in the synchronization information, the performance tempo is changed at the timing described in the timing information. As a result, the karaoke performance is reproduced with the same tempo and volume as when the singing sound is recorded, and at the same time, the singing sound of the singer is output to perform synchronized reproduction (s32).

  As shown in FIGS. 3 (C) and 3 (D), information indicating the elapsed time from the start of performance as the information indicating the playback timing of each song file in the synchronization information, or the delta time between song files ( When the first singing file describes the time from the start of performance), an audio signal based on each singing file is output along with the music data sequence. When the synchronization information is configured as MIDI data (expansion track of music data), the sequencer can read the MIDI data of the synchronization information and output an audio signal based on each song file.

  When the user operates the operation unit 15 to give an instruction to change the tempo (s33), the CPU 11 performs a karaoke performance at the changed tempo and changes the playback speed of the song file (s34). . In this case, the CPU 11 (or a DSP (not shown)) performs a process of expanding and contracting the audio signal on the time axis while maintaining the pitch of the singing sound. The process of expanding and contracting the audio signal on the time axis while maintaining the pitch of the singing sound is performed as follows, for example.

  That is, the CPU 11 cuts the voice signal of the singing sound based on the singing file into time axis waveforms for each sampling period, and generates a new time axis waveform (intermediate waveform) by combining a plurality of time axis waveforms. The intermediate waveform is generated by cross-fading and synthesizing the preceding and following time axis waveforms. When an intermediate waveform is inserted between the original time axis waveforms, it is possible to extend the time axis while maintaining the pitch of the singing sound. When the audio data is compressed, a process for replacing the intermediate waveform with the original time axis waveform is performed. For example, if an insertion process is performed every other sampling, it can be doubled (reproduction speed 1/2), and if a replacement process is performed, it can be compressed (reproduction speed is doubled). If insertion processing is performed every two samplings, it can be expanded by 1.5 times, and if insertion processing is performed every three samplings, it can be expanded by 1.33 times.

  Further, when the user operates the operation unit 15 to instruct key change, the CPU 11 changes the pitch of the audio signal. The pitch can be changed by resampling the audio signal. Further, the frequency characteristics of the audio signal may be changed.

  Note that the user can also freely set the balance between the singing sound based on the singing file, the musical sound of the music data, and the mixing of the own singing sound using the operation unit 15. That is, since each audio signal is composed of different sources, it is possible to control the volume independently, and it is easy to change the mixing balance in the mixer 16.

  The karaoke apparatus 7 executes the above operation until the music data sequence ends for one song (s35), and ends the operation when the music data is sequenced for one song (s36).

  In the above embodiment, when the distribution request is made, the synchronization information and the singing file are downloaded and stored in the HDD 13 or the RAM 12 of the karaoke apparatus 7 and then the performance is performed. First, only the synchronization information is downloaded. The song file may be stored in the HDD 13 and downloaded as streaming data. Even in this case, synchronized playback can be realized by synchronizing the playback timing of the streaming data with the start timing of the karaoke performance and outputting the song sound of the singer simultaneously with the musical sound.

  In the present embodiment, an example in which a singer performs an operation of registering a singing file using the karaoke device 7 has been described. However, the function of the karaoke device 7 is added to the center 1, and the singing file is stored using the center 1. It can also be configured to register. More simply, it can be realized by using a home PC that realizes the function of the karaoke apparatus 7. In this case, the software of the PC realizes a configuration such as a sequencer and a sound source, and configures a karaoke performance terminal. The duet distribution operation is not limited to the karaoke device 7 and can be realized using a home PC.

DESCRIPTION OF SYMBOLS 1 ... Center 2 ... Network 3 ... Karaoke store 5 ... Relay apparatus 7 ... Karaoke apparatus

Claims (5)

A karaoke system comprising a server and a karaoke performance terminal connected via a network,
The server includes a storage unit that stores voice data of the singer, and synchronization information between the voice data of the singer and the karaoke performance,
The karaoke performance terminal downloads the audio data and the synchronization information from the server;
Performance means for reproducing the audio data and performing a karaoke performance based on the downloaded synchronization information;
Sound collection means for collecting sound;
A karaoke system comprising: sound emitting means for emitting sound based on sound data reproduced by the performance means and sound collected by the sound collecting means.   2. The karaoke system according to claim 1, wherein the synchronization information includes tempo and volume information of a karaoke piece played during recording of the audio data. The audio data consists of a plurality of audio data,
The karaoke system according to claim 1, wherein the synchronization information includes information indicating a reproduction timing of each of the plurality of audio data. The performance means includes tempo control means for changing the performance tempo,
The karaoke system according to any one of claims 1 to 3, wherein a playback speed of audio data is changed in accordance with a change in the performance tempo.   The karaoke system according to any one of claims 1 to 4, wherein the downloading unit downloads the voice data and the synchronization information from the server when a billing process of voice data designated by a user is performed.

Images