JP4152990B2 - Communication system and terminal device - Google Patents

Description

The present invention relates to a communication system such as a communication karaoke system for exchanging various data via a communication line using a communication cable such as PSTN or ISDN, or a communication line not using a communication cable such as wireless communication or satellite communication, and a terminal. Relates to the device .

  In a conventional communication system, for example, a communication karaoke system, many kinds of karaoke data including MIDI data, lyrics data, control data, etc. are stored in the center device, and are sent to the terminal device when a new song is registered or in response to a request from the terminal device. The karaoke data is distributed, the terminal device accumulates the karaoke data distributed to a built-in or externally connected storage device (HD), and karaoke music and video based on the corresponding karaoke data according to the user's request Playback is in progress.

In recent years, with the multi-functionalization of such a communication karaoke system, a real voice back chorus function and a training karaoke function have been provided.
The above-mentioned real voice back chorus function is a function for playing back chorus recorded as real voice separately from the karaoke music reproduced with MIDI data. The training karaoke function is separate from the karaoke music reproduced with MIDI data. This function plays the main vocal recorded as a real voice.

  In the case of realizing such a function, the conventional communication karaoke system transmits karaoke data to which voice data (hereinafter referred to as “real voice data”) is added from the center device.

  However, since the amount of real voice data is generally larger than that of MIDI data, the addition of the real voice data increases the amount of karaoke data per song, and the terminal device side storage device (HD ) Increases in capacity and costs increase.

Therefore, conventionally, a real voice of a back chorus or main vocal is recorded, the real voice is sampled and compressed as digital data, karaoke data to which the compressed real voice data is added is stored, and a real voice is recorded based on the karaoke data. There was a karaoke device (for example, see Patent Document 1) that realizes a back chorus function and a training karaoke function.
JP-A-6-289872

  However, in the karaoke apparatus as described above, in order to reduce the data amount of the real voice data, all the real voice data is compressed in the same way, so that the back playback based on the compressed real voice data is performed. There is a possibility that the quality of voice such as chorus may be lowered uniformly, and there is a problem that the utility value of the real voice back chorus function and the training karaoke function is lowered.

  In addition, in order to save the capacity of the storage device on the terminal device side, if measures are taken to limit the number of songs in the karaoke data to which the real voice data is added, the music that allows the user to use the real voice back chorus function and the training karaoke function There is a problem that the number is reduced and the utility value is lowered.

  Furthermore, if the karaoke data to which the real voice data is added is not stored in the storage device but is delivered by a medium such as a CD-ROM, the delivery cost is increased and the response to the new song is delayed.

The present invention has been made in view of the above, an object of the Turkey to suppress the increase in the delivery cost to the cost increase and the terminal device of the storage device capacity of the terminal device side.

In order to achieve the above object, the present invention is a communication system comprising a center device and a terminal device capable of data communication via a communication line, wherein the voice data encoded in the data type is stored in the center device. Voice data storage means for storing data, and voice data transmission means for reading out and transmitting voice data of the data type requested from the terminal device from the voice data stored in the voice data storage means, In the apparatus, a request frequency totaling unit that totals the request frequency of the music data from the user, a data type determination unit that determines a data type of the voice data based on a total result by the request frequency totaling unit, and an existing data type read, whether or not matching the data type determined by the data type determination unit means, if they do not match, the existing Reproduces voice data, means for requesting the audio data of the data type is determined by the data type determination means to said center apparatus in parallel with the reproduction, which is transmitted from the center device based on the request by the unit Audio data receiving means for receiving audio data is provided.

Further, a terminal device capable of data communication with the center device via a communication line, a request frequency totaling unit that totals the request frequency of music data from the user, and a voice based on the total result by the request frequency totaling unit and determining the data type determination means the data type of the data, reads the existing data type, whether or not matching the data type determined by the data type determination unit, if they do not match, the audio data of the existing Means for reproducing and requesting the center device to receive the audio data of the data type determined by the data type determining means in parallel with the reproduction, and the audio data transmitted from the center device based on the request by the means An audio data receiving means for receiving is also provided.
The data type may be classified based on an encoding algorithm.
Furthermore, the data type may be classified based on the sample rate.

According to the communication system of the first aspect of the present invention and the terminal device of the fourth aspect of the present invention, with the configuration as described above, the high-quality music in which a large amount of data is allocated to music frequently requested by the user on the terminal device side It is possible to provide low-quality images that are allocated to a less frequently requested music with less data volume, and without substantially impairing the substantial function when providing real voice to users. The amount of data when accumulating the real voice data distributed from the center device can be saved, and an increase in storage capacity can be suppressed.

Further, according to the communication system of claim 2 and the terminal device of claim 5 of the present invention, the voice data is classified based on the encoding algorithm, and a high-quality compression algorithm is used when the user's request frequency is high. Provides high-quality real voice data that is compressed and assigned a large amount of data, and can transmit real voice data that is compressed with a low-quality compression algorithm and assigned a small amount of data when the required frequency is low .

  Therefore, it is possible to use the real voice back chorus function and the training karaoke function using the real voice data for all the performance music while suppressing the cost of the storage capacity on the terminal device side.

Further, according to the communication system of claim 3 and the terminal device of claim 6 of the present invention, the voice data is classified based on the sample rate, and when the user's request frequency is high, the data amount is high at the high sample rate. It is possible to provide high-quality real voice data assigned to a large amount, and to transmit real voice data assigned a small amount of data at a low sample rate when the request frequency is low.
Therefore, it is possible to use the real voice back chorus function and the training karaoke function using the real voice data for all the performance music while suppressing the cost of the storage capacity on the terminal device side.

The invention according to a communication system and terminal devices can and Turkey to suppress increase and delivery cost to the cost increase and the terminal device of the storage device capacity of the terminal device side.

Hereinafter, the best mode for carrying out the present invention will be specifically described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a communication karaoke system according to an embodiment of the present invention. In this communication karaoke system, a center apparatus 1 and a plurality of communication karaoke terminal apparatuses 2 are connected via an ISDN communication network (ISDN NETWORK) 3 so that data communication is possible.

  The console terminal device 11 of the center device 1 is realized by a microcomputer including a CPU, a ROM, a RAM, and the like. The console terminal device 11 includes a display, a keyboard, a CD reading device, and the like. The console terminal device 11 is connected to the center device body 10 and is connected to the storage device 13. And the operation status of the center apparatus body 10 are monitored.

  The system control unit 12 is realized by a microcomputer including a CPU, a memory, a timer, and the like. The system control unit 12 controls the entire center apparatus body 10 and distributes karaoke data with voice data to the communication karaoke terminal apparatus 2. Perform various processes.

  The storage device 13 is a storage means such as a magnetic disk device that stores various types of programs and karaoke data with real voice data distributed to the communication karaoke terminal device 2 and stores other various data.

The ISDN interface unit 14 includes a network termination circuit, a communication controller, and the like that are connected to each communication karaoke terminal device 2. When communicating with each communication karaoke terminal device 2, layer 1 signal processing of the ISDN communication network 3, D layer 2 signal processing is performed.
The console interface unit 15 is composed of SIO or the like, and performs an interface for data exchange between the console terminal device 11 and the system control unit 12.

On the other hand, the remote controller 21 of the communication karaoke terminal device 2 is a device that enables a user to input operation from a position away from the communication karaoke terminal device 2, and inputs operation information such as a request for karaoke music, Output information in infrared.
The microphone 22 inputs a user's voice.

The speaker 23 outputs karaoke music and the user's voice input from the microphone 22.
The monitor 24 is a display device such as a CRT or LCD that displays a background image and lyrics of karaoke music.

The system control unit 25 is realized by a microcomputer such as a CPU, a memory, and a timer, and controls the communication karaoke terminal device 2 as a whole.
The storage device 26 is a storage unit such as a magnetic disk device that stores various programs and various data such as karaoke data with real voice data distributed from the center device 1.

  The graphic generation unit 27 includes a graphic controller, a D / A converter (RAMDAC), and the like, generates a graphic image of lyric display based on karaoke data and color change of the lyric, and an analog image signal (RGB signal) of the graphic image ) Is output.

The voice decoding unit 28 includes a decoder, a D / A converter, and the like, decodes encoded voice data, and outputs an analog voice signal.
The MIDI playback unit 29 includes a MIDI sound source, a D / A converter, and the like, plays back karaoke music based on the MIDI data in the song data of the karaoke data, and outputs the analog music signal.

  The ISDN interface unit 30 includes a network termination circuit, a communication controller, and the like, and performs layer 1 signal processing of the ISDN communication network 3 and D channel layer 2 signal processing when communicating with the center apparatus 1.

  The user interface unit 31 includes an LCD display, a keypad, an infrared light receiver, and the like, and inputs operation information such as a karaoke music request by a user, and inputs operation information by infrared from the remote controller 21. Various guidance displays are displayed.

  The audio effector unit 32 includes an effector, an amplifier, and the like, performs audio effect processing such as echo and key control on the audio signal input from the microphone 22, and synthesizes the audio signal from the MIDI playback unit 29 and the audio decoding unit 28. Then, it is amplified and output to the speaker 23.

The image composition processing unit 33 includes a superimposer, an NTSC encoder, and the like, and synthesizes the background image and the lyrics based on the image signals from the V-CD drive 34 and the graphic generation unit 27 and outputs the synthesized image to the monitor 24.
The V-CD drive 34 reproduces the video signal of the background video based on the video information recorded on the video CD.

That is, the center apparatus 1, the audio data storage means for storing voice data encoded in the data type of the multiple (types are classified based on the coding algorithm or sample rate), in the speech data storage means It fulfills the function of voice data transmitting means for reading out and transmitting voice data of the data type requested from the communication karaoke terminal device 2 from the stored voice data.

Further, the communication karaoke terminal device 2 calculates a request frequency totaling unit that totals the request frequency of the music data from the user, and a data type determination that determines the data type of the voice data based on the totaling result by the request frequency totaling unit And the current data type are read out, and it is determined whether or not the data type determined by the data type determination unit matches. If not, the current audio data is reproduced, and in parallel with the reproduction, Means for requesting voice data of the data type determined by the data type determination means to the center apparatus 1, voice data receiving means for receiving voice data transmitted from the center apparatus 1 based on a request by the means, and means Voice data storage means for storing the voice data received by the voice data, and voice data for decoding the voice data stored in the means. Decoding means performs the function of the audio reproducing means for reproducing the speech in the decoded speech data by that device.

Next, basic processing in this online karaoke system will be described.
When the user operates the remote control 21 to specify the requested song on the communication karaoke terminal device 2 side, the requested song designation information is sent from the remote controller 21, and the designation information received by the user interface unit 31 is system controlled. The unit 25 is notified.

  The system control unit 25 determines the song number of the requested song based on the notified designation information, reads the karaoke data management table in the storage device 26, and searches for the corresponding song number. In this karaoke data management table, the song number of karaoke data registered in the storage device 26 and the file number of the karaoke data are registered in a list.

If there is karaoke data of the corresponding song number in the search, karaoke music is reproduced based on the karaoke data.
Further, if there is no karaoke data of the corresponding song number in the search, the ISDN interface unit 30 is controlled to make a call to the center device 1 to request distribution of the karaoke data of the song number.

  The center device 1 reads the karaoke data of the song number requested from the communication karaoke terminal device 2 from the storage device 13, and controls the ISDN interface unit 14 to distribute it to the requesting communication karaoke terminal device 2.

  Next, karaoke data distribution processing in this communication karaoke system will be further described. FIG. 2 is a diagram showing a procedure at the time of distribution of karaoke data in this communication karaoke system.

  In the communication karaoke terminal device 2, the system control unit 25 calls the center device 1 through the ISDN communication network 3 by the ISDN interface unit 30 based on an operation from the user.

When the system control unit 12 receives a call from the communication karaoke terminal device 2 to any of the ISDN interface units 14, the center device 1 controls the ISDN interface unit 14 that has called the communication karaoke terminal device. Respond to 2.
When the system control unit 25 confirms the response of the center device 1, the communication karaoke terminal device 2 transmits a data transfer start request message to the center device 1 by the ISDN interface unit 30.

  When the system control unit 12 receives the data transfer start request message from the communication karaoke terminal device 2, the center device 1 first refers to the terminal number in the data transfer start request message and stores it in the storage device 13. The terminal number is checked against the terminal number registered in the terminal management table to check whether the terminal number is registered. By checking the terminal number, it is checked whether or not the transmission source of the data transfer start request message is the data distribution destination communication karaoke terminal device.

  If the system control unit 12 determines that it is registered, the system control unit 12 reads out karaoke data corresponding to the information of the song number, request data type, and real voice data type of the data transfer start request message from the storage device 13, and the ISDN interface unit 14. Is transmitted to the communication karaoke terminal device 2 having the above terminal number.

  When the system control unit 25 of the communication karaoke terminal apparatus 2 completes the reception of the karaoke data from the center apparatus 1, the received karaoke data is filed and stored in the storage device 26, and the karaoke data management table is updated.

Next, basic reproduction processing of karaoke data in the communication karaoke terminal apparatus 2 will be described.
The system control unit 25 of the communication karaoke terminal device 2 extracts the lyric data from the karaoke data, reads out the data corresponding to the lyric data from the font data stored in the storage device 26 in advance, and the graphic generation unit 27 The lyrics image based on the font data is expanded and the lyrics are displayed.

  In parallel with the above processing, the system control unit 25 extracts music data from the karaoke data and measures the MIDI data in the music data to the MIDI playback unit 29 while measuring time based on the timing information in the music data. Is transferred, and the graphic generation unit 27 performs color change of the lyric image and page switching (lyric content update) based on the lyric color change data in the song data.

  Further, in parallel with the above processing, the system control unit 25 extracts the real voice data from the karaoke data, transfers it to the voice decoding unit 28, and executes an output such as a back chorus with a real voice that matches the karaoke music.

  Next, karaoke data creation and registration processing in the center apparatus 1 will be described. The karaoke data is created by an authoring tool (not shown). The authoring tool is a device that has all the functions of a communication karaoke terminal device as well as an input device for MIDI data, an input device for lyric data, and an input device for real voice data. It has a function to perform verification.

  The input device for the real voice data has a function of a voice coder, and is connected to an existing voice reproduction device such as a digital audio tape recorder (DAT), and the real voice signal reproduced by the voice reproduction device is received. It is possible to encode audio data having a plurality of types of data amounts according to a predetermined encoding algorithm or sample rate.

  Karaoke data MIDI data created by the MIDI data input device, lyrics data created by the lyrics data input device, and multiple types of encoded speech data created by the real voice data input device, The karaoke data consisting of is temporarily recorded on a data storage medium such as a CD, and the karaoke data recorded on the data storage medium by the console terminal device 11 is registered in the storage device 13 of the center device body 10.

  When the system control unit 12 of the center apparatus body 10 receives the karaoke data transferred from the console terminal device 11 by the console interface unit 15, the karaoke data is filed and written in the storage device 13, and the karaoke data management table is stored. Update.

FIG. 3 is a diagram showing the structure of the karaoke data.
The karaoke data includes song number 101, song information 102 including information related to the song, such as song name, composer, and songwriter name, font size for displaying lyrics and lyrics, and font type (for example, Lyrics data 103 composed of information such as morning, gothic, etc., and information such as song tempo, MIDI data, timing information when reproducing each MIDI data, lyrics color change and page break timing information It consists of song data 104, encoded voice data 105, and EOF 106 indicating the end code of karaoke data.

Next, the reproduction processing of karaoke data according to the present invention in the communication karaoke terminal apparatus 2 will be described.
First, various tables of the communication karaoke terminal apparatus 2 and messages transmitted to the center apparatus 1 will be described.

FIG. 4 is a diagram illustrating an example of a format of a request frequency management table of the communication karaoke terminal apparatus 2. This request frequency management table is a management table for registering the requested song number requested by the user and the requested date in association with each other.
The system control unit 25 registers the requested song number as the requested song number and the requested date as the requested date in the requested frequency management table. Based on the request frequency management table, the user's request frequency (number of requests) for each song is tabulated.

The request frequency management table may have a ring structure, and a storage capacity sufficient to manage a request history for a predetermined period (for example, the past month) with respect to the usage status (request frequency) may be allocated.
In this embodiment, the request date is registered. However, the request time may also be registered, and the request frequency based on the request date and the request time may be totaled.

FIG. 5 is a diagram showing an example of a format of a data transfer start request message sent from the communication karaoke terminal device 2 to the center device 1.
This data transfer start request message is a message type indicating that it is a data transfer start request message for karaoke data, the terminal number of the communication karaoke terminal device, the song number of the song requested (requested) by the user, the center device 1 Information such as a requested data type indicating the requested data type and a voice data type requested by the center apparatus 1 is stored.

FIG. 6 is a diagram illustrating an example of a format of the real voice data type determination table of the communication karaoke terminal apparatus 2.
This real voice data type determination table is a management table in which a real voice data type number indicating the data type of real voice data requested from the center apparatus 1 is registered for each number of requests (request frequency) of the user. Register in advance. In the figure, an example of the contents of the real voice data for each real voice data type number is shown.

  For example, when the number of requests is 51 or more, the data type “MPEG2 (Layer 2), 48 kHz sample” of the high quality sample rate voice data is assigned with a high quality encoding algorithm, and the high quality is assigned to 11-50. Is assigned with the data type “MPEG2 (Layer 2), 24 kHz sample” of the low-sound rate real voice data at 10 or less. The data type “G.722” is assigned.

FIG. 7 is a diagram showing an example of the format of the real voice data management table of the communication karaoke terminal apparatus 2.
The real voice data management table is a management table for real voice data stored in the storage device 26, and registers a song number corresponding to the real voice data, a data type, and a real voice data storage file number indicating a storage location. .
The system control unit 25 updates the real voice data management table every time the real voice data distributed from the center device 1 is stored in the storage device 26.

FIG. 8 is a flowchart showing the karaoke data reproduction process according to the present invention in the communication karaoke terminal apparatus 2.
The user operates the remote controller 21 to request a song. The operation content of the remote controller 21 is notified to the system control unit 25 via the user interface unit 31.

  The system control unit 25 determines whether or not there is a request from the user (S1). If there is, the system control unit 25 writes the requested song number in the request frequency management table shown in FIG. 4 and updates the content. Along with (S2), the song number is determined from the notified operation content, the karaoke data management table in the storage device 26 is read (S3), and a new song is determined depending on whether or not the corresponding karaoke data exists in the storage device 26. Whether or not (S4).

  In the case of a new song, the system control unit 25 creates a data transfer start request message for requesting karaoke data of the song, calls the center device 1, and transmits it from the center device 1 based on the procedure shown in FIG. The karaoke data is received and stored (S12), the contents of the karaoke data management table and the real voice data management table shown in FIG. 7 are updated (S13), and the karaoke data is reproduced (S11).

  For example, when a data transfer start request message of request data type “00” and real voice data type “03” is transmitted, the center apparatus 1 sends music data (music performance data), lyrics data, data type “MPEG2 (layer 2). ), 48 kHz sample "karaoke data is distributed.

  When it is not a new song, the system control unit 25 searches the request frequency management table to calculate the number of requests for the same song number for the past month (S5), and provides it in advance in the program based on the coefficient result. The real voice data type determination table shown in FIG. 6 is referred to, and the data type of the real voice data corresponding to the number of requests is determined (S6).

  Thereafter, the system control unit 25 reads the real voice data management table shown in FIG. 7 stored in the storage device 26, further reads the current data type (S7), and obtains the total result of the current data type and the number of requests. Based on the matrix type determination table with the data type based on the real voice determined based on the data type of the current real voice data for the song number (the real voice data stored in the storage device 26) and the total result of the request frequency management table It is determined whether the audio data type matches (S8).

If the data types are not the same , the system control unit 25 creates a data transfer start request message and calls the center apparatus 1, and karaoke data (may be only voice data) based on the procedure shown in FIG. ) Is stored in the storage device 26 and updated (S9), the real voice data management table is updated (S10), and the real voice is reproduced together with the karaoke music, the lyrics and the background video (S11). ), This process is terminated.

  In the above processing, when the data type is changed based on the result of the frequency calculation, the real voice data is transmitted immediately. However, in order to avoid a delay in response due to the transmission time, first, the existing real voice voice is transmitted. The voice voice data transmitted from the next request may be used by reproducing the data and transmitting the voice voice data in parallel therewith.

Further, the center device 1 may periodically check the usage frequency of the karaoke data of each communication karaoke terminal device 2 and replace the data type of the voice data whose usage frequency has been changed based on the check result. .
Furthermore, although the data type in the new song is fixed by an instruction from the communication karaoke device 2, it may be selected as appropriate in view of the request frequency assumed on the center device 1 side.

It is a figure which shows the structure of the communication karaoke system of one Embodiment of this invention. It is a figure which shows the basic procedure at the time of delivery of karaoke data in this communication karaoke system shown in FIG. It is a figure which shows an example of the structure of the karaoke data delivered to the communication karaoke terminal device from the center apparatus shown in FIG. It is a figure which shows an example of the format of the request frequency management table of the communication karaoke terminal device shown in FIG.

It is a figure which shows an example of a format of the data transfer start request message sent to the center apparatus from the communication karaoke terminal device shown in FIG. It is a figure which shows an example of the format of the real voice data type determination table of the communication karaoke terminal device shown in FIG. It is a figure which shows an example of the format of the real voice data management table of the communication karaoke terminal device shown in FIG. It is a flowchart which shows the reproduction | regeneration processing of the karaoke data which concerns on this invention in the communication karaoke terminal device shown in FIG.

Explanation of symbols

1: Center device 2: Communication karaoke terminal device 3: ISDN communication network 10: Center device main body 11: Console terminal device 12, 25: System control unit 13, 26: Storage device 14, 30: ISDN interface unit 15: Console interface Face unit 20: Communication karaoke terminal device main body 21: Remote control 22: Microphone 23: Speaker 24: Monitor 27: Graphic generation unit 28: Speech decoding unit 29: MIDI playback unit 31: User interface unit 32: Speech effector unit 33: Image composition processing unit 34: V-CD drive

Claims (6)

A communication system comprising a center device and a terminal device capable of data communication via a communication line,
Audio data storage means for storing audio data encoded in a plurality of data types in the center device, and data types requested by the terminal device from the audio data stored in the audio data storage means Providing voice data transmitting means for reading and transmitting voice data;
The terminal device includes a request frequency totaling unit that totals a request frequency of music data from a user, a data type determination unit that determines a data type of audio data based on a totaling result by the request frequency totaling unit, and existing data The type is read, and it is determined whether or not the data type matches the data type determined by the data type determination unit. If not, the existing audio data is reproduced and in parallel with the reproduction, the data type determination unit A means for requesting voice data of the determined data type to the center apparatus and a voice data receiving means for receiving voice data transmitted from the center apparatus based on a request by the means are provided. Communications system. The communication system according to claim 1, wherein the data type is classified based on an encoding algorithm. The communication system according to claim 1, wherein the data type is classified based on a sample rate. A terminal device capable of data communication with a center device via a communication line,
A request frequency totaling unit that totals a request frequency of music data from a user; a data type determination unit that determines a data type of audio data based on a totaling result by the request frequency totaling unit; It is determined whether or not it matches the data type determined by the data type determining means, and if it does not match, the existing audio data is reproduced and the data type determined by the data type determining means in parallel with the reproduction A terminal device comprising: means for requesting the voice data to the center apparatus; and voice data receiving means for receiving voice data transmitted from the center apparatus based on a request by the means. The terminal device according to claim 4, wherein the data type is classified based on an encoding algorithm. The terminal device according to claim 4, wherein the data type is classified based on a sample rate.

Images