JP2006267835A - Karaoke system and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To transmit lyric data, background image data, etc. from a KARAOKE system to a remote control terminal and to display lyrics and background images, etc. without delay in the remote control terminal by changing display quality in consideration of importance of data according to a communication status. <P>SOLUTION: When communication bandwidth is narrowed down and communication speed is lowered for some reason, the KARAOKE system 1 transmits lyric image data and background data to the remote control terminal 2 by an amount of data suitable for the communication speed by switching from background image data to be transmitted with large bit rate to compressed background image data with smaller bit rate or further thinning the compressed background image data according to the communication speed. Thus, the lyric image data is preferentially transmitted from the KARAOKE system 1 to the remote control terminal 2 and even when the communication speed changes, lyrics are displayed on the remote control terminal 2 without delay. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technique for displaying lyrics and background images and outputting karaoke performances with a remote control terminal in a karaoke system.

  Conventionally, a karaoke system is configured to display lyrics on a display device such as a monitor in accordance with the karaoke performance of the music in the karaoke device, and to display lyrics and background images of the music on the display device such as a liquid crystal monitor in the remote control terminal. It has been known.

  In such a karaoke apparatus, lyrics data and background image data are transmitted from the karaoke apparatus body to the remote control terminal by wireless communication such as wireless LAN. Then, the remote control terminal displays the lyrics and the background image on the display device by streaming processing that simultaneously reproduces while receiving the transmitted data.

  When data is transmitted and received by wireless communication as described above, the communication bandwidth (here, synonymous with communication speed) is the number of remote control terminals that are simultaneously connected to the wireless access point, the wireless access point and the remote control. It changes every moment due to the influence of the distance from the terminal, noise generated from other electronic devices, and the like. That is, when there are many remote control terminals connected to the wireless access point at the same time, when the distance between the wireless access point and the remote control terminal is long, or when noise is generated from other electronic devices, etc. The communication bandwidth may decrease due to the influence. In such a situation, there is a possibility that the communication speed corresponding to the amount of data to be transmitted in order to appropriately display the lyrics and the background image may not be ensured.

On the other hand, Patent Document 1 describes a technique for changing the display quality of each image according to the degree of interest of the user in order to reduce the communication load and display processing load when displaying a plurality of pieces of image information. ing. In other words, an image with a high degree of interest is displayed with a high display quality, and an image with a low degree of interest is displayed with a low display quality, thereby reducing communication load and display processing load.
JP-A-6-324661

  However, the above prior art does not consider the influence of the communication bandwidth that changes every moment according to the communication situation of the network, and is necessary in a situation where the communication bandwidth becomes smaller due to the influence of the communication situation. Communication speed may not be obtained. Therefore, in the case of the karaoke apparatus as described above, there is a possibility that the lyrics and the background image cannot be displayed on the display device of the remote control terminal during the karaoke performance of the music.

  Moreover, in the display of a karaoke apparatus, the lyrics which are indispensable displays for singing and the background image which is not indispensable for singing (can be sung without display) are displayed on the same screen. . In other words, displays having different degrees of importance for singing are displayed on the same screen. In such a case, when the display quality is uniformly reduced in order to reduce the communication load during data transmission, it is essential for singing together with a background image that is not essential for singing (ie, less important). The display quality of the lyrics that are the display (that is, the degree of importance is high) is also lowered uniformly. Alternatively, data transmission may be disabled depending on the influence of the communication status such as the communication bandwidth. In such a case, not only the display quality of the background image is deteriorated, but there is a possibility that the lyrics that should be important for the singing are difficult to see or are not displayed, so that the singing cannot be performed.

  The present invention has been made in view of the above problems, and by changing display quality in consideration of the importance of data in accordance with the communication status, lyrics data, background image data, and the like are transferred from the karaoke device to the remote control terminal. It is an object of the present invention to provide a karaoke system capable of displaying lyrics and background images and the like on a remote control terminal without delay.

  The karaoke system according to claim 1, which has been made in order to solve the above-described problem, extracts lyric image data by thinning out background image data and transmitting the data to a remote control terminal according to the communication speed determined based on the communication status data. Is preferentially transmitted to the remote control terminal.

  Specifically, the karaoke system includes a karaoke apparatus that performs karaoke performance based on performance data of a selected music piece, and a remote controller that receives an instruction from a user and notifies the karaoke apparatus of the received instruction. A terminal, and is configured to allow data communication between the karaoke apparatus and the remote control terminal.

  Among these, the karaoke device includes a lyric image data for displaying a character indicating the lyrics of the music and a color change in which the display color of the character changes from one to the other by a predetermined width, and a background image data for displaying a background image. A karaoke device side communication unit that transmits and receives data between a storage unit that stores data and a remote control side communication unit included in the remote control terminal, and a karaoke device side communication unit that stores lyrics image data and background image data stored in the storage unit And data transmission means for transmitting to the remote control terminal.

  The background image data here refers to, for example, image data for configuring a video as a moving image by continuously displaying a plurality of still images (frames). Specifically, for example, image data having a frame rate of 8 fps in a normal state is used. The lyric image data is obtained by recording a character indicating the lyric and a color change with respect to the character as image data in the same format as the background image data.

  On the other hand, the remote control terminal has a remote control side communication unit that transmits / receives data to / from the karaoke device side communication unit included in the karaoke device, and a remote control side communication unit that transmits lyrics image data and background image data transmitted from the karaoke device side. Communication status data transmission that generates communication status data based on the data reception status received via the data reception means and transmits the communication status data to the karaoke device via the remote control side communication unit Means, a display unit for displaying an image, and a display control unit for displaying the lyrics and the background image indicated by the lyrics image data and the background image data received by the data receiving unit on the display unit.

  Further, the karaoke apparatus determines the communication speed when transmitting the lyrics image data and the background image data by the communication speed determining means for determining the communication speed based on the communication status data transmitted from the remote control terminal side, and the data transmitting means. Based on the communication speed determined by the means, a selection process is performed for selecting background image data with a data amount such that the data amount to be transmitted per unit time is smaller than the determined communication speed as background image data to be transmitted. And at least one of data thinning means for performing thinning processing for thinning background image data to be transmitted at a predetermined rate based on the communication speed determined by the communication speed determining means. Yes.

  The communication status data here includes various information used for estimating the communication speed, such as the amount of received data received by the data receiving means and the required time for each frame of image data. It is data.

  Further, based on the communication speed determined by the communication speed determination means as described above, the background for transmitting the background image data having a data amount such that the data amount to be transmitted per unit time is smaller than the determined communication speed. In order to select as image data, a plurality of background image data with different amounts of data to be transmitted per unit time (also referred to as bit rate) is stored in advance in a storage means, and the background image data to be transmitted is selected from among them. You just have to do it.

  According to the karaoke system of the present invention, according to the communication speed determined based on the communication status data, the background image data such that the amount of data to be transmitted per unit time is smaller than the communication speed is converted into a plurality of backgrounds having different bit rates. The image data is selected from the image data, or the background image data to be transmitted is thinned out, and the background image data and the lyrics image data are transmitted to the remote control terminal. Specifically, when the communication bandwidth is narrowed for some reason and the communication speed is lowered, the background image data to be transmitted is changed from the background image data having a higher bit rate to the background image data having a lower bit rate according to the communication speed. The lyric image data and the background image data are transmitted to the remote control terminal with a data amount corresponding to the communication speed by switching to the above or thinning out the background image data to be transmitted (that is, reducing the amount of data to be transmitted). That is, in a situation where the bandwidth is narrower and the communication speed is slower than usual, the display quality of the background image that is less important for karaoke singing is reduced, and the display quality is lowered for the lyrics that are more important. Can be displayed. Further, depending on the degree of decrease in the communication speed, it is possible to deal with the case where all the background image data is thinned out (that is, the background image data is not transmitted) and only the lyrics image data is transmitted. On the other hand, when the communication bandwidth is widened and the communication speed is recovered until the transmission capacity can be sufficiently secured, the background image data to be transmitted is switched from the one with the low bit rate to the one with the high bit rate, or The background image data may be transmitted to the remote control terminal without being thinned out.

  By doing so, the amount of background image data to be transmitted is reduced according to the communication speed, and the lyrics image data is preferentially transmitted from the karaoke device to the remote control terminal. A background image can be displayed without delay.

  By the way, the communication speed is remarkably lowered by narrowing the communication bandwidth, and there may be a situation in which not only background image data but also lyrics image data cannot be transmitted alone. In preparation for such a situation, the following measures can be taken.

  First, “lyric text data” including text data indicating the lyrics of music and control data for controlling the color change of characters indicated by the text data is stored in the storage means. If the communication speed is significantly reduced and the lyrics image data cannot be transmitted, the data transmission means transmits the lyrics text data to the remote control terminal instead of the lyrics image data.

  The above-mentioned lyrics text data indicates the characters of the lyrics in a text format, and further indicates the color change of the lyrics by control data defining the color change position and time. The lyric text data composed of such text data and control data has a significantly smaller amount of data than the lyric image data showing the character and color change of the lyrics in an image format (generally, several tens to Hundreds of times). Therefore, when the communication speed decreases and the lyrics image data cannot be transmitted, the lyrics display can be continued on the remote control terminal side by transmitting the lyrics text data with a small data amount. However, this lyric text data requires more processing than the lyric image data when the remote control terminal side reproduces an image from the data. As a result, the processing load on the remote control terminal side increases.

  Therefore, in a situation where the communication bandwidth is wide and the communication speed sufficient to transmit the lyrics image data can be secured, if the lyrics image data is transmitted to the remote control terminal, the image is displayed on the remote control terminal side. The processing load can be reduced. On the other hand, when the communication bandwidth is narrow and the communication speed sufficient to transmit the lyrics image data cannot be secured, the transmission speed is significantly reduced by transmitting the lyrics text data to the remote control terminal side. Even so, the lyrics display on the remote control terminal can be continued.

  Further, as a specific example of the thinning process performed by the data thinning unit, a method of extracting frame data for every predetermined time from thinning target data and thinning out other frame data as in the karaoke system according to claim 2 Is mentioned. For example, if the data to be thinned out (background image data or lyrics image data) is 8 fps image data whose frames are switched at intervals of 0.125 seconds by default, every 0.25 seconds (4 fps) depending on the communication speed The thinning process is executed in such a manner that frames are extracted and other frames are thinned out.

In this way, frames can be thinned out at equal intervals, and an image can be displayed as smoothly as possible even if the display quality is reduced.
Further, as in the karaoke system according to claim 3, the data thinning means is configured to extract frame data when the scene changes from the background image data to be thinned, and thin out other frame data. May be. Specifically, scene change flag data is added in advance to frame data in which the scene of the background image (for example, title display, scenery, time, etc.) changes with respect to the background image data stored in the storage means. The data thinning means may extract the frame data to which the scene change flag data is added and thin out other frame data.

  By doing in this way, the background image can be displayed for each scene change by the thinned background image data, and the display emphasizing story development and effects in the background image can be performed.

  Further, as in the karaoke system according to claim 4, the data thinning-out means determines the maximum number of transmittable frames based on the communication speed determined by the communication speed determination means, and according to the determined maximum number of transmittable frames. The frame data may be thinned out from the thinning target data. Specifically, when the maximum number of transmittable frames calculated from the communication speed and the data amount per frame is 7 frames per second, if the thinning-out target data is image data of 8 fps by default, per second One method is to thin out one frame. According to such a data thinning method, if the communication speed is gradually reduced, the number of frames to be transmitted can be gradually reduced according to the communication speed. In a situation where the reduced communication speed gradually recovers, the number of frames to be transmitted is gradually increased according to the communication speed, and finally returned to the default number of transmission frames (for example, 8 fps). Such a flexible response is possible.

  When performing the above-described thinning process, it is desirable to thin out the frame data so that the time intervals between the frame data in the image data after the thinning process are as equal as possible. In this way, even if the display quality is reduced by thinning out the frame data, the image can be displayed as smoothly as possible.

  Incidentally, there is a possibility that the communication status data cannot be transmitted to the karaoke apparatus in a situation where the communication bandwidth is narrowed for some reason and the communication speed is significantly reduced. Moreover, if the communication bandwidth data is occupied by transmitting the communication status data, there is a possibility that the communication bandwidth for transmitting the background image data, the lyrics image data, and the like is insufficient.

  Then, it is good to comprise like the karaoke system of Claim 5. That is, the karaoke device includes a karaoke device side second side communication unit that receives data transmitted from the remote control side second communication unit provided in the remote control terminal, and the remote control terminal includes the karaoke device side second provided in the karaoke device. The remote control side second communication unit for transmitting data to the communication unit is provided, and when the communication status data transmission means determines that the lyrics image data is not received from the karaoke device, the remote control side second communication unit is used. The communication status data is configured to be transmitted to the karaoke apparatus side. Specifically, if the karaoke device side communication unit and the remote control side communication unit communicate, for example, by wireless LAN communication according to the “IEEE 802.11b” standard, the karaoke device side second communication unit and the remote control side second communication For example, the unit may be configured to perform communication by infrared communication based on the “IrDA” (registered trademark) standard.

  The karaoke system of the present invention is configured to preferentially transmit lyrics image data by changing the amount of background image data to be transmitted in accordance with the communication speed. Therefore, the fact that the lyrics image data cannot be received on the remote control terminal side means that the communication bandwidth is narrowed so that even the lyrics image data to be transmitted with priority cannot be transmitted (that is, the communication speed is significantly reduced). Conceivable. In such a situation, by transmitting communication status data to the karaoke device side via the remote control side second communication unit on the remote control terminal side, in a situation where the communication bandwidth is narrowed and the communication speed is significantly reduced, The communication status data can be reliably transmitted to the karaoke apparatus, and the communication bandwidth data is not occupied by transmitting the communication status data.

  Also, in a situation where the communication bandwidth is narrowed for some reason and the communication speed is remarkably reduced, if any data such as background image data, lyrics image data, performance data cannot be transmitted to the remote control terminal, the karaoke device If nothing is displayed on the display unit of the remote control terminal even though the performance has started, there is a risk of misunderstanding of the user such as “the remote control terminal is out of order”.

  Then, you may comprise like the karaoke system of Claim 6. That is, the remote control terminal includes a reception determination unit that determines whether the data reception unit has not received data from the karaoke apparatus side for a predetermined time or more, and has not received data for a predetermined time or more by the reception determination unit. When it is determined, the display control means is configured to display on the display section that data cannot be received or that lyrics cannot be displayed.

  By doing so, in a situation where the communication bandwidth is narrowed and the communication speed is significantly reduced, all data such as background image data, lyrics image data, performance data, etc. cannot be transmitted to the remote control terminal. Even if it exists, it can prevent a user's misunderstanding.

  In addition, as shown in claim 7, the communication speed determining means and the data thinning means or the communication status data transmitting means in the karaoke system according to any one of claims 1 to 6 is for causing a computer to function. It can be realized by the program. In the case of such a program, this program is recorded as a computer-readable recording medium such as FD, MO, DVD-ROM, CD-ROM, hard disk, etc., and is loaded into the computer and started as necessary. Can be used. Alternatively, the program may be written in the ROM or backup RAM, and the ROM or backup RAM may be incorporated into a computer.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a schematic configuration of the karaoke system.
As shown in FIG. 1, the karaoke system is configured such that a karaoke apparatus 1 and a remote control terminal 2 can perform data communication via a network 100.

[Description of configuration of karaoke apparatus 1]
As shown in FIG. 1, the karaoke apparatus 1 includes a control unit 12 that controls the operation of the karaoke apparatus 1 as a whole, an interface unit 14 for connecting the karaoke apparatus 1 to the network 100, performance data, lyrics data, background data, and the like. A hard disk (HDD) 16 for storing content data, a plurality of key switches, an operation unit 18 for performing a song reservation operation, the infrared signal transmitted from the remote control terminal 2 or a mobile phone is converted into an infrared communication standard (IrDA (Registered trademark)) Infrared communication unit 20 for receiving according to (registered trademark), operation processing unit 22 for processing signals from operation unit 18, microphone 26, MIDI for performing performance reproduction based on performance data (MIDI data) stored in HDD 16 Audio of musical composition from digital signal output from sound source 30 and MIDI sound source 30 A sound control unit 24 that generates signals (signals related to sound and sound), amplifies the generated audio signal and the audio signal input from the microphone 26 and outputs the amplified signal to the speaker 28, and a video RAM 32 that temporarily stores image data. A video playback unit 34 that controls playback of video based on the image data stored in the video RAM 32; a video control unit 38 that controls display of video played back by the video playback unit 34; . The control unit 12 and the audio control unit 24 are connected by a USB 40.

  Among these, the HDD 16 stores performance data, lyrics image data and lyrics text data as lyrics data, and background image data and compressed background image data as background data. Here, the performance data refers to information indicating the accompaniment content of the performance music. The lyrics image data is image data for displaying the lyrics of the music on the display unit 36 of the karaoke apparatus 1 or the display unit 58 of the remote control terminal 2. Specifically, the image includes character information indicating the lyrics of the performance music and information indicating so-called color change for changing the display color from one to the other along the accompaniment flow when the characters are displayed. Data configured as information. The lyric text data has a data format different from that of the lyric image data which is image data. The lyric text data indicates the text of the lyric in the text format, and further defines the color change of the lyrics and the position and time of the color change. Indicated by control data. Note that the text data and the text data composed of the control data have a significantly smaller data amount than the lyrics image data indicating the character and color change of the lyrics as image information (generally, several tens to several hundreds). A fraction). However, the amount of processing required for reproducing the image from the data is larger than that for the lyrics image data, and the processing load of the lyrics text data is increased compared to the case of reproducing the lyrics image data.

  The background image data is image data indicating a background image to be displayed together with the lyrics image of the music on the display unit 36 of the karaoke apparatus 1 and the display unit 58 of the remote control terminal 2 when the music is played. The compressed background image data is obtained by reducing the amount of data by compressing the background image data at a higher compression rate (that is, lowering the image quality). In this embodiment, the background image data, the compressed background image data, and the lyrics image data stored in the HDD 16 are MPEG2 format moving image data having a frame rate of 8 fps. The bit rate of each image data in this embodiment is 8 Mbps for background image data, 4 Mbps for compressed background moving image data, and 2 Mbps for lyrics image data, and the bit rate of each data is stored in the HDD 16 as a data table. .

  On the other hand, when performing the karaoke performance of the music corresponding to the performance music notified from the user side, the control unit 12 refers to the lyric data (hereinafter referred to as lyric image data or lyric text data when simply expressed as lyric data). And background data (hereinafter simply referred to as background data, it represents background image data or compressed background image data) are read from the HDD 16 and these data are transmitted to the remote control terminal 2 by the wireless access point 110. It has the function to transmit via.

  In addition, when transmitting data to the remote control terminal 2 via the wireless access point 110, the control unit 12 executes processing for changing the amount of background data and lyrics data to be transmitted according to the communication status in the network 100. It has the function to do. Specifically, the communication speed is calculated based on the communication status data (described later) transmitted from the remote control terminal 2, and the background data to be transmitted is changed from the background image data according to the calculated communication speed. Change to small compressed background image data, further thin out the frame data from the compressed background image data at a predetermined decimation rate according to the communication speed, or change the lyrics data to be transmitted from the lyric image data to lyric text data with a smaller data amount Or change it. A detailed description of these processes will be described later.

  The control unit 12 corresponds to a data transmission unit, a communication speed determination unit, a data selection unit, and a data thinning unit in the claims. The interface unit 14 corresponds to a karaoke device side communication unit. The HDD 16 corresponds to storage means. The infrared communication unit 20 corresponds to the karaoke device side second communication unit.

[Description of configuration of remote control terminal 2]
The remote control terminal 2 has a function of receiving an operation for reserving a song from a user and transmitting the operation signal to the karaoke apparatus 1, and displaying an image based on various data received from the karaoke apparatus 1. It also has a function to perform.

  Specifically, as shown in FIG. 1, the remote control terminal 2 includes a control unit 52 that controls the operation of the entire remote control terminal 2, an infrared communication unit 54 that transmits an infrared signal to the karaoke apparatus 1 according to the infrared communication standard (IrDA), A memory 56 for storing information, a touch panel installed along the display area of the display unit 58, and a plurality of key switches, an operation unit 60 for receiving an operation from a user, and an operation for processing a signal from the operation unit 60 A processing unit 62, a video RAM 64 for temporarily storing image data, a video control unit 66 for controlling display on the display unit 58 of image data stored in the video RAM 64, and a wireless access point 110 connected to the network 100. Wireless LAN standards (for example, IEEE802.11a / b / g standard, HomeRF standard, Bluetooth And a wireless LAN communication unit 68 for performing wireless communication according to specifications, etc.).

Among these, the wireless LAN communication unit 68 can receive the lyrics data and the background data transmitted from the karaoke apparatus 1 via the wireless access point 110.
The control unit 52 has a function of causing the display unit 58 to display the lyrics image and the background image indicated by the lyrics data and the background data received via the wireless LAN communication unit 68, respectively. Further, the control unit 52 generates communication status data based on the reception status when data is received from the karaoke apparatus 1 via the wireless LAN communication unit 68, and this is transmitted to the wireless LAN communication unit 68 or the infrared communication unit 54. Via the karaoke device 1. A detailed description of these processes will be described later.

  The control unit 52 corresponds to data receiving means, communication status data transmitting means, and reception determining means in the claims. The infrared communication unit 54 corresponds to the remote control side second communication unit. The wireless LAN communication unit 68 corresponds to a remote control side communication unit. The control unit 52 and the video control unit 66 correspond to display control means.

[Description of other configurations]
A wireless access point 110 is connected to the network 100 described above. The wireless access point 110 is a radio wave relay for connecting terminals by wireless communication in infrastructure mode, and has a function of performing communication simultaneously with a plurality of terminals. The karaoke device 1 and the remote control terminal 2 can perform data communication via the network 100 by relaying the wireless access point 110, and the lyrics data and background data of the performance music from the karaoke device 1 to the remote control terminal 2. Etc. are transferred by streaming, and the lyrics and background of the music are displayed on the remote control terminal 2.

  Note that a plurality of karaoke apparatuses 1, a data server (not shown), various terminals, and the like can be connected to the network 100. That is, by connecting all karaoke apparatuses, servers, terminals, and the like in the karaoke store to the network 100, a single network can be configured.

[Description of Data Transmission Processing in Karaoke Apparatus 1]
Hereinafter, the process procedure of the data transmission process which the control part 12 of the karaoke apparatus 1 performs is demonstrated based on the flowchart shown in FIG. 2, and FIG. This data transmission process is executed when the lyrics data and background data of the music being played are transmitted from the karaoke apparatus 1 to the remote control terminal 2 during the karaoke performance.

FIG. 2 is a flowchart showing a main process in the data transmission process executed by the control unit 12 of the karaoke apparatus 1.
First, in step 10 (hereinafter simply referred to as S10; the same applies to other steps), whether there is a performance request from the user, that is, whether the music to be played has been selected by the user. Determine whether or not. Here, when it is determined that the music is selected (S10: YES), the karaoke performance of the music is started in the selected order (S20), and the process proceeds to S30. If it is determined in S10 that the music is not selected (S10: NO), the process of S10 is repeated as it is.

  In S30, the background image data and the lyric image data for every one second of the image are read from the HDD 16 in synchronization with the progress of the performance of the music, and the read image data is divided for each frame. Next, the background image data and the lyrics image data divided for each frame are transmitted to the remote control terminal 2 via the interface unit 14 frame by frame (S40). At this time, data indicating the music number of the performance music and the number of times of data transmission in the performance music is added to the head of the data to be transmitted, and the data is transmitted to the remote control terminal 2.

  Next, it is determined whether or not the karaoke performance is completed (S50). If it is determined that the karaoke performance has not ended (S50: NO), it is determined whether communication status data corresponding to the previously transmitted data has been received from the remote control terminal 2 (S60).

  Here, the communication status data will be described. The communication status data is the background image data or lyric image received when the remote control terminal 2 receives the data transmitted from the karaoke apparatus 1 to the remote control terminal 2 via the interface unit 14 in S40 via the wireless LAN communication unit 68. This data is generated on the remote control terminal 2 side based on the data reception status and is transmitted from the remote control terminal 2 to the karaoke apparatus 1. The control unit 12 of the karaoke apparatus 1 calculates a communication speed based on the communication status data (described later). FIG. 7 is a schematic diagram showing specific contents of the communication status data. As shown in FIG. 7, the communication status data includes the number of the song being played (performance song number), the number of times data is transmitted from the karaoke device 1 (the number of times the karaoke device is transmitted), and one time data from the karaoke device 1. This is data consisting of information indicating the amount of data received by the remote control terminal 2 during transmission (the amount of received data per transmission) and the time required to receive each frame (required reception time for each frame).

Returning to the flowchart of FIG. If it is determined in S60 that the communication status data corresponding to the previously transmitted data has been received from the remote control terminal 2 (S60: YES), the communication speed at the time of the previous data transmission is calculated based on the received communication status data. (S90), the process proceeds to S100. Note that the communication speed is calculated by the following equation (1).

Communication speed (bps) = received data amount per transmission (bit) / total time required for each frame (seconds) (1)

On the other hand, when it determines with not having received the communication condition data corresponding to the data transmitted last time in S60 (S60: NO), it transfers to S70. In S70, the lyric image data for one second of the next image is read from the HDD 16, and the read lyric image data is divided for each frame. Then, the lyrics image data divided for each frame is transmitted to the remote control terminal 2 frame by frame via the interface unit 14 (S80), and the process proceeds to S50. As described above, when the communication status data is not received from the remote control terminal 2 (S60: NO), the communication between the karaoke apparatus 1 and the remote control terminal 2 is stagnant for some reason (for example, wireless communication is congested). There seems to be a possibility. Therefore, in such a situation, priority is given only to the lyric image data that is more important and relatively small in amount, without transmitting background image data that is less important for singing and that has a relatively large amount of data. By transmitting the remote control terminal 2, it is possible to maintain only the display of lyrics on the remote control terminal 2 side even in a situation where communication is delayed.

  Next, in S100, the communication speed calculated in S90 is compared with the sum of the data amount (bit rate) per unit time of the background image data and the lyrics image data. At this time, the sum of the bit rates to be compared with the communication speed may be obtained from the data for one second of the image read out next from the HDD 16 and the actual bit rate may be acquired. The total bit rate may be obtained from the table.

  Here, when it is determined that the sum of the bit rates of the background image data and the lyrics image data is equal to or lower than the communication speed (S100: YES), the process proceeds to S30, and the background image for the next image of 1 second passes through S30 and S40. Data and lyrics image data are transmitted to the remote control terminal 2. That is, in this case, since the communication speed is high enough to transmit the background image data and the lyric image data, the background image data and the lyric image data for the next one second are directly sent to the remote control terminal 2. Send.

  On the other hand, if it is determined that the sum of the bit rates of the background image data and the lyric image data is greater than the communication speed (S100: NO), the process proceeds to S110, and the portion corresponding to the background image data for the next one second is displayed. The compressed background image data is read from the HDD 16. That is, in this case, since the communication speed is insufficient to transmit the background image data and the lyrics image data to the remote control terminal 2, instead of the background image data, compressed background image data having a smaller data amount is used for transmission. The amount of data to be transmitted is reduced by using as the data.

  Subsequently, the communication speed calculated in S90 is compared with the total amount of data (bit rate) per unit time of the compressed background image data and the lyrics image data (S120). At this time, as the total bit rate to be compared with the communication speed, the actual bit rate may be acquired from the data for one second of image to be transmitted next read from the HDD 16 or the data of the bit rate described above. The total bit rate may be obtained from the table.

  In S120, when it is determined that the sum of the bit rates of the compressed background image data and the lyrics image data is equal to or lower than the communication speed (S120: YES), the process proceeds to S30, and the next image for one second is passed through S30 and S40. The compressed background image data and the lyrics image data are transmitted to the remote control terminal 2. That is, in this case, since the communication speed is large enough to transmit the compressed background image data and the lyric image data, the compressed background image data and the lyric image data for the next one second are transferred to the remote control terminal 2. Send to.

  On the other hand, when it is determined that the sum of the bit rates of the compressed background image data and the lyrics image data is larger than the communication speed (S120: NO), the process proceeds to S130, and the compression background image data is thinned out. In the thinning process in S130, the data amount is reduced by appropriately thinning frames from the compressed background image data. That is, in this case, since the communication speed is insufficient to transmit the compressed background image data and the lyric image data to the remote control terminal 2, the data capacity of the data to be transmitted is obtained by performing a thinning process on the compressed background image data. To reduce A detailed description of this thinning process will be given later.

  Subsequently, in S140, the communication speed calculated in S90 is compared with the sum of the data amount (bit rate) per unit time of the compressed background image data and the lyric image data subjected to the thinning process. Here, when it is determined that the sum of the bit rates of the compressed background image data and the lyric image data subjected to the thinning processing is equal to or lower than the communication speed (S140: YES), the process proceeds to S30, and the next process is performed through S30 and S40. The compressed background image data and the lyric image data subjected to the thinning process for one second of the image are transmitted to the remote control terminal 2. That is, in this case, since the communication speed is large enough to transmit the compressed background image data and the lyric image data subjected to the thinning process, the compressed background subjected to the thinning process for the next image for 1 second. The image data and the lyric image data are transmitted to the remote control terminal 2.

  On the other hand, when it is determined that the sum of the bit rates of the compressed background image data and the lyric image data thinned out is higher than the communication speed (S140: NO), the process proceeds to S150. Then, the communication speed calculated in S90 is compared with the data amount (bit rate) per unit time using only the lyrics image data (S150). That is, in this case, since the communication speed is insufficient to transmit the compressed background image data and the lyric image data subjected to the thinning process to the remote control terminal 2, the background image data is transmitted preferentially without being transmitted. The data capacity is reduced by switching to the process of transmitting only the lyrics image data to be transmitted.

  In S150, when it is determined that the bit rate of the lyric image data is equal to or lower than the communication speed (S150: YES), the process proceeds to S70, and the lyric image data for one second of the next image is transferred to the remote control terminal 2 through S70 and S80. Send to. That is, in this case, since the communication speed is high enough to transmit the lyric image data, the lyric image data for the next one second is transmitted to the remote control terminal 2.

  On the other hand, if it is determined that the bit rate of the lyric image data is greater than the communication speed (S150: NO), the process proceeds to S160, and the lyric text data of the portion corresponding to the lyric image data for the next one second is read from the HDD 16. The communication speed calculated in step S90 is compared with the bit rate of the read background text data. That is, in this case, since the communication speed is insufficient to transmit the lyrics image data to the remote control terminal 2, the lyrics text data having a smaller data amount is used as the data for transmission instead of the lyrics image data. To reduce the amount of data transmitted.

  In S160, when it is determined that the bit rate of the lyric text data is equal to or lower than the communication speed (S160: YES), the process proceeds to S170, and the lyric text data for the next image of 1 second is transmitted to the remote control terminal 2. That is, in this case, since the communication speed is high enough to transmit the lyric text data, the lyric text data for one second of the next image is transmitted to the remote control terminal 2.

  On the other hand, when it is determined that the bit rate of the lyric text data is higher than the communication speed (S160: NO), the data is not transmitted to the remote control terminal 2 (S180), and the process returns to S50 as it is.

  The control unit 12 repeatedly executes the above-described processes until the karaoke performance is completed. When it is determined in S50 that the karaoke performance is completed (S50: YES), a performance end command is transmitted to the remote control terminal 2. (S190), the data transmission process is terminated.

[Description of Data Transmission / Reception Processing in Remote Control Terminal 2]
Hereinafter, the processing procedure of the data transmission / reception process executed by the control unit 52 of the remote control terminal 2 will be described based on the flowchart shown in FIG. This data transmission / reception process is performed when lyric data and background data are received from the karaoke apparatus 1 in order to display the lyrics and background images of the music being played on the remote control terminal 2 side during karaoke performance by the karaoke apparatus 1. Executed.

FIG. 3 is a flowchart showing data transmission / reception processing executed by the control unit 52 of the remote control terminal 2.
First, in S200, it is determined whether or not a performance request from the user has been made to the karaoke apparatus 1, that is, whether or not the karaoke apparatus 1 has been notified of the music selected by the user. Here, when it is determined that the selected music is notified to the karaoke apparatus 1 (S200: YES), the process proceeds to S210. If it is determined in S200 that the music selection notification is not made (S200: NO), the process of S200 is repeated as it is.

  Next, in S210, it is determined whether or not lyrics image data has been received from the karaoke apparatus 1 via the wireless LAN communication unit 68. If it is determined that the lyrics image data has been received from the karaoke apparatus 1 (S210: YES), the value of the lyrics data identification flag is set to 1 (S220), and the received lyrics image data is written to the video RAM 64 (S230). ).

  Then, it is determined whether background image data is received from the karaoke apparatus 1 via the wireless LAN communication unit 68 (S240). If it is determined that the background image data has been received (S240: YES), the received background image data is written into the video RAM 64 (S250), and the process proceeds to S310. On the other hand, when the background image data is not received (S240: NO), the process proceeds to S310 as it is.

  By the way, when it is determined in S210 that the lyrics image data is not received from the karaoke apparatus 1 (S210: NO), the lyrics data identification flag is set to 0 (S260), and the process proceeds to S270. Here, it is determined whether or not lyrics text data is received from the karaoke apparatus 1 via the wireless LAN communication unit 68 instead of the lyrics image data. When it is determined that the lyrics text data has been received from the karaoke apparatus 1 (S270: YES), the received lyrics text data is converted into screen display lyrics data according to the contents of the data, and the converted screen display lyrics are displayed. Data is written to the video RAM (S280), and the process proceeds to S310.

  On the other hand, when it is determined in S270 that the lyrics text data has not been received from the karaoke apparatus 1 (S270: NO), it is determined whether or not the state in which no data is received has continued for a predetermined time (timeout) ( S290). Here, when it is determined that a time-out has occurred (S290: YES), an error display indicating that data cannot be received (for example, “Lyrics information cannot be displayed”) is displayed on the display unit 58 (S300), and the process proceeds to S340. . If it is determined in S290 that no data has been received for a predetermined time or longer (no timeout) (S290: NO), the process returns to S210.

  In S310, the image data and the like written in the video RAM 64 in each step of S230, S250, and S280 are read. Subsequently, in S320, background image data and lyric data (here, lyric image data or lyric data for screen display) are obtained. Superimpose. Then, the superimposed image data is displayed on the display unit 58 (S330), thereby realizing the lyrics, their color change display and the background image display by the remote control terminal 2.

  Next, the value of the lyrics data identification flag is determined (S340). Here, when the value of the lyric data flag is 1 (S340: YES), that is, when the lyric image data is received in S210, the reception state by the wireless LAN communication unit 68 when the background image data is received. Based on this, communication status data as shown in FIG. 7 is generated, and the generated communication status data is transmitted to the karaoke apparatus 1 via the wireless LAN communication unit 68 (S350). That is, here, the lyrics image data is received via the wireless LAN communication unit 68, so that it can be determined that a communication speed at least capable of transmitting the lyrics image data necessary for singing is secured. . Therefore, if the communication speed that can transmit the lyrics image data is secured, the occupied bandwidth even if the communication status data with a relatively small amount of data is transmitted to the karaoke apparatus 1 via the wireless LAN communication unit 68. Since the width is small, it can be considered that image data can be transmitted.

  On the other hand, when the value of the lyric data flag is 0 (S340: NO), that is, when the lyric image data is not received in S210, based on the reception status by the wireless LAN communication unit 68 when the background image data is received. Then, the communication status data as shown in FIG. 7 is generated, and the generated communication status data is transmitted to the karaoke apparatus 1 via the infrared communication unit 54 (S360). That is, here, the lyrics image data is not received via the wireless LAN communication unit 68 (that is, the lyrics image data is not transmitted from the karaoke apparatus 1 side), so that the lyrics image data necessary for singing cannot be obtained. It can be determined that the communication speed is decreasing. Therefore, the communication status data is reliably transmitted to the karaoke apparatus 1 by using infrared communication having a communication format different from that of the wireless LAN for the lyrics image data, and the communication bandwidth in the wireless LAN communication is not occupied. Can do.

  Next, in S370, it is determined whether a performance end instruction or a display end instruction is received from the karaoke apparatus 1 or input from the user via the operation unit 60. Here, when it is determined that the performance end command or the display end command has not been received (S370: NO), it is determined whether or not five minutes or more have elapsed since the performance start (S380).

  Here, the processing of S370 and S380 will be described. If the communication bandwidth in the wireless LAN communication is narrowed after the music performance starts and the communication speed is remarkably reduced, the remote control terminal 2 cannot receive the performance end command transmitted from the karaoke device 1. . In such a situation, the remote control terminal 2 cannot end the performance state even if the performance of the karaoke apparatus 1 ends. Therefore, in the present embodiment, even when the remote control terminal 2 cannot receive the performance end command in a situation where the communication bandwidth in the wireless LAN communication is narrowed and the communication speed is significantly reduced (NO is selected in S370). The performance state of the remote control terminal 2 can be normally terminated by setting a predetermined timeout time (that is, setting the process of S380 in the program). In general, in the karaoke field, it is preferable that the time-out time is set to 5 minutes, considering that the performance time for one song from the start to the end of karaoke performance is about 5 minutes.

If it is determined in S380 that five minutes or more have not elapsed since the start of the performance (S380: NO), the process returns to S210 and the same process is repeated.
The control unit 52 repeatedly executes each process described above until a performance end command or a display end command is received. When it is determined in S370 that the performance end command or the display end command is received (S370: YES), Alternatively, when it is determined in S380 that 5 minutes or more have elapsed since the start of performance (S380: YES), the data transmission / reception process is terminated.

[Description of thinning process in karaoke apparatus 1]
Hereinafter, the thinning process executed by the control unit 12 of the karaoke apparatus 1 will be described based on the flowcharts shown in FIGS. 4 to 6 and the diagrams shown in FIGS. This thinning-out process is a process executed in S130 in the flowchart of the data transmission process shown in FIG.

(1) FIG. 4 is a flowchart showing the thinning-out process (1) in which frame data is extracted every predetermined time from the thinning target data and other frame data is thinned out.
First, frame data for one second (in this embodiment, 8 frames) of compressed background image data to be thinned is read (S400). Next, frame data every 0.25 seconds is extracted from the read frame data (4 frames), other frame data is thinned out (S410), and the thinning process is terminated.

  FIG. 8 is a diagram schematically showing the processing in S410. As shown in FIG. 8, in this embodiment, the compressed background image data before the thinning process has a frame rate of 8 fps, and the allocation time of each frame is 0.125 seconds. From this data, frame data is extracted from this data, for example, every 0.25 seconds (1, 3, 5, and 7 frames in the example of FIG. 8), and the remaining frames are thinned out. In this way, the amount of data to be transmitted can be reduced by thinning out the frame data from the default compressed background image data.

  The interval for extracting the frame data from the compressed background image data before thinning may be various intervals such as an interval of 0.375 seconds and an interval of 0.5 seconds, in addition to the above-described 0.25 seconds interval. . Further, the interval for extracting the frame data may be appropriately changed according to the communication speed.

  (2) FIG. 5 is a flowchart showing a thinning process (2) in which frame data to which a scene change flag is added is extracted from the thinning target data, and other frame data is thinned out.

  First, frame data for one second (in this embodiment, 8 frames) of compressed background image data to be thinned is read (S500). In this thinning process, a scene change flag is added in advance to a frame corresponding to an image when a scene of the background image changes among frame data of compressed background image data to be thinned.

  Next, the first frame data of the read frame data for one second is set (S510), and it is determined whether or not a scene change flag is added to the set frame data (S520). If it is determined that the scene change flag is added to the frame (S520: YES), the frame data to which the flag is added is extracted (S530), and the process proceeds to S540. On the other hand, when it is determined that the scene change flag is not added to the frame data (S520: NO), the process proceeds to S540 as it is.

  In S540, it is determined whether there is next frame data. If it is determined that there is next frame data (S540: YES), the next frame is set (S550), and the process returns to S520. As described above, after the above process is repeated for all the frame data read in S500, if it is determined in S540 that there is no next frame (S540: NO), the thinning process is terminated.

  FIG. 9 is a diagram schematically showing a state in which frame data to which a scene change flag is added is extracted from the thinning target data, and other frame data is thinned out. As shown in FIG. 9, in the compressed background image data for 1 second (8 frames) before the thinning process, for example, if a scene change flag is added to the first and fourth frames, this scene change is performed by the thinning process. The first and fourth frames to which the flag is added are extracted, and the other frames are thinned out. In this way, the amount of data to be transmitted can be reduced by thinning out the frame data from the default compressed background image data.

  (3) In FIG. 6, the “maximum number of frames that can be transmitted” that is the maximum number of frames that can be transmitted per second is calculated based on the communication speed, and frame data for the maximum number of frames that can be transmitted is extracted from the thinning target data. 10 is a flowchart showing a thinning process (3) for thinning out other frame data.

First, frame data for one second (in this embodiment, 8 frames) of compressed background image data to be thinned is read (S600). Next, the maximum number of transmittable frames is calculated based on the communication speed calculated in S90 of FIG. 2 (S610). Here, the maximum number of transmittable frames is calculated by the following formula (2).

Maximum number of frames that can be transmitted = (communication speed (bps) −bit rate of lyric image data (bps)) / data amount per frame (bit) (2)

In this embodiment, since the bit rate of the compressed background image data is 4.0 Mbps and the frame rate is 8 fps, the data amount per frame is considered to be 0.5 Mbit. The bit rate of the lyrics image data is 2.0 Mbps. For example, if the communication speed calculated in S90 of FIG. 2 is 4.5 Mbps, the maximum number of frames that can be transmitted is 5 frames according to the following equation (3).

(4.5 Mbps-2.0 Mbps) /0.5 Mbit = 5.0 Formula (3)

Next, frame data for the maximum number of transmittable frames is extracted from the thinning target data based on the maximum number of transmittable frames calculated in S610, and other frame data is thinned (S620), and the thinning process is terminated.

  FIG. 10A is a diagram schematically illustrating a state in which frame data corresponding to the maximum number of transmittable frames is extracted from the thinning target data and other frame data is thinned out. FIG. 10A shows a case where the maximum number of transmittable frames is 5.

  As shown in FIG. 10A, the first, second, fourth, fifth and seventh frame data are extracted from the compressed background image data for one second (8 frames) before the thinning process, and the other frames are thinned out. In this way, the amount of data to be transmitted can be reduced by thinning out the frame data from the default compressed background image data.

  When extracting frames from the thinning target data, the frame data is extracted so that the frames are equally spaced as much as possible, so that the images are displayed more smoothly when displayed on the display unit 58 of the remote control terminal 2. Can do. Therefore, as shown in FIG. 10B, the frame number to be extracted for each maximum number of transmittable frames is set so that the frame data is extracted at an interval close to the ideal frame interval according to the maximum number of transmittable frames. It may be stored in advance as a data table.

  As described above, the thinning method (1) to (3) has been described for the thinning process in S130 of FIG. 2, but in the karaoke apparatus 1 of the present embodiment, the thinning process (1) to (3) is thinned. Any of the methods may be adopted. Or you may comprise so that the thinning-out method (1)-(3) can be selected according to a condition.

[effect]
According to the karaoke system of the present embodiment, the following effects can be obtained.
(1) The karaoke apparatus 1 according to the present embodiment, when the communication bandwidth is narrowed for some reason and the communication speed is lowered, the background image data to be transmitted from the background image data having a high bit rate according to the communication speed. By switching to compressed background image data with a low bit rate or further thinning out the compressed background image data, the lyrics image data and the background data are transmitted to the remote control terminal 2 with a data amount corresponding to the communication speed. In this way, the lyric image data can be preferentially transmitted from the karaoke apparatus 1 to the remote control terminal 2, and even when the communication speed is lowered, lyrics having high importance can be displayed without delay on the remote control terminal 2 side. it can.

  (2) In the karaoke apparatus 1 of the present embodiment, in a situation where the communication bandwidth is wide and a communication speed sufficient to transmit the lyric image data can be ensured, the lyric image data with a small load on display processing Is transmitted to the remote control terminal 2, the processing load when displaying an image on the remote control terminal 2 side can be reduced. On the other hand, in a situation where the communication bandwidth is narrow and a communication speed sufficient to transmit the lyric image data cannot be ensured, the lyric text data having a small data amount is transmitted to the remote control terminal 2 side. Even if the situation is significantly lowered, the lyrics display on the remote control terminal 2 side can be continued.

  (3) In the thinning-out process (1) executed by the control unit 12 of the karaoke apparatus 1, frame data is extracted at regular intervals from the thinning target data, and frames are thinned out at equal intervals by thinning out other frame data. Even if the display quality is lowered, the image can be displayed as smoothly as possible.

  (4) In the thinning process (2) executed by the control unit 12 of the karaoke apparatus 1, by extracting frame data corresponding to the image when the scene changes from the thinning target data and thinning out other frame data, The background image can be displayed for each scene change by the thinned compressed background image data, and the display emphasizing the story development and effects in the background image can be performed.

  (5) In the thinning process (3) executed by the control unit 12 of the karaoke apparatus 1, the maximum number of frames that can be transmitted is calculated based on the communication speed, and the frame data is obtained from the thinning target data according to the maximum number of frames that can be transmitted. If the communication speed is gradually reduced by thinning, the number of frames to be transmitted can be gradually reduced according to the communication speed. In a situation where the reduced communication speed gradually recovers, the number of frames to be transmitted is gradually increased according to the communication speed and finally returned to the default number of transmission frames (8 fps). Is possible.

  (6) If the lyrics image data cannot be received on the remote control terminal 2 side due to the reason that the communication is congested and the communication speed decreases, the communication status data is transmitted to the karaoke apparatus 1 via the infrared communication unit 54 on the remote control terminal 2 side. Thus, in a situation where the communication bandwidth is narrowed and the communication speed is significantly reduced, the communication status data can be reliably transmitted to the karaoke apparatus 1, and the communication status data can be transmitted accordingly. The communication band is not occupied.

  (7) When the control unit 52 of the remote control terminal 2 determines that the lyrics data has not been received for a predetermined time or longer, the control unit 52 displays on the display unit 58 that the data cannot be received or the lyrics cannot be displayed. Thus, even in a situation where data cannot be transmitted from the karaoke apparatus 1 to the remote control terminal 2 due to insufficient communication speed, it is possible to prevent misunderstanding of the user.

[Other Embodiments]
Although the embodiments of the present invention have been described above, the embodiments of the present invention are not limited to the above embodiments, and can be implemented in various modes as long as they belong to the technical scope of the present invention. It is.

  For example, it is conceivable that the karaoke apparatus can be configured so that the music piece can be previewed in advance on the remote control terminal side and the lyrics of the music piece and the background image can be displayed before the karaoke performance is started on the karaoke apparatus. In such a configuration, the technical idea of the present invention is used even when performance data, lyric data, and background data of the music are transmitted / reproduced in real time during the trial listening of the music, such as data transmission by streaming. Can do. That is, for example, if the priority of the data to be transmitted is set in the order of performance data, lyrics text data, lyrics image data, and background image data from the highest priority, the performance data is transmitted with the highest priority, and other data depending on the communication status The amount of transmission data can be reduced. Therefore, even if the communication speed between the karaoke device and the remote control terminal decreases, the performance data transmitted with the highest priority can be received on the remote control terminal side, so that the performance can be continued on the remote control terminal side. is there.

It is a block diagram which shows schematic structure of the karaoke system of embodiment. It is a flowchart which shows the data transmission process which the control part 12 of the karaoke apparatus 1 performs. It is a flowchart which shows the data transmission / reception process which the control part 52 of the remote control terminal 2 performs. It is a flowchart which shows the thinning-out process (1) which the control part 12 of the karaoke apparatus 1 performs. It is a flowchart which shows the thinning-out process (2) which the control part 12 of the karaoke apparatus 1 performs. It is a flowchart which shows the thinning-out process (3) which the control part 12 of the karaoke apparatus 1 performs. It is a schematic diagram which shows the specific content of communication condition data. It is explanatory drawing of the thinning-out process (1) which the control part 12 of the karaoke apparatus 1 performs. It is explanatory drawing of the thinning-out process (2) which the control part 12 of the karaoke apparatus 1 performs. It is explanatory drawing of the thinning-out process (3) which the control part 12 of the karaoke apparatus 1 performs.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus, 2 ... Remote control terminal, 12 ... Control part, 14 ... Interface part, 16 ... Hard disk (HDD), 18 ... Operation part, 20 ... Infrared communication part, 22 ... Operation processing part, 24 ... Voice control part, 26 ... Microphone, 28 ... Speaker, 30 ... MIDI sound source, 32 ... Video RAM, 34 ... Video playback unit, 36 ... Display unit, 38 ... Video control unit, 40 ... USB, 52 ... Control unit, 54 ... Infrared communication unit, 56 ... Memory, 58 ... Display unit, 60 ... Operation unit, 62 ... Operation processing unit, 64 ... Video RAM, 66 ... Video control unit, 68 ... Wireless LAN communication unit, 100 ... Network, 110 ... Wireless access point

Claims (7)

A karaoke apparatus that performs karaoke performance based on performance data of a selected music piece, and a remote control terminal that has a notification function of receiving an instruction from a user and notifying the received instruction to the karaoke apparatus, A karaoke system configured to be capable of data communication between the remote control terminal and the remote control terminal,
The karaoke device
Storage means for storing lyrics image data for displaying characters indicating the lyrics of the music and color changes in which the display color of the characters changes from one to the other by a predetermined width, and background image data for displaying the background image ,
A karaoke device side communication unit that transmits and receives data to and from a remote control side communication unit provided in the remote control terminal;
Data transmission means for transmitting lyrics image data and background image data stored in the storage means to the remote control terminal via the karaoke device side communication unit,
The remote control terminal is
A remote control side communication section for transmitting and receiving data to and from the karaoke apparatus side communication section provided in the karaoke apparatus;
Data receiving means for receiving lyrics image data and background image data transmitted from the karaoke device side via the remote control side communication unit;
Communication status data transmitting means for generating communication status data based on the reception status of the data received by the data receiving means, and transmitting the communication status data to the karaoke device via the remote control side communication unit;
A display for displaying an image;
Display control means for displaying the lyrics and background image indicated by the lyric image data and background image data received by the data receiving means on the display unit;
Furthermore, the karaoke device
A communication speed determining means for determining a communication speed based on communication status data transmitted from the remote control terminal side;
When the lyric image data and the background image data are transmitted by the data transmission unit, the amount of data to be transmitted per unit time is determined based on the communication rate determined by the communication rate determination unit. Data selection means for executing selection processing for selecting background image data having a data amount that is smaller as background image data to be transmitted, and the background to be transmitted based on the communication speed determined by the communication speed determination means A karaoke system comprising: at least one of data thinning means for performing thinning processing for thinning image data at a predetermined rate. The karaoke system according to claim 1,
The karaoke system characterized in that the data thinning means extracts frame data at regular intervals from thinning target data and thins out other frame data. The karaoke system according to claim 1,
The karaoke system characterized in that the data thinning means extracts frame data when a scene changes from background image data to be thinned, and thins out other frame data. The karaoke system according to claim 1,
The data thinning means determines the maximum number of transmittable frames based on the communication speed determined by the communication speed determination means, and thins out frame data from the thinning target data according to the determined maximum number of transmittable frames. A characteristic karaoke system. The karaoke system according to any one of claims 1 to 4,
The karaoke device includes a karaoke device side second side communication unit that receives data transmitted from the remote control side second communication unit provided in the remote control terminal,
The remote control terminal includes a remote control side second communication unit that transmits data to a karaoke device side second communication unit included in the karaoke device,
The communication status data transmission means transmits the communication status data to the karaoke device side via the remote control side second communication unit when it is determined that the lyrics image data is not received from the karaoke device. A characteristic karaoke system. A karaoke system according to any one of claims 1 to 5,
The remote control terminal is
The data receiving means includes a reception determining means for determining whether or not data has been received from the karaoke apparatus side for a predetermined time or more,
When the reception determining means determines that data has not been received for a predetermined time or more, the display control means displays on the display section that the data cannot be received or that the lyrics cannot be displayed. system.   A program for causing a computer to function as a communication speed determination unit and a data thinning unit or a communication status data transmission unit in the karaoke system according to any one of claims 1 to 6.

Images