JP4108786B2 - A method for receiving and reproducing digital multi-channel broadcast music programs on a karaoke device and displaying lyrics subtitles that change color in sync with the music - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a method for distributing a music program in digital multi-channel broadcasting and a karaoke apparatus for receiving the broadcast, and more specifically, for synchronizing the performance of a program song of a music program and the lyrics image of the karaoke song. The present invention relates to a distribution method and a karaoke apparatus.
[0002]
[Prior art]
Currently, a CS digital multi-channel broadcasting system using a communication satellite (hereinafter referred to as CS) as a relay station is in operation as digital multi-channel broadcasting. Programs broadcast on this system are converted into digital data by a data encoding / compression method defined in MPEG2. In addition to video data and audio data, various data such as time and characters are added to the program as necessary. These data groups are time-axis multiplexed to obtain a bit stream for one program. Further, by bundling a plurality of programs and performing channel multiplexing, it is possible to distribute TV programs of about 4 to 8 channels per transponder. Therefore, 100 channels or more of TV programs and radio programs can be simultaneously delivered by one CS.
Among these channels, there are many channels dedicated to music. Broadcast contents on music-specific channels include concerts, BGM, karaoke, and the like, and these are broadcast on different channels for each genre, etc., so as to respond to various viewer demands from various perspectives.
[0003]
An IRD (Integrated Receiver / Decoder) is prepared to receive such CS digital multi-channel broadcasts and reproduce the video and audio of the program. The IRD reproduces video signals and audio signals of programs by processing broadcast data in broadcast radio waves captured by a parabolic antenna or the like. The video and audio of the program are output by an audio visual (AV) device connected to the audio / video output unit of the IRD.
[0004]
As described above, since CS digital multi-channel broadcasting can be easily auditioned by simply connecting the IRD to the AV device, the CS digital multi-channel broadcasting is performed during a pause period such as between the performance of the requested music at a karaoke venue or the like. Channel broadcast program music can be output as BGM from a speaker of a karaoke device or a display device.
[0005]
Furthermore, the karaoke apparatus synchronizes the accompaniment music and the lyrics image of the karaoke music generated from the karaoke data, and outputs them to the speaker and the display. Therefore, it is naturally conceivable to use the lyric rendering data in the karaoke data for the lyric display of the program music of the CS digital multi-channel broadcast. Moreover, in a communication karaoke system or the like, the karaoke data is compact data such as MIDI data, and a large number of songs can be transferred to the karaoke apparatus in a short time via a telephone line. Combined with the increase and diversification of karaoke users, it is no exaggeration to say that almost all songs with lyrics are prepared as karaoke songs. Therefore, if the program music can be displayed with lyrics, even if the performance of the karaoke music is paused, it is possible to learn the lyrics of the program music or enjoy karaoke with the program music.
[0006]
[Problems to be solved by the invention]
However, the performance of the program music and the karaoke music are not completely the same, and the progress of the performance is also slightly different in the singing part as well as the time of the prelude and the interlude. Therefore, even if the drawing of the lyrics is started in accordance with the start of the program music, the program music and the lyric image are immediately different from each other, and there is no effect of displaying the lyrics. Furthermore, if the program music is to be output during the performance pause time of the karaoke music, it is unlikely that the program music will start exactly well at the beginning of the pause time.
[0007]
Therefore, the present invention provides a music program distribution method capable of synchronously outputting a program song broadcasted by a music program in digital multi-channel broadcasting and a lyrics image generated by a karaoke apparatus to a display, and receiving the music program The purpose is to provide a karaoke device.
[0008]
[Means for Solving the Problems]
For the sake of convenience, the first invention is a method invention specified by the following items (11) to (17).
(11) Receiving and playing digital multi-channel broadcast music programs on a karaoke device and displaying lyrics subtitles that change color in sync with the music. (12) The karaoke device renders accompaniment music data and lyrics of each song. (13) Lyrics rendering data is time-series data for displaying lyric subtitles that change color in synchronization with karaoke accompaniment music played by accompaniment music data. (14) When broadcasting a certain musical piece (a), the broadcasting station multiplexes the audio data of the musical piece (a) and repeatedly sends the musical piece ID (a) and performance progress data (c) ( 15) The song ID (b) specifies the song (a) in the karaoke device. (16) The performance progress data (c) is the lyrics rendering data of the song (a) when the song (a) is being broadcast. (17) The karaoke device receives the audio data, song ID (b), and performance progress data (c) of the song (a) being broadcast. While reproducing and outputting the sound data of the music (a), the lyric rendering data corresponding to the tune ID (a) is read from the storage means and is being broadcast based on the lyric rendering data and the performance progress data (c). Display lyrics subtitles that change color in sync with music. [0009]
For convenience, the second invention is a method invention specified by the following items (21) to (28).
(21) Receiving and playing back digital multi-channel broadcast music programs on a karaoke device and displaying lyrics subtitles that change color in sync with the music. (22) The karaoke device renders accompaniment music data and lyrics of each song. (23) Lyrics rendering data displays lyric subtitles that change color in synchronization with karaoke accompaniment music played by accompaniment music data. (24) When a broadcasting station broadcasts a certain piece of music (f), the broadcast station multiplexes the music data (f) with the audio data of the music (f) and provides the music ID (ki) and performance progress data (ku). Repeated sending (25) The song ID (ki) specifies the song (ka) in the karaoke device (26) The performance progress data (ku) is the elapsed time from the start of broadcasting the song (ka) (27) The time axis correction data corresponding to the music ID (ki) is the time on the time axis of the lyric rendering data corresponding to the music ID (ki) based on the performance progress data (ku). (28) The karaoke device receives the audio data, song ID (ki), and performance progress data (ku) of the song (f) being broadcast, ) Audio data is reproduced and output, and the lyric rendering data and time axis correction data corresponding to the music ID (ki) are read from the storage means, and the lyric rendering data, time axis correction data, and performance progress data (ku) are read out. Display lyrics subtitles that change color in sync with the music being broadcast based on
DETAILED DESCRIPTION OF THE INVENTION
=== Digital multi-channel broadcasting system ===
A CS digital multi-channel broadcasting system will be described as an embodiment of a digital multi-channel broadcasting system including a music program distribution method and a karaoke apparatus that receives the music program distribution method according to the present invention. FIG. 1 is a basic configuration diagram thereof, which includes a broadcasting station 1, a CS 10, and a karaoke apparatus 20. The karaoke device 20 is a reception / playback karaoke device 20 incorporating an integrated reception / playback device (IRD) for CS digital multi-channel broadcasting. The reception / playback karaoke apparatus 20 can perform data communication with the broadcasting station 1 or the karaoke host station 200 via a telephone line as necessary. In these basic configurations, the relationship between the broadcasting station 1 and the reception / playback karaoke apparatus 20 is based on the conventional CS digital multi-channel broadcasting system, and the relationship between the karaoke host station 200 and the reception / playback karaoke apparatus 20 is based on the communication karaoke system. .
[0025]
=== Data structure of a broadcasted music program ===
FIG. 2 shows a configuration diagram of a data stream transmitted when a program song is broadcast in a music program distributed by the distribution method according to the present invention. The data stream 300 is delimited by TS packets 301 having a fixed data length of 188 bytes. The TS packet 301 is composed of a packet header part 302 and a payload part 303. The packet header section 302 includes a packet synchronization code and identification code. Data is multiplexed by storing various data in the payload section 303. This data multiplexing system is defined by the MPEG2-Systems standard and is also used in current CS digital multi-channel broadcasting. Therefore, a detailed description of the technology around this will not be necessary.
In the payload section 303, in addition to the program music data 303a obtained by compressing and encoding the audio signal of the program music being broadcast according to the MPEG2 standard, in this embodiment, a music ID 303b and performance progress data 303c are stored. The music ID 303b is information for specifying the program music being broadcast, and also corresponds to the music ID for designating the requested music in the karaoke apparatus described later. The performance progress data 303c describes time information on the basis of the point in time when the performance of the program music being broadcast is started. A TS packet 301 storing these data 303 a to 303 c is appropriately arranged in the data stream 300.
The music ID 303b and the performance progress data 303c are inserted into the time series every time a certain number of clock pulses when sampling the audio signal of the program music are counted, so that the music ID 303b and the performance progress data 303c are at regular intervals. Is sent out. In this embodiment, the transmission interval is set to every 1/30 seconds. Of course, the music ID and performance progress data may be sent at different time intervals. Moreover, although the above-described music program has been described as a radio broadcast only with sound, it may be a TV broadcast. In that case, TS packet 301 in which MPEG2 video data corresponding to TV broadcast video is stored in payload section 303 is appropriately inserted into data stream 300.
The music program data stream 300 is scrambled, if necessary, and then multiplexed with the data streams of programs broadcast on a plurality of other channels. Then, it is transmitted through QPSK modulation.
[0026]
=== Configuration of receiving / reproducing karaoke apparatus ===
<Generation of karaoke music and reception of CS digital multi-channel broadcasting>
A reception / playback karaoke apparatus incorporating an IRD for CS digital multi-channel broadcasting is prepared in order to receive a music program distributed by such a method. The configuration of the reception / playback karaoke apparatus is shown in FIG. This reception / playback karaoke apparatus 20 is also a terminal of a communication karaoke system, and is connected to the telephone line 100 via a modem 44 at an appropriate communication opportunity, and receives distribution of karaoke data from the karaoke host station 200. The distributed karaoke data is stored in the hard disk device 50 via the central control unit 30. When the central control unit 30 receives a request input from the operation panel 31 or the remote control transmitter 32 via the operation control unit 33, the central control unit 30 reads appropriate karaoke data from the hard disk 50 and processes it. The karaoke data has a data format conforming to the MIDI standard, and includes synthesizer control data, lyric rendering data, and the like. The synthesizer control data is transferred to the synthesizer 34 to generate accompaniment music. The generated accompaniment music is mixed with the voice signal of the singer input from the microphone 36 by the mixing amplifier 35 and output to the speaker 37.
[0027]
The lyrics rendering data includes various information such as a lyrics character string, a display layout, a lyrics rendering sequence, and a singing time instruction. The central control unit 30 sequentially transfers the lyric image (the lyric character string to which the display layout and the singing time instruction expression information are added) according to the lyric rendering sequence to the video RAM 38. The lyric image developed as a bitmap in the video RAM 38 is superimposed on the mood video reproduced by the video CD changer 41 in the video control unit 39 and output to the display 40.
[0028]
On the other hand, the IRD 70 for receiving CS digital multi-channel broadcasting operates in response to an operation command issued by the central control unit 30 in a timely manner. Broadcast radio waves captured by the parabolic antenna 60 are converted into intermediate frequency (IF) signals and introduced into the IRD 70. Music program data is decoded from the IF signal. The audio signal of the decoded program is output from the speaker 37 via the mixing amplifier 35 when the central control unit 30 controls to switch the signal input of the audio switching unit 42 to the IRD 70 side. When the music program is a TV broadcast, the central control unit 30 controls to switch the input of the video switching unit 43 to the IRD 70 side, so that the TV video is output to the display 40 via the video control unit 39.
[0029]
<Decoding / Playing Program Music by IRD>
FIG. 4 shows an outline of the internal configuration of the IRD 70. The IF signal processing of the IRD 70 will be described with reference to this figure. The IRD control unit 71 is a microcomputer that includes a CPU, RAM, ROM, and the like. The IRD control unit 71 and each component unit are appropriately connected by a control bus 78 and a data bus 79. The IRD control unit 71 also exchanges control signals and data with the central control unit 30 of the main body of the reception / playback karaoke apparatus 20 via an internal communication interface. The IC card 77 set in the IC card interface unit 76 stores data relating to the billing system and the descrambling system, such as trial recording of CS digital multi-channel broadcasting and descrambling information. Then, at an appropriate communication opportunity, data communication is performed with the broadcasting station via the modem 44 to transfer the recorded contents.
Each component of the IRD 70 performs IF signal processing in the following path under the control of the IRD control unit 71. The tuning unit 72 extracts the IF signal in synchronization with the IF frequency of the carrier wave broadcasting the music program. The demodulator 73 performs QPSK demodulation on the IF signal to extract a program data stream. The demultiplexer 74 performs descrambling processing as necessary, and extracts TS packets for each data type from the input data stream and arranges them in time series. As a result, a data stream for each data type is output. Of the data streams output from the demultiplexing unit 74, the data stream of music ID and performance progress data is sent to the data bus 79 and transferred to the central control unit 30 via the IRD control unit 71. On the other hand, the program music data is sent to the MPEG2 decoding unit 75. Here, the video signal and audio signal of the program are reproduced.
[0030]
The above is the reception / reproduction control of normal CS digital multi-channel broadcasting. According to the reception / playback karaoke apparatus 20 according to the present embodiment, the music piece ID and performance progress data are appropriately processed to synchronize the program music played back by the IRD and the lyrics image generated from the lyric rendering data. 37 and a function of outputting to the display 40. Hereinafter, this function will be described.
[0031]
=== Method to synchronize lyrics image with program music ===
<Time axis correction data>
FIG. 5A shows an example of the data structure in the time axis correction data prepared for synchronizing the lyrics image with the performance time series of the program music. The time axis correction data is composed of a header portion describing a music ID and the like and section time ratio information describing a time ratio for each section. The section time ratio information includes the start and end time information for each section in the program music corresponding to the music ID when the music is divided into appropriate sections, and the karaoke music for the section performance time in the program music obtained from this time information. And the time ratio with the performance time in this section. In this example, one song is divided into three sections, each of which has a time of 100 seconds. For sections 1 to 3, time ratios are set to 1.2, 1.0, and 1.2, respectively. Taking section 1 as an example, the time information is described as 0 to 100, and the time ratio is described as 1.2. This means that the section 1 is played in 100 seconds for the program music and 120 seconds for the karaoke music.
FIG. 5B shows a performance time series when the program music and the karaoke music are compared based on the time axis correction data shown in FIG. It can be seen that when a piece of music is played as a program piece, the playing time is 300 seconds, whereas when it is played as a karaoke piece, it takes 340 seconds. Next, a method of synchronizing the program song and the lyrics image based on the time axis correction data and the performance progress data will be described.
[0032]
<Lyric image synchronization control>
When the broadcast data of the music program is received, the demultiplexing unit 74 of the IRD 70 extracts performance progress data and music ID from the multiplexed data. These data are sent to the central control unit 30 of the reception / playback karaoke apparatus main body. The central control unit 30 reads the lyric rendering data in the corresponding karaoke data and the corresponding time axis correction data from the hard disk device 50 based on the music ID. The performance place in the program musical piece is applied to the elapsed time from the start point of the performance in the karaoke musical piece from the time recorded in the performance progress data. Taking the music in FIG. 5 as an example, it is assumed that a time of 50 seconds is written in the performance progress information at the time of reception. This time is in section 1. Therefore, it is understood that the time point of 50 seconds × 1.2 = 60 seconds corresponds to the karaoke music piece. If the central control unit 30 transfers the lyric rendering data at the time when 60 seconds have elapsed in the karaoke music to the video RAM, a lyric image matching the performance of the program music at the time of reception is output to the display.
After the lyric image to be drawn at the time of reception is specified, the lyric drawing sequence (the time of singing time instruction such as color change and the display / erasure time of the character string) is corrected so as to be synchronized with the performance of the program music. That is, in section 1, the time obtained by multiplying the time acquired every time performance performance data is received by 1.2 is replaced with the time axis of the lyrics rendering sequence. Since the transmission time interval of the performance progress data coincides with 1/30 second, which is the frame period when the lyric image is output to the display, the lyric rendering data according to the time series on the corrected time axis is displayed. A lyric image synchronized with the program music is output simply by sequentially transferring it to the video RAM.
[0033]
=== Other Examples etc. ===
In the above embodiment, the lyrics rendering sequence is corrected based on the performance progress data in the broadcast data and the time axis correction data stored on the reception / playback karaoke apparatus side. Then, the program music and the lyric image are synchronized by generating lyric images in time series according to the corrected lyric rendering sequence. Instead of such a method, a method of describing the performance time in the karaoke music (time based on the performance start time of the karaoke music) in the performance progress data may be adopted. In this case, the central control unit receives the performance progress data and sends out the lyric rendering data corresponding to the time described therein to the video RAM. Therefore, it is not necessary to prepare time axis correction data.
[0034]
In addition, it is possible to change the reception / playback karaoke apparatus so that it is played back by the IRD and the program music is output to the speaker when the process of generating the karaoke music is paused, such as between performances of the karaoke music. In this case, when the central control unit detects that the music generation process is in a paused state, such as when karaoke data transfer is paused, the voice switching unit controls the voice switching unit to input a voice signal from the IRD, and the accompaniment music voice Input the signal to the mixing amplifier. When the music program is a TV broadcast, in addition to the switching control of the audio switching unit, the input of the video switching unit is switched to the IRD side. As a result, the program music can be output in conjunction with the performance pause time of the karaoke music.
[0035]
【The invention's effect】
According to the present invention, in a music program in a digital multi-channel broadcasting system, the song ID and performance progress data are multiplexed and broadcast on the program song data, so that the lyrics image synchronized with the performance of the program song is displayed on the display of the karaoke apparatus. A music program distribution method for outputting can be provided. In addition, a system standardized in the current CS digital multi-channel broadcasting can be used as it is as a music program distribution method including a data multiplexing system. Therefore, no special data multiplexing device or encoder is required. Therefore, extra expenses are required for broadcasting. In turn, the viewer (karaoke user) is not forced to bear an economic burden such as an increase in the viewing fee (karaoke usage fee).
[0036]
A karaoke apparatus that receives and processes multiplexed data of program tunes distributed by this music program distribution method includes a digital multi-channel broadcast data processing system similar to an IRD for digital multi-channel broadcasts and a conventional karaoke apparatus. By simply adding software (data or program) for processing music IDs and performance progress data demultiplexed by the system, it is possible to synchronize and output program music and lyrics images to the display. Moreover, the lyrics image from the middle can be output even when the program music being broadcast is received.
[0037]
Further, the performance progress data may describe the performance time of the program music or the performance time of the karaoke music, and can be appropriately changed according to the convenience of the broadcaster. The karaoke device can flexibly cope with either format of performance progress data by simply storing the time axis correction data in a hard disk device or the like by data communication or changing the program.
[0038]
By linking the output of the program music to the performance pause period in the karaoke music, the karaoke user can enjoy karaoke and remember the lyrics of the music during the karaoke performance pause time. If the program song contains vocals, you can also learn the typical singing state with lyrics.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of a digital multi-channel broadcasting system in an embodiment of the present invention.
FIG. 2 is a structural diagram of multiplexed data distributed in the embodiment.
FIG. 3 is a configuration diagram of a reception / playback karaoke apparatus according to an embodiment of the present invention.
FIG. 4 is a configuration diagram of an IRD in the reception / playback karaoke apparatus.
5A shows an example of a structure diagram of time axis correction data in an embodiment of the present invention, and FIG. 5B shows program music and karaoke music based on the time axis correction data shown in FIG. The performance time series when compared is shown.
[Explanation of symbols]
1 Broadcasting Station 20 Reception / Reproduction Karaoke Device 30 Central Control Unit 50 Hard Disk Device 70 IRD

Claims (2)

A method of receiving and reproducing a digital multi-channel broadcast music program on a karaoke device and displaying lyrics subtitles that change color in synchronization with the music,
The karaoke device includes storage means for storing accompaniment music data and lyric rendering data of each song in association with the song ID,
Lyrics rendering data is time-series data for displaying lyrics subtitles that change color in synchronization with karaoke accompaniment music performed by accompaniment music data.
When broadcasting a certain music (a), the broadcast station multiplexes the audio data of the music (a) and repeatedly sends the music ID (b) and performance progress data (c),
The song ID (A) identifies the song (A) in the karaoke device,
The performance progress data (c) is data representing the point in time on the time axis of the lyric rendering data of the music (a) when the music (a) is being broadcast.
The karaoke apparatus reproduces and outputs the audio data of the music (a) while receiving the audio data, music ID (b), and performance progress data (c) of the music (a) being broadcast, and the music ID (b). The lyric rendering data corresponding to the above is read from the storage means, and lyric subtitles that change color in synchronization with the music being broadcast based on the lyric rendering data and performance progress data (c) are displayed. A method of receiving and reproducing a digital multi-channel broadcast music program on a karaoke device and displaying lyrics subtitles that change color in synchronization with the music,
The karaoke apparatus includes storage means for storing accompaniment music data, lyrics rendering data, and time axis correction data of each song in association with the song ID,
Lyrics rendering data is time-series data for displaying lyrics subtitles that change color in synchronization with karaoke accompaniment music performed by accompaniment music data.
When a broadcasting station broadcasts a certain piece of music (f), it multiplexes it with the sound data of the music (f) and repeatedly sends out the music ID (ki) and performance progress data (h).
The song ID (ki) identifies the song (f) in the karaoke device,
Performance progress data (ku) is data corresponding to the elapsed time from the start of broadcasting of the song (f),
The time axis correction data corresponding to the song ID (ki) is correction calculation data for obtaining the time point on the time axis of the lyrics rendering data corresponding to the song ID (ki) based on the performance progress data (ku). Yes,
The karaoke apparatus reproduces and outputs the audio data of the music (f) while receiving the audio data, music ID (ki), and performance progress data (ku) of the music (f) being broadcast, and the music ID (ki). Lyric subtitles that change color in synchronization with the music being broadcast based on the lyric rendering data, the time base correction data, and the performance progress data (ku) are read out from the storage means. How to display.

Images