JP2000036795A - Device and method for transmitting data, device and method for receiving data and system, and method for transmitting/receiving data - Google Patents

Abstract

PROBLEM TO BE SOLVED: To distribute the data of a piece of music, to present information of lyrics or the like accompanied with a piece of music synchronously with the piece of music, and to flexibly utilize the information. SOLUTION: Additional information, such as the lyrics accompanying a piece of download enable music, is transmitted from transmitting equipment in the format of an additional music information file. The additional music information file has a file header part 110, one or more data parts 111 and sub file header parts 112 provided for each data part 111. The additional information collected into one file is divided for each prescribed unit and stored in the data parts 111. The display start time and display end time of data stored in the corresponding data part 111 are described in the sub file header part 112. Based on the time information described in the sub file header part 112, receiving equipment displays the data stored in the data part 111 synchronously with the presentation of the piece of music.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data transmitting apparatus and method, a data receiving apparatus and method, and a data transmitting and receiving system and method capable of distributing music data by digital satellite broadcasting or the like.

[0002]

2. Description of the Related Art In recent years, digital satellite broadcasting has been widely used. Digital satellite broadcasting is more resistant to noise and fading than conventional analog broadcasting, and can transmit high-quality signals. In digital satellite broadcasting, the frequency use efficiency is improved, and multi-channels can be achieved. For example, in digital satellite broadcasting, one satellite can secure several hundred channels. In such digital satellite broadcasting, a large number of specialized channels for sports, movies, music, news, etc. are prepared, and in these specialized channels, programs of respective specialized contents are broadcast.

[0003] Among these specialty channels, the music channel is one of the popular channels, and a promotion program mainly for introducing new songs and hit songs is broadcast.

[0004]

As described above, in a conventional music channel, a new song introduction or a hit song program is sent as a moving image and a sound. When the viewer sees such a music channel and finds a favorite song, the viewer may want to purchase a CD or the like of the introduced song and enjoy it. Further, there are times when it is desired to know the information of the artist of the music or the information of the album in which the music is stored. So, if you are watching a music program and want to know the artist information of the song or the album information that contains the song, you can get the information on the spot, and if you find a song you like, It would be very convenient if you could download the audio data for that song. However, in the conventional music channel, a moving image and a sound related to music are unilaterally transmitted, and such a request cannot be satisfied.

Therefore, in order to solve such a problem, information on music broadcast on a music channel can be easily obtained, and the music data can be easily downloaded to a data storage device. A music content distribution system has been proposed (1997 Patent Application No. 308488).

[0006] Conventionally, music applications such as karaoke are presumed to use a display device capable of displaying text and images, and information such as lyrics and images is fixedly attached to music. There was something like that. For example, in a karaoke application using a laser disk (LD), image information and audio information are simultaneously recorded on the disk, and the image information and audio information are closely associated with each other. Text information such as lyrics is embedded in the image information in advance.
Therefore, in such an application, accompanying information such as lyrics and images accompanying the music can be presented only in a predetermined form, and there is a problem that flexibility is poor. For example, it has not been possible to use accompanying information such as lyrics and images alone or to collectively display lyrics that are usually displayed part by part in synchronization with music.

[0007] In a music content distribution system in which music data can be downloaded to a data storage device, it is conceivable to add information such as lyrics and images to the music to be provided. However, also in this case,
As described above, if the image information and the audio information are closely associated with each other and the text information is embedded in the image information in advance, there is a problem that the system becomes inflexible.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and has as its object to enable distribution of music data, and to enable information accompanying the music to be presented in synchronization with the music, and to be flexible. It is an object of the present invention to provide a data transmission device and method, a data reception device and method, and a data transmission / reception system and method which can be used for a computer.

[0009]

SUMMARY OF THE INVENTION A data transmission apparatus according to the present invention comprises: music data; accompanying information presented along with the music; and time information for presenting the accompanying information in synchronization with the music presentation. And data transmitting means for transmitting the data generated by the data generating means.

The data transmission method according to the present invention is a data transmission method in which music data, accompanying information presented along with the music, and time information for presenting the accompanying information in synchronization with the presentation of the music. It generates the associated data of the structure and transmits the generated data.

[0011] The data receiving apparatus of the present invention is a data receiving apparatus which associates music data, accompanying information presented accompanying the music, and time information for presenting the accompanying information in synchronization with the presentation of the music. Receiving means for receiving the accompanying data of the structure, performing a process for presenting the music based on the music data received by the receiving means, and presenting the accompanying information in the accompanying data received by the receiving means to the music And a presentation processing means for performing a process for presenting the accompanying information in the accompanying data based on the time information in the accompanying data.

According to the data receiving method of the present invention, there is provided a data receiving apparatus which associates music data, accompanying information presented along with the music, and time information for presenting the accompanying information in synchronization with the presentation of the music. In addition to receiving the accompanying data of the structure and performing processing for presenting the music based on the received music data, the accompanying information in the received accompanying data is presented in synchronization with the presentation of the music. The processing for presenting the accompanying information in the accompanying data is performed based on the time information in the data.

[0013] The data transmitting / receiving system of the present invention includes a data transmitting device and a data receiving device. The data transmission device transmits the music data, the accompanying information presented along with the music, and the accompanying data having a data structure in which the accompanying information is associated with time information for presenting the accompanying information in synchronization with the presentation of the music. It has data generating means for generating, and transmitting means for transmitting data generated by the data generating means. A data receiving device, receiving means for receiving music data and accompanying data transmitted from the data transmitting device,
In order to perform a process for presenting music based on the music data received by the receiving means and to present the accompanying information in the accompanying data received by the receiving means in synchronization with the presentation of the music, the accompanying data And a presentation processing means for performing a process for presenting the accompanying information in the accompanying data based on the time information.

According to the data transmission / reception method of the present invention, data of music, associated information presented along with the music, and time information for presenting the accompanying information in synchronization with the presentation of the music are associated with each other. Generates the accompanying data of the structure, transmits the generated data, receives the transmitted music data and the accompanying data, and performs a process for presenting the music based on the received music data. At the same time, in order to present the accompanying information in the received accompanying data in synchronization with the presentation of the music, a process for presenting the accompanying information in the accompanying data is performed based on the time information in the accompanying data.

In the data transmitting apparatus or the data transmitting method of the present invention, the music data, the accompanying information presented along with the music, and the time for presenting the accompanying information in synchronization with the presentation of the music. Ancillary data having a data structure in which information is associated with the information is generated, and the generated data is transmitted.

In the data receiving apparatus or the data receiving method of the present invention, the music data, the accompanying information presented along with the music, and the time for presenting the accompanying information in synchronization with the presentation of the music. The accompanying data having a data structure in which the information is associated with the received data is received, a process for presenting the music is performed based on the received music data, and the accompanying information in the received accompanying data is presented to the music. In order to present the associated information in the associated data, a process for presenting the associated information in the associated data is performed based on the time information in the associated data.

In the data transmission / reception system of the present invention or the data transmission / reception method of the present invention, music data, accompanying information presented along with the music, and time for presenting the accompanying information in synchronization with the presentation of the music. The associated data of a data structure in which information is associated with the data is generated, the generated data is transmitted, the data of the transmitted music and the associated data are received, and the music based on the received music data is received. Is performed, and the accompanying information in the accompanying data is presented based on the time information in the accompanying data in order to present the accompanying information in the received accompanying data in synchronization with the presentation of the music. Is performed.

[0018]

Embodiments of the present invention will be described below in detail with reference to the drawings.

The system to which the present invention is applied broadcasts a music program using digital satellite broadcasting and distributes audio data associated with the music program so that a viewer can listen to the music program. In addition, when the user listens to a song that he / she likes through trial listening, the user can easily purchase the song on the spot.

FIG. 1 shows the overall configuration of a music content distribution system to which the present invention is applied. This music content distribution system includes a digital satellite broadcasting ground station 1 for multiplexing various signals and transmitting the multiplexed signals to a satellite 2, a billing server 5 connected to the ground station 1, and a television program (hereinafter, referred to as a television program). Material server 6, music material server 7, additional audio information server 8, graphical user interface (Graphic)
cal User Interface; hereinafter, referred to as GUI. A) a data server 9 and a key information server 10; Satellite 2
Transmits the signal transmitted from the ground station 1 to the ground. The satellite 2 is equipped with a plurality of transponders. One transponder has a transmission capacity of, for example, 30 Mbps.

The music content distribution system further includes, for example, a receiving facility 3 for each home for receiving a signal transmitted from the ground station 1 via the satellite 2. The receiving equipment 3 includes a parabolic antenna 11 for receiving a signal from the satellite 2 and a low noise block down converter (Low Noise Bl converter) that converts a signal received by the parabolic antenna 11 into a signal of a predetermined frequency.
ock Downconverter; hereinafter, referred to as LNB. ) 15,
An integrated receiver / decoder (Integrated Rec / Receiver) as a receiver for inputting the output signal of the LNB 15
eiver Decoder; hereinafter, referred to as IRD. ) 12 and a storage device 13 and a television receiver 14 connected to the IRD 12. IRD12
Is connected to a billing server 5 via, for example, a telephone line 4.

In the music content distribution system configured as described above, the digital satellite broadcast ground station 1 stores the TV program broadcast material from the TV program material server 6 and the music data material from the music material server 7. The additional audio information from the additional audio information server 8 and the GUI data from the GUI data server 9 are sent.

The TV program material server 6 is a server that provides materials of a normal music broadcast program. The music broadcast materials transmitted from the TV program material server 6 are moving images and audio. In a normal music broadcast program, for example,
Promotional videos and sounds for new song introductions are broadcast, and countdowns of the latest hit songs are broadcast.

The music material server 7 is a server that provides an audio program using an audio channel. The material of this audio program is audio only. The music material server 7 sends materials of audio programs of a plurality of audio channels to the ground station 1. In the program broadcasting of each audio channel, the same music is repeatedly broadcast at a predetermined unit time. Each audio channel is independent, and various usages can be considered. For example, in one audio channel, the recommended song in the latest Japanese pop is repeatedly broadcast for a predetermined time, and in the other audio channel, the recommended song in the latest American pop is repeatedly broadcast for a predetermined time. In another audio channel, a recommended song from jazz may be repeatedly broadcast for a predetermined time. Further, a plurality of music pieces of the same artist may be divided into respective audio channels and repeatedly broadcast.

The additional audio information server 8 provides additional audio information. The additional audio information is time information of the music output from the music material server 7, specifically, information on the total playing time of the music and the elapsed time from the start of playing the music.

The GUI data server 9 includes data for forming a screen of a list page of music to be distributed and an information page of each music, data for forming still image data of a jacket, and lyrics of the music to be distributed. Data, Electronic Program Guide (EPG)
It is written. ) Is provided to form data for forming a screen. As will be described later in detail, in a system to which the present invention is applied, by operating a GUI on the screen,
The lyrics of the distributed music, the concert information of the artist, and the like can be displayed on the screen. Also, G on the screen
Through the operation of the UI, music selection, download, reservation thereof, and the like can be performed. The data for that purpose is sent from the GUI data server 9. Note that this GUI
Data includes, for example, MHEG (Multimedia and Hypermedi
a Information Coding Experts Group) method is used.

The ground station 1 includes the above-described video data and audio data as the material of the music program broadcast from the television program material server 6, the audio data as the material of the audio channel from the music material server 7, and the sound addition. The voice additional information from the information server 8 and the GUI data from the GUI data server 9 are multiplexed and transmitted. At this time, the video data of the television program broadcast is compressed by, for example, the MPEG (Moving Picture Experts Group) 2 system, and the audio data of the television program broadcast is
It is compressed by the MPEG2 audio system. The audio data of each audio channel is stored in two different formats, for example, MPEG2 audio format and ATRAC (Ad
It is compressed by the aptive transform Acoustic Coding method. These data are encrypted using key information from the key information server 10 at the time of multiplexing.

The signal from the ground station 1 is transmitted via the satellite 2
For example, it is received by the parabolic antenna 11 of the receiving equipment 3 of each home. This received signal is converted to a predetermined frequency by the LNB 15 and supplied to the IRD 12.

The IRD 12 selects a signal of a predetermined channel from the received signal and demodulates video data and audio data. Further, the IRD 12 forms a list page of music to be distributed, an information page of each music, and an EPG screen. The output signal of the IRD 12 is supplied to the television receiver 14.

The storage device 13 is for storing downloaded audio data.
For example, as the storage device 13, an MD (mini disc) recorder player, a DAT (digital audio tape) recorder player, a DVD (digital video disc or digital versatile disc) recorder player, or the like can be used. It is also possible to use a personal computer as the storage device 13 and store the audio data on its hard disk or CD-R (writable compact disk).

The IRD 12 is connected to the accounting server 5 via the telephone line 4, for example. An IC card storing various information is inserted into the IRD 12. When the audio data of the music is downloaded, the information is stored in the IC card. The information of the IC card is sent to the accounting server 5 via the telephone line 4, for example. The billing server 5 performs appropriate billing based on the download information, and bills the viewer. As described above, by performing appropriate charging, the copyright of the downloaded music can be protected.

As described above, in the system to which the present invention is applied, the ground station 1 includes the video data and the audio data serving as the material of the music program broadcast from the television program material server 6 and the audio channel from the music material server 7. , Audio additional information data from the additional audio information server 8, and a GUI data server 9.
Is multiplexed with the GUI data from the server and transmitted. Then, when this broadcast is received by the receiving facility 3 of each home, a music program is viewed, and a GUI screen is displayed based on the transmitted GUI data. When the viewer performs a necessary operation while viewing the GUI screen, he or she can see an information page for each song and can listen to a preview of each song. The viewer further downloads the audio data of the desired music by performing necessary operations while viewing the GUI screen, and
Can be stored.

In FIG. 1, a ground station 1 corresponds to a data transmitting apparatus provided with data generating means and transmitting means in the present invention. In FIG. 1, the receiving equipment 3 corresponds to a data receiving apparatus provided with the receiving means and the presenting processing means in the present invention, and particularly, the IRD 12 corresponds to the presenting processing means.

Next, the operation of the viewer in the receiving facility 3 will be described in more detail.

When the above-mentioned music program broadcast is received by the receiving equipment 3 of each home, a GUI screen as shown in FIG. 2 is displayed on the television receiver 14. In the television program display area 21A at the upper left of this screen, a moving image based on the music program provided from the television program material server 6 is displayed. In the upper right part of the screen, a list 21B of songs of each channel being broadcast on the audio channel is displayed. Further, a text display area 21C and a jacket display area 21D are set at the lower left of the screen. Further, on the right side of the screen, a lyrics display button 22, a profile display button 23, an information display button 24, a reservation recording button 25,
A reserved list display button 26, a recording history display button 27, and a download button 28 are displayed.

The viewer searches for a song of interest while looking at the song name displayed in the list 21B. When you find a song you are interested in, use the arrow keys on the remote commander to move the cursor to that song,
Press the enter key of the remote commander attached to IRD12. As a result, it is possible to listen to the music piece with the cursor. That is, in each audio channel, the same music is repeatedly broadcast during a predetermined unit time, so that the screen of the television program display area 21A is kept as it is and the audio channel of the music is switched to listen to the music. it can. At this time, a still image of the MD jacket of the music is displayed in the jacket display area 21D.

In this state, when the cursor is moved to the lyrics display button 22 and the enter key is pressed (hereinafter, the operation of moving the cursor to the button and pressing the enter key is called the button), the lyrics of the music are displayed in the text display area 21C. Is displayed at the timing synchronized with the audio data.
Similarly, when the profile display button 23 or the information display button 24 is pressed, the artist profile or concert information corresponding to the music is displayed in the text display area 21C. Thus, the viewer can know what kind of music is currently being distributed, and can know detailed information about each music.

The viewer presses the download button 28 when he / she wants to purchase the tune listened to. When the download button 28 is pressed, the audio data of the selected music is downloaded and stored in the storage device 13. Along with the audio data of the music, lyrics data, artist profile information, jacket still image data, and the like can be downloaded. Each time a song is downloaded, that information is stored on an IC card in the IRD 12. The information stored in the IC card is downloaded to the charging server 5, for example, once a month. Thereby, the copyright of the downloaded music can be protected.

When the viewer wants to make a reservation for download in advance, he presses the reservation recording button 25. When this button 25 is pressed, the GUI screen is switched, and a list of songs that can be reserved is displayed on the entire screen. This list can display music searched in units of one hour, one week, or genre. When the viewer selects a song to be reserved for download from this list, the information is registered in the IRD 12. When the user wants to check the music for which download reservation has already been made, the user can press the reserved list display button 26 to display a list of reserved music on the entire screen. The music thus reserved is downloaded by the IRD 12 at the reserved time and stored in the storage device 13.

When the viewer wants to confirm the downloaded music, the recording history button 27 can be pressed to display a list of already downloaded music on the entire screen.

As described above, in the receiving equipment 3 in the system to which the present invention is applied, the G of the television receiver 14 is
A list of songs is displayed on the UI screen. When the viewer selects a song in accordance with the display on the GUI screen, the viewer can listen to the song on a trial basis, and can also know the lyrics of the song, the artist profile, and the like. The viewer can further use the GUI screen to download music and make a reservation for the music, display a download history, a list of reserved music, and the like.

As described above, in the music content distribution system to which the present invention is applied, a music broadcast program is distributed, and audio data of music is distributed using a plurality of audio channels. Then, using a list of distributed music, etc., search for the desired music,
The audio data can be easily stored in the storage device 13. Hereinafter, such a system will be described in more detail.

FIG. 3 shows an example of the configuration of the ground station 1 in the music content distribution system to which the present invention is applied.

The ground station 1 has a television program material server 6
A TV program material registration system 31 for registering material data from the PC, a music material registration system 32 for registering audio data from the music material server 7, and audio additional information from the audio additional information server 8 are registered. And a GUI material registration system 34 for registering GUI data from the GUI data server 9.

The ground station 1 further stores an AV (audio / video) server 35 holding the material data from the TV program material registration system 31, and compresses and packetizes the material data held by the AV server 35. And a television program transmission system 39 for transmitting.

The ground station 1 further includes an MPEG2 audio encoder 3 for encoding the audio data from the music material registration system 32 in the MPEG2 audio system.
6A, an MPEG audio server 40A that holds the MPEG audio data obtained by encoding by the MPEG2 audio encoder 36A, and an MPEG audio transmission system 43A that packetizes and transmits the MPEG audio data held by the MPEG audio server 40A. And

The ground station 1 further includes an ATRAC encoder 36B for encoding the audio data from the music material registration system 32 by the ATRAC method, and an ATRA encoder 36B.
An ATRAC audio server 40B that holds ATRAC data obtained by being encoded by the C encoder 36B, and an ATRAC audio transmission system 43B that packetizes and transmits the ATRAC data held by the ATRAC audio server 40B.

The ground station 1 further includes a voice additional information database 37 holding voice additional information from the voice additional information registration system 33, and a voice additional information database 37.
And a voice additional information transmission system 41 for packetizing and transmitting the voice additional information held by the device.

The ground station 1 further processes the GUI material database 38 holding the GUI data from the GUI material registration system 34, and processes the GUI data held by the GUI material database 38, packetizes the data, and sends out the packets. And a GUI authoring system 42.

The ground station 1 further includes the respective systems 39 and 43
A, 43B, each data and information from 41, 42,
A multiplexer 44 for performing time axis multiplexing (time division multiplexing) and encrypting using key information from the key information server 10 (FIG. 1), and after performing predetermined processing on the output of the multiplexer 44 , A radio wave transmission system 45 for transmitting a signal from an antenna (not shown) to the satellite 2.

In the ground station 1 thus configured, the material data from the TV program material registration system 31 is registered in the AV server 35. This material data is video data and audio data. The material data registered in the AV server 35 is sent to the television program transmission system 39, where the video data is compressed by, for example, the MPEG2 system, and the audio data is compressed by, for example, the MPEG2 audio system, and each is packetized. The output of the television program transmission system 39 is
Sent to

The audio data from the music material registration system 32 is an MPEG2 audio encoder 3
6A and the ATRAC encoder 36B, after being encoded respectively, the MPEG audio server 40
A and registered in ATRAC audio server 40B. MP registered in the MPEG audio server 40A
The EG audio data is sent to the MPEG audio transmission system 43A, where it is packetized and sent to the multiplexer 44. ATRAC data registered in the ATRAC audio server 40B is ATRAC data.
The data is sent to the audio transmission system 43B as quadruple-speed ATRAC data, packetized here, and sent to the multiplexer 44.

Further, the additional voice information from the additional voice information registration system 33 is registered in the additional voice information database 37. The additional audio information registered in the additional audio information database 37 is sent to the additional audio information transmission system 41, where it is packetized and then sent to the multiplexer 44.

The GUI data from the GUI material registration system 34 is registered in the GUI material database 38. GU registered in the GUI material database 38
The I data is sent to the GUI authoring system 42, where the GUI screen data is processed and packetized, and then sent to the multiplexer 44. Here, the GUI data includes still image information of a jacket, lyric information of music, concert information of an artist, and the like. Here, the still image information is, for example, JPEG (JointPhot
640x4 compressed by the (ographic Experts Group) method
The image data is 80 pixel image data.
The data is packetized as text data of up to 00 characters.

The multiplexer 44 includes a video packet and an audio packet from the television program transmission system 39, an audio packet from the MPEG audio transmission system 43A, a quadruple-speed audio packet from the ATRAC audio transmission system 43B, and an audio additional information transmission system. The voice additional information packet from 41 and the GUI data packet from the GUI authoring system 42 are time-division multiplexed and encrypted using key information from the key information server 10 (FIG. 1).

The output of the multiplexer 44 is sent to a radio wave transmission system 45, where it is subjected to processing such as addition of an error correction code, modulation and frequency conversion, and then transmitted from an antenna (not shown) to the satellite 2. .

FIG. 4 shows an example of data transmitted from the ground station 1. It should be noted that each data shown in this figure is actually time-division multiplexed. As shown in FIG. 4, one event is between time t1 and time t2, and the next event is from time t2. An event is a unit for changing the lineup of music, and is usually in units of 30 minutes or 1 hour. For example, it is conceivable to broadcast the 20th to 11th of the top 20 of the latest hit songs in an earlier event, and broadcast the 10th to 1st in a later event.

As shown in FIG. 4, from time t1 to time t
In the event No. 2, a music program having a predetermined content A1 is broadcast in a normal video program broadcast. In an event starting from time t2, a music program having predetermined content A2 is being broadcast. What is broadcast on this normal music program is moving images and audio.

For example, ten audio channels CH1 to CH10 are prepared.
At this time, each audio channel CH1, CH2, C
In H3,..., CH10, the same music is repeatedly transmitted during one event. That is, in the event from time t1 to time t2, the audio channel CH
1, the music B1 is repeatedly transmitted, the music C1 is repeatedly transmitted on the audio channel CH2, and thereafter, the music K1 is similarly transmitted on the audio channel CH10.
Is repeatedly transmitted. In the event starting from the time t2, the music B2 is repeatedly transmitted on the audio channel CH1, the music C2 is repeatedly transmitted on the audio channel CH2, and thereafter, the music K2 is repeatedly transmitted on the audio channel CH10. This is common to the MPEG audio channel and the 4 × ATRAC audio channel.

That is, in FIG. 4, the same numbers in parentheses, which are the channel numbers of the MPEG audio channel and the 4 × -speed ATRAC audio channel, relate to the same music. The number in parentheses, which is the channel number of the additional audio information, is the additional audio information added to the audio data having the same channel number. Still image data and text data transmitted as GUI data are also formed for each channel.

FIG. 5 shows a method of transmitting and reconstructing various data as shown in FIG. FIG.
As shown in (a) to (d), various data are MP
It is time-division multiplexed and transmitted by the transport packet of EG2. Each transport packet has a header, in which information indicating the type of the packet is described. In the IRD 12, the information indicating the type of the packet in the header of each packet is used, and FIG.
Each data is reconstructed as shown in (h).

Next, the receiving equipment 3 in each home will be described. As shown in FIG. 1, a parabolic antenna 11, an IRD 12, a storage device 13, and a television receiver 14 are prepared as receiving facilities in each home.

Here, the IRD 12 is connected to an analog audio output terminal Aout, as shown in FIG.
A digital audio output terminal Dout such as IEC958 for transmitting audio data via an optical cable;
94 and other digital interface terminals Dif. Therefore, the storage device 13 has only the analog audio input terminal Ain as shown in FIG. 6B, and the PCM audio input terminal Din such as IEC958 as shown in FIG. As shown in FIG. 6 (d), a device having a bidirectional digital interface terminal Dif such as IEEE1394 can be connected.

As shown in FIG. 6B, when a storage device 13A having only an analog audio input terminal Ain is used as a storage device, an analog output terminal Aout of the IRD 12 and an analog output terminal of the storage device 13A are used. The input terminal Ain is connected with the analog cable 16A.

As shown in FIG. 6C, a storage device 13B having a PCM audio input terminal Din such as IEC958 as a storage device.
Is used, the digital output terminal Dout of the IRD 12 and the digital input terminal Din of the storage device 13B are connected by, for example, an IEC958 optical fiber cable 16B.

As shown in FIG. 6D, when a storage device 13C having a bidirectional digital interface terminal Dif such as IEEE1394 is used as a storage device, the digital interface terminal Dif of the IRD 12 is connected to the storage device 13C. Storage device 1
Between the 3C digital interface terminal Dif
They are connected by an IEEE 1394 digital interface cable (hereinafter, referred to as an IEEE 1394 bus) 16C.

As shown in FIG. 6B, when a storage device having no digital input terminal is used, the downloaded MPEG audio data is subjected to MPEG2 decoding processing in the IRD 12. Then, the digital-to-analog conversion is performed, and the resultant signal is output from an analog audio output terminal Aout. Then, the data is sent from the IRD 12 to the storage device 13A via the analog cable 16A. In this case,
A control signal may be exchanged between the IRD 12 and the storage device 13A using wireless communication such as infrared rays or wired communication using a cable to confirm a connection relationship or a download operation. is there.

As shown in FIG. 6C, when a storage device 13B having a PCM audio input terminal Din is used as a storage device,
The downloaded MPEG audio data is IR
MPEG2 decoding processing is performed in D12, and IRD
12 is output as PCM audio data. Then, the data is sent from the IRD 12 to the storage device 13B via, for example, an IEC958 optical cable 16B. Also in this case, control signals are exchanged between the IRD 12 and the storage device 13A using wireless communication such as infrared rays or wired communication using a cable.
It is also possible to configure so as to check the connection relationship and the download operation.

As a specific example in the case shown in FIG.
An MD recorder / player (hereinafter, referred to as an IEEE 1394 or the like) having a bidirectional digital interface terminal Dif.
It is described as IEEE1394MD. ) Is used as the storage device 13C, the downloaded 4 × speed ATRAC data is
The data is sent to the storage device 13C via the IEEE 1394 bus 16C. Also, the storage device 13C
The IEEE 1394 MD can store text data such as jacket data and lyrics data together with audio data of the music selected by the IRD 12. In the following description, the storage device 1
IEEE1394MD as 3C is also denoted by reference numeral 13C.

As described above, devices used as the storage device 13 include analog input devices and PCs.
There are three systems, one for inputting M audio data and one for inputting ATRAC data.

FIG. 7 shows an example of the configuration of the IRD 12. The IRD 12 has an input terminal T1, an analog video output terminal T2, an analog audio output terminal T3, T4, an optical digital output interface 59, an IEEE 1394 interface 60, a man-machine interface 61,
A C card slot 62 and a modem 63 are provided.
Further, the IRD 12 includes a control CPU (central processing unit) 5
8 is provided.

The input terminal T1 is a terminal to which a received signal converted into a predetermined frequency by the LNB 25 is input. The analog video output terminal T2 is a terminal that supplies an analog video signal to the television receiver 14. The analog audio output terminal T3 is a terminal that supplies an analog audio signal to the television receiver 14. The analog audio output terminal T4 is a terminal for supplying an analog audio signal to an analog input storage device. The optical digital output interface 59 is IEC95
8, which transmits PCM audio data to the optical fiber cable 16B. IEEE139
4 interface 60 transmits video data, audio data, various commands, and the like to the IEEE 1394 bus 16.
Send to C The man-machine interface 61 is a remote commander (hereinafter, referred to as a remote controller) 6 by a user.
4 is sent to the control CPU 58. An IC card 65 is inserted into the IC card slot 62. Modem 6
3 is connected to a billing server 5 via a telephone line 4.

The IRD 12 further includes a tuner 51 connected to the input terminal T 1, a descrambler 52 provided after the tuner 51, and a transport IC (integrated circuit) provided after the descrambler 52. 53, an MPEG audio decoder 54 and an MPEG
Video decoder 55 and MPEG audio decoder 5
4, a digital-to-analog converter 5 provided at the subsequent stage
6, a one-input / two-output switch SW1 provided at the subsequent stage of the digital-analog converter 56,
And an NTSC conversion block 57 provided at the subsequent stage of the video decoder 55.

The output terminal of the NTSC conversion block 57 is connected to the analog video output terminal T2. Each output terminal of the switch SW1 is connected to an analog audio output terminal T3, T4, respectively. The MPEG audio decoder 54 is connected to an optical digital output interface 59. In addition, transport IC5
3 is connected to the IEEE 1394 interface 60.

The tuner 51 selects a signal of a predetermined reception frequency from the reception signals supplied from the terminal T1 based on the setting signal from the control CPU 58, further performs demodulation and error correction processing, and performs MPEG decoding. Output a port stream. The descrambler 52 includes the tuner 5
1 receives an MPEG transport stream from an IC
The descramble key data stored in the card 65 is received via the IC card slot 62 and the control CPU 58, and descrambling is performed using the key data. The user can use the transport IC 53
, Via the man-machine interface 61 and the control CPU 58, and extracts MPEG video data and MPEG audio data of a desired television program from the transport stream. MPEG
The video decoder 55 converts MPEG video data supplied from the transport IC 53 into video data before data compression. MPEG audio decoder 54
Converts the MPEG audio data supplied from the transport IC 53 into audio data (P
(CM audio data). The digital-to-analog converter 56 is an MPEG audio decoder 54.
The audio data supplied from A is converted into an analog audio signal. The switch SW1 selectively supplies an analog audio signal supplied from the digital-analog converter 56 to the analog audio output terminals T3 and T4.

The control CPU 58 performs the processing of the entire IRD 12. Further, the control CPU 58 is
8 is received via the man-machine interface 61 by the user using the remote controller 64. The modem 63 is connected to the control CPU 58. Information required for charging is stored in the IC card 65. The information of the IC card 65 is sent to the charging server 5 (FIG. 1) via the telephone line 4 using the modem 63.

The transport IC 53 fetches the audio additional information and GUI data shown in FIG. 4 from the transport stream and sends them to the control CPU 58. The control CPU 58, based on these data,
A screen of a list page, a screen of an information page of each song, or screen data for EPG is formed. The screen data thus formed is stored in the MPEG video decoder 5.
5 is written to a predetermined area of the buffer memory.
As a result, as shown in FIG. 2, it is possible to display a screen of a list page of broadcast music, an information page of each music, or a screen for EPG in a designated area on the screen.

Next, the operation of the IRD 12 shown in FIG. 7 will be described.

In the IRD 12 shown in FIG. 7, when the user selects a channel of the music content distribution system described above, a GUI screen as shown in FIG. 2 is displayed on the screen of the television receiver 14.

At this time, the received signal input to terminal T 1 is supplied to tuner 51. In the tuner 51, a signal of a predetermined reception frequency is selected from the reception signals based on the setting signal from the control CPU 58, and further subjected to demodulation and error correction processing to output an MPEG transport stream.

The output of tuner 51 is descrambler 5
2 is supplied. In the descrambler 52, the descramble key data stored in the IC card 65
The data is input via the C card slot 62 and the control CPU 58, and the key data is used to descramble the MPEG transport stream. The descrambled MPEG transport stream is sent to the transport IC 53.

A command input by the user from the remote controller 64 is input to the transport IC 53 via the man-machine interface 61 and the control CPU 58. According to the command, the transport IC 53 converts the MPEG of the desired television program from the transport stream.
The video data and the MPEG audio data are extracted and sent to the MPEG video decoder 55 and the MPEG audio decoder 54, respectively.

The M sent to the MPEG video decoder 55
The PEG video data is converted into video data before data compression, and then converted into a composite video signal by the NTSC conversion block 57, and then output from the analog video output terminal T2 to the television receiver 14.
The MPEG audio data sent to the MPEG audio decoder 54 is converted into audio data before data compression here.
After being converted into an analog audio signal at 6, the analog audio signal is output from the analog audio output terminal T3 to the television receiver 14.

When a tune is selected from the tune list 21B on the GUI screen shown in FIG. 2 and the audio data of the tune is previewed, MPEG audio data is extracted by the transport IC 53, and the MPE is extracted.
The GMPEG audio data is transferred to the audio decoder 54.
After being decoded by the digital-to-analog converter 56, the digital-to-analog converter 56 converts the digital-to-analog data to digital data.

When the download button 28 is pressed on the GUI screen shown in FIG. 2 and the audio data is downloaded, the audio data is extracted by the transport IC 53, and an audio digital output terminal T4 and an optical digital output terminal Interface 59 or I
Audio data is output from any one of the IEEE 1394 interfaces 60.

Here, as shown in FIG.
When the IEEE 1394 MD13C is connected to the IEEE 1394 interface 60 (digital interface terminal Dif), the transport IC 53 extracts the quadruple-speed ATRAC data and outputs the IEEE 139 MD139.
IEEE1394MD via the 4 interface 60
13C. At this time, jacket data compressed in the JPEG format is extracted in the transport IC 53 and sent to the IEEE 1394 MD 13C via the IEEE 1394 interface 60. Further, at this time, text data such as lyrics and artist profile is extracted by the transport IC 53 and transmitted to the IEEE 1394 MD 13C via the IEEE 1394 interface 60.

The optical digital output interface 59 has I
When a storage device 13B (FIG. 6C) not provided with the IEEE 1394 interface is connected, the transport IC 53 extracts the MPEG audio data, and the MPEG audio decoder 5
After the decoding at step 4, the PCM audio data is transmitted to the storage device 13B via the optical digital output interface 59 (digital output terminal Dout).

The storage device 13 capable of inputting only analog audio to the analog audio output terminal T4
When A (FIG. 6A) is connected, MPEG audio data is extracted by the transport IC 53, decoded by the MPEG audio decoder 54, and further digital-analog converted by the digital-analog converter 56. , Through the switch SW1 and the analog audio output terminal T4 (audio output terminal Ao
ut) to the storage device 13A.

FIG. 8 is a block diagram showing an example of the configuration of the IEEE1394MD13C. This IEEE139
4MD13C is an IEEE1394 interface 71
, An optical digital input interface 72, an analog audio input terminal T12, and an analog audio output terminal T13. The IEEE 1394 interface 71 is directly connected to the recording / reproducing unit 75, and is also connected to the recording / reproducing unit 75 via the ATRAC encoder 74. The optical digital input interface 72 is connected to a recording / reproducing unit 75 via an ATRAC encoder 74. Analog audio input terminal T
Reference numeral 12 denotes A through an analog-digital converter 73.
It is connected to a TRAC encoder 74. The analog audio output terminal T13 is connected to a recording / reproducing unit 75 via a digital-analog converter 78 and an ATRAC decoder 77. A disk 76 is set in the recording / reproducing section 75, and the recording / reproducing section 75
6 is recorded and reproduced. Although not shown here, the IEEE 1394 MD1
The 3C is provided with a control CPU for performing overall control and the like, and a man-machine interface.

Next, the recording operation of the IEEE 1394 MD 13C will be described.

When the IEEE 1394 interface 71 is connected to the IEEE 1394 interface 60 of the IRD 12 shown in FIG.
The audio data of the music, text data such as lyrics, and still image data such as a jacket transmitted from the interface 60 are input from the IEEE 1394 interface 71, and are directly recorded on the disk 7 by the recording / reproducing unit 75.
6 is recorded. As described later, at this time, each data is recorded on the disk 76 in the extended MD format.

When PCM audio data is externally input to the optical digital input interface 72, the input PCM audio data is encoded by the ATRAC encoder 74 and then recorded on the disk 76 by the recording / reproducing unit 75.

When an analog audio signal is externally input to the analog audio input terminal T12, the input analog audio signal is converted from analog to digital by the analog to digital converter 73, and the ATR
After being encoded by the AC encoder 74, it is recorded on the disk 76 by the recording / reproducing unit 75.

That is, the IEEE1394MD13C
Only when the connection with the IRD 12 is connected by the IEEE 1394 bus, the lyrics data and the still image data of the jacket are recorded together with the audio data of the music. In the case of the connection with the optical digital interface or the analog audio input, , Only audio data is recorded.

In the IEEE1394MD13C,
At the time of reproduction, a reproduction signal can be output from the IEEE1394 interface 71 or the analog audio output terminal T13. When the lyric data and the jacket data are recorded on the disk 76 together with the audio data of the music, the IEEE 1394
When outputting a playback signal from the interface 71,
Music data can be output to an IEEE1394 compatible audio device (amplifier, etc.), and lyrics data and jacket data can be displayed on an IEEE1394 compatible display or printed with an IEEE1394 compatible printer. It is.

As described above, the IEEE to which the present invention is applied
In the 1394MD 13C, it is possible to record and reproduce lyrics data, jacket data, etc. together with audio data of a music piece.

FIG. 9 shows an extended MD format which enables recording and reproduction of audio data of a musical piece, lyrics data thereof, jacket data, and the like. As shown in this figure, the audio data of the music is ATRA
It is recorded in the main data (MainData) area in the C system. This is the same as the current MD format. In the extended MD format, 2.8 Mbytes are further added.
The above-mentioned jacket data, lyrics data, etc. are recorded in the auxiliary data (Aux Data) area. Such an extension M
By using the D format, it becomes possible to record and reproduce jacket data, lyrics data, etc. together with the audio data of the music. Further, compatibility with the current MD format can be maintained.

Next, features of the present embodiment will be described.

First, the accompanying information such as the lyrics accompanying the downloadable music will be described. The accompanying information includes song lyrics data, song description data, artist description data, images related to the songs (images such as jacket photos of albums containing the songs, artist photos, animations, promotion images, etc.). ) Data. Of these, song lyrics data,
The description data of the music and the description data of the artist are text data, and the image data related to the music is J data.
It is compressed image data according to the PEG method. These accompanying information is transmitted from the ground station 1 to the receiving facility 3 by accompanying data as a part of the GUI data.

FIG. 10 shows an example of the data structure of the accompanying data for transmitting the accompanying information. In this example, the accompanying information is collected into one file for each song and data type. In the present embodiment, this file is referred to as a music accompanying information file. This music accompanying information file includes a file header section 110 provided for each file, one or more data sections 111,
And a sub-file header section 112 provided for each data section 111. The accompanying information compiled into one file is divided for each predetermined unit and divided data (in FIG. 10, data 1, data 2, data 3,...)
It is written. ). Each divided data is stored in the data section 111. In the file header section 110,
Sub-program tag (Sub Program Tag; hereinafter, the file type (lyric data, compressed image data, etc.), copyright information, file size, and corresponding music identification information)
Notated as SPT. ) Is described. In the subfile header section 112, the display start time and the display end time of the data stored in the corresponding data section 111 are described in hours, minutes, and seconds.
Note that the display start time and the display end time are represented by the elapsed time from the start of the music performance.

For example, in the case where the accompanying information is lyrics data, when creating a song accompanying information file, the lyrics data for one song is divided into phrases or units which are easy to display on the screen, and the divided data is obtained. Then, each divided data is stored in the data section 111. In addition, a sub-file header section 112 corresponding to each data section 111 has a data section 111
Describes the display start time and display end time of the data stored in. The file header section 110 describes that the file type is lyrics data, and also describes copyright information, file size, SPT of the corresponding music, and the like. By creating the music-related information file having such a data structure, as described in detail later, the data stored in each data section 111 is displayed from the display start time described in the sub-file header section 112. It is possible to display until the end time,
The lyrics can be displayed in synchronization with the presentation of the selected music.

In the case of other types of accompanying information other than the lyrics data, the accompanying information can be presented in synchronization with the presentation of the selected song by creating a song accompanying information file having the above data structure. Becomes

When a music-related information file having no sub-file header is created, all data included in one music-related information file is displayed collectively.

The music-related information file having the above data structure is stored in the GUI authoring system 4 shown in FIG.
2 and transmitted from the ground station 1 to the receiving facility 3 as part of the GUI data.

Next, a description will be given of a mechanism for presenting accompanying information such as lyric data accompanying the selected music in synchronization with the selected music in the present embodiment.

First, with reference to FIG. 11, a description will be given of time information necessary for presenting accompanying information in synchronization with music. Various data are transmitted from the ground station 1 to the receiving facility 3 by transport packets in an MPEG transport stream. FIG. 11B
Shows the data structure of this transport packet. The transport packet has a transport header 123 in which control information is stored, and a payload 124 in which information to be transmitted is stored. The payload 124 in the transport packet is obtained by dividing a packetized elementary stream (hereinafter referred to as PES) for each predetermined data length. FIG. 11A shows a data structure of a PES packet which is a packet in the PES. P
The ES packet is a PES header 1 in which control information is stored.
21 and a data section 122.

As shown in FIG. 11C, the transport header 123 of the transport packet includes packet identification information (Packet I) indicating the type of the packet.
dentification; hereinafter, referred to as PID. ) Is described.

In the MPEG system, a program clock reference (Program Clock Reference; hereinafter, P
Recorded as CR. ) Is transmitted from the transmitter to the receiver by a transport packet. The PCR is information on absolute time having a length of 42 bits, and indicates a time instant when a packet including the PCR arrives.

[0109] In the MPEG system, a transmitter and a receiver are respectively provided with a system time clock (System Time Clock).
Hereinafter referred to as STC. )have. The receiver is
A phase synchronization loop (hereinafter, referred to as PLL) adjusts its own STC to the value of the transmitted PCR. This allows 27MHz between transmitter and receiver
Can be synchronized. In the MPEG system, 2
7 MHz is the reference for synchronization. The 27 MHz clock generated by the STC of the receiver is used as a reference clock in signal processing as an MPEG audio decoder 54.
And the MPEG video decoder 55 and the like.

In this way, the transmitter and the receiver have 27M
By synchronizing the Hz reference clock, synchronization can be achieved between the transmitter and the receiver. In the MPEG system, using the 27 MHz reference clock, video data and audio data in one service are synchronized as follows.

That is, in the MPEG system, in order to synchronize video data and audio data, presentation time information (Presentation information) is provided for each access unit (a picture for video data and a coded frame for audio data).
tation Time Stamp; hereinafter, referred to as PTS. ) Is multiplexed and transmitted. The PTS is the PES shown in FIG.
11 stored in the PES header 121 of the packet.
Payload 1 of the transport packet shown in (b)
24 and transmitted.

The receiver sets the PTS of the video data to ST
When the value matches the value of C, the decoded video data is output.
When the value matches, the decoded audio data is output. As a result, the video data and the audio data are synchronized.

In the present embodiment, in order to present accompanying information such as lyrics data in synchronism with the music, the audio additional information and the sub-file header section 112 in the music accompanying information file shown in FIG. Use.

[0114] The audio additional information includes the total playing time of the corresponding music and the elapsed time from the start of playing the music, in hours, minutes, and minutes.
Described in seconds. In addition, each audio additional information includes
Each is given a PTS. This PTS is shown in FIG.
The packet is stored in the PES header 121 of the PES packet shown in FIG. 11A and stored in the payload 124 of the transport packet shown in FIG. When the PTS of the additional audio information matches the value of the STC, the receiver validates the additional audio information, that is, information on the total playing time and elapsed time of the corresponding music piece.

Here, 27 generated by the STC of the receiver is used.
The MHz clock is convenient as information handled by the receiver, but is difficult to handle for equipment that does not handle MPEG.
Therefore, in the present embodiment, the accompanying information, which is information that can be used as a service outside the receiver, is 27M
From the clock of Hz, information of absolute time represented by hours, minutes and seconds is generated, and this information is treated as time information. This facilitates processing of the accompanying information. In the present embodiment, specifically, as described above, the PTS of the audio additional information
When the value coincides with the STC value, the information on the elapsed time in the audio additional information is made valid, thereby generating information on the absolute time expressed in hours, minutes, and seconds. Then, using the display start time and display end time described in the sub-file header section 112 in the music accompanying information file and the absolute time information expressed in hours, minutes, and seconds, display (presentation) of the accompanying information. ) To control the timing.

Next, a description will be given of a mechanism for associating the selected music, the additional audio information, and the accompanying information such as lyrics data. Information for enabling selection of music and the like by operating the GUI on the screen is given by GUI data. The GUI data includes song lyrics data, song description data, artist description data,
A plurality of types of data such as image data related to music are included. Each of the plurality of types of data includes data for each music piece. The SPT is added to the data for each song, and the SPT identifies the data for each song. Therefore, when a certain music is selected by operating the GUI on the screen in the IRD 12, an SPT corresponding to the music is obtained. And
Based on the SPT, the IRD 12 extracts the data of the selected music, the audio additional information, and the accompanying information from the received data.

Here, a method of extracting the data of the selected music piece and the additional audio information based on the SPT will be described. The transport stream can include multiple channels (programs) to target channels (programs)
In order to make it possible to extract the PAT, a program association table (hereinafter referred to as PAT) and a program map table (Program Map)
Table; hereinafter, referred to as PMT. ) Are multiplexed.

The PAT describes a PID corresponding to the PMT for each channel. Note that the PID of the transport packet including the PAT is “0”. The PMT describes a PID for each type of data such as video data and audio data in the channel.

Therefore, the IRD 12 extracts the transport packet whose PID is “0”,
T can be obtained. The IRD 12 further includes a PI corresponding to the PMT for each channel described in the PAT.
By extracting D's transport packet,
A PMT for each channel can be obtained. IRD1
2 can know the PID for each type of data in each channel from the PMT for each channel. In this way, the IRD 12 knows the PID for each type of data in the selected channel and extracts the transport packets of those PIDs, thereby extracting video data and audio data in the selected channel. It becomes possible.

Here, the music broadcast channel from which the music data described above can be downloaded is set to EMD.
(Electric Music Download) channel. In the present embodiment, in addition to the PMT, a sub PMT (hereinafter referred to as S
Notated as MT. ) Is defined. This SMT is prepared for each music that can be downloaded. The SMT describes the PID of each of the MPEG audio data, ATRAC data, and audio additional data in the music.

In this embodiment, the PMT of the EMD channel includes video data, audio data,
In addition to the PID for each type of data such as GUI data, the SMT PID for each downloadable song is described. In the present embodiment, the description of the SMT PID for each downloadable music piece is called a linkage descriptor.

FIG. 12 shows the above PAT, PMT and S
This is a conceptual representation of the relationship between MTs. As shown in the figure, the PAT describes a PID corresponding to the PMT for each channel. In the example shown in FIG. 12, the PAT has four channels of PMT, that is, PMT.
It is assumed that PIDs of MT1 to PMT4 are described. Here, PMT4 is the PMT of the EMD channel.
It is assumed that The PMT 4 includes a plurality of linkage descriptors describing the PID of the SMT for each song that can be downloaded. In the example shown in FIG. 12, there are 10 songs that can be downloaded and the SMT
It is also assumed that there are ten SMT1 to SMT10. In the linkage descriptor and SMT for each song,
Each SPT is added, and the SPT is used to generate a linkage descriptor and an SMT for each music.
Is identified.

With the mechanism of PAT, PMT and SMT, the IRD 12 is selected when an EMD channel is selected and an arbitrary music piece is selected from a plurality of downloadable music pieces. Based on the SPT of the song, the P of the EMD channel
From the MT, the PID of the SMT of the selected music is known, and further, the PID of each of the MPEG audio data, ATRAC data, and audio additional data of the music is known from the SMT corresponding to the PID, and the PIDs thereof are obtained.
, It is possible to extract MPEG audio data, ATRAC data, and audio additional data in the selected channel.

When an EMD channel is selected and an arbitrary song is selected from a plurality of downloadable songs, the IRD 12 outputs the GUI data based on the SPT of the selected song. From among them, the accompanying information of the selected music is extracted.

In this way, based on the SPT, the selected music piece, the voice additional information, and the accompanying information such as lyrics data are associated.

FIG. 13 is a block diagram showing a circuit configuration for presenting accompanying information such as lyrics data in the IRD 12 in synchronization with music. As shown in this figure,
The IRD 12 includes an STC counter 131 constituting the STC.
When the power of the IRD 12 is turned on, the control C
A switch 132 for setting a PCR extracted from the transport stream, which is turned on by the PU 58, to the STC counter 131;
A comparator 133 that compares the count value of 1 with the extracted PCR value and outputs a signal corresponding to the difference between the two, and a voltage control that controls the oscillation frequency based on the signal output from the comparator 133 Oscillator (hereinafter, referred to as VCO) 1
34. The VCO 134 generates a 27 MHz clock. The STC counter 131 has the VCO1
The clock generated by 34 is input and counted.

[0127] The MPEG audio decoder 54 in the IRD 12 controls the MP output from the transport IC 53.
Audio decoder 135 that decodes EG audio data 141 and outputs audio data 142
And PTS of audio data and STC counter 131
And a comparator 136 for giving an audio data output instruction to the audio decoder 135 when the count values match.

The IRD 12 further stores the PT of the audio additional information.
S and the count value of the STC counter 131 are compared, and when they match, a comparator 137 that outputs an ON signal for turning on a gate circuit described later, and information 143 of the elapsed time in the audio additional information , A gate circuit 138 that outputs elapsed time information 143 when an ON signal output from the comparator 137 is input, the elapsed time information 143 output from the gate circuit 138, lyrics data, etc. The display start time 144 and the display end time 145 described in the sub-file header in the accompanying information of are compared, and the elapsed time information 143 and the display start time 144 are compared.
139 outputs a signal 146 instructing the start of the display of lyrics when the information matches, and outputs a signal 147 instructing the end of the display of the lyrics when the elapsed time information 143 and the display end time 145 match. And

Next, the operation of the circuit shown in FIG. 13 will be described, taking as an example a case where the accompanying information is lyrics data. When the power of the IRD 12 is turned on, the PCR included in the transport stream is extracted by the transport IC 53. At this time, the switch 132 is turned on by the control CPU 58, and the extracted P
The value of CR is set in the STC counter 131. ST
When the PCR value is set in the C counter 131, the switch 132 is turned off, and the STC counter 131
The counting of the clock supplied from the VCO 134 is started. The count value of the STC counter 131 is
3 is supplied. The comparator 133 is provided with the STC counter 13
The count value of 1 is compared with a PCR value newly extracted from the transport stream, and a signal corresponding to the difference between the two is output. The oscillation frequency of VCO 134 is controlled based on the signal output from comparator 133. In this way, the PLL control is performed so that the count value of the STC counter 131 matches the value of the PCR.

In the MPEG audio decoder 54, the comparator 136 compares the PTS of the audio data with the count value of the STC counter 131, and when they match, gives an audio data output instruction to the audio decoder 135. . Audio decoder 135
When an audio data output instruction is given, MP
The EG audio data 141 is decoded, and the audio data 142 is output. When an arbitrary song is selected from a plurality of downloadable songs, the selected song is played.

The comparator 137 compares the PTS of the audio additional information with the count value of the STC counter 131, and when they match, outputs an ON signal for turning on the gate circuit 138. At the time when this ON signal is output, the elapsed time from the start of the performance of the actual music piece matches the elapsed time in the audio additional information. When the ON signal is output, the gate circuit 138 is turned on, and information 143 on the elapsed time in the audio additional information is output to the comparator 139. The comparator 139 outputs the elapsed time information 1
43 is compared with the display start time 144 and the display end time 145 described in the sub-file header of the lyrics data, and when the elapsed time information 143 matches the display start time 144, a signal instructing the start of the display of the lyrics. 1
46, the elapsed time information 143 and the display end time 1
When the number matches 45, a signal 147 for instructing the end of the display of the lyrics is output. These signals 146,147
Is sent to the control CPU 58. Control CPU 58
Receives the signal 146, performs processing for displaying lyrics based on the lyrics data corresponding to the subfile header in which the display start time 144 that matches the elapsed time information 143 is described, and generates the signal 147. Upon input, processing for ending the display of lyrics is performed.

Next, the operation of displaying the lyrics in the IRD 12 in synchronization with the presentation of the selected music will be described with reference to the flowcharts of FIGS.

FIG. 14 is a flowchart showing the operation of the IRD 12 until the GUI screen shown in FIG. 2 is displayed when the EMD channel is selected. In this behavior,
When an EMD channel is selected in the IRD 12 (step S101), the IRD 12 acquires a PMT of the EMD channel (step S102). Next, IRD
Reference numeral 12 denotes a PMT of main video data, which is video data of a music program supplied from the TV program material server 6 in FIG. 1, and a PID of main audio data, which is audio data of the music program, from the PMT of the EMD channel. Is acquired (step S103). Next, IR
D12 acquires the PID of the GUI data from the PMT of the EMD channel (step S104). Next, I
The RD 12 extracts the GUI data from the transport stream by extracting the transport packet having the PID of the GUI data, and displays the GUI screen as shown in FIG. 2 based on the GUI data, The main video data and the main audio data are extracted based on the PID of the main video data and the PID of the main audio data, and the music program is reproduced (step S10).
5) End the operation up to the display of the GUI screen.

FIG. 15 shows the G displayed as described above.
11 is a flowchart showing an operation of the IRD 12 when an arbitrary music piece is selected from a music list 21B using the UI screen. In this operation, the IRD 12 first obtains the SPT of the selected music piece from the GUI data (step S111). Next, the IRD 12 searches the PMT of the EMD channel for a linkage descriptor corresponding to the SPT, and acquires the SMT PID of the selected music (step S112). Next, the IRD 12 extracts the SMT of the selected song by extracting a transport packet having the PID of the SMT of the selected song.
, And the PID of the MPEG audio data and the PID of the audio additional information are obtained from the SMT (step S113). Next, the IRD 12 extracts and decodes the MPEG audio data based on the PID of the MPEG audio data (Step S114). Next, I
The RD 12 extracts the additional audio information based on the PID of the additional audio information, and acquires the elapsed time of the music from the additional audio information (step S115). Next, the IRD 12
It is determined whether or not the data of the selected music has ended (step S116). If the data of the selected music has not been completed (N), the IRD 12 proceeds to step S11.
4, when the operation is completed (step S116; Y), the operation in the case where an arbitrary music is selected is ended.

FIG. 16 shows the G displayed as described above.
9 is a flowchart showing the operation of the IRD 12 relating to the display of lyrics when an arbitrary song is selected from the song list 21 using the UI screen and the lyrics display button 22 is further pressed. In this operation, first, the IRD 12 searches the GUI data for a directory in which lyrics are collectively written (step S121). Next, the IRD 12 uses the selected song from the directory based on the SPT of the selected song.
A file containing the selected lyrics is searched for (step S122). Next, the IRD 12 determines whether or not the elapsed time of the music matches the display start time in the sub-file header (step S123). If the elapsed time of the music does not match the display start time in the subfile header (N), the IRD 12 repeats step S123,
If they match (step S123; Y), the lyrics corresponding to the sub-file header are written in FIG.
Is displayed in the text display area 21c (step S124). Next, the IRD 12 determines whether or not the elapsed time of the music matches the display end time in the subfile header corresponding to the lyrics being displayed (step S1).
25). If the elapsed time of the music does not match the display end time in the sub-file header (N), the IRD 12
Step S125 is repeated, and if they match (step S125; Y), the display of the lyrics ends (step S126). Next, the IRD 12 determines whether or not the data of the selected music has ended (step S12).
7). If the data of the selected music has not been completed (N), the IRD 12 returns to step S123, and if completed (step S127; Y), ends the operation related to the display of the lyrics.

When the music-related information file corresponding to the selected music has a structure without a sub-file header, all data included in one music-related information file are displayed collectively.

Further, a button is provided on the GUI screen for instructing the lyrics to be displayed collectively, and when this button is pressed, the IRD 12 sets the sub-file header even if the sub-file header is included in the music accompanying information file. All data included in one music accompanying information file may be displayed collectively, ignoring the file header.

As described above, according to the present embodiment, the accompanying information such as the lyrics data attached to the music that can be downloaded and the time information (display start time and display end time) for presentation thereof are associated with each other. Since the music accompanying information file having the attached data structure is generated, and the music accompanying information file is transmitted from the ground station 1 to the receiving equipment 3 as a part of the GUI data, the user can select one of the downloadable music pieces. When presenting the music piece, the accompanying information such as lyrics data can be displayed in synchronization with the presentation of the music piece. This makes it possible to display the lyrics at the timing when the lyrics are actually used during the presentation of the music. Further, according to the present embodiment, it is possible to present not only text information such as lyrics, but also animations and promotion images in synchronization with the presentation of music, for example, a picture-story service synchronized with music. Becomes possible.

Further, according to the present embodiment, the accompanying information such as the lyrics data is transmitted as data independent of the music data, so that the accompanying information is determined in a conventional manner. Not only the mode but also various modes can be presented, and a highly flexible service can be realized. For example, it is possible to collectively display lyrics that are normally displayed part by part in synchronization with a song. Also, for example, it is possible to selectively present any one of the lyrics data by attaching two or more lyrics data to the data of one music piece. Thereby, when the lyrics of a certain language (for example, English) are used as the original, one of the lyrics data is used as the lyrics data of the original language, and the other one of the lyrics data is used.
And transmitting the two types of lyrics data as data of lyrics in another language (for example, Japanese) in association with the data of one song, and selecting one of the lyrics data in the IRD 12. Thus, it is possible to present music while selectively displaying lyrics in any language.

[0140] The accompanying information includes music data,
It can be stored in the storage device 13C. In this case, the time information for the presentation is stored in the storage device 13C together with the accompanying information. Therefore, when music data is reproduced from the storage device 13C, it is possible to display the accompanying information in synchronization with the presentation of the music using the accompanying information and the time information for the presentation.

In the present embodiment, the time information for presenting the accompanying information is expressed in hours, minutes, and seconds,
Instead of 27MHz clock in G system,
Since the accompanying information is displayed on the basis of hours, minutes, and seconds so as to be synchronized with the presentation of the music, the handling of the accompanying information becomes easy for devices and persons other than the MPEG system. In addition, when music information and accompanying information are used in a device or system having a unique reference time, the time information for presenting the accompanying information is easily converted to information suitable for the unique reference time. It becomes possible.

[0142] The present invention is not limited to the above embodiment. For example, in the embodiment, the music data, the voice additional information, and the accompanying information are transmitted in separate packets. However, two or more of them may be transmitted in the same packet. Good.

A plurality of types of accompanying information, for example, a promotion image and lyrics may be combined and displayed.

The present invention can also be applied to a system for downloading music distributed by terrestrial broadcasting, a system for downloading music distributed by cable broadcasting, and a system for downloading music via the Internet.

[0145]

As described above, according to the data transmitting apparatus or the data transmitting method of the present invention, the data of the music, the accompanying information presented along with the music, and the accompanying information of the music are combined. Synchronous with the presentation, time data for presentation and associated data of a data structure that is associated with the data are generated and transmitted, so that music data can be distributed, and The accompanying information can be presented in synchronization with the music and can be used flexibly.

Further, according to the data receiving apparatus of the present invention or the data receiving method of the present invention, the data of the music, the accompanying information presented along with the music, and the accompanying information are presented in synchronization with the presentation of the music. And associated data of a data structure in which time information for performing the association is received, a process for presenting the music is performed based on the data of the received music, and the associated information in the received accompanying data is In order to present in synchronization with the presentation, processing for presenting the accompanying information in the accompanying data is performed based on the time information in the accompanying data, so that music data can be distributed,
The information accompanying the music can be presented in synchronization with the music and can be used flexibly.

Further, according to the data transmission / reception system of the present invention or the data transmission / reception method of the present invention, the music data, the accompanying information presented along with the music, and the accompanying information are presented in synchronization with the presentation of the music. Associated data of a data structure that is associated with time information for transmitting, transmitting these data, receiving the data of the music and the associated data, and presenting the music based on the data of the received music. Process for presenting the accompanying information in the accompanying data based on the time information in the accompanying data in order to present the accompanying information in the received accompanying data in synchronization with the presentation of the music. Since this is performed, the data of the music can be distributed, and the information accompanying the music can be presented in synchronization with the music and can be used flexibly.

[Brief description of the drawings]

FIG. 1 is a block diagram showing the overall configuration of a system to which the present invention is applied.

FIG. 2 is an explanatory diagram showing an example of a screen displayed on a television receiver in the system shown in FIG.

FIG. 3 is a block diagram showing an example of a configuration of a ground station in the system shown in FIG.

FIG. 4 is an explanatory diagram showing a structure of an example of data transmitted in the system shown in FIG. 1;

FIG. 5 is an explanatory diagram showing a method of transmitting various kinds of data and a method of restructuring in the system shown in FIG. 1;

FIG. 6 is an explanatory diagram showing a relationship between an IRD and various storage devices in the system shown in FIG. 1;

FIG. 7 is a block diagram showing an example of an IRD configuration in the system shown in FIG. 1;

FIG. 8 is a block diagram showing an example of the configuration of IEEE1394MD in FIG. 6;

FIG. 9 is a diagram showing a recording format of IEEE1394MD in FIG. 6;

FIG. 10 shows an example of a data structure of accompanying data according to an embodiment of the present invention.

FIG. 11 is an explanatory diagram for describing time information necessary for presenting accompanying information in synchronization with music in one embodiment of the present invention.

FIG. 12 is an explanatory diagram for explaining a mechanism for associating selected music, additional sound information, and accompanying information in one embodiment of the present invention.

FIG. 13 is a block diagram showing a circuit configuration for presenting incidental information in synchronization with music in one embodiment of the present invention.

FIG. 14 is a flowchart showing an operation of the IRD until a GUI screen as shown in FIG. 2 is displayed in one embodiment of the present invention.

FIG. 15 is a flowchart showing an operation of an IRD when an arbitrary music piece is selected using a GUI screen in one embodiment of the present invention.

FIG. 16 is a flowchart showing the operation of the IRD relating to the display of lyrics in one embodiment of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Ground station, 3 ... Receiving equipment, 12 ... IRD, 13 ... Storage device, 13C ... IEEE1394MD, 14
... Television receiver.

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 7/081 F term (Reference) 5C063 AA20 AB03 AB07 AB11 AC02 AC05 AC10 5D108 BC12 BD02 BF20 5K101 KK18 LL11 MM07 NN18 NN21

Claims (12)

[Claims] The present invention relates to music data, and accompanying data of a data structure that associates accompanying information presented along with a song and time information for presenting the accompanying information in synchronization with the presentation of the song. A data transmission device comprising: a data generation unit for generating; and a transmission unit for transmitting data generated by the data generation unit. 2. The data transmitting apparatus according to claim 1, wherein said data generating means further generates data representing an elapsed time from the start of playing the music. 3. A music data, and accompanying data of a data structure in which the accompanying information presented along with the music and the time information for presenting the accompanying information in synchronization with the presentation of the music are associated with each other. Generating a data and transmitting the generated data. 4. The data transmission method according to claim 3, further comprising generating and transmitting data representing an elapsed time from the start of playing the music. 5. The music data, the accompanying information presented along with the music, and the accompanying data having a data structure in which the accompanying information is associated with time information for presenting the information in synchronization with the presentation of the music. Receiving means for receiving, performing processing for presenting music based on the data of the music received by the receiving means, and presenting the accompanying information in the accompanying data received by the receiving means in synchronization with the presentation of the music And a presentation processing means for performing a process for presenting the accompanying information in the accompanying data based on the time information in the accompanying data. 6. The data receiving means further receives data representing an elapsed time from the start of playing the music, and the presentation processing means comprises data representing the elapsed time received by the data receiving means and accompanying data. 6. The data receiving apparatus according to claim 5, wherein a process for presenting the accompanying information in the accompanying data is performed based on the time information in the data. 7. The music data, the accompanying information presented along with the music, and the accompanying data having a data structure in which the accompanying information is associated with time information for presenting the accompanying information in synchronization with the presentation of the music. Receives and performs the process for presenting the music based on the received music data, and also presents the accompanying information in the received accompanying data in synchronization with the presentation of the music. A data receiving method comprising: performing a process for presenting accompanying information in accompanying data based on the data. 8. A method for receiving data representing an elapsed time from the start of playing a music piece and presenting accompanying information in the accompanying data based on the data representing the received elapsed time and time information in the accompanying data. 8. The data receiving method according to claim 7, wherein the following processing is performed. 9. The music data, the accompanying information presented along with the music, and the accompanying data having a data structure in which the accompanying information is associated with time information for presenting the accompanying information in synchronization with the presentation of the music. A data transmitting device having a data generating device for generating, a transmitting device for transmitting data generated by the data generating device, a receiving device for receiving data of music and accompanying data transmitted from the data transmitting device; Performing a process for presenting the music based on the music data received by the receiving means, and presenting the accompanying information in the accompanying data received by the receiving means in synchronization with the presentation of the music. A data receiving device having presentation processing means for performing a process for presenting the accompanying information in the accompanying data based on the time information in the data. That data transmission and reception system. 10. The data generating means further generates data indicating an elapsed time from the start of playing the music, and the data receiving means further generates data indicating the elapsed time from the start of playing the music. Receiving, wherein the presentation processing means performs a process for presenting the accompanying information in the accompanying data based on the data indicating the elapsed time received by the data receiving means and the time information in the accompanying data. The data transmission / reception system according to claim 9. 11. Data of music and associated data of a data structure in which associated information presented along with the music and time information for presenting the associated information in synchronization with the presentation of the music are associated with each other. Generating, transmitting the generated data, receiving the transmitted music data and the accompanying data, performing a process for presenting the music based on the received music data, and receiving the accompanying data. A data transmission / reception method, characterized by performing a process for presenting the accompanying information in the accompanying data based on the time information in the accompanying data in order to present the accompanying information therein in synchronization with the presentation of the music. 12. A method for generating and transmitting data representing an elapsed time from the start of a music performance, receiving data representing an elapsed time from the start of a music performance, and receiving the data representing the received elapsed time. 12. The data transmission / reception method according to claim 11, wherein a process for presenting the accompanying information in the accompanying data is performed based on the time information in the accompanying data.