JP2004032637A - Communication system, server device, communication method, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a communication device capable of utilizing even one streaming data for multiple purpose and effectively utilizing the information to be derived from the streaming data. <P>SOLUTION: A personal computer 1 has a function of reproducing while receiving a streaming data sent from an Internet server 6. A control part of the personal computer 1 transmits the request to the Internet server 6 when a specific operation is requested for relevant information related to the contents in the middle of reproduction during the reproduction of streaming data. When the control part receives the relevant information sent from the Internet server 6 corresponding to the transmission of the request, the control part makes a printer 2 print the received relevant information. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a communication device such as a personal computer system or a facsimile device having a function of reproducing and receiving streaming data, a printing function or a display function, a server device for distributing streaming data, and transmission and reception of such streaming data. And a computer program for controlling a communication device and a server device.
[0002]
[Prior art]
2. Description of the Related Art In recent years, a broadband connection environment has been established as an infrastructure of the Internet due to expansion of ADSL (Asymmetric Digital Subscriber Line), CATV (Cable Television) network, FTTH (Fiber to the Home), and the like. A personal computer in such a broadband connection environment can play back almost no waiting time while receiving so-called streaming data.
[0003]
The streaming data includes audio data mainly including audio and music, and movie data mainly including moving images while including audio and music. In any of the data systems, a certain amount of reproduction time (about several seconds) is stored in the memory by buffering upon reception, and data is simultaneously reproduced while reading and writing data at high speed by a FIFO (First In First Out) method. According to such a streaming data distribution service, the user can select desired music or video when necessary and view it in real time.
[0004]
[Problems to be solved by the invention]
However, according to the current streaming data distribution service, real-time properties and on-demand can be realized, but the content (content) of the streaming data is consistently one pattern that cannot be changed throughout. . In this regard, the streaming data distribution service is the same as general radio broadcasting and television broadcasting.
[0005]
In other words, on the user side receiving the streaming data distribution service, while playing and listening to the content that changes from moment to moment, while encountering content that interests or wants to know more detailed information during the viewing, Even if the content can be paused or repeatedly played back, it can only be delivered as it is, and one piece of streaming data cannot simply be used for multiple purposes.
[0006]
The present invention has been proposed in view of the above points, and it is possible to use a single stream of data for multiple purposes, and to effectively use information derived from the stream data, a communication device and a server. It is an object to provide an apparatus, a communication method, and a computer program.
[0007]
[Means for Solving the Problems]
In order to achieve the above object, a communication apparatus according to the first aspect of the present invention is a communication apparatus having a function of playing back streaming data received from a server apparatus while receiving the streaming data. When a predetermined operation for requesting related information related to the content being reproduced is performed, related information request transmitting means for transmitting the request to the server device; and the request by the related information request transmitting means. Related information receiving means for receiving the related information sent from the server device in response to the transmission of the related information, and related information output means for printing out and / or displaying the related information received by the related information receiving means; It is characterized by having.
[0008]
According to such a communication device, there are points of interest and details to be known during the reproduction of the streaming data, and when a predetermined operation for requesting these points is performed, the contents related to the contents during the reproduction are The related information obtained from the server device can be obtained and printed or displayed, so that only one piece of streaming data can be used for multiple purposes, and related information derived from the streaming data can be effectively used.
[0009]
A communication device according to a second aspect of the present invention is the communication device according to the first aspect, wherein the related information request transmission unit measures a reproduction time from the start of reproduction of the streaming data to the end thereof. Along with the request, a time stamp indicating a reproduction time at which the predetermined operation is performed is transmitted in the request, and the related information receiving unit transmits the time stamp corresponding to the time stamp from the server device. Receive related information.
[0010]
According to such a communication device, in addition to the effect of the communication device according to claim 1, by transmitting the time stamp, the related information corresponding to the reproduction content at the time when the predetermined operation is performed is transmitted. Therefore, it is possible to obtain desired related information that matches the operation timing on the reproducing side, and it is possible to prevent inconvenience that related information that is not originally intended is sent.
[0011]
Furthermore, a communication device according to a third aspect of the present invention is the communication device according to the first or second aspect, wherein the reproduction of the streaming data is interrupted until the printout and / or the display output of the related information is completed. Then, after completion of the print output and / or the display output, the reproduction of the streaming data is restarted from the beginning or from the interruption.
[0012]
According to such a communication device, in addition to the effect of the communication device according to claim 1 or 2, the reproduction of the streaming data is interrupted until a print result or a display result of the related information is obtained, and the print result or the print result is interrupted. When the display result is obtained, the reproduction of the streaming data is resumed from the beginning or from the point of interruption, so that it is possible to watch the reproduction sound or the reproduction image based on the streaming data again while watching the print result and the display result of the related information.
[0013]
A communication device according to a fourth aspect of the present invention is the communication device according to the first or second aspect, wherein the reproduction of the streaming data is interrupted until the printout and / or the display output of the related information is completed. After completion of the print output and / or the display output, a request to retransmit another streaming data is transmitted to the server device, and the another streaming data transmitted in response thereto is transmitted. Play while receiving.
[0014]
According to such a communication device, in addition to the effect of the communication device according to claim 1 or 2, when a print result or a display result of the related information is obtained, streaming data different from the original is reproduced. For example, it is possible to play different streaming data from the beginning, which is closely related to the related information in general, and it is possible to read through the print result and display result of the related information but also play the sound and image based on the streaming data throughout. You can enjoy.
[0015]
Further, the server device of the invention described in claim 5 is a server device having a function of distributing streaming data to a communication device on a network, wherein the streaming device distributes the streaming data to the communication device. A related information request receiving unit for receiving a request for related information relating to the content of the streaming data being reproduced, which is sent from the communication device; and the communication device receiving the request by the related information request receiving unit. And a related information transmitting means for transmitting the related information to the user.
[0016]
According to such a server device, when a request is received from a communication device of the distribution destination during distribution of streaming data, related information corresponding to the request is transmitted to the communication device. The related information derived from the streaming data can also be used, and by preparing the related information derived from the streaming data in association with the streaming data, the related information regarding the streaming data can be effectively used.
[0017]
A server device according to a sixth aspect of the present invention is the server device according to the fifth aspect, wherein the request includes a request for the related information during reproduction of the streaming data on the communication device. And a time stamp indicating a reproduction time at the time when the predetermined operation is performed, and the related information transmitting unit transmits the relevant information corresponding to the time stamp to the communication device.
[0018]
According to such a server device, in addition to the effect of the server device according to claim 5, by receiving the time stamp, the reproduction content at the time when a predetermined operation is performed in the communication device of the distribution destination is supported. Since the related information can be transmitted reliably, it is possible to send desired related information that matches the operation timing on the reproducing side, and it is possible to prevent inconvenience of transmitting related information that is not originally intended.
[0019]
Further, the communication method according to the invention described in claim 7, wherein the streaming data is transmitted between a server device that distributes streaming data and a communication device that receives and reproduces the streaming data transmitted from the server device. A communication method for performing communication in conjunction with transmission and reception of the streaming data, wherein in the communication device, when the streaming data is reproduced, a predetermined operation for requesting related information related to the content being reproduced is performed. A related information request transmitting step of transmitting the request to the server device, and, in the server device, a related information request receiving step of receiving the request sent from the communication device that has performed the related information request transmitting step, In the server device, the related information When the request is received by a quest receiving step, a related information transmitting step of transmitting the related information to the communication device, and the communication device, wherein the communication device sends the related information from the server device that has performed the related information transmitting step. A related information receiving step of receiving related information; and a related information outputting step of printing and / or displaying and outputting the related information received through the related information receiving step in the communication device. I do.
[0020]
According to such a communication method, the communication device according to claim 1 and the server device according to claim 5 can exchange streaming data and related information while cooperating with each other. The same effects as those of the communication device and the server device described can be obtained.
[0021]
Further, a computer program according to the invention described in claim 8 is a computer program for controlling a communication device having a function of playing while receiving streaming data sent from a server device, During playback, when a predetermined operation for requesting related information related to the content being played is performed, a related information request transmission task for transmitting the request to the server device, and the related information request transmission task A related information receiving task for receiving the related information sent from the server device in response to a request transmission, and a related information output task for printing out and / or displaying the related information received by the related information receiving task And a computer that controls the communication device. Characterized in that to execute the.
[0022]
According to such a computer program, by causing a computer that controls a communication device such as a personal computer system or a facsimile device to execute the same, the same effect as the communication device according to the first aspect can be obtained.
[0023]
Further, the computer program according to the ninth aspect of the present invention is a computer program for controlling a server device having a function of delivering streaming data to a communication device on a network. A related information request receiving task for receiving a request for related information relating to the content of the streaming data being reproduced, which is sent from the communication device during distribution of the streaming data; and Upon receipt of the request, the computer that controls the server device executes a related information transmission task of transmitting the related information to the communication device.
[0024]
According to such a computer program, the same effects as those of the server device according to the fifth aspect can be obtained by causing a computer that controls a server device such as a streaming server on the Internet to execute the same.
[0025]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.
[0026]
FIG. 1 is a network configuration diagram showing a communication device and a server device according to the present invention.
[0027]
The communication device comprises a so-called personal computer 1 and a printer 2 connected thereto. The personal computer 1 is connected to the Internet 5 by a broadband connection method via a splitter 3 and an ADSL modem 4 installed in the house. Always connected. The server device is a distribution source of so-called Web pages and streaming data existing on the Internet 5, and has a function as the Internet server 6. Incidentally, a facsimile device 8 and a telephone are connected to the other port of the splitter 3.
[0028]
FIG. 2 is a functional block diagram showing the configuration of the personal computer 1 and its peripherals. The personal computer 1 has a control unit 10 such as a CPU and a ROM, a main storage unit 20 such as a RAM, an auxiliary storage unit 30 such as a hard disk, and a network connection unit 40 such as a network interface card, except for a printing unit 80 functioning as the printer 2. , An operation unit 50 such as a keyboard and a mouse, a speaker unit 60 such as a speaker, and a display unit 70 such as a display device. The main storage unit 20, the auxiliary storage unit 30, and the network connection unit 40 are connected to the control unit 10 via an internal interface 90, and the operation unit 50, the speaker unit 60, the display unit 70 via an external interface 91. , A printing unit 80 are connected.
[0029]
The control unit 10 executes a browser task 12, a playback player task 13, a speaker output task 14, a display processing task 15, a print processing task 16, and the like under task management by the supervisor 11. The supervisor 11 is a program execution unit based on the OS 31 stored in the auxiliary storage unit 30, and the tasks 12 to 16 are program execution units based on application software and utility software stored in the auxiliary storage unit 30.
[0030]
The browser task 12 is further executed in functional units such as a request transmission task 120 and a data reception task 121. According to the request transmission task 120, a request (transmission request information) to transmit the data together with a URL (Uniform Resource Locators) indicating the location of the Web page or the streaming data is transmitted through the network connection unit 40. According to the data reception task 121, a Web page or the like received from the Internet server 6 is transferred to the display processing task 15. The reproduction player task 13 is further executed for each function such as a request transmission task 130, a data reception task 131, and a buffer reproduction task 132. According to the request transmission task 130, in addition to the URL of the streaming data to be viewed and a request to transmit the URL, the URL of the related information relating to the content of the streaming data being reproduced at the present time. And a request to transmit the related information are transmitted through the network connection unit 40. For example, in the case of streaming data configured to sequentially reproduce a plurality of songs, the related information means information expressing lyrics, titles, singer names, and the like related to each song on a text basis. According to the data receiving task 131, the streaming data received from the Internet server 6 is transferred to the buffer reproducing task 132, and the received related information is transferred to the print processing task 16. According to the buffer reproduction task 132, streaming data is reproduced while performing buffering, and audio data and movie data as a reproduction result are transferred to the speaker output task 14 and the display processing task 15.
[0031]
According to the speaker output task 14, the speaker unit 60 is controlled based on the received Web page and audio data included in the streaming data, and the speaker unit 60 emits voice, music, and the like. According to the display processing task 15, the display unit 70 is controlled based on the movie data included in the streaming data or the Web page itself, and an image is displayed on the screen of the display unit 70. According to the print processing task 16, printing is performed by controlling the printing unit 80.
[0032]
The main storage unit 20 provides an area 21 for loading a program to the control unit 10, and also provides a printer buffer area 22, a display data storage area 23, a streaming data buffer area 24, and the like. In the auxiliary storage unit 30, in addition to the OS 31 as a basic system program, various application software and utility software such as a WWW browser 32, a playback player 33, a printer driver 34, a network driver 35, and the like are stored by installation. The network connection unit 40 exchanges data between the control unit 10 and the ADSL modem 4. The operation unit 50 transmits input information by key input or click to the control unit 10. The speaker unit 60 emits voice, music, and the like under the control of the control unit 10. The display unit 70 displays a moving image or a still image under the control of the control unit 10. The printing unit 80 performs printing under the control of the control unit 10.
[0033]
FIG. 3 is a functional block diagram illustrating the configuration of the Internet server 6. In general, a WWW server that enables browsing of a Web page and a streaming server that distributes streaming data are individually constructed, but in the present embodiment, these server functions are provided by one Internet server 6. It is assumed that they are provided together. The Internet server 6 is physically a personal computer except that a large-capacity hard disk for storing streaming data having a relatively large data amount and a mechanism for efficiently distributing data are provided. It is not different from the main body configuration.
[0034]
The Internet server 6 includes a request receiving unit 600, a URL switch 610, a web page URL table 620, a streaming data URL table 630, a related information specifying URL table 640, a web page storage unit 650, a streaming data storage unit 660, and a related information storage unit 670. , And a data transmission unit 680.
[0035]
The request receiving unit 600 receives a request to transmit Web pages, streaming data, and related information together with their URLs, and transfers the received information to the URL switch 610. The URL switch 610 distributes a request to each of the tables 620 to 640 based on the URL from the request receiving unit 600. The Web page URL table 620 indicates the correspondence between the Web page URL and the storage location of the Web page in the Web page storage unit 650, and is referred to when specifying the Web page corresponding to the request. The streaming data URL table 630 indicates the correspondence between the streaming data URL and the storage location of the streaming data in the streaming data storage unit 660, and is referred to when specifying the streaming data corresponding to the request. The related information specifying URL table 640 indicates a correspondence relationship between a time stamp or a related information specifying URL described later and a storage location of the related information in the related information storage unit 670, and is used to specify the related information corresponding to the request. Referred to. The Web page storage unit 650 stores various Web pages in, for example, HTML (Hypertext Markup Language) format. The streaming data storage unit 660 stores various streaming data as audio data and movie data. The related information storage section 670 stores related information related to a point in time during the reproduction of streaming data. The data transmission unit 680 transmits the data called from the storage units 650 to 670 in response to the request to the personal computer 1 that is the request source.
[0036]
Next, the main points will be described.
[0037]
For example, the personal computer 1 receives streaming data from the Internet server 6 and sequentially reproduces a plurality of songs. For the song currently playing at the time of the reproduction, the personal computer 1 requests related information regarding the lyrics of the song. When a key input or a click operation for printing out is performed, a time stamp indicating the reproduction time at the time of the operation is sent to the Internet server 6 in a request for the related information.
[0038]
In the Internet server 6, related information representing the lyrics of the song being reproduced at the time of operation based on the time stamp is specified on a text basis, and the related information is sent to the personal computer 1.
[0039]
Then, on the personal computer 1 side, printing is performed by the printer 2 based on the received related information, and the lyrics of the song reproduced at the time of operation are obtained as a print result. Thus, simply playing back the streaming data will only allow the user to view the music or video based on the streaming data, but according to the present embodiment, it is possible to separately obtain the relevant information related to the point in time during the playback. It is.
[0040]
Next, the basic operation will be described in detail with reference to a flowchart.
[0041]
FIG. 4 is a flowchart showing a procedure for receiving and reproducing streaming data in the personal computer 1. Note that, on the personal computer 1, a Web page is displayed on the display unit 70, and it is immediately after a link for streaming content arranged in the Web page is designated by the user.
[0042]
When the link for the streaming content is specified by the user, the control unit 10 of the personal computer 1 requests the Internet server 6 to transfer the metafile. Upon receiving the metafile sent from the Internet server 6 accordingly, the control unit 10 transmits the metafile to the reproduction player task 13. The metafile contains the URL of the streaming data. In the reproduction player task 13, a request to start transmission of streaming data is transmitted to the Internet server 6 based on the streaming data URL included in the metafile by the request transmission task 130 (S1).
[0043]
Upon receiving the streaming data sent from the Internet server 6 in response (S2: YES), the control unit 10 sets the reproduction flag to "1" (S3), and further starts measuring the reproduction time. (S4) The reproduction process of the received streaming data is started (S5). According to the streaming data reproducing process, a process of simultaneously reading and writing data at high speed by the FIFO method while simultaneously storing the received streaming data in the streaming buffer area 24 to a certain extent is performed. Incidentally, the reproduction flag is status information indicating the reproduction status of the streaming data, and is held at “0” before the reproduction.
[0044]
When the user performs a key input or a click operation for acquiring related information during the reproduction of the streaming data (S6: YES), the control unit 10 executes a subroutine as an interrupt process and starts the reproduction. A time stamp indicating the elapsed time (reproduction time) up to the operation time point is obtained (S21), and a request to start transmission of related information at the operation time point including this time stamp is transmitted to the Internet server 6. (S22). It should be noted that streaming data is being reproduced even during execution of the subroutine.
[0045]
Thereafter, the control unit 10 sets the print flag to "1" (S23), and monitors the reception status of the related information specifying URL sent from the Internet server 6 in response to the request (S24). Incidentally, the print flag is status information indicating the printing status of the related information, and is held at “0” before printing.
[0046]
When receiving the related information specifying URL from the Internet server 6 (S24: YES), the control unit 10 transmits the received related information specifying URL to the Internet server 6 (S25). When the related information specifying URL cannot be received from the Internet server 6 (S24: NO), the control unit 10 monitors the reception status of the related information specifying URL until the specified time has elapsed. If not received, a message to that effect is displayed on the display unit 70, and the process proceeds to S6: NO and subsequent steps.
[0047]
When the related information corresponding to the transmitted related information specifying URL is received from the Internet server 6 (S26: YES), the control unit 10 causes the printer 2 to print the received related information (S27). Thereby, even during the reproduction while receiving the streaming data, the related information requested at the point of the reproduction can be acquired from the Internet server 6 and printed. If the related information cannot be received from the Internet server 6 (S26: NO), the control unit 10 monitors the reception status of the related information until the specified time elapses. Displays a message to that effect on the display unit 70, and then proceeds to S6: NO.
[0048]
Thereafter, when the reproduction of the streaming data is completed (S7: YES), the control unit 10 sets the reproducing flag to "0" (S8) and determines whether or not the print flag is set to "1". (S9).
[0049]
When the print flag is “1” (S9: YES), the control unit 10 further determines whether or not the printing process of the related information has already been completed (S10).
[0050]
If the printing process has been completed (S10: YES), the control unit 10 sets the print flag to “0” (S11), and ends the streaming data reception / reproduction process.
[0051]
In S10, when the printing process is continuing (S10: NO), the control unit 10 waits until the printing process is completed.
[0052]
In S9, when the print flag is “0” (S9: YES), the control unit 10 ends the streaming data reception / reproduction processing as it is.
[0053]
In S7, if the reproduction of the streaming data has not been completed (S7: NO), the control unit 10 returns to S5 and continues the reproduction processing of the streaming data.
[0054]
In S6, when no key input or click operation for acquiring related information is performed during the reproduction of the streaming data (S6: NO), the control unit 10 proceeds to S7 as a normal main routine.
[0055]
In S2, if the streaming data cannot be received from the Internet server 6 (S2: NO), the control unit 10 monitors the reception status of the streaming data until the specified time has elapsed, but cannot receive the streaming data even after the specified time has elapsed. In this case, after displaying a message to that effect on the display unit 70, the streaming data reception / reproduction processing ends.
[0056]
FIG. 5 is a flowchart showing the procedure of streaming data distribution processing in the Internet server 6.
[0057]
In the Internet server 6, when the request receiving unit 600 receives a request for streaming data from the personal computer 1 (S31: YES), the streaming data URL table 630 is searched for streaming data corresponding to the streaming data URL included in the request. I do. The streaming data obtained as a search result is read from the streaming data storage unit 660, and the data transmission unit 680 transmits the streaming data to the personal computer 1 (S32).
[0058]
Thereafter, when the request for the related information including the time stamp is received from the personal computer 1 during reproduction while receiving the streaming data (S33: YES), the related information specifying URL corresponding to the time stamp is stored in the related information specifying URL table 640. (S34). The related information specifying URL obtained as a search result is directly transmitted to the personal computer 1 through the data transmission unit 680 (S35).
[0059]
When there is a reply from the personal computer 1 about the transmitted related information specifying URL (S36: YES), the related information corresponding to the related information specifying URL is searched from the related information specifying URL table 640, and the related information obtained as a search result is obtained. Is transmitted to the personal computer 1 through the data transmission unit 680 (S37).
[0060]
When the transmission of the related information is completed (S38: YES), it is determined whether there is a notification that the reception of all the streaming data has been completed from the personal computer 1 (S39). S39: YES), end this streaming data distribution process.
[0061]
In S39, when there is no notification of the completion of the reception (S39: NO), the process returns to S32 to continue the transmission of the streaming data.
[0062]
If the transmission of the related information has not been completed in S38 (S38: NO), the process returns to S37 and continues the transmission of the related information.
[0063]
In S36, when there is no reply from the personal computer 1 for the transmitted related information specifying URL (S36: NO), the process proceeds to S39.
[0064]
In S33, when there is no particular request for the related information (S33: NO), the process proceeds to S39.
[0065]
In S31, if there is no request for streaming data (S31: NO), the process waits until there is a request.
[0066]
Therefore, according to the above-described embodiment, there are points of interest and details to be known during the reproduction of streaming data on the personal computer 1. At this time, key input and click operations for acquiring relevant information are performed. By doing so, it is possible to obtain and print the relevant information relating to the time from the Internet server 6, so that only one piece of streaming data can be used for multiple purposes, and the related information derived from the streaming data can be effectively used. Can be.
[0067]
Also, a time stamp indicating the playback time at the time of operation is transmitted from the personal computer 1 to the Internet server 6 while being included in the request for the related information, and the playback content at the time of operation is transmitted from the Internet server 6 based on the time stamp. Is transmitted, so that it is possible to acquire the relevant information that matches the operation timing on the personal computer 1 on the reproducing side, and to prevent the inconvenience that the related information that is not originally intended by the user is transmitted. be able to.
[0068]
Further, another embodiment will be described. In addition, since other embodiments are common in many points with the above-mentioned embodiment, these common points are denoted by the same reference numerals and the like, and description thereof is omitted, and different points will be described with emphasis.
[0069]
FIG. 6 is a functional block diagram illustrating a configuration of an Internet server according to another embodiment.
[0070]
According to the Internet server according to another embodiment, streaming data that enables a plurality of songs to be sequentially reproduced is distributed, and related information for printing lyrics of each song with respect to the streaming data is also distributed. Then, after the distribution of the related information, the karaoke data including only the karaoke music is distributed as streaming data.
[0071]
Therefore, the streaming data storage unit 661 stores streaming data as song information including singing voice, and also stores karaoke data of accompaniment without singing voice as streaming data. The streaming data URL table 631 describes the correspondence between the streaming data URL including the karaoke data URL and the storage location of the streaming data in the streaming data storage unit 661. Further, the related information specifying URL table 641 describes the storage location of the related information in the related information storage unit 670, and also stores the time stamp, the related information specifying URL, and the storage location of the karaoke data in the streaming data storage unit 661. The correspondence is also described.
[0072]
FIG. 7 is a flowchart showing a procedure for receiving and reproducing streaming data according to another embodiment. In this flowchart, streaming data means data including singing voice, and karaoke data means data not including singing voice.
[0073]
By executing S41 to S45 in the same manner as S1 to S5 in FIG. 4, if the user performs a key input or a click operation for acquiring related information during the reproduction of the streaming data (S46: YES), an interruption process is performed. The subroutine is executed, and the control unit 10 ends the reproduction of the streaming data (S51), and sets the reproducing flag to “0” (S52). That is, according to the subroutine executed at this time, the reproduction of the streaming data is interrupted, and the execution of the main routine is exclusively controlled.
[0074]
Then, the control unit 10 executes S53 to S55 in the same manner as S21 to S23 in FIG. 4, but thereafter, the control unit 10 receives the related information specifying URL and the karaoke data URL transmitted in response to the request. The situation is monitored (S56).
[0075]
When receiving the related information specifying URL and the karaoke data URL from the Internet server (S56: YES), the control unit 10 first transmits the received related information specifying URL to the Internet server (S57). If the related information specifying URL and the karaoke data URL cannot be received (S56: NO), the control unit 10 monitors the reception status of the related information specifying URL until the specified time has elapsed. If the data cannot be received, a message to that effect is displayed on the display unit 70, and then the streaming data reception / reproduction processing ends.
[0076]
When the related information corresponding to the transmitted related information specifying URL is received from the Internet server (S58: YES), the control unit 10 causes the printer 2 to print the received related information (S59). Thus, while the song including the singing voice is being reproduced while receiving the streaming data, the reproduction can be temporarily stopped, and the related information including the lyrics of the song can be acquired from the Internet server 6 and printed. If the related information cannot be received from the Internet server 6 (S58: NO), the control unit 10 monitors the reception status of the related information until the specified time elapses. Displays a message to that effect on the display unit 70, and then ends the streaming data reception / reproduction processing.
[0077]
Thereafter, when the printing process of the related information ends (S60: YES), the control unit 10 sets the print flag to “0” (S61), and then requests that the karaoke data corresponding to the related information be transmitted. Is transmitted to the Internet server (S62). If the printing process of the related information is being performed (S60: NO), the control unit 10 returns to S59 and continues the printing process.
[0078]
When receiving the karaoke data transmitted from the Internet server in response to the karaoke data request (S63: YES), the control unit 10 performs a reproduction process while receiving the karaoke data (S64). The control unit 10 monitors the reception status of the karaoke data until the specified time elapses. If the reception status cannot be received even after the specified time elapses, the control unit 10 displays a message to that effect on the display unit 70 and the like. This streaming data reception / reproduction processing ends.
[0079]
When the reproduction of the karaoke data is finally completed (S65: YES), the control unit 10 ends the streaming data reception / reproduction processing. If the karaoke data is being reproduced (S65: NO), the control unit 10 returns to S64 and continues the reproduction process.
[0080]
Attention is paid to the original main routine again. When the reproduction of the streaming data is completed (S46: NO) without performing the operation for acquiring the related information (S46: NO), the control unit 10 sets the reproduction flag to “ON”. Is set to "0" (S48), and the streaming data reception / reproduction processing is terminated as it is.
[0081]
FIG. 8 is a flowchart showing the procedure of streaming data distribution processing according to another embodiment.
[0082]
After executing S71 and S72 in the same manner as S31 and S32 in FIG. 5, if a request for related information including a time stamp is received from the personal computer 1 during reproduction while receiving streaming data (S73: YES), the Internet server Moves to a subroutine as an interrupt process, interrupts the transmission of streaming data (S81), and searches the related information specifying URL table 641 for the related information specifying URL corresponding to the time stamp (S82). The related information specifying URL obtained as a search result is transmitted to the personal computer 1 through the data transmitting unit 680 as it is together with the corresponding karaoke data URL (S83).
[0083]
When there is a reply from the personal computer 1 about the transmitted related information specifying URL (S84: YES), the related information corresponding to the related information specifying URL is searched from the related information specifying URL table 641, and the related information obtained as a search result is obtained. Is transmitted to the personal computer 1 through the data transmission unit 680 (S85). If there is no reply with respect to the transmitted related information specifying URL (S84: NO), the streaming data distribution process ends.
[0084]
When the transmission of the related information is completed (S86: YES), it is determined whether there is a request for the karaoke data from the personal computer 1 (S87). When the request for the karaoke data is received (S87: YES), The corresponding karaoke data is transmitted to the personal computer 1 (S88). If the related information is being transmitted (S86: NO), the process returns to S85 and the transmission of the related information is continued. If there is no request for karaoke data (S87: NO), the streaming data distribution process ends.
[0085]
Thereafter, when there is a notification of completion of reception for all karaoke data (S89: YES), the streaming data distribution process ends. If there is no notification of the completion of the reception (S89: NO), the process returns to S88 and the transmission of the karaoke data is continued.
[0086]
Paying attention again to the original main routine, if there is no particular request for the related information from the personal computer 1 in S73 (S73: NO), it is determined whether there is a notification that the reception of all the streaming data from the personal computer 1 is completed. (S74), and if there is a notification of completion of reception (S74: YES), the streaming data distribution process ends.
[0087]
If there is no notification of the completion of the reception in S74 (S74: NO), the process returns to S72 to continue the transmission of the streaming data.
[0088]
Therefore, according to the other embodiment described above, the reproduction of the streaming data including the original singing voice is interrupted on the personal computer 1 in response to the request for the related information, and the related information including the lyrics of the song is responded to the request. Is obtained, the karaoke data different from the original is reproduced, so that the user can enjoy singing along with the karaoke data while looking at the lyrics by looking through the printing result of the related information.
[0089]
Further, another embodiment will be described. Note that this embodiment also has many points in common with the above-described embodiment. Therefore, these common points are denoted by the same reference numerals and the like, and description thereof is omitted, and different points will be described with emphasis.
[0090]
FIG. 9 is an explanatory diagram for explaining a related information specifying URL table included in the Internet server according to another embodiment.
[0091]
According to the Internet server according to another embodiment, the streaming data distribution service requires a login procedure due to membership or the like, and a user level is set in advance for each user who can log in.
[0092]
Therefore, although not shown, the streaming data storage unit and the related information storage unit store streaming data and related information corresponding to each user level, and the related information specifying URL tables are indicated by reference numerals 640A, 640B, and 640C. It is constructed separately for each user level. The related information specifying URL table shown by reference numeral 640A corresponds to the user level "0", the related information specifying URL table shown by reference numeral 640B corresponds to the user level "1", and the related information specifying URL table shown by reference numeral 640C corresponds to the user level. It shall correspond to level “2”.
[0093]
FIG. 10 is a flowchart showing a procedure for receiving and reproducing streaming data according to another embodiment. S101 to S127 other than S91 and S92 shown in this flowchart have substantially the same contents as S1 to S27 in FIG.
[0094]
As shown in FIG. 10, the control unit 10 transmits a login request to the Internet server before transmitting a request for streaming data (S91). The login request includes an ID and a password given to the user, and is automatically transmitted by being registered as setting information of the reproduction player 33 in advance.
[0095]
Thereafter, when login is permitted by the Internet server (S92: YES), the control unit 10 transmits a request for streaming data (S101).
[0096]
If the login is not permitted in S92 (S92: NO), the control unit 10 displays a message to that effect on the display unit 70, and ends the streaming data reception / playback processing.
[0097]
Note that streaming data and related information sent from the Internet server after the login is permitted are limited to those corresponding to the user level confirmed by the Internet server with the permission of the login. Therefore, for example, when the login is permitted at the user level “0”, the streaming data and the related information corresponding to the user levels “1” and “2” cannot be obtained, and the user level “0” corresponds to the user level “0”. Streaming data can be reproduced and viewed, and related information can be printed.
[0098]
FIG. 11 is a flowchart illustrating a procedure of a distribution process of streaming data according to another embodiment.
[0099]
In the Internet server according to another embodiment, when the request receiving unit 600 receives a login request from the personal computer 1 (S131: YES), it is checked whether or not the user is a registered user (S132). At this time, the user level is also confirmed.
[0100]
If the login is permitted based on the collation result (S133: YES), the user level is maintained (S134), and the permission of the login is notified to the requesting personal computer 1 (S135).
[0101]
Thereafter, S136 to S138 having the same contents as S31 to S33 in FIG. 5 are executed, and when a request for the related information is received (S138: YES), the related information is obtained based on the user level held in S134. It is determined whether or not the user is capable of (S139). In other words, there are some users who are permitted to log in but only receive the streaming data distribution service and are not allowed to obtain related information.
[0102]
If the user can acquire related information (S139: YES), a related information specifying URL corresponding to the user level is searched from the related information specifying URL tables 640A to 640C (S140). The related information specifying URL obtained as a search result is transmitted to the personal computer 1 through the data transmission unit 680 as it is (S141). Thereafter, S142 to S145 having the same contents as S36 to S39 in FIG. 4 are executed.
[0103]
In S139, if the user has not been permitted to acquire the related information (S139: NO), a notification indicating that printing is not possible is transmitted to the personal computer 1, and the process returns to S137 to continue transmitting the streaming data.
[0104]
In step S133, if the login cannot be permitted (S133: NO), a notice of the login disapproval is transmitted to the personal computer 1, and the process returns to the first step S131 to wait for the reception of the login request again.
[0105]
If there is no login request in S131 (S131: NO), the process waits until a login request is accepted.
[0106]
Therefore, according to such another embodiment, on the personal computer 1, it is possible to acquire streaming data and related information according to the user level, and acquire and print different related information for each user. it can.
[0107]
Note that the present invention is not limited to the above embodiments.
[0108]
In the above embodiment, the Internet 5 is always connected by ADSL, but may be always connected by CATV network or FTTH. Further, the connection is not limited to the constant connection, but may be a dial-up connection.
[0109]
The communication device is mainly configured with the personal computer 1 to which the printer 2 is connected, but may be configured only with a facsimile device having an Internet connection function.
[0110]
Each of the above embodiments is based on the premise that streaming data mainly composed of audio data is used. Related information related to the content of the moving image, for example, advertisement information may be printed or displayed.
[0111]
In addition, the streaming data distribution service can be applied to, for example, an advertisement service and a used car auction service, in addition to music services such as song information and karaoke data.
[0112]
According to the flowchart of FIG. 4, the related information can be printed during the reproduction of the streaming data, but the reproduction of the streaming data is interrupted until the printing processing of the related information is completed, and the streaming data is reproduced from the beginning after the printing of the related information is completed. The reproduction may be started or the reproduction may be restarted from the data at the point of interruption.
[0113]
As the printing method, in addition to the ink jet method, an electrophotographic method using toner as a printing material, a sublimation method using an ink ribbon, or a heat-sensitive method may be adopted.
[0114]
【The invention's effect】
As described above, according to the communication device of the first aspect of the present invention, there are points of interest and details to be known during the reproduction of streaming data, and a predetermined operation for requesting these points is performed. By doing so, it is possible to obtain related information relating to the content being played back from the server device and print or display the same, so that a single piece of streaming data can be used for multiple purposes, and the related information derived from the streaming data can be used. Information can be used effectively.
[0115]
According to the communication device of the second aspect of the present invention, in addition to the effect of the communication device of the first aspect, by transmitting a time stamp, the reproduction content at the time when a predetermined operation is performed is supported. Since the related information is transmitted, desired related information that matches the operation timing on the reproducing side can be obtained, and the inconvenience that related information that is not originally intended is transmitted can be prevented.
[0116]
Furthermore, according to the communication device of the invention described in claim 3, in addition to the effect of the communication device described in claim 1 or 2, the reproduction of the streaming data is performed until the print result or the display result of the related information is obtained. When the print result or the display result is obtained, the reproduction of the streaming data is resumed from the beginning or the point of interruption, so that the reproduction sound and the image based on the streaming data are again observed while viewing the print result and the display result of the related information. Can be watched.
[0117]
According to the communication device of the invention described in claim 4, in addition to the effect of the communication device of claim 1 or 2, if a printing result or a display result of the related information is obtained, a streaming different from the initial one is obtained. Since the data is reproduced, for example, it is possible to reproduce different streaming data from the beginning, which is closely related to the related information in general, and it is possible to read the printing result and the display result of the related information but also to make the streaming data throughout. It is possible to enjoy the reproduction sound and the reproduction image based on the reproduction sound.
[0118]
Further, according to the server device of the invention described in claim 5, when a request is received from the communication device of the distribution destination during distribution of the streaming data, related information corresponding to the request is transmitted to the communication device. Even one piece of streaming data can be used for multiple purposes, and by preparing related information derived from the streaming data in association with the streaming data, related information about the streaming data can be effectively used.
[0119]
According to the server device of the invention described in claim 6, in addition to the effect of the server device described in claim 5, by receiving the time stamp, a predetermined operation is performed in the communication device of the distribution destination. Since the related information corresponding to the playback content at the time can be reliably transmitted, desired related information that matches the operation timing of the playback side can be transmitted, and the inconvenience of transmitting related information that is not originally intended is prevented. Can be.
[0120]
Furthermore, according to the communication method of the invention described in claim 7, the communication device described in claim 1 and the server device described in claim 5 can exchange streaming data and related information while cooperating with each other. The same effects as those of the communication device and the server device according to the first and fifth aspects can be obtained.
[0121]
Further, according to the computer program of the invention described in claim 8, by causing a computer that controls a communication device such as a personal computer system or a facsimile machine to execute the same, the same computer program as in claim 1 is executed. The effect can be obtained.
[0122]
Further, according to the computer program of the ninth aspect of the present invention, by causing a computer that controls a server device such as a streaming server on the Internet to execute the same, the same effect as the server device of the fifth aspect is achieved. Can be obtained.
[Brief description of the drawings]
FIG. 1 is a network configuration diagram showing a communication device and a server device according to the present invention.
FIG. 2 is a functional block diagram showing a configuration of a personal computer and its peripherals.
FIG. 3 is a functional block diagram illustrating a configuration of an Internet server.
FIG. 4 is a flowchart showing a procedure for receiving and reproducing streaming data in a personal computer.
FIG. 5 is a flowchart showing a procedure of streaming data distribution processing in the Internet server.
FIG. 6 is a functional block diagram illustrating a configuration of an Internet server according to another embodiment.
FIG. 7 is a flowchart illustrating a procedure for receiving and reproducing streaming data according to another embodiment.
FIG. 8 is a flowchart illustrating a streaming data distribution processing procedure according to another embodiment.
FIG. 9 is an explanatory diagram illustrating a related information specifying URL table included in an Internet server according to another embodiment.
FIG. 10 is a flowchart showing a streaming data reception / reproduction processing procedure according to another embodiment.
FIG. 11 is a flowchart showing a streaming data distribution processing procedure according to another embodiment.
[Explanation of symbols]
1 Personal computer
2 Printer (related information output means)
3 splitter
4 ADSL modem
5 Internet
6 Internet server
10 control unit (related information request transmitting means, related information receiving means)
20 Main memory
30 auxiliary storage unit
40 Network connection
50 Operation unit
60 Speaker section
70 Display
80 Printing unit (printer)
600 Request receiving unit (Related information request receiving means)
610 URL switch
620 Web page URL table
630 Streaming Data URL Table
640 related information specifying URL table
650 Web page storage
660 streaming data storage
670 related information storage unit
680 Data transmission unit (related information transmission means)

Claims (9)

A communication device having a function of playing while receiving streaming data sent from a server device,
During the reproduction of the streaming data, when a predetermined operation for requesting related information related to the content being reproduced is performed, a related information request transmitting unit that transmits the request to the server device;
Related information receiving means for receiving the related information sent from the server device in response to the transmission of the request by the related information request transmitting means,
A communication device, comprising: related information output means for printing out and / or displaying the related information received by the related information receiving means. The related information request transmission unit measures a reproduction time from the start to the end of reproduction of the streaming data, and transmits a time stamp indicating a reproduction time at the time when the predetermined operation is performed in the request. 2. The communication device according to claim 1, wherein the related information receiving unit receives the related information sent from the server device in accordance with the time stamp. Suspending the reproduction of the streaming data until the print output and / or the display output of the relevant information is completed, and after the print output and / or the display output are completed, restart the reproduction of the streaming data from the beginning or the interruption point; The communication device according to claim 1. The reproduction of the streaming data is suspended until the printout and / or the display output of the related information is completed, and after the printout and / or the display output is completed, another streaming data is newly retransmitted to the server device. The communication device according to claim 1, wherein the communication device transmits a request to do so, and reproduces the another streaming data while receiving the request. A server device having a function of delivering streaming data to a communication device on a network,
Related information request receiving means for receiving a request for related information related to the content of the streaming data being reproduced, which is sent from the communication device during distribution of the streaming data to the communication device,
A server device comprising: a related information transmitting unit that transmits the related information to the communication device when the request is received by the related information request receiving unit. The request includes a time stamp indicating a reproduction time at a time when a predetermined operation for requesting the related information is performed during the reproduction of the streaming data on the communication device, and the related information transmitting unit includes: The server device according to claim 5, wherein the server transmits the related information corresponding to the time stamp to the communication device. A communication method for performing communication between a server device that distributes streaming data and a communication device that receives and reproduces the streaming data transmitted from the server device in accordance with the transmission and reception of the streaming data. hand,
In the communication device, during the reproduction of the streaming data, when a predetermined operation for requesting related information related to the content during the reproduction is performed, a related information request transmitting step of transmitting the request to the server device; ,
In the server device, a related information request receiving step of receiving the request sent from the communication device that has performed the related information request transmitting step,
In the server device, when the request is received by the related information request receiving step, a related information transmitting step of transmitting the related information to the communication device;
In the communication device, a related information receiving step of receiving the related information sent from the server device that has performed the related information transmitting step,
A communication method, wherein the communication device sequentially executes a related information output step of printing out and / or displaying the related information received through the related information receiving step. A computer program for controlling a communication device having a function of playing while receiving streaming data sent from a server device,
During the reproduction of the streaming data, when a predetermined operation for requesting related information related to the content being reproduced is performed, a related information request transmission task for transmitting the request to the server device;
A related information receiving task for receiving the related information sent from the server device in response to the transmission of the request by the related information request transmitting task,
A computer program that causes a computer that controls the communication device to execute a related information output task that prints and / or displays and outputs the related information received by the related information receiving task. A computer program for controlling a server device having a function of delivering streaming data to a communication device on a network,
A related information request reception task for receiving a request for related information related to the content of the streaming data being reproduced, which is sent from the communication device during distribution of the streaming data to the communication device,
A computer program for causing a computer that controls the server device to execute a related information transmission task of transmitting the related information to the communication device when the request is received by the related information request reception task.

Images