JP2003078954A - Streaming data automatic reproduction system, wireless terminal, and streaming data distributor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a streaming data automatic reproduction system, a wireless terminal and a streaming data distributor that can relieve a user from trouble and complication of viewing from the beginning and minimize the communication cost when radio channel is interrupted during reception of streaming data distributed via a wireless channel network. SOLUTION: When a radio channel is interrupted due to any cause during reproduction of streaming data by a wireless terminal 110, a reception detection means 105 detects interruption of streaming data. A reproduction means 104 reproduces the streaming data until the streaming data stored in a data storage means 102 completes the reproduction. Then a marking means 103 stores a read point of the interrupted streaming data into a mark storage means 101. When the data reception is attained again, the mark information is extracted from the mark storage means 101 and a transmission means 107 makes a request of distributing the streaming data on the way.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a wireless terminal device for reproducing multimedia streaming data such as video and audio distributed via a wireless network, a streaming data distribution device, and a streaming data automatic reproduction system.

[0002]

2. Description of the Related Art Streaming media are effective media for delivering multimedia data such as audio and video using a network having a limited bandwidth. In the related art, a wireless terminal device such as a mobile phone can receive multimedia data such as audio and video and play them back. It is also possible to reproduce multimedia data, mark a point on the time axis that the user wants to view, and start reproduction from that point at any time.

[0003]

However, when the wireless terminal device moves out of the service area or in a place where the reception condition is poor and the reproduction of the streaming data is interrupted, the user must re-execute the reproduction from the beginning of the data. You will re-watch the data you have seen. It is also possible for the user to mark a point on the time axis in advance and play from that point in case the reproduction is interrupted. However, if it is not marked frequently, in the worst case, the data must be viewed from the beginning. These are inconvenient for a user who wants to watch the continuation, such as “an operation for watching the continuation is troublesome” or “cannot be watched from a place where he / she wants to watch”. Further, there is a disadvantage that extra communication cost is required because the same data is received again.

In view of the above problems, the present invention frees the user from the trouble and trouble of watching from the beginning, and an automatic streaming data reproducing system, a wireless terminal device, and a streaming which can minimize the communication cost. An object is to provide a data distribution device. Further, it is an object of the present invention to provide a streaming data automatic reproduction system, a wireless terminal device, and a streaming data distribution device that can be reproduced midway even in the case of live data such as live relay.

[0005]

In order to solve the above-mentioned problems, the first invention of the present application comprises a receiving means for receiving streaming data distributed via a wireless network, and a data storing means for accumulating the streaming data. A wireless terminal device having a reproducing means for taking out streaming data from the data storing means and reproducing it, a data storing means for accumulating streaming data to be distributed via a wireless network, and distribution request information received from the wireless terminal device On the other hand, in a streaming data automatic reproduction system including a streaming data distribution device having a distribution means for distributing streaming data, the wireless terminal device has a reception detection means for detecting whether or not the streaming data can be received. , The reception detection means has detected that reception is impossible. Marking means for marking the read-out point of streaming data at a point, mark information storage means for storing mark information about the read-out point, and mark information from the mark storage means when the reception detecting means detects that the mark information can be received. Reading means, transmitting means for transmitting distribution request information of streaming data together with mark information, receiving means for receiving streaming data redistributed in response to the distribution request information, and reproducing means for automatically reproducing the streaming data And is provided.

Further, the above streaming data distribution apparatus receives the mark information together with the distribution request information, the receiving means, the distribution control means for distributing the streaming data from the read point derived from the mark information, and the read point. And a distribution unit that distributes the streaming data of 1. to the wireless terminal device.

Further, according to the second invention of the present application, a receiving means for receiving the streaming data distributed via the wireless network, a data storing means for storing the streaming data, and a streaming data taken out from the data storing means and reproduced. In a wireless terminal device equipped with a reproducing means for reproducing, a reception detecting means for detecting whether or not streaming data can be received, and a streaming data reading point at the time when the reception detecting means detects that the streaming data cannot be received. It is characterized by comprising marking means for marking and mark information storage means for storing mark information regarding the read point.

The wireless terminal device, when the reception detecting means detects that the reception is possible, means for reading the mark information from the mark storing means, and transmitting means for transmitting the distribution request information of the streaming data together with the mark information.
It is characterized by comprising a receiving means for receiving the streaming data redistributed in response to the distribution request information, and a reproducing means for automatically reproducing the streaming data.

Further, a third invention of the present application is data storage means for accumulating streaming data to be distributed via a wireless network, and distribution means for distributing streaming data in response to distribution request information received from a wireless terminal device. In the streaming data distribution device, the receiving means receives the mark information together with the distribution request information, the distribution control means for controlling the distribution of the streaming data from the read point derived from the mark information, and the streaming data from the read point. Is provided to the wireless terminal device.

Further, according to the fourth invention of the present application, in response to the distribution request information received from the wireless terminal device, the data storage means for accumulating the streaming data to be distributed via the wireless network, the streaming data is transmitted via the wireless network. In a streaming data distribution device including a distribution unit that distributes the data, a detection unit that detects whether or not communication with the wireless terminal device is possible during distribution of the streaming data, and a time point when the detection unit detects that communication is impossible. Marking means for marking the reading point of the streaming data, mark information storing means for storing the mark information about the reading point, and streaming from the reading point derived from the mark information when the distribution request information is received again from the wireless terminal device. Distribution system that controls to distribute data Wherein means, by comprising a delivering device for delivering streaming data from the reading point to the wireless terminal.

[0011]

DETAILED DESCRIPTION OF THE INVENTION First to third embodiments of the present invention will be described in detail with reference to the accompanying drawings. <First Embodiment> A first embodiment of the present invention will be described below with reference to FIGS. 1 and 2
FIG. 1 is a system configuration diagram according to an embodiment of the present invention.
In both figures, the same parts are designated by the same reference numerals. Further, FIG. 3 is a sequence diagram in the present embodiment, and shows a sequence from the interruption of the wireless and the interruption of the streaming reproduction in the wireless environment to the recovery of the streaming reproduction.

In S301, the wireless terminal device 110 issues a viewing request to the streaming data distribution server 108. The streaming data distribution server 108 receives the viewing request from the receiving means 204, and the data storing means 20.
Distribution control means 2 for streaming data accumulated in 1
The transmission means 203 starts distribution from the top of the specified streaming data to the wireless terminal device 110 (S303).

The wireless terminal device 110 includes the reception detecting means 10
If it is determined that the data can be received according to 5, the receiving unit 106
And stores the streaming data in the data storage unit 102 (S305a). Data storage means 10
By temporarily storing the data in No. 2, it is possible to maintain the reproduction to some extent even in a situation where the reception of the video data and the audio data is not synchronized such that the reproduction of the video data and the audio data cannot be synchronized, for example, when reproducing the moving image with sound.

When the data is stored in the data storage means 102, the reproduction means 104 reads out the data from the data storage means 102 in the order of accumulation and reproduces the data (S305a). The next distributed data is received (S305b). The above processing is continued until the streaming data distribution server 108 stops the distribution or the wireless terminal device 110 issues a request to stop the reception.

The wireless terminal device 11 indicates that the wireless data reception is no longer possible while receiving the streaming data.
When it is detected by the reception detection means 105 of 0 (S307), after the reproduction of the data stored in the data storage means 102 is finished, the reproduction data is marked up to what extent (S309). For marking, the marking means 103 acquires a “readout point”, associates it with identification information of streaming data, and stores it as mark information in the mark storage means 101. An example of the read point is shown below. Elapsed time that represents the start of streaming data playback as time 0. A pointer that indicates the byte number of the data.

In the case of the present embodiment, the streaming data distribution server 108 detects a wireless break (S).
After 307), distribution of streaming data is continued.
After that, when it is determined that the wireless terminal device 110 can be received by the reception detection unit 105 (S311), the mark information accumulated in the mark storage unit 101 is transmitted by the transmission unit 107 to the streaming data distribution server 108.
Request to deliver subsequent data (S
313).

In the streaming data distribution server 108, the mark information is received by the receiving means 204, and if the distribution is being continued, it is temporarily stopped (S315). If the distribution has been completed, or if it has stopped, the next processing (S
317) is performed. In S317, the delivery control unit 202 designates “specific streaming data” and “the reading point” derived from the mark information, and delivers the streaming data from the reading point.
The designated streaming data is S305a to S30.
5b is reproduced in the same manner as in the case of 5b (S319a to S31).
9b). This realizes automatic reproduction.

<Second Embodiment> A second embodiment of the present invention will be described below with reference to FIGS. 1, 2 and 4. 1 and 2 are system configuration diagrams in the embodiment of the present invention. In both figures, the same parts are designated by the same reference numerals. Further, FIG. 4 is a sequence diagram in the present embodiment, and shows a sequence from the interruption of the radio and the interruption of the streaming reproduction in the wireless environment to the recovery of the streaming reproduction.

In step S401, the wireless terminal device 110 issues a viewing request to the streaming data distribution server 108. The streaming data distribution server 108 receives the viewing request from the receiving means 204, and the data storing means 20.
Distribution control means 2 for streaming data accumulated in 1
The transmission means 203 starts distribution from the beginning of the specified streaming data to the wireless terminal device 110 (S403).

The wireless terminal device 110 includes the reception detecting means 10
If it is determined that the data can be received according to 5, the receiving unit 106
And stores the streaming data in the data storage unit 102 (S405a). Data storage means 10
By temporarily storing the data in No. 2, it is possible to maintain the reproduction to some extent even in a situation where the reception of the video data and the audio data is not synchronized such that the reproduction of the video data and the audio data cannot be synchronized, for example, when reproducing the moving image with sound. Data storage means 1
When the data is stored in 02, the reproduction unit 104 reads out the data from the data storage unit 102 in the order of accumulation and reproduces the data (S405a).

In the case of the present embodiment, the wireless terminal device 110
Every time streaming data is received, or constant /
Data reception confirmation information (here, AC
The K signal) is transmitted to the streaming data distribution server 108 (S407a). The streaming data is read from the data storage unit 102, and the next distributed data is received (S405b). Then, as in the case of S407a, every time streaming data is received, or
An ACK signal is transmitted to the streaming data distribution server 108 at fixed / indefinite time intervals (S407b). The above processing is continued until the streaming data distribution server 108 stops the distribution or the wireless terminal device 110 issues a request to stop the reception.

During the reception of streaming data, the reception detecting means 10 indicates that the wireless data reception is no longer possible.
5 (S409), the wireless terminal device 110 detects A
The transmission of the CK signal is also stopped (or even if it is transmitted, it does not reach the streaming data distribution server 108). If the ACK signal is not received for the predetermined time, the streaming data distribution server 108 stops the distribution of the streaming data (S404). In this case, the streaming data distribution server 108 can receive and distribute a viewing request from another wireless terminal device 110, which has an advantage of saving resources.

On the other hand, the wireless terminal device 110, after finishing reproducing the data stored in the data storage means 102, marks up to which reproducing the streaming data being received (S411). For marking, the marking means 103 acquires a “readout point”, associates it with identification information of streaming data, and stores it as mark information in the mark storage means 101. An example of the read point is shown below. Elapsed time that represents the start of streaming data playback as time 0. A pointer that indicates the byte number of the data.

After that, when it is judged that the wireless terminal device 110 is receivable by the reception detecting means 105 (S
413), the mark information accumulated in the mark storage unit 101 is transmitted to the streaming data distribution server 108 by the transmission unit 107, and a request is made to distribute subsequent data (S415). The streaming data distribution server 108 receives the mark information by the reception means 204, and if there is no free resource, waits until it becomes free (S417).
If there is a free resource, the next process (S4)
19) is performed.

In S419, the delivery control means 202 derives "specific streaming data" from the mark information.
And "the reading point" are designated, and the streaming data from the reading point is delivered. The designated streaming data is S405a to S407b.
Is reproduced in the same manner as the above (S421a to S421)
b). This realizes automatic reproduction.

<Third Embodiment> A third embodiment of the present invention will be described below with reference to FIGS. 1, 2 and 5. 1 and 2 are system configuration diagrams in the embodiment of the present invention. In both figures, the same parts are designated by the same reference numerals. Further, FIG. 5 is a sequence diagram in the present embodiment, and shows a sequence from the interruption of the radio and the interruption of the streaming reproduction in the wireless environment to the restoration of the streaming reproduction.

In step S501, the wireless terminal device 110 issues a viewing request to the streaming data distribution server 108. The streaming data distribution server 108 receives the viewing request from the receiving means 204, and the data storing means 20.
Distribution control means 2 for streaming data accumulated in 1
The transmission means 203 starts distribution from the beginning of the specified streaming data to the wireless terminal device 110 (S503).

The wireless terminal device 110 includes the reception detecting means 10
If it is determined that the data can be received according to 5, the receiving unit 106
And stores the streaming data in the data storage means 102 (S505a). Data storage means 10
By temporarily storing the data in No. 2, it is possible to maintain the reproduction to some extent even in a situation where the reception of the video data and the audio data is not synchronized such that the reproduction of the video data and the audio data cannot be synchronized, for example, when reproducing the moving image with sound. Data storage means 1
When the data is stored in 02, the reproducing means 104 reads from the data storing means 102 in the order of accumulation and reproduces the data (S505a).

In the case of the present embodiment, the wireless terminal device 110
Every time streaming data is received, or constant /
Data reception confirmation information (here, AC
The K signal) is transmitted to the streaming data distribution server 108 (S507a). The streaming data is read from the data storage unit 102, and the next distributed data is received (S505b). Then, as in the case of S507a, every time streaming data is received, or
An ACK signal is transmitted to the streaming data distribution server 108 at fixed / indefinite time intervals (S507b). The above processing is continued until the streaming data distribution server 108 stops the distribution or the wireless terminal device 110 issues a request to stop the reception.

Reception detection means 10 indicates that wireless data reception is no longer possible while streaming data is being received.
5 (S509), the wireless terminal device 110 detects A
The transmission of the CK signal is also stopped (or even if it is transmitted, it does not reach the streaming data distribution server 108). When the ACK signal is not received for the predetermined time, the streaming data distribution server 108 stops the distribution of the streaming data (S511). In this case, the streaming data distribution server 108 can receive and distribute a viewing request from another wireless terminal device 110, which has an advantage of saving resources.

In the case of the present embodiment, the streaming data distribution server 108 marks the streaming data to what extent the distribution is made (S513).
At this time, it is preferable that the marking position is located ahead of the boundary between the delivered portion and the undelivered portion.
Streaming data distribution server 1 for marking
The marking means (not shown) provided in 08 acquires the "reading point", associates it with the identification information of the streaming data, and stores it as mark information in the mark storage means (not shown). An example of the read point is shown below. Elapsed time that represents the start of streaming data playback as time 0. A pointer that indicates the byte number of the data. After that, when it is determined that the wireless terminal device 110 can be received by the reception detecting unit 105 (S515), information requesting redistribution of streaming data is transmitted to the streaming data distribution server 108 (S51).
7).

On the other hand, the streaming data distribution server 108 retrieves the corresponding mark information from the mark storage means, and waits until there is no free resource (S518). If the resource has a free space, the following process (S519) is performed as it is. In S519, the delivery control unit 202 designates the "specific streaming data" derived from the mark information and the "reading point thereof", and delivers the streaming data from the reading point. The specified streaming data is S50
5a to S507b are reproduced in the same manner (S52).
1a-S521b). This realizes automatic reproduction.

Although the embodiments of the present invention have been described in detail above, the reception detecting means 105 in the above-described first to third embodiments determines whether data can be received or cannot be received as follows. Can be done. However, it is obvious that the present invention is not limited to this. a) When it is determined that data cannot be received due to interruption of wireless Judgment method 1: The electric field strength is below a predetermined value. Judgment method 2: The received data cannot be processed as data. b) When it is determined that data cannot be received due to data quality Judgment method 1: The error rate of the received data is equal to or higher than a predetermined value. Judgment method 2: The rate, number and amount of correctly received data are below a predetermined value. The error rate (rate of correctly received data)
May be set in any of a bit unit, a byte unit, a packet unit, and a frame (one screen) rate (for a moving image).

Although the embodiment of the present invention has been described in detail above, the present invention is not limited to this. For example, when the reception is changed to the reception-enabled state, "immediately reproduces". Alternatively, the user may select either "play when viewing". Further, the reading point is not limited to the “point at the time when the reception is interrupted”, but it is also possible to be the “arbitrary point until the time when the reception is interrupted”. Furthermore, when receiving live data, it is possible that the streaming data delivery server 108 records all the streaming data and delivers the recorded streaming data without delivering the live data in real time. Alternatively, if you record the difference data between the time corresponding to the read point and the current distribution time, the amount of recorded data will be minimal, and you can watch while watching the streaming data that was delivered live as above. it can.

[0035]

As described above, according to the present invention, even if the wireless connection is interrupted during the reception of the streaming data distributed via the wireless network, it is possible to automatically reproduce from the interrupted portion. As a result, it is possible to free the user from the trouble and trouble of watching from the beginning, and to minimize the communication cost. Furthermore, in the case of live data such as live broadcast, if the live is still being performed, you can watch while following the automatic playback, but if you also store the temporal position, you can play back halfway. It will be possible.

[Brief description of drawings]

FIG. 1 is a system configuration diagram that is an embodiment of the present invention.

FIG. 2 is a system configuration diagram that is an embodiment of the present invention.

FIG. 3 is a sequence diagram illustrating the first embodiment of the present invention.

FIG. 4 is a sequence diagram illustrating a second embodiment of the present invention.

FIG. 5 is a sequence diagram illustrating a third embodiment of the present invention.

[Explanation of symbols]

101 mark storage means 102 data storage means 103 marking means 104 playing means 105 reception detecting means 106 receiving means 107 transmission means 108 Streaming data distribution server 110 wireless terminal device 201 data storage means 202 delivery control means 203 means of transmission 204 receiving means

Claims (5)

[Claims] 1. A receiving means for receiving streaming data distributed via a wireless network, a data storing means for accumulating the streaming data, and a reproducing means for taking out the streaming data from the data storing means and reproducing the streaming data. A wireless terminal device, a data storage unit that stores streaming data to be distributed via a wireless network, and a distribution unit that distributes the streaming data in response to distribution request information received from the wireless terminal device. In the streaming data automatic reproduction system including the streaming data distribution device described above, the wireless terminal device cannot receive by the reception detection unit that detects whether or not the streaming data can be received, and the reception detection unit cannot receive the streaming data. Streaming data at the time Marking means for marking the reading point of the data, mark information storing means for storing the mark information about the reading point, and the mark information from the mark storing means when the reception detecting means detects that it is receivable. Means for reading the delivery request information of the streaming data together with the mark information, a receiving means for receiving the streaming data redistributed in response to the delivery request information, and the streaming data automatically And a distribution control for controlling the streaming data distribution device to distribute the streaming data from the read point derived from the mark information, and the receiving unit that receives the mark information together with the distribution request information. Means and the read-out port. Streaming data automatic reproducing system, characterized in that the streaming data from the cement has and a delivery means for delivering to the wireless terminal device. 2. Receiving means for receiving streaming data distributed via a wireless network, data storing means for accumulating the streaming data, and reproducing means for taking out the streaming data from the data storing means and reproducing it. In a wireless terminal device including: a reception detection unit that detects whether or not the streaming data can be received; and a reading point of the streaming data when the reception detection unit detects that the streaming data cannot be received. A wireless terminal device comprising: marking means; and mark information storage means for storing mark information regarding the read-out point. 3. The wireless terminal device according to claim 2, wherein when the reception detecting unit detects that the mark is receivable, a unit for reading the mark information from the mark storing unit, and a distribution request for the streaming data. And a receiver for receiving streaming data redistributed in response to the distribution request information, and a player for automatically playing the streaming data. A characteristic wireless terminal device. 4. Streaming data distribution comprising data storage means for accumulating streaming data distributed via a wireless network, and distribution means for distributing the streaming data in response to distribution request information received from a wireless terminal device. In the apparatus, a receiving unit that receives mark information together with the distribution request information, a distribution control unit that controls distribution of streaming data from a read point derived from the mark information, and streaming data from the read point by the wireless communication. A streaming data distribution device, comprising: a distribution unit that distributes to a terminal device. 5. Data storage means for accumulating streaming data to be distributed via a wireless network, and distribution means for distributing the streaming data to the distribution request information received from the wireless terminal device via the wireless network. In the streaming data distribution apparatus comprising: a detecting unit that detects whether or not communication with the wireless terminal device is possible during the distribution of the streaming data; and streaming data at a time point when the detecting unit detects that communication is impossible. When the distribution request information is received again from the wireless terminal device, the marking means for marking the reading point, the mark information storing means for storing the mark information about the reading point, and the streaming data from the reading point derived from the mark information To control delivery Control means and streaming data distribution apparatus, wherein the streaming data that has and a delivery means for delivering to the wireless terminal device from the read points.