CN1695377A

CN1695377A - Transmission data structure, and method and device for transmitting the same

Info

Publication number: CN1695377A
Application number: CN 200380100750
Authority: CN
Inventors: 井户大治; 松井义德; 杉浦雅贵
Original assignee: Matsushita Electric Industrial Co Ltd
Current assignee: Panasonic Holdings Corp
Priority date: 2002-11-14
Filing date: 2003-11-13
Publication date: 2005-11-09

Abstract

By storing and transmitting information on reproduction of division static medium data contained in static medium transmission data, in static medium transmission data preceding that static medium transmission data, when no division static medium data is received, it is possible to judge whether no division static data is contained from the beginning or certain division static data has been lost. Thus, when using static medium such as Timed Text in streaming type distribution, if the data reception device does not receive static medium data, it is judged whether no next medium data to be displayed is present or medium data has been lost during transmission and cannot be displayed, thereby correctly reporting the medium data loss to a user. Moreover, without increasing pre-buffering, it is possible to reduce the time required for packet loss detection and perform retransmission request.

Description

Transmission data structure and the method and apparatus that sends this transmission data structure

Technical field

The present invention relates to the transmission data structure of a kind of transmission such as Still Media data such as text data, and the method and apparatus that is used to send the Still Media data.

Background technology

3GPP (Third Generation Partnership Project, third generation partnership projects) SA (Service and System Aspect, service and system aspects) WG4 group developed multimedia distribution criteria TS26.234, and 3GPP is the tissue of exploitation 3G (Third Generation) Moblie (W-CDMA) global standards.5.2.0 the multimedia distribution criteria TS26.234 of version has expanded the file of MP4 (ISO/IEC 14496-1:2001) form that can be used for the distribution of download type multimedia, and has defined the data structure of text data (timed text, timing text).This make it not only can be in playing as the service of the MP4 file of downloading displaying video and audio frequency, and can play text.

Use the information notice of text extremely important as the information notification means, this is that information to be sent can directly be sent to the user because compare with video, and data volume may be considerably less.In the above-mentioned service of playing as the MP4 file of downloading, text is as independently track (track) transmission, rather than with video and group of text altogether with coding and send the result, and this has reduced the situation that can not read text because text is destroyed, and enables the notice of transmission information efficiently.

In addition, in the timing text of 3GPP definition, the part text can be modified, move, and link that perhaps can near another URL is attached to character string (style, highlighted, Karaoke, character frame, flicker, rolling, hyperlink or the like).This enables the information that playback sends with various expression waies.

Use Fig. 1 to explain the data structure of the timing text of 3GPP definition herein.

MP4 file 10 comprises head part 20 and data division 30.Head part 20 comprises track head 40, sample and describes 50 and schedule of samples 60.Data division 30 comprise samples of text 70,71 ...

Track head 40 is the information relevant for the timing text playback, and comprise following information: the time scale of the playback duration of layout (size of viewing area is with the relative position of video), layer (with the hierarchical relationship such as other medium such as videos), timing text, file playback time and date and later time-sample pane 61 of describing, or the like.

Sample describe 50 comprise a plurality of sample items 51,52 ...

Sample item 51,52 ... for relevant for samples of text 70,71 ... the information of default format, comprise and have or do not exist rolling and direction, level and vertical alignment position, background color, font name, font size or the like.

Schedule of samples 60 comprises time-sample pane 61, sample size frame 62 and sample-block of information frame 63.Time-sample pane 61 according to samples of text 70,71 ... put in order include about samples of text 70,71 ... playback duration information 65,66 ...Information 65,66 ... the time scale of the value of being stored is specified by track head 40.More particularly, one second esolving degree of track head 40 storages is as time scale.For example, the time scale value of storing when track head 40 is during for [1000], and can obtain with 1/1000 second is the esolving degree of unit.Correspondingly, by with samples of text 70,71 ... playback duration be converted to second unit and the value that obtains become by with information 65,66 ... the time scale value of storing divided by track head 40 and the value that obtains.For example, when the time ratio value was [1000], the value [3400] of information 66 expressions referred to samples of text 71 broadcasts 3.4 seconds.Below describing supposition time scale value is [1000].Sample size frame 62 according to samples of text 70,71 ... put in order include about samples of text 70,71 ... data length information 67,68 ...This make broadcast can with detect each samples of text 70,71 ... information between each border.Sample-block of information frame 63 comprise with samples of text 70,71 ... with sample item 51,52 ... related information.

Samples of text 70 comprises the data length 76 and the modifier 77 of text 75, text 75.Modifier 77 is the information of relevant text 75 Optional Forms, and is used for playing with a large amount, Karaoke, flicker, hyperlink or the like the information of text 75.Because other samples of text 71 ... have the data structure identical, describe so omit with samples of text 70.

Use Fig. 2 to specifically describe the playback of timing text below.

At first, explain the concrete structure of sample item 51 with reference to Fig. 2 A.Other sample items 52 ... have identical structure, omit and describe.Sample item 51 comprises and has or do not exist rolling and direction (" show label "), level in the viewing area and vertical alignment position (" horizontal alignment ", " vertical alignment "), the background color of representing by rgb value and transparency (" background color "), viewing area (" text box "), font name (" table of type ", " font ID "), font size (" font size "), such as runic, italic, styles such as underscore (" surperficial style "), and the font color of representing by rgb value and transparency (" font color ").In addition, specify data (" beginning character ", " termination character of the applied scope of this form ") value [0] always, and show that this form is applied to the gamut of the text in the samples of text that form applied of sample item 51 appointments.Each value of the sample item 51 that shows among Fig. 2 means the default format of having specified text 75, thereby background color is a white, and font color is that black and style are normal.

Explain the concrete structure of modifier 77 below with reference to Fig. 2 B.Modifier 77 comprises: the data length of modifier 77 (" modifier size "), the appointment of text 75 Optional Forms (" modifier type ", " item count "), applied Optional Form text 75 scope appointment (" beginning character "; " termination character "); font name (" font ID "); font size (" font size ");; styles such as underscore (" surperficial style ") such as runic; italic, and the font color of representing by rgb value and transparency (" font color ").Be higher than by arbitrary sample item 51,52 ... the priority of the form of appointment applies the appointment for this Optional Form.Each value of the modifier 77 that shows among Fig. 2 B means that the 5th of text 75 represents with bold face type to Eight characters symbol.

Fig. 2 C shows the playback state of the samples of text 70 that has applied above-mentioned form.For example, when the content of text 75 expression be [It ' s fine today], the 5th [fine] that accords with to the Eight characters play with bold face type.In addition, the value [1000] of the information 65 of at first arranging from time-sample pane 60 shows that playback duration is the 1000[millisecond] (Fig. 1).

When broadcast has the MP4 file of said structure, download this MP4 file in advance by receiving terminal, and after download is finished, play this MP4 file by receiving terminal.When downloading the MP4 file, generally use TCP, it is a reliable transport protocol, and guarantees that receiving terminal receives the MP4 file with complete form.

Simultaneously, comprise in the service of media data of video and audio frequency in distribution, people adopt stream distribution to substitute type of download more and more.In stream distribution, executed in parallel is by the process of receiving terminal receiving media data and the process of the media data that broadcast received.Therefore, have the following advantages:, also can shorten from the request media data to the stand-by period of carrying out playback even when playing long-time media data.In addition, this is the distribution formats that is suitable for distributing the media data for the treatment of live broadcast.

In such stream distribution, use RTP/UDP as sending the transmission of media data agreement, to substitute TCP.TCP is for ensureing the reliable protocol of transfer of data, and RTP/UDP is for outstanding aspect real-time performance and be suitable for the non-reliable protocol of stream distribution.

As the scheme that is used for using RTP transmission such as Still Medias such as text and still image, be useful on the general RTP payload format (http://standards.ericssson.net/westerlund/draft-westerlund-avt-rtp-static-media-00.txt) of (Time-lined) Still Media of band timeline.This is that the scheme of duration head with expression playback duration (duration) wherein is provided, and this scheme has following feature: send playback duration to the recipient.In addition, use RTP but not TCP enables to utilize the real-time Transmission of Still Media.

Yet under the situation of the stream type distribution of using RTP/UDP, the packet that comprises media data can be lost on cable network and wireless propagation path in some cases, thereby can not show text to be played.Because in any lost data packet and under the situation of the media data that will play below not having to send, receiving terminal is not received data, so there is following problem: not having media data to show below receiving terminal can't be determined still is to have lost media data in transmission course, shows thereby make it to carry out.Therefore, can not notify the user to lose media data by carrying out the demonstration that for example " can't receive data now ".

Yet, using RTP to carry out having following situation under the situation of flow transmission:, packet loss can take place according to the situation of transmission path.In the data packet transmission of using RTP, (SN) detects packet loss according to the sequence number that gives RTP.That is, when receiving that SN is 5 packet and when not receiving that SN is 4 packet, judge that SN is 4 RTP packet loss.Under the situation such as continuous medias such as voice and video datas, the transmission intercal between each RTP packet is not long, approximately a few tens of milliseconds to 100 millisecond, determines method thereby allow to carry out such packet loss.Under the packet loss situation bigger to quality influence, after the decision data packet loss, carry out and resend request, enable to prevent quality degradation thus.In this case, owing to resend the delay that causes, generally before media playback begins, provide the pre-buffer time of the data that are used for obtaining in advance 2 to 3 seconds in order to absorb.

Yet, under the flow transmission that will use RTP was applied to situation such as text media such as timing text and the Still Media that comprises jpeg data, following problem can take place.Because the playback duration of Still Media (time that promptly shows one text and same still image) is generally several seconds to tens of seconds, so the RTP data packet transmission correspondingly becomes several seconds to tens of seconds at interval.The RTP data packet transmission equals packet loss at interval and detects the required time, and is longer than general pre-buffer time.Correspondingly, be not easy by the pre-buffer time required time of absorption data packet loss detecting.In addition, if pre-buffer time was added to (for example) about 10 to 20 seconds, then there is the problem of heavy damage user comfort.

Summary of the invention

The object of the present invention is to provide that a kind of not have media data to show still be data structure, data sending device and the data sink that media data is lost and can not be shown and correctly lose to the user report media data in the process of transmission when being used for stream distribution and data receiving terminal such as Still Medias such as timing texts and not receiving the Still Media data, below can determining.

This purpose can be by to be issued to: will be relevant for information storage and transmission in the Still Media transmission data more Zao than these Still Media transmission data of the playback of cutting apart the Still Media data that comprises in the Still Media transmission, when not receiving when cutting apart the Still Media data, determine that the basic Still Media data of just not cutting apart still are to exist to lose thus.

In addition, another object of the present invention is to provide a kind of data transmission method for uplink and data sink, when using such as Still Medias such as timing texts in middle stream distribution, it reduces the packet loss detection and resends the required time of request with execution under the situation that does not increase pre-buffering.

Transmit the playback duration information that comprises in the data by reference at Still Media, when the Still Media that will play below after playback duration finishes, not receiving, determine to have taken place packet loss,, can reach above purpose thus to judge whether should carry out the request of resending.

Description of drawings

Fig. 1 is the schematic diagram of the data structure of the timing text of demonstration 3GPP definition;

Fig. 2 A is the schematic diagram of the data structure of Displaying timer text;

Fig. 2 B is the schematic diagram of the data structure of Displaying timer text;

Fig. 2 C is the schematic diagram of the data structure of Displaying timer text;

Fig. 3 is the block diagram of the configuration of demonstration data sink of the present invention;

Fig. 4 is the schematic diagram of the data structure of demonstration RTP packet of the present invention;

Fig. 5 is the schematic diagram of the text display example of demonstration data display method of the present invention;

Fig. 6 is for showing the schematic diagram of text display example when the error of transmission of data display method of the present invention takes place;

Fig. 7 is the flow chart of the operation of explanation data display method of the present invention;

Fig. 8 is the schematic diagram of the text data store example of demonstration data transmission method for uplink of the present invention;

Fig. 9 is the schematic diagram of the text data store example of demonstration data transmission method for uplink of the present invention;

Figure 10 is the schematic diagram of the text data store example of demonstration data transmission method for uplink of the present invention;

Figure 11 is for showing the schematic diagram of text display example when storing a plurality of text of data display method of the present invention;

Figure 12 is for showing the schematic diagram of text display example when the error of transmission of data display method of the present invention takes place;

Figure 13 is the block diagram of the configuration of demonstration data sending device of the present invention;

Figure 14 is the schematic diagram of demonstration according to the data structure of the PES packet of the embodiment of the invention 2;

Figure 15 is the block diagram of demonstration according to the configuration of the data sink of the embodiment of the invention 3;

Figure 16 is for showing the schematic diagram of data structure of the present invention;

Figure 17 A is the schematic diagram of the display operation of video data receiving system;

Figure 17 B is the schematic diagram of the display operation of video data receiving system;

Figure 18 A is the schematic diagram of the display operation of video data receiving system;

Figure 18 B is the schematic diagram of the display operation of video data receiving system; And

Figure 19 is the flow chart of video data receiving system received processing program.

Embodiment

Following with reference to accompanying drawing specific explanations embodiments of the invention.

(embodiment 1)

Embodiment 1 explains and uses RTP (Real Time Transport Protocol, real time transport protocol), RTSP (Real Time Streaming Protocol, real time streaming transport protocol) and the flow transmission of the text track of SDP (SessionDescription Protocol, Session Description Protocol).

RTP is the data packet format of the media stream of the RFC1889 definition recommended by IEFT (Internet Engineering Task Force, the Internet engineering duty group).RTSP and SDP are respectively by RFC2326 and RFC2327 control protocol definition, transmission of multimedia streams.In addition, in this embodiment, the interpretative version data are used as the Still Media data conditions.

Fig. 3 is the block diagram of demonstration according to the configuration of the data sink of the embodiment of the invention 1.

This data sink comprises: Data Receiving parts 1001 are used for receiving the RTP packet that comprises text data; Text display decimation in time parts 1002 are used for extracting the time that is presented at the text that comprises in the RTP packet; Extended head memory unit 1003 is used for extracting the next text size that comprises and next text display time with storage in the RTP of RTP packet packet extended head; Parts 1004 are determined in loss of data, even be used for when also not receiving the RTP packet on the time that should receive the RTP packet, determine that the RTP packet is lost or postponed; Text extracts and memory unit 1005, is used for extracting the text data that comprises with storage in the RTP packet; Text decoration is determined parts 1006, is used for determining to be used for modifying according to the data that received the decoration information of text data, for example font, color or the like; Replace text storage parts 1007, be used for storing replacement text to display in the time can't using the text data that will show owing to RTP packet loss or its delay; Text display time judging part 1008 is used for judging time of being extracted by text display decimation in time parts 1002 or the time from the videotex data in next text display time storage area of storing in extended head memory unit 1003; Videotex judging part 1009, be used for when packet is not lost or postponed according to determining by text decoration that wherein parts determine that the method for modifying of the text data that comprises judges the text that shows in the RTP packet, and when packet is lost or postponed, judge to show the replacement text of replacing 1007 storages of text storage parts; And text display parts 1010, be used for showing time of judging by text display time judging part 1008 and the text of judging by videotex judging part 1009.In addition, when loss of data determined that parts 1004 are determined not have loss of data, videotex judging part 1009 was judged by being determined that by text decoration the modification mode that parts 1006 are determined is presented at stored text in text extraction and the memory unit 1005.

In this data sink, when loss of data determines that parts 1004 are determined not have loss of data, text display decimation in time parts 1002 extract the time (duration of describing among Fig. 4 8006) that is presented at the text that comprises in the RTP packet, and text display time judging part 1008 is selected time of being extracted.In addition, at this moment, videotex judging part 1009 is according to determining that from loss of data that provide and the indication of parts 1004 does not have the information of loss of data, selects to extract the text data (the described text 8008 of Fig. 4) that extracts with memory unit 1005 by text.Correspondingly, when loss of data determines that parts 1004 are determined not have loss of data, only show the time of being determined by duration 8006 on text display parts 1010, the wherein current text data that is receiving is included in the current RTP packet.

Different therewith, when loss of data determines that parts 1004 define loss of data, videotex judging part 1009 selects to replace text according to this result, for example at " * " that replace text storage parts 1007 but not store in text extraction and the memory unit 1005.In addition, at this moment, according to demonstration time of the extended head (the described header extension 8003 of Fig. 4) that in the early RTP packet that is stored in extended head memory unit 1003, receives (

next sample duration

8202,8204,8206, with

next sample length

8203,8205,8207, promptly relevant for the information of demonstration time of the part of losing that causes the data that receiving), the replacement text that text display time judging part 1008 is presented at 1010 of text display parts to replace storage in the text storage parts 1007 is by the time of next sample duration appointment.In addition, when next sample length of storage in extended head memory unit 1003 is 0, this means does not have text to show at all, thereby text display time judging part 1008 does not show text display parts 1010 whatever in the time by next sample duration appointment.

In the extended head of early RTP packet storage and send the RTP packet that expression receiving text data demonstration time and existence or do not have the information of text data, extended head is stored into extended head memory unit 1003, and this enables to judge according to the extended head of being stored whether text data was arranged originally when obliterated data, and when obliterated data, even data were arranged originally, this also enables to replace text with corresponding time showing.

Herein, the media data relevant for the MP4 file format embodiment of the invention 1, that provided by server sends as the RTP packet.

For the timing text that is provided by the MP4 file by flow transmission is provided, the RTP packet has data structure shown in Figure 4.The data structure of RTP packet shown in Figure 4 comprises RTP head 8001 and RPT Payload 8002.In this embodiment, the whole packet that comprises RTP head 8001 and RPT Payload 8002 is called text transmission data.The header extension of describing after the RPT Payload comprises (extended head) 8003, and each all has the #1 of text frame, #2, the #3 (8101,8102,8103) of a samples of text.Utilize the #1 of text frame (8101) to explain the configuration of each text frame.Because the #2 of text frame, #3 and text frame subsequently have identical configuration, describe so omit.In addition, in this embodiment, RTP head 8001 is called the head part with the header extension (extended head) of RPT Payload.

The configuration of text frame 8101 comprises: duration 8006, the text size 8007 that is illustrated in the length of the text that comprises in the samples of text, the videotex 8008 of the time of the index 8005 of the relation of length 8004, expression and the sample item of expression text frame length, expression videotex sample and the information modifier 8009 that is used for modifying text.In this embodiment, the length 8004 of expression text frame length, expression are called as the text header data with the duration 8006 of the time of the index 8005 of the relation of sample item and expression videotex sample, and the samples of text that comprises text size 8007, the text 8008 to be shown of the length that is illustrated in the text that comprises in the samples of text and be used for modifying the information modifier 8009 of text is called as and cuts apart the back text data.In addition, the text playback of data refers to the described MP4 file 3000 of Fig. 1.With corresponding text sample (cutting apart the back text data), the storage of head part 3010 that forms MP4 file 3000 shown in Figure 1 is in the text frame of RTP packet, as text header data shown in Figure 4 (index 8005 of the relation of length 8004, expression and the sample item of expression text frame length and the duration 8006 of representing the time of videotex sample).

Below explain the configuration of the header extension (extended head) 8003 of the information that is described in the text frame that comprises in next RTP packet (SN=2).Header extension (extended head) 8003 comprises: next number of samples 8201 that is illustrated in the number of the text frame that comprises in next RTP packet, be illustrated in next sample duration #1 8202 of the information of the text frame that comprises among next RTP, next sample length #1 8203, next sample duration #2 8204, next sample length #2 8205 ...Instantly a sample number order 8201 is 3 o'clock, and this is illustrated in and comprises 3 text frames in next RTP packet.Below explain next sample duration #1 8202 and next sample length #1 8203, it is the information of first text frame of comprising in next RTP packet.Second text frame and frame subsequently are identical with first text frame, omit and explain.Next sample duration #1 8202 is illustrated in the text display time of first text frame that comprises in next RTP packet.Next sample length #1 8203 is illustrated in the text size of first text frame that comprises in next RTP packet.In other words, next sample duration #1 8202 is identical with the duration 8212 of the RTP packet of SN=2, and next sample length #1 8203 is identical with the text size 8213 of the RTP packet of SN=2.

Below explain the example of the operation of receiving terminal when using above-mentioned transmission structure.Explain that below demonstration shown in Figure 5 gives the example of receiver terminal device.At first, text size is 22 " Could youhelp me out? " show 6 seconds kinds, text size is 3 seconds kinds of " Sure. " demonstration of 5, and text size is 5 seconds kinds of " Thanks " demonstration of 7.In addition, the space also counts number of characters.

Below use Fig. 4 to explain the method that in this case timing text is stored into the RTP packet.In addition, in this case, explain the situation of a samples of text of storage in 1RTP.In the RTP of SN=1 packet, in the text field the storage " Could you help me out? ", in duration, store 6000, and in text size, store 22.Store 3000 and 5 respectively in next sample duration and next text size, next sample duration is illustrated in the text frame that comprises in next RTP packet (SN=2) and shows the time, and has 3 seconds kinds of " Sure. " demonstration of 5 characters.After this, in the RTP of SN2 and SN3 packet, store text message similarly.

Below use the demonstration of Fig. 6 explanation when RTP packet (SN=2) receiving terminal when losing.When receiving RTP packet (SN=1), receiving terminal shows " Could you help me out? " 6 seconds kinds for the fixed time.

When RTP packet (SN=2) when losing, because do not receiving next text message after the kind through 6 seconds, so by the header extension that in RTP packet (SN=i), comprises infer text size be 5 and the text display time be 3 seconds kinds, show " * * * * * " the 3 seconds kinds corresponding to 5 characters then, wherein each " * " expression text is not correctly received.

Below the flow chart of use Fig. 7 is explained the operation of the receiving terminal of the RPT packet of receiving above storage.

Receiving RTP packet (SN=i) afterwards, receiver terminal device is play text, and continues to show, until the playback duration end (step ST9001) of the text that comprises in SN=i.When playback duration finishes, determine whether to receive that sequence number is next RTP packet (step ST9002) of SN=i+1.When receiving this RTP packet (SN=i+1), handle and proceed to step ST9003, and when not receiving this RTP packet, handle proceeding to step ST9005.At step ST9003, from the RTP packet of the SN=i+1 that received, read duration and text (step ST9003), and to the time period (step ST9004) of receiving terminal videotex by the duration appointment.At step ST9005, from the RTP packet of SN=i, read next sample duration and next sample length, and, lose " * " (step ST9006) of data to be shown to play expression corresponding to the number of text size for next sample duration.At step ST9007, i increases by 1.

Then explain the operation when a plurality of text frame of storage in the 1RTP packet.Below only explain the different part of situation of storing a text with each RTP.

Fig. 8,9,10 is presented at the example of storage text in the RTP packet.Mark " * " expression ineffective law, rule, etc. originally promptly, this means not videotex.

In RTP packet (SN=1), store the text that comprises " Tom, this is Kay Adams. " 8501, " " 8503 and " Kay, this is my brother, Tom Hagen. " 8502.The text message that comprises in RTP packet (SN=2) also is stored in the extended head.In RTP packet (SN=2), store the text that comprises " How do you do. " 8504, " " 8505 and " How do you do. " 8506.The text message that comprises in RTP packet (SN=3) also is stored in the extended head.Storage " Nice to meet you. " 8507 and " " 8508 in RTP packet (SN=3), and the text message that comprises in RTP packet (SN=4) also is stored in the extended head.

Below use the demonstration example of Figure 11 explanation when not having error of transmission.At first show " Tom, thisis Kay Adams. " 0.5 second, then show then not show 0.4 second whatever in " Kay, this is my brother, Tom Hagen. " 0.5 second.After this, with " How do you do. ", ineffective law, rule, etc. this, " How do you do. ", " Nice to meet you. ", ineffective law, rule, etc. originally show 0.5 second respectively, 0.2 second, 0.5 second, 0.6 second, 6 seconds.

Below use the display packing of Figure 12 explanation when losing RTP packet (SN=2).

Because correctly received the RTP packet of SN=1, so at first show " Tom, this is KayAdams. " 0.5 second, then show " Kay, this is my brother, Tom Hagen. " 0.5 second, then do not show 0.4 second whatever.Because lost next RTP packet, so can not correctly show next text.Yet, in the extended head of the RTP packet that is contained in SN=1, stored 14 characters for 0.5 second, for 0.2 second ineffective law, rule, etc. this and for 14 characters of 0.5 second, thereby will wherein arrange corresponding to the text display of the mark " * " of the number of 14 characters 0.5 second, then videotex 0.2 second not then will wherein have been arranged corresponding to the text display of the mark " * " of the number of 14 characters 0.5 second.

In addition, though the above situation of losing fully of having explained can use the present invention to show when the RTP of SN=2 packet is delayed.In this case,, this method can be changed into the display packing that is applicable to following situation:, just do not make a mistake in case the RTP packet that postpones arrives though use this display packing to show.

Figure 13 is the block diagram of demonstration according to the configuration of the data sending device of the embodiment of the invention 1.

This data sending device comprises: text message memory unit 2001 is used for storing text message and the decoration information that sends the destination of giving to be sent; Next text data information generates parts 2003, be used for being created on comprise in the text that sends as next transmission data after the transmission data that are being generated such as information such as text size, playback durations; Head generates parts 2002, is used for generating head according to the control information for transmission of textual data and next text data information generation information; Payload generates parts 2004, is used for generating the Payload that transmits data according to text message to be sent and decoration information; Transmission data compound component 2005 is used for synthesizing the transmission data with Payload from the head; And data unit 2006, be used for sending the transmission data to sending the destination.

In the dispensing device of above configuration, next text data information generates parts 2003 and read the information for the treatment of as the text of next transmission data transmission from text message memory unit 2001, and the information (text style, playback duration or the like) that enables thus will be contained in next text that transmits data is included in the transmission data that sending.

By this mode, according to described data structure, the data receiving terminal device, and data send terminal installation, send the demonstration time (next sample duration) for the treatment of the text data that sends as next RTP packet in advance and have or do not exist (next sample length) text data by extended head, thereby when loss of data takes place, the data receiving terminal device can determine whether not exist originally text data, and when not having text data originally, text display parts 1010 do not show the replacement text, and in contrast, when having text data originally, text display parts 1010 can show the replacement text.

Whether this just allows to show to wait such as " * " according to text display parts 1010 replaces text, even some text datas are being arranged originally but the situation of loss of data is arranged and distinguished between the situation of no data loss originally.

In addition, for extended head of the present invention, exist or do not exist the parameter of SDP that can be by before transfer of data, sending to client in advance for the utilization of extended head to send.For example, when server uses extended head to send next transmitting data information, in SDP, describe " next-packet-into:1 ", and when not comprising expansion, can in SDP, describe " next-packet-into:0 ".

In addition, though utilize embodiment 1 to describe the transmission text data, the invention is not restricted to this, and the present invention is applicable to following situation: send the media data and the JAVA that comprise static image data and CG as the Still Media data conditions ^The data of LISP program LISP data.In this case, can use static image data, Still Media data or routine data, with alternative text data, and can in replace text storage parts 1007, storage replace static image data, replace Still Media data or replacement routine data.About replacing static image data, replace the Still Media data, perhaps replace routine data, videotex judging part 1009 (is used for judging still image when receiving still image, and decision procedure when receiving routine data) the request size is adjusted to the static image data that is received from replace text storage parts 1007, the Still Media data, the perhaps replacement still image of the size of routine data, replace Still Media, perhaps replace program, and replace text storage parts 1007 provide replacement still image from the request size to videotex judging part 1009, replace Still Media, perhaps replace program.

(embodiment 2)

Embodiment 2 explains the flow transmission of the text track that uses MPEG-2 TS.Described text track is to comprise the identical data of utilizing with 3GPP definition expression way, that be used for the information of execution contexts playback of timing text.

Figure 14 shows the data structure of the PES packet 1 of the flow transmission of using MPEG-2 TS execution contexts track.

In the MPEG-2 system, be called as ES (Elementary Stream, basic stream) as the signal that forms such as the element of tracks such as video, audio frequency or text.In addition, wherein ES is divided into the ES that piece, each piece have variable-length and added header information on it and is called as PES (PacketizedElementary Stream, grouping is stream substantially).In the MPEG-2 system, TS (Transport Stream transmits stream) is defined as sending the signal of a plurality of PES multiplexedly.

The data structure of PES packet shown in Figure 14 comprises the PES head part 310 and Payload part 311 by MPEG-2 system definition.PES head part 310 has PTS (PresentationTime Stamp, presentative time stabs), and it is the temporal information that is used for such as synchronized playback between the tracks such as audio frequency, video and text.Payload part 311 comprises: track head part 3111, sample describes 3112, configuration information 3113, extended head 3114, text frame 3115,3115 ' ..., and the identifier (track head identifier 3111a, sample are described identifier 3112a, configuration information identifier 3113a, extended head identifier 3114a and the 3115a of text frame) that is used to identify each information.Track head part 3111, sample describe 3112, configuration information 3113,, text frame 3115,3115 ' is identical with embodiment 1, and omit and describe.Insert " 000001 " of sign indicating number (SCP) 3110 to start with before being right after the identifier of each information that in Payload, comprises.

For extended head 3114, similar to Example 1, below explain the configuration of the header extension (extended head) 8003 of the information that is described in the text frame that comprises in the PES packet.Header extension (extended head) 8003 comprises: next number of samples 8201 that is illustrated in the number of the text frame that comprises in next PES packet, be illustrated in next sample duration #1 8202 of the information of the text frame that comprises among next RTP, next sample length #1 8203, next sample duration #2 8204, next sample length #2 8205 ...Instantly a sample number order 8201 is 3 o'clock, and this is illustrated in and comprises 3 text frames in next PES packet.Below explain next sample duration #1 8202 and next sample length #1 8203, it is the information of first text frame of comprising in next PES packet.Second text frame and frame subsequently are identical with first text frame, omit and explain.Next sample duration #1 8202 is illustrated in the text display time of first text frame that comprises in next PES packet.Next sample length #1 8203 is illustrated in the text size of first text frame that comprises in next PES packet.In other words, next sample duration #18202 is identical with the duration 8212 of next PES packet, and next sample length #1 8203 is identical with the text size 8213 of this PES packet.

In this way, according to the data structure of this embodiment, even in the flow transmission of the text track that uses MPEG-2 TS, also may judge easily when losing text data whether text data is arranged originally.

(embodiment 3)

Similar with the situation of embodiment 1, embodiment 3 explains the flow transmission of the text track that uses RTP (real time transport protocol), RTSP (real time streaming transport protocol) and SDP (Session Description Protocol).RTP is the data packet format of the media stream of the RFC1889 definition recommended by IEFT (the Internet engineering duty group).RTSP and SDP are respectively by RFC2326 and RFC2327 control protocol definition, transmission of multimedia streams.In addition, in this embodiment, the interpretative version data are used as the Still Media data conditions.

Figure 15 is the block diagram of demonstration according to the configuration of the data sink of the embodiment of the invention 3.This data sink comprises: Data Receiving parts 1001 are used for receiving the RTP packet that comprises text data; Text display decimation in time parts 1002 are used for extracting the time that is presented at the text that comprises in the RTP packet; Extended head memory unit 1003 is used for extracting the next text character number that comprises and next text display time to store in the extended head part of RTP packet; Timer 1017 is used for rise time information; Parts 1004 are determined in loss of data, even be used for when also not receiving the RTP packet on the time that should receive the RTP packet, use timer 1017 to determine to exist the RTP packet loss; Text extracts and memory unit 1005, is used for extracting the text data that comprises with storage in the RTP packet; Text decoration is determined parts 1006, is used for determining to be used for modifying according to the data that received the decoration information of text data, for example font, color or the like; Text display parts 1010 are used for making predetermined display unit (for example liquid crystal display component or the like) to determine from text decoration that the decoration information of parts 1006 outputs is modified from text and extract the data that the text data with memory unit 1005 outputs obtains by using according to the demonstration time showing that provides from text display decimation in time parts 1002; Parts 1018 are determined in the request that resends, be used for when loss of data determines that parts 1004 determine to exist the RTP packet loss, by using timer 1017 to calculate transmission time started and its transmission concluding time of the request that resends, determine whether carry out the request of resending; Resend request data packet and generate parts 1019, be used for determining parts 1018 when the request of resending and determine carry out when resending request, generation resends request data packet; And data unit 1011, be used for sending by resending the generation request data packet again that request data packet generates parts 1019 generations to transmit leg.

In this data sink, when loss of data determines that parts 1004 are determined not have loss of data, text display decimation in time parts 1002 extract the time (duration of describing among Fig. 4 8006) that is presented at the text that comprises in the RTP packet, and text display parts 1010 videotex correspondingly.

Herein, the media data about the MP4 file format that is provided by server of embodiments of the invention 3 sends as the RTP packet.

Because the timing text that is provided by the MP4 file is provided flow transmission, so the RPT packet has the data structure shown in Figure 4 of embodiment 1.As shown in Figure 4, the data structure of RTP packet comprises RTP head 8001 and RPT Payload 8002.In this embodiment, the whole packet that comprises RTP head 8001 and RPT Payload 8002 is called text transmission data.The header extension of describing after the RPT Payload comprises (extended head) 8003, and each all has the #1 of text frame, #2, the #3 (8101,8102,8103) of a samples of text.Utilize the #1 of text frame (8101) to explain the configuration of each text frame.Because the #2 of text frame, #3 and text frame subsequently have the configuration identical with the #1 of text frame, describe so omit.In addition, in this embodiment, RTP head 8001 is called the head part with the header extension (extended head) of RPT Payload.

The configuration of text frame 8101 comprises: duration 8006, the text size 8007 that is illustrated in the length of the text that comprises in the samples of text, the videotex 8008 of the time of the index 8005 of the relation of length 8004, expression and the sample item of expression text frame length, expression videotex sample and the information modifier 8009 that is used for modifying text.In this embodiment, the length 8004 of expression text frame length, expression are called as the text header data with the duration 8006 of the time of the index 8005 of the relation of sample item and expression videotex sample, and the samples of text that comprises the text size 8007 of the length that is illustrated in the text that comprises in samples of text text 8008 to be shown and be used for modifying the information modifier 8009 of text is called as and cuts apart the back text data.In addition, the text playback of data refers to the described MP4 file 3000 of Fig. 1.With corresponding text sample (cutting apart the back text data), the storage of head part 3010 that forms MP4 file 3000 shown in Figure 1 is in the text frame of RTP packet, as text header data shown in Figure 4 (index 8005 of the relation of length 8004, expression and the sample item of expression text frame length and the duration 8006 of representing the time of videotex sample).

Below use Figure 16 to explain the method that in this case timing text is stored into the RTP packet.In addition, in this case, explain the situation of a samples of text of storage in 1RTP.In the RTP of SN=1 packet, in the text field the storage " Could you help me out? ", in duration, store 6000, and in text size, store 22.Store 3000 and 5 respectively in next sample duration and next text size, next sample duration is illustrated in the text frame that comprises in next RTP packet (SN=2) and shows the time, and has 3 seconds kinds of " Sure. " demonstration of 5 characters.After this, in the RTP of SN2 and SN3 packet, store text message similarly.

Below use Figure 17 to explain the display operation of data receiving terminal when the RTP packet loss.

At first explain the operation of data receiving terminal when packet loss.In Figure 17 A, transverse axis express time and time t1, t2, t3, t4 refer to be presented at respectively the time of the text that comprises in the RTP packet (SN=1, SN=2, SN=3, SN=4).When pre-buffer time was 0, time t1, t2, t3, t4 equaled to receive the time of RTP packet (SN=1, SN=2, SN=3, SN=4).When pre-buffer time is ptime when (second), receives that the time of RTP packet (SN=1, SN=2, SN=3, SN=4) becomes t1+ptime, t2+ptime, t3+ptime, t4+ptime.The explanation that herein provides supposes that pre-buffer time is 0.

In addition, shown in Figure 17 A, for example, suppose that the second conversion value of the demonstration time D UR (duration) that comprises is 5 seconds in the RTP of SN=1 packet, and second shows that the second conversion value of time D UR (that is NDUR (next duration)) is 6 seconds.In other words, the time that is presented at the text that comprises in the RTP packet of SN=1 is 5 seconds, and the time that is presented at the text that comprises in next RTP packet of SN=2 is 6 seconds, and this equal SN=2 the RTP packet DUR the second conversion value.In addition, this also is applicable to the RTP packet after SN=2.

Like this, this embodiment is characterised in that the following problem of considering: the playback time started that can judge next RTP packet (for example SN=2) according to the playback duration (duration) of the RTP packet that comprises (for example RTP packet of SN=1) in the RTP packet, and can judge the playback time started of next RTP packet (for example SN=2) next RTP packet again (for example SN=3) afterwards according to the playback duration (next sample duration) of next the RTP packet (SN=2) that in RTP packet (for example RTP packet of SN=1), comprises, as described in reference Figure 18, judge whether carry out the request of resending according to playback duration thus.

Below use the operation of Figure 17 B explanation when the RTP of SN=2 packet loss.This embodiment is characterised in that: before the RTP packet of receiving SN=3, use the DUR value of SN=1, the losing of the RTP packet of detection SN=2.

Can be that the playback duration that 5 seconds this point calculate the RTP packet of SN=1 is 5 seconds according to the playback duration information D UR (duration) that in SN=1, comprises.Correspondingly, the value of time t2 for obtaining of the RTP packet of beginning playback SN=2 by the playback time started t1 that added SN=1 in 5 seconds with playback duration DUR.Like this, when not receiving the RTP packet of SN=2 at the text playback concluding time t2 place of time t1 place beginning RTP packet playback, SN=1, the RTP packet of determining to lose SN=2, and transmission resends request data packet.

Below use Figure 18 to explain operation when losing continuous two RTP packets.Figure 18 A shows the situation of the RTP packet of losing SN=2 and SN=3.In this case, similar with situation shown in Figure 17, when not receiving the RTP packet of SN=2 at the text playback concluding time t2 place of time t1 place beginning RTP packet playback, SN=1, determine to lose the RTP packet of SN=2, and transmission resends request data packet.Then, again, because the demonstration time (playback duration) of the text that comprises in the RTP of SN=2 packet is in the end of time t3 place, so according to this embodiment, do not send the request that resends for the RTP packet of SN=2 after time t3.Promptly, at time t2 place, beginning is for the request that resends of the RTP packet of SN=2, and regularly carry out this and resend request, until the RTP packet of receiving SN=2, and even when also not receiving the RTP packet of SN=2, stop to send this and resend request at time t3 place.This enables to begin the request that resends for the RTP packet of SN=3 after time t3.In addition, also may judge the playback time started t3 of the RTP packet of SN=3 according to the playback duration (next sample duration) of the SN=2 that describes in the RTP packet that formerly receive, SN=1 and the playback time started t1 of SN=1.In addition, in the following explanation, exist the playback duration (next sample duration) of next RTP packet to be represented as the situation of NDUR (next duration).

Herein, Figure 18 is the schematic diagram of another embodiment of the request that the resends processing shown in the displayed map 18A.Resending request shown in Figure 18 B is handled different in the following areas with situation shown in Figure 18 A: for the request of resending send beginning timing and for the timing that takes place to finish be different from resend ask time started t1, t2, t3 ...

In other words, the time t2 ' that for example begins for the request that resends of the RTP packet of SN=2 is time t2 ' (=t2+ constant), it obtains by being added time t2 the set time (" constant "), at time t2 place, begins to play the RTP packet of SN=1.Correspondingly, can absorb the RTP packet and receive timing error, even and the RTP packet of behind elapsed time t2, receiving the actual SN=2 that sends from transmit leg, also can receive and play this RTP packet, thereby enable to avoid transmitting the useless request that resends.

In addition, for example, for the stop timing of the request that resends of the RTP packet of SN=2 be time t3 ' (=t3-RTT), this time t3 ' is than the Zao transmit leg of playback time started t3 of the RTP packet of SN=3 and the (two-way time: RTT) round trip message time between the recipient.Correspondingly, resend request according to this and resend under the situation of RTP packet sending the request of resending and transmit leg to transmit leg from data sink, if send the request that resends from data sink before at time t3 ', then data sink may be received in the RTP packet of the SN=2 that the playback stop timing (the playback time started of the RTP packet of SN=3) of SN=2 resends before.

In this way, handle, can carry out resending the playback process of asking more smoothly with the RTP packet that correspondingly resends according to the request that resends of Figure 18 B.

Below use flow chart shown in Figure 19 to explain that the reception of the data sink when receiving above-mentioned RTP packet handles.

As shown in figure 19, at step ST9011, the loss of data of data sink determines that parts 1004 determine whether to receive the RTP packet of SN=i.When obtaining negative decision herein, this means the RTP packet of also not receiving SN=i, definite processing that parts 1004 repeat in step ST9011 is determined in loss of data this moment.

Different therewith, when in step ST9011, obtaining positive result, this means the RTP packet of having received SN=i, loss of data this moment determines that parts 1004 proceed to step ST9012, the time that obtains with the playback time started ti of current time t relatively and RTP packet by playback duration DUR (i) being added SN=i, and as current time t during more than or equal to above time, playback time started of the text that comprises in the RTP packet of determining to have passed through and proceed to step ST9013 at SN=i+1.

In addition, when obtaining negative decision in step ST9012, this means the playback time started of also not passing through the text that comprises in the RTP of SN=i+1 packet, definite processing that parts 1004 repeat in step ST9012 are determined in loss of data this moment.

In this way, the playback of the text that comprises in the RTP packet of having passed through at SN=i+1 is during the time started, and loss of data determines that parts 1004 proceed to step ST9013, to determine whether to have received the RTP packet of SN=i+1.When in step ST9013, obtaining positive result, this means the playback duration of the RTP packet of having passed through SN=i, after this receive the RTP packet of the SN=i+1 after this RTP packet, promptly pass through the demonstration time of the RTP packet of SN=i, received data next to be shown this moment.Correspondingly, at this moment, loss of data determines that parts 1004 proceed to step ST9017, so that i is increased by 1, after this returns above-mentioned steps ST9012, to wait for the demonstration time through the RTP packet of having confirmed its reception in step ST9013.

Different therewith, when in step ST9013, obtaining negative decision, this means the playback duration of the RTP packet of having passed through SN=i, after this do not receive the RTP packet of the SN=i+1 after this RTP packet, promptly pass through the demonstration time of the RTP packet of SN=i, do not received data next to be shown this moment; At this moment, loss of data determines that parts 1004 send the report that RTP packet to be received is not received in expression to the definite parts 1018 of the request that resends.

Correspondingly, the request that resends of receiving this report determines that parts 1018 transmissions are unreceived relevant for receiving this moment, the request that resends of the RTP packet of SN=i+1.

Simultaneously, obtain not receive that at step ST9013 the result of SN=i+1 is with after reporting to it definite parts 1018 of request of resending, loss of data determines that parts 1004 proceed to step ST9015, to determine whether to receive the RTP packet of SN=i+2, this RTP packet is after the RTP packet of the SN=i+1 of the request that resends of passing through the definite parts 1018 of the request of resending, perhaps compare current time t and add the time that the playback time started ti of the RTP packet of SN=i obtains, and judge that whether current time t is greater than this time by playback duration NDUR (i) with playback duration DUR (i) and SN=i+1.

When obtaining negative decision herein, this means that no show should receive the time of the RTP packet of SN=i+2; At this moment, loss of data determines that parts 1004 return above-mentioned steps ST9013 with the processing of repeating step ST9013 to step ST9015.Correspondingly, before the time of the RTP packet that should receive SN=i+2, judge whether receiving the RTP packet of the SN=i+1 that before the RTP of SN=i+2 packet, receive, and when not receiving, repeat the request that resends of RTP packet.

Different therewith, when when step ST9015 obtains positive result, this means arrival should receive SN=i+2 the RTP packet time or actually received this RTP packet; At this moment, loss of data determines that parts 1004 proceed to step ST9016, so that i is increased by 1, after this proceeds to step ST9017, once more i is increased by 1.

In this way, when when step ST9015 obtains positive result, loss of data determines that parts 1004 carry out the increase processing of i at step ST9016 and step ST9017, so that i is increased by 2 altogether, and return the processing among the above-mentioned steps ST9012, after this repeat the processing identical with above-mentioned processing.

In this way, according to received processing program shown in Figure 19, when execution resends request, playback duration according to the RTP packet, determine whether to carry out the request that resends, and need not wait for and receive the RTP packet, enable to reduce the request of the resending time before that sends thus.In addition, even when losing two RTP packets continuously, also may use next playback duration (NDUR) that in the RTP packet of receiving afterwards, comprises suitably to carry out the request that resends.

In this way, according to the data sink of this embodiment,, determine whether to carry out the request that resends according to the playback duration of RTP packet, and need not wait for and receive the RTP packet, enable to reduce the required time of packet loss of detecting thus.

In addition, though described the situation that text data sends as the Still Media data with embodiment 1, but the invention is not restricted to this, and the present invention is applicable to the data conditions of the routine data that sends the media data comprise static image data and CG and XML language.In this case, can use static image data, Still Media data or routine data, to substitute text data.

As mentioned above, according to the present invention, even, also can show and replace Still Media by correct playback duration when because former thereby when losing Still Media transmission data such as error of transmission etc.In addition, according to the present invention, can reduce the required time of packet loss of detecting.

The application is based on Japanese patent application 2002-331410 that submitted to November 14 in 2002 and the Japanese patent application 2003-16364 that submitted on January 24th, 2003, and its full content incorporates this literary composition as a reference.

Industrial applicibility

The present invention is applicable to and for example is used for sending, such as the transmission data structure of the Still Media data of text data etc., and the method and apparatus that is used to send these type of data.

Claims

1. the transmission data structure of Still Media transmission data, described Still Media transmission data are used for transmitting in order and playing the Still Media playback of data, and described Still Media playback of data is used for the playback of Still Media data,

Wherein said Still Media playback of data comprises: a plurality of wherein cut apart the Still Media data cut apart the Still Media data; And comprise the Still Media header data that is used to play the information of cutting apart the Still Media data; And

Wherein said Still Media transmits data packets contains: add to cut apart the Still Media data cut apart the Still Media data identifier, add the Still Media header data identifier of Still Media header data to, and relevant for the Still Media information of cutting apart the Still Media data that in next Still Media transmission data, comprises.

2. the transmission data structure of program transmission data, described program transmission data are used for transmitting in order and the playing program playback of data, and described program playback of data is used for the playback of routine data,

Wherein said program playback of data comprises: a plurality of segmentation procedure data of wherein having cut apart routine data; And the program header data that comprises the information that is used to play the segmentation procedure data; And

Wherein said program transmits data packets contains: the segmentation procedure data identifier that adds the segmentation procedure data to, add the program head data identifier of program header data to, and relevant for the program information that transmits the segmentation procedure data that comprise in data in next program.

3. the transmission data structure of text transmission data, described text transmission data are used for transmitting in order and playing the text playback of data, and described text playback of data is used for the playback of text data,

Wherein said text playback of data comprises: a plurality of text datas of cutting apart of wherein having cut apart text data; And comprise the text header data that is used to play the information of cutting apart text data; And

Wherein said text transmits data packets contains: add to cut apart text data cut apart the text data identifier, add the text header data identifier of text header data to, and relevant for the text message of cutting apart text data that in next text transmission data, comprises.

4. the transmission data structure of text as claimed in claim 3 transmission data wherein saidly comprises relevant for the text message of cutting apart text data that comprises in next text transmission data: the described number of cutting apart text data that comprises in next text transmission data.

5. the transmission data structure of text as claimed in claim 3 transmission data wherein saidly comprises relevant for the text message of cutting apart text data that comprises in next text transmission data: the text playback duration information of cutting apart text data that comprises in next text transmission data.

6. the transmission data structure of text as claimed in claim 3 transmission data wherein saidly comprises relevant for the text message of cutting apart text data that comprises in next text transmission data: the text data length information of cutting apart text data that comprises in next text transmission data.

7. the sending method of text transmission data, described text transmission data are used for transmitting in order and playing the text playback of data, and described text playback of data is used for the playback of text data, and described sending method comprises:

Generate the Payload part that described text transmits data according to described text playback of data, described text playback of data comprises: a plurality of text datas of cutting apart of wherein having cut apart text data; And be used to begin the playback start information that text data is cut apart in playback;

Generate the head part of described text transmission data, added the text message that in next packet, comprises thereon; And

Partly add described head part to the Payload that each generated, and form packet,

Wherein each Payload partly comprises the playback start information of text header data.

8. the sending method of text transmission data, described text transmission data are used for transmitting in order and playing the text playback of data, and described text playback of data is used for the playback of text data, and described sending method comprises:

Generate the head part of described text transmission data, added the number of cutting apart text data that in next packet, comprises thereon; And

9. the sending method of text transmission data, described text transmission data are used for transmitting in order and playing the text playback of data, and described text playback of data is used for the playback of text data, and described sending method comprises:

Generate the head part of described text transmission data, added the playback duration information of cutting apart text data that in next packet, comprises thereon; And

10. the sending method of text transmission data, described text transmission data are used for transmitting in order and playing the text playback of data, and described text playback of data is used for the playback of text data, and described sending method comprises:

Generate the head part of described text transmission data, added the text data length of cutting apart text data that in next packet, comprises thereon; And

11. the method for reseptance of text transmission data, described text transmission data are used for transmitting in order and playing the text playback of data, and described text playback of data is used for the playback of text data, and described method of reseptance comprises:

Receive first text transmission data and when after through the playback duration of first text data, not receiving the second transmission data, define loss of data; And

When defining loss of data, transmit the text message of cutting apart text data that comprises in data relevant for next text in first text transmission data with what the replacement of second text transmission data comprised.

12. the reception and the display packing of text transmission data, described text transmission data are used for transmitting in order and playing the text playback of data, and described text playback of data is used for the playback of text data, and described method comprises:

Receive first text transmission data, and when process is not received the second transmission data after the playback duration of first text data, define loss of data; And

When defining loss of data, transmit the text message of cutting apart text data that comprises in data relevant for next text in first text transmission data with what the replacement of second text transmission data comprised; And

When text data length is 1 or when bigger, show according to text data length and replace text, and when text data length is 0, the not demonstration of execution contexts data.

13. a data sink comprises:

The Data Receiving parts are used for from server or remote station receiving text data;

Text display decimation in time parts are used for from the data that received extracting text display time of videotex data;

The extended head memory unit, the information that is used for from the data that received, extracting and storing the extended head of the text data information of wherein storing next text data;

Parts are determined in loss of data, are used for having determined whether loss of data;

Text extracts and memory unit, is used for extracting from the data that received and the storage text data;

Replace the text storage parts, be used for storing the replacement text that when not receiving text data to be shown, will show;

Text display time judging part, be used for when loss of data determines that parts define loss of data judging from time text display time of extended head memory unit input, and when determine not have loss of data, judge from time text display time that text display decimation in time parts are imported as videotex as videotex;

The videotex judging part, be used for when loss of data determines that parts are determined not have loss of data, judging being presented at stored text in text extraction and the memory unit, and when loss of data determines that parts define loss of data, judge to be presented at and replace the replacement text of storing in the text storage parts; And

The text display parts are used for showing time of being judged by text display time judging part and the text of being judged by the videotex judging part.

14. a data sending device that is used for sending to remote station text data comprises:

The text message memory unit is used for storing the text message for the treatment of to the remote station transmission;

Next text data information generates parts, with generating the text size that comprises in the text that sends as next transmission data after the transmission data that are being generated and/or the information of playback duration of being included in;

Head generates parts, is used for generating head according to the control information for transmission of textual data and next text data information generation information;

Payload generates parts, is used for generating the Payload that transmits data according to text message to be sent and its decoration information;

Transmission data compound component is used for from described head and the synthetic transmission of Payload data; And

Data unit is used for sending the transmission data to remote station.

15. the transmission data structure of still image transmission data, described still image transmission data are used for transmitting in order and playing the still image playback of data, and described still image playback of data is used for the playback of static image data,

Wherein said still image playback of data comprises: a plurality of static image datas of cutting apart of wherein having cut apart static image data; And comprise the still image header data that is used to play the information of cutting apart static image data; And

Wherein said still image transmits data packets contains: add to cut apart static image data cut apart the static image data identifier, add the still image header data identifier of still image header data to, and relevant for the still image information of cutting apart static image data that in next still image transmission data, comprises.

16. the transmission data structure of still image as claimed in claim 15 transmission data wherein saidly comprises relevant for the still image information of cutting apart static image data that comprises in next still image transmission data: with the still image information of cutting apart the static image data similar number that comprises in next still image transmission data.

17. the transmission data structure of still image as claimed in claim 15 transmission data wherein saidly comprises relevant for the still image information of cutting apart static image data that comprises in next still image transmission data: the still image playback duration information of cutting apart static image data that comprises in next still image transmission data.

18. the transmission data structure of still image as claimed in claim 15 transmission data wherein saidly comprises relevant for the still image information of cutting apart static image data that comprises in next still image transmission data: the still image size information of cutting apart static image data that comprises in next still image transmission data.

19. the sending method of still image transmission data, described still image transmission data are used for transmitting in order and playing the still image playback of data, and described still image playback of data is used for the playback of static image data, and described sending method comprises:

Generate the Payload part that described still image transmits data according to described still image playback of data, described still image playback of data comprises: a plurality of static image datas of cutting apart of wherein having cut apart static image data; And be used to begin the playback start information that static image data is cut apart in playback;

Generate the head part of described still image transmission data, added the still image information that in next packet, comprises thereon; And

Wherein each Payload partly comprises the playback start information of still image header data.

20. the sending method of still image transmission data, described still image transmission data are used for transmitting in order and playing the still image playback of data, and described still image playback of data is used for the playback of static image data, and described sending method comprises:

Generate the head part of described still image transmission data, added the number of cutting apart static image data that in next packet, comprises thereon; And

21. the sending method of still image transmission data, described still image transmission data are used for transmitting in order and playing the still image playback of data, and described still image playback of data is used for the playback of static image data, and described sending method comprises:

Generate the head part of described still image transmission data, added the playback duration information of cutting apart static image data that in next packet, comprises thereon; And

22. the sending method of still image transmission data, described still image transmission data are used for transmitting in order and playing the still image playback of data, and described still image playback of data is used for the playback of static image data, and described sending method comprises:

Generate the head part of described still image transmission data, added the still image size of cutting apart static image data that in next packet, comprises thereon; And

23. the method for reseptance of still image transmission data, described still image transmission data are used for transmitting in order and playing the still image playback of data, and described still image playback of data is used for the playback of static image data, and described method of reseptance comprises:

Receive first still image transmission data, and when after through the playback duration of first static image data, not receiving the still image transmission data of second still image, define loss of data; And

When defining loss of data, transmit the still image information of cutting apart static image data that comprises in data relevant for next still image in first still image transmission data with what the replacement of second still image transmission data comprised.

24. the reception and the display packing of still image transmission data, described still image transmission data are used for transmitting in order and playing the still image playback of data, and described still image playback of data is used for the playback of static image data, and described method comprises:

When defining loss of data, transmit the still image information of cutting apart static image data that comprises in data relevant for next still image in first still image transmission data with what the replacement of second still image transmission data comprised; And

Size according to still image shows the replacement still image.

25. a data sink comprises:

The Data Receiving parts are used for receiving static image data from server or remote station;

Still image shows the decimation in time parts, is used for extracting the still image that shows static image data and shows the time from the data that received;

The extended head memory unit, the information that is used for storing the extended head of the static image data information of wherein storing next static image data;

Parts are determined in loss of data, are used for having determined whether that static image data loses;

Still image extracts and memory unit, is used for extracting from the data that received and the storage static image data;

Replace the still image memory unit, be used for storing the still image that when not receiving static image data to be shown, will show;

Still image shows the time judging part, be used for when loss of data determines that parts define loss of data, judging showing the time, and judgement shows that from still image the still image of decimation in time parts input shows that the time is as the time that shows still image when determining not have loss of data as the time that shows still image from the still image of extended head memory unit input;

Show the still image judging part, be used for when loss of data determines that parts are determined not have loss of data, judging being presented at the still image of storing in still image extraction and the memory unit, and when loss of data determines that parts define loss of data, judge to be presented at and replace the replacement still image of storing in the still image memory unit; And

The still image display unit is used for showing by still image showing time judging part time of judging and the still image of being judged by demonstration still image judging part.

26. a data sending device that is used for sending to remote station static image data comprises:

Still image information stores parts are used for storing the still image information for the treatment of to the remote station transmission;

Next static image data information generates parts, with generating the still image size that comprises in the still image that sends as next transmission data after the transmission data that are being generated and the information of playback duration of being included in;

Head generates parts, is used for generating head according to the control information that generates information for static image data transmission and next static image data information;

Payload generates parts, is used for generating the Payload that transmits data according to still image information to be sent and its decoration information;

Data unit is used for sending the transmission data to remote station.

27. data transmission method for uplink, be used for sending indication Still Media data and play the information of the Still Media data readback time of these Still Media data, and be used for sending the data that the playback duration of next Still Media data of broadcast after described Still Media data is treated in indication with described Still Media data.

28. a data receive method is used for receiving the Still Media transmission data of playback duration that indication is sent out the Still Media data of a plurality of Still Media data of played in order, this method comprises:

Receive first Still Media transmission data, and, determine after playback duration, whether to receive second Still Media transmission data through the first Still Media data to be played according to first Still Media transmission data;

According to described definite result, when not receiving second Still Media transmission data, define loss of data; And

When defining loss of data, begin to send the request that resends of first Still Media transmission data.

29. data receive method, the Still Media transmission data of the playback duration of next the Still Media data that is used for receiving the playback duration of indicating the Still Media data that are sent out a plurality of Still Media data of played in order and treats after described Still Media data, to play, this method comprises:

Receive first Still Media transmission data, and according to first Still Media transmission data, determine whether to receive after the playback duration through the first Still Media data to be played second Still Media transmission data, these second Still Media transmission data are used for playing the first Still Media data next Still Media data afterwards;

According to described definite result, when not receiving second Still Media transmission data, define loss of data;

When defining loss of data, begin to send the request that resends of first Still Media transmission data; And

Through based on the playback duration that transmits next Still Media data of next the Still Media data readback time that comprises in the data at first Still Media, finish to send the request that resends of second Still Media transmission data according to whether.

30. data receive method as claimed in claim 29 wherein is set to finish send the timing of the request that resends of second Still Media transmission data from draw back time of transmission data required two-way time between the transmit leg of Still Media transmission data and recipient time that the playback duration of next Still Media data finishes.

31. data transmission method for uplink, be used for sending indication Still Media data and play the information of the Still Media data readback time of these Still Media data, and be used for sending the data and the information of indicating the number of characters that in next Still Media data, comprises that the playback duration of next Still Media data of broadcast after described Still Media data is treated in indication with described Still Media data.

32. data receive method, be used for receiving playback duration that indication is sent out the Still Media data of a plurality of Still Media data of played in order, treat the playback duration of next Still Media data of playing and the Still Media of the number of characters that comprises transmits data described Still Media data after in next Still Media data, this method comprises:

Receive Still Media transmission data, and, determine after playback duration, whether to receive next Still Media transmission data of next the Still Media data that is used for playing after these Still Media data through Still Media data to be played according to these Still Media transmission data;

According to described definite result, when not receiving next Still Media transmission data, define loss of data; And

When defining loss of data, the character book of next static data that shows according to Still Media transmission data begins to send the request that resends to Still Media transmission data greater than 0 condition.

33. a data sink is used for receiving the Still Media transmission data of playback duration that indication is sent out the Still Media data of a plurality of Still Media data of played in order, this device comprises:

Reception result is determined parts, is used for receiving first Still Media transmission data, and according to first Still Media transmission data, determines whether to receive second Still Media transmission data after the playback duration through the first Still Media data to be played;

Parts are determined in loss of data, are used for determining according to reception result definite result of parts, when not receiving second Still Media transmission data, define loss of data; And

The request that resends sends the beginning parts, is used for when loss of data determines that parts define loss of data, begins to send the request that resends of first Still Media transmission data.