JP2002112194A - Data processing method and device, data transmission system, transmission medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a data transmission system, where a decoder terminal does not need special data and special processing for special reproduction at all, attains decoding and display or the like of data other than video data during special reproduction and can maintain a synchronization relation of the data at that time. SOLUTION: When the decode terminal 12 makes usual reproduction, a server 10 outputs video data or the like used for the usual reproduction, and when the decode terminal 12 conducts special reproduction, a data conversion section 3 uses video data read from a storage section 9 to generate and output data, resulting from special reproduction of a designated kind as video data which satisfy the ISO/IEC 13818-2 standards, and a data conversion section 7 interleaves the video data, so that number of outputted AUs(access units) is a reciprocal of a reproduction speed for example and outputs the resulting data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention distributes multimedia data including video data, audio data, text data, graphic data, and the like such as still images and moving images using a network, and distributes the distributed multimedia data. The present invention relates to a data processing method and an apparatus, a data transmission system, and a transmission medium that are optimally used when performing trick play in a data distribution system that receives, decodes, and displays the data in a decoding terminal.

[0002]

2. Description of the Related Art Video data and the like obtained by compressing image signals of still images and moving images are distributed via a transmission medium.
FIG. 28 shows a configuration example of a conventional data distribution system in which a decoding terminal receives, decodes, and displays the data. In addition,
In FIG. 28, only the path of the video data is described to simplify the description. Also, in the following description,
Video data can be transferred to, for example, an ISO (Internatioal Organizat
ion for Standardization / IEC (International E)
In this example, a packet is distributed to a transport stream (Transport stream, hereinafter simply referred to as TS) defined in 13818-1 (so-called MPEG-2 Systems).

In FIG. 28, a server 200 includes a storage unit 209 for storing video data. The video data read from the storage unit 209 is
At 04, the packet is packetized into a TS, and is further formed as distribution data 211 by the transmission unit 205, output to the transmission medium 210, and distributed to, for example, the decoding terminal 212. At this time, the TS distribution data 211 is transmitted using the protocol used in the transmission medium 210. For example, a TS that satisfies the provisions of ISO / IEC13818-1
IEC61883 "Digital Interface for cons
umer audio / video equipment, for example, IEEE (Institute of Electrical and Electron
cs Engineers) It is possible to transmit using a 1394 standard transmission medium. Note that the multiplexing unit 204 and the transmitting unit 205 may be integrated.

[0004] In the decoding terminal 212, the distribution data 211 is received by the reception unit 213 and sent to the separation unit 214.
The separating unit 214 separates the video data from the TS packet and sends the video data to the decoding unit 215. In the decoding unit 215,
Decode the encoded video data. The decoded video data is sent to, for example, a display device (not shown) and displayed as a video image.

In such a data distribution system,
For example, when performing special playback display such as fast-forward playback or frame-by-frame playback, for example, a special playback designation signal (instruction signal such as fast-forward playback or frame-by-frame playback) according to an operation of a terminal front panel or a remote controller by a user.
206 is a special reproduction control unit 216 of the decoding terminal 212
Will be entered. At this time, the special reproduction control unit 216 of the decoding terminal 212 transmits the special reproduction video data of the type specified by the special reproduction specifying signal 206 to the server 2.
00, a special reproduction request signal 220 for requesting the transmission medium 2 is transmitted.
10 to the special reproduction control unit 201 of the server 200.

[0006] Upon receiving the special reproduction request signal 220, the special reproduction control unit 201 of the server 200 generates control signals 202a and 202b corresponding to the request and sends them to the corresponding multiplexing unit 204 and transmission unit 205, respectively.
The multiplexing unit 204 reads data from the storage unit 209 under the control of the trick play control unit 201 based on the control signal 202b.
The special reproduction of the type specified by the user is performed by the decoding terminal 212.
Reads out video data for special reproduction to enable. The multiplexing unit 204 packetizes the special reproduction video data into a TS and sends the packet to the transmission unit 205. The transmission unit 205 distributes the packet of the special reproduction video data to the decoding terminal 212 as distribution data 211 under the control of the special reproduction control unit 201 by the control signal 202a.

At the decoding terminal 212 when the distribution data 211 composed of the special reproduction video data is supplied, the control signals 217a and 217b for performing the special reproduction control according to the special reproduction designation signal 206 are transmitted to the decoding terminal 212. The data is output from the reproduction control unit 216 and sent to the corresponding receiving unit 213 and decoding unit 215, respectively. Receiver 21
3 receives the distribution data 211 composed of the video data for the special reproduction under the control of the special reproduction control unit 216 based on the control signal 217b, and sends it to the separation unit 214. The separation unit 214 separates the special reproduction video data from the TS packet and sends the special reproduction video data to the decoding unit 215. The decoding unit 215 decodes video data for trick play under the control of the trick play control unit 216 based on the control signal 217a. As a result, a special playback display such as fast-forward playback or frame-forward playback is performed on a display device (not shown).

In the data distribution system described above, for example, ISO / IEC13818-2 (so-called M
An example of distributing compressed video data conforming to PEG-2 video is described, but the ISO / IEC13818 is used.
The compressed video data specified in -2 must be encoded so as not to overflow and underflow the decoder buffer. The decoder buffer corresponds to an input buffer (not shown) provided in the decoding unit 215. This ISO / IEC1381
If data exceeds the size of the buffer specified in 8-2, the decoder buffer overflows. On the other hand, if data necessary for decoding does not arrive at the time to decode, the decoder buffer underflows.

A video frame encoding method defined in ISO / IEC13818-2 includes an I-picture (Intra-code) encoding from only intra-frame data.
d picture: an intra-coded image and a B picture (Bidirectionally) to be coded using inter-frame prediction
There are a predictive-coded picture: a bidirectional predictive coded image) and a P picture (Predictive-coded picture: a forward predictive coded image).

In the data distribution system shown in FIG. 28, the I-picture which does not use the inter-video frame prediction processing is used as the special reproduction video data read from the storage unit 209. I have. That is, I-pictures are regularly included in video data for normal reproduction to enable random access, and the I-pictures are extracted to form video data for special reproduction. As described above, in the conventional data distribution system shown in FIG. 28, when special decoding such as fast forward is performed in the decoding
Video data consisting of only IEC13818-2 I pictures is distributed from the server 200 to the decoding terminal 212.

[0011]

However, the amount of video data consisting of only I pictures increases.
The decoder buffer may overflow or underflow. For this reason, in the conventional data distribution system, special data for special reproduction different from that for normal reproduction is prepared in advance so as to enable special reproduction without overflowing or underflowing the decoder buffer. When performing special reproduction in a decoding terminal, special data for the special reproduction is distributed. In addition, the decoding terminal also needs a special terminal capable of performing special trick-play processing different from normal trick-play processing corresponding to the special data for trick-play.

That is, in the conventional data distribution system, in order to realize the special reproduction without causing the decoder buffer to overflow or underflow, special reproduction different from the above-mentioned special reproduction video data consisting of only I-pictures is required. It is necessary to prepare special data for the special playback in advance, and at the same time, the decoding terminal also needs a special terminal capable of handling the special data for the special reproduction. Further, in the conventional data distribution system for distributing a plurality of multimedia data described above, when trick play is performed, only video data is decoded and displayed on the decoding terminal side. There is a problem that data such as audio data and subtitle text cannot be handled.

For this reason, it is desired to be able to handle data other than video such as audio data and subtitle text data even during special playback such as fast forward playback and rewind playback.

Further, in the case where display of data other than the video data is realized during the trick play,
If the synchronization relationship between a plurality of data during the trick play is not preserved, for example, the relationship between the image and the audio is shifted, or the image and the caption are shifted.

Therefore, in order to realize display of data other than video data during the special reproduction, it is necessary to maintain a synchronous relationship among the plurality of data.

Accordingly, the present invention has been made in view of such circumstances, and in order to perform special reproduction on the decoding terminal side, special data for special reproduction different from that for normal reproduction is prepared in advance. And does not require any special processing for special playback at the decoding terminal, and enables decoding and display of data other than video during special playback, and furthermore, other than video during special playback. It is an object of the present invention to provide a data processing method and apparatus, a data transmission system, and a transmission medium that can maintain a synchronous relationship between a plurality of data when decoding and display of the data can be performed.

[0017]

A data processing method according to the present invention is a data processing method for transmitting data coded for each predetermined coding unit to a receiving side. When performing the special reproduction on the receiving side, when performing the special reproduction on the receiving side, a predetermined data for the special reproduction is added to the first data among the plural data used for the normal reproduction. Perform conversion processing and output,
The above-described problem is solved by thinning out the second data of the plurality of data used for the normal reproduction and outputting the result.

Further, the data processing apparatus of the present invention is a data processing apparatus for transmitting data coded for each predetermined coding unit to a receiving side, and when performing normal reproduction on the receiving side, When transmitting a plurality of data used for normal reproduction and performing special reproduction on the receiving side, a predetermined conversion process for special reproduction is performed on the first data of the plurality of data used for normal reproduction. The above-described problem is solved by providing a data conversion unit that outputs the second data among the plurality of data used for the normal reproduction by performing a thinning process and outputting the second data.

Next, a data transmission system according to the present invention is a data transmission system comprising a transmitting device for transmitting data encoded for each predetermined coding unit and a receiving device for receiving the data. The device transmits a plurality of data used for the normal reproduction when performing the normal reproduction in the receiving device, and transmits the first data among the plurality of data used for the normal reproduction when performing the special reproduction in the receiving device.
Data conversion means for performing predetermined conversion processing for special reproduction on the data and outputting the data, and performing thinning processing on the second data of the plurality of data used for the normal reproduction and outputting the data. To solve the problems.

Next, the transmission medium according to the present invention is a transmission medium for transmitting data coded for each predetermined coding unit by the transmitting device to the receiving device. When a plurality of data used for the normal reproduction is transmitted, and when the special reproduction is performed by the receiving device, a predetermined conversion process for the special reproduction is performed on the first data of the plurality of data used for the normal reproduction. The above-described problem is solved by transmitting the extracted data and transmitting the data obtained by performing the thinning process on the second data among the plurality of data used for the normal reproduction.

That is, according to the present invention, the server on the transmission side is provided with data conversion means for converting data in accordance with the special reproduction designation. For example, during special reproduction such as fast forward reproduction or rewind reproduction, data is reproduced in special reproduction. And then distribute it,
Further, data to be output is selected from the data for normal reproduction according to the special reproduction speed, and the data is converted to data for special reproduction by rearranging the order at the time of reverse reproduction. here,
By selecting the data based on the playback speed of the special playback or the display time in the data for normal playback,
Enables conversion while preserving the synchronization relationship between data. Further, by selecting data to be selected from the data for normal reproduction as a set of display units (coding units) that are continuous to some extent, even if the reproduction speed of the special reproduction is high, it is significant when displayed. Convert to get the display result.

[0022]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below with reference to the drawings.

Video data such as still images and moving images, audio data, multimedia data such as text data and graphic data, etc. are distributed via a transmission medium, received at a decoding terminal, decoded, and displayed. FIG. 1 shows a configuration example of a data distribution system according to an embodiment of the present invention. In the following description, for example, video data and the like are referred to as ISO (International Organization for Standa
rdization) / IEC (International Electrotechnica)
l Comission) 13818-1 (so-called MPEG-2
Systems) for packetizing a transport stream (Transport stream: TS) for distribution.

In FIG. 1, the server 10 includes a storage unit 9 for storing multimedia data such as video data such as still images and moving images, audio data, text data, and graphic data. For example, video data is read from the storage unit 9, and the video data is sent to the multiplexing unit 4 via the data conversion unit 3 described later, for example. Further, output data from a data conversion unit 7 described later is also sent to the multiplexing unit 4 as necessary. The multiplexing unit 4 packetizes the data output from the data conversion units 3 and 7 into a TS. The TS packet is further formed into distribution data 22 by the transmission unit 5 and output to the transmission medium 21, and is distributed to, for example, the decoding terminal 12. At this time,
The distribution data 22 of the TS is transmitted using the protocol used in the transmission medium 21. For example, a TS satisfying the provisions of ISO / IEC13818-1
IEC61883 "Digital Interface for consumer
audio / video equipment ”, for example, IEEE (Institute of Electrical and Electronics)
Engineers) It is possible to transmit using a 1394 standard transmission medium. Note that the multiplexing unit 4 and the transmitting unit 5 may have an integrated configuration.

In the decoding terminal 12, the distribution data 22 is received by the reception unit 13 and sent to the separation unit 14. Separation unit 1
In 4, it separates the video data from the packet of the TS, the desired decoder 15 among the plurality of decoding units 15 ₁ to 15 _n
Send to The decoding unit 15 decodes the supplied data, that is, decodes the encoded video data. The decoded video data is sent to, for example, a display device (not shown) and displayed as a video image. Note that a plurality of decoding terminals 12 may be connected.

When the special reproduction display is performed at the decoding terminal 12 of the data distribution system, for example, a special reproduction designation signal 6 corresponding to an operation by the user of the decoding terminal 12 is transmitted to the decoding terminal 12 shown in FIG. It is transmitted to the server 10 via the transmission medium 21 from a transmission medium interface unit or the like that does not. The special reproduction designation signal 6 is a signal including a type of special reproduction such as fast-forward reproduction, rewind reproduction, frame-forward reproduction, and designation of video data and the like stored in the storage unit 9. If the server 10 and the decoding terminal 12 are connected in a short distance like a home network, for example, and the user can operate a front panel or a remote controller of the server 10, the front of the server 10 By operating a panel, a remote controller, or the like by a user, it is also possible to directly input the trick play designation signal 6 to the server 10.

The special reproduction designating signal 6 input to the server 10 is input to the special reproduction control unit 1 provided in the server 10. The special reproduction control section 1 controls the special reproduction control signals 2a and 2b including the type of special reproduction and the designation of video data in response to the special reproduction specifying signal 6.
Is generated and sent to the corresponding data converters 3 and 7, respectively. Note that any number of data conversion units 3 and 7 may exist in accordance with the number of data to be distributed.

The data conversion unit 3 controls the control signal 2a
The video data is read out from the storage unit 9 under the control of the trick play control unit 1 by. Further, the data conversion unit 3 uses the video data read from the storage unit 9 and converts the data obtained as a result of performing the special reproduction of the type specified by the control signal 2a, for example, in accordance with ISO / IEC13818-2. Generate and output as video data. That is, at this time, when decoding is performed in the decoding unit 15 of the decoding terminal 12 in the same manner as in normal reproduction, the data conversion unit 3 performs special reproduction (such as fast forward reproduction, rewind reproduction, or frame forward reproduction) (specified by the user). The video data read from the storage unit 9 is converted into video data that realizes (special reproduction).

Here, the data conversion process in the data conversion unit 3 will be briefly described with reference to FIGS.

FIG. 2 shows that the video data for normal reproduction (video data read from the storage unit 9) encoded by MPEG2 video is encoded by the data conversion unit 3 as an example of a special reproduction process. An outline of a data conversion process when realizing fast-forward playback and converting to video data satisfying the provisions of ISO / IEC13818-2 will be described. In the figure, I is an I picture, P is a P picture, and B is a picture.
Represents a B picture. In addition, in the specification of MPEG2 video, the encoding order (the order in which data is encoded in a bit stream) may be different from the actual display order because encoding is performed using prediction between pictures. ,
FIG. 2 shows the encoding order and the display order together. FIG.
2A shows the encoding order of the video data for normal reproduction, and FIG. 2B shows the display order when decoding and displaying the video data for normal reproduction. FIG. 2C shows the encoding order in the case where the conversion process for the special playback is performed such that the normal playback section US is shifted to the fast-forward playback section FS next to the normal playback section US and thereafter returned to the normal playback section US. FIG. 2D shows the display order in the case where a conversion process for special reproduction as shown in FIG. 2C is performed.

[0031] The data conversion unit 3, the fast-forward reproduction interval FS for the special playback is performed, in the drawing E _k, E _m, as shown in E _n, I during normal playback video data shown in FIG. 2 (a) picture (I _k, I _m, I _n) using an extracted, further, in order not to collapse the decoder buffer, performs data conversion processing to insert a repeat pictures B _R therebetween I picture. Although details will be described later, the above repeat pictures B _R, a picture of repeating the predicted original image, when the decoding is a picture is treated as B-picture. Also, repeat pictures B _R
Insertion also has the effect of adjusting the speed of fast forward playback.

FIG. 3 shows the MPEG2 vid as in FIG.
In the data conversion unit 3, rewind reproduction as an example of special reproduction processing is realized with video data for normal reproduction (video data read from the storage unit 9) encoded by eo, and ISO / An outline of a data conversion process when converting into video data satisfying the definition of IEC13818-2 will be described. FIG. 3A shows the encoding order of the video data for normal reproduction, and FIG. 3B shows the display order when the video data for normal reproduction is decoded and displayed. FIG. 3C shows a coding order in a case where a conversion process for special reproduction is performed such that a transition is made to the rewind reproduction section BS next to the normal reproduction section US and then to the normal reproduction section US. FIG. 3 (d) shows FIG. 3 (c).
The display order in the case where the conversion processing for special reproduction as described above is performed is shown.

[0033] The data conversion unit 3, the rewind reproduction section BS which special playback is performed, in the drawing E _k, E _m, as shown in E _n, in FIG. 3 during normal playback video data (a) I picture (I _k, I _m, I _n) interchanged and their order withdrawn, in order to prevent further collapse of the decoder buffer, performs data conversion processing to insert a repeat pictures B _R therebetween I picture .

As described above, the special reproduction video data (hereinafter, appropriately referred to as conversion data) converted by the data conversion unit 3 has the same configuration as that of the multiplexing unit 4 and thereafter as described above. The data is distributed to the decryption terminal 12 via the terminal. Note that, as in the data conversion unit 3, data obtained as a result of performing special reproduction using video data for normal reproduction read from the storage unit 9 is transmitted to, for example, ISO / IEC13818.
Japanese Patent Application No. 2000-178999 and Japanese Patent Application No. 2000-178999 discuss a technique for generating and outputting video data (converted data) satisfying the requirements of the US Pat.
No. -179000. An example of a more detailed configuration and operation of the data converter 3 will be described later.

As described above, according to the present embodiment,
The data conversion unit 3 of the server 10 uses the normal reproduction video data read from the storage unit 9 and performs the special reproduction of the type specified by the special reproduction specification signal 6 (control signal 2a). ISO / IEC13
818-2 is generated as video data that satisfies the rules, and the video data (converted data) is distributed to the decoding terminal 12, so that special distribution data for special reproduction as in the above-described prior art can be used and set in advance. There is no need to prepare, and the decoding terminal 12 can have a simple configuration that does not require a special terminal capable of handling special distribution data for the special reproduction.

Further, the data distribution system according to the present embodiment enables decoding and display of audio data other than video data and subtitle text data during special reproduction, and further enables the decoding of data other than video during special reproduction. The data conversion unit 7 is provided in the server 10 as a configuration for maintaining the synchronous relationship of the plurality of data when decoding and display are enabled.

The configuration and operation of the data conversion unit 7 for processing data other than video data such as the audio data and subtitle text data will be described below. Of course, the data other than the video data is not limited to audio data or text data for subtitles, and will be simply referred to as data in the following description.

FIG. 4 shows a detailed configuration of the data converter 7. FIG. 4 shows a server 10 other than the data converter 7.
At the same time.

The data conversion section 7 has a reading section 16 for reading data from the storage section 9 under the control of the control signal 2b from the special reproduction control section 1, and a time information is coded and added to the output data. And a time information rewriting unit 19. When there are a plurality of data conversion units 7, the reading unit 16 in the data conversion unit 7 may have a common configuration for all the data conversion units 7.

When the type, speed, and video data of the special reproduction are specified by the control signal 2b from the special reproduction control unit 1, the reading unit 16 specifies the read operation. The data to be output is selected from the data for normal reproduction (for example, data other than video data such as audio data and text data for subtitles) stored in the storage unit 9 in accordance with the specified special reproduction speed, and the special reproduction is performed. Generate data for When rewind reproduction is designated as special reproduction, data conversion processing for rearranging the order of the selected data is also performed. When the return from the special reproduction to the normal reproduction is designated by the control signal 2b from the special reproduction control section 1, the reading section 16
Returns to the process of reading the normal reproduction data from the storage unit 9.

The time information rewriting unit 16
When time information such as a data arrival time, a display start time, a display end time, a display time, or a decoding time is added to data output from 0, the time information is encoded and added to the data. In the case of audio data, these pieces of time information are actually times related to sound emission,
Since image display and sound emission are related, expressions such as display start time, display end time, and display time are used as described above. The same applies to the following description.

Next, the detailed operation of the data converters 3 and 7 will be described with reference to FIGS.

First, referring to FIG. 5, as a first data conversion processing example in the data distribution system of the present embodiment,
The state of data conversion when performing double-speed fast-forward playback will be described.

FIG. 5A shows that video data (video data read from the storage unit 9) input to the data conversion unit 3 is used for special reproduction in the data conversion unit 3 as described above. This shows the display timing (display timing of the video data for normal reproduction) when the conversion processing has not been performed. Note that in some encoding methods such as MPEG2 video, the actual display order and the encoding order (the order in which data is encoded in the bit stream) may be different. In order to make it easy to understand, they are shown according to the display order. AU300 and AU30 in FIG.
4 and the like represent one display unit, which corresponds to a picture in the case of video data. Normally, data is encoded for each display unit. This display unit, that is, the coding unit, is hereinafter referred to as an AU (access unit). The display time of one AU generally depends on the encoding method. FIG. 5B shows the display timing (display timing of the normal reproduction data) when the data input to the data conversion unit 7 is not converted by the data conversion unit 7 for special reproduction. Represents.

In FIG. 5C, in the data conversion section 3, the special reproduction control section 1 controls the special reproduction, and the AU next to the AU 300 in the normal reproduction section US becomes the fast forward reproduction section FS. , AU303 and thereafter show the display timing when a process for returning to the normal playback section US is performed (the display timing when the conversion process is performed). That is, in FIG. 5C, when the double-speed reproduction is performed as the special reproduction, the data conversion unit 3 converts the normal reproduction video data of FIG. select AU301 and AU302 like an I-picture, further performs conversion processing to insert a repeat pictures R _B is B-picture between them, the conversion of fast forward playback section FS of (c) of FIG. 5 Generate data. In this case, the decoding terminal 12 displays the special reproduction (fast-forward reproduction) after the display end time To (special reproduction start time To ') of the AU 300, and displays the normal reproduction again from the AU 303 after the special reproduction end time Ti'. Will be done.

Here, when fast forward reproduction is performed as special reproduction as shown in FIG. 5, the time t when the conversion processing for the special reproduction is not performed and the conversion processing for the special reproduction are performed. The relationship with time t 'when
It changes every time the trick play is performed. On the other hand,
When returning from the fast-forward playback section FS to the normal playback section at the time Ti ′, the display must be restarted from the data corresponding to the AU 303 in FIG. 5A on the time t before the special playback is performed. . Therefore, the data conversion unit 3
Then, even when the data conversion process for the special reproduction is performed, the AU 303 corresponding to the special reproduction end time Ti on the time t before the special reproduction is performed is replaced with the AU 303 of the special reproduction end time Ti ′ on the time t ′. When it can be selected.
The time t when the conversion process is not performed and the time t ′ when the conversion process is performed are associated with the special reproduction end time T on the time t ′ when the conversion process is performed.
The offset can be calculated by subtracting the display start time of the AU 303 on the time t when no conversion processing is performed from i ′ (display start time of the AU 303 on the time t ′) as an offset. That is, the time on the time t before the conversion processing is performed is obtained by subtracting the offset from the time on the time t 'when the conversion processing is performed. In addition, since the offset does not change during normal reproduction, it is considered that the offset at the end of the previous special reproduction is effective even at the start of the next special reproduction. Therefore, assuming that this offset is F, for example, the special reproduction start time To on the time t before the conversion processing for the special reproduction is performed is the special reproduction start time To on the time t 'when the conversion processing for the special reproduction is performed. The start time To 'can be used to calculate the following equation (1).

To = To'-F (1) Further, assuming that the reproduction speed of the special reproduction is n times, the time T on the time t before the conversion processing for the special reproduction is performed is the same as the time T for the special reproduction. Time t 'at which conversion processing was performed
From the above time T ′, it is obtained by the following equation (2).

T = To + (T′−To ′) × n (2) The special reproduction control unit 1 sends the special reproduction start time To ′ or the special reproduction end time Ti ′ and the type of the special reproduction to the data conversion unit 7. In addition, the offset is notified to the data conversion unit 7 directly from the data conversion unit 3 or via the special reproduction control unit 1. The type of special playback is
In the example shown in FIG. 5, double-speed fast-forward playback is indicated. in this way,
By knowing the trick play start time To 'or trick play end time Ti', the trick play type, and the offset, the data conversion unit 7 performs trick play in FIG.
Is realized.

That is, in the data conversion unit 7, when fast-forward playback is designated by the special playback control unit 1, the AU in the normal playback data is specified according to the designated playback speed.
Is thinned out and output. In this example, an example of double-speed fast-forward playback is given. Therefore, the data conversion unit 7 sets the output number of AUs of normal playback data to １ ／, that is, FIG. 1AU is thinned out for every 2AU of
As shown in FIG. 5D, a conversion process for connecting the AUs is performed to generate converted data of the fast-forward playback section FS in FIG. 5D. In particular, in the case of data in which the display time of the AU is constant and the display is continuous (for example, audio data or the like), the data conversion unit 7 thins out the number of AUs to be output so as to be the reciprocal times the reproduction speed. Thus, the data for normal reproduction is converted into the data for the special reproduction speed designated by the special reproduction control unit 1.

Here, in the case of the example of FIG. 5, since all data are converted according to the same reproduction speed,
In each playback section, no synchronization deviation is accumulated between a plurality of data. However, since the display time of the AU differs depending on the encoding method, a synchronization shift may occur when the special reproduction ends. For example, the synchronization relationship between the AU 303 and the AU 306 in FIG.

For this reason, in this embodiment, in order to prevent the accumulation of synchronization deviation when ending the special reproduction, the special reproduction on the time t before the conversion processing for the special reproduction is performed is performed. By starting to output the AU near the end time Ti near the special reproduction end time Ti ′ on the time t ′ after the conversion process, the synchronization shift at the end of the special reproduction is suppressed within the display time of 1 AU. ing. FIG.
In the example of, the AU 306 having the display time immediately after the special reproduction end time Ti on the time t before the conversion processing is set as the first AU displayed after the special reproduction end time Ti 'on the time t' after the conversion processing. Output.

Further, the time information rewriting section 19 provided in the data conversion section 7 converts time information such as the data arrival time, the display start time, the display end time, the display time or the decoding time into the time t ′ after the conversion processing. Rewrite to time information and output. That is, as described above, the time information rewriting unit 19 converts the converted data output by thinning out the AUs in the normal reproduction data based on the time information of the previous AU.
U time information is calculated, and the time information is encoded into data and output. Since the display time of the AU itself does not change, for example, the display time of the AU on the time t ′ after the conversion processing is changed to the display time on the time t ′ of the previous AU.
It can be uniquely obtained by adding the display time of U.

As described above, according to the data distribution system of the present embodiment, the audio data, the text data for subtitles, and the like are also converted into data for special reproduction by the data conversion unit 7 and distributed. Even during special playback, the decoding terminal 12 can automatically display such audio data and text data for subtitles by the same decoding and display processing as during normal playback. There is no need to use and prepare in advance such special distribution data for special reproduction, and the decoding terminal 12 has a simple configuration that does not require a special terminal capable of handling the special distribution data for special reproduction. It is possible to do.

Further, according to the data distribution system of the present embodiment, even if special reproduction is performed on a plurality of different data, the deviation of the synchronization relationship between the plurality of different data is suppressed to be small, and the synchronization deviation is accumulated. Can be avoided. For example, the AU 306 output at the end of the special reproduction is reduced by one, and the AU 306 that returns to the normal reproduction is
By outputting at the original display time (the display time on the converted time t ′), it is possible to eliminate the deviation of the synchronization relationship between different data. However, in this case,
There are sections where no data is displayed.

Next, a second data conversion example in the data distribution system of the present embodiment will be described with reference to FIG. FIG. 6 shows the same process as FIG. 5, and (a) and (c) of FIG. 6 represent the same processing as (a) and (c) of FIG.

Here, as described with reference to FIG. 5, when performing a process of thinning out AUs in accordance with the designated playback speed in the special playback, the result of decoding and displaying is undesirable. It may be. That is, for example, in the case of audio data, as shown in FIG.
If a conversion process that thins out every other time is performed, when the converted data after the thinning out is decoded, a decoded result that is very hard to hear will result.

Therefore, in the second data conversion processing according to the embodiment of the present invention, in order to solve the above-described problem caused by the AU thinning, the number of AU thinnings is not performed in the AU unit at the time of special reproduction. The thinning is performed in units of the AUs. The example of FIG. 6 shows an example in which thinning is performed in units of a group of five AUs.

In the case of the second data conversion process shown in the example of FIG. 6, when fast-forward playback is designated by the special playback control unit 1, the data conversion unit 7 responds according to the designated playback speed. The AU is thinned out in units of a group of five AUs (hereinafter, referred to as a set AU) in the data for normal reproduction. That is, as an example, in the case of 2 × speed reproduction, the special reproduction start time To of the normal reproduction data in FIG.
The set of the next five AUs in the set AU407 consisting of the following five AUs is thinned out, and the set AU408 of the next five AUs is thinned out.
, The next set of five AUs is thinned out, and further processing is performed to leave the next set of five AUs AU409, and as shown in FIG.
A conversion process for connecting U is performed, and FIG.
The conversion data of the middle fast-forward playback section FS is generated. Note that the unit of the AU group in the above-described thinning-out processing is not based on the number of AUs, but is based on the display time length such that data (AU) corresponding to display for 0.5 seconds is used as a unit. I do not care.

According to the second data conversion process, thinning is performed in units of a collection of several AUs. In each set AU that is left without thinning, AUs that are temporally continuous Is decoded and displayed, so that the quality of the decoding and display result can be improved. Further, in the second data conversion processing, data other than video data can be displayed during special reproduction according to the reproduction speed while avoiding a shift in synchronization between different data. This is the same as the case of the first data conversion processing shown in FIG.

Next, a third data conversion processing example in the data distribution system of the present embodiment will be described with reference to FIG. FIG. 7 shows the same process as FIG. 5, and FIGS. 7A and 7C show the same processes as FIGS. 5A and 5C.

If the data to be displayed during trick play is data that may be interrupted, the AU to be output is
(Or the display time of the output AU) need not necessarily be thinned out so as to be the reciprocal multiple of the playback speed. For example, even if the number of It is considered that the quality of the display result is hardly affected.

Therefore, in the third data conversion processing according to the embodiment of the present invention, if data to be displayed during special reproduction is data that may be interrupted, the number of AUs to be output (or display of AUs to be output) Time) to be less than or equal to the reciprocal multiple of the playback speed, and for the normal playback data before conversion that is less than the reciprocal multiple of the playback speed,
A conversion process is performed to leave a section in which no data to be displayed exists as a so-called gap.

In the case of the third data conversion processing shown in the example of FIG. 7, when fast-forward playback is designated by the special playback control unit 1, the data conversion unit 7 performs a reciprocal multiple of the designated playback speed. AU thinning is performed as follows. That is, in the case of the example of FIG. 7, the data conversion unit 7 performs the AU thinning so that the data for normal reproduction shown in FIG. 7B is smaller than the reciprocal times the designated reproduction speed. , AU505, AU506, AU507, etc., and select those AU505, AU505 as shown in FIG.
The conversion data of the fast-forward playback section FS with a gap left between the 506 and the AU 507 is formed.

However, if a gap exists as described above, AU505, AU506, AU5 in FIG.
It is necessary to calculate the 07 display time PTS (Presentation Time Stamp). In the data conversion unit 7 of the present embodiment, the AU display time P on the time t ′ after the conversion processing
TS ′ is calculated from the display time PTS on the time t before the conversion processing as in the following equation (3).

PTS ′ = To ′ + (PTS−To) / n (3) In the third data conversion method, as shown in FIG. 7B and FIG. When an AU is selected from among the data for variable-speed reproduction, an AU having a display time near the display time of the AU selected for variable-speed reproduction is selected from other data such as video data for normal reproduction. . This makes it possible to preserve the local synchronization relationship of AUs that are decoded and displayed during trick play between different data. That is, for example,
In the data conversion unit 7, the AU5 having the display time immediately after the display time of the AU 501 of the video data selected at the time of variable-speed playback, out of the video data for normal playback shown in FIG.
06 is selected from the data for normal reproduction shown in FIG. 7B, and similarly, the AU 507 having the display time immediately after the display time of the AU 502 of the video data is selected. As a result, AUs whose display times are close to each other in the original data for normal reproduction are displayed at the same time even between different data during special reproduction, so that the display result retains a local synchronization relationship. The display time of the AU selected for variable-speed playback from the video data for normal playback is notified directly from the data converter 3 or to the data converter 7 via the special playback controller 1.

In the third data conversion method, it is also possible to select a set of several AUs as a unit, as in the second data conversion method described above.

Next, a fourth data conversion processing example in the data distribution system of this embodiment will be described with reference to FIG. FIG. 8 shows the same process as FIG. 5, and FIGS. 8 (a) and (c) show the same processing as FIGS. 5 (a) and (c).

Here, in the fourth data conversion method,
As in the third data conversion method described with reference to FIG.
A as the data for variable speed reproduction from the data for normal reproduction
When selecting U, an AU having a display time near the display time of the AU selected for variable-speed playback is selected from other data such as video data for normal playback.
In order to avoid the occurrence of a section where data to be displayed does not exist (a so-called gap), the above-mentioned selected A
AUs subsequent to U are also output.

That is, the data conversion section 7 converts the AU 606 having the display time immediately after the display time of the AU 601 of the video data selected at the time of variable-speed reproduction from the video data for normal reproduction shown in FIG. In addition to selecting from the data for normal reproduction shown in (b), several AUs following the AU 606 are also output, and similarly, the AU 6 having the display time immediately after the display time of the AU 602 of the video data is output.
07, and also outputs some AUs following the AU 607, and then connects the AUs 602 and the following AUs, the AU 607 and the subsequent AUs as shown in FIG. The conversion data of the fast-forward playback section FS not to be formed is formed. In other words, in the data conversion unit 7, when selecting an AU, as shown in FIG. 8D, a number of data conversion units 7 are set so that no gaps exist between the AU 606 and the AU 607 and between the AU 607 and the AU 608. A conversion process is performed so that the AU is output after the AU 606 and the AU 607.

When data to be displayed or the like during the special reproduction is data that is not desired to be interrupted, a variable-speed reproduction section (fast-forward reproduction section FS in FIG. 8) in which no gap exists (has no interruption) is set. It can be formed.

According to the fourth data conversion method, similarly to the third data conversion method, the data conversion unit 7 controls the speed change of the video data for normal reproduction shown in FIG. AU of video data selected during playback
AU 606 having a display time immediately after the display time of 601 is
By selecting from the data for normal reproduction shown in FIG. 8B, and similarly selecting the AU 607 having the display time immediately after the display time of the AU 602 of the video data, the original normal data can be obtained even between different data during special reproduction. In the reproduction data, AUs whose display times are close are displayed at the same time, and the display result not only preserves the local synchronization relationship, but also eliminates a section (gap) where there is no data to be displayed. , It is possible to eliminate the quality deterioration of the decoding and display results due to the existence of the gap. It should be noted that a synchronization shift caused by a difference in the display time of the AU depending on the encoding method can be solved in the same manner as in the first data conversion method.

In the above-described first to fourth data conversion methods, the fast forward reproduction in the forward direction has been described as an example of the special reproduction processing. However, the present invention provides a fifth data conversion method in which the reproduction direction is reversed. The same applies to the reverse reproduction as described above.

In the case of the rewind reproduction according to the fifth data conversion method, the variable n representing the speed of the special reproduction in the above-mentioned equations (2) and (3) becomes a negative value. For example, 2
In the case of double-speed rewind reproduction, the value of the variable n is -2.
Becomes

When time information such as display time and decoding time is encoded in data, the time information rewriting unit 1
In step 9, the time information is rewritten to the time after data conversion for rewind reproduction and encoded.

Further, in the case of rewind reproduction, for data such as audio data, for which reproduction and display results which are not preferable if reproduced in reverse order are obtained, the above-described first to fourth data conversion methods are used. A group of AUs that are temporally continuous among AUs selected in the same manner as described above is output in the forward direction within the group of AUs.

That is, for example, as in the case of the fast-forward reproduction shown in FIG. 6 described above, an example in which five sets AU are converted as a unit will be described. The set AU 705, the set AU 706, and the set AU 705 including five AUs after the special reproduction start time To in the data for normal reproduction of FIG.
As shown in FIG. 9 (d), a conversion process is performed such that the order of each set AU is arranged in reverse order while maintaining the forward direction for each AU in the set AU. The conversion data of the middle rewind playback section BS is generated. Note that FIG. 9 is shown in the same manner as FIG. 5, but the AUs in the rewind playback section BS of (a) and (c) of FIG. Also in this example, the unit of the AU group in the thinning-out processing is not the number of AUs but data (AU) corresponding to, for example, display for 0.5 seconds.
May be based on the display time length.

As described above, the forward direction is maintained for each AU in the set AU, and the AUs are output in reverse order between the set AUs. Data can be output. As a result, good decoding and display results can be obtained even for data such as audio data for which decoding and display results that are undesirable when reproduced in reverse order are obtained.

In the first to fifth data conversion processes described above, when the display start time and the display end time or the display time are encoded and added to the input data itself, the time information of the data conversion unit 7 An example is given in which the rewriting unit 19 corrects and outputs the display start time, the display end time, or the display time.
When the display start time and the display end time or the display time are added to the data by the multiplexing unit 4, the data conversion unit 7 notifies the multiplexing unit 4 of the change of the display start time, the display end time or the display time, The multiplexing unit 4 adds the changed display start time, display end time, or display time.
Alternatively, when the display start time and the display end time or the display time are added to the data by the transmission unit 5, the data conversion unit 7 similarly notifies the transmission unit 5 of the change in the time information, and the transmission unit 5 changes the time information. A later display start time, display end time, or display time is added to the data.

The data conversion unit 7 according to the embodiment of the present invention
In this case, the AU to be output at the time of trick play is selected from the data for normal playback. However, when the data is encoded using inter-AU prediction, such as MPEG2 video, an AU that does not break the prediction relationship is used. Select As an example with reference to FIG. 6, when data is encoded by an encoding method using prediction from a previous AU, the first AU of the selected set AU 408, AU 409, and AU 406 returning to normal reproduction Is selected from intra-coded AUs that do not use prediction, it is possible to convert to decoded data that can be decoded without breaking the prediction relationship.

When the data conversion process is not performed by the data conversion unit 3, the data conversion unit 3 is unnecessary, and a configuration in which the data conversion process is performed only by the data conversion unit 7 is also included in the present invention. .

As described above, according to the data distribution system of the present embodiment, the server 10 includes the data conversion units 3 and 7 for converting data in accordance with the special reproduction designation.
At the time of special reproduction, data corresponding to the special reproduction speed is selected from the data for normal reproduction, and when performing reverse reproduction, a conversion process for rearranging the order of the data is performed. It is possible to display data or the like even during special reproduction without special processing.

Further, according to the present embodiment, the data is selected based on the reproduction speed of the special reproduction or the display time in the data for normal reproduction, thereby enabling the conversion processing in which the synchronization relationship between the data is preserved. It has become.

Further, according to the present embodiment, by selecting data to be selected from the data for normal reproduction in a continuous data unit, even if the reproduction speed of the special reproduction is high, the data can be displayed at the time of display. There is also an effect that a meaningful display result can be obtained.

Next, an example of the detailed configuration and operation of the data converter 3 for performing a conversion process on video data will be described below.

The data conversion unit 3, as shown in FIG.
It comprises a reading section 101 for reading video data and insertion data from the storage section 9, a vbv delay detecting section 102, a stuffing inserting section 103, and a switching output section 105. The insertion data stored in the storage unit 9 is, for example, a repeat picture conforming to the MPEG2 standard. The repeat picture is a picture indicating that the prediction source video data is repeated because all the macroblocks are constituted by skip macroblocks. Here, the insertion data is called repeat data and includes data indicating that it is the same as the prediction source. In particular, in the case of video data, it is called a repeat picture. In this example, a case where only video data and insertion data are stored in the storage unit 9 will be described. However, multimedia data such as still image data, audio data, text data, and graphic data may be used.

The reading unit 101 reads specified video data from the storage unit 9 and reads inserted data from the storage unit 9 in accordance with the control signal 2a from the trick play control unit 1. Readout unit 101
Selects and reads out only video data necessary for special reproduction from designated video data according to the type of special reproduction included in the control signal 2a. The reading unit 101 outputs the read video data 110 to the vbv delay detection unit 102, and outputs the read insertion data 111 to the stuffing insertion unit 105.

The vbv delay detection section 102 detects a vbv delay which is information indicating the locus of the bit occupancy of the vbv buffer encoded for each video data.
The vbv delay detection unit 102 includes a read unit 101
Is output to the switching output unit 105, and the detected vbv delay is supplied to the stuffing insertion unit 103.

The stuffing insertion unit 103 performs the following based on the vbv delay from the vbv delay detection unit 102.
The data size of the insertion data is adjusted in order to make the trajectory of the bit occupancy of the vbv buffer continuous. The stuffing insertion unit 103 adjusts the data size of the insertion data by inserting the stuffing data into the insertion data. The stuffing insertion unit 103 outputs the insertion data after adjusting the data size to the switching output unit 105.

For example, when the insertion data is the above-described repeat data, the stuffing insertion unit 103 does not break down the vbv buffer by adding the stuffing data to the repeat data because the data size of the repeat data is smaller than that of the I picture. Therefore, it is possible to set a desired data size. The data size of a repeat picture when connecting video data is determined by referring to the vbv delay of the video data used for editing. Note that the insertion data may be composed of a plurality of repeat pictures.

The switching output unit 105 switches the video data from the vbv delay detection unit 102 and the insertion data from the stuffing insertion unit 103 to perform the special reproduction according to the control signal 2a from the special reproduction control unit 1. The converted data is output to the multiplexing unit 4. The switching output unit 105 receives video data from the switched terminal b and outputs the video data from the common terminal a, and also receives input data from the switched terminal c and outputs the data from the common terminal a to output video data or insertion data. Is output to the multiplexing unit 4 as conversion data.

Next, when the conversion data for the special reproduction is output in the data conversion unit 3 described above, the switching output unit 105 switches the video data from the video data A to the video data B and outputs the video data. The insertion method will be described.

FIG. 11 shows the locus of the bit occupancy of the video data A in the vbv buffer, and FIG.
5 shows the locus of the bit occupancy of the vbv buffer. Here, an example in which data after frame n in video data A is switched to data after frame m of video data B and output will be described. That is, when frame n-1 of video data A is an out frame, the end point of frame n-1 is an out point, and when frame m of video data B is an in frame, the start point of frame m is an in point. .

According to FIGS. 11 and 12, since the vbv delay of the frame n is different from the vbv delay of the frame m, when the switching is performed by the switching output unit 105, as shown in FIG. The trajectory of the bit occupancy may overflow the buffer size of the vbv buffer or cause an underflow without matching.

On the other hand, when switching the video data, the data conversion unit 3 performs the switching between the frame n and the frame m as shown in FIG. 14 in order to maintain the consistency of the locus of the bit occupancy of the vbv buffer. Insertion data is inserted in between, and processing is performed so that the vbv buffer is not broken before and after the switching of the video data.

That is, the vbv delay detector 102
Detects the vbv delay of the video data before and after the switching in order to make the trajectory of the bit occupancy of the vbv buffer continuous when the switching of the video data is performed by the switching output unit 105. On the other hand, the stuffing insertion unit 103 inserts stuffing data into a repeat picture to make the trajectory of the bit occupancy of the vbv buffer continuous, and adjusts the data size of the inserted data. Then, the switching output unit 105 performs switching processing so as to adjust the picture type of the repeat pictures and the number of repeat pictures constituting the insertion data to be inserted between the video data A and the video data B. The data size of the insertion data to be inserted between A and the video data B is determined. Thereby, the switching output unit 105
Outputs to the multiplexing unit 4 conversion data for special reproduction that does not break down the vbv buffer.

Next, the processing of the data conversion unit 3 when the special reproduction designating signal 6 for specifying the temporary stop as the type of special reproduction is input to the special reproduction control unit 1 will be described.

When the control signal 2a for pausing as a type of special reproduction is input from the special reproduction control unit 1, the data conversion unit 3 inserts insertion data after the out-frame as shown in FIG. To release the stop, the video data returns to the video data after the out-frame.

FIG. 16 shows a processing procedure of the data conversion unit 3 when performing such processing. According to FIG. 16, when the read unit 101 reads out the video data for normal reproduction, and the control signal 2a to stop temporarily is being input to the decoding terminal 12 while transmitting the transmission data (step S1). ST11) First, a process of determining an out frame is performed (step ST12). At this time,
The reading unit 101 determines whether the out-frame picture type is an I picture or
It is desirable to select the video data of the picture. Thereby, the reading unit 101 can increase the image quality during the pause.

Next, the data converter 3 inserts the insertion data for a time corresponding to the temporary stop (step ST1).
3) The process of inserting the insertion data is repeated until the control signal 2a for releasing the suspension is input (step ST14).

At this time, the reading section 101 reads the repeat picture from the storage section 9 as insertion data and outputs it to the stuffing insertion section 103 as data to be displayed on the decoding terminal 12 side during the pause. The stuffing insertion unit 103 sets the reading unit 10 to a data size obtained by multiplying the video data rate by the display interval time of the video frame in order to prevent the breakdown of the vbv buffer.
The stuffing data is added to the repeat picture from No. 1 and output to the switching output unit 105. Switching output unit 105
Outputs the repeat picture from the stuffing insertion unit 103 to the multiplexing unit 4 during the pause.

Here, the stuffing insertion unit 103
Maintain the display order of the pictures before the out-frame by determining the picture type of the repeat picture so that the number of consecutive B-pictures after the out-frame is the same as that during normal playback without pause. Can be.

When the pause is released, the reading unit 101 of the data conversion unit 3 determines the picture type of the first picture after the in-frame (step ST1).
5) If it is determined that the picture is not a B picture, the process returns to normal reproduction as it is (step ST17), and the process ends.
When determining that the picture is a B picture, the reading unit 101 performs a correction process (step ST16). When the picture type of the first picture after the in-frame is not a B picture, the reading unit 101 returns to normal reproduction (step ST17) and ends the process. I do.

The above-described correction processing will be described with reference to an example in which a pause processing is performed on video data for normal reproduction in an encoding order and a display order as shown in FIG. In the following description, it is assumed that an arrow in the figure is a motion prediction direction, a frame indicated by the arrow is a prediction destination picture, and a start source of the arrow is a prediction source picture.

The video data for normal reproduction shown in FIG. 17A is data in which a frame I ₆ (I picture whose display order is the sixth) is an out-frame and a frame B ₄ is an in-frame. Here, in the video data for normal reproduction, the frame immediately after the in-frame becomes a B picture,
Frame B ₄ and frame B ₅ are frame I ₆ and frame P ₉
Are encoded using predictions from

The repeat picture R (B ₁ ) to repeat picture R (P ₉ ) are inserted between the frame I ₆ and the frame B ₄ by the switching output unit 105 and are used for the special reproduction shown in FIG. When the conversion data is output from the switching output unit 105 to the multiplexing unit 4 as the converted data, the frames B ₄ and B ₅ are decoded by the decoding terminal 12 using the prediction from the repeat picture R (P ₆ ) and the repeat picture R (P ₉ ). Will be decrypted. In such a case, the decoding result of the repeat picture R (P ₉ ) is equal to the frame I ₆ , but the decoding result of the frame P ₃ is different from that of the repeat picture R (P ₆ ), so that the frames B ₄ and B ₅ Cannot be decoded correctly.

On the other hand, in the correction processing, the reading unit 105 sets the frame B which is the B picture following the head in the display order after the in-frame as shown in FIG.
_4, the frame B _5, is correctly decoded by inserting the repeat pictures for correction to replace the repeat B picture using only backward prediction. Readout unit 10
1 is a repeat picture R as shown in FIG.
Repeat picture R using only prediction from (P ₉ )
(B ₇ ), repeat picture R (B ₈ ) and frame B ₄ ,
Storage unit 9 inserts data to replace the frame B ₅
The process of reading from is performed. As a result, the decoding terminal 12 can correctly decode the frames B ₄ and B ₅ . Further, the stuffing insertion unit 103 can guarantee that the vbv buffer is not broken by inserting the stuffing data into the repeat pictures R (B ₇ ) and the repeat pictures R (B ₈ ) replaced for correction.

Note that ISO / IEC14496-2 (M
When transmitting video data encoded by an encoding method capable of making the display interval of a picture variable, such as an encoding method defined by PEG-4 video), instead of inserting a repeat picture, By changing the display time of the picture, it is possible to repeat the picture in the special reproduction and to realize the pause.

Next, the processing of the data conversion unit 3 when a special reproduction specifying signal 6 for specifying fast-forward reproduction as a type of special reproduction is input to the special reproduction control unit 1 will be described.

When the control signal 2a for fast forward reproduction is input from the special reproduction control unit 1 as a type of special reproduction, the data conversion unit 3 selects an appropriate I picture from the out-frame and thereafter as shown in FIG. The reading unit 101 is operated to read from the storage unit 9 by
Insertion data is inserted so as not to break down the bv buffer, and when fast-forward playback is released, the video data returns to the video data after the in-frame.

FIG. 19 shows a processing procedure of the data conversion unit 3 when performing such processing. According to FIG. 19, when the control unit 2 reads the video data for normal reproduction by the reading unit 101 and performs fast-forward reproduction during transmission of transmission data to the decoding terminal 12 (step S1). ST21) First, a process of determining an out frame is performed (step ST22). At this time, it is desirable that the reading unit 21 selects video data in which the out-frame picture type is I picture. Accordingly, the reading unit 21 can increase the image quality immediately after the fast forward reproduction.

Next, the reading section 102 selects and reads an I picture or a P picture to be used for fast-forward playback from the video data for normal playback stored in the storage section 9 (step ST23). Here, the reading unit 1
In No. 02, by selecting an I picture, the image quality during fast-forward playback can be increased. Also,
When the fast-forward playback speed is specified by the control signal 2a from the special playback control unit 1, the reading unit 102 adjusts the interval between the selected pictures to adjust the fast-forward playback speed.

Next, the vbv delay detector 102 receives the video data read in step ST23 from the reader 102, and the stuffing inserter 103
The repeat picture (insertion data) read by the reading unit 102 is supplied. The vbv delay detection unit 102 detects the vbv delay using the video data, and the stuffing insertion unit 103 inserts the stuffing data into the repeat picture based on the vbv delay so that the trajectory of the bit occupancy of the vbv buffer is continuous. Output to the output unit 105. Thereby, the switching output unit 1
In step S05, a repeat picture and stuffing data are input to video data as shown in FIG.
T24).

Next, the data conversion section 3 repeats the processing in step ST23 and the processing in step ST24 until the control signal 2a indicating the release of the fast-forward playback is input and determines that the fast-forward playback is to be released. When the reproduction is canceled, the process proceeds to the next processing (step ST25).

When the fast-forward reproduction is released, the reading section 102 performs a process of selecting an I picture to be used as an in-frame and reading it from the storage section 9 (step ST2).
6), and supply it to the vbv delay detection unit 102.

Next, the vbv delay detecting section 102 detects a vbv delay of video data to be an in-frame from the reading section 102 and outputs the stuffing inserting section 103
Inserts stuffing data based on the vbv delay so as not to break the vbv buffer, and outputs a repeat picture to the switching output unit 105 (step ST2).
7).

Next, reading section 102 determines whether or not the selected in-frame video data is the first in the coding order of the closed GOP (step ST28).

When the in-frame video data is the first video data in the coding order of the closed GOP, the reading section 102 returns to the process of reading the video data for normal reproduction (step ST3).
0), and the process ends.

[0118] More specifically, when releasing the fast-forward playback frame I ₂ is the head of a closed GOP as shown in (a) of FIG. 20 as an in-frame, repeat pictures as shown in FIG. 20 (b) Can be decrypted on the decoding terminal 12 side without inserting.

On the other hand, when the video data to be in-frame is not the first video data in the coding order of the closed GOP, the reading unit 102 performs a correction process of replacing the video data with a repeat picture having the same data size (step ST29). The process returns to the process of reading the video data for reproduction (step ST30), and the process ends.

More specifically, when the fast forward reproduction is canceled by setting the frame I ₂ which is not the head of the closed GOP as shown in FIG. 21A as an in-frame, immediately after the in-frame as shown in FIG. Since the prediction source picture has been switched for special reproduction, the B picture continuous from the head in the display order cannot be decoded correctly. Here, the reading unit 102 performs corrective processing of replacing the B picture immediately after the in-frame with repeat pictures R (B ₀ ) and R (B ₁ ) using only backward prediction, thereby decoding accurately on the decoding terminal 12 side. Let me do the processing.
Also, the stuffing insertion unit 103 stores the data of the pictures B ₀ and B ₁ before replacement and the repeat pictures R (B ₀ ) and R (B ₁ ) after replacement in order to prevent the breakdown of the vbv buffer. Insert stuffing data so that the sizes are equal.

When performing fast-forward playback, the data conversion unit 3 always checks that the in-frame is a closed GOP.
, And so on, unless the in-frame condition determined in step ST26 is particularly different from the picture condition selected in step ST23, the processes in steps ST26 and ST27 are performed in steps ST23 and ST27, respectively. Step ST24
You may go in.

When performing fast-forward playback in the reverse direction, the data conversion unit 3 selects the I-selection in step ST23.
Processing for arranging the time direction of the picture in the reverse direction is performed.

Next, the processing of the data conversion unit 3 when the special reproduction specifying signal 6 for specifying slow reproduction as the type of special reproduction is input to the special reproduction control unit 1 will be described.

When the control signal 2a for performing slow reproduction as the type of special reproduction is input from the special reproduction control section 1, the data conversion section 3 starts the frame of the normal reproduction video data from the out-frame and thereafter as shown in FIG. A process of inserting a repeat picture in between is performed, and when the slow reproduction is released, the video data returns to the video data after the in-frame.

FIG. 23 shows a processing procedure of the data conversion unit 3 when performing such processing. According to FIG. 23, when the control section 2 reads the video data for normal reproduction by the reading section 102 and performs the slow reproduction while transmitting the transmission data to the decoding terminal 12 (step S1). ST41) First, a process of determining an out frame is performed (step ST42).

Here, the video data for normal reproduction is IS
In the case of a TS defined by O / IEC13818-1, the display time information of an I picture or a P picture may be encoded and transmitted prior to the picture data. When the display time is encoded, the out-frame is selected from the I picture or the P picture.

Next, in order to obtain the display time of the current I picture or P picture, the reading unit 102 calculates the number of repeat pictures to be inserted until the next I picture or P picture after starting slow playback. It is determined (step ST43). When it is not necessary to encode the display time, the reading unit 102 does not need to determine the number of insertions in advance. The reading unit 102 controls the speed of slow reproduction based on the number of pictures to be inserted.

Next, the switching output unit 105 performs a process of inserting a repeat picture, which is a B picture, between pictures of video data for normal reproduction (step ST44).
The conversion data for special reproduction decoded as slow reproduction is output to the multiplexing unit 4. At this time, the stuffing insertion unit 103 uses the stuffing data so that the data size of the repeated picture to be inserted is the data size obtained by multiplying the video data rate by the display interval time of the video frame, and does not break down the vbv buffer. I guarantee that. Here, when the display time is encoded, the switching output unit 105 performs control so that slow playback is not canceled until the number of repeat pictures determined in step ST43 is inserted. The accuracy of the displayed time is maintained.

Next, the data conversion section 3 determines whether or not the control signal 2a for canceling the slow playback has been input from the special playback control section 1 (step ST45). Is operated by the reading unit 102 so as to read (step ST4).
6) When the processing is terminated and the slow reproduction is not canceled, the processing of the above-mentioned steps ST43 and ST44 is repeated.

Next, the processing of the data conversion unit 3 when a special reproduction specifying signal for specifying jump reproduction as a type of special reproduction is input to the special reproduction control unit 1 will be described.

When the control signal 2a for performing the jump reproduction as the type of the special reproduction is input from the special reproduction control unit 1, the data conversion unit 3 starts the frame of the normal reproduction video data from the out-frame and thereafter as shown in FIG. A process of inserting a repeat picture in between is performed, and the process returns to video data after the in-frame. That is, the server 10
During the transmission of the video data for normal reproduction, the reproduction continues from a different frame of the video data for normal reproduction.

FIG. 25 shows the processing procedure of the data conversion unit 3 when performing such processing. According to FIG. 25, when the control section 2 reads the video data for normal reproduction by the reading section 102 and performs the jump reproduction while transmitting the transmission data to the decoding terminal 12 (step S1). ST51) First, the vbv delay detection unit 102 is operated to detect the vbv delay of the frame immediately after the out-frame and the in-frame. At this time, the reading unit 102 reads out the video data of the frame immediately after the out-frame and the in-frame from the storage unit 9 and supplies the video data to the vbv delay detection unit 102, and reads out the repeat picture from the storage unit 9 and supplies the stuffing insertion unit 103 To supply.

Next, the stuffing insertion unit 103 adjusts the data size of the repeat picture by inserting stuffing data based on the detected vbv delay so as not to break the vbv buffer (step ST52).

When the display time information before the out-frame is encoded prior to the video data and transmitted to the decoding terminal 12, the number of consecutive B-pictures after the out-frame jumps. The display order of the pictures before the out-frame is maintained by determining the picture type of the repeat picture so that the number of pictures becomes the same as when the reproduction is not performed.

Next, the reading section 102 determines whether or not the in-frame video data read in the previous step is the head of a closed GOP (step ST5).
3). When determining that the in-frame video data is not the head of the closed GOP, the reading unit 102 performs a correction process of replacing the in-frame video data with a repeat picture having the same data size as in the above-described step ST29 (step ST54), and performs a video for normal reproduction. Returning to the process of reading data (step ST55), the process ends. Thereby, the server 10 can perform jump playback even when
The decoding terminal 12 performs the decoding process accurately, and v
The failure of the bv buffer is prevented.

On the other hand, when determining that the in-frame video data is at the head of the closed GOP, the reading unit 102 returns to the process of reading the video data for normal reproduction (step ST55), and ends the process.

Next, a description will be given of the processing of the data conversion unit 3 when a special reproduction designating signal for designating frame advance as a type of special reproduction is input to the special reproduction control unit 1.

When the control signal 2a for performing frame-by-frame reproduction as a type of special reproduction is input from the special reproduction control unit 1, the data conversion unit 3 outputs I-pictures at appropriate intervals after the out-frame as shown in FIG. Alternatively, a P picture is selected, the selected picture is replaced with a repeat picture, and the process returns to the video data after the in-frame.

FIG. 27 shows the processing procedure of the data conversion unit 3 when performing such processing. According to FIG. 27, when the reading unit 102 reads video data for normal reproduction, and the control signal 2a for performing frame-by-frame reproduction during transmission of transmission data to the decoding terminal 12 is input ( Step ST61) First, the reading unit 1
02 performs a process of determining an out-frame (step ST62). Here, the reading unit 102 can select any picture in the video data for normal reproduction as an out-frame. The reading unit 102 can increase the image quality in the in-frame by selecting the I picture as the out-frame.

Next, the reading section 102 selects an I picture or a P picture (frame feed reproduction video data) to be extracted next from the normal reproduction video data (step ST63). Here, when the P-picture is selected as the frame-by-frame playback video data, if the picture serving as the prediction source of the P-picture has been replaced with a repeat picture, the reading unit 102 decodes correctly on the decoding terminal 12 side. Therefore, a process of reading frame-by-frame playback video data from the storage unit 9 is performed so as to satisfy a condition that an I picture or a P picture immediately before a selected P picture is not replaced with a repeat picture. In addition, the reading unit 102 selects an I picture as frame-by-frame playback video data in order to increase the image quality during frame-by-frame playback.

The reading section 102 reads a repeat picture from the storage section 9. At this time, by selecting the number of repeat pictures, the reading unit 102 adjusts the interval between the video data for frame-by-frame playback, and controls the length of time to advance for each picture.

The reading section 102 supplies the video data for frame-by-frame playback read in this processing to the vbv delay detecting section 102 and supplies the repeat picture to the stuffing inserting section 103.

Next, the data conversion unit 3 performs a process of replacing all the video data for frame advance reproduction selected in the previous step with a repeat picture (step ST6).
4). When the original picture of the video data for normal reproduction is an I picture or a P picture, the reading unit 102
A read picture is read from the read section 102 so as to be replaced with a repeat picture composed of pictures, and when the original picture is a B picture, the read section 102 is replaced with a repeat picture composed of B pictures.
Reads a repeat picture from. Thereby, the data conversion unit 3 can maintain the display order for each picture type. Also, the stuffing insertion unit 103
Adds stuffing data to a repeat picture so that the data size of the repeat picture is equal to the picture before replacement in order to ensure that the vbv buffer is not broken.

Next, the data converter 3 receives the control signal 2a indicating the release of the frame-by-frame playback and inputs the control signal 2a until it determines that the frame-by-frame playback is to be canceled.
3 and the process at step ST64 are repeated to release frame-by-frame playback, the process proceeds to the next process (step ST65).

When the frame-by-frame playback is released, the reading section 102 determines whether or not the I picture or P picture immediately before the in-frame has been replaced by a repeat picture (step ST66). It returns to the process of reading the video data for use (step ST69), and ends the process.

On the other hand, when the reading unit 102 determines that the replacement has been performed, the reading unit 102 performs the same processing as the above-described steps ST28 and ST29. That is, the reading unit 102 determines whether or not the selected in-frame video data is the head in the closed GOP encoding order (step ST67), and determines that the in-frame video data is the closed GOP encoding order. If it is determined that the data is the head of the process, the process returns to the process of reading the video data for normal reproduction (step ST69), and the process ends. When the video data to be the in-frame is not the first video data in the coding order of the closed GOP, the reading unit 102 performs a correction process of replacing the video data with a repeat picture having the same data size (step ST68). Returning to the process of reading video data (step ST69), the process ends.

When the control signal 2a for performing frame-forward playback at a frame-speed playback speed other than the same-speed playback is input, the data converter 3 determines the interval between I-pictures or P-pictures selected in step ST63. Adjust the number of repeat pictures to widen. At this time, the data conversion unit 3 performs a process of thinning out the repeat pictures replaced in step ST64 or a process of further inserting the repeat pictures. In addition, the data conversion unit 3 determines the data size of the repeat picture in the same manner as in the case described in step ST24.

When the control signal 2a for performing the frame forward reproduction in the reverse direction is input, the data conversion section 3 performs processing for arranging the time direction of the I picture selected in step ST63 in the reverse direction.

In such a server 10, even when transmitting the converted data for trick play to the decoding terminal 12, the number of pictures and the data size are adjusted according to the kind of trick play, and the repeat picture is inserted. Conversion data for special reproduction in the same data format as the video data for use.

According to such a data distribution system,
Even when performing the special reproduction, the conversion data for the special reproduction converted by the data conversion unit 3 is converted into the same video data format as that of the normal reproduction. No special reception processing or decoding processing is required for the decoding, and no special reproduction control device is required on the decoding terminal 12 side.

According to the data distribution system described above, for example, when ISO / IEC13818-2 is used, when data is converted into data for special reproduction by the data conversion unit 3 for performing special reproduction. By performing control processing for outputting converted data for trick play that does not break down the vbv buffer, the decoding terminal 12 can have a simple configuration that does not require special processing for trick play.

Further, the server 10 having the data conversion unit 3
According to, even when performing special playback, since it is converted to the same video data format as when performing normal playback,
There is no need to have a function to create a special data format for trick play. The server 10 is, for example, an ISO / IEC13
Even when data is transmitted from the TS specified in 818-1 by the method specified in IEC61883 using the IEEE 1394 cable as the transmission medium 20, vbv
Since the video data is converted into video data that does not cause the buffer to fail, T that satisfies the provisions of ISO / IEC13818-1
S can be multiplexed, and data can be transmitted in a data format that meets the requirements of IEC61883.

Therefore, according to the data distribution system, it is not necessary to combine a special server and a decoding terminal when transmitting data for special reproduction.

Furthermore, according to this data distribution system,
Since there is no need to perform decoding and re-encoding when video data is transmitted by the server 10, the configuration of the data conversion unit 3 can be simplified, and processing delay at the time of transmission can be reduced. There is no degradation of image quality.

The present invention is effective for any data encoding method regardless of the type of data such as still image signals, moving image signals, audio signals, text data, and graphic data. Further, the present invention can be realized by hardware or software.

[0156]

According to the present invention, when performing special reproduction on the receiving side, the first data of a plurality of data used for normal reproduction is subjected to a predetermined conversion processing for special reproduction and output. By performing thinning-out processing on the second data of a plurality of data used for normal reproduction and outputting the same, special data for special reproduction different from that for normal reproduction can be used for performing special reproduction on the receiving side. It does not need to be prepared in advance and does not require any special processing for special playback on the receiving side, and decodes and displays audio data other than video, subtitle text data, etc. during special playback. It is also possible to maintain a synchronous relationship between the plurality of data at that time. In addition, in the present invention, by selecting data to be selected from the data for normal reproduction in a continuous data unit, even if the reproduction speed of the special reproduction is high, a meaningful display result when displayed is obtained. There is also an effect that it can be obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of a data distribution system according to an embodiment of the present invention.

FIG. 2 is a diagram used for a brief description of an example (fast-forward reproduction) of an operation of a data converter for video data.

FIG. 3 is a diagram used for a brief description of an example of an operation (rewind reproduction) of a data converter for video data.

FIG. 4 is a block diagram used for describing a detailed configuration of a server.

FIG. 5 is a diagram used for describing a first data conversion method.

FIG. 6 is a diagram used for describing a second data conversion method.

FIG. 7 is a diagram used to explain a third data conversion method.

FIG. 8 is a diagram used for describing a fourth data conversion method.

FIG. 9 is a diagram used to explain a fifth data conversion method.

FIG. 10 is a block diagram illustrating a configuration example of a data converter for video data.

11 is a diagram illustrating a locus of bit occupancy of a vbv buffer for video data A. FIG.

FIG. 12 is a diagram showing a locus of bit occupancy of a vbv buffer for video data B;

FIG. 13 is a diagram showing a locus of bit occupancy of a vbv buffer when switching from video data A to video data B;

FIG. 14 is a diagram illustrating a locus of bit occupancy of a vbv buffer when a repeat picture is inserted between video data A and video data B.

FIG. 15 is a diagram for explaining processing when the data conversion unit for video data pauses.

FIG. 16 is a flowchart for explaining a processing procedure when a pause is performed by a data converter for video data.

FIG. 17 is a diagram for explaining a correction process when a pause is performed by a data converter for video data.

FIG. 18 is a diagram for describing processing when fast-forward playback is performed by a data converter for video data.

FIG. 19 is a flowchart for explaining a processing procedure when performing fast-forward playback by a data converter for video data.

FIG. 20 is a diagram for describing an example of performing fast-forward playback by a data converter for video data.

FIG. 21 is a diagram for describing correction processing when fast-forward playback is performed by a data converter for video data.

FIG. 22 is a diagram for describing processing when performing slow reproduction by a data converter for video data.

FIG. 23 is a flowchart for explaining a processing procedure when performing slow reproduction by a data converter for video data.

FIG. 24 is a diagram for describing processing when a jump is performed by a data converter for video data.

FIG. 25 is a flowchart for explaining a processing procedure when a jump is performed by a data converter for video data.

FIG. 26 is a diagram for describing processing when frame-by-frame playback is performed by a data converter for video data.

FIG. 27 is a flowchart for explaining a processing procedure when frame-by-frame playback is performed by a data converter for video data.

FIG. 28 is a block diagram illustrating a configuration example of a conventional data distribution system.

[Explanation of symbols]

1 Special playback control unit, 3,7 Data conversion unit, 4
Multiplexing unit, 5 transmitting unit, 9 storing unit, 10 server, 12 decoding terminal, 13 receiving unit, 14 separating unit, 15 decoding unit, 16 reading unit, 19 time information rewriting unit

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/76 H04N 7/173 610B 5D044 5/91 5/92 H 5J064 5/93 5/91 N 5K028 5 / 937 5/93 E 7/08 C 7/081 G 7/24 7/08 Z 7/173 610 7/13 Z (72) Inventor Yoichi Yagasaki 6-7-35 Kita Shinagawa, Shinagawa-ku, Tokyo Sony In-house F term (reference) 5C052 AA01 AB03 AC02 AC03 AC04 AC05 AC06 CC06 CC11 DD06 DD08 5C053 FA14 GA11 GB04 GB06 GB11 GB38 HA22 HA24 HA25 HA27 HA33 JA12 JA16 JA21 KA04 KA08 KA24 LA06 LA15 5C059 KK35 LB07 MA04 PP02 PP06 RC08 SS17 SS18 UA32 5C063 AA01 AB03 AB07 AB09 AC01 AC05 CA20 CA36 DA01 DA05 DA07 DA13 DB09 5C064 BA01 BB10 BC04 BC18 BC23 BD02 BD08 BD09 BD14 5D044 AB05 AB07 BC01 CC05 DE17 DE39 FG18 FG23 GK07 HL11 5J064 AA01 BA01 BB00 BB09 BC01 BC02 BC25 BD03 5K028 AA14 EE03 HH01 KK01 KK03 MM16 NN51 PP02 PP03 PP04 SS04 SS14

Claims (43)

[Claims] 1. A data processing method for transmitting data encoded for each predetermined encoding unit to a receiving side, wherein when performing normal reproduction on the receiving side, a plurality of data used for the normal reproduction are transmitted. When performing the special reproduction on the receiving side, the first data of the plurality of data used for the normal reproduction is subjected to a predetermined conversion process for the special reproduction and output, and is used for the normal reproduction. A data processing method comprising: performing thinning-out processing on second data of a plurality of data to be output; 2. The data processing method according to claim 1, wherein the thinning processing is performed on the second data for each group of a plurality of continuous coding units. 3. The number of display units of the second data used when performing normal reproduction on the receiving side is as follows:
2. The data processing method according to claim 1, wherein a thinning process is performed on the second data so that the number of the second data is equal to or less than a reciprocal multiple of the reproduction speed of the special reproduction. 4. When the second data is decimated, a coding unit having a time near a time corresponding to a coding unit of an output obtained by subjecting the first data to the predetermined conversion processing is used. 2. The data processing method according to claim 1, wherein the data is selected from the second data. 5. The time information for the coding unit after the thinning processing is calculated based on the time information corresponding to the coding unit before the coding unit, and the second time information after the thinning processing is calculated.
2. The data processing method according to claim 1, wherein the data is encoded in the data. 6. The data processing method according to claim 2, wherein the group of the plurality of continuous coding units is determined based on a desired number of coding units. 7. The data processing method according to claim 2, wherein the group of the plurality of continuous coding units is determined based on a desired time length. 8. When the plurality of data are encoded using prediction, when performing special reproduction on the receiving side, select data of a coding unit that does not use prediction between coding units. 2. The data processing method according to claim 1, wherein 9. When the plurality of data are encoded using prediction, a head of a group of the plurality of continuous encoding units is a coding unit that does not use prediction between coding units. 3. The data processing method according to claim 2, wherein: 10. The number of coding units of the second data used when performing normal reproduction on the receiving side is smaller than the number corresponding to a reciprocal multiple of the reproduction speed of the special reproduction. By performing the decimation process on the second data, when a gap section in which the coding unit does not exist exists between the second data remaining after the decimation process, the second data remaining after the decimation process is generated. 4. The data processing method according to claim 3, wherein a number of coding units subsequent to the coding unit of the data is output in a number corresponding to the gap section. 11. When shifting from the special reproduction to the normal reproduction, an encoding unit corresponding to a time near the special reproduction end time on a time before the special reproduction is performed is replaced with a coding unit when the special reproduction is performed. 2. The data processing method according to claim 1, wherein the output is started near the end time of the special reproduction in time. 12. The data processing method according to claim 5, wherein the coding unit after the thinning processing is output so as to be reproduced at a time corresponding to the calculated time information. 13. The data processing method according to claim 1, wherein when the trick play is a reverse forward play, the coding units used for the trick play are output in a temporally reverse order. 14. A set of encoding units that are reproduced continuously in time from among the encoding units used for the trick play is output in the forward direction within the set of encoding units. 14. The data processing method according to claim 13, wherein: 15. A data processing device for transmitting data coded for each predetermined coding unit to a receiving side, wherein when performing normal reproduction on the receiving side, a plurality of data used for the normal reproduction are transmitted. When the data is transmitted and the special reproduction is performed on the receiving side, the first data of the plurality of data used for the normal reproduction is subjected to a predetermined conversion process for the special reproduction and output, and is used for the normal reproduction. A data processing device, comprising: a data conversion unit that performs a thinning process on a second data of a plurality of pieces of data to be output. 16. The data processing apparatus according to claim 15, wherein said data conversion means performs said thinning-out processing on said second data for each group of a plurality of continuous coding units. 17. The data conversion means according to claim 1, wherein the number of coding units of the second data used when performing normal reproduction on the receiving side is a reciprocal multiple of the reproduction speed of the special reproduction. 16. The data processing apparatus according to claim 15, wherein a thinning process is performed on the second data so as to be equal to or less than the number corresponding to the second data. 18. The data conversion means according to claim 1, wherein said thinning process of said second data sets a time near a time corresponding to a coding unit of an output obtained by subjecting said first data to said predetermined conversion process. 16. The data processing device according to claim 15, wherein a coding unit to be provided is selected from the second data. 19. The time information for the coding unit after the thinning processing is calculated based on the time information corresponding to the coding unit before the coding unit, and is included in the second data after the thinning processing. The data processing apparatus according to claim 15, further comprising time information processing means for encoding. 20. The data processing apparatus according to claim 16, wherein said data conversion means determines a group of said plurality of continuous coding units based on a desired number of coding units. 21. The data processing apparatus according to claim 16, wherein said data conversion means determines a group of said plurality of continuous coding units based on a desired time length. 22. When the plurality of data are encoded using prediction, the data conversion means performs encoding without using prediction between encoding units when performing special reproduction on the receiving side. 16. The data processing apparatus according to claim 15, wherein data of a unit is selected. 23. The data conversion unit, when the plurality of data are encoded using prediction, sets the head of the group of the plurality of continuous coding units to not use prediction between coding units. 17. The data processing device according to claim 16, wherein the data processing unit is a coding unit. 24. The data conversion means, wherein the number of coding units of the second data used when performing normal reproduction on the receiving side is a reciprocal multiple of the reproduction speed of the special reproduction. By performing the thinning process on the second data so as to be smaller than the number corresponding to the above, when a gap section where the coding unit does not exist between the second data remaining after the thinning process occurs, the thinning is performed. 18. The data processing apparatus according to claim 17, wherein the number of coding units subsequent to the coding unit of the second data remaining after the processing is output in a number corresponding to the gap section. 25. The data conversion means, when shifting from the special reproduction to the normal reproduction, converts the coding unit corresponding to a time near the special reproduction end time on the time before the special reproduction is performed, into the special reproduction. 16. The data processing apparatus according to claim 15, wherein the output is started near the end time of the special reproduction on the time when the data reproduction is performed. 26. The data conversion means, wherein the coding unit after the thinning processing is output so as to be reproduced at a time corresponding to the time information calculated by the time information processing means. The data processing device according to claim 19. 27. The data conversion means according to claim 15, wherein, when the trick play is a reverse forward play, the data conversion means outputs a coding unit used for the trick play in a temporally reverse order. Data processing equipment. 28. The data conversion means according to claim 1, wherein said set of encoding units reproduced continuously in time from among the encoding units used for said trick play is forward-directed in said set of encoding units. 29. The data processing device according to claim 28, wherein the data is output to the data processing device. 29. In a data transmission system including a transmitting device for transmitting data encoded for each predetermined coding unit and a receiving device for receiving the data, the transmitting device normally reproduces the data by the receiving device. When performing a special reproduction in the receiving device, a plurality of data used for the normal reproduction is transmitted. A data transmission system comprising: a data conversion unit that performs processing, outputs the data, and performs thinning processing on the second data among the plurality of data used for the normal reproduction and outputs the result. 30. The data transmission system according to claim 30, wherein said data conversion means performs said thinning-out processing on said second data for each group of a plurality of continuous coding units. 31. The data conversion means is a reciprocal multiple of the reproduction speed of the special reproduction with respect to the number of coding units of the second data used when normal reproduction is performed in the reception device. 31. A thinning process is performed on the second data so that the number of the second data becomes equal to or less than the number corresponding to the second data.
Data transmission system as described. 32. The data conversion means according to claim 27, wherein in the thinning-out processing of said second data, a time near a time corresponding to a coding unit of an output obtained by subjecting said first data to said predetermined conversion processing. 31. The data transmission system according to claim 30, wherein a coding unit to be provided is selected from the second data. 33. The transmitting apparatus calculates time information for the coding unit after the thinning processing based on time information corresponding to a coding unit before the coding unit, and calculates the time information for the coding unit before the coding unit. 31. The data transmission system according to claim 30, further comprising time information processing means for encoding data in the second data. 34. The data transmission system according to claim 31, wherein said data conversion means determines a group of said plurality of continuous coding units based on a desired number of coding units. 35. The data transmission system according to claim 31, wherein said data conversion means determines a set of said plurality of continuous coding units based on a desired time length. 36. When the plurality of data are encoded using prediction, the data conversion means performs encoding without using prediction between encoding units when performing special reproduction in the receiving device. 31. The data transmission system according to claim 30, wherein a unit of data is selected. 37. When the plurality of data are encoded using prediction, the data conversion means does not use the prediction between the coding units for the head of the group of the plurality of continuous coding units. The data transmission system according to claim 31, wherein the data transmission system is a coding unit. 38. The data conversion means, wherein the number of coding units of the second data used when performing normal reproduction in the receiving device is a reciprocal multiple of the reproduction speed of the special reproduction. So that the number is smaller than the number corresponding to
When a gap section where the coding unit does not exist is generated between the second data remaining after the thinning processing by performing the thinning processing on the data of the second data, the coding unit of the second data remaining after the thinning processing is performed. 33. The data transmission system according to claim 32, wherein a number of coding units subsequent to the number of the coding units are output in a number corresponding to the gap section. 39. The data conversion means, when shifting from the special reproduction to the normal reproduction, converts the coding unit corresponding to a time near the special reproduction end time on the time before the special reproduction is performed, into the special reproduction. 31. The data transmission system according to claim 30, wherein the output is started near the end time of the special reproduction on the time when the operation is performed. 40. The data conversion means for outputting the coding unit after the thinning-out processing so as to be reproduced at a time corresponding to the time information calculated by the time information processing means. The data transmission system according to claim 34. 41. The data conversion means according to claim 30, wherein when the trick play is reverse forward play, the data conversion means outputs the coding units used for the trick play in a temporally reverse order. Data transmission system. 42. The data conversion means, for a set of coding units used for the trick play, which is reproduced continuously in time, in the set of coding units, in a forward direction. 43. The data transmission system according to claim 42, wherein the data is output to the data transmission device. 43. In a transmission medium for transmitting data coded for each predetermined coding unit by a transmission device to a reception device, when performing normal reproduction by the reception device, a plurality of data used for the normal reproduction are used. When data is transmitted, and the special reproduction is performed in the receiving device, data obtained by performing a predetermined conversion process for the special reproduction on the first data of the plurality of data used for the normal reproduction is transmitted, A transmission medium characterized in that data obtained by thinning out second data among a plurality of data used for the normal reproduction is transmitted.