JP2000041220A - Device and method for transmitting image data, device and method for receiving image data and providing medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a smooth moving image even in the case of trick mode reproduction by providing the system with a 1st output means for outputting 1st information indicating the end of reading up to a set reproducing picture and a 2nd output means for outputting information related to a specified reproducing mode and 2nd information indicating the set reproducing picture. SOLUTION: A mode information setting part 33 sets up a value for realizing slow reverse e.g. as reproducing mode information. A packetizing part 32 generates a new transport steam only by the set producing mode information. A reading part 11 reads out all transport stream packets from the set I picture up to a target picture from a storage part 10. When the slow reverse is not reset, the target picture is set up to the picture preceding timewisely by one picture, pictures are read out from the I picture existing on the head of a GOP including the target picture and a DIT is outputted.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image data transmitting apparatus and method, an image data receiving apparatus and method, and a providing medium, and more particularly, to setting a picture to be displayed, and setting a first IOP of a GOP including the set picture. Image data transmitting apparatus and method for reading from a picture,
The present invention relates to an image data receiving apparatus and method, and a providing medium.

[0002]

2. Description of the Related Art FIG. 11 is a block diagram showing a configuration of an example of a stream output device for processing a transport stream transmitted by digital broadcasting as a conventional image data transmitting device. This stream output device 1
It is connected to the stream decoding device 3 by the connection line 2. The stream decoding device 3 outputs the decoded signal to the monitor 4. Playback instruction section 5
Is a remote controller or the like, which is operated when the user instructs the stream output device 1 to perform a reproduction mode.

[0003] This stream output device uses MPEG (Moving).
Picture Experts Group 2), and its data structure will be described below. FIG. 12 shows the PES
FIG. 3 is a diagram illustrating a relationship between a (Packetized Elementary Stream) packet and a transport packet. As shown in the figure, a PES packet composed of video data or audio data is divided into a plurality of blocks, and each block has a TPH (Transport Packet Header).
To form a transport stream packet.

Here, the syntax of the transport packet is shown below. <Table 1> No.of bits 1 Transport_Packet () {2 sync_byte 8 3 transport_error_indicator 1 4 payload_unit_start_indicator 1 5 transport_priority 1 6 PID 13 7 transport_scrambling_control 2 8 adaptation_field_control 2 9 continuity counter 4 10 if (adaptation_field_control == '10' ｜｜ 11 adaptation_field_control == '11') {12 adaptation_field () 13} 14 if (adaptation_field_control == '01' || 15 adaptation_field_control == '11') {16 for (i = 0; i <N; i ++) {17 data_byte 8 18} 19} 20}

[0005] The sync_byte in the second row is a field indicating an 8-bit synchronization byte. Transport_erro in the third line
r_indicator is a 1-bit flag.
Indicates that at least one uncorrectable bit error exists in the transport stream. Payload_unit_start_indic on line 4
ator is a 1-bit flag, and when it is 1, the payload of this transport stream packet is PES
Indicates to start from the first byte of the packet,
If it is 0, it indicates that the PES packet has not started in this transport packet.

[0006] The transport_priority in the fifth row is a 1-bit identifier. When set to 1, the packet has a higher priority than other packets having the same PID and not having this bit set to 1. It is shown that. The PID in the sixth row is a 13-bit field, and indicates the type of data stored in the packet payload. 7th line
transport_scrambling_control is a 2-bit field, and indicates a scrambling mode of the payload of the transport stream packet.

The adaptation_field_control on the eighth line is 2
This is a bit field, and indicates that at least one of the adaptation field and the payload comes in the transport stream packet header.
The continuity_counter in the ninth row is a 4-bit field that increases for each transport stream packet having the same PID. Lines 10 to 16 show the contents of the adaptation field. The data_byte on the 17th line is a continuous byte from the PES packet data or a continuous byte of private data not in this structure.

Next, the syntax of the PES packet will be described. The syntax shown below is the syntax of the PES packet in the case of normal reproduction. <Table 2> No.of bits 1 PES_packet_Example_for_NORMAL_PLAYBACK () {2 packet_start_code_prefix 24 3 stream_id 8 4 PES_packet_length 16 5 '10' 2 6 PES_scrambling_control 2 7 PES_priority 1 8 data_alignment_indicator 1 9 copyright 1 10 original_or_copy 1_lag 1 ES_1_TS1_lag 1 ES_1TS1_TS1_lag1_TS1flag 1 14 DSM_trick_mode_flag 1 15 additional_copy_info_flag 1 16 PES_CRC_flag 1 17 PES_extension_flag 1 18 PES_header_data_length 8 19 PTS 40 20 DTS 40 21 for (I-0; i <N2; i ++) {22 PES_packet_data_byte 8 23} 24}

The packet_start_code_prefix in the second line is 2
It is a 4-bit code and constitutes a packet start code for identifying the start of a packet. The stream_id in the third line defines the type and number of the elementary stream. PES_packet_length in the fourth row is a 16-bit field, and defines the number of bytes in the PES packet following the last bit of this field. PES_scrambling_c on line 6
“ontrol” is a 2-bit field and indicates a scrambling mode of the payload of the PES packet.

[0010] PES_priority in the seventh row is a 1-bit field, and indicates the priority of the payload of the PES packet. The data_alignment_indicator on the eighth line is a 1-bit flag, and indicates whether a video start code or audio synchronization word continues or is defined. The copyright on line 9 indicates whether the payload material of the associated PES packet is copyright protected,
Or indicate whether it is defined.

The original_or_copy on the 10th line is the PES
Indicates whether the content of the packet payload is an original or a copy. PTS_DTS_flags on line 11
Is a 2-bit flag, and a PTS (Presentation Time Stamp) field and a DTS
Indicates whether a (Decoding Time Stamp) field exists. ESCR_flag on the twelfth line is a 1-bit flag, and indicates whether or not the ESCR basic and extension fields are present in the PES packet header. ES_rate_ on line 13
The flag is a 1-bit flag, and indicates whether or not ES_rate exists in the PES packet header.

DSM_trick_mode_flag on the 14th line is a 1-bit flag, and indicates whether or not a trick_mode_Control field exists. 15th line additional_c
opy_info_flag is a 1-bit flag.
Indicates whether l_copy_info exists. 16
PES_CRC_flag in the row is a 1-bit flag,
Indicates whether the field exists in the PES packet. PES_extension_flag on the 17th line is a 1-bit flag, and indicates whether or not an extension field exists in the PES packet header.

The PES_header_data_length in the 18th line is 8
This is a bit field, and defines the total number of bytes of an option field and a stuffing byte included in the PES packet header. The PTS on line 19 is Prese
Abbreviation of ntation_Time_Stamp, which is a 33-bit field. DTS on the 20th line is an abbreviation for Decoding_Time_Stamp, and is a 33-bit field. PE on line 22
S_packet_data_byte is the Stream_id or PID of the packet
Are continuous byte data of the elementary stream indicated by.

In Table 2, DSM_trick_ on line 14
mode_flag is set to 0 since normal reproduction is performed. However, in the case of trick mode playback instead of normal playback, the value of this flag is set to 1. Here, the trick mode reproduction is, for example, slow motion or fast forward. DSM_trick_mode_fla on line 14
If g is 1, trick_mode_cont
The line of rol_parameters () is inserted. This trick_mode_c
In ontrol_parameters (), a reproduction method other than normal reproduction is specified.

In the following, trick_mode_control_parameters ()
Shows the syntax of <Table 3> No.of bits 1 trick_mode_control_parameters () {2 trick_mode_control 3 3 if (trick_mode_control == fast_forward) {4 field_id 2 5 intra_slice_refresh 16 frequency_truncation 2 7} 8 else if (trick_mode_control == slow_motion) {9 rep_cntrl 5 10 } 11 else if (trick_mode_control == freeze_frame) {12 field_id 2 13 reserved 3 14} 15 else if (trick_mode_control == fast_reverse) {16 field_id 2 17 intra_slice_refresh 1 18 frequency_truncation 2 19} 20 else if (trick_mode_control == slow_reverse) { 21 rep_cntrl 5 22} 23 else 24 reserved 5 25}

[0016] The trick_mode_control on the second line is a 3-bit field and indicates the type of trick mode. That is, when the value of this field is "000", it is fast forward (fast_forward), when it is "001", it is slow motion (slow_motion), when it is "010", it is freeze (freeze_frame), and when it is "011", it is reverse fast forward ( Fast_reverse) and “100” indicate slow reverse (slow_reverse), respectively. Also, “1”
01 "to" 111 "are reserved (secured) for the future.

The value of trick_mode_control on the second line is "00"
In the case of "0", in order to realize fast_forward, first, which field is to be displayed is specified in field_id on the fourth line.
Indicates that only the top field is displayed, "01" indicates that only the bottom field is displayed, and "10" indicates that a complete video frame is displayed. 11 "is reserved for future use.

If the bit of intra_slice_refresh in the fifth row is set to 1, there is a case where a macroblock is missing, and the decoder replaces the missing macroblock with a video frame decoded earlier. Indicates that it can be replaced by a macroblock at the same position. Frequency_truncation in the sixth line is a field indicating that a set of restricted coefficients is included.

The value of trick_mode_control on the second line is "00"
In the case of “1”, in order to realize slow_motion, r
In ep_cntrl, the number of times the same picture is repeatedly displayed is defined.

The value of trick_mode_control on the second line is "01"
In the case of 0 ", the 12th line
In field_id, a field to be displayed is defined. The field_id on the twelfth line and the field_id on the fourth line described above
The same rule is used for id.

The value of trick_mode_control on the second line is "01"
In the case of 1 ", the 16th line is used to realize fast_reverse.
In the field_id, first, the field_id on the fourth or twelfth line
Fields to be displayed are defined by the same rules as described above. Intra_slice_refresh on line 17 is intra on line 5
The same rule as _slice_refresh is specified.
frequency_truncation is also frequency_truncati on line 6
Same rules as on.

The value of trick_mode_control on the second line is "10"
In the case of "0", in order to realize slow_reverse, in rep_control on line 21, similarly to rep_cntrl on line 9,
The number of times the same picture is repeatedly displayed is defined.

The stream output device 1 handles data having the above-described data structure. Stream output device 1
In the recording unit 10, a transport stream transmitted by digital broadcasting is recorded. The transport stream recorded in the recording unit 10 is read by the reading unit 11 and output to the switch 12.
When reading the transport stream from the recording unit 10, the reading unit 11 reads the transport stream according to the playback mode specified by the user by the playback instruction unit 5.

The switch 12 is switched to the contact E side when the instruction from the reproduction instructing section 5 is normal reproduction, and outputs the output from the read section 11 to the contact E side of the switch 19. The switch 19 is also switched to the contact E side when the instruction from the reproduction instruction unit 5 is normal reproduction, and outputs the output from the switch 12 to the stream decoding device 3.

When the reproduction instructing unit 5 instructs other than normal reproduction, for example, slow motion, the switch 1
2 and the switch 19 are each switched to the contact F side. When the switch 12 is switched to the contact F side, the transport stream read by the reading unit 11 is input to the stream inspection unit 13.

The stream checking unit 13 checks the stream input from the reading unit 11 via the switch 12 and checks information necessary for decoding, for example, sequence h.
If the eader is not sufficient, the eader outputs a signal instructing the reading unit 11 to read out the insufficient information. If the input stream cannot be decoded by itself, the stream inspection unit 13 discards the stream. The stream output from the stream inspection unit 13 is input to the PES extraction unit 14.

[0027] A PES packet is extracted from the transport stream input to the PES extraction unit 14 and output to the video stream extraction unit 15. The video stream extracting unit 15 extracts a video stream packet from the input PES packet, and outputs the video stream packet to the PES packetizing unit 16. The PES packetizer 16 includes a mode information setting unit 1
The signal output from 7 is also input.

The mode information setting section 17 encodes information relating to the reproduction mode specified by the reproduction instruction section 5, and
Output to the S packetizer 16. That is, the reproduction instruction unit 5 instructs the reproduction mode (trick_mode_control), the instruction of the field to be reproduced (field_id), and the number of times of repetition reproduction (rep_cntrl). Encode and output to PES packetizer 16.

The PES packetizer 16 multiplexes the mode information output from the mode information setting unit 17 with the video stream output from the video stream extractor 15 and outputs the multiplexed information to the transport packetizer 18. When outputting the PES packet, the PES packetizer 16 outputs the DSM_trick_mode of the stream.
_Flag is changed from 0 to 1 and output to the transport packetizing unit 18.

The transport packetizing section 18
The PES packet output from the packetizer 16 is remultiplexed into a transport stream, and is output to the stream decoding device 3 via the switch 19 switched to the contact F side. The stream decoding device 3 decodes the transport stream output from the stream output device 1,
Output to monitor 4. The monitor 4 reproduces an image based on the input data. This reproduced image is a trick mode reproduced image.

[0031]

The above-described stream output device 1 and stream decoding device 2 reproduce only I-pictures when performing reverse reproduction.
For this reason, it has been difficult to display a moving image that moves smoothly.

When the stream output device 1 outputs a stream to which fast-forward playback is applied, the reading unit 11 randomly accesses the recording unit 10 in the forward direction, reads a transport stream, and reads the transport stream. Output to the decoding device 3. In the output transport stream, the stream decoding device 3
, A stream that cannot be decoded may be included.

The present invention has been made in view of such a situation, and when reading a recorded picture in order to perform trick mode playback, the first IOP existing in the GOP including the target picture is read. Thus, a smooth moving image can be displayed even in trick mode reproduction.

[0034]

An image data transmitting apparatus according to claim 1, comprising: a setting means for setting a reproduced picture;
Reading means for reading from the first I picture of the GOP including the picture set by the setting means to the reproduction picture set by the setting means;
First output means for outputting first information indicating that the reading up to the reproduction picture set by the setting means has been completed, instruction means for instructing the reproduction mode, and information on the reproduction mode instructed by the instruction means And second output means for outputting second information indicating the reproduced picture set by the setting means.

According to a fourth aspect of the present invention, there is provided an image data transmitting method comprising:
A setting step of setting a playback picture; a reading step of reading from the first I picture of the GOP including the picture set in the setting step to the playback picture set in the setting step; A first output step of outputting first information indicating that reading of up to a reproduction picture has been completed, an instruction step of instructing a reproduction mode, and information related to the reproduction mode instructed in the instruction step and set in the setting step And outputting a second information indicating the reproduced picture.

According to a fifth aspect of the present invention, in the providing medium, a setting step of setting a playback picture, and reading out from the first I picture of the GOP including the picture set in the setting step to the playback picture set in the setting step are performed. A first output step of outputting first information indicating that the reading up to the reproduction picture set in the setting step has been completed in the reading step, an instruction step of instructing a reproduction mode, and an instruction step. Provided is a computer-readable program for causing an image data transmitting apparatus to execute a process including information on a designated playback mode and a second output step of outputting second information indicating a playback picture set in the setting step. It is characterized by doing.

The image data receiving apparatus according to claim 6 is
A first receiving unit for receiving image data, a second receiving unit for receiving data indicating a picture to be reproduced, and a second receiving unit out of the image data received by the first receiving unit.
And a reproducing means for reproducing the picture specified by the data received by the receiving means.

The image data receiving method according to claim 7 is
A first receiving step of receiving image data, a second receiving step of receiving data indicating a picture to be reproduced, and a receiving step of receiving image data of the image data received in the first receiving step. And a reproducing step of reproducing the picture specified by the specified data.

According to the present invention, there is provided a providing medium, comprising: a first receiving step of receiving image data; a second receiving step of receiving data indicating a picture to be reproduced;
A computer-readable program that causes a video data receiving apparatus to execute a process including a reproduction step of reproducing a picture specified by the data received in the second receiving step, of the image data received in the receiving step. It is characterized by providing a program.

In the image data transmitting apparatus according to the first aspect, the image data transmitting method according to the fourth aspect, and the providing medium according to the fifth aspect, a reproduced picture is set.
The first I picture of the GOP including the set picture to the set playback picture are read, and the first indicating that the reading up to the set playback picture is completed
Is output, and information on the designated playback mode and second information indicating the set playback picture are output.

In the image data receiving apparatus according to the sixth aspect, the image data receiving method according to the seventh aspect, and the providing medium according to the eighth aspect, the image data is received, and data indicating a picture to be reproduced is provided. Is received, and the designated picture is reproduced from the received image data.

[0042]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below. In order to clarify the correspondence between each means of the invention described in the claims and the following embodiments, each means is described. When the features of the present invention are described by adding the corresponding embodiment (however, an example) in parentheses after the parentheses, the result is as follows. However, of course, this description does not mean that each means is limited to those described.

An image data transmitting apparatus according to claim 1 is
Setting means for setting a reproduced picture (for example, step S22 in FIG. 5), and reading means for reading from the first I picture of the GOP including the picture set by the setting means to the reproduced picture set by the setting means (for example, Steps S23 and S26 in FIG. 5 and first output means (for example, in FIG. 5) for outputting first information indicating that the reading up to the reproduction picture set by the setting means has been completed by the reading means. Step S3
0), instruction means for instructing the reproduction mode, and second output means for outputting information on the reproduction mode instructed by the instruction means and second information indicating the reproduced picture set by the setting means (for example, FIG. 5 step S25).

[0044] The image data receiving apparatus according to claim 6 is
First receiving means for receiving image data (for example, FIG. 10
Step S61), second receiving means for receiving data indicating a picture to be reproduced (for example, step S66 in FIG. 5), and second receiving among the image data received by the first receiving means. Reproduction means (for example, step S67 in FIG. 10) for reproducing the picture specified by the data received by the means.

FIG. 1 is a diagram showing a configuration of an image processing system to which the present invention is applied. The stream output from the stream output device 21 is input to the stream decoding device 22. The stream decoding device 22 decodes the input stream and outputs it to the monitor 4. The monitor 4 reproduces an image based on the input data. The stream recording device 23 is adapted to record the stream output from the stream output device 21 as appropriate.
These devices are connected to each other by a connection line 2. In this system, MPEG (Moving Pic
The data compressed by the Experts Group 2 is used.

FIG. 2 is a block diagram showing a configuration example of the stream output device 21. The recording unit 10 includes, for example, a digital video cassette on which a transport stream transmitted by digital broadcasting is recorded. The reading unit 11 reads a transport stream recorded in the recording unit 10. This read is
The reproduction is performed in accordance with the reproduction mode specified by the reproduction instruction unit 5. The reproduction instructing unit 5 is configured by a remote controller or the like, and when a desired reproduction mode is selected by a user operation, transmits the data of the selected mode to the reading unit 11 of the stream output device 21.

The reading unit 11 reads a stream from the recording unit 10 when reading a stream defined by MPEG2.
In some cases, a stream in which no eader exists is read and output to the switch 31. To cope with such a case, the reading unit 11 reads the information of the sequence header from the storage unit 10 and outputs the information to the mode information setting unit 33, and the mode information setting unit 33 stores the information. When the trick mode is instructed, the mode information setting unit 33 outputs the stored sequence header to the packetizing unit 32.

The mode information setting unit 33 includes the packetizing unit 3
When the information of the sequence header is output to
Describe in ideo_sequence_header_descriptor. Further, this descriptor is, for example, a digital video disc (DVB).
eo Broadcasting) defined in Selection_Informa
It has a structure of tion_Table, is transport-packetized, and is output to the packetizer 32.

Here, video_sequence_header_descript
or will be described. video_sequence_header_descript
or is sequence_heade multiplexed in the stream
This is a descriptor giving the information of r. Video_s below
Indicates the syntax of equence_header_descriptor. <Table 4> No.of bits 1 video_sequence_header_descriptor () 2 {3 descriptor_tag 8 4 descriptor_length 8 5 video_coding_mode 4 6 profile_and_level_indication 8 7 chroma_format 2 8 horizontal_size_value 12 9 vertical_size_value 12 10 frame_rate_code 4 11 bit_rate_value 18 12 vbv_buffer_size} value 13 12

Descriptor_tag on the third line is an 8-bit field, and is set to an unused value in the MPEG2 system and DVB. The value of descriptor_length in the fourth line is set to 9. The video_coding_mode on the fifth line is v
This is a 4-bit field indicating the encoding method of ideo_elementary_stream. The value of this field is “0000”
, Indicates an undefined stream, "0001" indicates an MPEG1 stream, and "0010" indicates an MPEG2 stream. "0011" to "1"
111 "has been reseved.

Profile_and_level_indication on line 6
Is a field that defines an 8-bit profile and level, and is defined by ISO / IEC13818-2.
The same rules as rofile_and_level_indication apply. The chroma_format in the seventh row is a 2-bit field and indicates a color difference format. The horizontal of the 8th line
_size_value is composed of the lower 12 bits of horizontal_size, and horizontal_size indicates the width of a portion of each luminance component to be displayed in pixel units.

In the ninth line, vertical_size_value is
It is composed of the lower 12 bits of l_size.
ical_size indicates the height of a portion of each luminance component of the frame in the line displayed in line units. Fram on line 10
e_rate_code is a 4-bit field, frame_r
Used to define ate_value. Bit on line 11
The _rate_value is composed of the lower 18 bits of the bit_rate, and is a field in which data is described to limit the amount of generated bits. Vbv_buffer_size_ on line 12
The value is composed of the lower 10 bits of vbv_buffer_size that determines the size of the generated code amount control virtual buffer. Reserved on the 13th line indicates that it is reserved for the future.

The packetizing section 32 receives, in addition to the information relating to the sequence header, from the mode information setting section 33, information relating to the reproduction mode specified by the reproduction instructing section 5. The packetizer 32 converts the input information into a transport stream packet and outputs the transport stream packet. The output transport stream packet is output to the stream decoding device 22 via the contact B of the switch 31.

The operation of the stream output device 21 shown in FIG. 2 will be described with reference to the flowchart of FIG. In step S1, the reading unit 11 and the mode information setting unit 33 determine whether the reproduction mode specified by the reproduction instruction unit 5 is normal reproduction.

If it is determined that the reproduction is normal reproduction, the transport stream of the current picture is read from the recording unit 10 in step S2. Readout unit 11
Is output to the switch 31, and is output to the stream decoding device 22 via the contact A of the switch 31. When the output of the transport stream is completed, the process returns to step S1,
Subsequent processing is repeated.

The transport stream in the case of normal reproduction will be described with reference to FIG. FIG. 4 (A)
Indicates a stream read from the recording unit 10. FIG. 4B shows a stream output from the stream output device 21. FIG. 4C shows the monitor 4
Indicates a picture to be reproduced. Further, I represents an I picture, P represents a P picture, and B represents a B picture, and the number added after each alphabet is a number indicating the order of reproduction during normal reproduction (normal reproduction). is there.

As shown in FIG. 4A, in the case of normal reproduction, the order of the stream (picture) reproduced from the recording unit 10 and the picture output from the stream output device 21 are the same. In the case of normal reproduction, the stream having such an arrangement is displayed on the monitor 4 as shown in FIG.
The reproduction is performed in the order shown in FIG.

Returning to the description of the flowchart of FIG. 3, when it is determined in step S1 that the reproduction mode instructed by the reproduction instructing section 5 is not normal reproduction, the flow proceeds to step S3. In step S3, it is determined whether the instruction is a slow reverse instruction. Slow reverse is reverse slow motion playback. If it is determined in step S3 that slow reverse has been instructed, the process proceeds to step S4. In step S4,
Slow reverse processing is performed.

FIG. 5 shows a flowchart of the slow reverse process. In step S21, the reading unit 11 instructs the mode information setting unit 33 to set DIT (Dis
continuity Information Table) to the packetizer 32. This DIT is DVB (Digital Video Broadcas)
ting), data transmitted when the user changes the program (channel). By transmitting the DIT, the device connected to the IRD (Integrated Reciever Decoder) understands that the program has been changed, and understands that the SI (Service Information) has been changed accordingly. In other words, DIT is data indicating a discontinuity of SI.

In the present invention, the DIT is the following DI from the DIT.
A group of pictures (transport streams) transmitted until T is data transmitted to indicate that decoding is possible continuously in transmission order. Therefore, DIT
Indicates a discontinuous point of the picture to be decoded. The reading unit 11 instructs the mode information setting unit 33 every time the recording unit 10 is randomly accessed to output the DIT to the packetizing unit 32 in order to read the transport stream to which the slow reverse is applied from the recording unit 10. Let it. The packetizer 32 converts the input DIT into a transport packet, and outputs the transport packet to the stream decoding device 22 via the contact B of the switch 31.

In the following description, random access is performed, in other words, DIT is output every time the GOP to be read is changed.

When the DIT is output in step S21, the process proceeds to step S22, and the reading unit 11 sets a target picture to which the slow reverse is applied. Then, in step S23, a read address is set so that reading is performed from the first I picture of the GOP including the set target picture.

The mode information setting unit 33 determines in step S24
, Information for realizing the slow reverse is set. This information is available in trick_mode_control_parameters
(Hereinafter referred to as TMCP), which is output as a transport stream packet in step S25. The syntax of trick mode control is shown below.

<Table 5> No.of bits 1 trick_mode_control_parameters () {2 trick_mode_control 3 3 if (trick_mode_control == fast_forward) {4 field_id 2 5 intra_slice_refresh 1 6 frequency_truncation 2 7 group_id 8 8} 9 else if (trick_mode_control == slow_motion ) {10 rep_cntrl 5 11 reserved 8 12} 13 else if (trick_mode_control == freeze_frame) {14 field_id 2 15 reserved 11 16} 17 else if (trick_mode_control == fast_reverse) {18 field_id 2 19 intra_slice_refresh 1 20 frequency_truncation 2 21 group_id 8 22} 23 else if (trick_mode_control == slow_reverse) {24 rep_cntrl 5 25 group_id 8 26} 27 else if (trick_mode_control == freeze_rep_info) {28 rep_cntrl 5 29 reserved 8 30} 31 else if (trick_mode_control == normal_playback) {32 reserved 13 33 else 34 reserved 13 35}

Table 5 described above is a syntax obtained by expanding Table 3. The description of the syntax part similar to that in Table 3 is omitted, and the description of the expanded part is described below. Group_id on line 7, line 21 and line 25
Is an 8-bit field, and indicates that the picture of the video stream to which the same group_id is applied is a group of pictures that can be decoded continuously. 11
Reserved in the line indicates that it is reserved for the future.

The else if (trick_mode_control
== freeze_rep_info) is a newly extended mode. When the trick mode is set to freeze_rep_info, the value of trick_mode_control on the second line is “10
1 ". This mode is a mode transmitted when the freeze mode is released.
Information on the display period of the video frame to which the freeze mode is applied is shown in p_cntrl.

Else if (trick_mode_control
== normal_playback) is also a newly extended mode. When the trick mode is set to this normal_playback, the value of trick_mode_cntrl on the second line is "11
0 ". This mode indicates a case of normal reproduction and a case where trick reproduction is canceled and returns to normal reproduction.

As described above, the 3-bit trick_mode_contr
The ol field (second line) and the information composed of 13 bits corresponding to the reproduction mode set by this field, from a total of 16 bits to trick_mode_control
_parameters is composed.

Returning to the description of step S24 in FIG. 5, the mode information setting section 33 sets a value for realizing the slow reverse as the information on the reproduction mode to be output as the transport stream packet. That is, trick_mode
As _control_parameters, the value of trick_mode_control is set to “100”, the value of rep_cntrl is set to a value indicated by 5 bits indicating M times, and a group_id indicating a group of pictures that can be decoded continuously.
Is set with 8 bits. The information for realizing the freeze frame set as described above is transmitted to the packetizing unit 3.
2 is output.

In step S25, the packetizing unit 32 generates a new transport stream using only the information of the reproduction mode set in step S24, which is output from the mode information setting unit 33. For that purpose, ISO / IEC
Use private_section () defined in 13818-1.

The trick_mode_information_table (hereinafter referred to as TM
IT) is a table that describes trick mode playback information, and one trick_mode_information_s
Section. This section
Is the se of private_section () defined in ISO / IEC13818-1
This is a syntax structure when ction_syntax_indicator is “0”. The syntax of trick_mode_information_section is shown below. <Table 6> No.of bits 1 trick_mode_information_section () {2 table_id 8 3 section_syntax_indicator 1 4 reserved_1 1 5 reserved_2 2 6 section_length 12 7 trick_mode_control_parameters () 16 8}

The table_id in the second row is an 8-bit field, and must be a value that is not used in the ISO / IEC13818-1 and DVD standards. The table_id is a field for identifying a private table to which this section belongs. The section_syntax_indicator on the third line is
This is a 1-bit field, and its value is set to “0”. If this value is set to “0”, private_da
Indicates that ta_byte immediately follows the private_section_length field. private_data_byte is a field that can be defined by the user, in this case, trick_mode_con
trol_parameters () is defined.

Reserved lines 4 and 5 are fields reserved for the future. Section_ on line 6
length is a 12-bit field, and indicates the number of remaining bytes of this private section after this field. And, in this case, as described above, 16
Bit trick_mode_control_parameters () is defined.

When the DIT is output as a transport stream packet, trick_mode_control_p in the seventh row of Table 6
arameters () becomes DIT_parameters (). The number of bits is 8 bits. First one of 8 bits
The bit is a flag indicating the continuation or discontinuity of the picture, and the remaining 7 bits are reserved.

Trick_mode_informa defined in this way
The tion_section has a fixed length of 40 bits (3 for DIT).
(Fixed length of 2 bits), it is possible to transmit in one transport packet. This trick_mode_inf
The syntax when the ormation_section is converted into a transport packet is shown below.

<Table 7> No.of bits 1 transport_packet_for_Trick_mode_Information_Table () {2 sync_byte 8 3 transport_error_indicatator 1 4 payload_unit_start_indicator 1 5 transport_priority 1 6 PID 13 7 transport_scrambling_control 2 8 adaptation_field_control 2 9 continuity_counter_section 4 10_pointer_pointer_pointer_pointer_pointer_pointer_pointing 178 (byte) 13}

Table 7 is obtained by rewriting Table 1 so as to be suitable for the present invention. The second to ninth rows are the same as those in Table 1, and therefore detailed description is omitted.
The value of the sync_byte in the line is set to “0100 0111” (0X47), and the value of the transport_error_indicator in the third line is “
0 ”is set, and payload_unit_start_indicat on the fourth line
The value of or is set to "1", and transport_prio in the fifth line
The value of rity is set to “0”.

The PID in the sixth line is based on ISO / IEC13818-1 and DV
Since it is sufficient that an unused value is set in the B standard, for example, “0X001D” is set. Transpor on line 7
The value of t_scrambling_control is set to “00” and 8
Adaptation_field_contr on line
The value of ol has no adaptation field and is set to “01” indicating only the payload. Then, the value of the continuity_counter on the ninth line is “
0000 ".

The pointer_field on the 10th line is t
rick_mode_information_section () is the pointer_fie
It indicates from which byte after ld it starts, and when set to "0000 0000", it indicates that it starts immediately after. Trick_mode_information on line 11
The trick mode information composed of 40 bits described in Table 6 is inserted into _section (). Then, the values of stuffing_bytes on the twelfth line are all set to “1”.

In the case of the DIT, since the DIT information is inserted in the eleventh row, it has 32 bits. Therefore, stuffing_bytes on the twelfth line is 179 bytes.

Returning to the description of the flowchart of FIG. 5, in steps S24 and S25,
mode_information_section and transport_packet_for_Tri
The transport stream packet generated by using the ck_mode_Information_Table is
Is output to the stream decoding device 22 via the.

In step S26, the reading unit 11
Starts reading the transport stream packets from the I picture set in step S23 to the target picture from the storage unit 10. Readout unit 1
In step S27, all the packets necessary for displaying the target picture are read out, and it is determined whether or not the packets have been output.
Returning to 24, the subsequent processing is repeated.

On the other hand, when it is determined in step S27 that the output of the transport stream packet necessary for displaying the target picture has been completed, the process proceeds to step S28. In step S28, it is determined whether the slow reverse has been canceled. When releasing the slow reverse, for example, the user releases his / her hand from the button for instructing the slow reverse or operates another button. The reading unit 11 and the mode information setting unit 33 determine whether or not such an operation has been performed.

If it is determined in step S28 that the slow reverse has not been released, the process proceeds to step S2.
In step 9, the target picture is set to the picture one picture before in time, and the reading is set to start from the first I picture of the GOP including the target picture. Then, in step S30, the DIT is output, the process returns to step S24, and the subsequent processing is repeated.

On the other hand, if it is determined in step S28 that the slow reverse has been released, a DIT is output, and the flow advances to step S5 (FIG. 3). In step S5, it is determined whether or not an instruction for normal reproduction has been issued. If it is determined that the instruction is a normal reproduction instruction, the process proceeds to step S6.

In step S6, the mode information setting section 33 sets information for returning to normal reproduction. This information setting is “11” as the value of trick_mode_control.
"0" is set (normal_playback), and the remaining bits, including the reserved field, are all set to 0. When the information for returning to normal reproduction is set as described above, the process proceeds to step S7, and is set in step S6. The information for returning to the normal reproduction is packetized as a transport stream by the packetizing unit 32 and output to the stream decoding device 22 via the contact B of the switch 31.

If the transport stream packet is output in step S7, the process returns to step S2, and the subsequent processing is repeated.

Steps S21 to S3 described above
The process of 0 will be described with reference to FIG. FIG.
(A) shows the recording unit 10 (DS) of the stream output device 21.
M: Digital Storage Media) indicates the order of transport streams. In this example, GOPX, GOPY, and GOPZ are recorded as three GOPs, each of which is composed of four pictures.

FIG. 6B shows a transport stream output from the stream output device 21.
When the slow reverse is instructed, DIT1 is output in step S21. Next, TMCP1 is output. This T
The MCP 1 includes the information set for realizing the slow reverse in step S24, and includes information set in step S25.
Is the transport stream packet output. After this TMCP1 is output, step S2
At 6, the picture I10 of GOPZ is output. This picture I10 is the I picture set as the picture to be read out in step S23. Also, here
The target picture set in step S22 is P13.

When the output of the picture I10 is completed, the process proceeds to step S27, and it is determined whether the output of the packet necessary to display the target picture set in step S22 has been completed. In this case, since only picture I10 has been output, the process returns to step S22, and the subsequent processing is repeated. I.e. the same rep_cntrl and g
After the TMCP1 having the roup_id is output, the picture P13 is output. When reading and outputting up to the picture P13 as the target picture are completed in this way, the process proceeds from step S27 to step S28, where it is determined whether or not the release of the slow reverse has been instructed, and it is determined that the release has not been released. If so, the process proceeds to step S29.

In step S29, the target picture is set to a picture one picture before in time. That is, in this case, the picture B12 is set as the target picture. When the target picture is set, step S30
And DIT2 is output. After that, it is assumed that, by repeating the same processing, as shown in FIG. 6B, after the GOPY picture P9 is set as the target picture, the slow reverse is released in the processing of step S28.

When the slow reverse is released and the reading is performed from the recording unit 10 for the next, for example, normal reproduction, the DIT 6 is output. Then, TMCP3 is output. The TMCP3 is a transport stream packet in which information for returning from slow reverse to normal reproduction is set. The transport stream output in this manner is transmitted to the monitor 4 in the order shown in FIG.
Displayed above. That is, picture P13, picture B
12, picture B11, picture I10, and picture P9
In this order, each picture is displayed the number of times specified by rep_cntrl.

Returning to the description of the flowchart of FIG. 3, when it is determined in step S3 that the instruction given by the reproduction instruction section 5 is not the instruction of slow reverse,
Proceed to step S8. In step S8, it is determined whether or not the instruction by the reproduction instruction unit 5 is a first reverse. If it is determined that the first reverse is performed, the process proceeds to step S9. In step S9,
First reverse processing is performed.

FIG. 7 is a flowchart showing the first reverse process. This flowchart is the same as the slow reverse process flowchart shown in FIG. 5, but the information to be set is different. That is, step S4
In 4, the information to be set is information for realizing fast reverse, and trick_mode_control_par
As ameters, the value of trick_mode_control is “01”
1 ”is set, the value of field_id indicating which field is to be displayed is set with 2 bits, and intra_slice_refresh which is information on the lack of a macroblock is 1
Frequency_truncaton, which is set in bits and indicates whether a set of restricted coefficients is included, is set in two bits, and group_id is eight bits, indicating group of pictures that can be decoded continuously. You.

Then, in step S48, it is determined whether cancellation of the first reverse has been instructed. Also, the picture set in step S49 may be an I picture or P picture
This is a picture, and no B picture is set. Other processes are the same as those in the slow reverse process in FIG.

Here, steps S41 to S5
0 will be described with reference to FIG. FIG. 8A shows a GOPX, GO, in which one GOP is composed of four pictures, as a transport stream recorded in the recording unit 10.
PY and GOPZ are shown. FIG. 8B shows the order of the transport streams output from the stream output device 21.

FIG. 8B shows a transport stream output from the stream output device 21.
When fast reverse is instructed, DIT1 is output in step S41. Next, TMCP1 is output.
This TMCP1 includes the information set to realize the fast reverse in step S44, and is the transport stream packet output in step S45. After the output of the TMCP1, the picture I10 of the GOPZ is output in step S46. This picture I10 is the I picture set as the picture to be read out in step S43. Here, the target picture set in step S42 is
P13.

When the output of the picture I10 has been completed, the flow advances to step S47 to determine whether or not the output of the packet necessary to display the target picture set in step S42 has been completed. In this case, since only the picture I10 has been output, the process returns to step S42, and the subsequent processing is repeated. I.e. the same rep_cntrl and g
After the TMCP1 having the roup_id is output, the picture P13 is output. When the reading and outputting of the picture P13 as the target picture are completed in this way, the process proceeds from step S47 to step S48, where it is determined whether or not the release of the fast reverse has been instructed, and it is determined that the release has not been performed. If so, the process proceeds to step S49.

In step S49, the target picture is set to a picture one picture earlier in time. That is, in this case, the picture I10 is set as the target picture. In the case of fast reverse, an I picture or a P picture is set as a target picture, and a B picture is not set. When the target picture is set, the process proceeds to step S30, where DIT2 is output.
Thereafter, the same processing is repeated to obtain FIG.
As shown in (B), it is assumed that after the picture I6 of GOPY is set as the target picture, the fast reverse is canceled in the processing of step S48.

When the first reverse is released and the next reading is performed from the recording unit 10 for normal reproduction, for example, DIT5 is output. Then, TMCP3 is output. This TMCP3 is a transport stream packet in which information for returning from fast reverse to normal reproduction is set. The transport stream output in this manner is in the order shown in FIG.
It is displayed on the monitor 4. That is, picture P13, picture I10, picture P9, and picture I6 are displayed in this order.

Returning to the description of the flowchart of FIG. 3, when it is determined in step S8 that the playback mode instructed by playback instructing section 5 is not fast reverse, or in step S5, it is not an instruction for normal playback. If it is determined, the process proceeds to step S10, and it is determined whether or not the instruction from the reproduction instruction unit 5 is an instruction to end the reproduction. If it is determined that the instruction is not an instruction to end the reproduction, the process proceeds to step S11, and the instructed process is executed. For example, in the case of an instruction to reproduce a freeze frame, information for realizing the freeze frame reproduction is set, a transport stream packet is formed, and the process returns to step S1.

If it is determined in step S10 that the instruction is for terminating the reproduction, the processing of this flowchart ends.

Thus, the stream output device 21
The stream decoding device 22 that decodes the transport stream output from the. FIG. 9 is a block diagram showing the configuration of the stream output device 22. The transport stream packet output from the stream output device 21 is input to the demultiplexer 41 of the stream decoding device 22. Demultiplexer 41
Separates the payload (PES packet) and PID (Packet Identification) of the input transport packet.

When the separated PID indicates a video stream, the switch 42 switches the internal connection to the contact C side, and outputs a PES packet to the depacketizing unit 43. The switch 42 has a PID of Selection_Informati
When the on_Table is indicated, the internal connection is switched to the contact D side, and the video_sequence
_header_descriptor parameter or trick mode c
ontrol parameters (playback mode information)
And outputs the information to the mode information decoder 44. The depacketizing unit 43 separates the video stream from the input PES packet and outputs the video stream to the buffer 46.

On the other hand, the reproduction mode information input to the mode information decoder 44 is decoded. The decoded reproduction mode information is transmitted to the trick mode controller 45.
Is output to The trick mode controller 45 controls the video decoder 47 based on the input reproduction mode information.
Control.

The buffer 46 mainly reproduces data in the reverse direction (fast
_reverse or slow_reverse) is provided to buffer video streams having the same group_id. Therefore, this buffer 46
Is set to a capacity larger than the maximum number of bits of one GOP (Group_of_Pictures).

The video stream output from the buffer 46 is input to a video decoder 47. In addition to the video stream from the buffer 46, information on the reproduction mode is input from the trick mode controller 45 to the video decoder 47 as appropriate. The video decoder 47 decodes the video stream using the input information and outputs the decoded video stream to the monitor 4.

The operation of the stream decoding device 22 will be described with reference to the flowchart of FIG. In step S61, the demultiplexer 41 receives the transport stream packet output from the stream output device 21. The demultiplexer 41 separates a payload (PES packet) and a PID from the input transport stream packet. Then, in step S62, the switch 42 sets the separated PI
It is determined whether D indicates a video stream, or trick mode information or a sequence header.

If it is determined in step S62 that the PID indicates a video stream, the process proceeds to step S62.
At 63, the received video stream is decoded by video decoder 47. First, switch 4
2 is switched to the contact C side. Switch 4
By switching 2 to the contact C side, the video stream (PES packet) separated by the demultiplexer 41 is output to the depacketizing unit 43.

[0110] The depacketizing section 43 separates the video stream from the input PES packet and outputs the video stream to the video decoder 47. Trick mode controller 45
Controls the video decoder to decode in step S63 in accordance with the reproduction mode information set in step S66 described later. Then, in step S64, the decoded video stream is
It is stored in a storage unit (not shown) inside the video decoder 47. In this way, the transport stream input to the stream decoding device 22 is
Is returned to step S61, and the subsequent processing is repeated.

On the other hand, if it is determined in step S62 that the PID does not indicate a video stream, the flow advances to step S65. In step S65, it is determined whether the received transport stream is a DIT. If it is determined that it is not a DIT, the process proceeds to step S66. If the received transport stream is neither a video stream nor a DIT, the transport stream is a packet containing TMCP. Therefore,
In step S66, the trick mode controller 4
Reference numeral 5 sets reproduction information for controlling the video decoder 47 based on the received TMCP.

On the other hand, if it is determined in step S65 that the received transport stream is a DIT, the flow advances to step S67. In step S67, a predetermined picture is output from the video stream (picture group) decoded and stored in the video decoder 47 according to the information set in the trick mode controller 45.

In the above-described embodiment, the change of the GOP being read is determined by the DIT. However, the change may be determined by the group_id in the TMCP information. DI when judging by group_id
There is no need to output T.

In the above-described embodiment, information such as slow reverse is output as a transport stream packet. However, as another form, for example, a trick mode is included in the header of an isochronous packet defined by IEEE1394. Control parameter information may be written and output.

Further, the present invention can be applied to data structures of packets other than transport stream packets and isochronous packets. Needless to say, the present invention can be applied to a playback mode other than the slow reverse and the fast reverse.

In the present specification, a providing medium for providing a user with a computer program for executing the above processing includes an information recording medium such as a magnetic disk and a CD-ROM, and a transmission medium via a network such as the Internet and a digital satellite. Is also included.

[0117]

As described above, according to the image data transmitting apparatus according to the first aspect, the image data transmitting method according to the fourth aspect, and the providing medium according to the fifth aspect, a reproduced picture is set and set. From the first I picture of the GOP including the set picture to the set playback picture, output first information indicating that the reading up to the set playback picture has been completed, and output information on the indicated playback mode. Since the second information indicating the playback picture set as “?” Is output, it is possible to smoothly display a moving image to which trick mode playback has been applied.

According to the image data receiving apparatus of the sixth aspect, the image data receiving method of the seventh aspect, and the providing medium of the eighth aspect, the picture data is received and the picture to be reproduced is specified. Since the data is received and the designated picture is reproduced from the received image data, it is possible to smoothly display the moving image to which the trick mode reproduction is applied.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an embodiment of an image processing system to which the present invention has been applied.

FIG. 2 is a block diagram illustrating a configuration of a stream output device.

FIG. 3 is a flowchart illustrating an operation of the stream output device of FIG. 2;

FIG. 4 is a diagram illustrating normal reproduction.

FIG. 5 is a flowchart illustrating details of a slow reverse process in step S4 of FIG. 3;

FIG. 6 is a diagram illustrating slow reverse playback.

FIG. 7 is a flowchart illustrating details of a fast reverse process in step S9 of FIG. 3;

FIG. 8 is a diagram illustrating fast reverse playback.

FIG. 9 is a block diagram illustrating a configuration of a stream decoding device.

FIG. 10 is a flowchart illustrating an operation of the stream decoding device in FIG. 9;

FIG. 11 is a block diagram illustrating a configuration of an example of a conventional stream output device.

FIG. 12 is a diagram illustrating a PES packet.

[Explanation of symbols]

21 stream output device, 22 stream decoding device, 31 switch, 32 packetizer, 33
Mode information setting unit, 41 demultiplexer, 4
2 switch, 43 depacketizer, 44 mode information decoder, 45 trick mode controller, 46 buffer, 47 video decoder

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C053 GB06 GB08 GB38 HA23 HA25 JA30 KA01 LA06 LA11 5C059 MA00 PP05 PP06 PP07 RC01 RC31 SS02 SS18 SS20 UA05 UA38 UA39

Claims (8)

[Claims] 1. A setting means for setting a reproduced picture; a reading means for reading from a first I picture of a GOP including a picture set by the setting means to a reproduced picture set by the setting means; Thus, the first output means for outputting the first information indicating that the reading up to the reproduction picture set by the setting means has been completed, an instruction means for instructing a reproduction mode, and an instruction by the instruction means An image data transmitting apparatus comprising: information on a reproduction mode; and second output means for outputting second information indicating a reproduced picture set by the setting means. 2. The image data transmitting apparatus according to claim 1, wherein the first information is a DIT. 3. The image data transmitting apparatus according to claim 1, wherein the second output unit outputs the second information as a transport stream packet. 4. A setting step of setting a reproduced picture; a reading step of reading from a first I picture of a GOP including the picture set in the setting step to a reproduced picture set in the setting step; A first output step of outputting first information indicating that the reading up to the reproduction picture set in the setting step has been completed, an instruction step of instructing a reproduction mode, and an instruction of the instruction step. An image data transmission method, comprising: a second output step of outputting information relating to a reproduction mode and second information indicating a reproduction picture set in the setting step. 5. A setting step of setting a reproduced picture, a reading step of reading from a first I picture of a GOP including the picture set in the setting step to a reproduced picture set in the setting step, and the reading step A first output step of outputting first information indicating that the reading up to the reproduction picture set in the setting step has been completed, an instruction step of instructing a reproduction mode, and an instruction of the instruction step. To provide a computer-readable program for causing an image data transmitting apparatus to execute a process including information on a reproduction mode and a second output step of outputting second information indicating a reproduced picture set in the setting step. A providing medium characterized by the above-mentioned. 6. A first receiving means for receiving image data, a second receiving means for receiving data indicating a picture to be reproduced, and the image data received by the first receiving means. An image data receiving apparatus comprising: a reproducing unit that reproduces a picture specified by the data received by the second receiving unit. 7. A first receiving step of receiving image data, a second receiving step of receiving data designating a picture to be reproduced, and the image data received in the first receiving step. A reproducing step of reproducing a picture designated by the data received in the second receiving step. 8. A first receiving step of receiving image data, a second receiving step of receiving data designating a picture to be reproduced, and the image data received in the first receiving step. A providing medium for providing a computer-readable program for causing an image data receiving apparatus to execute a process including a reproducing step of reproducing a picture designated by data received in a second receiving step.