JPH11252553A - Segmenting method for time series information and its system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize a time series information segmentation method by which partial information is accurately segmented from time series information. SOLUTION: In a segmenting method for time series information to segment partial information from received time series information, a transmission schedule time generating means 11 at a transmitter side 1 sends in advance a transmission schedule time of the partial information, an index addition means 13 adds an index to time information series and sends the result, and an index designation information generating means 15 sends index designation information to designate the partial information by the index. A time trimming means 31 at a receiver side tentatively segments the time series information including the partial information based on the transmission schedule time, and an index trimming means 34 segments again the partial time series information that is tentatively segmented based on the index designation information. Thus, the partial information is accurately segmented from the time series information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for extracting a part of information from time-series information such as video and audio to be transmitted and a system for implementing the method, and more particularly to a method for extracting partial information with accurate accuracy. Is realized.

[0002]

2. Description of the Related Art In digital satellite broadcasting, video, audio and data are multiplexed on a transport stream (TS) of an MPEG2 system and broadcast in order to support multi-programs.

In this TS, a fixed-length 188-byte transport packet (TS packet) is used for multiplexing. As shown in FIG. 3, the TS packet includes a packet (packet) before a payload (information) as shown in FIG. Data content identification information is added.

In the TS, individual program packets (PES (Packetized Elementary Stream) packets)
The information (shown in FIG. 4) is subdivided and transmitted by a plurality of TS packets.

[0005] When the receiving apparatus receives the modulated TS, it demodulates and then decodes and reproduces the packets of the selected program.

In the transmission of video and audio by the MPEG method, the decoding and reproduction time of a video and audio decoding unit (video is one frame, audio is one audio frame) is transmitted to the decoding side, as shown in FIG. , PTS (Presentasion
Time Stamp) and DTS (Decoding Time Stamp)
Different time stamps are used. PTS is time management information for reproduction output, and DTS is time management information for decoding. These time stamps are added to the packet if the packet has the head of the decoding unit, and are not added if the packet does not have the head of the decoding unit.

As shown in FIG. 3, a PCR (Program Clock Reference) for giving a time reference to these time stamps is added to the TS packet.

[0008] In such digital broadcasting, it is possible to increase the number of channels, and the number of options for viewers increases, but the program selection operation becomes complicated. For this reason, in digital multi-channel broadcasting, an EPG (Electronic Program Guide) including information such as a program name, a broadcast schedule, and cast names is data broadcasted to facilitate program selection. The viewer can display it on the television screen and operate channel selection and viewing reservation directly on the program guide, and can watch the next program announcement of the selected program.

In a group including the present inventors, viewers
We are developing a next-generation digital broadcasting system that allows you to watch the program you want to watch at your own pace, regardless of the broadcast time.

[0010] In this broadcasting system, the receiving apparatus selects a program suitable for the viewer's preference from the information to be broadcast and automatically accumulates the program without waiting for the viewer's operation. For example, the next program announcement of a program often viewed by the viewer is stored from the EPG information, and the CM of the car is stored when the viewer likes the car. The viewer can enjoy the information thus accumulated on the screen of the receiving device at a convenient time.

In this broadcasting system, the broadcasted
It is necessary to cut out predetermined partial information from audio information. In addition, extracting partial information from transmitted video / audio information is not limited to such a system,
It is required in many transmission systems.

A system for extracting partial information from time-series information such as video and audio has been configured as shown in FIG. When the time-series information is a video, the transmitting unit 1 that transmits the video includes a video generating unit that generates the video.
12; and a scheduled transmission time generating means 11 for outputting a scheduled transmission time of the partial video to be cut out. The receiving unit 3 on the video receiving side includes a clocking means 33 for clocking the time and a transmission means 2 A time trimming unit 31 for cutting out a partial image at a predetermined time from a video transmitted through the device, and a display unit 32 for displaying the cut out partial image.

In this system, the video generating means 12 of the transmitting section 1 outputs a video, and the transmission scheduled time generating means 11
Notifies the receiving unit 3 in advance of the scheduled transmission start time and transmission end time of the partial video to be cut out.

The time trimming unit 31 of the receiving unit 3 cuts out the video from the scheduled transmission start time to the scheduled transmission end time from the received video based on the time information output by the clock unit 33. The clipped partial image is displayed on the display unit 32.
Is output and displayed.

As described above, by specifying the time of the video clip before transmitting the video on the transmitting side, the partial video can be extracted on the receiving side.

[0016]

However, the time at which the time-series information is actually transmitted from the transmitting unit is affected by the buffering operation in the transmitting unit and the like. The exact time cannot be determined. Further, in a broadcast using a satellite or the like, a transmission delay by a transmission means is considerably large, and a time of about 0.2 seconds elapses just by a broadcast wave reciprocating between satellites. Therefore, the method of specifying the time zone in which the time series information is to be extracted in advance has a problem that the receiving side cannot accurately extract the partial information.

The present invention solves such a conventional problem, and provides a time-series information extracting method capable of accurately extracting partial information from time-series information, and a system for implementing the method. It is intended to be.

[0018]

Therefore, according to the present invention, the transmitting side of the time-series information transmits the scheduled transmission time of the partial information in advance, and the index (index) capable of specifying the actually transmitted time-series information. Or actual time), and the receiving side of the time-series information tentatively cuts out the time-series information including the partial information based on the scheduled transmission time, and provisionally extracts the time-series information based on the specified information. The partial information is cut out again from the temporally cut out time-series information.

Therefore, the receiving side can accurately extract partial information for which the transmission time cannot be accurately determined until the transmission is completed, without requiring a large memory capacity.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS According to a first aspect of the present invention, there is provided a time series information extracting method for extracting partial information from transmitted time series information.
The scheduled transmission time of the partial information is transmitted in advance, the index is added to the time-series information and transmitted, and the index information specifying the partial information by this index is transmitted,
The receiving side of the time-series information tentatively cuts out the time-series information including the partial information based on the scheduled transmission time, and again cuts out the partial information from the tentatively-cut time-series information based on the index designation information. Thus, partial information can be accurately extracted from the time-series information.

According to a second aspect of the present invention, the transmitting side transmits a transport stream of the MPEG2 system as time series information and uses a program clock reference as an index, and the error is 100 ms or less ( Partial information can be cut out with an accuracy of (about 3 frames).

According to a third aspect of the present invention, the transmitting side transmits an MPEG2 system stream as time-series information and uses a presentation timestamp as an index. Can be cut out.

According to a fourth aspect of the present invention, the transmitting side transmits an MPEG2 system stream as time-series information, and uses a decode time stamp as an index. Can be cut out.

According to a fifth aspect of the present invention, in the time-series information extracting method for extracting partial information from the transmitted time-series information, the transmitting side of the time-series information previously transmits a scheduled transmission time of the partial information, Sends time-series information and sends actual time information specifying the time at which the partial information was actually sent, and the receiving side of the time-series information provisionally prepares the time-series information including the partial information based on the scheduled sending time The partial information is cut out temporarily from the time series information temporarily cut out based on the actual time information, and the partial information can be accurately cut out from the time series information with a simple configuration.

According to a sixth aspect of the present invention, there is provided a time-series information transmission system comprising a transmitting device for transmitting time-series information and a receiving device for receiving the time-series information and cutting out partial information. A time-series information generating means for generating sequence information; a scheduled transmission time generating means for generating a scheduled transmission time of the partial information and transmitting the partial information before the partial information is transmitted;
A time-series information transmitting means for adding an index to the time-series information and transmitting the index information, and an index specifying information generating means for generating and transmitting index specifying information for specifying the partial information by the index are provided. , A time trimming means for temporarily cutting out time series information including partial information, and an index trimming means for cutting out partial information from time series information temporarily cut out based on index designation information. In this case, the method for extracting time-series information according to claim 1 can be implemented.

According to a seventh aspect of the present invention, the time-series information transmitting means transmits the transport stream of the MPEG2 system using the program clock reference as an index, and the index designation information generating means transmits the partial information to the program stream. The index specifying information specified by the clock reference is generated, and the time-series information extracting method according to claim 2 can be implemented.

In the invention according to claim 8, the time-series information transmitting means transmits an MPEG2 system stream using the presentation time stamp as an index, and the index designation information generating means converts the partial information by the presentation time stamp. The index designation information to be designated is generated, and the time-series information extracting method according to claim 3 can be implemented.

According to a ninth aspect of the present invention, the time-series information transmitting means transmits an MPEG2 system stream using the decode time stamp as an index, and the index designation information generating means converts the partial information by the decode time stamp. The index specifying information to be specified is generated, and the time-series information extracting method according to claim 4 can be implemented.

According to a tenth aspect of the present invention, in a time-series information transmission system comprising a transmitting apparatus for transmitting time-series information and a receiving apparatus for receiving the time-series information and cutting out partial information, A time-series information generating means for generating and transmitting sequence information, a scheduled transmission time generating means for generating a scheduled transmission time of the partial information and transmitting the partial information before the partial information is transmitted; First time trimming for provisionally cutting out time series information including partial information in the receiving device based on the scheduled transmission time by providing the actual time information for generating and transmitting the actual time information specifying the specified time 6. A time-series information extracting method according to claim 5, further comprising a second time trimming means for extracting partial information from time-series information temporarily extracted based on the actual time information. It can be carried out.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First Embodiment) As shown in FIG. 1, a time-series information transmission system according to a first embodiment
A video generating means 12 for generating a video, and a scheduled transmission time generating means for outputting a scheduled transmission time of a partial video to be cut out
11, an index generating means 14 for generating an index to be added to the video, and an index adding means 13 for adding the index to the video generated by the video generating means 12.
And index designation information generating means 15 for generating and transmitting index designation information designated by an index for the partial information to be cut out.
Clocking means 33 for measuring time; time trimming means 31 for roughly cutting out a time-designated partial video from a video transmitted through the transmission means 2; and index designation information from the partial video cut out by the time trimming means 31 Index trimming means 34 for accurately cutting out the partial video based on the image data, and display means 32 for displaying the partial video cut out by the index trimming means 34.

The operation of this system will be described with reference to the flowchart shown in FIG.

Step 1: Image generating means 12 of transmitting section 1
Generates an image and outputs it to the index adding means 13,
At the same time, it outputs the result information indicating the actual output result of the video to the index designation information generating means 15. Further, the scheduled transmission time generation means 11 generates a scheduled transmission start time and a scheduled transmission end time of the partial video to be cut out, and transmits them to the receiving unit 3 in advance.

Step 2: The index generating means 14 of the transmitting unit 1 generates an index to be added to the video,
The index is output to the index adding means 13 and the index designation information generating means 15, and the index adding means 13 adds the index to the video output from the video generating means 12. , To the receiving unit 3 through the transmission means 2.

Step 4: The time trimming means 31 of the receiving unit 3 determines, based on the time information output by the time measuring means 33, the transmission start scheduled time and the transmission start time previously received from the transmission unit 1 from the received video information. The video between the scheduled end time,
Cut it out with a margin.

Step 5: The index designation information generating means 15 of the transmitting section 1 adds the index information input from the video generating means 12 and the index input from the index generating means 14 to the beginning and end of the partial video to be cut out. The added index is obtained, and index specifying information for specifying the partial video is generated by using the index, and the receiving unit 3
To send to.

Step 6: The index trimming means 34 of the receiving unit 3 cuts out the partial video specified by the index designation information from the partial video (temporary partial video) cut out by the time trimming means 31. The display means 32 displays the clipped partial video.

As described above, in the system according to the present embodiment, the transmitting side transmitting the time-series information notifies the receiving side in advance of the scheduled transmission time of the partial information to the receiving side, and also transmits the partial information based on the index attached to the actual time-series information. Is transmitted to the receiving side. On the other hand, the receiving side tentatively cuts out the received time-series information based on the scheduled transmission time, and then, from the tentatively cut-out time-series information, extracts accurate partial information based on the index designation information. It has been cut out.

Therefore, the receiving side can accurately extract the partial information without having a large memory for storing the time-series information.

In the system for transmitting the TS of the MPEG2 system between the sending side and the receiving side as the time series information, the PCR attached to the TS packet can be used as an index.

In this case, prior to transmitting the partial information, the transmitting side designates the scheduled transmission time of the partial information and, after actually transmitting the time-series information, attaches it to the TS packet at the time of transmission. The PCR is analyzed, and the partial information is re-designated by the PCR.

On the other hand, the receiving side saves a larger number of TS packets in the received TS packets than the time-specified range in the storage means, and when the re-designation by PCR is received, unnecessary TS packets Is deleted from the storage means. The PCR can be referred to even if the payload is scrambled.

By using PCR as an index, a partial image can be cut out with an error range of 100 ms or less (around 3 frames).

Also, in this case, by using PTS or DTS as an index, the cutout accuracy of the partial information can be further improved.

At this time, the transmitting side transmits the TS packet to the PC
After re-designating with R, the actual PTS or DTS at the time of transmission is analyzed, and partial information is again designated with PTS or DTS.

The receiving side selects the TS selected based on the PCR.
Only information having a corresponding PTS or DTS is selected from the packet.

As described above, by using the PTS or DTS as an index, a partial video can be cut out with an accuracy of one frame. However, when the payload is scrambled, the PTS and DTS can be referred to only after descrambling.

An MPE packed with PES packets
Similarly, in an MPEG2 video system that transmits G2-PS (Program Stream) as time-series information, the PES
By using a PTS or DTS attached to a packet as an index, a partial video can be cut out with frame unit accuracy.

(Second Embodiment) In the second embodiment,
A system capable of accurately extracting partial information with a simple configuration will be described.

In this system, as shown in FIG. 5, a transmitting unit 1 includes a video generating means 12 for generating a video, a scheduled transmission time generating means 11 for outputting a scheduled transmission time of a partial video to be cut out, and A receiving unit 3 for generating and transmitting actual time information for displaying the actual transmission time of the video; and a receiving unit 3 for measuring the time. A first time trimming means 35 for roughly cutting out a partial video from a video transmitted through the transmission means 2 based on a scheduled transmission time, and actual time information from the provisional partial video cut out by the first time trimming means 35. Second to cut out the partial video accurately based on
A time trimming means 36 and a display means 32 for displaying the partial video clipped by the second time trimming means 32 are provided.

In the sending section 1 of this system, the scheduled sending time generating means 11 generates the scheduled sending start time and the scheduled sending end time of the partial video to be cut out, and sends them to the receiving section 3 in advance. In addition, the video generation unit 12 outputs the generated video, and outputs the performance information indicating the actual output performance of the video to the performance time generation unit 17.

The actual time generating means 17 obtains the time at which the head and the end of the partial video to be cut out are actually transmitted, based on the actual information input from the video generating means 12 and the time information input from the clocking means 16. Is transmitted to the receiving unit 3 as the result information.

In the receiving section 3, the first time trimming means 35
However, based on the time information output from the clock means 33, the video between the scheduled transmission start time and the scheduled transmission end time previously received from the transmission unit 1 is selected from the received video information.
Cut it out with a margin.

The second time trimming means 36 accurately cuts out the partial video from the partial video (temporary partial video) cut out by the first time trimming means 35 based on the actual time information. The display means 32 displays the clipped partial video.

As described above, in the system according to the present embodiment, the transmitting side transmitting the time-series information notifies the receiving side in advance of the scheduled transmission time of the partial information, obtains the actual transmission time of the partial information, and determines this. Transmit to the receiving side. on the other hand,
The receiving side tentatively cuts out the received time-series information based on the scheduled transmission time, and then cuts out a portion corresponding to the actual transmission time of the partial information from the tentatively cut-out time-series information. ing.

Therefore, in an environment where the delay caused by the transmission means 2 can be ignored, the partial information can be accurately extracted from the time-series information on the receiving side with a simple configuration.

In each embodiment, the cut-out partial information is directly displayed on the display means. However, the partial information may be temporarily stored in the storage means.

[0058]

As is apparent from the above description, the method for extracting time-series information according to the present invention can accurately extract partial information from time-series information without requiring a large amount of memory on the receiving side. Enable.

Further, the time-series information transmission system of the present invention can realize this time-series information extracting method, and can be configured without modifying a multiplexer or the like provided in a conventional transmitting apparatus. can do.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a time-series information transmission system according to a first embodiment;

FIG. 2 is a flowchart showing a procedure of a method for extracting time-series information according to the first embodiment;

FIG. 3 shows the data structure of an MPEG2 transport packet,

FIG. 4 shows a data structure of a PES packet,

FIG. 5 is a block diagram showing a configuration of a time-series information transmission system according to a second embodiment;

FIG. 6 is a block diagram illustrating a configuration of a conventional time-series information transmission system.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Sending part 2 Transmission means 3 Receiving part 11 Scheduled sending time generating means 12 Video generating means 13 Index adding means 14 Index generating means 15 Index designation information generating means 16, 33 Clocking means 17 Actual time generating means 31 Time trimming means 32 Display means 34 Index trimming means 35 First time trimming means 36 Second time trimming means

Claims (10)

[Claims] 1. A time-series information extracting method for extracting partial information from transmitted time-series information, wherein a transmitting side of the time-series information transmits a scheduled transmission time of the partial information in advance and adds an index to the time-series information. And transmitting index designation information for designating the partial information by the index, and the receiving side of the time-series information tentatively converts the time-series information including the partial information based on the scheduled transmission time. And extracting the partial information again from the temporally extracted time series information based on the index designation information. 2. A transmitting apparatus according to claim 1, wherein said time series information is an MPE.
2. The method according to claim 1, wherein a transport stream of a G2 system is transmitted, and a program clock reference is used as the index. 3. The transmitting side transmits an MPE as the time series information.
The method according to claim 1, wherein a stream of a G2 system is transmitted, and a presentation time stamp is used as the index. 4. The transmitting side transmits an MPE as the time series information.
The method according to claim 1, wherein a stream of a G2 system is transmitted, and a decode time stamp is used as the index. 5. A time-series information extracting method for extracting partial information from transmitted time-series information, wherein a transmitting side of the time-series information transmits a scheduled transmission time of the partial information in advance and transmits the time-series information. And transmitting actual time information specifying the time at which the partial information was actually transmitted, and the receiving side of the time-series information tentatively converts the time-series information including the partial information based on the scheduled transmission time. And extracting the partial information again from the temporally extracted time-series information based on the actual time information. 6. A time-series information transmission system comprising a transmitting device for transmitting time-series information and a receiving device for receiving the time-series information and cutting out partial information, wherein the transmitting device generates the time-series information. A time-series information generating means, a scheduled transmission time generating means for generating a scheduled transmission time of the partial information, and transmitting the partial information before the partial information is transmitted; Sequence information transmitting means; and index specifying information generating means for generating and transmitting index specifying information for specifying the partial information by the index, wherein the receiving device includes the partial information based on the scheduled transmission time. Time trimming means for temporarily cutting out the time-series information; and, based on the index designation information, Time-series information transmission system characterized by comprising an index-trimming means for cutting the partial information. 7. The time-series information transmitting means according to claim 1, wherein said index is a program clock reference.
7. The time series according to claim 6, wherein a transport stream of a PEG2 system is transmitted, and said index specification information generating means generates index specification information for specifying said partial information by said program clock reference. Information transmission system. 8. The method according to claim 1, wherein the time-series information transmitting means uses a presentation time stamp as the index.
7. The time-series information transmission system according to claim 6, wherein a stream of a PEG2 system is transmitted, and said index specification information generating means generates index specification information for specifying said partial information by said presentation time stamp. . 9. The time-series information transmitting means according to claim 1, wherein:
7. An MPEG2 system stream using a time stamp as said index, and said index designation information generating means generates index designation information for designating said partial information by said decode time stamp. The described time-series information transmission system. 10. A time-series information transmission system comprising a transmitting device for transmitting time-series information and a receiving device for receiving the time-series information and cutting out partial information, wherein the transmitting device generates the time-series information. A time series information generating means for transmitting the partial information; a scheduled transmission time generating means for generating a scheduled transmission time of the partial information and transmitting the partial information before the partial information is transmitted; and a time when the partial information is actually transmitted. First time trimming for temporarily extracting time-series information including the partial information based on the scheduled transmission time based on the scheduled transmission time. Means, and second time trimming means for cutting out the partial information from the time series information tentatively cut out based on the actual time information. Information transmission system.