JP4858389B2 - Moving image receiving apparatus, moving image receiving method, and program - Google Patents

Description

  The present invention relates to a moving image receiving apparatus, a moving image receiving method, and a program, and more particularly to an apparatus that can be used for representative image automatic collection.

Television broadcasting and moving image distribution services that digitally transmit moving image content via public wireless broadcasting such as terrestrial and satellite waves or various wired / wireless communication networks are becoming widespread.
Improvements in moving image compression technology such as MPEG have led to an increase in the number of channels that can be distributed simultaneously, making it possible to meet the diverse distribution needs of viewers. On the other hand, the increase in the number of distribution channels causes a problem that makes it difficult for the user to determine the viewing channel selection. In order to solve this problem, the receiving apparatus is equipped with a function that supports the user's channel selection determination. Examples are increasing.

  Automatic collection of representative images (thumbnail) is a typical example of such a support function. For example, a moving image stream being distributed on another channel that is not viewed by the user is received and decoded in the background, and a representative image representing the content is created and stored in the memory. The collected representative images are displayed in a list on the display screen when the user performs a button operation, for example, and the viewer can easily determine the channel to be viewed next based on this information.

  A simple method for performing cyclic stream reception is a method of collecting streams of all channels designated as collection targets while switching channels to be received and decoded in an appropriate order. This method is effective for a conventional moving image system using analog signal transmission, and even when receiving means with a small number of receivable channels is used, image acquisition is performed without deteriorating the immediacy of the representative image. Is possible. For example, when receiving means capable of simultaneous reception of one channel is used to collect representative images from 15 channels through which a moving image signal of 30 [frame / sec] is transmitted, it is assumed that a frame at the time of channel switching is used. Even if the worst 1/30 seconds are required for synchronization, stream collection of all 30 channels can be completed within 1 second. Even if an image one second before is displayed at the time of the display request for the representative image of each channel, there is no great inconvenience for the channel selection of the user.

  However, when moving picture transmission is performed using an encoding scheme based on inter-frame prediction such as MPEG, it is not always possible to immediately decode a picture stream received after channel switching. This is because a picture that has undergone interframe predictive coding cannot restore a normal picture unless a decoded picture of a picture to be predicted and referenced is obtained. In this case, since decoding can be started after switching the reception stream is limited to the timing when the intra-frame coded picture is received, it takes time to collect the streams of all the collection target channels. For example, representative images are collected. In this case, the immediacy of the obtained image decreases.

  As a specific example, in non-one-segment digital terrestrial broadcasting (ISDB-T) (see Non-Patent Document 1), moving image data with a time resolution of 30 [frame / sec] (interlaced or progressive) is MPEG- The data is encoded by two methods, multiplexed into TS (Transport System) format data, and transmitted. Except for special cases such as when switching scenes, an intra-frame encoded picture (I picture) that can be decoded independently is inserted at a rate of once every 0.5 seconds, and the others are inter-frame prediction called P picture or B picture. It is encoded as an encoded picture. For this reason, a waiting time of about 0.5 seconds at the maximum and an average of 0.25 seconds occurs stochastically from when the reception channel is switched to when the I picture stream is received. As a result, for example, when collecting streams from 15 channels, a waiting time of about 7.5 seconds at maximum and 3.75 seconds on average occurs, and when decoding time of I picture is combined, the worst is 8 seconds. May take more time.

  As another example, in the same segment of ISDB-T for mobile devices, moving image data with a time resolution of 15 [frame / sec] (progressive) is H.264. It is encoded and transmitted by the H.264 system, and insertion of I pictures is allowed to have a time interval of a maximum of 5 seconds. Therefore, even if the number of channels for collecting representative images is only 5, if the worst condition overlaps, it takes 25 seconds to receive all channels.

  The occurrence of such problems is not limited to television broadcasting using public radio waves. Even in a system that receives moving image distribution from the Internet network, the same problem occurs when the distribution server does not have a special function for representative image transmission and synchronization regarding I picture insertion is not achieved between channels. . Due to the characteristics of interframe predictive coding, the problem that the stream collection time increases in proportion to the I picture insertion interval is inevitable.

  With respect to the periodicity of the I picture insertion described above, the time at which stream data is actually transmitted and the reception time are not constant. The length of stream data obtained by encoding each picture varies within a predetermined range.

  Moreover, as such a related technique, for example, Patent Document 1 shown below can be cited.

  Patent Document 1 discloses a video display device that displays program videos of a plurality of channels in a pseudo manner on one screen. This video display device can switch and display a program video including an intra-frame encoded image and an inter-frame encoded image, and detects the appearance timing of the intra-frame encoded image of each program video to be processed. When switching the display from the first program video to the second program video, the second program video is referred to the appearance information from the storage means when the display is switched from the first program video to the second program video. Based on the reference means and the appearance information referred to, the processing target is changed from the first program video to the second program video so that the display is switched in accordance with the appearance timing of the intra-frame encoded image of the second program video. Switching means for switching.

The reference means refers to appearance information of a plurality of program videos that are candidates for switching, compares the time until an intra-frame encoded image of each program video appears, and can switch the program video in the shortest time Is selected as the second program video.
In this way, the process of switching the program video is executed in accordance with the appearance timing of the I picture that is the intra-frame encoded image, so that the non-displayable period is not generated as much as possible.

  The prediction of the appearance time of the I picture is performed as follows, for example. First, in multi-screen display, channels are switched at regular time intervals, and program videos to be processed for multi-screen display are displayed in order. At this time, the appearance timing of the I picture of each program video (for example, the appearance tendency of the I picture (GOP picture structure) and the appearance time of the last I picture) is detected, and the appearance information indicating the appearance timing is stored. Store in the means. When the channel switching is completed and the channel returns to the first channel again, the appearance time of the I picture is predicted by referring to the appearance information stored in the storage means.

Specifically, when switching the display from program A to program B, the appearance information of program B is referred to from the storage means. Then, an integer N satisfying Equation 1 is calculated from “the last I picture appearance time B1” and “I picture interval Bd” included in the appearance information and “the current time (= channel switching time) C0”. .
| Bl + Bd × N−C0 | <Bd Formula 1

Next, the appearance time C1 ′ of the I picture is calculated from Equation 2 using the calculated integer N.
C1 ′ = Bl + Bd × N Equation 2

  When switching to the same channel in a relatively short cycle as in the multi-screen display, there is a low possibility that a scene change or the like will occur between the previous display and the next display. Therefore, the appearance time of the I picture can be predicted with high accuracy by referring to the appearance information in the previous display. When a shift occurs in the appearance time of the I picture due to a scene change or the like, the appearance tendency and the appearance time are corrected and stored.

JP-A-2005-184457 Revised digital broadcasting textbooks, Impress, 66-73 pages, 120-130 pages, 2004

However, the related art has the following disadvantages. In other words, in broadcast distribution in which moving image transmission based on inter-frame predictive coding is performed, when automatic collection for displaying representative images of many channels is performed, processing is performed when receiving streams of many channels. It takes time and there is a disadvantage that a representative image with high immediacy cannot be presented.
In addition, in order to receive a large number of channels, there is a point to be improved in that it is not possible to suppress the processing capacity required for the receiving means and the amount of communication generated. For example, in the case of a public wireless broadcast receiver, the number of antennas that receive broadcast radio waves, the reception sensitivity, the circuit scale and power consumption of a device that demodulates a bit stream from the received signal, or increase the power consumption In the case of moving image distribution, it has been necessary to increase the number of channels for which transmission is requested or to increase the flow rate of data flowing through the communication path.

  Further, Patent Document 1 states that, from the “appearance time B1 of the last I picture” and the “interval Bd of I pictures”, the appearance of the I picture is considered without considering other factors, assuming that the I picture interval is fixed. Since the time is predicted and the actual appearance of the I picture is not at a constant interval, an error between the predicted value and the actual interval is likely to occur, leading to inconvenience that the prediction accuracy is poor and the processing time is long.

  The present invention has been made in order to solve the above-described disadvantages of the technology, and the purpose thereof is necessary for broadcast distribution in which moving image transmission based on interframe predictive coding is performed. It is an object of the present invention to provide a moving image receiving apparatus, a moving image receiving method, and a program capable of receiving, in a short time, a decodable stream from a large number of channels without increasing processing capacity and communication amount.

  In order to achieve the above object, a moving picture receiving apparatus according to the present invention includes a code reception time for receiving an intra-frame coded picture of a moving picture stream, and any of reproduction time information and decoding time information included in the moving picture stream. Based on the periodic time information including the time information storage processing means for storing the periodic time information including one or both for each moving image stream of a plurality of channels, and the periodic time information of the time information storage processing means, Code reception time prediction means for predicting the code reception time of the intra-frame coded picture, and the channel of the video stream to be received based on the prediction code reception time information predicted by the code reception time prediction means And channel selection control means for performing selection control.

  The moving image receiving method of the present invention is a periodicity including a code reception time for receiving an intra-frame coded picture of a moving image stream, and one or both of reproduction time information and decoding time information included in the moving image stream. A time information storage processing step for storing time information for each of the moving image streams of a plurality of channels, and a code of the intra-frame coded picture based on the periodic time information of the time information storage processing step. A code reception time prediction step for predicting a reception time; and a channel selection control step for selecting and controlling a channel of the video stream to be received based on the prediction code reception time information predicted in the code reception time prediction step; It is characterized by including.

  The program of the present invention is a computer-executable program, and is any one of a code reception time for receiving an intra-frame coded picture of a moving image stream, and reproduction time information and decoding time information included in the moving image stream. Based on the time information storage processing function for storing the periodic time information including one or both for each moving image stream of a plurality of channels, and the periodic time information of the time information storage processing function, Select a channel of the video stream to be received based on a code reception time prediction function for predicting a code reception time of an intra-frame coded picture and prediction code reception time information predicted by the code reception time prediction function And a channel selection control function to be controlled.

According to the present invention, from the code reception time of an intra-frame coded picture received in the past for each channel to be received as a moving image stream and periodic time information (for example, PTS, DTS, etc.) The code reception time of the inner coded picture is predicted, and a channel that shortens the time required for channel image collection is selected based on the prediction result.
As a result, in the second and subsequent rounds of collection, the waiting time from when switching to the stream of the selected channel until reception of the intra-frame coded picture is shortened. It is possible to provide an unprecedented excellent moving image receiving apparatus, moving image receiving method, and program capable of reducing the time required to collect a stream.

[Basic configuration of moving image receiving apparatus]
First, the basic configuration of the moving image receiving apparatus according to the present invention will be described. The moving picture receiving apparatus of the present invention has, as a basic configuration, a code receiving time for receiving an intra-frame coded picture of a moving picture stream, and one of reproduction time information and decoding time information included in the moving picture stream, or Time information storage processing means (for example, reference numeral 12 shown in FIG. 1) for storing periodic time information including both for each moving image stream of a plurality of channels, and the periodicity of the time information storage processing means. A code reception time prediction unit (for example, a configuration including the codes 22, 24, and 25 shown in FIG. 2) for predicting a code reception time of the intra-frame coded picture based on the time information, and the code reception time prediction unit Channel selection control means (for example, FIG. 2) for selecting and controlling the channel of the video stream to be received based on the predicted prediction code reception time information. And the like reference numeral 26) shown, is intended to include.

According to the moving image receiving apparatus having such a configuration, the code reception time prediction unit predicts the code reception time, and the channel selection control unit selects the channel so that the time required for channel image collection is shortened. The time required to collect each channel stream is reduced.
That is, the code reception time of an intra-frame coded picture received in the past for each channel to be received as a moving image stream, decoding time information (DTS) or reproduction time information (PTS) as an example of periodic time information, and the like From this point onward, the code reception time of the intra-frame coded picture is predicted, and on the basis of this prediction result, the channel for performing stream reception decoding for representative image creation is shortened so that the time required for channel image collection is shortened. select. As a result, in the second and subsequent rounds of collection, the waiting time from when switching to the stream of the selected channel until reception of the intra-frame coded picture is shortened. The time required to collect the stream is reduced.

Preferred embodiments of the present invention will be specifically described below with reference to the drawings.
[First Embodiment]
(Overall configuration of moving image receiving device)
FIG. 1 is a block diagram showing an example of the overall schematic configuration of the apparatus according to the first embodiment of the present invention.

  In FIG. 1, a moving picture receiving apparatus 1 according to the present embodiment collects intra-frame coded pictures of each channel of digital television broadcasting as a representative picture indicating the broadcast contents of the channel. A moving image coded stream receiving means (hereinafter abbreviated as coded stream receiving means) 10 for receiving a stream, and a code reception time, reproduction time information (PTS), and decoding time information (DTS) are accumulated for each channel. Accumulation processing means 12, system clock 14, intra-frame encoded picture reception time prediction / channel selection means (hereinafter abbreviated as time prediction / channel selection means) 20 for predicting code reception time and selecting a channel, The control means 30 which controls each part is comprised.

  The encoded stream receiving means 10 receives the code of the moving image encoded stream from the outside of the moving image receiving apparatus 1, and refers to the system clock 14 when the code of the intra-frame encoded picture is included in the code. The reception time of the picture is obtained, and the code reception time of the intra-frame coded picture and the decoding time information (DTS) or the reproduction time information (PTS) as an example of the periodicity time information are stored in the storage processing means 12. Forward to.

  The accumulation processing means 12 includes a code reception time for receiving an intra-frame coded picture of a moving image stream, and periodic time information including one or both of reproduction time information and decoding time information included in the moving image stream. Is stored for each moving image stream of a plurality of channels. The accumulation processing means 12 can be constituted by a storage unit such as a memory or a hard disk.

  The system clock 14 is adjusted to the SCR time when there is an SCR in the code, and is referred to by the encoded stream receiving means 10 when obtaining the reception time of the code of the intra-frame encoded picture in the code. Referenced when the encoded stream receiving unit 10 matches the channel at the predicted reception time by the time prediction / channel selection unit 20.

  The time prediction / channel selection means 20 includes the code reception time of the past intra-frame coded picture of each channel stored in the accumulation processing means 12, and reproduction time information (PTS) or decoding time as an example of periodic time information. Based on the information (DTS), the code reception time of the intra-frame encoded picture after the current time is predicted, and the channel matching of the encoded stream reception means 10 is performed at the prediction code reception time.

  Here, the time prediction / channel selection means 20 is based on a code reception time prediction function (code reception time prediction means) for predicting a code reception time of an intra-frame coded picture and a prediction result by the code reception time prediction function. And a channel selection control function (channel selection control means) for determining the channel circulation order and making a selection to control the channel circulation.

  The moving image receiving apparatus 1 operates by program control, and if it has a network-related function, the information apparatus (information processing apparatus / communication apparatus) having a wireless / wired communication function, or a similar computer Any computer can be used, whether mobile or fixed.

  In this case, the hardware configuration of the moving image receiving apparatus 1 is for displaying data (screen) for displaying various information and the like for operating and inputting data on the display screen (various input fields thereof). Operation input means (for example, keys), transmission / reception means (communication means) for transmitting / receiving various signals / data, storage means for storing various programs / various data, or storage processing means (for example, memory), these Control means (such as a CPU) for controlling the control can be included.

  Further, for example, in non-one-segment terrestrial digital broadcasting (ISDB-T), MPEG-2 or H.264 is used. Two types of time called decoding time stamp (DTS), which is decoding time information, and reproduction time stamp (PTS), which is decoding time information, for picture data encoded in the H.264 format The stream data multiplexed with the MPEG-2TS format with the information added is transmitted from the transmission side to the reception side. DTS represents the time at which the receiving side should decode the picture data obtained by separating the MPEG-2TS, and PTS represents the time at which the picture data obtained by the decoding process is displayed.

  Since the values of DTS and PTS are assigned based on the reference clock on the transmission side, the reception side needs to synchronize the reference clock for decoding and display control with the transmission side. This adjustment is performed based on information called PCR (Program Clock Reference) stored in MPEG-2TS.

Regarding the periodicity of the insertion of the frame coded picture (I picture), the interval is constant is the time information indicated by the DTS and PTS added to the frame coded picture (I picture), and the stream data is actually transmitted. The code transmission time and code reception time are not constant. The length of stream data obtained by encoding each picture varies within a predetermined range.
For this reason, in the present embodiment, this code reception time is predicted by the time prediction / channel selection means 20. Moreover, the time prediction / channel selection means 20 obtains a predicted PTS or DTS based on PTS or DTS, which is an example of periodic time information, and predicts the code reception time based on this.

The operation of the moving image receiving apparatus 1 of FIG. 1 according to the present embodiment configured as described above is roughly performed as follows.
First, the encoded stream receiving means 10 receives a code of a moving image encoded stream from the outside of the apparatus, and if there is a code of an intra-frame encoded picture in the code, refer to the system clock 14. The reception time of the picture is acquired, and the reception time of the intra-frame coded picture and the DTS or PTS are transferred to the storage processing means 12.

  The system clock 14 is adjusted to the SCR time when there is an SCR in the code, and is referred to by the encoded stream receiving means 10 when obtaining the reception time of the code of the intra-frame encoded picture in the code. Referenced when the encoded stream receiving unit 10 matches the channel at the predicted reception time by the time prediction / channel selection unit 20.

  The time prediction / channel selection means 20 predicts the reception time of past intra-frame coded pictures of each channel stored in the accumulation processing means 12 and the reception time of intra-frame coded pictures after the current time from the PTS or DTS. Thus, channel matching of the encoded stream receiving means 10 is performed at the predicted reception time.

(About processing procedure)
(Overall processing)
Next, various processing procedures in moving image reception having the above-described configuration will be described with reference to FIG.

  The moving picture receiving method according to the present embodiment basically includes a code reception time for receiving an intra-frame coded picture of a moving picture stream, and reproduction time information and decoding time information included in the moving picture stream. A time information accumulation processing step (for example, step S103 shown in FIG. 7) for accumulating periodic time information including either one or both for each moving image stream of a plurality of channels, and the time information accumulation processing step. Based on the periodicity time information, the code reception time prediction step (for example, step S104 shown in FIG. 7) for predicting the code reception time of the intra-frame coded picture and the code reception time prediction step are used. Channel selection for selecting and controlling the channel of the video stream to be received based on prediction code reception time information A control step (e.g., step S104 shown in FIG. 7) and is characterized in that it comprises a.

  First, the outline of the procedure in the moving image receiving method will be described. Each step shown in the flowchart of FIG. 7 is roughly divided into two.

  In step S101 to step S103, the moving image receiving apparatus 1 stores the reception time of the code of the intra-frame coded picture and the history of DTS or PTS in the accumulation processing unit 12 in the channel during the moving image broadcast.

  In steps S104 to S107, the moving picture receiving apparatus 1 uses the time prediction / channel selection means 20 to predict the reception time of the code of the intra-frame coded picture from the history onward for each of the channels and the channel. After selecting, the encoded stream receiving means 10 receives the moving image stream in the selected channel.

(About detailed processing)
Next, details of the processing will be described.
First, the moving image receiving apparatus 1 receives a moving image encoded stream by the encoded stream receiving means 10 (step S101 in FIG. 7).

  The moving image receiving apparatus 1 refers to the system clock 14 when the code of the intra-frame coded picture is included in the code in the stream (Yes in step S102). The time at which the code is received is acquired, and the channel, the reception time of the code of the intra-frame coded picture and the DTS or PTS received at step S101 are stored in the accumulation processing means 12 (step S103).

  After step S103, the process returns to step S101, and the encoded stream receiving means 10 receives the next moving image stream on the same channel or a different channel.

  If No in step S102, the process returns to step S101, and the encoded stream receiving means 10 receives the next moving image stream in the same channel or a different channel.

  The moving image receiving apparatus 1 uses the time prediction / channel selection means 20 to receive the past intra-frame encoded picture reception time stored in the accumulation processing means 12 for each channel selection target channel and the frames subsequent to the present from the DTS or PTS. The reception time of the inner coded picture is predicted, and a channel is selected so as to receive the intra-frame coded picture at the predicted time (step S104).

  The moving image receiving apparatus 1 refers to the time of the system clock 14 (step S105), compares the system time with the predicted reception time, and the result is that the system time value is less than the predicted reception time value. If (No in step S106), the process returns to step S105, the system time is compared with the predicted reception time, and if the result is that the system time value is equal to or greater than the predicted reception time value (step S106). In the case of Yes), the encoded stream receiving means 10 is matched with the selected channel, receives and outputs the moving picture stream in the channel (step S107), and returns to step S104.

(About effect)
Next, the effect of this embodiment will be described.
According to the present embodiment, the intra-frame coded pictures from the reception time and time stamp (DTS or PTS) of the intra-frame coded picture received in the past for each channel that is the reception target of the moving image stream are The reception time is predicted, and a channel on which stream reception decoding is performed for representative image creation is selected so that the time required for collecting images of the target channel is shortened based on the prediction result. As a result, in the second and subsequent rounds of collection, the waiting time from when switching to the stream of the selected channel to reception of the intra-frame coded picture is shortened, so it is compared with a simple method that circulates the channels in a fixed order. Thus, an effect of shortening the time required to collect the streams of the respective channels can be obtained.

  In the present embodiment, the time at which an intra-frame coded picture is received after the present time is determined by the time stamp of the picture (DTS or PTS as an example of periodicity time information) and the difference between the time stamp and the reception time. Predict by dividing into two types. Since the former that can be accurately predicted based on the periodicity of the intra-frame coded picture and the latter that is affected by the fluctuation in the amount of picture code are predicted separately, the prediction accuracy is improved, resulting in stream collection time The effect of shortening is obtained.

  In the present embodiment, the moving image receiving apparatus accumulates, as a history, the reception time of a code of an intra-frame encoded picture that can be decoded independently in the code of the moving image stream in each channel being broadcast and DTS or PTS. Thus, it is configured to be able to predict the reception time of the code of the intra-frame encoded picture after the present from the history and select a channel based on the prediction code reception time.

  In many digital video broadcasts, there is a code reception time of an intra-frame coded picture and a periodicity of DTS or PTS, so the code reception time of an intra-frame coded picture received in the past and the history information of DTS or PTS are used. By using it, it becomes possible to predict the code reception time of the intra-frame coded pictures after the present.

  By using the predicted reception time, it is possible to select a channel that can minimize the time from channel switching to code reception of an intra-frame coded picture.

  Collection time of moving image streams that can be decoded immediately by performing channel selection that minimizes the sum of the time from channel switching to code reception of intra-frame coded pictures for all broadcast channels The effect of shortening is obtained.

  On the other hand, when collecting moving image streams, for example, by simply performing a round without using the time prediction / channel selection means of the moving image receiving apparatus according to the present invention, the channel is selected by the channel selection of the encoded stream receiving means. There is a possibility of selecting a channel having the longest time from switching to reception of an intra-frame coded picture. Therefore, in order to obtain the above effect, the intra-frame coded picture code reception time prediction / channel selection means possessed by the moving picture receiving apparatus according to the present embodiment is required.

  In the present embodiment, the effect of further reducing the moving image stream collection time can be obtained by limiting the selection target channels.

  When the viewer collects moving image streams to search for a favorite program, the genre of the program may be limited.

  In addition, a broadcast station may specialize a broadcast program in a specific genre. As described above, the moving image stream collection time can be further shortened without impairing the convenience of the viewer by limiting the moving image stream collection target channels.

  Furthermore, in the present embodiment, the DTS or PTS periodicity of the intra-frame coded picture is used to predict the interval value of the adjacent intra-frame coded picture DTS or PTS on the same moving image stream, and the prediction By adding a natural number multiple of the PTS interval value to the latest DTS or PTS in the history, the DTS or PTS of the intra-frame encoded picture after the present is predicted, and the reception time of the intra-frame encoded picture in the history The prediction of the code reception time of the intra-frame coded picture after the current and the PTS from the difference between DTS or PTS and the difference between the PTS and subtracting the prediction difference from the predicted PTS makes it possible to The reception time is predicted.

  When directly predicting the code reception time of an intra-frame encoded picture, it is necessary to consider an error due to an environmental change in the transmission path of the moving image stream.

  The prediction error of the code reception time of the intra-frame coded picture is obtained by dividing the prediction of the code reception time of the intra-frame coded picture into the PTS interval value prediction and the difference prediction between the code reception time and the PTS, It can be divided into a difference prediction error between the code reception time and the PTS.

  Since the regularity of the PTS cycle of the intra-frame coded picture is high, it is possible to predict the PTS interval value without error, so that the reception time prediction error can be reduced to only the difference prediction error.

  When the error may be assumed to be small in the prediction of the reception time of the intra-frame coded picture, the time between the predicted reception time of the intra-frame coded picture and the actual reception time can be reduced. Therefore, it is possible to further reduce the waiting time from channel switching added to take error into reception of intra-frame coded pictures.

  In the above description, the operation content of each step described above and the components of each unit may be programmed and executed by a computer.

[Second Embodiment]
Next, a second embodiment according to the present invention will be described with reference to FIGS. In the following, description of the substantially similar configuration of the first embodiment will be omitted, and only different parts will be described. FIG. 2 is a block diagram showing an example of the second embodiment of the moving image receiving apparatus of the present invention.

  The moving picture receiving apparatus according to the present embodiment discloses a specific configuration example of prediction and channel selection in the time prediction / channel selection means 20.

  Here, the moving image receiving apparatus is intended to collect intra-frame coded pictures of each channel of digital television broadcasting as a representative image indicating the broadcast content of the channel.

  FIG. 4 shows an example of a moving image stream of digital television broadcasting using m channels (channel 1 to channel m, where m is a natural number of 3 or more) used in the present embodiment.

  In the present embodiment, it is assumed that, among the m channels, channel 1, channel 2, and channel m are designated as representative image collection target channels.

  In FIG. 4, each parallelogram represents one picture, and the numbers in the picture indicate picture numbers assigned for convenience. In FIG. 4, black parallelograms with white characters indicate intra-frame encoded pictures, and white parallelograms with black characters indicate inter-frame encoded pictures.

  Here, in the example of FIG. 4, the magnitude relationship between the picture numbers in the same channel indicates the reception order between the pictures, but the magnitude relationship between the picture numbers between different channels also indicates the reception order between the pictures. It is not meant to be shown.

  In the example of FIG. 4, 1 in 6 moving picture streams in channel 1 are intra-frame coded pictures, and 1 in 7 moving picture streams in channel 2 are intra-frame coded pictures. In the moving picture stream in the channel m, one out of four pictures is an intra-frame coded picture, but the moving picture receiving apparatus 1 in FIG. 1 has a constant insertion interval of the intra-frame coded picture for each channel. As a whole, it is assumed that the information of the insertion interval of the intra-frame coded picture is not acquired for any channel.

  Assume that there is only one encoded stream receiving means 10 in the moving image receiving apparatus 1 of FIG. 1 in the present embodiment.

(About configuration)
Next, a detailed configuration of the moving image receiving apparatus 1 will be described with reference to FIG. FIG. 2 is a block diagram showing an example of a detailed configuration of the time prediction / channel selection means of the moving picture receiving apparatus according to the present embodiment. First, the configuration of the intra-frame coded picture reception time prediction / channel selection means (hereinafter abbreviated as time prediction / channel selection means) will be described, followed by the configuration of the control means.

  The moving image receiving apparatus of the present embodiment discloses an example in which the time prediction / channel selection unit 20 in FIG. 1 is configured as the time prediction / channel selection unit 20 shown in FIG. The configuration is the same as that of the first embodiment.

(Time prediction / channel selection means)
As shown in FIG. 2, the time prediction / channel selection unit 20 in the moving picture receiving apparatus of the present embodiment, based on the previous reproduction time information, reproduces the reproduction time information of the intra-frame coded pictures after the present. The first prediction unit 22 that predicts the code, the second prediction unit 24 that predicts the code reception time based on the predicted reproduction time predicted by the first prediction unit 22, and the prediction for each channel A prediction calculation module control unit 25 that controls the calculation procedure so as to perform, and a channel selection unit 26 that controls channel selection based on the predicted code time information.

  Here, the first prediction unit 22, the second prediction unit 24, and the prediction calculation module control unit 25 may constitute a prediction unit (code reception time prediction unit).

  The first predicting unit 22 predicts a common divisor of increments of the values of the reproduction time information as interval values of the reproduction time information, and based on the predicted reproduction time information interval value and the past reproduction time information. Thus, the reproduction time information of the intra-frame coded pictures after the present is predicted. The first prediction unit 22 can also be referred to as first prediction means.

  More specifically, the first prediction unit 22 uses the increment of the PTS value of the intra-frame coded picture of each channel, and uses the common divisor of the increment as the PTS interval value of the intra-frame coded picture. By adding a natural number multiple of the PTS interval value in the PTS interval value prediction unit 22a to the PTS of the PTS interval value prediction unit 22a to be predicted and the PTS of the intra-frame coded picture stored in the latest past, And a PTS value prediction unit 22b that calculates a predicted value of the PTS of the intra-frame coded picture after the time.

  The PTS interval value prediction unit 22a includes a PTS increment calculation unit 22a-1 that calculates an increment of the PTS value of the intra-frame coded picture of each channel, and among the increments calculated by the PTS increment calculation unit 22a-1. And a common divisor calculating unit 22a-2 for calculating a numerical value (predicted PTS interval value) to be a common divisor.

  The PTS value predicting unit 22b is a natural number multiple determining unit 22b-1 that determines a natural number multiple as to which predicted value is to be calculated, and a numerical value of the common divisor calculated by the common divisor calculating unit 22a. Multiply the (predicted PTS interval value) by the natural number multiple determined by the natural number multiple determination unit 22b-1, and add the PTS value of the intra-frame coded picture stored in the past to the previous PTS addition unit 22b- 2.

  The second prediction unit 24 receives the code of the intra-frame coded picture received after the current time based on the code reception time and the reproduction time information of the intra-frame coded picture received in the past. The difference between the time and the reproduction time information is predicted, and based on the predicted difference and the reproduction time information predicted by the first prediction unit 22, the intra-frame encoded pictures of the subsequent frames are encoded. The code reception time is predicted.

  Furthermore, the second prediction unit 24 uses a value obtained by adding a specific margin to the average value of the difference between the past code reception time and the reproduction time information, for the intra-frame coded picture received after the present. A difference between the code reception time and the reproduction time information is predicted. The second prediction unit 24 can also be referred to as second prediction means.

  The second prediction unit 24 calculates the difference between the code reception time of the code of the intra-frame coded picture received in the past and the PTS from the code reception time of the code of the intra-frame coded picture received after the present and the PTS. Predicted reception time—a value obtained by adding a predetermined margin to the average value of the differences calculated by the PTS difference prediction unit 24a (hereinafter sometimes abbreviated as a PTS difference prediction unit) and the PTS difference prediction unit 24a A reception time prediction value calculation unit 24b that calculates a prediction value of a code reception time of an intra-frame coded picture based on a difference from the prediction PTS calculated by the PTS value prediction unit 22b of one prediction unit 22 Is done.

  The PTS difference prediction unit 24a includes a difference average value calculation unit 24a-1 that calculates the average value of the difference between the code reception time of the code of the intra-frame coded picture received in the past and the PTS, and the difference average value calculation unit 24a- And a margin setting processing unit 24a-2 that performs margin setting and calculation processing so that a value obtained by adding a predetermined margin to the difference average value calculated in 1 becomes a prediction difference.

  The prediction calculation module control unit 25 has a function of controlling the execution procedure of each unit. For example, in the process of calculating the prediction value of the code reception time of the intra-frame coded picture for one channel, for example, while performing the operation of the second prediction unit, the intra-frame coded picture for the other channel A function for controlling the first prediction unit to perform the calculation in the process of calculating the predicted value of the code reception time is assumed.

  Based on the prediction code reception time predicted by the second prediction unit 24 included in the code reception time prediction unit, the channel selection unit 26 sets the channel circulation order so that the representative image collection target channel circulation time is minimized. It is determined and channel selection is performed. The channel selection unit 26 can also be referred to as channel selection control means.

  Further, the channel selection unit 26 can obtain an approximate solution of the channel circulation order by repeatedly selecting a representative image collection target channel and performing a depth-first search. The channel selection unit 26 calculates an evaluation value with respect to a channel selection order based on the prediction code reception time, selects a channel in order from the highest evaluation value, and the evaluation value is collected. The selection order of channels can be determined by calculating based on the immediacy or collection time of representative images. At that time, the channel selection unit 26 can calculate the evaluation value as a required traveling time for circulating the channel.

  The channel selection unit 26 includes a channel cyclic order determination processing unit 26a (hereinafter sometimes abbreviated as a channel order determination processing unit) that determines the channel cyclic order of the representative image collection target channel based on the prediction code reception time, and the channel order. And a channel selection processing unit 26b that performs processing necessary for channel circulation based on the channel circulation order determined by the determination processing unit 26a.

  The channel order determination processing unit 26a includes a first evaluation function calculation unit 26a-1 that calculates a first evaluation function F1 for determining a cyclic order of unselected channels, and the first evaluation function calculation unit 26a- And a first unselected channel selection unit 26a-2 that selects and selects a cyclic order from unselected channels based on the first evaluation function calculation result calculated in step 1. The

  The channel order determination processing unit 26a calculates a second evaluation function F2 for determining the cyclic order when there are a plurality of unselected channels having the same calculation result of the first evaluation function F1. The cyclic order is determined from among the unselected channels based on the second evaluation function calculation unit 26a-3 and the second evaluation function calculation result calculated by the second evaluation function calculation unit 26a-3. And a second unselected channel selection unit 26a-4 that performs selection.

  Further, the channel order determination processing unit 26a determines the final cyclic order in consideration of the calculation results of the first evaluation function F1 and the second evaluation function F2, and controls the execution procedure of these units. The channel determination processing control unit 26a-5 is included.

In the first evaluation function calculating unit 26a-1, when selecting a channel to be cycled next in the search, the prediction code reception time of the intra-frame coded picture in the channel selected immediately before is set to T_P, and the channel Assuming that the predicted code reception time of the intra-frame coded picture received after the time T_P in (CH) is T_I (CH, T_P), the first evaluation function F1 for each unselected channel (CH) The
F1 (CH) = T_I (CH, T_P) −T_P
Calculate as

  The first unselected channel selection unit 26a-2 selects an unselected channel with the smallest calculation result of the first evaluation function F1 as a channel to be matched first.

The second evaluation function calculation unit 26a-3 receives the frame received after the time T_P in the channel (CH) when there are a plurality of unselected channels that minimize the calculation result of the first evaluation function F1. Assuming that the prediction code reception time of the second picture of the inner coded picture is T_II (CH, T_P), a second evaluation function F2 is obtained for each unselected channel (CH).
F2 (CH) = T_II (CH, T_P)
Calculate as

  The second unselected channel selection unit 26a-4 selects the unselected channel that maximizes the calculation result of the second evaluation function F2 as the channel to be matched first.

  The channel determination processing control unit 26a-5 determines the cyclic order determined by the first unselected channel selection unit 26a-2 and the second unselected channel selection unit 26a-4. The final order of the tour can be determined in consideration of the determined channel.

  The channel selection processing unit 26b can perform control processing necessary for channel circulation based on the channel circulation order determined by the channel circulation order determination processing unit 26a.

  The time prediction / channel selection means 20 of the moving image receiving apparatus 1 having the above-described configuration operates generally as follows. That is, the prediction calculation module control unit 25 of the time prediction / channel selection unit 20 causes the first prediction unit 22 and the second prediction unit 24 to be executed for one channel, and receives a prediction code of an intra-frame coded picture. Time and predicted PTS are calculated. Similarly, the prediction calculation module control unit 25 causes the first prediction unit 22 and the second prediction unit 24 to be executed for other channels, and calculates the prediction code reception time and the prediction PTS of the intra-frame coded picture. .

  Specifically, the first prediction unit 22 causes the PTS interval value prediction unit 22a to execute and uses the increment of the PTS value of the intra-frame coded picture to calculate the common divisor of the increment as the intra-frame coded picture. As an interval value of the PTS, it is predicted.

  Subsequently, the first prediction unit 22 causes the PTS value prediction unit 22b to execute the PTS of the intra-frame coded picture stored in the past in the PTS interval value of the PTS interval value prediction unit 22a. By adding the natural number multiple, the predicted value of the PTS of the intra-frame coded picture after the current time is calculated.

  Further, the second prediction unit 24 causes the reception time-PTS difference prediction unit 24a to execute the intra-frame received from the present onward based on the code reception time of the code of the intra-frame coded picture received in the past and the PTS. The difference between the code reception time of the code of the encoded picture and the PTS is predicted.

  Then, the second prediction unit 24 causes the reception time predicted value calculation unit 24b to execute, and a value obtained by adding a predetermined margin to the average value of the differences calculated by the reception time-PTS difference prediction unit 24a and the first The prediction value of the code reception time of the intra-frame coded picture is calculated based on the difference from the prediction PTS calculated by the PTS value prediction unit 22b of the prediction unit 22.

  In this way, when the prediction code reception time of the intra-frame coded picture and the prediction PTS are calculated for each channel, the time prediction / channel selection means 20 causes the channel selection unit 26 to execute the channel cyclic order. Make a decision.

  Specifically, the channel selection unit 26 causes the channel cyclic order determination processing unit 26a to execute, and first calculates the first evaluation function F1 for each channel by the first evaluation function calculation unit 26a-1. The unselected channel selection unit 26a-2 determines a channel that has the smallest first evaluation function F1 as a channel to be selected first.

  At this time, if there are a plurality of channels having the same first evaluation function F1, the second evaluation function calculation unit 26a-3 calculates the second evaluation function F2, and the second unselected channel selection unit 26a. According to −4, the channel having the maximum second evaluation function F2 is determined as a preferentially selected channel among the channels having the same first evaluation function F1.

  In this way, the final cyclic order is determined by the channel determination processing control unit 26a-5 in consideration of the calculation results of the first evaluation function F1 and the second evaluation function F2.

(Control means)
The control means 30 in the moving image receiving apparatus of the present embodiment controls the above-described units, and includes a time information acquisition control unit 32 and a channel circulation control unit 34 as shown in FIG. Consists of.

The time information acquisition control unit 32 controls the encoded stream receiving unit 10 to receive the code of the moving image encoded stream, and whether or not there is a code of the intra-frame encoded picture in the moving image encoded stream. If there is a code, the system clock 14 is referred to obtain the code reception time of the intra-frame coded picture, the code reception time is stored in the accumulation processing means 12, and the moving image Control is performed so that the PTS information and DTS information given to the intra-frame coded picture included in the coded stream is stored in the storage processing means 12.
In addition, the time information acquisition control unit 32, when there is no code in the determination, or when the storage control processing to the accumulation processing unit 12 is completed, the encoded stream reception unit 10 uses the same channel or different channels. Control is performed to receive the next moving image stream.

  Specifically, the time information acquisition control unit 32 controls the encoded stream reception unit 10 to receive the code of the encoded video stream, and receives the encoded stream reception. An encoded picture code determination processing unit 32b for determining whether or not there is a code of an intra-frame encoded picture in the moving image encoded stream received by the means 10, and the encoded picture code determination processing unit 32b When it is determined that there is a code of the intra-frame coded picture, the system clock 14 is referred to obtain the code reception time of the intra-frame coded picture, and the code reception time is stored in the storage processing means 12. And storing the PTS information and DTS information attached to the intra-frame encoded picture included in the moving image encoded stream. Configured to include a reception time · PTS / DTS acquisition processing section 32c for controlling to store the product processing unit 12, a.

  Based on the channel cycle order (search result) determined by the time prediction / channel selection unit 20, the channel cycle control unit 34 adjusts the channel so that the encoded stream reception unit 10 matches each channel at each time. Performs patrol control.

  The channel circulation control processing unit 34 refers to the time prediction / channel selection processing unit 34a that controls the time prediction / channel selection unit 20 to select a specific channel from the representative image collection target channels, and the system clock 14. A system time acquisition processing unit 34b that acquires a system time, and whether or not the system time acquired by the system time acquisition processing unit 34b is a predicted reception time of a code of an intra-frame coded picture in the specific channel. A time determination processing unit 34c for determining and controlling the encoded stream, when the time determination processing unit 34c determines that the system time is a predicted reception time of a code of an intra-frame encoded picture in the specific channel. The receiving means 10 is adjusted to a specific channel, and the moving image stream in the specific channel is And the stream reception processing unit 34d for the control for signal and output configured to include a, a module control unit 34e for controlling the execution procedure with controls the these units.

  In the stream reception processing unit 34d, since the code of the output moving image stream to be output includes the code of the intra-frame coded picture, it is possible to generate a representative image by the external device that has received the output moving image stream. It is.

  When the stream reception processing unit 34d outputs the moving image stream in the specific channel, the module control unit 34e causes the time prediction / channel selection unit 20 to execute the time prediction / channel selection processing unit 34a again. Then, control is performed to select another channel from the representative image collection target channels that have not been collected.

  That is, the module control unit 34e also executes the time prediction / channel selection processing unit 34a, the system time acquisition processing unit 34b, the time determination processing unit 34c, and the stream reception processing unit 34d for the other channels. Control to generate a representative image of the channel.

  In this way, the module control unit 34e receives the moving image encoded stream including the code of the intra-frame encoded picture for all the representative image collection target channels, and generates the representative images of all the channels. Then, the process is completed.

Here, some of the blocks in the block diagrams shown in FIG. 1, FIG. 2, and FIG. 3 show a state in which the computer is functionalized by executing various programs stored in an appropriate memory. It can be thought of as a software module configuration. That is, the physical configuration is, for example, one or a plurality of CPUs (or one or a plurality of CPUs and one or a plurality of memories), but the software configuration by each unit (means) is a plurality of CPUs that are exhibited by the control of the program. Are expressed as components by a plurality of units (means).
When the CPU dynamically expresses a dynamic state (a state in which each procedure constituting the program is executed) executed by the program, each unit (means) is configured in the CPU. In a static state in which the program is not executed, the entire program (or each program part included in the configuration of each unit) that realizes the configuration of each unit is stored in a storage area such as a memory.
The description of each part (means) described above can be interpreted as a computer functionalized by a program together with the function of the program, or a plurality of functions permanently functioning by specific hardware. Naturally, it can be interpreted that the device comprising the electronic circuit block is described. Therefore, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and is not limited to any one.

  The control means 30 of the moving image receiving apparatus 1 having the above-described configuration generally operates as follows. That is, the time information acquisition control unit 32 of the control unit 30 executes the encoded stream reception processing unit 32a and controls the encoded stream reception unit 10 to receive the code of the moving image encoded stream.

  Subsequently, the time information acquisition processing unit 32 of the control unit 30 causes the encoded picture code determination processing unit 32b to execute intra-frame encoding in the moving image encoded stream received by the encoded stream receiving unit 10. It is determined whether or not there is a picture code.

  When the intra-coded picture code determination processing unit 32b determines that there is a code of the intra-frame coded picture, the time information acquisition control unit 32 of the control means 30 receives the reception time / PTS / DTS. The acquisition processing unit 32c is executed, the code reception time of the intra-frame coded picture is acquired with reference to the system clock 14, the code reception time is stored in the accumulation processing means 12, and the moving image encoded stream is stored in the moving image encoded stream. Control is performed so as to store the PTS information and the DTS information given to the included intra-frame coded picture in the accumulation processing means 12.

  Further, the time information acquisition control unit 32 of the control unit 30 executes the picture code determination processing unit 32b when there is no code in the determination, or when the storage control processing to the storage processing unit 12 is completed, The encoded stream receiving means 10 controls to receive the next moving image stream on the same channel or different channels.

  Next, the channel circulation control unit 34 of the control unit 30 causes the module control unit 34e to execute the time prediction / channel selection processing unit 34a, and the time prediction / channel selection unit 120 selects a specific channel from the representative image collection target channel. Control to select.

  Further, the channel patrol control unit 34 of the control means 30 controls the module control unit 34 e to execute the system time acquisition processing unit 34 b and acquire the system time with reference to the system clock 14.

  Further, the channel circulation control unit 34 of the control unit 30 causes the module control unit 34e to execute the time determination processing unit 34c, and the system time acquired by the system time acquisition processing unit 34b is the frame in the specific channel. It is determined whether or not it is the predicted reception time of the code of the inner coded picture.

  Then, the channel cyclic control unit 34 of the control unit 30 causes the module control unit 34e to execute the stream reception processing unit 34d, and the time determination processing unit 34c sets the system time to the intra-frame coded picture in the specific channel. When it is determined that the predicted reception time of the code is reached, the encoded stream receiving unit 10 is adjusted to a specific channel, and control is performed to receive and output a moving image stream on the specific channel. Accordingly, since the code of the output moving image stream to be output includes the code of the intra-frame coded picture, the representative image can be generated by the external apparatus that has received the output moving image stream.

(About processing procedure)
Next, various processing procedures in the moving image receiving apparatus 1 having the above-described configuration will be described with reference to FIGS. FIG. 7 is a flowchart showing an example of the entire processing procedure of the moving image receiving apparatus according to this embodiment. FIG. 8 is a flowchart showing an example of a detailed processing procedure of the moving image receiving apparatus according to the present embodiment.
First, the entire process will be described, and then each detailed process (code reception time prediction step, channel selection control step, cyclic control step) will be described.

(Overall processing)
The moving image stream is received by the moving image receiving apparatus 1 by the encoded stream receiving means 10 of FIG. 1 (step S101 shown in FIG. 7). If the code of the intra-frame coded picture exists in the code in the stream (step S102 shown in FIG. 7), the reception time of the code of the intra-frame coded picture is acquired with reference to the system clock 14. The reception time and the PTS of the picture are stored in the accumulation processing means 12 (step S103 shown in FIG. 7).

  Then, the time prediction / channel selection unit 20 in FIG. 1 receives the intra-frame coded pictures after the current time for each of the representative image collection target channels from the values in FIG. 6 stored in the accumulation processing unit 12. Time is predicted, and a channel to which the encoded stream receiving means 10 is matched is selected based on the predicted reception time (step S104 shown in FIG. 7).

  In the present embodiment, it is assumed that the time is obtained in units of seconds. However, the unit time and the notation format of the time are not limited in applying the present invention.

  Also, the values shown in FIG. 6 are values obtained by the encoded stream receiving means 10 appropriately circulating through the channels being broadcast, and the code reception times and PTSs for all intra-frame encoded pictures in each channel. For example, the intraframe coded picture in which the code reception time and the PTS (0:00 and 0:05) are first obtained in the channel 1 in FIG. 6 is the picture “101” in FIG. "Intra-frame coded pictures for which the second code reception time and PTS (0:11 and 0:17) are obtained are in the frame following the intra-frame coded picture" 101 "in FIG. It is not necessarily the encoded picture “107”.

(Code reception time prediction step)
Here, a more detailed processing procedure of step S104 will be described with reference to FIG.
First, an interval value (PTS interval value) of the reproduction time information that is an increment of the value of each reproduction time information (PTS) is predicted, and based on the predicted reproduction time information interval value and the previous reproduction time information. A first prediction step (for example, a step consisting of step S210 and step S211 shown in FIG. 8) for predicting the reproduction time information (PTS) of the intra-frame coded picture after the present is performed.

  Here, as an example of the prediction method of the PTS interval value using the increment of the PTS value of the intra-frame coded picture of each channel shown in FIG. 6, there is a method of using the common divisor of the increment.

  That is, using the increment of the PTS value of the intra-frame coded picture of each channel, the common divisor of the increment is predicted as the PTS interval value of the intra-frame coded picture (step S210) <PTS interval value prediction process Step or PTS interval value prediction function>.

More specifically, in the example shown in FIG. 6, regarding the channel 1, when the increment of the PTS of the intra-frame coded picture is calculated,
0: 17-0: 05 = 0: 12,
0: 35-0: 17 = 0: 18,
0: 59-0: 35 = 0: 24,
(Step S210a) <PTS increment calculation processing step or PTS increment calculation function>.

  Therefore, when the common divisor of the increment is calculated, it becomes 0:06 (step S210b) <common divisor calculation processing step or common divisor calculation function>. Here, 0:06 of the common divisor is predicted as the PTS interval value of the intra-frame coded picture, and 0:06 is the predicted PTS interval value.

  Here, when the PTS interval value prediction process in step S210 is performed for one channel and then for another channel, the process may be returned to step S210 again after step S213 described below is completed. This step S210 may be repeated for other channels.

In any case, as in the case of channel 1, in the example shown in FIG. 6, when the PTS increment calculation processing step of step S210a is performed for channel 2, and the PTS increment of the intra-frame coded picture is calculated, Respectively,
0: 10-0: 03 = 0: 07,
0: 31-0: 10 = 0: 21,
0: 45-0: 31 = 0: 14,
It becomes. For this reason, when the common divisor calculation processing step of step S210b is performed for channel 2 and the common divisor of the increment is calculated, 0:07 is obtained. Therefore, for channel 2, 0:07 is the predicted PTS interval value of the intra-frame coded picture.

Similarly, in the example shown in FIG. 6, when the PTS increment calculation processing step of Step S210a is performed for the channel m and the PTS increment of the intra-frame coded picture is calculated,
0: 23-0: 07 = 0: 16,
0: 35-0: 23 = 0: 12,
0: 51-0: 35 = 0: 16,
It becomes. Therefore, when the common divisor calculation processing step of step S210b is performed for the channel m and the common divisor of the increment is calculated, 0:04 is obtained. Therefore, for channel m, 0:04 is the predicted PTS interval value for intra-frame coded pictures.

  Next, by adding a natural number multiple of the predicted PTS interval value in the PTS interval value prediction unit 22a to the PTS of the intra-frame encoded picture stored in the latest past, the intra-frame encoding after the current time is added. A prediction value (prediction PTS) of the PTS of the picture is calculated (step S211) <PTS value prediction processing step or PTS value prediction function>.

More specifically, in the example shown in FIG. 6, regarding channel 1, assuming that the current time is 1:00, the PTS (intermediate past PTS) of the inter-frame coded picture stored in the latest past is 0. Therefore, when the predicted value of PTS interval 0:06 is multiplied by a natural number (n = 1) to 0:59 of the latest past PTS,
0: 59 + 0: 06 × 1 = 1: 05
(Step S211a) <Past PTS addition processing step or Past PTS addition function> This added value 1:05 is taken as a predicted PTS.

Further, for the natural number multiple (n = 2), the past PTS addition processing step of step S211a is performed,
0: 59 + 0: 06 × 2 = 1: 11, and 1:11 is the predicted PTS.

Further, for the natural number multiple (n = 3), the past PTS addition processing step of step S211a is performed,
0: 59 + 0: 06 × 3 = 1: 17, and 1:17 is set as the predicted PTS.

  Thereafter, similarly, the past PTS addition processing step of step S211a is performed until the natural number is multiplied (n = k). For example, in the natural number multiple (n = k), it is determined whether or not the predicted PTS has been calculated up to a preset natural number multiple (step S211b) <set natural number multiple determination processing step or set natural number multiple determination function >.

  In this determination process, when it is determined that the predicted PTS is not calculated for natural number multiple (n = k), the past PTS addition processing step of step S211a is performed. If it is determined that the predicted PTS is calculated at (n = k), the process proceeds to the next step.

Similarly, in the example shown in FIG. 6, regarding channel 2, assuming that the current time is 1:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 0:45. Therefore, when the natural number multiple (n = 3) of the predicted value 0:07 of the PTS interval is added to 0:45 of the latest past PTS,
0: 45 + 0: 07 × 3 = 1: 06
It becomes. This added value 1:06 is set as a predicted PTS.

Further, for the natural number multiple (n = 4), the past PTS addition processing step of step S211a is performed,
0: 45 + 0: 07 × 4 = 1: 13, and 1:13 is the predicted PTS.
Further, for the natural number multiple (n = 5), the past PTS addition processing step of step S211a is performed,
0: 45 + 0: 07 × 5 = 1: 20, and 1:20 is set as the predicted PTS.
Thereafter, the same calculation is performed.

Similarly, in the example illustrated in FIG. 6, regarding the channel m, when the current time is 1:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 0:51. Therefore, when a natural number multiple (n = 3) of the predicted value 0:04 of the PTS interval is added to 0:51 of the latest past PTS,
0: 51 + 0: 04 × 3 = 1: 03
It becomes. This added value 1:03 is set as a predicted PTS.

Further, for the natural number multiple (n = 4), the past PTS addition processing step of step S211a is performed,
0: 51 + 0: 04 × 4 = 1: 07, and 1:07 is the predicted PTS.
Further, for the natural number multiple (n = 5), the past PTS addition processing step of step S211a is performed,
0: 51 + 0: 04 × 5 = 1: 11, and 1:11 is set as the predicted PTS.
Thereafter, the same calculation is performed.

  In summary, assuming that the current time is 1:00, the predicted PTS for channel 1 is 1:05, 1:11, 1:17,. For channel 2, the predicted PTS is 1:06, 1:13, 1:20,. For channel m, the predicted PTS is 1:03, 1:07, 1:11,.

  Next, based on the predicted PTS interval value, a prediction difference value that is a difference between the code reception time and the PTS is predicted, and a prediction code reception time is predicted from the prediction difference value (for example, FIG. 8). Step S212 and step S213 shown in FIG.

  First, the difference between the reception time of the code of the intra-frame coded picture received after the current time and the PTS is predicted from the reception time of the code of the intra-frame coded picture received in the past and the PTS (step S212) <reception Time-PTS difference prediction processing step or reception time-PTS difference prediction function>.

As an example of the difference prediction method, a value obtained by adding a specific margin to the average value of the difference between the code reception time of the intra-frame encoded picture received in the past and the PTS, and the prediction calculated in step S211 For example, a calculation method for calculating a predicted value of the code reception time of an intra-frame coded picture based on a difference from PTS can be used.
In this case, in the second prediction step, a value obtained by adding a specific margin to an average value of differences between the past code reception time and the reproduction time information is used as the intra-frame coded picture received after the present. It can also be predicted that this is the difference between the code reception time and the reproduction time information.

More specifically, in the example shown in FIG. 6, with respect to channel 1, if the difference between the code reception time of the intra-frame coded picture and the PTS is calculated,
0: 05-0: 00 = 0: 05,
0: 17-0: 11 = 0: 06,
0: 35-0: 31 = 0: 04,
0: 59-0: 54 = 0: 05,
<Difference calculation step or difference calculation function>
And when calculating the average of these differences,
(0: 05 + 0: 06 + 0: 04 + 0: 05) / 4 = 0: 05 (step S211a) <difference average value calculation processing step or difference average value calculation function>.

  Furthermore, a specific margin added to the difference average value in this embodiment is set to 0:01 (step S211b) <margin setting processing step or margin setting processing function>.

Therefore, when the prediction value of the code reception time of the intra-frame coded picture is calculated based on the prediction PTS, the difference average value of the step S212a, and the specific margin of the step S211b for the channel 1,
1: 05- (0: 05 + 0: 01) = 0: 59,
1: 11- (0: 05 + 0: 01) = 1: 05,
1: 17- (0: 05 + 0: 01) = 1: 11,...
(Step S213) <Reception Time Prediction Value Calculation Processing Step or Reception Time Prediction Value Calculation Function>

  For this reason, the predicted value of the code reception time of the intra-frame coded picture after the current (1:00) is 1: 05 + 0: 06 × (n−1) (n is a natural number).

Similarly, in the example shown in FIG. 6, the difference average value calculation processing step of step S211a is performed for channel 2. First, when calculating the difference between the code reception time of the intra-frame coded picture and the PTS,
0: 03-0: 01 = 0: 02,
0: 10-0: 07 = 0: 03,
0: 31-0: 28 = 0: 03,
0: 45-0: 41 = 0: 04,
It becomes.
And when calculating the average of these differences,
(0: 02 + 0: 03 + 0: 03 + 0: 04) / 4 = 0: 03.

  Here, the specific margin added to the difference average value in the present embodiment is set to 0:01.

Therefore, with respect to channel 2, the reception of step S213 that calculates the predicted value of the code reception time of the intra-frame coded picture based on the predicted PTS, the difference average value of step S212a, and the specific margin of step S211b. When the time prediction value calculation processing step is performed,
1: 06- (0: 03 + 0: 01) = 1: 02,
1: 13- (0: 03 + 0: 01) = 1: 09,
1: 20- (0: 03 + 0: 01) = 1: 16, ...
It becomes.

  For this reason, the predicted value of the code reception time of the intra-frame coded pictures after the present is 1: 02 + 0: 07 × (n−1) (n is a natural number).

Similarly, in the example illustrated in FIG. 6, the difference average value calculation processing step of step S211a is performed for the channel m. First, when calculating the difference between the code reception time of the intra-frame coded picture and the PTS,
0: 07-0: 03 = 0: 04,
0: 23-0: 18 = 0: 05,
0: 35-0: 31 = 0: 04,
0: 51-0: 48 = 0: 03,
It becomes.
And when calculating the average of these differences,
(0: 04 + 0: 05 + 0: 04 + 0: 03) / 4 = 0: 04.

  Here, the specific margin added to the difference average value in the present embodiment is set to 0:01.

Therefore, the reception of step S213 for calculating the prediction value of the code reception time of the intra-frame coded picture based on the prediction PTS, the average difference value of step S212a, and the specific margin of step S211b for the channel m. When the time prediction value calculation processing step is performed,
1: 03- (0: 04 + 0: 01) = 0: 58,
1: 07- (0: 04 + 0: 01) = 1: 02,
1: 11- (0: 04 + 0: 01) = 1: 06,...
It becomes.

  For this reason, the predicted value of the code reception time of intra-frame encoded pictures after the present is 1: 02 + 0: 04 × (n−1) (n is a natural number).

  In this way, the prediction code reception time is calculated for each channel. Then, for example, it is determined whether or not there is another channel for which a predicted value has not been calculated (step S214) <prediction code reception time calculation availability determination processing step or prediction code reception time calculation availability determination function>.

  In this determination process, if there is another channel whose predicted code reception time has not been calculated, the process returns to step S210 to process each step. On the other hand, in this determination process, if there is no other channel for which the predicted code reception time has not been calculated, the process proceeds to the next step.

  Here, it is only an example that such a determination process (determining whether or not a process has been performed for another channel) is placed after the step S213, and it goes without saying that there are other various methods. For example, the processing may be performed in the subsequent stage of step S210, the subsequent stage of step S211, the subsequent stage of step S212, and the subsequent stage of step S213. Further, the subsequent stage of step S210a, the subsequent stage of step S210b, and the step S211a. Processing may be performed in the subsequent stage, the subsequent stage of step S211b, the subsequent stage of step S212a, the subsequent stage of step S212b, and the subsequent stage of step S213.

(Channel selection control step)
Next, detailed processing of the selection control step for selecting and determining the channel cyclic order based on the predicted code reception time for each channel will be described.

  In the channel selection control step, based on the prediction code reception time predicted in the code reception time prediction step, the channel circulation order is determined and channel selection is performed so that the representative image collection target channel circulation time is minimized. (Step consisting of Step S215 and Step S216).

  First, the time prediction / channel selection means 20 determines the channel cyclic order based on the predicted reception time of the intra-frame coded picture so that the representative image collection target channel cyclic time becomes the shortest, and the cyclic order is Channel selection is performed (step S215) <channel cyclic order determination processing step or channel cyclic order determination processing function>.

  As a method for determining the channel circulation order, for example, a combination optimization algorithm can be used.

  In this embodiment, an approximate solution of the channel circulation order is obtained by performing depth-first search by repeatedly selecting the representative image collection target channel.

  Further, in the channel selection control step, an evaluation value is calculated with respect to a channel selection order based on the prediction code reception time, and a channel is selected in descending order of the evaluation value. The channel selection order is determined by calculation based on the immediacy or collection time of the representative image to be collected. Further, in the channel selection control step, the evaluation value is calculated as a required traveling time for circulating the channel.

In the depth-first search, when a channel to be circulated next is selected, the following evaluation function F1 [first evaluation function] is selected for each unselected channel CH.

F1 (CH) = T_I (CH, T_P) -T_P [First evaluation function]

(Step S215a) <first evaluation function calculation processing step or first evaluation function calculation function>.

  Here, T_P is the predicted code reception time of the intra-frame coded picture in the channel selected immediately before. In addition, when the first cyclic channel is selected, T_P is set as the current time. Further, T_I (CH, T_P) is a predicted code reception time of an intra-frame coded picture received after the time T_P in the channel CH.

  When the next circulation target channel is selected, the first evaluation function F1 (1), F1 (2),..., F1 for each channel in the first evaluation function calculation processing step of step S215. Based on the calculation result of (m), an unselected channel with the minimum value of F1 (1), F1 (2),..., F1 (m) is selected (step S215b) <first channel Selection processing step or first channel selection function>.

  It is determined whether or not there are a plurality of unselected channels in which the values of the first evaluation functions F1 (1), F1 (2),..., F1 (m) are minimum (step S215c) <minimum value Channel number determination processing step or minimum value channel number determination function>.

If it is determined in step S215c that there are not a plurality of unselected channels that minimize the first evaluation function F1, the process proceeds to step S215f. On the other hand, if it is determined in step S215c that there are a plurality of unselected channels that minimize the first evaluation function F1, the following evaluation function F2 [second evaluation function]

F2 (CH) = T_II (CH, T_P) ... [second evaluation function]

(Step S215c) <second evaluation function calculation processing step or second evaluation function calculation function>.

  Here, T_II (CH, T_P) is the second predicted code reception time of the intra-frame coded picture received after the time T_P in the channel CH.

  Of the plurality of unselected channels with the first evaluation function F1 having the minimum value, the channel with the second evaluation function F2 having the maximum value is selected (step S215d) <the second channel selection processing step or the second Channel selection function>.

  In this way, the final channel cyclic order is determined based on the calculation results of the first evaluation function F1 and the second evaluation function F2 (step S215f) <order determination processing step or order determination function> .

More specifically, first, the encoded stream receiving unit 10 determines a channel to be matched first.
That is, in step S213, the prediction result obtained by the time prediction / channel selection means 20 is
For channel 1, 1: 05 + 0: 06 × (n−1) (n is a natural number),
For channel 2, 1: 02 + 0: 07 × (n−1) (n is a natural number),
For channel m: 1: 02 + 0: 04 × (n−1) (n is a natural number),
It is.

For this reason, the value of the first evaluation function F1 calculated in step S215a is
F1 (1) = 0: 05,
F1 (2) = 0: 02,
F1 (m) = 0: 02
It becomes.

Here, since F1 (2) = F1 (m), when the value of the second evaluation function F2 is calculated for the channel 2 and the channel m in the step S215d,
F2 (2) = 1: 09,
F2 (m) = 1: 06
It becomes. At this time, since F2 (2)> F2 (m), the first channel to be matched is determined as channel 2.

Next, the encoded channel receiving means 10 selects the second channel to be matched.
When the value of the first evaluation function F1 is calculated in step S215a for channel 1 and channel m that are not selected,
F1 (1) = 0: 03,
F1 (m) = 0: 04
It becomes.
At this time, since F1 (1) <F1 (m), the second channel to be matched is determined as channel 1.

  Accordingly, in step S215f, the final cyclic order is the order of channel 2, channel 1, and channel m.

(Patrol control step)
As a result of the above search, at times 1:02, 1:05, and 1:06, the encoded stream receiving means 10 is circulated so as to match channel 2, channel 1, and channel m, respectively, and the channels are selected in order. (Step S216) <Channel selection processing step or channel selection processing function>
In this step, when one channel is selected for patrol, steps S104, S105, S106, and S107 shown in FIG. 7 are repeated for the one channel, and the other channels to be selected next are shown in FIG. Steps S104, S105, S106, and S107 shown in FIG. 6 are repeated, and thereafter the processing is repeated for each channel in the same manner.

  First, the time prediction / channel selection means 20 selects channel 2 from the representative image collection target channels (step S104 in FIG. 7).

  The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is 1:02 which is a predicted reception time of a code of an intra-frame coded picture in channel 2 (step S106 in FIG. 7),

  The time prediction / channel selection means 20 sets the encoded stream reception means 10 to channel 2 to receive and output a moving picture stream in the channel 2 (step S107 in FIG. 7), and returns to step S104.

  Since the code of the output moving image stream includes the code of the intra-frame coded picture, the representative image can be generated by the external device that has received the output moving image stream.

  Next, channel 1 is selected from the representative image collection target channels that have not been collected (step S104 in FIG. 7).

  The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is 1:05 which is the predicted reception time of the code of the intra-frame coded picture in channel 1 (step S106 in FIG. 7), the time prediction / channel selection unit 20 sets the encoded stream reception unit 10 to In accordance with channel 1, the moving image stream is received and output in channel 1 (step S107 in FIG. 7), and the process returns to step S104.

  Next, the channel m is selected from the representative image collection target channels that have not been collected (step S104 in FIG. 7). The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is 1:06 which is the predicted reception time of the code of the intra-frame coded picture in the channel m (step S106 in FIG. 7), the time prediction / channel selection unit 20 sets the encoded stream reception unit 10 to In accordance with the channel m, the moving image stream is received and output in the channel m (step S107 in FIG. 7), and the process returns to step S104. Since the image encoded stream has been received, the processing is completed.

(About effect)
As described above, according to the present embodiment, it is possible to achieve the same operational effects as the first embodiment.
Here, without using the moving picture receiving apparatus according to the present embodiment, an intra-frame coded picture that can be independently decoded and can be used for representative image generation in the order of channel 1, channel 2, and channel m is obtained. In this case, when the code of the intra-frame coded picture is received at the prediction time, the reception time of the code of the intra-frame decoded picture is 1:05, 1:09, 1:10, and the representative image collection command input Takes 10 seconds.

  On the other hand, when the moving image receiving apparatus of this embodiment is used, the representative image collection is completed in 6 seconds from the representative image collection command, and in this embodiment, the representative image collection time is shortened by 4 seconds. Has been.

  In the present embodiment, when the genre of the broadcast content is known by the specialization of the broadcast content of each channel due to the multi-channel, but the details of the broadcast content are unknown, the representative image collection target among the channels being broadcast By specifying the channel, the time required for collecting the representative image is reflected while reflecting the intention of the viewer who collects the representative image by the moving image receiving apparatus 100, the number of moving image stream receiving means is reduced, and the transmission path of the moving image stream The effect of suppressing the necessary bandwidth is obtained.

  Since the PTS interval value of adjacent intra-frame encoded pictures in the same moving image stream as the PTS history of intra-frame encoded pictures received in the past is constant, the PTS of intra-frame encoded pictures after the present is determined. Predict accurately, predict the difference between the code reception time of the intra-frame coded picture received in the past and the PTS history from the code reception time of the current intra-frame coded picture and the PTS. By predicting the code reception times of the current and subsequent intra-frame coded pictures by reducing the prediction difference, it is possible to obtain an effect of realizing high accuracy of prediction of the code reception times of the current and subsequent intra-frame coded pictures. .

  By using the common divisor of the increment of the PTS of the intra-frame coded picture received in the past in the prediction of the PTS of the intra-frame coded picture after the present, the adjacent intra-frame code in the same moving image stream in the history Even if the PTS of the coded picture is not obtained, the effect of predicting the interval value of the PTS of the temporally adjacent intra-frame coded pictures in the same moving picture stream with high accuracy can be obtained.

  By predicting the difference between the code reception time of the intra-frame coded picture and the PTS after the present, by adding a predetermined margin to the average value of the difference between the code reception time of the intra-frame coded picture received in the past and the PTS, While accurately performing the prediction, the intra-frame coded picture that was attempted to be received because the code of the picture arrived at the moving picture receiving apparatus before the predicted code reception time of the intra-frame coded picture after the present is missed. The effect which implement | achieves reduction of the probability which will be acquired is acquired.

  By matching the channel of the coded stream receiving means to the predicted code reception time, an effect of shortening the time from channel matching to code reception of the intra-frame coded picture can be obtained.

  Furthermore, by determining the cyclic order of the representative image collection target channel from the prediction code reception time by the combinational optimization algorithm, an effect of shortening the time required for the channel circulation for collecting the representative image can be obtained.

  In this embodiment, the depth-first search based on the evaluation function calculated from the prediction code reception time of the intra-frame coded picture is used for the combination optimization, but the combination of the simulated annealing method and the genetic algorithm is used. It is also possible to use optimization techniques.

  In addition, as a moving image receiving apparatus, a receiving unit that receives a moving image stream transmitted through a plurality of channels in a fragmented manner while switching channels, particularly when a moving image stream that has been inter-frame prediction encoded is transmitted. Therefore, it is possible to receive the stream of each channel in a short time without increasing the processing capacity and the amount of communication required.

  The prediction of the code reception time of the intra-frame coded picture is performed in consideration of the PTS or DTS having the periodicity of the time interval. Therefore, the prediction accuracy is higher than when prediction is performed based only on the code reception time of the intra-frame coded picture. Can be improved.

  Other configurations, other steps, and operational effects thereof are the same as those in the first embodiment described above. In the above description, the operation content of each step described above and the components of each unit may be programmed and executed by a computer.

[Third Embodiment]
Next, a third embodiment according to the present invention will be described with reference to FIG. In the following, description of the substantially similar configuration of the first embodiment will be omitted, and only different parts will be described. FIG. 9 is a block diagram showing an example of the third embodiment of the moving image receiving apparatus of the present invention.

In the present embodiment, the second prediction unit 124 performs prediction using the histogram, and the channel selection unit 126 uses the third evaluation function in addition to the first and second evaluation functions to perform channel estimation. The selection is made. This will be described in detail below.
(About configuration)
First, a detailed configuration of the moving image receiving apparatus 1 will be described with reference to FIG. FIG. 9 is a block diagram illustrating an example of a detailed configuration of the time prediction / channel selection unit in the moving image receiving apparatus of the present embodiment.

The moving picture receiving apparatus of the present embodiment discloses an example in which the time prediction / channel selection means 20 in FIG. 1 is configured as the time prediction / channel selection means 120 shown in FIG. The configuration is the same as that of the first embodiment.
(Time prediction / channel selection means)
In FIG. 9, the time prediction / channel selection means 120 includes a first prediction unit 122, a second prediction unit 124, a prediction calculation module control unit 125, and a channel selection unit 126. .

  The first prediction unit 122 predicts the reproduction time of the intra-frame coded picture after the current time based on the previous reproduction time.

  Further, the first prediction unit 122 predicts a minimum increment of each reproduction time information value as an interval value of the reproduction time information, and the predicted reception time information interval value and the frame received last. The reproduction time information of the intra-frame coded picture after the current time is predicted based on the reproduction time information of the inner-coded picture. The first prediction unit 122 can also be referred to as first prediction means.

More specifically, the first prediction unit 22 uses the increment of the PTS value of the intra-frame coded picture received in the past in the specific channel, and sets the minimum value of the increment to the intra-frame coded picture. A PTS interval value predicting unit 122a that predicts the PTS interval value of
By adding a natural number multiple of the PTS interval value in the PTS interval value prediction unit 122a to the PTS of the intra-frame coded picture stored (last received) in the latest past, And a PTS value prediction unit 122b that calculates a predicted value of the PTS of the intra-frame coded picture.

  The PTS interval value prediction unit 122a includes a PTS increment calculation unit 122a-1 that calculates an increment of the PTS value of the intra-frame coded picture of each channel, and among the increments calculated by the PTS increment calculation unit 122a-1. And a minimum value calculation unit 122a-2 that calculates a numerical value (predicted PTS interval value) that becomes the minimum value.

  The PTS value predicting unit 122b is a natural number multiple determining unit that determines a natural number multiple as to which prediction value is to be calculated, and a numerical value (predicted PTS) of the minimum value calculated by the minimum value calculating unit 122a. A past PTS adding unit that multiplies the interval value) by the natural number multiple determined by the natural number multiple determining unit and adds the PTS value of the intra-frame coded picture stored in the past to the interval value) .

  The second prediction unit 124 predicts the code reception time based on the predicted reproduction time predicted by the first prediction unit 122.

  Further, the second prediction unit 124, based on the code reception time and the reproduction time information of the intra-frame coded picture received in the past, the intra-frame coded picture received after the present. A difference between the code reception time and the reproduction time information is predicted, and based on the predicted difference and the reproduction time information predicted by the first prediction unit 122, the current and subsequent intra-frame coded pictures The code reception time is predicted.

  Further, the second prediction unit 124 generates a histogram of the difference between the past code reception time and the reproduction time information, and selects a percentage point class having a cumulative probability equal to or higher than a specific percentage from the histogram. The representative value of this class is predicted to be a difference between the code reception time of the intra-frame coded picture received after the present time and the reproduction time information. The second prediction unit 124 can also be referred to as second prediction means.

  The second prediction unit 124 calculates the difference between the code reception time of the code of the intra-frame coded picture received in the past and the PTS from the code reception time of the code of the intra-frame coded picture received after the present and the PTS. Predicted reception time-PTS difference prediction unit 124a, prediction difference value calculated by reception time-PTS difference prediction unit 124a, and prediction value of PTS of intra-frame coded picture after current time And a reception time prediction value calculation unit 124b that calculates a prediction value of the code reception time of the coded picture.

  The reception time-PTS difference prediction unit 124a includes a difference histogram calculation unit 124a-1 for calculating and generating a histogram of the difference between the code reception time of the code of the intra-frame coded picture received in the past and the PTS, and the difference histogram calculation unit A percent point calculation unit 124a-2 for performing a calculation for selecting a class of percentage points at which the cumulative probability is equal to or higher than a specific percentage from the histogram generated by calculation at 124a-1, and the percent point calculation unit 124a-2. The representative value of the percentage point class calculated in step (b) is calculated, and this representative value is predicted to be the difference between the code reception time and the reproduction time information of the intra-frame encoded picture received after the present. A prediction difference value determination unit 124a-3.

  The prediction calculation module control unit 125 controls the execution procedure of each unit. For example, in the process of calculating the prediction value of the code reception time of the intra-frame coded picture for one channel, for example, while performing the operation of the second prediction unit, the intra-frame coded picture for the other channel A function for controlling the first prediction unit to perform the calculation in the process of calculating the predicted value of the code reception time is assumed.

  Based on the prediction code reception time predicted by the second prediction unit 124 included in the code reception time prediction unit, the channel selection unit 126 sets the channel circulation order so that the representative image collection target channel circulation time becomes the shortest. It is determined and channel selection is performed. The channel selection unit 126 can also be referred to as channel selection control means.

  Further, the channel selection unit 126 can obtain an approximate solution of the channel circulation order by repeatedly selecting a representative image collection target channel and performing a depth-first search. The channel selection unit 126 calculates an evaluation value with respect to a channel selection order based on the prediction code reception time, selects a channel in order from the highest evaluation value, and the evaluation value is collected. The selection order of channels can be determined by calculating based on the immediacy or collection time of representative images. At that time, the channel selection unit 126 can calculate the evaluation value as a required traveling time for circulating the channel.

  The channel selection unit 126 is based on the channel cyclic order determination processing unit 126a that determines the channel cyclic order of the representative image collection target channel based on the prediction code reception time, and the channel cyclic order determined by the channel cyclic order determination processing unit 26a. And a channel selection processing unit 126b that performs processing necessary for channel circulation.

  The channel cyclic order determination processing unit 126a calculates the third evaluation function calculation unit 126a-5 that calculates the third evaluation function F3 for determining the cyclic order of unselected channels, and the calculation result of the third evaluation function F3. A first evaluation function calculation unit 126a-1 for calculating a first evaluation function F1 for determining a cyclic order among channels having the same value when there are a plurality of unselected channels having the same value; Based on the first evaluation function calculation result calculated by the first evaluation function calculation unit 126a-1, the priority of the cyclic order from among the channels in which the calculation result of the third evaluation function F3 has the same value. And a first unselected channel selection unit 126a-2 that performs selection control for determining the channel number.

  Further, the channel cyclic order determination processing unit 126a determines the priority of the cyclic order among the channels having the same value when there are a plurality of unselected channels having the same calculation result of the first evaluation function F1. Based on the second evaluation function calculation unit 126a-3 for calculating the second evaluation function F2 and the second evaluation function calculation result calculated by the second evaluation function calculation unit 126a-3, Second unselected channel selection unit for performing selection control for determining a cyclic order from channels in which the calculation result of the third evaluation function F3 is the same and the calculation result of the first evaluation function F1 is the same value 126a-4.

  Further, the channel cyclic order determination processing unit 126a assigns the priority of the channel cyclic order to each unselected channel based on the calculation result of the third evaluation function F3 calculated by the third evaluation function calculation unit 126a-5. And the priority of the third evaluation function F3, the priority of the first unselected channel selection unit 126a-2, and the priority of the second unselected channel selection unit 126a-4. In consideration, the channel priority determination unit 126a-6 that determines the priority of the final cyclic order and the channel determination processing control unit 126a-7 that controls the execution procedure of each unit are configured. The

The third evaluation function calculator 126a-5 defines the third image defined as follows based on the difference between the PTS (or DTS) of the intra-frame coded picture and the current time for the representative image collection target channel CH. The evaluation function F3 (CH) is calculated.
That is, the third evaluation function F3 (CH) in a specific channel (CH) is
If representative image collection has not been performed in the past, F3 (CH) = ∞,
If representative image collection has been performed in the past, F3 (CH) = T_C−T_Prv (CH)
It is defined as
Here, T_C indicates the current time. T_Prv (CH) indicates the PTS (or DTS) of the representative image collected in the past in the channel CH.

  The channel priority determination unit 126a-6 uses the third evaluation function F3 (CH), the first evaluation function F1 (CH), and the priority set using the second evaluation function F2 (CH). Select channels in descending order. More specifically, the priority P (CH) in the channel CH is set so as to increase as the channel having the larger F3 (CH). When there are a plurality of channels having the same value of F3 (CH), F1 ( The channel is set to be higher as the channel is larger. Further, when there are a plurality of channels having the same value of F1 (CH), the channel is set to be higher as the channel has a larger F2 (CH).

  Thus, the channel selection unit 126 can also be called channel selection control means. This channel selection control means uses the current time as T_C and a representative image collected in the past in the channel (CH) based on the difference between the predicted playback time information or decoding time information of the intra-frame coded picture and the current time. If the predicted reproduction time information or decoding time information of the intra-frame coded picture is T_Prv (CH), the third evaluation function F3 (CH) is collected for the representative image collection target channel (CH). Is performed in the past, F3 (CH) = T_C−T_Prv (CH). If representative image collection has not been performed in the past, F3 (CH) = ∞ is calculated, and the third evaluation function F3 is calculated. A value with a large calculation result value is set as a channel selection with a high priority, and the channels are selected and controlled in descending order of the priority.

  Further, the channel selection control means is set such that, when there are a plurality of channels having the same calculation result of the third evaluation function F3, the higher the priority is, the higher the channel of the first evaluation function F1 is. To do.

  Further, when the channel selection control means uses the third evaluation function F3 to set the priority, when there are a plurality of channels having the same calculation result of the first evaluation function F1, The channel is set so that the higher the priority is, the larger the calculation result of the second evaluation function F2.

  The time prediction / channel selection means 20 of the moving image receiving apparatus 1 having the above-described configuration operates generally as follows. That is, the prediction calculation module control unit 125 of the time prediction / channel selection unit 120 executes the first prediction unit 122 and the second prediction unit 124 for one channel, and receives a prediction code of an intra-frame coded picture. Time and predicted PTS are calculated. Similarly, the prediction calculation module control unit 125 executes the first prediction unit 122 and the second prediction unit 124 for other channels, and calculates the prediction code reception time and the prediction PTS of the intra-frame coded picture. .

  Specifically, the first prediction unit 122 causes the PTS interval value prediction unit 122a to execute and use the increment of the PTS value of the intra-frame coded picture to set the minimum value of the increment to the intra-frame coded picture. As an interval value of the PTS, it is predicted.

  Subsequently, the first predicting unit 122 causes the PTS value predicting unit 122b to execute the PTS of the intra-frame coded picture stored in the past in the interval of the PTS in the PTS interval value predicting unit 122a. By adding the natural number multiple, the predicted value of the PTS of the intra-frame coded picture after the current time is calculated.

  Further, the second prediction unit 124 causes the reception time-PTS difference prediction unit 124a to execute intra-frame reception from the present time onward based on the code reception time of the code of the intra-frame coded picture received in the past and the PTS. The difference between the code reception time of the code of the encoded picture and the PTS is predicted.

  Specifically, the reception time-PTS difference prediction unit 124a of the second prediction unit 124 generates a histogram of the difference between the past code reception time and the reproduction time information, and the cumulative probability of the histogram is specified. A percentage point class that is equal to or greater than the percentage is selected, and a representative value of this class is predicted to be a difference between the code reception time of the intra-frame coded picture received after the present and the reproduction time information. .

  Then, the reception time predicted value calculation unit 124b of the second prediction unit 124 receives the value obtained by multiplying the prediction difference value calculated by the reception time-PTS difference prediction unit 124a by a natural number, and intra-frame coding after the current time. By adding the predicted value of the PTS of the picture, the predicted value of the code reception time of the intra-frame coded picture is calculated.

  In this way, when the prediction code reception time and the prediction PTS of the intra-frame coded picture are calculated for each channel, the time prediction / channel selection unit 120 causes the channel selection unit 126 to execute the channel cyclic order. Make a decision.

  Specifically, the channel cyclic order determination processing unit 126a of the channel selection unit 126 causes the channel determination processing control unit 126a-7 to execute, and first, for each channel, the third evaluation function calculation unit 126a-5 performs the third evaluation function calculation unit 126a-5. The evaluation function F3 is calculated, and the channel priority determination unit 126a-6 assigns a higher priority to a channel with a larger value among the values of the third evaluation function F3 of each channel.

  At this time, the channel determination processing control unit 126a-7 determines that the channel priority determination unit 126a-6 determines that there are a plurality of channels having the same value of the third evaluation function F3. The first evaluation function F1 is calculated for a plurality of the same channels.

  Then, the channel determination processing control unit 126a-7 causes the first unselected channel selection unit 126a-2 to execute and prioritizes the channel having the smallest first evaluation function F1 as the channel to be selected first. Determine the degree.

  At this time, the channel determination processing control unit 126a-7 determines that the first unselected channel selection unit 126a-2 has a plurality of channels having the same value of the first evaluation function F1. Then, the second evaluation function calculation unit 126a-3 is executed to calculate the second evaluation function F2 for the same plurality of channels.

  Then, the channel determination processing control unit 126a-7 causes the second unselected channel selection unit 126a-4 to execute and prioritizes the channel having the maximum second evaluation function F2 as the channel to be selected first. Determine the degree.

  In this manner, the channel determination processing control unit 126a-7 causes the channel priority determination unit 126a-6 to execute, and the first unselected channel selection unit 126a together with the priority based on the calculation result of the third evaluation function F3. Considering the priority at -2 and the priority at the second unselected channel selector 126a-4, final priority assignment (determination of the cyclic order) in the channel cyclic order is performed.

(About processing procedure)
Next, various processing procedures in the moving image receiving apparatus 1 having the above-described configuration will be described with reference to FIGS. 10 to 13. FIG. 13 is a flowchart illustrating an example of a detailed processing procedure of the moving image receiving apparatus according to the present embodiment.
In the processing procedure of the present embodiment, the entire process is the same as that of the first embodiment, and will be omitted, and each detailed process (prediction step, selection control step, cyclic control step) will be described.

  Here, the preconditions in the present embodiment will be described. The moving image receiving apparatus 1 in FIG. 1 receives the m moving image stream examples in FIGS. 4 and 5 (m is a natural number of 4 or more), and the representative image collection target channels are channel 1, channel 2, and channel. 3. Assume that channel m is specified.

  Further, as a result of applying steps S101 to S103 of FIG. 7 to the moving image stream, the reception time and PTS of the code of the past intra-frame coded picture stored in the storage processing means 12 of the moving image receiving apparatus are obtained. It is assumed that it is obtained as shown in FIG.

  Here, the time at the time of inputting the representative image collection command is 3:00, and the time is the current time.

  Of the representative image collection target channels, channel 1, channel 2, and channel m have been collected in the past as reception images and PTS intra-frame coded pictures shown in white in FIG. It is assumed that the representative image has not been collected for the channel 3 in the past.

(Code reception time prediction step)
Details of the intra-frame encoded picture reception time prediction / channel selection processing in step S104 of FIG. 7 will be described with reference to FIG.
In this code reception time prediction step, the minimum increment of each reproduction time information value is predicted as an interval value of the reproduction time information, and the predicted reproduction time information interval value and the last received intraframe code A first prediction step (step consisting of step S310 and step S311 shown in FIG. 13) in which the reproduction time information of the intra-frame coded picture after the current time is predicted based on the reproduction time information of the encoded picture. I do.

  First, the time prediction / channel selection means 120 predicts the PTS of the intra-frame coded picture received after the current time from the PTS of the intra-frame coded picture received in the past for each of the representative image collection target channels. Then, the reception time of the code of the intra-frame encoded picture received after the current time from the prediction PTS is predicted.

  More specifically, as a technique for predicting the PTS of an intra-frame coded picture received after the current time for each of the representative image collection target channels, the following technique may be mentioned. For example, the minimum value of the PTS increment of the intra-frame coded picture received in the past is predicted as the PTS interval value of the intra-frame encoded picture in the channel, and the natural number multiple of the PTS interval value is received last. There is a method of adding to the PTS of the encoded intra-frame picture.

  Here, using the increment of the PTS value of the intra-frame coded picture of each channel, the minimum value of the increment is predicted as the PTS interval value of the intra-frame coded picture (step S310) <PTS interval value prediction Processing step or PTS interval value prediction function>.

More specifically, in the example shown in FIG. 11, regarding the channel 1, when the increment of the PTS of the intra-frame coded picture is calculated,
0: 23-0: 11 = 0: 12
0: 47-0: 23 = 0: 24,
0: 53-0: 47 = 0: 06,
0: 59-0: 53 = 0: 06,
1: 29-0: 59 = 0: 30
1: 53-1: 29 = 0: 24,
2: 17-1: 53 = 0: 24,
2: 35-2: 17 = 0: 18,
2: 47-2: 35 = 0: 12
(Step S310a) <PTS increment calculation processing step or PTS increment calculation function>.

  Therefore, when the minimum value of the increment is calculated, it becomes 0:06 (step S310b) <minimum value calculation processing step or minimum value calculation function>. Here, the minimum value 0:06 is predicted as the PTS interval value of the intra-frame coded picture, and 0:06 is the predicted PTS interval value.

Similarly, in the example shown in FIG. 11, when the PTS increment calculation processing step of step S310a is performed for channel 2, and the PTS increment of the intra-frame coded picture is calculated,
0: 34-0: 13 = 0: 21,
0: 48-0: 34 = 0: 14,
1: 44-0: 48 = 0: 58,
2: 05-1: 44 = 0: 21,
2: 12-2: 05 = 0: 07,
2: 19-2: 12 = 0: 07,
2: 33-2: 19 = 0: 14,
2: 47-2: 33 = 0: 14,
3: 01-2: 47 = 0: 14
It becomes. Therefore, when the minimum value calculation processing step of step S310b is performed for channel 2 and the minimum value of the increment is calculated, 0:07 is obtained. Therefore, for channel 2, 0:07 is the predicted PTS interval value of the intra-frame coded picture.

Similarly, in the example shown in FIG. 11, when the PTS increment calculation processing step of step S310a is performed for channel 3, and the PTS increment of the intra-frame coded picture is calculated,
0: 28-0: 13 = 0: 15,
0: 48-0: 28 = 0: 20,
1: 03-0: 48 = 0: 15,
1: 28-1: 03 = 0: 25,
1: 48-1: 28 = 0: 20,
2: 08-1: 48 = 0: 20,
2: 28-2: 08 = 0: 20,
2: 33-2: 28 = 0: 05,
2: 48-2: 33 = 0: 15,
It becomes. Therefore, when the minimum value calculation processing step of step S310b is performed for channel 3, and the minimum value of the increment is calculated, 0:05 is obtained. Therefore, for channel 3, 0:05 is the predicted PTS interval value of the intra-frame coded picture.

Similarly, in the example shown in FIG. 11, when the PTS increment calculation processing step of step S310a is performed for the channel m and the PTS increment of the intra-frame coded picture is calculated,
0: 17-0: 13 = 0: 04,
0: 37-0: 17 = 0: 20,
0: 53-0: 37 = 0: 16,
1: 13-0: 53 = 0: 20,
1: 33-1: 13 = 0: 20,
1: 53-1: 33 = 0: 20,
2: 17-1: 53 = 0: 24,
2: 37-2: 17 = 0: 20,
3: 01-2: 37 = 0: 24,
It becomes. Therefore, when the minimum value calculation processing step of step S310b is performed for the channel m and the minimum value of the increment is calculated, 0:04 is obtained. Therefore, for channel m, 0:04 is the predicted PTS interval value for intra-frame coded pictures.

  Thus, in the example of FIG. 11, the predicted PTS interval values of the intra-frame coded pictures in channel 1, channel 2, channel 3, and channel m are 0:06, 0:07, 0:05, and 0:04, respectively. It becomes.

  Next, by adding a natural number multiple of the predicted PTS interval value in the PTS interval value prediction unit 122a to the PTS of the intra-frame encoded picture stored in the latest past, the intra-frame encoding after the current time is added. A prediction value (prediction PTS) of the PTS of the picture is calculated (step S311) <PTS value prediction processing step or PTS value prediction function>.

More specifically, in the example shown in FIG. 11, regarding the channel 1, assuming that the current time is 3:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 2 Therefore, if the natural number multiple (n = 3) of the predicted value 0:06 of the PTS interval is added to 2:47 of the latest past PTS,
2: 47 + 0: 06 × 3 = 3: 05
<Past PTS addition processing step or past PTS addition function> This added value 3:05 is set as a predicted PTS.

Furthermore, the past PTS addition processing step is performed for natural number multiples (n = 4),
2: 47 + 0: 06 × 4 = 3: 11, and 3:11 is the predicted PTS.

Furthermore, the past PTS addition processing step is performed for natural number multiples (n = 5),
2: 47 + 0: 06 × 5 = 3: 17, and 3:17 is set as the predicted PTS.

  Thereafter, the past PTS addition processing step is performed in the same manner until the natural number is multiplied (n = k). For example, it is determined whether or not the predicted PTS has been calculated up to a preset natural number multiple at a natural number multiple (n = k) <set natural number multiple determination processing step or set natural number multiple determination function>.

  In this determination process, when it is determined that the predicted PTS is not calculated at a natural number multiple (n = k), a past PTS addition processing step is performed. In this determination process, the natural number multiple (n = k) If it is determined in k) that the predicted PTS has been calculated, the process proceeds to the next step.

Similarly, in the example shown in FIG. 11, regarding channel 2, assuming that the current time is 3:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 2:47. Therefore, when the natural number multiple (n = 2) of the predicted value 0:07 of the PTS interval is added to 2:47 of the latest past PTS,
2: 47 + 0: 07 × 2 = 3: 01
It becomes. This added value 3:01 is set as a predicted PTS.

Further, the past PTS addition processing step is performed for natural number multiples (n = 3),
2: 47 + 0: 07 × 3 = 3: 08, and 3:08 is the predicted PTS.
Further, the past PTS addition processing step is performed for natural number multiples (n = 3),
2: 47 + 0: 07 × 4 = 3: 15, and 3:15 is the predicted PTS.
Thereafter, the same calculation is performed.

Similarly, in the example shown in FIG. 11, regarding the channel 3, when the current time is 3:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 2:48. Therefore, if a natural number multiple (n = 3) of the predicted value 0:05 of the PTS interval is added to 2:48 of the latest past PTS,
2: 48 + 0: 05 × 3 = 3: 03
It becomes. This added value 3:03 is set as a predicted PTS.

Furthermore, the past PTS addition processing step is performed for natural number multiples (n = 4),
2: 48 + 0: 05 × 4 = 3: 08, and 3:08 is the predicted PTS.
Furthermore, the past PTS addition processing step is performed for natural number multiples (n = 5),
2: 48 + 0: 05 × 5 = 3: 13, and 3:13 is the predicted PTS.
Thereafter, the same calculation is performed.

Similarly, in the example shown in FIG. 11, regarding the channel m, if the current time is 3:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 2:37. Therefore, when the natural number multiple (n = 6) of the predicted value 0:04 of the PTS interval is added to 2:37 of the latest past PTS,
2: 37 + 0: 04 × 6 = 3: 01
It becomes. This added value 3:01 is set as a predicted PTS.

Further, the past PTS addition processing step is performed for natural number multiples (n = 7),
2: 37 + 0: 04 × 7 = 3: 05, and the past PTS addition processing step is also performed for natural number multiples (n = 8),
2: 37 + 0: 04 × 8 = 3: 09, and 3:09 is the predicted PTS.
Thereafter, the same calculation is performed.

  In summary, assuming that the current time is 3:00, the predicted PTS for channel 1 is 3:05, 3:11, 3:17,. For channel 2, the predicted PTS is 3:01, 3:08, 3:05,. For channel 3, it becomes 3:03, 3:08, 3:13,. For channel m, the predicted PTS is 3:01, 3:05, 3:09,.

  Next, a histogram of the difference between the previous code reception time and the reproduction time information is generated, a percentage point class having a cumulative probability equal to or greater than a specific percentage is selected from the histogram, and a representative value of this class is obtained. The second prediction step (steps S312 and S313 shown in FIG. 13) predicts the difference between the code reception time of the intra-frame encoded picture received after the present and the reproduction time information. Step).

  First, the difference between the reception time of the code of the intra-frame coded picture received after the present and the PTS is predicted from the reception time of the code of the intra-frame coded picture received in the past and the PTS (step S312) < Reception time-PTS difference prediction processing step or reception time-PTS difference prediction function>.

  As an example of the difference prediction method, a calculation method in which the percent difference in the histogram of the difference between the reception time of the intra-frame coded picture received in the past and stored in the accumulation processing means 12 and the PTS difference histogram is used as the prediction difference. Etc.

More specifically, in the example shown in FIG. 11, when the difference between the code reception time of the intra-frame coded picture and the PTS is calculated for channel 1,
0: 11-0: 04 = 0: 07,
0: 23-0: 18 = 0: 05,
0: 47-0: 43 = 0: 04,
0: 53-0: 50 = 0: 03,
0: 59-0: 54 = 0: 05,
1: 29-1: 23 = 0: 06,
1: 53-1: 48 = 0: 05,
2: 17-2: 12 = 0: 05,
2: 35-2: 29 = 0: 06,
2: 47-2: 43 = 0: 04,
<Difference calculation step or difference calculation function>
Accordingly, for example, a histogram as shown in FIG. 12 is calculated based on the difference information (step S312a) <difference histogram calculation processing step or difference histogram calculation processing function>.

In the present embodiment, the percent point at which the lower cumulative probability is 80 percent or more is set as the prediction difference between the reception time of the code of the intra-frame coded picture and the PTS. Specifically, the percent point at which the lower cumulative probability becomes 80 percent or more is calculated and determined (step S312b) <percent point calculation processing step or percent point calculation function>.
In the example of FIG. 12, the percentage point is an area of class 0: 05.5 or more and less than 0: 06.5.

  When the class of the percentage point is determined, a representative value of the class is determined as a predicted difference value (step S312c) <predicted difference value determining process step or predicted difference value determining process function>. In the example of FIG. 12, the prediction difference value for channel 1 is 0:06, which is the representative value of the class.

Similarly, in the example shown in FIG. 11, when the difference between the code reception time of the intra-frame coded picture and the PTS is calculated for channel 2,
0: 13-0: 07 = 0: 04,
0: 34-0: 30 = 0: 04,
0: 48-0: 43 = 0: 05,
1: 44-1: 39 = 0: 05,
2: 05-1: 58 = 0: 07,
2: 12-2: 06 = 0: 06,
2: 19-2: 13 = 0: 06,
2: 33-2: 25 = 0: 08,
2: 47-2: 40 = 0: 07,
3: 01-2: 54 = 0: 07,
It becomes.

Thereby, a histogram is calculated based on the difference information. In the present embodiment, the percent point at which the lower cumulative probability is 80 percent or more is set as the prediction difference between the reception time of the code of the intra-frame coded picture and the PTS.
Specifically, the percent point at which the lower cumulative probability is 80 percent or more is calculated and determined in the percent point calculation processing step of step S312b. In channel 2,
Two 0:04 that is 0: 03.5 or more and less than 0: 04.5,
There are two 0:05 that are 0: 04.5 or more and less than 0: 05.5.
Two 0:06, which are 0: 05.5 or more and less than 0: 06.5,
There are three 0:07 that are 0: 06.5 or more and less than 0: 07.5,
0:08, which is 0: 07.5 or more and less than 0: 08.5,
Therefore, the percent point at which the lower cumulative probability is 80% is an area of the class 0: 06.5 or more and less than 0: 07.5.
When the class of the percentage point is determined, the representative value of the class is determined as a predicted difference value in the predicted difference value determination processing step of step S312c. In this example, the prediction difference value for channel 2 is 0:07, which is the representative value of the class.

Similarly, in the example shown in FIG. 11, when the difference between the code reception time of the intra-frame coded picture and the PTS is calculated for the channel 3,
0: 13-0: 09 = 0: 04,
0: 28-0: 21 = 0: 07,
0: 48-0: 42 = 0: 06,
1: 03-0: 58 = 0: 05,
1: 28-1: 23 = 0: 05,
1: 48-1: 42 = 0: 06,
2: 08-2: 03 = 0: 05,
2: 28-2: 23 = 0: 05,
2: 33-2: 29 = 0: 04,
2: 48-2: 45 = 0: 03,
It becomes.

Thereby, a histogram is calculated based on the difference information. In the present embodiment, the percent point at which the lower cumulative probability is 80 percent or more is set as the prediction difference between the reception time of the code of the intra-frame coded picture and the PTS.
Specifically, the percent point at which the lower cumulative probability is 80 percent or more is calculated and determined in the percent point calculation processing step of step S312b. In channel 3,
0:03 which is 0: 02.5 or more and less than 0: 03.5,
Two 0:04 that is 0: 03.5 or more and less than 0: 04.5,
There are four 0:05 that are 0: 04.5 or more and less than 0: 55.5,
Two 0:06, which are 0: 05.5 or more and less than 0: 06.5,
0:07, which is 0: 06.5 or more and less than 0: 07.5,
Therefore, the percent point at which the lower cumulative probability is 80% is an area of class 0: 05.5 or more and less than 0: 06.5.
When the class of the percentage point is determined, the representative value of the class is determined as a predicted difference value in the predicted difference value determination processing step of step S312c. In this example, the prediction difference value for channel 3 is 0:06, which is the representative value of the class.

Similarly, in the example shown in FIG. 11, when the difference between the code reception time of the intra-frame coded picture and the PTS is calculated for the channel m,
0: 13-0: 07 = 0: 06,
0: 17-0: 11 = 0: 06,
0: 37-0: 30 = 0: 07,
0: 53-0: 44 = 0: 09,
1: 13-1: 05 = 0: 08,
1: 33-1: 26 = 0: 07,
1: 53-1: 45 = 0: 08,
2: 17-2: 10 = 0: 07,
2: 37-2: 30 = 0: 007,
3: 01-2: 55 = 0: 06,
It becomes.

Thereby, a histogram is calculated based on the difference information. In the present embodiment, the percent point at which the lower cumulative probability is 80 percent or more is set as the prediction difference between the reception time of the code of the intra-frame coded picture and the PTS.
Specifically, the percent point at which the lower cumulative probability is 80 percent or more is calculated and determined in the percent point calculation processing step of step S312b. In channel m
There are three 0:06, which is 0: 05.5 or more and less than 0: 06.5,
There are four 0:07 that are 0: 06.5 or more and less than 0: 07.5,
Two 0:08 that are 0: 07.5 or more and less than 0: 08.5,
0:09, which is 0: 08.5 or more and less than 0: 09.5,
Therefore, the percent point at which the lower cumulative probability is 80% is an area of class 0: 07.5 or more and less than 0: 08.5.
When the class of the percentage point is determined, the representative value of the class is determined as a predicted difference value in the predicted difference value determination processing step of step S312c. In this example, the prediction difference value for channel 3 is 0:08, which is the representative value of the class.

As described above, in the example of FIG. 11, the prediction difference values that are the difference between the code reception time of the intra-frame coded picture and the PTS in channel 1, channel 2, channel 3, and channel m are 0:06, 0:07, 0:06, 0:08.
In the present embodiment, the prediction difference value is calculated based on the percentage point at which the lower cumulative probability is 80 percent. However, the present invention is not limited to this, and the percentage point may be 90 percent or may be 70 percent. It may be.

Then, based on the prediction PTS and the prediction difference value, the prediction value of the code reception time of the intra-frame coded picture is calculated (step S313) <Reception time prediction value calculation processing step or reception time prediction value calculation processing function>.
Specifically, from the prediction PTS and the prediction difference, for channel 1, the prediction value of the code reception time of the intra-frame encoded picture after the present is:
3: 05 + 0: 06 × (n−1) (n is a natural number),
It becomes.

Similarly, with respect to channel 2, the predicted value of the code reception time of the intra-frame coded pictures after the present is
3: 01 + 0: 07 × (n−1) (n is a natural number),
It becomes.

Similarly, with regard to channel 3, the predicted value of the code reception time of the intra-frame coded pictures after the present is
3: 03 + 0: 06 × (n−1) (n is a natural number),
It becomes.

Similarly, with respect to the channel m, the predicted value of the code reception time of the intra-frame coded pictures after the present is
3: 01 + 0: 08 × (n−1) (n is a natural number),
It becomes.

  In this way, the prediction code reception time is calculated for each channel. Then, for example, it is determined whether or not there is another channel for which a predicted value has not been calculated (step S314) <prediction code reception time calculation availability determination processing step or prediction code reception time calculation availability determination function>.

  In this determination process, if there is another channel for which the predicted code reception time has not been calculated, the process returns to step S310 and each step is processed. On the other hand, in this determination process, if there is no other channel for which the predicted code reception time has not been calculated, the process proceeds to the next step.

  Here, such a determination process (determining whether or not another channel has been processed) is placed in the subsequent stage of step S313, and it goes without saying that there are various other methods. For example, the processing may be performed in the subsequent stage of step S310, the subsequent stage of step S311, the subsequent stage of step S312 and the subsequent stage of step S313. Further, the subsequent stage of step S310a, the subsequent stage of step S310b, and the step S312a. Processing may be performed in each of the latter stage, the latter stage of step S312b, and the latter stage of step S312c.

(Channel selection control step)
Next, detailed processing of the selection control step for selecting and determining the channel cyclic order based on the predicted code reception time for each channel will be described.

  First, the time prediction / channel selection means 120 determines the channel cyclic order based on the predicted reception time of the intra-frame coded picture so that the representative image collection target channel cyclic time is the shortest, and in the cyclic order Channel selection is performed (step S315) <channel cyclic order determination processing step or channel cyclic order determination processing function>.

  Specifically, in the channel cyclic order determination processing step, F1 (CH) and F2 (CH) defined in the above embodiment and the predicted DTS of intra-frame coded pictures are defined for the representative image collection target channel CH. Alternatively, based on the difference between the PTS and the current time, channels are selected in descending order of priority set using the third evaluation function F3 (CH) defined as follows.

Here, the third evaluation function F3 (CH) in the channel CH is
If representative image collection has not been performed in the past, F3 (CH) = ∞,
When representative image collection has been performed in the past, it is defined as F3 (CH) = T_C−T_Prv (CH).

  Here, T_C indicates the current time. T_Prv (CH) indicates the PTS (or DTS) of the representative image collected in the past in the channel CH.

  Based on the calculation result of the third evaluation function, the priority P (CH) in the channel CH is set so as to be higher as the channel has a larger F3 (CH), and channels having the same value for F3 (CH). When there are a plurality of channels, the channel is set such that the higher the priority is, the larger the first evaluation function F1 (CH) is. Further, when there are a plurality of channels having the same value for the first evaluation function F1 (CH), the higher the priority is set for the channel having the second evaluation function F2 (CH).

  That is, first, the third evaluation function F3 is calculated for each channel (step S315a) <third evaluation function calculation processing step or third evaluation function calculation function>.

  Subsequently, processing for comparing the calculation results of the third evaluation function F3 of each channel is performed (step S315b) <third evaluation function comparison processing step or third evaluation function comparison processing function>.

  Then, a process of determining whether or not there are a plurality of channels whose calculation results of the third evaluation function F3 have the same value is performed (step S315c) <third evaluation function calculation result analysis determination step or third evaluation function calculation Result analysis judgment function>.

  If it is determined in step S315c that there are not a plurality of channels in which the calculation result of the third evaluation function F3 has the same value, the process proceeds to step S315i.

  On the other hand, when it is determined in step S315c that there are a plurality of channels having the same value as the calculation result of the third evaluation function F3, the first evaluation function F1 for the plurality of channels having the same value. Is performed (step S315d) <first evaluation function calculation processing step or first evaluation function calculation processing function>.

  Subsequently, processing for comparing the calculation results of the first evaluation function F1 of each channel is performed (step S315e) <first evaluation function comparison processing step or first evaluation function comparison processing function>.

  Then, a process of determining whether or not there are a plurality of channels having the same calculation result of the first evaluation function F1 (step S315f) <first evaluation function calculation result analysis determination step or first evaluation function calculation Result analysis judgment function>.

  If it is determined in step S315f that there are not a plurality of channels in which the calculation result of the first evaluation function F1 has the same value, the process proceeds to step S315i.

  On the other hand, when it is determined in step S315f that there are a plurality of channels having the same value as the calculation result of the first evaluation function F1, the second evaluation function F2 for the plurality of channels having the same value. (Step S315g) <second evaluation function calculation processing step or second evaluation function calculation processing function>.

  Subsequently, processing for comparing the calculation results of the second evaluation function F2 of each channel is performed (step S315h) <second evaluation function comparison processing step or second evaluation function comparison processing function>.

  As a result, the final priority based on the calculation result of the third evaluation function F3, the priority based on the calculation result of the second evaluation function F2, and the priority based on the calculation result of the first evaluation function F1 are considered, respectively. Control processing for determining the priority in the channel circulation order is performed (step S315i) <Channel priority determination processing step or channel priority determination processing function>.

The above steps S315a to S315i will be described with specific numerical examples. In this embodiment, since the channel 3 has not collected representative images in the past,
F3 (3) = ∞, and for channel 1, channel 2, and channel m for which representative images have been collected in the past, F3 (1) = 2: 07, F3 (2) = 2: 12, F3 (m) = 2:07.

  As a result, since F3 (3)> F3 (2)> F3 (1) = F3 (m), first, intra-frame coded pictures are collected as representative images in channel 3, and then frames in channel 2 are collected. The inner coded picture is collected as a representative image.

  When the value of the evaluation function F1 in the channel 1 and the channel m is calculated based on the predicted code reception time of the intra-frame coded picture of the channel 2, F1 (1) = F1 (m) = 0: 02.

Therefore, when the second evaluation function F2 is calculated, F2 (1) = 0: 08> F1 (m) = 0: 06.
Therefore, the moving image receiving apparatus assigns priorities such that P (3)> P (2)> P (1)> P (m).
Then, the operation is performed so as to select the representative image collection target channels in the order of higher priority (steps S104 to S107 in FIG. 2).

(Patrol control step)
When such channel priorities are determined, based on these priorities, the encoded stream receiving means 10 performs processing to control channel selection (step S316) <channel selection processing step or channel selection processing function >.

More specifically, based on the result of the priority determination described above, channel circulation is performed so that the encoded stream receiving means 10 matches channel 3, channel 2, channel 1, and channel m, respectively, and the channels are selected in order.
In this step, when one channel is selected for patrol, steps S104, S105, S106, and S107 shown in FIG. 7 are repeated for the one channel, and the other channels to be selected next are shown in FIG. Steps S104, S105, S106, and S107 shown in FIG. 6 are repeated, and thereafter the processing is repeated for each channel in the same manner.

  First, the time prediction / channel selection means 20 selects channel 3 from the representative image collection target channels (step S104 in FIG. 7).

  The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is the predicted reception time of the code of the intra-frame coded picture in channel 3 (step S106 in FIG. 7), the time prediction / channel selection unit 120 sets the encoded stream reception unit to channel 3, The moving image stream is received and output in the channel 3 (step S107 in FIG. 7), and the process returns to step S104.

  Since the code of the output moving image stream includes the code of the intra-frame coded picture, the representative image can be generated by the external device that has received the output moving image stream.

  Next, channel 2 is selected from the representative image collection target channels that have not been collected (step S104 in FIG. 7).

  The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is the predicted reception time of the code of the intra-frame encoded picture in channel 2 (step S106 in FIG. 7), the time prediction / channel selection unit 120 sets the encoded stream reception unit 10 to channel 1. The moving image stream is received and output in channel 2 (step S107 in FIG. 7), and the process returns to step S104.

  Next, channel 1 is selected from the representative image collection target channels that have not been collected (step S104 in FIG. 7).

  The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is the predicted reception time of the code of the intra-frame encoded picture in channel 1 (step S106 in FIG. 7), the time prediction / channel selection unit 120 sets the encoded stream reception unit 10 to channel 1. The moving image stream is received and output in channel 1 (step S107 in FIG. 7), and the process returns to step S104.

  Next, the channel m is selected from the representative image collection target channels that have not been collected (step S104 in FIG. 7). The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is the predicted reception time of the code of the intra-frame coded picture in the channel m (step S106 in FIG. 7), the time prediction / channel selection means 120 sets the coded stream reception means 10 to the channel m. Then, the moving image stream is received and output in the channel m (step S107 in FIG. 7), and the process returns to step S104, and the moving image coded stream including the code of the intra-frame coded picture for all the representative image collection target channels. Since reception has been performed, the processing is completed.

(About effect)
As described above, according to the present embodiment, while the same effect as that of the first embodiment is achieved, the intra-frame frame received in the past in the prediction of the PTS of the intra-frame coded picture after the present can be obtained. By using the minimum value of the increment of the PTS of the encoded picture, if the PTS of the adjacent intra-frame encoded picture in the same moving picture stream is obtained in the history, the adjacent frame in the same moving picture stream is obtained. It is possible to accurately obtain the PTS interval value of the inner coded picture with a small amount of calculation.

  The prediction of the difference between the code reception time and the PTS of the intra-frame coded picture after the present is performed by using the percentage point in the histogram of the code reception time and the PTS difference of the intra-frame coded picture received in the past. And the probability that the code of the intra-frame coded picture reaches the moving picture receiving apparatus after the predicted code reception time of the intra-frame coded picture after the current time is received is greater than or equal to a predetermined probability. The effect of guaranteeing that is obtained.

  Further, by performing channel selection by performing the prioritization, a representative image collected for a representative image collected channel is used before a new representative image is collected. In addition, since the representative image is preferentially collected for the channel for which the representative image has not been collected, an effect of further shortening the time from the representative image collection command to the presentation of the representative image in all the representative image collection target channels can be obtained.

  It is possible to present to the viewer that the representative image for the channel given a low priority after the presentation is updated from the previously collected one to the newly obtained one, and the immediacy of the representative image is maintained. The

  Other configurations, other steps, and operational effects thereof are the same as those in the first embodiment described above. In the above description, the operation content of each step described above and the components of each unit may be programmed and executed by a computer.

[Fourth Embodiment]
Next, a fourth embodiment according to the present invention will be described with reference to FIGS. FIG. 14 is a block diagram showing an example of the fourth embodiment of the moving image receiving apparatus of the present invention.

  The present embodiment is characterized in that the second prediction unit 224 performs prediction using the probability distribution, and the channel selection unit 226 performs channel selection in consideration of the priority based on the channel set. .

(About configuration)
First, a detailed configuration of the moving image receiving apparatus 1 will be described with reference to FIG. FIG. 14 is a block diagram showing an example of a detailed configuration of the time prediction / channel selection means of the moving picture receiving apparatus according to the present embodiment.

  The moving image receiving apparatus 1 of the present embodiment discloses an example in which the time prediction / channel selection unit 20 in FIG. 1 is configured as the time prediction / channel selection unit 220 shown in FIG. The configuration is the same as that of the first embodiment.

  Here, in the present embodiment, as in the third embodiment, the moving image receiving apparatus 1 in FIG. 1 receives the m moving image stream examples in FIGS. 4 and 6 (m Is a natural number of 4 or more), and the representative image collection target channels are designated as channel 1, channel 2, channel 3, and channel m.

  Further, as a result of applying Steps S101 to S107 shown in FIG. 7 to the moving picture stream, the reception time of the code of the past intra-frame coded picture stored in the storage processing means 12 of the moving picture receiving apparatus. And PTS are obtained as shown in FIG. Furthermore, the time when the representative image collection command is input is set to 3:00, and the time is set as the current time.

  Among the representative image collection target channels, channel 1, channel 2, and channel m have received time and PTS intra-frame coded pictures shown in white in FIG. 11 collected in the past as channel images. 3 assumes that no representative image has been collected in the past.

(Time prediction / channel selection means)
As shown in FIG. 14, the time prediction / channel selection unit 220 in the moving image receiving apparatus of the present embodiment includes a first prediction unit 222, a second prediction unit 224, a prediction calculation module control unit 225, And a channel selection unit 226.

  The first prediction unit 222 predicts the reproduction time of the intra-frame coded picture after the current time based on the previous reproduction time.

  Further, the first predicting unit 222 selects the increment that fits within the range of the specific range reproduction time information interval value obtained from the known information from the increments of the values of the reproduction time information. An interval value of the reproduction time information is predicted, and the reproduction of the intra-frame coded picture after the present is based on the predicted reproduction time information interval value and the reproduction time information of the intra-frame encoded picture received last. Time information is predicted. The first prediction unit 222 can also be referred to as first prediction means.

  More specifically, the first prediction unit 222 uses the increment of the PTS value of the intra-frame encoded picture received in the past as a PTS interval value of the intra-frame encoded picture in a specific channel. The PTS interval value prediction unit 222a to be predicted and the PTS of the intra-frame coded picture stored (last received) in the latest past are multiplied by the natural number times the interval value of the PTS in the PTS interval value prediction unit 222a. And a PTS value predicting unit 222b that calculates the predicted value of the PTS of the intra-frame coded picture after the current time.

  The PTS interval value prediction unit 222a includes a PTS increment calculation unit 222a-1 that calculates an increment of the PTS value of the intra-frame coded picture of each channel, and among the increments calculated by the PTS increment calculation unit 222a-1. And a PTS interval value range selection unit 222a-2 that performs a process of selecting an item within a specific range.

  The PTS value predicting unit 222b is a natural number multiple determining unit that determines a natural number multiple as to which predicted value is to be calculated, and the numerical value (the value selected by the PTS interval value range selecting unit 222a-2) A past PTS addition unit that multiplies the predicted PTS interval value) by the natural number multiple determined by the natural number multiple determination unit, and adds the PTS value of the intra-frame coded picture stored in the past to this Is done.

  The second prediction unit 224 predicts the code reception time based on the predicted reproduction time predicted by the first prediction unit 222.

  Further, the second prediction unit 224, based on the code reception time and the reproduction time information of the intra-frame encoded picture received in the past, the intra-frame encoded picture received after the present A difference between the code reception time and the reproduction time information is predicted, and based on the predicted difference and the reproduction time information predicted by the first prediction unit 222, the current and subsequent intra-frame coded pictures The code reception time is predicted.

  Further, the second prediction unit 224 calculates the expected value and variance of the difference between the past code reception time and the reproduction time information, respectively, and the cumulative probability in the probability distribution model followed by the difference becomes a specific probability. By calculating a percentage value, and using the percentage value as a coefficient, a sum of a value obtained by multiplying the square root of the variance by the coefficient and the expected value is calculated, so that the intra-frame coded pictures after the present time are calculated. The difference between the code reception time and the reproduction time information is predicted. The second prediction unit 224 can also be referred to as second prediction means.

  The second prediction unit 224 calculates the difference between the code reception time of the code of the intra-frame coded picture received in the past and the PTS from the code reception time of the code of the intra-frame coded picture received in the past and the PTS. Predicted reception time-PTS difference prediction unit 224a, prediction difference value calculated by reception time-PTS difference prediction unit 224a, and prediction value of PTS of intra-frame coded picture after current time And a reception time prediction value calculation unit 224b that calculates a prediction value of the code reception time of the coded picture.

  The reception time-PTS difference prediction unit 224a calculates an expected difference between the code reception time of the code of the past intra-frame coded picture and the PTS, and an expected difference value calculation unit 224a-1, and calculates the variance of the difference. The difference variance calculation unit 224a-2, the probability distribution information acquisition calculation unit 224a-3 that performs calculation for acquiring information related to the probability distribution model that the difference follows, and the probability distribution calculated by the probability distribution information acquisition calculation unit 224a-3 The percent point calculation unit 224a-4 that calculates the value of the percent point at which the cumulative probability in the model is a specific probability, and the percentage point value calculated by the percent point calculation unit 224a-4 as a coefficient By calculating the sum of a value obtained by multiplying the square root by the coefficient and the expected value, the code reception time and the previous time of the intra-frame coded picture after the present are calculated. Configured to include a predicted difference value calculating unit 224a-5 to predict the difference between the reproduction time information.

  The prediction calculation module control unit 225 controls the execution procedure of each unit. For example, in the process of calculating the prediction value of the code reception time of the intra-frame coded picture for one channel, for example, while performing the operation of the second prediction unit, the intra-frame coded picture for the other channel A function for controlling the first prediction unit to perform the calculation in the process of calculating the predicted value of the code reception time is assumed.

  Based on the prediction code reception time predicted by the second prediction unit 224 included in the code reception time prediction unit, the channel selection unit 226 sets the channel circulation order so that the representative image collection target channel circulation time becomes the shortest. It is determined and channel selection is performed. The channel selection unit 226 can also be referred to as channel selection control means.

  In addition, the channel selection unit 226 can obtain an approximate solution of the channel circulation order by performing depth-first search by repeatedly selecting the representative image collection target channel. The channel selection unit 126 calculates an evaluation value with respect to a channel selection order based on the prediction code reception time, selects a channel in order from the highest evaluation value, and the evaluation value is collected. The selection order of channels can be determined by calculating based on the immediacy or collection time of representative images. At that time, the channel selection unit 226 can calculate the evaluation value as a required traveling time for circulating the channel.

  The channel selection unit 226 is based on the channel cyclic order determination processing unit 226a that determines the channel cyclic order of the representative image collection target channel based on the prediction code reception time, and the channel cyclic order determined by the channel cyclic order determination processing unit 226a. And a channel selection processing unit 226b that performs processing necessary for channel circulation.

  The channel cyclic order determination processing unit 226a is arbitrarily set in advance, and a threshold information acquisition processing unit 226a that acquires information on a threshold T_TH (specific threshold) for a time interval from the code reception time of the representative image collected in the past to the current time. 1 and a reception time for calculating a difference (time difference) between a code reception time and a current time of a representative image collected in the past for each representative image collection target channel, and the representative time difference calculation unit 226a-2 Channel set division processing for dividing an image acquisition target channel into a set S_H (first channel set) in which the time difference is greater than or equal to the threshold T_TH and a set S_L (second channel set) in which the time difference is less than the threshold T_TH Unit 226a-3 and each channel set S_H (first channel set) divided by the channel set division processing unit 226a-3 , And channel set S_L (second channel set), a priority determination processing unit 226a-4 that performs processing related to determination of prioritization (priority of channel circulation order) similar to that of the third embodiment, , Including.

  The channel set division processing unit 226a-3 performs processing so that channels that have not been collected as representative images are included in the set S_H (first channel set).

  The priority determination processing unit 226a-4 includes a channel set prioritization processing unit 226a-5 that performs processing related to prioritization of channel sets, and channel priority that performs processing related to prioritization of channels included in the channel set. The finalizing unit 226a-6 takes into consideration the set priority in the channel set prioritizing unit 226a-6 and the channel priority in the channel prioritizing unit 226a-5. And a final channel priority determination unit 226a-7 that performs processing related to channel priority determination.

The channel set prioritization processing unit 226a-5 of the priority determination processing unit 226a-4 includes a channel CH_H included in the channel set S_H (first channel set) and a channel included in the channel set S_L (second channel set). For any combination with CH_L, the relationship of priority P is
P (CH_H)> P (CH_L)
Prioritization is performed so that the channel of the first channel set is given priority.

For example, assume that the threshold is specified as T_TH = 2: 15.
At this time, the channel set division processing unit 226a-3 divides the representative image collection channel into groups of the channel set S_H (first channel set) and the channel set S_L (second channel set) and groups them. ,
Channel set S_H = {2, 3, m},
Channel set S_L = {1}
It becomes.

The channel prioritization processing unit 226a-5 of the priority determination processing unit 226a-4 performs the third processing on each channel of the channel set S_H (first channel set) and the channel set S_L (second channel set). Prioritization similar to that of the embodiment is performed.
For example, for channels included in the channel set S_H (first channel set),
P (3)> P (2)> P (m)
Prioritization is performed so that.

  The channel set prioritization processing unit 226a-6 makes the priority of the channels included in the channel set S_H (first channel set) higher than the priority of the channels included in the channel set S_L (second channel set). To be determined.

The final channel priority determination unit 226a-7 considers the set priority in the channel set prioritization processing unit 226a-6 and the channel priority in the channel prioritization processing unit 226a-5, and displays all representative images. Priorities for channels to be collected
P (3)> P (2)> P (m)> P (1)
To be determined.

  Thus, the channel selection unit 226 can also be referred to as channel selection control means. The channel selection control means calculates a difference between the code reception time of the representative image collected in the past and the current time for each representative image collection target channel, and sets each representative image collection target channel based on the time difference. It is divided into a plurality of channel sets, and the priority of channel selection is determined by setting the set priority of each channel set that has priority over the channel priority of each channel unit.

  Further, the channel selection control means calculates a difference between the code reception time of the representative image collected in the past and the current time for each representative image collection target channel, and the time difference is specified threshold value for the representative image collection target channel. The representative image collection target channel and the channel where the representative image has not been collected are set as a first channel set, the representative image collection target channel whose time difference is less than the specific threshold is set as a second channel set, and the first channel set is set as The channel priority of each channel in each channel set is set under a set priority setting condition that makes the priority higher than that of the second channel set.

  The time prediction / channel selection means 220 of the moving image receiving apparatus 1 having the above-described configuration generally operates as follows. That is, the prediction calculation module control unit 225 of the time prediction / channel selection unit 220 executes the first prediction unit 222 and the second prediction unit 224 for one channel, and receives a prediction code of an intra-frame coded picture. Time and predicted PTS are calculated. Similarly, the prediction calculation module control unit 225 causes the first prediction unit 222 and the second prediction unit 224 to be executed for other channels, and calculates the prediction code reception time and the prediction PTS of the intra-frame coded picture. .

  Specifically, the first predicting unit 222 causes the PTS interval value predicting unit 222a to execute and use the increment of the PTS value of the intra-frame coded picture to determine what is within a specific range among the increments. This is selected and predicted as the PTS interval value of the intra-frame coded picture.

  Subsequently, the first prediction unit 222 causes the PTS value prediction unit 222b to execute the PTS of the intra-frame coded picture stored in the past in the PTS interval value prediction unit 222a. By adding the natural number multiple, the predicted value of the PTS of the intra-frame coded picture after the current time is calculated.

  Further, the second prediction unit 224 causes the reception time-PTS difference prediction unit 224a to execute the intra-frame received from the present time onward based on the code reception time of the code of the intra-frame coded picture received in the past and the PTS. The difference between the code reception time of the code of the encoded picture and the PTS is predicted.

  Specifically, the reception time-PTS difference prediction unit 224a of the second prediction unit 224 calculates the expected value and variance of the difference between the past code reception time and the reproduction time information, respectively, and the difference follows The percentage point value at which the cumulative probability in the probability distribution model is a specific probability is calculated, and the sum of the value obtained by multiplying the square root of the variance by the coefficient and the expected value is calculated using the percentage point value as a coefficient. Thus, the difference between the code reception time and the reproduction time information of the intra-frame encoded picture after the present is predicted.

  That is, the expected difference calculation unit 224a-1 calculates the expected value of the difference between the code reception time of the past intra-frame coded picture code and the PTS. Further, the difference variance calculation unit 224a-2 calculates the variance of the difference or the square root of the variance. Then, the probability distribution information acquisition calculation unit 224a-3 acquires and calculates information related to the probability distribution model followed by the difference. Further, the percent point calculation unit 224a-4 calculates the value of the percent point at which the cumulative probability in the probability distribution model calculated by the probability distribution information acquisition calculation unit 224a-3 becomes a specific probability. Thus, the predicted difference value calculation unit 224a-5 uses the percent point value calculated by the percent point calculation unit 224a-4 as a coefficient, the value obtained by multiplying the square root of the variance by the coefficient, and the expected value. The difference between the code reception time and the reproduction time information of the intra-frame coded picture after the present is predicted.

  The reception time prediction value calculation unit 224b of the second prediction unit 224 then encodes the prediction difference value calculated by the reception time-PTS difference prediction unit 224a by a natural number, and intra-frame coding after the current time. By adding the predicted value of the PTS of the picture, the predicted value of the code reception time of the intra-frame coded picture is calculated.

  In this way, when the prediction code reception time of the intra-frame coded picture and the prediction PTS are calculated for each channel, the time prediction / channel selection unit 220 causes the channel selection unit 226 to execute the channel cyclic order. Make a decision.

  Specifically, the channel cyclic order determination processing unit 226a of the channel selection unit 226 causes the threshold information acquisition processing unit 226a-1 to execute, and is arbitrarily set in advance, from the code reception time of the representative image collected in the past to the current time. The information regarding the threshold value T_TH (specific threshold value) for the time interval until is acquired.

  Further, the channel cyclic order determination processing unit 226a causes the reception time-current time difference calculation unit 226a-2 to execute the difference between the code reception time of the representative image collected in the past and the current time for each representative image collection target channel. (Time difference) is calculated.

  Then, the channel cyclic order determination processing unit 226a causes the channel set division processing unit 226a-3 to execute the representative image collection target channel as a set S_H (first channel set) in which the time difference is equal to or greater than the threshold T_TH. The time difference is divided into a set S_L (second channel set) in which the time difference is less than the threshold T_TH.

For example, assume that the threshold is specified as T_TH = 2: 15.
At this time, the channel cyclic order determination processing unit 226a causes the channel set division processing unit 226a-3 to execute the representative image collection channel as the channel set S_H (first channel set) and the channel set S_L (second channel set). ) Divided into groups and grouped,
Channel set S_H = {2, 3, m},
Channel set S_L = {1}
And

Next, the channel cyclic order determination processing unit 226a causes the priority determination processing unit 226a-4 to execute the channel CH_H included in the channel set S_H (first channel set) and the channel set S_L (second channel set). For any combination with included channel CH_L, the relationship of priority P is
P (CH_H)> P (CH_L)
Prioritize so that

Specifically, the channel cyclic order determination processing unit 226a causes the priority determination processing unit 226a-4 to execute and each of the channel set S_H (first channel set) and the channel set S_L (second channel set). Prioritization is performed on channels in the same manner as in the third embodiment.
For example, for channels included in the channel set S_H (first channel set),
P (3)> P (2)> P (m)
Prioritization is performed so that.

  Further, the channel cyclic order determination processing unit 226a causes the priority determination processing unit 226a-4 to execute, and the priority of the channels included in the channel set S_H (first channel set) is set to the channel set S_L (second channel set). Is determined to be higher than the priority of the channels included in the.

Further, the channel cyclic order determination processing unit 226a causes the priority determination processing unit 226a-4 to execute, the set priority in the channel set prioritization processing unit 226a-6, and the channel prioritization processing unit 226a-5 Considering the channel priority, the priority for all representative image acquisition target channels
P (3)> P (2)> P (m)> P (1)
To be determined.
In this way, the priority determination processing unit 226a-4 performs final priority assignment (cyclic order determination) in the channel cyclic order.

(About processing procedure)
Next, various processing procedures in the moving image receiving apparatus 1 having the above-described configuration will be described with reference to FIGS. 10 to 13. FIG. 13 is a flowchart illustrating an example of a detailed processing procedure of the moving image receiving apparatus according to the present embodiment.
In the processing procedure of the present embodiment, the entire process is the same as that of the first embodiment, and will be omitted, and each detailed process (prediction step, selection control step, cyclic control step) will be described.

  Here, the preconditions in the present embodiment will be described. In the present embodiment, similar to the third embodiment, the moving image receiving apparatus 1 in FIG. 1 receives the m moving image stream examples in FIGS. 4 and 6 (m is 4 or more). ), The representative image collection target channel is designated as channel 1, channel 2, channel 3, and channel m.

  Further, as a result of applying Steps S101 to S107 shown in FIG. 7 to the moving picture stream, the reception time of the code of the past intra-frame coded picture stored in the storage processing means 12 of the moving picture receiving apparatus. And PTS are obtained as shown in FIG. Furthermore, the time when the representative image collection command is input is set to 3:00, and the time is set as the current time.

  Among the representative image collection target channels, channel 1, channel 2, and channel m have received time and PTS intra-frame coded pictures shown in white in FIG. 11 collected in the past as channel images. 3 assumes that no representative image has been collected in the past.

(Code reception time prediction step)
Details of the intra-frame encoded picture reception time prediction / channel selection processing in step S104 shown in FIG. 7 will be described with reference to FIG.

  First, the time prediction / channel selection unit 220 calculates the PTS of the intra-frame coded picture received after the current time from the PTS of the intra-frame coded picture received in the past for each of the representative image collection target channels. Prediction is performed to predict the reception time of the code of the intra-frame coded picture received after the current time from the predicted PTS.

  More specifically, the following method is exemplified as a method for predicting the PTS of the intra-frame coded picture received after the present for each representative image collection target channel. For example, known information including candidates for prediction values of PTS interval values of intra-frame coded pictures in the channel, such as increments of PTS of intra-frame coded pictures received in the past and common divisors of the increments A value within a predetermined range obtained from the above is predicted as a PTS interval value, and a natural number multiple of the PTS interval value is added to the PTS of the intra-frame encoded picture received last.

  That is, in the code reception time prediction step, the reproduction is performed by selecting the increment that fits within the range of the specific range reproduction time information interval value obtained from the known information from the increments of the values of the reproduction time information. An interval value of time information is predicted, and based on the predicted reproduction time information interval value and the reproduction time information of the intra-frame encoded picture received last, the reproduction time of the intra-frame encoded picture after the present A first prediction step (step consisting of step S410 and step S411 shown in FIG. 15) in which information is predicted is performed.

  First, in this embodiment, under the precondition that the specific range of the PTS interval value is defined as 0:04 or more and less than 0:08, the increment of the PTS of the intra-frame coded picture received in the past is set. One within the above range is selected and set as a predicted PTS interval value (step S410) <PTS interval value prediction processing step or PTS interval value prediction function>.

More specifically, in the example shown in FIG. 11, regarding the channel 1, when the increment of the PTS of the intra-frame coded picture is calculated,
0: 23-0: 11 = 0: 12
0: 47-0: 23 = 0: 24,
0: 53-0: 47 = 0: 06,
0: 59-0: 53 = 0: 06,
1: 29-0: 59 = 0: 30
1: 53-1: 29 = 0: 24,
2: 17-1: 53 = 0: 24,
2: 35-2: 17 = 0: 18,
2: 47-2: 35 = 0: 12
(Step S410a) <PTS increment calculation processing step or PTS increment calculation function>.

  For this reason, when the one that satisfies the precondition that the specific range of the PTS interval value is defined as 0:04 or more and less than 0:08 is selected from the increments, 0:06 is obtained (step S410b) < PTS interval value range selection processing step or PTS interval value range selection function>. Here, 0:06 that satisfies the above condition is predicted as the PTS interval value of the intra-frame coded picture, and 0:06 is the predicted PTS interval value.

Similarly, in the example shown in FIG. 11, when the PTS increment calculation processing step of step S410a is performed for channel 2, and the PTS increment of the intra-frame coded picture is calculated,
0: 34-0: 13 = 0: 21,
0: 48-0: 34 = 0: 14,
1: 44-0: 48 = 0: 58,
2: 05-1: 44 = 0: 21,
2: 12-2: 05 = 0: 07,
2: 19-2: 12 = 0: 07,
2: 33-2: 19 = 0: 14,
2: 47-2: 33 = 0: 14,
3: 01-2: 47 = 0: 14
It becomes. For this reason, when the channel 2 is subjected to the PTS interval value range selection processing step of step S410b and the increment that meets the above condition is calculated, 0:07 is obtained. Therefore, for channel 2, 0:07 is the predicted PTS interval value of the intra-frame coded picture.

Similarly, in the example shown in FIG. 11, when the PTS increment calculation processing step of step S410a is performed for channel 3, and the PTS increment of the intra-frame coded picture is calculated,
0: 28-0: 13 = 0: 15,
0: 48-0: 28 = 0: 20,
1: 03-0: 48 = 0: 15,
1: 28-1: 03 = 0: 25,
1: 48-1: 28 = 0: 20,
2: 08-1: 48 = 0: 20,
2: 28-2: 08 = 0: 20,
2: 33-2: 28 = 0: 05,
2: 48-2: 33 = 0: 15,
It becomes. For this reason, when the PTS interval value range selection processing step of step S410b is performed for channel 3, and the increment that meets the condition is calculated, 0:05 is obtained. Therefore, for channel 3, 0:05 is the predicted PTS interval value of the intra-frame coded picture.

Similarly, in the example shown in FIG. 11, when the PTS increment calculation processing step of step S410a is performed for the channel m and the PTS increment of the intra-frame coded picture is calculated,
0: 17-0: 13 = 0: 04,
0: 37-0: 17 = 0: 20,
0: 53-0: 37 = 0: 16,
1: 13-0: 53 = 0: 20,
1: 33-1: 13 = 0: 20,
1: 53-1: 33 = 0: 20,
2: 17-1: 53 = 0: 24,
2: 37-2: 17 = 0: 20,
3: 01-2: 37 = 0: 24,
It becomes. For this reason, when the minimum value calculation processing step of step S410b is performed for the channel m and the increment that meets the condition is calculated, 0:04 is obtained. Therefore, for channel m, 0:04 is the predicted PTS interval value for intra-frame coded pictures.

  Thus, in the example of FIG. 11, the predicted PTS interval values of the intra-frame coded pictures in channel 1, channel 2, channel 3, and channel m are 0:06, 0:07, 0:05, and 0:04, respectively. It becomes.

  Next, by adding a natural number multiple of the predicted PTS interval value in the PTS interval value prediction unit 222a to the PTS of the intra-frame encoded picture stored in the latest past, the intra-frame encoding after the current time is added. A prediction value (prediction PTS) of a PTS of a picture is calculated (step S411) <PTS value prediction processing step or PTS value prediction function>.

More specifically, in the example shown in FIG. 11, regarding the channel 1, assuming that the current time is 3:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 2 Therefore, if the natural number multiple (n = 3) of the predicted value 0:06 of the PTS interval is added to 2:47 of the latest past PTS,
2: 47 + 0: 06 × 3 = 3: 05
<Past PTS addition processing step or past PTS addition function> This added value 3:05 is set as a predicted PTS.

Furthermore, the past PTS addition processing step is performed for natural number multiples (n = 4),
2: 47 + 0: 06 × 4 = 3: 11, and 3:11 is the predicted PTS.

Furthermore, the past PTS addition processing step is performed for natural number multiples (n = 5),
2: 47 + 0: 06 × 5 = 3: 17, and 3:17 is set as the predicted PTS.

  Thereafter, the past PTS addition processing step is performed in the same manner until the natural number is multiplied (n = k). For example, it is determined whether or not the predicted PTS has been calculated up to a preset natural number multiple at a natural number multiple (n = k) <set natural number multiple determination processing step or set natural number multiple determination function>.

  In this determination process, when it is determined that the predicted PTS is not calculated at a natural number multiple (n = k), a past PTS addition processing step is performed. In this determination process, the natural number multiple (n = k) If it is determined in k) that the predicted PTS has been calculated, the process proceeds to the next step.

Similarly, in the example shown in FIG. 11, regarding channel 2, assuming that the current time is 3:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 2:47. Therefore, when the natural number multiple (n = 2) of the predicted value 0:07 of the PTS interval is added to 2:47 of the latest past PTS,
2: 47 + 0: 07 × 2 = 3: 01
It becomes. This added value 3:01 is set as a predicted PTS.

Further, the past PTS addition processing step is performed for natural number multiples (n = 3),
2: 47 + 0: 07 × 3 = 3: 08, and 3:08 is the predicted PTS.
Further, the past PTS addition processing step is performed for natural number multiples (n = 3),
2: 47 + 0: 07 × 4 = 3: 15, and 3:15 is the predicted PTS.
Thereafter, the same calculation is performed.

Similarly, in the example shown in FIG. 11, regarding the channel 3, when the current time is 3:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 2:48. Therefore, if a natural number multiple (n = 3) of the predicted value 0:05 of the PTS interval is added to 2:48 of the latest past PTS,
2: 48 + 0: 05 × 3 = 3: 03
It becomes. This added value 3:03 is set as a predicted PTS.

Furthermore, the past PTS addition processing step is performed for natural number multiples (n = 4),
2: 48 + 0: 05 × 4 = 3: 08, and 3:08 is the predicted PTS.
Furthermore, the past PTS addition processing step is performed for natural number multiples (n = 5),
2: 48 + 0: 05 × 5 = 3: 13, and 3:13 is the predicted PTS.
Thereafter, the same calculation is performed.

Similarly, in the example shown in FIG. 11, regarding the channel m, if the current time is 3:00, the PTS of the inter-frame coded picture stored in the latest past (the latest past PTS) is 2:37. Therefore, when the natural number multiple (n = 6) of the predicted value 0:04 of the PTS interval is added to 2:37 of the latest past PTS,
2: 37 + 0: 04 × 6 = 3: 01
It becomes. This added value 3:01 is set as a predicted PTS.

Further, the past PTS addition processing step is performed for natural number multiples (n = 7),
2: 37 + 0: 04 × 7 = 3: 05, and the past PTS addition processing step is also performed for natural number multiples (n = 8),
2: 37 + 0: 04 × 8 = 3: 09, and 3:09 is the predicted PTS.
Thereafter, the same calculation is performed.

  In summary, assuming that the current time is 3:00, the predicted PTS for channel 1 is 3:05, 3:11, 3:17,. For channel 2, the predicted PTS is 3:01, 3:08, 3:15,. For channel 3, the predicted PTS is 3:03, 3:08, 3:13,. For channel m, the predicted PTS is 3:01, 3:05, 3:09,.

  Next, in the code reception time prediction step, an expected value and a variance of the difference between the previous code reception time and the reproduction time information are respectively calculated, and the cumulative probability in the probability distribution model followed by the difference becomes a specific probability. By calculating a percentage value, and using the percentage value as a coefficient, a sum of a value obtained by multiplying the square root of the variance by the coefficient and the expected value is calculated, so that the intra-frame coded pictures after the present time are calculated. A second prediction step (step consisting of step S412 and step S413 shown in FIG. 15) is performed in which a difference between the code reception time and the reproduction time information is predicted.

  In the second prediction step, the difference is predicted using the probability distribution model as a standard normal distribution.

  First, from the reception time of the code of the intra-frame coded picture received in the past and the PTS, the difference between the reception time of the code of the intra-frame coded picture received after the present and the PTS is predicted (step S412) < Reception time-PTS difference prediction processing step or reception time-PTS difference prediction function>.

  As an example of the difference prediction method, an intra-frame coded picture is obtained by obtaining an expected value and a variance of the difference between the reception time of the intra-frame coded picture received in the past stored in the accumulation processing means 12 and the PTS. The estimated value of the difference between the reception time of the code of the intra-frame coded picture and the PTS from now on, using as a coefficient the percent point at which the lower cumulative probability in the standard normal distribution according to the difference between the reception time of the code and the PTS becomes a predetermined probability And the sum of the expected value and the square root of the variance multiplied by the coefficient.

More specifically, in the example shown in FIG. 11, when the difference between the code reception time of the intra-frame coded picture and the PTS is calculated for channel 1,
0: 11-0: 04 = 0: 07,
0: 23-0: 18 = 0: 05,
0: 47-0: 43 = 0: 04,
0: 53-0: 50 = 0: 03,
0: 59-0: 54 = 0: 05,
1: 29-1: 23 = 0: 06,
1: 53-1: 48 = 0: 05,
2: 17-2: 12 = 0: 05,
2: 35-2: 29 = 0: 06,
2: 47-2: 43 = 0: 04,
<Difference calculation step or difference calculation function>
Thereby, the expected value of the difference between the code reception time of the past intra-frame coded picture and the PTS is calculated (step S412a) <difference expected value calculation processing step or difference expected value calculation processing function>. That is, when the expected value of the difference is calculated based on the difference information,
Expected value = (0: 07 + 0: 05 + 0: 04 + 0: 03 + 0: 05 + 0: 06
+0: 05 + 0: 05 + 0: 06 + 0: 04) / 10 = 0: 05.

  Further, the square root (standard deviation) of the variance of the difference is calculated (step S412b) <difference variance calculation processing step or difference variance calculation processing function>. That is, when the square root of the variance of the difference is calculated based on the difference information, the result is as follows.

First, since the arithmetic mean is 0:05, the variance σ ² is
σ ² = {(0: 05-0: 07) ² + (0: 05-0: 05) ²
+ (0: 05-0: 04) ² + (0: 05-0: 03) ²
+ (0: 05-0: 05) ² + (0: 05-0: 06) ²
+ (0: 05-0: 05) ² + (0: 05-0: 05) ²
+ (0: 05-0: 06) ² + (0: 05-0: 04) ² } / 10
= 0: 00012
Therefore, the square root σ of the dispersion is approximately 0: 01.1.

  Next, information on the probability distribution model followed by the difference is obtained and calculated, and a percentage value at which the cumulative probability in the calculated probability distribution model becomes a specific probability is calculated (step S412c). That is, if the specific probability is 80 percent, the percentage point of the probability in the normal distribution which is an example of the probability distribution model is about 0.87.

  Then, by calculating the sum of the value obtained by multiplying the square root of the variance by the coefficient and the expected value using the value of the percent point as a coefficient, the code reception time of the intra-frame coded picture after the present and the Prediction of difference from reproduction time information (step S412d) <prediction difference value calculation processing step or prediction difference value calculation processing function>.

That is, in this step, since the percentage point of the specific probability is about 0.87, the difference (prediction difference value) between the code reception time of the intra-frame coded picture and the PTS is calculated for channel 1.
0: 05 + 0.87 × 0: 01.1 = (approximately) 0:06
Predict.

Similarly, in the example shown in FIG. 11, when step 412 is performed for channel 2, the following results.
First, when calculating the difference between the code reception time of the intra-frame coded picture and the PTS,
0: 13-0: 07 = 0: 04,
0: 34-0: 30 = 0: 04,
0: 48-0: 43 = 0: 05,
1: 44-1: 39 = 0: 05,
2: 05-1: 58 = 0: 07,
2: 12-2: 06 = 0: 06,
2: 19-2: 13 = 0: 06,
2: 33-2: 25 = 0: 08,
2: 47-2: 40 = 0: 07,
3: 01-2: 54 = 0: 07,
It becomes.

Thus, when the expected value of the difference is calculated based on the difference information,
Expected value = (0: 04 + 0: 04 + 0: 05 + 0: 05 + 0: 07 + 0: 06
+0: 06 + 0: 08 + 0: 07 + 0: 07) / 10 = (approximately) 0:06.

  Further, when the square root of the variance of the difference is calculated based on the difference information, the result is as follows.

First, since the arithmetic mean is 0:06, the variance σ ² is
σ ² = {(0: 06-0: 04) ² + (0: 06-0: 04) ²
+ (0: 06-0: 05) ² + (0: 06-0: 05) ²
+ (0: 06-0: 07) ² + (0: 06-0: 06) ²
+ (0: 06-0: 06) ² + (0: 06-0: 08) ²
+ (0: 06-0: 07) ² + (0: 0-06-0: 07) ² } / 10
= 0: 00017
Therefore, the square root σ of the dispersion is approximately 0: 013.

If the percentage point of the specific probability is about 0.87, for channel 2, the difference between the code reception time of the intra-frame coded picture and the PTS (prediction difference value) is
0: 06 + 0.87 × 0: 013 = (approximately) 0:07
Predict.

Similarly, in the example shown in FIG. 11, when step 412 is performed for channel 3, the following is performed.
First, when calculating the difference between the code reception time of the intra-frame coded picture and the PTS,
0: 13-0: 09 = 0: 04,
0: 28-0: 21 = 0: 07,
0: 48-0: 42 = 0: 06,
1: 03-0: 58 = 0: 05,
1: 28-1: 23 = 0: 05,
1: 48-1: 42 = 0: 06,
2: 08-2: 03 = 0: 05,
2: 28-2: 23 = 0: 05,
2: 33-2: 29 = 0: 04,
2: 48-2: 45 = 0: 03,
It becomes.

Thus, when the expected value of the difference is calculated based on the difference information,
Expected value = (0: 04 + 0: 07 + 0: 06 + 0: 05 + 0: 05 + 0: 06
+0: 05 + 0: 05 + 0: 04 + 0: 03) / 10 = 0: 05.

  Further, when the square root of the variance of the difference is calculated based on the difference information, the result is as follows.

First, since the arithmetic mean is 0:05, the variance σ ² is
σ ² = {(0: 05-0: 04) ² + (0: 05-0: 07) ²
+ (0: 05-0: 06) ² + (0: 05-0: 05) ²
+ (0: 05-0: 05) ² + (0: 05-0: 06) ²
+ (0: 05-0: 05) ² + (0: 05-0: 05) ²
+ (0: 05-0: 04) ² + (0: 05-0: 03) ² } / 10
= 0: 00012
Therefore, the square root σ of the dispersion is approximately 0: 011.

If the percentage point of the specific probability is about 0.87, for channel 2, the difference between the code reception time of the intra-frame coded picture and the PTS (prediction difference value) is
0: 05 + 0.87 × 0: 011 = (approximately) 0:06
Predict.

Similarly, in the example shown in FIG. 11, when step 412 is performed for channel m, the result is as follows.
First, when calculating the difference between the code reception time of the intra-frame coded picture and the PTS,
0: 13-0: 07 = 0: 06,
0: 17-0: 11 = 0: 06,
0: 37-0: 30 = 0: 07,
0: 53-0: 44 = 0: 09,
1: 13-1: 05 = 0: 08,
1: 33-1: 26 = 0: 07,
1: 53-1: 45 = 0: 08,
2: 17-2: 10 = 0: 07,
2: 37-2: 30 = 0: 007,
3: 01-2: 55 = 0: 06,
It becomes.

Thus, when the expected value of the difference is calculated based on the difference information,
Expected value = (0: 06 + 0: 06 + 0: 07 + 0: 09 + 0: 08 + 0: 07
+0: 08 + 0: 07 + 0: 07 + 0: 06) / 10 = (approximately) 0:07.

  Further, when the square root of the variance of the difference is calculated based on the difference information, the result is as follows.

First, since the arithmetic mean is 0:07, the variance σ ² is
σ ² = {(0: 07-0: 06) ² + (0: 07-0: 06) ²
+ (0: 0-07-0: 07) ² + (0: 0-07-0: 09) ²
+ (0: 0-07-0: 08) ² + (0: 0-07-0: 07) ²
+ (0: 0-07-0: 08) ² + (0: 0-07-0: 08) ²
+ (0: 07-0: 07) ² + (0: 0-07-0: 06) ² } / 10
= 0: 0001
Therefore, the square root σ of the dispersion is approximately 0:01.

If the percentage point of the specific probability is about 0.87, for channel 2, the difference between the code reception time of the intra-frame coded picture and the PTS (prediction difference value) is
0: 07 + 0.87 × 0: 01 = (approximately) 0:08
Predict.

As described above, in the example of FIG. 11, the prediction difference values that are the difference between the code reception time of the intra-frame coded picture and the PTS in channel 1, channel 2, channel 3, and channel m are 0:06, 0:07, 0:06, 0:08.
In the present embodiment, the prediction difference value is calculated by the percentage point at which the cumulative probability is 80 percent. However, the present invention is not limited to this, and the percentage point at 90 percent or the percentage point at 70 percent may be used. May be.

  Then, based on the prediction PTS and the prediction difference value, the prediction value of the code reception time of the intra-frame coded picture is calculated (step S413) <Reception time prediction value calculation processing step or reception time prediction value calculation processing function>.

Specifically, from the prediction PTS and the prediction difference, for channel 1, the prediction value of the code reception time of the intra-frame encoded picture after the present is:
3: 05 + 0: 06 × (n−1) (n is a natural number),
It becomes.

Similarly, with respect to channel 2, the predicted value of the code reception time of the intra-frame coded pictures after the present is
3: 01 + 0: 07 × (n−1) (n is a natural number)
It becomes.

Similarly, with regard to channel 3, the predicted value of the code reception time of the intra-frame coded pictures after the present is
3: 03 + 0: 06 × (n−1) (n is a natural number),
It becomes.

Similarly, with respect to the channel m, the predicted value of the code reception time of the intra-frame coded pictures after the present is
3: 01 + 0: 08 × (n−1) (n is a natural number)
It becomes.

  In this way, the prediction code reception time is calculated for each channel. Then, for example, it is determined whether or not there is another channel for which a predicted value has not been calculated (step S414) <prediction code reception time calculation availability determination processing step or prediction code reception time calculation availability determination function>.

  In this determination process, when there is another channel for which the predicted code reception time has not been calculated, the process returns to step S410 and each step is processed. On the other hand, in this determination process, if there is no other channel for which the predicted code reception time has not been calculated, the process proceeds to the next step.

  Here, it is only an example that such a determination process (determining whether or not a process has been performed for another channel) is placed after the step S413, and it goes without saying that there are other various methods. For example, the process may be performed in the subsequent stage of step S410, the subsequent stage of step S411, the subsequent stage of step S412, and the subsequent stage of step S413. Further, the subsequent stage of step S410a, the subsequent stage of step S410b, and the step S412a. Processing may be performed for each of the subsequent stage, the subsequent stage of step S412b, the subsequent stage of step S412c, and the subsequent stage of step S412d.

(Selection control step)
Next, detailed processing of the selection control step for selecting and determining the channel cyclic order based on the predicted code reception time for each channel will be described.

  First, the time prediction / channel selection means 220 determines the channel cyclic order based on the predicted reception time of the intra-frame coded picture so that the representative image collection target channel cyclic time is the shortest, and in the cyclic order Channel selection is performed (step S415) <Channel cyclic order determination processing step or channel cyclic order determination processing function>.

Specifically, in the channel circulation order determination processing step, channel selection is performed in the order of priority set as follows.
That is, a process of acquiring information related to a threshold T_TH (specific threshold) for a time interval from the code reception time of the representative image collected in the past to the current time is performed in advance (step S415a) <threshold information acquisition processing step Or threshold information acquisition processing function>.

  Further, a process of calculating the difference (time difference) between the code reception time of the representative image collected in the past and the current time for each representative image collection target channel (step S415b) <reception time-current time difference calculation processing step Or reception time-current time difference calculation processing function>.

  The representative image collection target channel is divided into a set S_H (first channel set) in which the time difference is greater than or equal to the threshold T_TH and a set S_L (second channel set) in which the time difference is less than the threshold T_TH. Processing is performed (step S415c) <channel set division processing step or channel set division processing function>.

For example, assume that the threshold is specified as T_TH = 2: 15.
At this time, the representative image collection channel is divided into groups of the channel set S_H (first channel set) and the channel set S_L (second channel set) and grouped.
Channel set S_H = {2, 3, m},
Channel set S_L = {1}
And

Next, prioritization similar to that in the third embodiment is performed for each channel of the channel set S_H (first channel set) and the channel set S_L (second channel set) (step S415d) < Channel prioritization processing step or channel prioritization function>.
For example, for channels included in the channel set S_H (first channel set),
P (3)> P (2)> P (m)
Prioritization is performed so that.

  Further, the priority of channels included in the channel set S_H (first channel set) is determined to be higher than the priority of channels included in the channel set S_L (second channel set) (step S415e) <channel Aggregate prioritization processing step or channel aggregate prioritization function>.

That is, for any combination of channel CH_H included in channel set S_H (first channel set) and channel CH_L included in channel set S_L (second channel set), the relationship of priority P is
P (CH_H)> P (CH_L)
Prioritize so that

In this way, the priority is determined, and the final priority for all representative image collection target channels is determined in consideration of the aggregation priority and the channel priority.
P (3)> P (2)> P (m)> P (1)
(Step S415f) <final channel priority determination processing step or final channel priority determination processing function>. In this way, final priority assignment (decision of the cyclic order) in the channel cyclic order is performed.

  In summary, in the channel selection control step, for each representative image collection target channel, the difference between the code reception time and the current time of the representative image collected in the past is calculated, and each representative image is calculated based on the time difference. The channel to be collected is divided into multiple channel sets, and the priority of channel selection is determined by setting the set priority of each channel set that has priority over the channel priority of each channel unit. .

  In the channel selection control step, for each representative image collection target channel, a difference between the code reception time of the representative image collected in the past and the current time is calculated, and the representative image collection target channel The representative image collection target channel and the channel where the representative image has not been collected are set as a first channel set, the representative image collection target channel whose time difference is less than the specific threshold is set as a second channel set, and the first channel set is set as The channel priority of each channel in each channel set is set under a set priority setting condition that makes the priority higher than that of the second channel set.

(Patrol control step)
When such channel priorities are determined, processing for controlling the encoded stream receiving means 10 to perform channel selection is performed based on those priorities (step S416) <channel selection processing step or channel selection processing function >.

More specifically, based on the result of the priority determination described above, channel circulation is performed so that the encoded stream receiving means 10 is matched with channel 3, channel 2, channel m, and channel 1, respectively, and the channels are selected in order.
In this step, when one channel is selected for patrol, steps S104, S105, S106, and S107 shown in FIG. 7 are repeated for the one channel, and the other channels to be selected next are shown in FIG. Steps S104, S105, S106, and S107 shown in FIG. 6 are repeated, and thereafter the processing is repeated for each channel in the same manner.

  First, the time prediction / channel selection means 220 selects channel 3 from the representative image collection target channels (step S104 in FIG. 7).

  The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is the predicted reception time of the code of the intra-frame coded picture in channel 3 (step S106 in FIG. 7), the time prediction / channel selection unit 220 matches the encoded stream reception unit with channel 3, The moving image stream is received and output in the channel 3 (step S107 in FIG. 7), and the process returns to step S104.

  Since the code of the output moving image stream includes the code of the intra-frame coded picture, the representative image can be generated by the external device that has received the output moving image stream.

  Next, channel 2 is selected from the representative image collection target channels that have not been collected (step S104 in FIG. 7).

  The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is the predicted reception time of the code of the intra-frame encoded picture in channel 2 (step S106 in FIG. 7), the time prediction / channel selection unit 220 sets the encoded stream reception unit 10 to channel 2. The moving image stream is received and output in channel 2 (step S107 in FIG. 7), and the process returns to step S104.

  Next, the channel m is selected from the representative image collection target channels that have not been collected (step S104 in FIG. 7).

  The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is the predicted reception time of the code of the intra-frame coded picture in the channel m (step S106 in FIG. 7), the time prediction / channel selection unit 220 sets the encoded stream reception unit 10 to the channel m. The moving image stream is received and output in the channel m (step S107 in FIG. 7), and the process returns to step S104.

  Next, channel 1 is selected from the representative image collection target channels that have not been collected (step S104 in FIG. 7). The moving image receiving apparatus 1 as the representative image receiving apparatus acquires the system time with reference to the system clock 14 (step S105 in FIG. 7).

  When the system time is the predicted reception time of the code of the intra-frame encoded picture in channel 1 (step S106 in FIG. 7), the time prediction / channel selection unit 220 sets the encoded stream reception unit 10 to channel 1. Then, the moving image stream is received and output in channel 1 (step S107 in FIG. 7), and the process returns to step S104, and the moving image coded stream including the code of the intra-frame coded picture for all the representative image collection target channels. Since reception has been performed, the processing is completed.

(About effect)
As described above, according to the present embodiment, the same effects as in the first embodiment can be obtained, but in the present embodiment, in the prediction of the PTS of the intra-frame coded picture after the present, By using the known range of the PTS interval value of the inner coded picture, an effect of improving the accuracy of the PTS prediction of the intra-frame coded picture after the present can be obtained.

  In addition, in the prediction of the difference between the code reception time of the intra-frame coded picture and the PTS after the present, the probability distribution model of the difference between the code reception time of the intra-frame coded picture and the PTS is a normal distribution, and the lower cumulative probability is predetermined. Multiply the coefficient at the percentage point that is equal to or greater than the probability of the above by multiplying the square root of the difference value between the code reception time of the intra-frame coded picture received in the past and the PTS, and add the expected value of the difference to the product. By making the predicted value of the difference between the code reception time of the intra-frame coded picture after the current and the PTS, when the difference is random within a certain range, the prediction is performed accurately and the intra-frame within the current and subsequent frames An effect is obtained in which the probability that the code of the picture reaches the moving picture receiving apparatus before the predicted code reception time of the encoded picture is less than a predetermined probability. It is.

  Further, by performing the prioritization and channel selection, the collected representative image is displayed when the difference between the reception time of the collected representative image and the current time among the channels of the representative image collected is equal to or greater than the threshold value. It is determined that the image is too old, and new representative images are preferentially collected. If the value is less than the threshold, the collected representative images can be reused to omit or postpone new representative image collection.

  As a result, when the collection of a new representative image by reuse is omitted, it is possible to shorten the time until the use of a representative image having a predetermined immediacy or more becomes possible.

  Further, when the collection of new representative images by reuse is postponed, further improvement can be achieved while maintaining the immediacy of the representative images to be used at a predetermined level or higher.

  Other configurations, other steps, and operational effects thereof are the same as those in the first embodiment described above. In the above description, the operation content of each step described above and the components of each unit may be programmed and executed by a computer.

[Various modifications]
Also, although the apparatus and method according to the present invention have been described according to some specific embodiments thereof, the embodiments described in the text of the present invention can be used without departing from the spirit and scope of the present invention. Various modifications are possible.

  For example, in the above-described embodiment, the predicted PTS is calculated from the PTS interval value based on the past PTS (reproduction time information) that is an example of the periodic time information, and the difference between the past code reception time and the PTS is calculated. However, the present invention is not limited to this. For example, based on the past DTS (decoding time information) which is another example of the periodic time information, the predicted DTS is calculated from the DTS interval value, and the predicted difference value is calculated from the difference between the past code reception time and the DTS. It is good also as a structure to calculate.

  Specifically, an example of DTS is shown in FIG. DTS can also be predicted in the same manner as the PTS of the second embodiment. As an example, FIG. 16 shows a configuration, and FIG. 17 shows a processing procedure.

  The configuration of each part of the time prediction / channel selection means 320 in FIG. 16, the processing procedures in steps S510 to S514 and steps S215 to S216 in FIG. 17, and the operational effects thereof are the same as those in the second embodiment. The configuration and processing procedure are the same as those of the second embodiment except that the PTS is DTS.

  As another example, FIG. 19 shows a configuration, and FIG. 20 shows a processing procedure. The configuration of each part of the time prediction / channel selection means 420 in FIG. 19, the processing procedures in steps S610 to S614 and steps S315 to S316 in FIG. 20, and the operational effects thereof are the same as those in the third embodiment. The configuration and processing procedure are the same as those of the third embodiment except that PTS is set to DTS.

  As another example, FIG. 21 shows a configuration, and FIG. 22 shows a processing procedure. The configuration of each part of the time prediction / channel selection means 520 in FIG. 21, the processing procedures in steps S710 to S714 and steps S415 to S416 in FIG. 22, and the operational effects thereof are the same as those in the fourth embodiment. The configuration and processing procedure are the same as those in the fourth embodiment except that PTS is DTS.

  In addition, in the said prediction, the structure which estimates by combining PTS and DTS may be sufficient.

Furthermore, in the fourth embodiment described above, one of the PTS increments of the intra-frame encoded picture in the history is within a known range, but all the PTS increments of the intra-frame encoded picture in the history are all It may be outside the known range.
In that case, since the PTS increment of the intra-frame coded picture in the history is estimated to be a natural multiple of the actual PTS interval value, a divisor is calculated for one of the increments. , One of the divisors within a known range can be selected to predict the PTS interval value of the intra-frame coded picture.

  In the fourth embodiment, a common divisor is calculated for a plurality of increments of PTS increments of intra-frame coded pictures in the history, and a common divisor within the known range is selected. Thus, the PTS interval value of the intra-frame coded picture can be predicted.

In the fourth embodiment described above, the normal distribution (Gaussian distribution) is used as the probability distribution model. However, if there is another suitable probability distribution model (probability density function), it may be used. Is possible.
For example, the second prediction unit includes a chi-square distribution that is a continuous distribution, a beta distribution, a gamma distribution, an exponential distribution, a lognormal distribution, a Pareto distribution, a mixed distribution, a uniform distribution, a binomial distribution that is a discrete distribution, Poisson The prediction may be performed using a distribution, a geometric distribution, a negative binomial distribution, a multidimensional distribution, a multivariate normal distribution, other conditional distributions, a composite Poisson distribution, and the like.
Furthermore, according to the probability distribution model to be used, any statistic for the difference between the code reception time of the intra-frame coded picture in the history and the PTS may be used.

  In addition, the number, position, shape, and the like of the constituent members are not limited to the above-described embodiment, and can be set to a suitable number, position, shape, and the like in practicing the present invention. That is, in the above-described embodiment, the case of channel 1, channel 2, and channel m and the case of channel 1, channel 2, channel 3, and channel m are shown as the number of channels. The number is not limited.

  Furthermore, the operation of the moving picture receiving apparatus 1 described in the above embodiment is an example for obtaining the effect of the present invention, and the time prediction / channel selection means 20 receives the reception time of the intra-frame coded picture and Other configurations may be used as long as DTS or PTS is predicted and channel matching is performed in the encoded stream receiving unit 10 based on the prediction result.

  Specifically, the time prediction / channel selection means 20 operates so as to accurately calculate the reception time of the intra-frame coded picture by calculating in combination from known or accurately predictable time / time information. Is also an example.

  In addition, the time prediction / channel selection unit 20 may be configured to operate so as to limit the channel selection range by determining a representative image collection target channel based on viewer preference information and trend information of broadcast programs of each channel. is there.

  Also, based on the representative image collection history in each channel and the time information of the representative images collected in the past so that the time prediction / channel selection means 20 can effectively reuse the representative images collected in the past. Thus, a configuration may be adopted in which priority is given to the representative image collection target channel.

  In addition to the specific configuration example described above, a configuration in which the encoded stream receiving unit 10 can simultaneously receive a plurality of channels is also given as an example.

  A configuration in which the encoded stream receiving means 10 can receive a moving image stream broadcast (IP broadcast) via the Internet is also an example.

  The storage processing means 12 receives not only the reception time of the intra-frame encoded picture received in the past and the PTS or DTS, but also the reception time of the intra-frame encoded picture such as the picture number of the intra-frame encoded picture if available. A configuration that can store any information that can be used for prediction is also an example.

(program)
Further, the software program of the present invention that realizes the functions of the above-described embodiments is a program corresponding to the processing unit (processing means), functions, etc. shown in the various block diagrams in each of the above-described embodiments, Each processing program processed in a program corresponding to the processing procedure, processing means, function, etc. shown in the flowchart etc., a program using the data structure shown in the figure, etc., a method generally described in this specification (Step), the entire process or data (for example, DTS, PTS, predicted DTS, predicted PTS, code reception time, prediction code reception time, etc.) for each channel.

  Specifically, the program of the present invention is a computer-executable program, which includes a code reception time for receiving an intra-frame encoded picture of a moving image stream, reproduction time information included in the moving image stream, and decoding. A time information storage processing function (for example, reference numeral 12 shown in FIG. 1) for storing and processing periodic time information including one or both of time information for each of the moving image streams of a plurality of channels, and the time information A code reception time prediction function for predicting a code reception time of the intra-frame coded picture based on the periodic time information of the accumulation processing function (for example, a configuration including codes 22, 24, and 25 shown in FIG. 2); Based on the prediction code reception time information predicted by the code reception time prediction means, the channel of the video stream to be received is selected and controlled. Channel selection control function (e.g., such as code 26 shown in FIG. 2), it is intended to be executed by the computer functions including.

  Further, the data structure can be a data structure of time information used for moving image reception processing performed by a computer. This data structure includes: a code reception time for receiving an intra-frame coded picture of a moving picture stream; and periodic time information including one or both of reproduction time information and decoding time information included in the moving picture stream. The first structure can be stored (accumulated) in association with each moving image stream of a plurality of channels.

  In the first structure, the computer includes code reception time prediction processing (for example, processing including steps S210 to S214 illustrated in FIG. 8) and channel selection control processing (for example, steps S215 to S216 illustrated in FIG. 8). Process).

  This code reception time prediction process can predict the code reception time of the intra-frame coded picture based on the periodic time information. Further, the channel selection control process can select and control the channel of the video stream to be received based on the prediction code reception time information predicted by the code reception time prediction function.

  Here, the data structure includes a structure in which code time information and reproduction time information are formed for each channel, a structure in which code time information and decoding time information are formed for each channel, code time information and reproduction time information. And the structure in which the decoding time information is formed for each channel.

  The program described above may be in any form such as an object code, a program executed by an interpreter, or script data supplied to the OS. The program can be implemented in a high level procedural or object oriented programming language, or in assembly or machine language as required. In either case, the language may be a compiler or interpreted language. Also included is a program in which the above-described program is incorporated into application software that can be operated on a general personal computer or a portable information terminal.

  As a method of supplying the program, it is also possible to provide the program from an external device that is communicably connected to the computer via an electric communication line (whether wired or wireless). The program code constituting the program may be divided into a plurality of files.

  According to the program of the present invention, if the program is read from a storage medium such as a ROM storing the control program into a computer (CPU) and executed, or the program is downloaded to the computer via communication means. If it is executed after being executed, the above-described moving picture receiving apparatus according to the present invention can be realized relatively easily. When the software of the moving image receiving apparatus is realized as an embodiment of the idea of the invention, it naturally exists and is used on a storage medium storing such software.

  Moreover, the program is the same without any question about the copying stage of the primary copy product, the secondary copy product, etc. If the program is supplied using a communication line, the communication line becomes a transmission medium and the present invention is used.

(Information recording medium)
Moreover, the structure which recorded the program on the information recording medium may be sufficient. An application program including a program is stored in the information recording medium, and a computer can read the application program from the information recording medium and install the application program on the hard disk. Thus, the program can be provided by being recorded on an information recording medium such as a magnetic recording medium, an optical recording medium, or a ROM. Use of an information recording medium in which such a program is recorded in a computer constitutes a convenient information processing apparatus.

  As an information recording medium for supplying the program, for example, ROM, RAM, semiconductor memory such as flash memory and SRAM, and an integrated circuit, or a USB memory, memory card, optical disk, magneto-optical disk, magnetic recording medium and the like including them. Further, flexible disk, CD-ROM, CD-R, CD-RW, FD, DVDROM, HDDVD (HDDVD-R-SL <1 layer>, HDDVD-R-DL <2 layers>, HDDVD-RW) -SL, HDDVD-RW-DL, HDDVD-RAM-SL), DVD ± R-SL, DVD ± R-DL, DVD ± RW-SL, DVD ± RW-DL, DVD-RAM, Blu-Ray Disk <registration Trademark> (BD-R-SL, BD-R-DL, BD-RE-SL, BD-RE-DL), MO It is recorded on a portable medium such as ZIP, magnetic card, magnetic tape, SD card, memory stick, non-volatile memory card, IC card, etc., a storage device such as a hard disk built in a computer system, etc. Good.

  Furthermore, the “information recording medium” is a medium that dynamically holds a program for a short time (transmission medium), such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. Or a transmission wave), a volatile memory inside a computer system serving as a server or a client in that case, and those holding a program for a certain time.

  In addition, when an OS running on a computer, an RTOS on a terminal (for example, a mobile phone) performs part or all of the processing, the same functions as those in the above embodiment can be realized and An effect can be obtained.

  Furthermore, the program is encrypted, stored in a recording medium such as a CD-ROM, distributed to the user, and the user who clears the predetermined condition is allowed to download key information for decryption from the homepage via the Internet, and It is also possible to execute the encrypted program by using the key information and install the program on a computer. In this case, the configuration of the present invention may include each component (various means, steps and data) of the program and encryption means for encrypting the program (various means, steps and data).

  The apparatus of the above embodiment may be configured as a part of a client-server system or a system based on peer-to-peer (Peer to Peer) communication in which terminals form a network without passing through a server and transmit / receive data to / from each other. Good. At this time, the “system” may be configured as a system integrated with another “information processing system”. This “system” includes an OS and hardware such as peripheral devices.

  Furthermore, as an information processing apparatus in which the above-described program or the like is installed, the server is not limited to a personal computer, for example, but includes various servers, EWS (engineering workstation), medium-sized computers, mainframes, and the like. In addition to the above examples, information terminals include portable information terminals, various mobile terminals, PDAs, mobile phones, wearable information terminals, various (such as portable) televisions, DVD recorders, various acoustic devices, and various information communication functions. It may be configured to be usable from home appliances equipped with a computer, a game device having a network function, and the like.

  Further, the program may be for realizing a part of the above-described functions, and further, a program that can realize the above-described functions in combination with a program already recorded in a computer system, a so-called difference file ( Difference program).

  Further, in the present specification, the steps shown in the flowchart include processes that are executed in parallel or individually even if they are not necessarily processed in time series, as well as processes that are executed in time series according to the described procedure. It is a waste. In the implementation, the order in which the program procedures (steps) are executed can be changed. Further, certain procedures (steps) described herein can be implemented, removed, added, or rearranged as a combined procedure (step) as needed for implementation.

Further, the functions of the program such as each means, each function, and the procedure function of each step of the moving image receiving apparatus may be achieved by dedicated hardware (for example, a dedicated semiconductor circuit). A part of all functions may be processed by hardware, and another function among all functions may be processed by software. In the case of dedicated hardware, each unit may be formed by an integrated circuit such as an LSI. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them. Further, the LSI may include other functional blocks such as a streaming engine. Further, the method of circuit integration is not limited to LSI, and implementation with a dedicated circuit or a general-purpose processor is also possible. Further, if integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology or a derivative other technology, it is naturally also possible to carry out function block integration using this technology.
Further, in “communication”, wireless communication and wired communication as well as communication in which wireless communication and wired communication are mixed, that is, wireless communication is performed in a certain section and wired communication is performed in another section. There may be. Further, communication from one device to another device may be performed by wired communication, and communication from another device to one device may be performed by wireless communication.

  This communication includes a communication network. As a network constituting the communication network, for example, a cellular phone network (including a base station and an exchange system), a public phone network, an IP phone network, an ISDN network such as various network networks, the Internet (Nochi, TCP. Any hardware configuration such as communication mode using IP protocol), intranet, LAN (including Ethernet: registered trademark, gigabit Ethernet, etc.), WAN, optical fiber communication network, power line communication network, and various dedicated line networks compatible with broadband But you can. In addition to the TCP / IP protocol, the network may be any communication protocol such as a network using various communication protocols, a virtual network constructed in software, or a network including any network similar thereto. Further, the network is not limited to a wired network, but includes a wireless (including satellite communication, various high-frequency communication means, etc.) network (for example, a single carrier communication system such as a simple telephone system or a mobile phone, W-CDMA or IEEE 802.11b). Network including a spread spectrum communication system such as a wireless LAN, a multi-carrier communication system such as IEEE802.11a and HiperLAN / 2, etc., or a combination of these may be used. It may be a system connected to a network. Further, the network may take any form such as point-to-point, point-to-multipoint, multipoint-to-multipoint.

  In the communication structure between the moving image receiving apparatus and another communication apparatus, the type of interface formed on one or both of them is, for example, a parallel interface, a USB interface, IEEE1394, a network such as LAN or WAN, or the like. Any interface that is similar to this or that will be developed in the future may be used.

  Further, the method for predicting the code time information is not necessarily limited to a substantial apparatus, and it can be easily understood that the method also functions as the method. For this reason, the invention relating to the method is not necessarily limited to a substantial apparatus, and there is no difference that the method is also effective. In this case, a moving image receiving apparatus, a communication apparatus, etc. can be included as an example for realizing the method.

  By the way, such a moving image receiving apparatus may exist alone, or may be used in a state of being incorporated in a certain device (for example, an electronic device). Various embodiments are included. Therefore, it can be changed as appropriate, such as software or hardware. When the software of the branch predicting apparatus is realized as an example of realizing the idea of the invention, it naturally exists on a storage medium storing such software and must be used.

  Furthermore, it may be a case where a part is software and a part is realized by hardware, and a part is stored on a storage medium and is read as needed. It may be as a thing. When the present invention is realized by software, a configuration using hardware or an operating system may be used, or may be realized separately from these.

  Furthermore, the dependent claim in the apparatus can be configured to correspond to the dependent claim in the apparatus as a dependent claim in the method or program.

  Further, the above embodiments include various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. That is, examples include combinations of the above-described embodiments, or any of them and any of the modifications. In this case, even if not specifically described in the present embodiment, the obvious effects from the respective configurations disclosed in the respective embodiments and their modifications are naturally included as the operational effects of the embodiments. it can. On the contrary, the configuration capable of exhibiting all the effects described in the present embodiment is not necessarily an essential component of the essential features of the present invention. In addition, an embodiment based on a configuration in which some of the configuration requirements are deleted from all the configuration requirements shown in the embodiment, and a technical scope based on the configuration may be an invention.

In addition, the description so far including each of the embodiments and the modifications thereof is intended to facilitate the understanding of the present invention. The embodiments of the invention are merely shown as examples of implementation, are illustrative, not limiting, and can be modified and / or modified as appropriate. The present invention can be implemented in various forms based on its technical idea or its main features, and the technical scope of the present invention should not be construed in a limited manner by each embodiment and its modifications. It will not be.
Therefore, each element disclosed above is intended to include all design changes and equivalents belonging to the technical scope of the present invention.

  INDUSTRIAL APPLICABILITY The present invention is applicable to the computer industry, the communication industry, and other similar information processing industries. More specifically, the present invention receives a moving image stream transmitted through a plurality of channels in a fragmented manner while switching channels. It can be applied to applications such as devices.

It is a block diagram which shows an example of the whole structure of the moving image receiver by the 1st Embodiment of this invention. It is a block diagram which shows an example of a detailed structure of the intra-frame encoded picture reception time prediction and channel selection part of the moving image receiver by the 2nd Embodiment of this invention. It is a block diagram which shows an example of the detailed structure of the control means of the moving image receiver by the 2nd Embodiment of this invention. It is explanatory drawing which shows an example of a structure of the moving image encoding stream encoded using inter-frame prediction. It is explanatory drawing for demonstrating an example of the moving image stream in the moving image receiver of this invention. It is explanatory drawing for demonstrating an example of the code reception time and PTS of the intra-frame encoded picture by the 2nd Embodiment of this invention. It is a flowchart which shows an example of the whole process sequence of the moving image receiver by the 2nd Embodiment of this invention. It is a flowchart which shows an example of the detailed process sequence of the moving image receiver by the 2nd Embodiment of this invention. It is a block diagram which shows an example of a detailed structure of the intra-frame encoded picture reception time prediction and channel selection part of the moving image receiver by the 3rd Embodiment of this invention. It is explanatory drawing for demonstrating an example of the moving image stream used in addition in the moving image receiver by the 3rd Embodiment of this invention. In the moving picture receiver by the 3rd Embodiment of this invention, it is explanatory drawing for demonstrating an example of the code reception time of an intra-frame coded picture, and PTS. FIG. 10 is an explanatory diagram for explaining an example of a histogram of code reception times and PTS differences of intra-frame coded pictures received in the past in channel 1 in the moving picture reception device according to the third embodiment of the present invention. . It is a flowchart which shows an example of the detailed process sequence of the moving image receiver by the 3rd Embodiment of this invention. It is a block diagram which shows an example of a detailed structure of the intra-frame encoded picture reception time prediction and channel selection part of the moving image receiver by the 4th Embodiment of this invention. It is a flowchart which shows an example of the detailed process sequence of the moving image receiver by the 4th Embodiment of this invention. It is a block diagram which shows an example of a detailed structure of the intra-frame encoded picture reception time prediction and channel selection part of the moving image receiver of this invention. It is a flowchart which shows an example of the detailed process sequence of the moving image receiver of this invention. In the moving picture receiver of this invention, it is explanatory drawing for demonstrating an example of the code reception time of an intra-frame coded picture, and DTS. It is a block diagram which shows an example of a detailed structure of the intra-frame encoded picture reception time prediction and channel selection part of the moving image receiver of this invention. It is a flowchart which shows an example of the detailed process sequence of the moving image receiver of this invention. It is a block diagram which shows an example of a detailed structure of the intra-frame encoded picture reception time prediction and channel selection part of the moving image receiver of this invention. It is a flowchart which shows an example of the detailed process sequence of the moving image receiver of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Moving image receiver 10 Encoded stream receiving means 12 Accumulation processing means 14 System clock (time measuring part)
20 Time Prediction / Channel Selection Unit 22 First Prediction Unit 24 Second Prediction Unit 26 Channel Selection Unit

Claims (25)

Code reception time for receiving an intra-frame coded picture of a video stream, and periodic time information including one or both of playback time information and decoding time information included in the video stream, for each of a plurality of channels Time information storage processing means for storing each moving image stream;
Code reception time prediction means for predicting the code reception time of the intra-frame coded picture based on the periodicity time information of the time information storage processing means;
Channel selection control means for selecting and controlling the channel of the video stream to be received based on the prediction code reception time information predicted by the code reception time prediction means;
A moving image receiving apparatus comprising: The moving image receiving apparatus according to claim 1,
The code reception time prediction means includes
Considering each increment of each of the past periodic time information, predict the interval value of each of the periodic time information, the interval value of the predicted periodic time information and the last received in the past First predicting means for predicting the periodic time information of the intra-frame coded pictures after the current time based on the periodic time information;
Based on the code reception time and the periodicity time information of the intraframe encoded picture received in the past, the code time information and the periodicity time information of the intraframe encoded picture received after the present And the code reception time of the intra-frame coded picture after the present is predicted based on the predicted difference and the prediction periodicity time information predicted by the first prediction unit. A second predicting means,
A moving image receiving apparatus comprising: The moving image receiving apparatus according to claim 2,
The first prediction means includes
An apparatus for receiving a moving image, wherein the interval value of the periodic time information is predicted based on a common divisor of each increment of the periodic time information. The moving image receiving apparatus according to claim 2,
The first prediction means includes
A moving image receiving apparatus, wherein the interval value of the periodic time information is predicted based on a minimum value of each increment of the periodic time information. The moving image receiving apparatus according to claim 2,
The first prediction means includes
By selecting the increment that fits within the range of the specific range periodic time information interval value obtained from the known information from among the increments of each of the periodic time information, the interval value of the periodic time information A moving picture receiving apparatus characterized by predicting the above. The moving image receiving apparatus according to claim 2,
The second prediction means includes
The value obtained by adding a specific margin to the average value of the difference between the past code reception time and the periodic time information, and the code reception time and the periodicity time of the intra-frame coded picture received after the present A moving image receiving apparatus which is predicted to be a difference from information. The moving image receiving apparatus according to claim 2,
The second prediction means includes
A histogram of the difference between the past code reception time and the periodicity time information is generated, and a percentage point class with a cumulative probability equal to or greater than a certain percentage is selected from the histogram, and a representative value of this class is set as a current value. A moving picture receiving apparatus, which predicts a difference between the code reception time of the intra-frame coded picture received thereafter and the periodicity time information. The moving image receiving apparatus according to claim 2,
The second prediction means includes
Calculating the expected value and variance of the difference between the previous code reception time and the periodic time information, calculating the percentage value at which the cumulative probability in the probability distribution model followed by the difference is a specific probability, By calculating the sum of a value obtained by multiplying the square root of the variance by the coefficient and the expected value, using the value of the percent point as a coefficient, the code reception time and the periodicity of the intra-frame coded picture after the present are calculated. A moving image receiving apparatus that predicts a difference from time information. The moving image receiving apparatus according to claim 8, wherein
The second prediction means includes
A moving image receiving apparatus, wherein the difference is predicted using the probability distribution model as a standard normal distribution. The moving image receiving apparatus according to claim 1,
The channel selection control means includes
Based on the prediction code reception time predicted by the code reception time prediction means, the channel circulation order is determined and channel selection is performed so that the representative image collection target channel circulation time is minimized. Moving image receiving device. The moving image receiving device according to claim 10,
The channel selection control means includes
A moving image receiving apparatus characterized in that an approximate solution of a channel circulation order is obtained by performing depth-first search by repeatedly selecting the representative image collection target channel. The moving image receiving device according to claim 10,
The channel selection control means includes
Based on the prediction code reception time, an evaluation value is calculated with respect to a channel selection order, and channels are selected in order from the highest evaluation value. Alternatively, the moving image receiving apparatus is characterized in that the channel selection order is determined by calculation based on the acquisition time. The moving image receiving device according to claim 12,
The channel selection control means includes
The moving image receiving apparatus according to claim 1, wherein the evaluation value is calculated as a required traveling time for circulating the channel. The moving image receiving device according to claim 12,
The channel selection control means includes
A first evaluation showing a relationship between a previous code reception time of the intra-frame coded picture in the channel selected immediately before and the code reception time of the intra-frame coded picture received after the previous code reception time A moving image receiving apparatus characterized in that a function is calculated and an unselected channel having the smallest calculation result of the first evaluation function is selected as a channel to be first matched. The moving image receiving apparatus according to claim 14, wherein
The channel selection control means includes
When there are a plurality of unselected channels with the minimum calculation result of the first evaluation function, the second code reception time indicating the second code reception time of the intra-frame coded picture received after the immediately preceding code reception time The moving image receiving apparatus is characterized in that the evaluation function is calculated and an unselected channel with the maximum calculation result of the second evaluation function is selected as a channel to be matched first. The moving image receiving apparatus according to claim 14, wherein
The channel selection control means includes
The third evaluation function is calculated by calculating a third evaluation function indicating the relationship between the predicted periodicity time information of the intra-frame coded picture and the current time, and taking into account whether representative image collection has been performed in the past. A moving image receiving apparatus, wherein a function calculation result having a large value is set as a channel having a high priority, and the channels are selected and controlled in descending order of the priority. The moving image receiving apparatus according to claim 16,
The channel selection control means includes
When there are a plurality of channels having the same calculation result of the third evaluation function, the moving image is set such that the higher the priority is, the higher the channel of the first evaluation function is. Receiver device. The moving image receiving apparatus according to claim 17,
The channel selection control means includes
When the priority is set using the third evaluation function, if there are a plurality of channels where the calculation result of the first evaluation function is the same, the calculation result of the second evaluation function is large. A moving image receiving apparatus, wherein the priority is set such that the priority is higher for a channel. The moving image receiving device according to claim 10,
The channel selection control means includes
For each representative image collection target channel, the difference between the code reception time and the current time of the representative image collected in the past is calculated, and each representative image collection target channel is divided into a plurality of channel sets based on the time difference. An apparatus for receiving a moving image, characterized in that a priority of channel selection is determined by setting a set priority of each channel set that is given priority over a channel priority of each channel unit. Code reception time for receiving an intra-frame coded picture of a video stream, and periodic time information including one or both of playback time information and decoding time information included in the video stream, for each of a plurality of channels A time information storage process step for storing each moving image stream;
A code reception time prediction step for predicting a code reception time of the intra-frame coded picture based on the periodic time information of the time information storage processing step;
A channel selection control step for selecting and controlling a channel of the video stream to be received based on the prediction code reception time information predicted in the code reception time prediction step;
A moving image receiving method. The moving image receiving method according to claim 20,
The code reception time prediction step includes:
In consideration of the increment of each of the past periodic time information, an interval value of each of the periodic time information is predicted, and based on the predicted interval value of the periodic time information and the past periodic time information. A first prediction step of predicting the periodic time information of the intra-frame encoded pictures after the present;
A second prediction step of predicting the code reception time based on the prediction periodicity time information predicted in the first prediction step;
A moving image receiving method. The moving image receiving method according to claim 21, wherein
In the second prediction step,
A histogram of the difference between the past code reception time and the periodicity time information is generated, and a percentage point class with a cumulative probability equal to or greater than a certain percentage is selected from the histogram, and a representative value of this class is set as a current value. A moving picture receiving method, wherein a difference between the code reception time of the intra-frame coded picture received thereafter and the periodic time information is predicted. The moving image receiving method according to claim 21, wherein
In the second prediction step,
Calculate the expected value and variance of the difference between the past code reception time and the reproduction time information, respectively, calculate the percentage value at which the cumulative probability in the probability distribution model followed by the difference becomes a specific probability, By calculating the sum of a value obtained by multiplying the square root of the variance by the coefficient and the expected value using the value of the point as a coefficient, the code reception time and the periodicity time of the intra-frame encoded picture after the present are calculated. A moving image receiving method characterized by predicting a difference from information. The moving image receiving method according to claim 20,
In the channel selection control step,
Based on the prediction code reception time, an evaluation value is calculated with respect to a channel selection order, and channels are selected in order from the highest evaluation value. Alternatively, the moving image receiving method is characterized in that the channel selection order is determined by calculation based on the acquisition time. A computer executable program,
Code reception time for receiving an intra-frame coded picture of a video stream, and periodic time information including one or both of playback time information and decoding time information included in the video stream, for each of a plurality of channels A time information storage processing function for storing each moving image stream;
A code reception time prediction function for predicting a code reception time of the intra-frame coded picture based on the periodic time information of the time information storage processing function;
A channel selection control function for selecting and controlling the channel of the video stream to be received based on the prediction code reception time information predicted by the code reception time prediction function;
A program for causing a computer to execute a function including:

Images