JP5219122B2 - Electronics - Google Patents

Description

  The present invention relates to H.264. A technique for searching for the start point of the minimum unit of video decoding for video data encoded in the H.264 type without decoding the encoded transport stream (TS) data. About.

  Currently, the development of high-speed Internet communication networks such as light has improved the transmission path capacity so that even large amounts of video data can be transmitted easily, and the video encoding efficiency has improved and the transmission data size has become compact. Various streaming video distribution services at a practical level have been provided.

  By the way, streaming video distribution is a sequential data transmission method in which encoded TS (transport stream) data is sequentially transmitted to a client terminal along a reproduction time series. Therefore, when a random access operation such as a skip operation is performed on the client terminal side, the following procedure is taken. That is, first, request data including a playback position at a skip destination such as “2 minutes 30 seconds” is transmitted from the client terminal to the video distribution server. Then, the video distribution server refers to a prepared time chart (a table indicating the reproduction position and the encoded TS data at the position), and returns the encoded TS data to the client terminal from the position according to the request. That's it.

H. Since the MPEG encoded video data including the H.264 type uses inter-frame prediction (a technique for encoding / decoding with reference to the preceding and succeeding frames), frames that cannot be decoded independently (P, B frames) Etc.). Therefore, the time chart is created so as to be transmitted from the encoded TS data of the first frame (I frame or the like) of the minimum video decoding unit that can be decoded independently. That is, in the above time chart, for example, “2 minutes 29 seconds (the encoded TS data position of the 49th I frame)”, “2 minutes 32 seconds (the encoded TS data position of the 50th I frame)”,.・ The playback position in the minimum video decoding unit is shown. Therefore, the encoded TS data at the “23 minutes 30 seconds” point included in the request is, for example, a B frame that cannot be decoded independently, and is therefore encoded from an I frame of 2 minutes 29 seconds that approximates the request position. That is, TS data is returned to the client terminal.
JP 2003-018568 A

  However, the conventional techniques have the following problems. That is, as described above, in the time chart, the reproduction position needs to be shown in the minimum video decoding unit. Here, in the case of encoded TS data encoded in the Mpeg2 type, a so-called “GOP (Group of Pictures)” called “GOP (Group of Pictures)” is encoded at the beginning of the data structure encoded in the smallest unit that can be decoded. A start code indicating the start of GOP is defined. Therefore, a time chart satisfying the above condition can be generated by searching the start code of the GOP with the encoded TS data without decoding the encoded TS data and acquiring the frame information.

  However, the Mpeg2 type is generally H.264. Compared to the H.264 type, it is said to have an encoding compression efficiency of 1/2 to 1/3, and the amount of encoded TS data tends to be extremely large in order to maintain a certain level of image quality. Therefore, the Mpeg2 type is not a compression encoding format suitable for streaming video distribution.

  However, H.P. is a compression encoding format suitable for streaming video distribution. In the H.264 type (including other Mpeg4 parts), the definition corresponding to the start code of the GOP is not made. Therefore, when generating a time chart, it is necessary to search the reproduction position of the minimum unit of video decoding by once decoding the encoded TS data into frame data and acquiring the frame information.

  Therefore, H.H. In the case of streaming distribution of video data encoded in the H.264 type, there is a problem that time and computer resources are conventionally required to generate a time chart, which is troublesome.

  In order to solve the above-described problems, the present invention provides H.264. The present invention provides a technique capable of searching for the starting point of the minimum unit of video decoding without decoding H.264 type encoded TS data. Specifically, assuming that one “SPS (data including encoding information in sequence units)” is included in the minimum video decoding unit, “AU Delimiter (data access) in front of the SPS is assumed. Provided is an electronic device having a function of determining that “the data indicating the head of a unit” ”is a boundary of a minimum unit of video decoding.

  More particularly, A “time reference acquisition unit” that acquires a time reference arranged immediately after the transport stream header of H.264 type encoded transport stream data, and a “start search unit” that searches for the start byte position of the video decoding minimum unit And the acquired time reference, the byte position where the time reference is arranged, the start byte position of the video decoding minimum unit searched by the start search unit, the decoding bit rate when decoding by the playback device, The “start time information acquisition unit” that acquires start time information indicating the time at which the start position of each video decoding minimum unit is to be reproduced.

  In addition, an electronic device control method for controlling the electronic device so as to realize the above function is also provided. In addition, this invention is H.264. It is not necessarily limited to the encoded TS data of H.264 type (that is, various standards including Mpeg4 part 10), and includes an encoding type standardized by parts other than Mpeg4 part 10.

  According to the present invention having the above-described configuration, H.264 can be used. It is possible to find an SPS that can be searched with H.264 type encoded TS data as it is, and obtain the reproduction time of the AU delimiter before the SPS as the reproduction time of the start position of the video decoding minimum unit. Therefore, H.H. Even in the H.264 type, it is possible to search for the start position of the minimum unit of video decoding without decoding the encoded TS data and generate a time chart showing the reproduction time.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to these embodiments, and can be implemented in various modes without departing from the spirit of the present invention.

  In the first embodiment, claims 1, 5, 6, 7, and 8 will be mainly described. In the second embodiment, claim 2 will be mainly described. In the third embodiment, claim 3 will be mainly described. In the fourth embodiment, claim 4 will be mainly described.

  Example 1

    <Overview>

  FIG. 1 is a conceptual diagram for explaining an example of encoded TS data distributed from a video distribution server which is an example of an electronic apparatus of the present embodiment, and a time chart thereof. As shown in FIG. 1A, the encoded TS data is composed of “access units” whose boundaries are indicated by an AUD (AU delimiter). However, for example, the moving image data 2 included in the access unit of the AUD 2 is moving image data starting from the B frame as shown in FIG. 1B. Cannot be decrypted.

  On the other hand, the video data 1 and video data 3 included in the access units of AUD1 and AUD3 immediately before the SPS are video data starting from an I frame as shown in FIG. A stream can be transmitted as the head of the minimum unit.

  Therefore, in the electronic apparatus of this embodiment, the position of the AUD (AU delimiter) arranged immediately before the SPS portion is searched as the head of the video decoding minimum unit, for example, as described above. Then, by calculating the reproduction time (reproduction position) of the head position of the searched AU delimiter, for example, “00: 02.29”, “00: 02.32”, etc., without decoding the encoded TS data. A time chart as shown in FIG. 1C is generated.

  Here, in this embodiment, a method for calculating the reproduction time of the head position such as this AU delimiter without decoding the data will be described below with reference to a more detailed data structure of the encoded TS data shown in FIG. Explained. As shown in this figure, the encoded TS data is composed of a collection of TS packets of, for example, 188 bytes. As described above, for example, the head position (β1) of the AUD immediately before SPS (α1) can be set as the head position of the video decoding minimum unit. An example of using PCR (γ1) in order to calculate the reproduction time of the head position will be described here. “PCR” includes information (for example, 140 seconds) indicating the timing at which moving image data immediately after that is output from the decoder buffer for reproduction, and is arranged in the encoded TS data. Therefore, the distance between this PCR placement position and the head position of the AUD immediately before the SPS, that is, the encoded data amount is calculated, and the bit rate (data amount per unit time of the decoded video data) is calculated. The elapsed time (for example, 9 seconds) is calculated. Then, the playback time “149 seconds” of the head position of the video decoding minimum unit is calculated by adding or subtracting the elapsed time to or from the time reference indicated by PCR.

    <Functional configuration>

  FIG. 3 is a diagram illustrating an example of functional blocks in the electronic apparatus according to the present embodiment. As shown in this figure, the “electronic device” (0300) of the present embodiment includes a “time reference acquisition unit” (0301), a “first search unit” (0302), and a “first time information acquisition unit” (0303). And having.

  Note that “electronic device” refers to a device including an arithmetic circuit, a memory, and an I / O (input / output), and here refers to a device further provided with a function of reproducing and distributing video data. In addition, the electronic apparatus according to the present invention may be incorporated into, for example, a server apparatus having the above-described configuration and functions, or may be incorporated into a client terminal apparatus having a function of performing video distribution using P2P (peer to peer) technology. Alternatively, it may be incorporated in a recorder or the like that stores and reproduces broadcast video data as a TS stream.

  The functional blocks of the electronic device described below can be realized as hardware, software, or both hardware and software. Specifically, if a computer is used, a CPU, a main memory, a bus, or a secondary storage device (a hard disk, a non-volatile memory, a storage medium such as a CD or a DVD, a reading drive for the medium, etc.), a printing device And display devices, hardware components such as other external peripheral devices, I / O ports for the external peripheral devices, driver programs and other application programs for controlling these hardware, and users used for information input Examples include interfaces.

  Then, by CPU processing according to the program developed on the main memory, the data input via the interface and stored in the memory and hard disk are processed and stored, and the above hardware and software are controlled. Instructions are generated. In addition to the general-purpose computer as described above, the arithmetic circuit and the program may be realized as a dedicated device realized on a single hardware, and may be incorporated into a server device or a terminal device.

  In addition, the present invention can be realized not only as an electronic device but also as a method. A part of the invention can be configured as software. Furthermore, a software product used for causing a computer to execute such software and a recording medium in which the product is fixed to a recording medium are naturally included in the technical scope of the present invention (the same applies throughout the present specification). Is).

  The “time reference acquisition unit” (0301) has a function of acquiring a time reference from the encoded TS data. “Time reference” This is information indicating various timings such as decoding and reproduction of a frame that is arranged in the TS packet header of H.264 type encoded TS data and immediately after that. Specifically, for example, the playback time of a frame included immediately after itself, the output timing from the decoder buffer, and the like can be mentioned. Therefore, for example, if the timing “2 minutes 29 seconds” is indicated in the time reference, the frame arranged immediately after the time reference in the encoded TS data is “2 minutes 29 seconds” from the decoder buffer. It will be output to VRAM for playback. Then, as described with reference to FIG. 2, the playback time of the video decoding minimum unit is calculated using the distance from the time reference to the first byte position of the video decoding minimum unit. For this purpose, it is preferable to acquire information including information indicating the arrangement position in association with the time reference acquired here.

  Examples of the time reference include the above-mentioned “PCR”. In this case, the time reference acquisition unit may include “PCR acquisition means” (0404) for acquiring the time reference from the PCR portion of the transport stream as shown in FIG. Specifically, the placement position of the PCR in the TS packet is fixed (immediately after the TS header), but is not necessarily included in all TS packets (the PCR is placed in which TS packet) This depends on the encoder settings).

  Therefore, the PCR acquisition means first determines whether the PCR is arranged in a 188-byte TS packet as shown in FIG. In the determination process of the presence / absence of the arrangement, since the arrangement position of the PCR in the TS packet is determined as described above, a value at a predetermined position where the PCR is to be arranged in the TS packet is determined. Can be judged. If it is determined that the PCR is included, the time reference indicated by the PCR and the arrangement position thereof can be acquired.

  Hereinafter, an example of the PCR acquisition process by the PCR acquisition means will be described with reference to the flowcharts of FIGS. As described above, the PCR acquisition unit first determines whether a PCR is arranged in the TS packet. That is, as shown in FIG. 5, 188 bytes (one packet) of TS packets are read from a predetermined read data position of the encoded TS data (step S0501) and stored in the main memory or the like. Subsequently, the 27th bit value a of the read 188-byte data is acquired (step S0502). If it is determined by the CPU logical operation processing (step S0503) that the value of a is not 1, the packet is not included in the PCR (step S0507), and 1 is added to a loop counter (not shown). Further, the next TS packet is read and the above determination process is repeated.

  On the other hand, when the determination result that a = 1 is output, the value b of the 44th bit from the beginning of the 188-byte data is acquired (step S0504), and it is determined whether the value is 1 or not. Processing is executed (step S0505). If the determination result that b = 1 is output as a result of the determination process, it is assumed that the read TS packet includes the PCR (step S0506), and then, as shown in FIG. Is calculated. In addition, the calculation processing of the PCR arrangement position may be executed together with it.

  As shown in FIG. 6A, when it is determined that there is a PCR by the above-described processing, a binary value (PCR base value) of 48 bits to 81 bits from the head of the read 188 bytes of data is obtained. Conversion into a decimal number e (step S0601).

  PCR Base (specified in ISO / IEC13818-1 2.4.3.4) indicates the processing timing in terms of the number of clocks in a 90 kHz base clock. It is necessary to convert to a value corresponding to the H.264 base clock. Here, for example, H.R. If the H.264 base clock is 27 MHz, the value e may be multiplied by 300. Therefore, in this processing example, a value E obtained by multiplying the PCR base value e by, for example, 300 times (this value may vary depending on the base clock) is calculated (step S0602).

  However, when the value E is set to 300 times as described above, the accuracy of the PCR Base value is lowered. Therefore, in order to compensate for the decrease in accuracy, PCR Extension data (specified in ISO / IEC13818-1 2.4.3.4) indicated by PCR is used. Specifically, a binary value (PCR Extension) of 88 to 97 bits from the head of the 188-byte data is converted into a decimal number f (step S0603). Then, in order to add the complement value f to E and convert the value into “seconds”, etc. By dividing by H.264 base clock (for example, 27 MHz), a time reference (such as the number of seconds) indicated by PCR is calculated (step S0604).

  In addition, as shown in FIG. 6B, the arrangement position of the PCR may be calculated here. Specifically, when it is determined that there is PCR as a result of the PCR presence / absence determination process as shown in FIG. 5, the data reading position is calculated. Specifically, for example, the loop counter is counted when the process of determining whether a PCR is included in a 188-byte TS packet is repeated. When the value of the loop counter is 4, that is, when PCR is included in the fourth TS packet, the read position is a value obtained by adding “12 bytes” to 188 × 4 bytes = 752 bytes. This is because the arrangement position in the PCR TS packet (188-byte data) is fixed, and the position is the 12th byte from the beginning of the TS packet.

  Subsequently, in the electronic apparatus of the present embodiment, the first byte position of the minimum video decoding unit is acquired with the following configuration.

  The “head search section” (0302) has a function of searching for the head byte position of the minimum video decoding unit. The “video decoding minimum unit” refers to the minimum unit of a data structure that can be decoded independently in encoded TS data, and includes, for example, a data structure unit including a frame of “IBB • P”. . The present invention is characterized in that “SPS” arranged in the encoded TS data is used to search for the head of this video decoding minimum unit. “SPS (sequence parameter set)” refers to a header portion in an encoded TS stream in which information related to encoding of a reference sequence such as an encoding profile and an encoding level is indicated. More specifically, a search is made such that the first byte position of the SPS, the neighboring byte position, and the like are searched as the first byte position of the video decoding minimum unit.

  For example, in this embodiment, using the distance between the “time reference arrangement position” acquired by the previous time reference acquisition unit and the “first byte position of the minimum video decoding unit” acquired here, That is, it is possible to calculate the playback time of the minimum video decoding unit.

  As the first byte position of the video decoding minimum unit, not only the first byte position of the SPS itself but also the “first byte position of the AU delimiter arranged immediately before the SPS part” as described above can be cited. . In this case, as shown in FIG. 4, the head search unit includes AU delimiter acquisition means (0405) for acquiring the AU delimiter arranged immediately before the SPS portion as the head byte position of the video decoding minimum unit. It is good to have. Specifically, first, it is determined whether or not a predetermined value indicating SPS is included in the data read in TS packet units (188 byte units). For example, the first byte position of the AU delimiter is acquired.

  Hereinafter, an example of the acquisition process of the AU delimiter arranged immediately before the SPS portion by the AU delimiter acquisition unit will be described with reference to the flowchart of FIG. As shown in this figure, first, the loop counter is set to 0 (step S0701), and 188 bytes of encoded TS data are read from a predetermined read data position of the encoded TS data (initially the beginning of the data) (step S0701). S0702).

  Subsequently, it is determined by logical operation processing of the CPU whether any one of A (0x00000127), B (0x00000147), and C (0x00000167) is included in the read data (step S0703). Note that one of the values A, B, and C is an SPS identification value that is always included in the SPS. If the above-mentioned value is not included, SPS is not included in the read 188-byte data for one packet, and 1 is added to the loop counter (step S0704), and the read data position is set to 188 bytes ahead. (Step S0705) and the above process is repeated.

  If any of the values A, B, and C is present in the read TS packet, it can be determined that the SPS portion is included in the TS packet. Here, when using the SPS itself instead of the AU delimiter, from the appearance byte position of the SPS in the read TS packet and the loop counter value (the number of 188-byte TS packets read until the SPS discovery), The first byte position of the SPS in the entire encoded TS data may be calculated as the first byte position of the video decoding minimum unit.

  On the other hand, when the AU delimiter acquisition unit acquires the AU delimiter, the first byte position of the AU delimiter immediately before the SPS found by the above-described processing is acquired.

  However, when the encoded TS data is divided into TS packets of 188 bytes, one AU delimiter may be divided and exist separately in the preceding and following packets, for example, as in the third packet shown in FIG. is there. Therefore, the AU delimiter acquisition unit may execute the following processing, for example.

  That is, as shown in FIG. 7, when a determination result indicating that there is an SPS in the TS packet read by the determination processing in step S0703 is output, the AU delimiter is included in the subsequently read 188-byte data. It is determined whether or not the identification value D (0x00000109) is included (step S0706).

  If the value D is included, the AU delimiter is included in the 188-byte data including the SPS (the AU delimiter is not separated), and the AU is included in the TS packet currently read. The head of the delimiter will be present. Therefore, first, the number of appearance bytes x1 of D from the head of the read 188-byte data is acquired (step S0707y). Subsequently, the loop counter r × 188 + x1 is acquired as the first byte position of the video decoding minimum unit (the first byte position of the AU delimiter immediately before the SPS) (step S0708y).

  On the other hand, if it is determined in step S0706 that the value D is not included, the AU delimiter is separated (or just separated at the boundary between the AU delimiter and the SPS), and the head thereof is one before the read packet data. Existing in the packet data. Therefore, in this case, the number of appearance bytes x2 of D from the head of the 188-byte data immediately before the read data is acquired (step S0707n). Subsequently, (r−1) × 188 + x2 is acquired as the first byte position of the video decoding minimum unit (step S0708n).

  By the way, since the number of bytes of the AU delimiter is fixed at 6 bytes, for example, 6 bytes before the head of the found SPS may be specified as the head byte position of the AU delimiter, and the head byte position may be acquired. Specifically, the head byte position can be acquired as shown in FIG. S2601 to S2605 in FIG. 26 have the same processing contents as S0701 to S0705. When a determination result indicating that an SPS is present in the read TS packet is output (step S2603), the difference between the beginning of the read 188-byte data and the appearance byte position of any of A, B, and C is obtained. It is determined whether it is 6 bytes or more (step S2606).

  If the difference is 6 bytes or more, the head of the AU delimiter is present in the 188-byte data including the SPS (AU delimiter is not separated), and the AU is included in the TS packet currently read. The head of the delimiter will be present. Therefore, first, the number of appearance bytes y1 of any one of A, B, and C from the head of the read 188-byte data is acquired (step S2607y). Subsequently, the loop counter r × 188 + y1 + 6 is acquired as the first byte position of the video decoding minimum unit (the first byte position of the AU delimiter immediately before the SPS) (step S2608y).

  On the other hand, if it is determined in step S2606 that the difference is less than 6 bytes, the AU delimiter is separated (or just separated at the boundary between the AU delimiter and the SPS), and the head of the packet is one packet before the read packet data. It exists in the data. Therefore, in this case, the number of occurrence bytes y2 of any one of A, B, and C from the head of the 188-byte data immediately before the read data is acquired (step S2607n). Subsequently, (r−1) × 188 + y2 is acquired as the first byte position of the video decoding minimum unit (step S2608n).

  In this embodiment, the “PCR time (time reference)”, “time reference arrangement position”, and “starting byte position of video decoding minimum unit” calculated in this way are used as follows. In this way, the time for reproducing the head position of the video decoding minimum unit is calculated.

  The “start time information acquisition unit” (0303) includes the acquired time reference, the byte position where the time reference is arranged, the start byte position of the video decoding minimum unit searched by the start search unit, and the playback device It has a function to acquire the start time information from the decoding bit rate when decoding with. “Head time information” refers to information indicating the time at which the head position of each video decoding minimum unit is to be reproduced, and includes time information indicated by timing output from the decoder buffer, for example. And the time chart for random access is produced | generated using this head time information. The “decode bit rate” refers to the amount of data per unit time of decoded video data, and includes values such as 500 kbps (the amount of video data per second is 500 kbit).

  Regarding the acquisition of “time reference”, “time reference arrangement (byte) position”, and “starting byte position of video decoding minimum unit”, which are parameters for calculating the start time information, the above-described configurations The description is omitted because it is described in the requirements. Here, another process for obtaining “decoding bit rate”, which is a parameter for calculation, and calculation process for head time information using these parameters will be described in detail below.

  First, the decoding bit rate calculation method includes the following method. That is, for example, the arrangement positions of two PCRs are acquired, and the distance (data amount) between the PCRs is calculated. Since each PCR value represents a time reference indicating the input time to the decoder, the difference value of the time reference indicates the video data reproduction time between the two PCRs. Therefore, by dividing “distance between two PCRs (data amount)” by “reproduction time of video data between two PCRs (time-based difference value)”, the data amount per unit time of decoded video data, That is, the decoding bit rate is calculated.

  FIG. 8 is a flowchart showing an example of the above-described processing flow for acquiring the decoding bit rate of encoded TS data. As shown in this figure, first, one PCR time T1 is acquired by the process shown in FIG. Subsequently, in order to acquire the next PCR, a position obtained by adding 188 bytes from the previous read data position is set as the read data position (step S0801).

  In the next PCR discovery process, the loop counter rb for bit rate calculation is set to 1 (step S0802). Then, 188 bytes (one packet) of data is read from the read data position set in S0801 (step S0803). Subsequently, the process as shown in FIG. 5 is performed to determine whether the next PCR is included in the read 188-byte data (step S0804). As a result of the determination process (step S0805), if the next PCR is not included, the read data position is set to the position after adding 188 bytes (step S0806), and 1 is added to the loop counter rb (step S0805). S0807), the above process is repeated.

  If it is determined that there is a next PCR as a result of the PCR presence / absence determination process, the process shown in FIG. 6 is executed to obtain a time reference T2 for the next PCR (step S0808). Then, the difference value t between the previous PCR time T1 and the next PCR time T2 is acquired as a value indicating the reproduction time of the moving image data between the PCRs (step S0809). Since the PCR is arranged immediately after the TS header of 188-byte data (TS packet), the amount of data between both PCRs is equal to the amount of data read. Accordingly, the number of repetitions rb × 188 required from the discovery of one PCR to the discovery of the next PCR is calculated, and the data amount d is calculated (step S0810).

  Finally, the “decoding bit rate per unit time” is calculated by dividing the “data amount d between both PCRs” by the “difference time t between both PCRs”. In calculating the decoding bit rate, in the above processing example, the decoding bit rate is calculated including data other than video data such as PCR and SPS header. However, the decoding bit rate is calculated only for video data. Also good.

  Then, in the encoded TS data having the data structure as shown in FIG. 2, the data is obtained from the difference between the “time-based arrangement byte position” (γ1) and the “first byte position of the video decoding minimum unit” (β1). Calculate the amount. Then, by dividing the calculated data amount by the “decoding bit rate”, the reproduction time indicated by the output timing to the decoder buffer of the frame included in the data is calculated. Then, by adding the calculated reproduction time to the “time reference” indicated by PCR, it is possible to calculate the reproduction time in β1, that is, the head time information.

  As described above, the electronic device of the present embodiment can acquire the start time information that is the reproduction time of the video decoding minimum unit without decoding the encoded TS data. Then, each head time information in the encoded TS data can be sequentially acquired by repeating the above processing, and a time chart for random access can be generated.

  In the electronic apparatus according to the present embodiment, the configuration in which TS packets are read sequentially from the front in the acquisition of time reference and other processes has been described as an example. Of course, the above processes are performed by reading sequentially from the back. It may be configured.

    <Process flow>

  Hereinafter, an example of the overall flow in the start time information calculation process of the present embodiment will be described with reference to FIGS. Note that the steps shown below may be processing steps that constitute a program for controlling a computer recorded on a medium. First, in the electronic apparatus of the present embodiment, various parameters are initialized in order to calculate head time information.

  FIG. 9 is a flowchart showing an example of this initialization process. As shown in this figure, the PCR position is set to 0 (step S0901), and the PCR time is also set to 0 (step S0902). Further, the loop counter is set to 0 (step S0903).

  The bit rate value is set to 0 (step S0904), and the bit rate loop counter is set to 0 (step S0905). Further, the read data position is set to 0 (step S0906), and the bit rate read data position is also set to 0 (step S0907). Further, the AU delimiter value is set to 0 (step S0908), and the difference value is also set to 0 (0909).

  After the parameters are initialized as described above, the bit rate calculation process is performed. Here, the reason why the bit rate calculation process is performed before the search for the first byte position of the video decoding minimum unit is to deal with the following exception process. That is, in the above-described processing, the PCR is first acquired for the calculation of the bit rate. However, if the video decoding minimum unit is acquired before the PCR acquisition exceptionally, the bit rate up to the first byte position of the video decoding minimum unit remains unknown. Therefore, in order to deal with such an exception, the bit rate is first obtained.

  FIG. 10 is a flowchart showing an example of a bit rate calculation process for this exceptional process. As shown in this figure, first, the above-described various parameter initialization processing is executed (step S1001), and then 188 bytes (one packet) of data is read from the read data position (step S1002). Then, the PCR presence / absence determination process as shown in FIG. 5 is executed (step S1003). If the PCR is not included in the read data, the read position is set to 188 bytes (step S1004). Repeat the presence / absence determination process. Then, when a determination result indicating that there is a PCR is output, the bit rate is (provisionally) calculated by a process as shown in FIG. 6 or FIG. 8 (step S1004).

  Then, the read data position is returned to 0 (step S1005), the PCR position and the PCR time are set to 0 (step S1006), and the next start time information calculation process is executed.

  H. When encoding with the H.264 type, the bit rate is a so-called “VBR” in which the code amount per unit time is variable. Therefore, it is desirable to calculate the bit rate by using a PCR in the vicinity of each video decoding minimum unit.

  FIG. 11 is a flowchart showing an example of calculation of head time information executed after the exception processing. As shown in this figure, first, the process shown in FIG. 5 is executed to read 188 bytes of data and determine whether there is a PCR in the read data (step S1101). Here, if the determination result that there is no PCR in the read 188-byte data and the determination result that the SPS and the AU delimiter are present is output in step S1105, The bit rate calculated in the above exception process is used.

  On the other hand, if a determination result indicating that PCR is present is output in step S1101, PCR time acquisition (step S1102) and PCR position acquisition (step S1103) are executed as shown in FIG. Subsequently, processing as shown in FIG. 8 is executed, and a new bit rate is calculated (step S1104).

  Subsequently, as shown in FIG. 7, a process for determining whether or not there is an SPS in the read 188-byte data is executed (step S1105). As a result, when it is determined that there is no SPS, 1 is added to the loop counter r (step S1106), and the processing from the PCR determination is repeated.

  On the other hand, it is determined that there is an SPS, and as shown in FIG. 7, the first byte position of the AU delimiter immediately before the SPS is acquired (step S1107), and the “PCR position” is subtracted from the “AU delimiter position”. A difference position L (bytes) is calculated (step S1108). Then, the “difference position L” is divided by the “bit rate”, and the “PCR time” is added to calculate head time information (step S1109). Further, the head time information and the AU delimiter position calculated in this way are output to a time chart and referred to at the time of random access.

    <Hardware configuration>

  FIG. 12 is a schematic diagram illustrating an example of the configuration of the electronic device when the functional components are realized as hardware. The operation of each hardware component in the acquisition process of the start time information will be described using this figure.

  As shown in this figure, the electronic apparatus includes a “CPU (central processing unit)” (1201) and a “main memory” (1202) for performing various arithmetic processes. Also, an “HDD” (1203) that holds encoded TS data for stream video distribution and a time chart for random access, and a “communication IF (interface)” (0804) connected to a network for distributing video by streaming. ). They are connected to each other via a data communication path such as a “system bus” to transmit / receive information and process information.

  A program is read into the “main memory”, and the “CPU” interprets the read program and executes various arithmetic processes. In addition, a plurality of addresses are assigned to the “main memory”, “HDD”, cache in the “CPU”, and the like, and in the arithmetic processing of the “CPU”, the address is specified and stored. It is possible to perform arithmetic processing using data by accessing.

  Here, first, according to the time chart generation program, 188 bytes of data from the beginning of the encoded TS data is read from “HDD” to address 1 of “main memory”. Subsequently, the loop counter, PCR time, PCR position, AU delimiter position, bit rate, etc. set (initialization) stored in each address of the “main memory” are executed, whereby each parameter value is set to 0. The

  Then, the “CPU” performs the PCR presence / absence determination process as described above according to the program. That is, the value a of the 27th bit and the value b of the 44th bit from the head in the 188-byte data read at the address 1 of the “main memory” are acquired. Then, the process of determining whether or not both values are 1 is executed by the logical operation process of “CPU”. Here, when a determination result that either one of the values of a and b is not 1 is output, the value of the loop counter stored at the address 2 of the “main memory” is incremented by 1 and the next 188 bytes worth is obtained. The encoded TS data reading and the PCR presence / absence determination process are repeated.

  When the determination result that both values a and b are 1 is output, the “CPU” executes the calculation process of the PCR time and the PCR position as described above according to the program. That is, the 48- to 81-bit value (PCR Base) of the read 188-byte data is converted to a decimal number by the arithmetic processing of “CPU” and multiplied by 300. Then, the 88- to 97-bit value (PCR Extension) of the 188-byte data is converted into a decimal number by the arithmetic processing of “CPU” and added to the calculated value. Then, the value is divided by 27M and stored as “PCR time” at address 3 of “main memory”. In addition, the value stored in the loop counter is multiplied by 188 by the arithmetic processing of “CPU”, and 12 bytes are added to the value to calculate “PCR position”, which is stored in address 4 of “main memory”. Is done.

  Subsequently, the “CPU” performs the decoding bit rate calculation process as described above according to the program. That is, the next 188 bytes of data are read and the next PCR is detected. Then, the difference value t between the two PCR times is calculated as a value t indicating the reproduction time of the moving image data between the PCRs. Also, the loop counter value for bit rate calculation stored at the address 6 of the “main memory” is multiplied by 188 to calculate the data amount d between both PCRs. Then, the value of “t / d” is calculated by the calculation process of “CPU”, and stored as “decode bit rate value” at address 7 of “main memory”.

  Subsequently, the “CPU” performs the acquisition process of the first byte position of the video decoding minimum unit as described above according to the program. That is, it is determined by logical operation processing of “CPU” whether any one of A (0x00000127), B (0x00000147), and C (0x00000167) is included in the read data. When the determination result that the above value is not included is output, 1 is added to the loop counter stored at address 2 of the “main memory”, and then the next 188 bytes of data are stored in the “main memory”. Read to address 1 of “memory” and repeat the above process.

  If the determination result that any one of the values A, B, and C is included in the read data is output, the AU delimiter is divided as shown in FIG. To determine whether it exists. Then, using the value of the loop counter and the value of the first byte position of the AU delimiter as variables, the “first byte position of the minimum video decoding unit” is calculated by “CPU” calculation processing and stored in address 5 of “main memory”. To do.

  Then, as described above, the calculation of “CPU” is performed using “PCR time”, “PCR position”, “decoding bit rate value”, and “starting byte position of video decoding minimum unit” stored in each address as parameters. First time information is calculated by processing. That is, the data amount is calculated from the difference between the “time-based arrangement byte position” and the “first byte position of the minimum video decoding unit”. Then, the reproduction time of the frame included in the data is calculated by dividing the calculated data amount by the “decoding bit rate”. Then, by adding the calculated playback time to the “time reference” indicated by PCR, the top playback time of the video decoding minimum unit, that is, the top time information is calculated and stored in address 8 of “main memory”. , And so on.

  Then, the head time information obtained in this way is stored in the “HDD” as a time chart in association with the head byte position of the video decoding minimum unit, thereby responding to a random access command from a client terminal on the network. I can do it.

  << Other Examples of Example 1 >>

    <Overview>

  In the above-described embodiment, an example in which PCR is used as a time reference has been described. In addition to this, for example, if encoded TS data is transport stream data with a time stamp, an example in which a time stamp is used as a time reference is also given. It is done.

  FIG. 13 is a conceptual diagram illustrating an example of a TTS packet of a transport stream with a time stamp. Note that the TS packet part (188-byte data part) shown in this figure has the same data structure as the TS packet shown in FIG. A feature of the data structure of the TTS packet is that data of 4 bytes is always added as a time stamp (time reference) at the head of the TS packet.

  That is, the “PCR” that is the time reference in the TS packet is not necessarily arranged in the TS packet, and therefore it is necessary to perform the detection (determination of arrangement presence / absence) processing of the PCR as described above. On the other hand, in the case of a TTS packet in a transport stream with a time stamp, a time reference “time stamp” is always placed at the beginning of the packet, so that the determination processing of the presence / absence of the placement can be omitted from the above processing. It is.

    <Functional configuration>

  FIG. 14 is a diagram illustrating an example of still another functional block in the electronic apparatus according to the present embodiment. As shown in this figure, an “electronic device” (1400) having another configuration of the present embodiment further includes a “time stamp time reference acquisition unit” (1404) in a “time reference acquisition unit” (1401). It is characterized by that. Other configurations (time reference acquisition unit, head search unit, head time information acquisition unit, AU delimiter acquisition unit) have already been described, and thus description thereof is omitted.

  The “time stamp time reference acquisition unit” (1404) has a function of acquiring a time reference from a time stamp located at the beginning of a TS packet of a transport stream with a time stamp. Since the time stamp is always added to the head of the TTS packet, the head time information can be acquired by executing the above-described processing in which the presence / absence determination processing is omitted.

    <Process flow>

  FIG. 15 and FIG. 16 are flowcharts illustrating an example of the flow of the start time information calculation process in another electronic device of the present embodiment. As shown in FIG. 15, first, the loop counter is set to 0 (step S1501), the read data position is set to 0 (step S1502), and the AU delimiter value is set to 0 (step S1503). Run.

  Then, as shown in FIG. 16, after the initialization process of each parameter (step S1601), the encoded TS data is transferred from the predetermined read data position (initially, the top of the data) to 192 bytes. Minutes are read (step S1602).

  Subsequently, it is determined by logical operation processing of the CPU whether any one of A (0x00000127), B (0x00000147), and C (0x00000167) is included in the read data (step S1603). If the above-mentioned value is not included, SPS is not included in the read 192-byte data for one packet, and 1 is added to the loop counter (step S1604), and the read data position is set to 192 bytes ahead. (Step S1605) and the above process is repeated.

  If any of the values A, B, or C is included in the read data, the SPS portion is included in the data, so that the head position of the AU delimiter that is placed immediately before that is included. Perform the acquisition process. In this case as well, in consideration of the fact that one AU delimiter is divided in the 192-byte TTS packet, the leading value D (0x00000109) of the AU delimiter is included in the read 192-byte data. Is included (step S1606).

  If the value D is included, it is assumed that the head of the AU delimiter is present in the 192-byte data including the SPS (AU delimiter is not separated). First, a 4-byte time stamp value is acquired from the beginning of the read 192-byte data (1607y). Further, the value of 192 × loop counter r is acquired as the time stamp position. Subsequently, the number of appearance bytes x1 of D from the beginning of the 192-byte data is obtained, and the value of the loop counter r × 188 is added to the value of x1, thereby obtaining the beginning byte position of the video decoding minimum unit. (Step S1608y). That's it.

  On the other hand, if it is determined in step S1606 that the value D is not included, the AU delimiter is separated, and the head thereof is present in the packet data immediately before the read packet data. Therefore, in this case, a 4-byte time stamp value is acquired from the head of the 192-byte data immediately before the read data (step S1607n). Also, a value of 192 × (r−1) is acquired as the time stamp position. Also, the number of appearance bytes x2 of D from the head of the read data is acquired, and (r-1) × 188 + x2 is acquired as the head byte position of the video decoding minimum unit (step S1608n).

  In any case, the time reference value is calculated by dividing the acquired time stamp value by 27M (step S1609). Thus, in the present embodiment, the above process can be executed without the time reference presence / absence determination process.

  Then, using the acquired “starting byte position of minimum video decoding unit”, “time stamp time”, “time stamp position”, and “decoding bit rate value”, the starting time information can be calculated. The “decoding bit rate value” calculation process and the start time information acquisition process are the same as those described above, and a description thereof will be omitted.

    <Hardware configuration>

  FIG. 17 is a schematic diagram illustrating an example of a configuration of an electronic device when the functional components described above are realized as hardware. The operation of each hardware component in the acquisition process of the start time information with reference to the time stamp information will be described using this figure. As described above, except for omitting the time stamp information presence / absence determination process, the process is almost the same as the process for acquiring the start time information with reference to the PCR.

  As shown in this figure, the electronic device includes a “CPU” (1701), a “main memory” (1702), an “HDD” (1703), and a “communication IF” (1704).

  Here, according to the time chart generation program, first, 192 bytes of data from the head of the encoded TS data is read from “HDD” to address 1 of “main memory”. Subsequently, initialization processing of parameter values including a loop counter stored at each address of the “main memory” is executed.

  Then, according to the program, the “CPU” first performs the acquisition process of the first byte position of the video decoding minimum unit as described above. Specifically, it is determined by logical operation processing of “CPU” whether any one of A (0x00000127), B (0x00000147), and C (0x00000167) is included in the read data. When the determination result that the above value is not included is output, 1 is added to the loop counter stored at address 2 of the “main memory”, and then the next 192 bytes of data are stored in the “main memory”. Read to address 1 of “memory” and repeat the above process.

  If the determination result that the value of any one of A, B, and C is included in the read data is output, the value of the loop counter and the value of the first byte position of the AU delimiter are used as variables, The “starting byte position of minimum video decoding unit” is calculated by the calculation process of “CPU” and stored in address 5 of “main memory”.

  Subsequently, according to the program, the “CPU” executes time stamp time and time stamp position calculation processing as described above. That is, the value is acquired from the read 4-byte data of the 192 read, and the “time stamp time” calculated by dividing the value by 27M is stored in the address 3 of the “main memory”. Further, the “time stamp position” is calculated by multiplying the value stored in the loop counter by 188 by the calculation processing of “CPU”, and is stored in the address 4 of “main memory”. When the AU delimiter exists separately in the TTS packet, the time stamp time and the time stamp position may be calculated for the previous TTS packet with the loop counter set to (r−1).

  Subsequently, according to the program, the “CPU” calculates the “decode bit rate” as described above and stores it in the address 6 of the “main memory”. Then, the data amount is calculated from the difference between the “time stamp position” and the “first byte position of the minimum video decoding unit”. Then, the reproduction time of the frame included in the data is calculated by dividing the calculated data amount by the “decoding bit rate”. Then, the start time information is calculated by adding the calculated reproduction time to the “time stamp time” and stored in the address 7 of the “main memory”.

    <Brief description of effect>

  As described above, in the electronic apparatus of this embodiment, the The reproduction time of the head position of the video decoding minimum unit can be acquired with the H.264 type (including other types of Mpeg4) encoded TS data. Therefore, H.H. Even in the H.264 type, it is possible to search for the start position of the minimum unit of video decoding without decoding the encoded TS data and generate a time chart indicating the reproduction time.

  << Example 2 >>

    <Overview>

  The electronic apparatus according to the present embodiment is further characterized in that, based on the first embodiment, further has a function of holding the calculated start time information in an HDD or the like. Then, as in the present embodiment, the head time information is held in the HDD or the like, and a time chart is generated, so that it is possible to deal with random access to streaming distribution video data.

    <Functional configuration>

  FIG. 18 is a diagram illustrating an example of functional blocks in the electronic apparatus of the present embodiment. As shown in this figure, the “electronic device” (1800) of the present embodiment is based on the first embodiment and includes a “time reference acquisition unit” (1801), a “first search unit” (1802), Time information acquisition unit "(1803). Further, it may have “PCR acquisition means”, “AU delimiter acquisition means”, “time stamp time reference acquisition means”, etc. (not shown). In addition, since these component requirements have already been described in the said Example, the description is abbreviate | omitted.

  A feature point of the electronic apparatus of the present embodiment is that it further includes a “first time information holding unit” (1804).

  The “first time information holding unit” (1804) has a function of holding the first time information acquired by the first time information acquisition unit, and can be realized by, for example, an HDD, a flash memory, or another storage medium.

  FIG. 19 is a conceptual diagram showing an example of a time chart including head time information held by the head time information holding unit. As shown in this figure, the video decoding minimum unit that approximates the requested playback time is obtained by correlating the start time information calculated by the above processing with the start byte position of the AU delimiter and making a time chart. The encoded TS data at the head can be returned to the requesting terminal.

    <Process flow>

  FIG. 20 is a flowchart illustrating an example of a processing flow in the electronic apparatus of the present embodiment. Note that the steps shown below may be processing steps that constitute a program for controlling a computer recorded on a medium.

  As shown in this figure, the process as described in the first embodiment is executed, and the start time information is acquired (step S2001). Then, the acquired start time information is recorded in a holding unit such as an HDD (step S2002), and a time chart as shown in FIG. 19 is created using the recorded and held start time information, for example. (Step S2003).

    <Brief description of effect>

  As described above, the first time information can be held in the HDD or the like by the electronic apparatus of the present embodiment. Then, by generating a time chart using the held start time information, it is possible to deal with random access to streaming delivery video data.

  Example 3

    <Overview>

  Based on the above embodiment, the electronic device of this embodiment accepts a random access request from a video playback terminal, and specifies identification information for identifying a video decoding minimum unit to be transmitted according to the received request. It further has the function to perform.

    <Functional configuration>

  FIG. 21 is a diagram illustrating an example of functional blocks in the electronic apparatus according to the present embodiment. As shown in this figure, the “electronic device” (2100) of the present embodiment is based on the first embodiment and includes a “time reference acquisition unit” (2101), a “first search unit” (2102), Time information acquisition unit "(2103). Further, it may have “PCR acquisition means”, “AU delimiter acquisition means”, “time stamp time reference acquisition means”, etc. (not shown). In addition, since these component requirements have already been described in the said Example, the description is abbreviate | omitted.

  The feature of the electronic apparatus of the present embodiment is that it further includes a “reproduction start position input receiving unit” (2104) and a “reproduction start minimum unit ID acquisition unit” (2105).

  The “playback start position input receiving unit” (2104) has a function of receiving an input for designating the playback start position by the elapsed time after the start of playback of the content. This input reception can be realized by a “communication IF” that receives designation information input from another terminal via a network, considering that the basic embodiment of the present invention is video distribution.

  Specifically, for example, a seek bar of a video playback player of another terminal is operated, and elapsed time information after playback start such as “2 minutes 30 seconds” specified by the operation is received as request information.

  The “reproduction start minimum unit ID acquisition unit” (2105) has a function of acquiring the video decoding minimum unit ID to be reproduced first using the received elapsed time after reproduction start and the start time information. The “video decoding minimum unit ID” refers to identification information indicating the video decoding minimum unit searched by the head search unit. The video decoding minimum unit ID is determined according to the start byte position of the video decoding minimum unit and the arrangement order thereof. Examples include a serial number assigned to the minimum decryption unit. This reproduction start minimum unit ID acquisition unit can be realized by referring to a time chart as shown in FIG. 19, for example, and executing a search process by a logical operation process of the CPU. Then, by obtaining the reproduction start minimum unit ID, for example, the start byte position, etc., the video decoding to be reproduced at a time approximate to the elapsed time after the reproduction start requested from the video reproduction terminal. The minimum unit can be acquired.

    <Hardware configuration>

  FIG. 22 is a schematic diagram illustrating an example of a configuration of an electronic device when the functional components described above are realized as hardware. The operation of each hardware component in the process of acquiring the reproduction start minimum unit ID will be described using this figure.

  As shown in this figure, the electronic device includes a “CPU” (2201), a “main memory” (2202), an “HDD” (2203), a “communication IF” (2204), as in the above-described embodiment. It is equipped with.

First, in accordance with the above-described time chart generation program, first time information is acquired, and a time chart using the first time information is stored in “HDD”. Subsequently, when the elapsed time after the reproduction start is acquired from the client terminal on the network, such as “2 minutes 30 seconds”, in the “communication IF”, it is stored in the address 1 of the “main memory”. Then, the search processing of the time chart stored in “HDD” is executed by the logical operation processing of “CPU” using the elapsed time after the start of reproduction as a key. In the time chart, the start byte position of the minimum playback start unit associated with the start time information approximate to the elapsed time after the start of playback is acquired and stored in address 2 of the “main memory”.

    <Process flow>

  FIG. 23 is a flowchart illustrating an example of a processing flow in the electronic apparatus of the present embodiment. Note that the steps shown below may be processing steps that constitute a program for controlling a computer recorded on a medium.

  As shown in this figure, the processing as described in the first embodiment is executed, and the start time information is acquired (step S2301). After that, when the designation input of the elapsed time after the start of reproduction is received (step S2302), the reproduction start minimum unit ID, for example, the first byte position is obtained from the designated input elapsed time after the reproduction start and the first time information. (Step S2303).

    <Brief description of effect>

  As described above, the video decoding minimum unit to be played back at the time approximate to the elapsed time after the start of playback requested by the video playback terminal can be acquired by the electronic apparatus of the present embodiment.

  Example 4

    <Overview>

  The electronic apparatus according to the present embodiment is based on the third embodiment, and functions to respond to a random access playback request from a video playback terminal using the acquired playback start minimum unit ID, for example, the start byte position thereof. Is further provided.

    <Functional configuration>

  FIG. 24 is a diagram illustrating an example of functional blocks in the electronic apparatus of the present embodiment. As shown in this figure, the “electronic device” (2400) of the present embodiment is based on the third embodiment and includes a “time reference acquisition unit” (2401), a “first search unit” (2402), A "time information acquisition unit" (2403), a "reproduction start position input reception unit" (2404), and a "reproduction start minimum unit ID acquisition unit" (2405). Further, it may have “PCR acquisition means”, “AU delimiter acquisition means”, “time stamp time reference acquisition means”, etc. (not shown). In addition, since these component requirements have already been described in the said Example, the description is abbreviate | omitted.

  The feature of the electronic apparatus of the present embodiment is that it further includes a “holding unit” (2406) and a “reproduction start minimum unit ID acquisition unit” (2407).

  The “holding unit” (2406) It has a function of holding head time information in association with an H.264 type encoded transport stream, and can be realized by, for example, an HDD, a flash memory, or a storage medium thereof.

  The “sending unit” (2407) It has a function of sending a H.264 type encoded transport stream from the byte position specified by the reproduction start minimum unit ID, and can be realized by, for example, a communication IF, its control circuit, or a communication application.

  With the above configuration, the video decoding to be played back at the time approximate to the elapsed time after the start of playback using the playback start minimum unit ID acquired by the request of the video playback terminal (the elapsed time after the start of playback) Transmission of video data starting from the smallest unit can be executed.

    <Process flow>

  FIG. 25 is a flowchart illustrating an example of a processing flow in the electronic apparatus of the present embodiment. Note that the steps shown below may be processing steps that constitute a program for controlling a computer recorded on a medium.

  As shown in this figure, the process as described in the first embodiment is executed, and the start time information is acquired (step S2501). The acquired first time information is recorded in the holding unit in association with the encoded TS data (step S2502).

  After that, when the designation input of the elapsed time after the start of reproduction is received (step S2503), the reproduction start minimum unit ID, for example, the first byte position thereof is acquired from the designated input elapsed time after the reproduction start and the first time information. (Step S2504). Then, the encoded TS data is transmitted from the byte position specified by the acquired first byte position of the minimum reproduction start unit (step S2505).

    <Brief description of effect>

  As described above, the electronic device of the present embodiment approximates the elapsed time after the start of playback by using the start byte position of the minimum playback start unit acquired by the request of the video playback terminal (the elapsed time after the start of playback). It is possible to execute transmission of video data starting from the minimum video decoding unit to be reproduced at the time to be played.

Conceptual diagram for describing an example of encoded TS data distributed from a video distribution server, which is an example of the electronic apparatus according to the first embodiment, and a time chart thereof. Conceptual diagram showing an example of a more detailed data structure of encoded TS data distributed by the electronic apparatus of the first embodiment FIG. 6 is a diagram illustrating an example of functional blocks in the electronic apparatus according to the first embodiment. FIG. 6 is a diagram illustrating an example of another functional block in the electronic apparatus according to the first embodiment. 7 is a flowchart illustrating an example of PCR presence / absence determination processing by the PCR acquisition unit of the electronic device according to the first embodiment. 7 is a flowchart illustrating an example of a PCR acquisition process by a PCR acquisition unit of the electronic device according to the first embodiment. 7 is a flowchart illustrating an example of acquisition processing of an AU delimiter arranged immediately before the SPS portion by the AU delimiter acquisition unit of the electronic device according to the first embodiment. 8 is a flowchart illustrating an example of a flow of processing for obtaining a decoding bit rate of encoded TS data in the electronic apparatus according to the first embodiment. 7 is a flowchart illustrating an example of an initialization process in the first time information calculation process of the electronic device according to the first embodiment. 7 is a flowchart illustrating an example of a bit rate calculation process for exception processing in the first time information calculation process of the electronic device according to the first embodiment. 7 is a flowchart illustrating an example of a start time information calculation process in the electronic device according to the first embodiment. 1 is a diagram illustrating an example of a hardware configuration in an electronic device according to a first embodiment. Conceptual diagram showing an example of a TTS packet of a transport stream with a time stamp distributed by the electronic device of the first embodiment FIG. 10 is a diagram illustrating an example of still another functional block in the electronic apparatus according to the first embodiment. 7 is a flowchart illustrating an example of a flow of an initialization process in the start time information calculation process of another electronic device according to the first embodiment. 10 is a flowchart illustrating an example of the flow of start time information calculation processing in another electronic device according to the first embodiment. FIG. 6 is a diagram illustrating an example of another hardware configuration in the electronic apparatus according to the first embodiment. FIG. 6 is a diagram illustrating an example of functional blocks in an electronic device according to a second embodiment. The conceptual diagram showing an example of the time chart containing the head time information hold | maintained in the head time information holding part of the electronic device of Example 2. 7 is a flowchart illustrating an example of a process flow in the electronic device according to the second embodiment. FIG. 6 is a diagram illustrating an example of functional blocks in an electronic apparatus according to a third embodiment. FIG. 6 is a diagram illustrating an example of a hardware configuration in an electronic device according to a third embodiment. 10 is a flowchart illustrating an example of a process flow in the electronic device according to the third embodiment. FIG. 6 is a diagram illustrating an example of functional blocks in an electronic device according to a fourth embodiment. 10 is a flowchart illustrating an example of a process flow in the electronic device according to the fourth embodiment. 7 is a flowchart illustrating an example of acquisition processing of an AU delimiter arranged immediately before the SPS portion by the AU delimiter acquisition unit of the electronic device according to the first embodiment.

Explanation of symbols

0300 Electronic equipment 0301 Time reference acquisition unit 0302 First search unit 0303 First time information acquisition unit 0404 PCR acquisition unit 0405 AU delimiter acquisition unit 1404 Time stamp time reference acquisition unit

Claims (13)

A time reference acquisition unit for acquiring a time reference arranged in the encoded transport stream data of the compressed video information;
A head search unit for searching for the head byte position of the video decoding minimum unit;
Each video decoding is performed by adding the time reference to the difference between the byte position where the time reference is arranged and the first byte position of the video decoding minimum unit divided by the decoding bit rate when decoding by the playback device. A start time information acquisition unit for acquiring start time information indicating the time at which the start position of the minimum unit is to be reproduced;
Electronic equipment having   The electronic device according to claim 1, further comprising a start time information holding unit that holds start time information acquired by the start time information acquisition unit. A playback start position input receiving unit for receiving an input for specifying a playback start position by an elapsed time after starting playback of the content;
A reproduction start minimum unit ID acquisition unit for acquiring a video decoding minimum unit ID to be reproduced first using the received elapsed time after reproduction start and the start time information;
The electronic device according to claim 1, comprising: A holding unit for holding head time information in association with the encoded transport stream of compressed video information;
A sending unit for sending an encoded transport stream of compressed video information from a byte position specified by a reproduction start minimum unit ID;
The electronic device according to claim 3, further comprising:   The electronic device according to claim 1, wherein the time reference acquisition unit includes a PCR acquisition unit that acquires a time reference from a PCR portion of a transport stream.   The electronic apparatus according to any one of claims 1 to 5, wherein the time reference acquisition unit includes time stamp time reference acquisition means for acquiring a time reference from a time stamp located at the beginning of a TS packet of a transport stream with a time stamp. machine.   The electronic device according to claim 1, wherein the head search unit includes an AU delimiter acquisition unit configured to acquire an AU delimiter arranged immediately before the SPS portion as a head byte position of a video decoding minimum unit. A time reference acquisition step of acquiring a time reference arranged in the encoded transport stream data of the compressed video information;
A head search step for searching a head byte position of a video decoding minimum unit;
Each video decoding is performed by adding the time reference to the difference between the byte position where the time reference is arranged and the first byte position of the video decoding minimum unit divided by the decoding bit rate when decoding by the playback device. A start time information acquisition step for acquiring start time information indicating a time at which the start position of the minimum unit is to be reproduced;
For controlling electronic equipment that causes a computer to execute the above.   9. The method of controlling an electronic device according to claim 8, further causing the computer to execute a first time information recording step for recording the first time information acquired in the first time information acquisition step. A playback start position input receiving step for receiving an input for specifying a playback start position by an elapsed time after the start of playback of the content;
A reproduction start minimum unit ID obtaining step for obtaining a video decoding minimum unit ID to be reproduced first using the received elapsed time after reproduction start and the start time information;
10. The method for controlling an electronic device according to claim 8, further comprising: causing the computer to execute. A method for controlling an electronic device having a holding unit that holds head time information in association with an encoded transport stream of compressed video information,
11. The method of controlling an electronic device according to claim 10, further causing a computer to execute a sending step of sending a compressed transport stream of compressed video information from a byte position specified by a reproduction start minimum unit ID. The electronic apparatus according to claim 1, wherein the start time information acquisition unit calculates the decode bit rate before calculating the start byte position of the video decoding minimum unit. 9. The method of controlling an electronic device according to claim 8, wherein the start time information acquisition step calculates the decode bit rate before calculating the start byte position of the video decoding minimum unit.

Images