JP4991579B2 - Playback device - Google Patents

Description

The present invention also relates to the reproducing apparatus of video data.

  2. Description of the Related Art Conventionally, an apparatus that encodes moving image data by a motion compensation predictive encoding method such as MPEG and records the same on a recording medium is known. In the MPEG system, moving image data is encoded by selectively using intra-frame encoding and inter-frame encoding, and an intra-frame encoded image (so-called I picture or intra-frame encoded picture) is a moving picture. Discretely arranged in the image data.

  When reproducing moving image data recorded in the MPEG system, frames (P picture and B picture) that are inter-frame encoded cannot be decoded unless the reference frame is decoded. Therefore, first, it is necessary to decode the intra-frame encoded frame (I picture). Also, in the case where cueing and reproducing an arbitrary position in moving picture data encoded by the MPEG method, it is also necessary to start decoding from an I picture.

  Accordingly, it has been proposed to store the display timing (PTS: Presentation Time Stamp) of each I picture in the moving image data and the position information (TSN) in the moving image data as management information. Specifically, when the IN point is instructed by the PTS, the I picture (a) having the nearest (immediately preceding) PTS (a) below the instructed PTS is searched from the management information, and the The TSN (a) indicating the storage start position of the I picture (a) and the subsequent parts are decoded. Thus, reproduction from a desired frame or picture is realized.

  In photographing with a digital video camera or the like, management information loss often occurs when a momentary interruption or removal of a recording medium is performed before or during writing of management information. When the management information is lost, even if the moving image data is intact, the I picture corresponding to the IN point cannot be detected, and as a result, the moving image data cannot be reproduced.

Japanese Patent Application Laid-Open No. 2004-151867 describes a technique for searching for moving image data from the beginning to the end and restoring management information. Patent Document 2 describes a technology that uses a non-volatile memory to restore management information.
JP 2006-033239 A JP 2001-266696 A

  With the technique described in Patent Document 1, when the moving image data is large, the search process takes time, and it takes a lot of time to return to a state where it can be actually played back, which causes great stress on the user.

  In the technique described in Patent Document 2, a nonvolatile memory is essential.

An object of the present invention is to provide a playback device that restores management information without using a non-volatile memory without causing the user to feel stress.

The reproduction apparatus according to the present invention includes a plurality of first frames that are intra-coded, and moving image data that includes a second frame that is inter-frame encoded between the first frames, and the moving image data When the management information including position information related to the position in the moving image data of the plurality of first frames in the video is reproduced from the recording medium, and the management information is not correctly recorded on the recording medium, Repairing means for repairing the management information recorded on the recording medium, wherein the repairing means detects the first frame from the moving image data reproduced by the reproducing means, and detects the detected first frame. Recorded on the recording medium so as to include position information related to the position of the first frame in the moving image data and not to include the position information of the first frame other than the first frame. Characterized in that it repair the serial management information.

The reproduction apparatus according to the present invention includes a plurality of first frames that are intra-coded, and moving image data that includes a second frame that is inter-frame encoded between the first frames, and the moving image data When the management information including position information related to the position in the moving image data of the plurality of first frames in the video is reproduced from the recording medium, and the management information is not correctly recorded on the recording medium, A restoration unit for restoring the management information recorded on the recording medium, wherein the restoration unit reproduces a predetermined amount of the moving image data reproduced while seeking from the recording medium every predetermined amount of data. The first frame is detected from the recording medium and recorded on the recording medium so as to include position information related to the position in the moving image data of each of the detected plurality of first frames. Characterized by repairing the management information.

  According to the present invention, when there is a defect in the management information, the management information is partially repaired in a short time so that it can be reproduced in a short time, and the management information is completely restored in subsequent sequential reproduction. To do. Partial repairs can avoid situations that cannot be regenerated. In addition, since the time-consuming complete restoration is executed behind the sequential reproduction, the management information can be completely restored without putting stress on the user.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows a schematic block diagram of an embodiment of the present invention, and FIG. 2 shows a moving image data recording format of the present embodiment.

With reference to FIG. 2, the recording format in the present embodiment will be described. The moving image data is obtained by encoding the moving image with the H.264 encoding method. After encoding with H.264 / MPEG4-AVC, the data is multiplexed into a transport stream (hereinafter referred to as TS). That is, moving image data is coded using intra-frame coding and inter-frame coding, discretely contain intra-frame coded picture, including inter-frame coded picture between the intra-frame coded picture.

  Management information is attached to each moving image data. The management information stores I picture information, user information, and playback function mask information of the corresponding moving image data. In the I picture information, the PTS information of each I picture (intra-frame coded picture) in the moving image data and the TS packet number (TSN) at which the I picture starts are stored in ascending order. In the user information, a code indicating the repair status of the management information is stored. The playback function mask information is a bitmap indicating a function of masking (rejecting use) among playback functions.

  The reproduction list includes a table in which the IN point (display start picture) and the OUT point (display end picture) of each moving image data are sequentially stored in PTS.

  The configuration of the present embodiment will be described with reference to FIG. The recording medium 10 includes a hard disk or a flash memory card. The recording medium 10 stores moving image data having contents as shown in FIG. If the situation described in the problem does not occur, management information corresponding to each moving image is also recorded. In the scene where this embodiment functions, there are cases where the management information is missing or damaged. When the playback IN point and OUT point are designated, a playback list is also recorded. By default, the IN point indicates the beginning of the corresponding moving image, and the OUT point indicates the end.

  The recording medium control device 12 reads the moving image data from the recording medium 10 and outputs it to the RAM 24 that functions as a buffer. Of course, when the attached management information is recorded on the recording medium 10, the recording medium control device 12 also reads the management information and stores it in the RAM 24. If there is a playback list, the playback list is also stored in the RAM 24. Store.

  First, the demultiplexer 14 acquires PAT / SIT information from the transport stream (TS) stored in the RAM 24, acquires the PID of the PMT from the acquired PAT, and acquires the PMT. Further, the demultiplexer 14 acquires the PID of the video data from the acquired PMT, collects the video packet based on the PID, removes the TS header portion, converts it into a PES packet, and outputs it to the RAM 24.

  The video decoder 16 is an H.264 decoder. This is a decoder for H.264 / MPEG4-AVC. The video decoder 16 stores the H.264 data stored in the RAM 24. The H.264 / MPEG4-AVC PES packet is decomposed into elementary streams (ES) and decoded. The processor 20, which is the system control apparatus of this embodiment, sets the IN point and OUT point of the playlist in the video decoder 16. The video decoder 16 outputs the decoded video data or reproduced video data to the display device 18 at the PTS timing described in the PES header when the PTS of the decoded picture falls within the set IN point and OUT point range. To do. The display device 18 includes a liquid crystal monitor and the like, and displays an image indicated by the video data from the video decoder 16 on the screen. The video decoder 16 also notifies the processor 20 of the PTS of the picture currently outputting the video data.

  The playback apparatus of this embodiment includes a management information loss detection device 26 and an I picture information detection device 28 for partial and complete repair of management information. The functions of the management information loss detection device 26 and the I picture information detection device 28 may be realized as software on the processor 20. The management information loss detection device 26 detects a loss (loss or damage) of management information. The I picture information detection device 28 functions as picture position detection means in the claims.

  The I picture is discretely located in the moving image data, and an inter-frame coded picture composed of a P picture or a B picture is located between the I pictures. The amount of data after compression of each frame is not constant. Therefore, in order to find the head position of the I picture, it is necessary to sequentially reproduce a certain data portion or range from the head of the moving image data. The I picture information detection device 28 analyzes the TS packet stored in the RAM 24, and detects the head packet of the I picture, that is, the position of the I picture in the moving image data. The I picture information detection device 28 notifies the processor 20 via the RAM 24 of the detected I picture PTS information and storage start position information.

  The ROM 22 stores a program of the processor 20 and the like. The processor 20 controls the entire system based on a program stored in the ROM 22.

  As described above, the RAM 24 stores TS, H.264, and RAM. It is used to temporarily store H.264 / MPEG4-AVC PES packets, management information and playlists. The RAM 24 also stores the detection result of the I picture information detection device 28 and is used as a work memory for management information restoration. The RAM 24 is also used as a work memory for programs that run on the processor 20.

  The bus 30 is used for connecting various blocks in the system and transferring various data.

  In this embodiment, the management information is partially repaired so that the moving image data lacking the management information can be reproduced for the time being. This is called partial repair or partial repair operation. Partial repair is executed when there is no management information and when there is management information but the data in the management information is invalid. Partial restoration makes it possible to perform normal playback (sequential playback) from the beginning of the video data for the time being. Complete management information is created during this sequential playback. This is called complete repair or complete repair operation.

In playback mode, normal reproduction, still reproduction, there are four types of reproduction of slow reproduction and search reproduction, as a rule, in any mode, in order to play the video data is required management information. The playback function that cannot be used can be specified by the playback function mask information in the management information. The user can designate or use only a playback mode that is not masked by the playback function mask information.

  The operation in the normal playback mode will be described. In response to the normal playback mode instruction, the processor 20 controls the recording medium control device 12 to read the playback list and management information from the recording medium 10 and store them in the RAM 24. The processor 20 analyzes the reproduction list and obtains the order of moving image data to be reproduced and the IN / OUT points of each moving image data.

  Next, the processor 20 compares the acquired IN / OUT point with the I picture information of the management information. A read target is an I picture having the maximum PTS below the IN point and before an I picture having the minimum PTS above the OUT point, and the corresponding TSN section is set as a moving image data read range. If the IN point is smaller than the minimum PTS registered in the I picture information, the reading start position is set from the beginning of the moving image data. Similarly, if the OUT point is larger than the maximum PTS, the read end position is set as the end of the moving image data.

  Next, the recording medium control device 12 reads the data in the reading range from the moving image data in the TS format from the recording medium 10 and temporarily stores it in the RAM 24. Simultaneously with the start of reading, the processor 20 sets the IN / OUT point PTS in the video decoder 16. The video decoder 16 is set to output only between the IN point and the OUT point to the display device 18.

  The demultiplexer 14 once decomposes the TS data temporarily stored in the RAM 24 into PES packets. The video decoder 16 decodes the PES packet based on the DTS (Decode Time Stamp) information of the PES header, and outputs the video data of the pictures included between the IN point and the OUT point to the display device 18 in the PTS order.

  The reading of the moving image data is sequentially performed as long as the RAM 24 is free.

  The operation in the still playback mode will be described. For example, when an instruction for the still playback mode is received during the normal playback mode operation, the processor 20 puts the demultiplexer 14 and the video decoder 16 in a stopped state until there is an instruction to cancel the still playback mode. As a result, the image displayed at the time point of instructing the still reproduction mode is repeatedly displayed on the display device 18.

  When the slow reproduction mode instruction is received during the still instruction, the processor 20 operates the demultiplexer 14 and the video decoder 16 for a certain period of time and puts them again in the stopped state. Thereafter, until there is an instruction to cancel the slow playback mode, the operation and deactivation of the demultiplexer 14 and the video decoder 16 are repeated internally.

  The operation in the search playback mode will be described. For example, when receiving the search playback mode instruction during the normal playback mode operation, the processor 20 acquires the PTS information of the output picture from the video decoder 16. The processor 20 discards the read moving image data stored in the RAM 24, and returns the demultiplexer 14 and the video decoder 16 to the initial state. Next, an I picture having a PTS close to the PTS of the final output picture of the video decoder 16 is searched from the I picture information in the management information. Data of a predetermined size is read from the recording medium 10 from the storage start position of the searched I picture, and is decoded and output through the same process as normal playback. At this time, the IN point and OUT point set in the video decoder 16 are made the same as the I picture. As a result, only the video data of the I picture is output to the display device 18. Thereafter, a predetermined number of I pictures corresponding to the reproduction double speed in the search reproduction mode are skipped in the I picture information in the management information, and decoding / output processing is performed in the same manner.

  With reference to FIG. 3, the management information repair process according to the present embodiment will be described. FIG. 3 shows a flowchart of the management information repair process of this embodiment.

  The management information loss detection device 26 checks for a loss of management information developed in the RAM 24 (S1). Details of the defect check will be described later. When a defect is recognized (S1), partial repair described later is executed and the search reproduction mode is masked (S2). Step S2 corresponds to a partial repair means or step in the claims. When partial repair is executed, a code indicating the partial repair state is recorded in the user information of the corresponding management information.

  If no defect is recognized (S1), or when partial repair is completed (S2), the processor 20 checks whether or not the management information is partially repaired from the user information of the management information (S3). If it is not in the partial restoration state (S3), the steady state of the reproduction operation in which all the reproduction modes are permitted is entered (S8). If it is in the partial restoration state (S3), the type of playback mode instructed by the user is examined (S4). When the normal playback mode, the still playback mode, or the slow playback mode is instructed (S4), the respective playback modes are operated (S5). Then, the management information is completely restored while reproducing the target moving image data from the beginning to the end (S6). Step S6 corresponds to a complete restoration means or step in the claims.

  When complete restoration is completed, the bitmap of the reproduction function mask information is cleared (S7), and a normal reproduction operation is performed (S8). If the reproduction operation is stopped before completing the complete restoration (S7), the process returns to step S4.

  Only in the search reproduction mode (S4), the process stops at S4 according to the reproduction function mask information. That is, since the complete management information cannot be used at the time of partial repair, execution of the search reproduction mode is prohibited.

  FIG. 4 shows a flowchart of the management information loss detection operation (S1) by the management information loss detection device 26.

  It is checked whether the management information of the moving image data to be noticed exists in the RAM 24 or the recording medium 10 (S11). If there is management information (S11), the validity / invalidity of the I picture information in the management information is checked (S12). The validity / invalidity of the I picture information is determined by the presence or absence of a header portion of I picture information (not shown) and whether the number of stored I picture information is 1 or more. When it is determined that the I picture information is valid (S12), it is checked whether the PTS / TSN in the I picture information is in ascending order (S13). If it is in ascending order, the repair is unnecessary, and a value indicating that the repair is unnecessary is returned to the processor 20 (S14).

  If the management information does not exist (S11), if the I picture information is invalid (S12), or if the PTS / TSN in the I picture information is not in ascending order (S13), the management information needs to be restored, A value indicating that repair is necessary is returned to the processor 20 (S15).

  With reference to FIG.5 and FIG.6, the partial repair operation | movement of step S2 is demonstrated. FIG. 5 shows a detailed flowchart of step S2.

  In this embodiment, only the first I picture information of the target moving image data is registered in the management information by partial restoration. Since reproduction is performed using management information in which only the first I picture is registered, the search reproduction mode in which jump reproduction using the I picture of the management information is disabled, that is, masked.

  First, regardless of whether there is management information in the RAM 24, the management information is discarded (S21). A predetermined size of the moving image data is read from the recording medium 10 to the RAM 24 (S22). The I picture information detection device 28 detects an I picture in the moving image data read to the RAM 24 (S23). Until the first I picture is detected (S23), reading to the RAM 24 (S22) and detection of the I picture (S23) are repeated.

  When an I picture is detected (S23), the detected I picture is registered in the I picture information (S24). Information indicating that the partial restoration has been completed is registered in the user information (S25), and a search reproduction mode mask is registered in the reproduction function mask information (S26). Management information including the information of steps S24, S25, and S26 is written to the recording medium 10 as management information of the corresponding moving image data (S27).

  FIG. 6 shows an example of the partial repair operation image and the partially repaired management information according to the flowchart of FIG.

  FIG. 7 shows a detailed flowchart of the complete repair operation (S6). The complete restoration operation is an operation for registering information of all I pictures of the corresponding moving image data in the I picture information of the management information. Specifically, during sequential playback of normal playback, slow playback, or still playback, the I picture information detection device 28 converts an I picture from a TS packet read from the recording medium 10 to the RAM 24 for decoding and output processing. To detect. If the detected position information of the I picture is not registered in the management information, the processor 20 additionally registers the information of the I picture in the management information. As all moving picture data is reproduced, all I pictures are detected and registered.

  First, the processor 20 refers to the user information of the management information and checks whether or not the management information is in a partial repair state (S31). If it is not in the partial repair state (S31), the complete repair operation is unnecessary, and the process ends.

  If it is in the partial restoration state (S31), I pictures are sequentially detected from the moving image data read to the RAM 24 (S33, S34), and if the detected I pictures are not registered in the management information, they are additionally registered in the management information. (S35). Steps S33, S34, and S35 are repeated until registration of all I pictures of moving image data is completed (S32). That is, the management information is reconstructed by reproducing the target moving image from the beginning to the end.

  When registration of all the I pictures is completed (S32), the search reproduction function mask is cleared from the reproduction function mask information (S36). That is, the search reproduction function can be used. Next, the code indicating the partial repair state is canceled from the user information of the management information (S37). Thereby, the completely repaired management information is completed. The management information thus completely repaired is written back to the recording medium 10 (S38). This completes the complete repair operation (S6).

  In this way, in this embodiment, complete management information can be constructed without causing the user to wait for a long time by executing the two-stage repair of partial repair and complete repair. That is, when management information is lost, partial restoration is performed so that the corresponding moving image data can be reproduced at least in a short time. In the partial repair state, some playback functions whose operation cannot be guaranteed are disabled. Further, when an effective reproduction process is performed in the partial restoration state, the management information is completely restored behind the reproduction process. Such two-stage repair makes it possible to complete management information without causing stress to the user.

  A second embodiment of the present invention will be described. In this embodiment, in the partial restoration operation, not only the first I picture in the moving image data is registered in the management information, but also some I pictures in the middle of the moving image data are efficiently detected, and the management information Register with. FIG. 8 shows a flowchart of the partial repair operation of the second embodiment.

  In FIG. 8, steps S41 to S45 are the same as steps S21 to S25 of FIG. In FIG. 8, the following processing is further added. That is, a predetermined size or data amount of moving image data on the recording medium 10 is sought (S46), and a predetermined size is read into the RAM 24 (S48). The size or data amount of the seek amount and the read size or data amount are determined in advance. Of course, when the end of the moving image data is reached or exceeded (S47), the process proceeds to step S51. It is checked whether there is an I picture in the read moving image data of a certain size (S49). When an I picture is detected (S49), the detected I picture is additionally registered in the I picture information (S50). Such seeking and reading are repeated until the end of the moving image data is reached (S47).

  When the end of the moving image is reached (S47), the management information having the information registered in steps S44, S45, and S50 is written to the recording medium 10 as the management information of the corresponding moving image data (S51).

  In this embodiment, if not complete, one or a plurality of I pictures existing in the middle of moving image data are registered in the partially repaired management information, so that it is not necessary to prohibit search reproduction. Therefore, it is not necessary to mask search reproduction with the reproduction function mask information. The user is notified that search reproduction will be incomplete.

  FIG. 9 shows an example of the partial repair operation image according to the flowchart shown in FIG. 8 and the management information partially repaired.

  In this embodiment, in addition to the effects of the first embodiment, search reproduction can be used incompletely even after partial repair. When sequential reproduction is performed after partial restoration of the flow shown in FIG. 8, the management information is completely restored by the same method as in the first embodiment.

The seek size may be variable. Further, after seeking, moving image data may be continuously read from the recording medium 10 until an I picture is detected. The size of the moving image data is smaller than the seek size, if only one of the first I-picture that can not be detected and registered, as in the first embodiment, may mask the search reproduction function .

It is a schematic block diagram of one Example of this invention. It is explanatory drawing of the recording format of a present Example. It is a main flowchart of the repair function process of a present Example. It is a flowchart of the management information loss | deletion detection operation | movement (S1) of a present Example. It is a flowchart of partial restoration operation (S2) of management information. It is an example of the operation | movement image of the partial repair shown in FIG. 6, and the management information by which partial repair was carried out. It is a flowchart of the complete restoration operation | movement (S6) of the management information of a present Example. It is a flowchart of the partial recovery of the management information in 2nd Example. It is an example of the operation | movement image of the partial repair in 2nd Example, and the management information by which partial repair was carried out.

Explanation of symbols

10: Recording medium 12: Recording medium control device 14: Demultiplexer 16: Video decoder 18: Display device 20: Processor 22: ROM
24: RAM
26: Management information loss detection device 28: I picture information detection device 30: Bus

Claims (5)

Movie data including a plurality of first frames that are intra-coded, and a second frame that is inter-frame encoded between the first frames, and a plurality of the first frames in the movie data Replaying means for replaying management information including position information related to the position in the moving image data from a recording medium;
Repairing means for repairing the management information recorded on the recording medium when the management information is not correctly recorded on the recording medium
And
The restoration means detects the first frame at the head from the moving image data reproduced by the reproduction means, and includes position information relating to the position of the detected first frame at the first frame in the moving image data, The reproduction apparatus characterized by repairing the management information recorded on the recording medium so as not to include the position information of the first frame other than the head . Movie data including a plurality of first frames that are intra-coded, and a second frame that is inter-frame encoded between the first frames, and a plurality of the first frames in the movie data Replaying means for replaying management information including position information related to the position in the moving image data from a recording medium;
Repairing means for repairing the management information recorded on the recording medium when the management information is not correctly recorded on the recording medium
And
The restoration unit detects the first frame from a predetermined amount of the moving image data reproduced while seeking from the recording medium every predetermined amount of data by the reproduction unit, and detects the plurality of detected first frames The reproduction apparatus characterized in that the management information recorded on the recording medium is restored so as to include position information relating to the position of each frame in the moving image data . The restoration means is included in the management information in which position information relating to positions in the moving image data of the plurality of first frames in the moving image data recorded on the recording medium is recorded on the recording medium. 3. The management information recorded in the recording medium is determined not to be repaired, and the management information is not repaired. 3. Playback device. The restoration unit further detects the first frame from the moving image data reproduced by the reproducing unit during normal reproduction, and relates to a position in the moving image data of each of the detected plurality of first frames. The reproducing apparatus according to claim 1 or 2, wherein the management information is restored by adding position information to the management information. 2. The reproducing apparatus according to claim 1, wherein the restoration means stores information indicating search reproduction inhibition of the moving image data in the management information that has been restored.

Images