JP4048809B2 - Data processing apparatus and method, recording medium, and program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a data processing apparatus and method, a program storage medium, and a program, and more particularly to a data processing apparatus and method, a program storage medium, and a data processing apparatus and method capable of reliably generating special reproduction data from encoded image data. Regarding the program.
[0002]
[Prior art]
In recent years, MPEG (Moving Picture Experts Group) 2 has attracted attention as a general-purpose encoding method for high-definition images. The MPEG2 system is a motion-compensated predictive encoding system that encodes data by compressing the amount of information using correlation between frames. The sequence encoded by the MPEG2 system includes I (intra) pictures (pictures of intra-frame encoded images) at regular intervals, and the I picture is a discrete cosine transform (DCT). Alternatively, encoding is performed using only data in one frame by quantization or the like.
[0003]
Therefore, in a digital VTR (Video Tape Recorder), in addition to generating high-resolution data for normal playback from input video data, an I picture (intra frame) generated at a fixed period (for example, 15 frames) It has been proposed that low resolution data for special reproduction is generated using data, and the generated special reproduction data is recorded in a recording area provided in a special storage area for special reproduction.
[0004]
FIG. 1 is a block diagram showing a configuration of a conventional digital VTR 1 for recording normal reproduction data and special reproduction data.
[0005]
The encoder 11 encodes the supplied video data by the MPEG method, and supplies the encoded video data to the intra frame separation unit 12 and the buffer memory 14. The buffer memory 14 stores the supplied data (normal reproduction data). The intra frame separation unit 12 extracts an intra frame (hereinafter referred to as an I frame) from the supplied MPEG data, and outputs this to the special reproduction data generation unit 13. The special reproduction data generating unit 13 generates special reproduction data from the I frame video data and supplies the special reproduction data to the buffer memory 15. The buffer memory 15 stores the supplied special reproduction data.
[0006]
The data multiplexing unit 16 reads the normal reproduction data and special reproduction data stored in the buffer memory 14 and the buffer memory 15, performs processing such as word length restriction, and then processes this along with audio data and system data Multiplexed and supplied to the recording format processing unit 17. The recording format processing unit 17 performs processing such as error correction code addition and modulation on the supplied data, and records the data on the magnetic tape 18.
[0007]
FIG. 2 is a diagram illustrating an arrangement example of frames in which one GOP is configured by 15 frames. FIG. 3 is a diagram illustrating an example of the occupied state of the buffer memory in the frame configuration of FIG. At time t1, special reproduction data is input to the buffer memory 15, and at time t2, the recording on the magnetic tape 18 is completed, and the buffer memory 15 becomes empty at the same time. At this time, the VBV (Video Buffering Verifier) delay (which indicates the amount of buffer memory accumulated in 90 Hz clock time) size of the I frame is time T1. Specifically, the time T1 is the time from the time t1 of the input timing to the time when the next I frame (the first frame of each 1 GOP in the VIDEO phase based on the DTS) is input. Description of time t3 to time t12 and time T2 to time T6 is the same as that of time t1 and time t2 and time T1, and is therefore omitted.
[0008]
[Problems to be solved by the invention]
However, as shown in FIG. 2, the digital VTR 1 is shown in FIG. 3 when the special reproduction data generation rate (that is, the input rate of the I frame) is low (I frame has a period of 15 frames). As shown, since the recording completion timing (time t2) of the special reproduction data is earlier than the input timing (time t3) of the next special reproduction data, all the special reproduction data can be recorded. As shown in FIG. 4, the special reproduction data generation rate (I frame input rate) is faster than the write rate to the magnetic tape 18 (in the example of FIG. 4, the I frame has a period of 9 frames (1 GOP is 9 frames). ))), As shown in FIG. 5, the recording of the next special reproduction data is started from the recording completion timing (time t27) of the special reproduction data. The force timing (time t26) is earlier, in its timing, it is not possible to record the special playback data.
[0009]
That is, at time t26, the next special reproduction data is input to the buffer memory 15. At this time, since all the special reproduction data input at time t25 is not yet recorded in the buffer memory 15, Remaining.
[0010]
A similar situation occurs at the timings at times t30 and t31 and at timings t36 and t37.
[0011]
Short GOPs can also be caused by repeated stitching. FIG. 6 is a diagram illustrating an example of the arrangement of frames in a stream that has been shot together. In the figure, Pi (i = 1, 2,...) Indicates a stitching point. In this example, as a result of performing continuous shooting at points P1 to P5, 1 GOP is 3 frames.
[0012]
Even in such a case, a timing at which special reproduction data cannot be recorded occurs.
[0013]
As described above, when there are few frames constituting one GOP, there is a problem that a timing at which special reproduction data cannot be recorded occurs.
[0014]
The present invention has been made in view of such circumstances, and makes it possible to reliably generate special reproduction data from compressed digital data.
[0015]
[Problems to be solved by the invention]
  The image processing apparatus according to the present invention generates separation reproduction means for separating an intra frame from image data, and special reproduction data from the intra frame separated by the separation means.At the same time, first accompanying information that is time information corresponding to the special reproduction data is generated.Generation means, special reproduction data generated by generation means, and first accompanying informationIs written to one of the multiple storage units, and the written storage unit is readable or writableStored informationUpdateBy writing means and writing meansCaseBased on the first accompanying information and stored information written in the storage section,CaseTo NobebuWritingRead the special playback dataAt the same time, the storage information of the read storage unit is updated.Reading means;ReadingRecording means for recording the special reproduction data read by the reading means on a recording medium, and the writing means includes a plurality of storage units based on the storage information.Out ofWritePossibleSelect the storageWrite special playback data and update the storage information of the selected storage unit to indicate that it can be read.,ReadingBased on the stored information, the flushing meansCaseNabebeOut ofReadPossibleSelect storageWhen the comparison result between the time information converted from the recording position on the recording medium and the first accompanying information in the selected storage unit indicates that the special reproduction data can be recorded on the recording medium, Read the special playback data and update the storage information of the selected storage unit to indicate that it can be writtenIt is characterized by doing.
[0016]
  SaidWriting means andReadingThe flushing means can share the first attached information and the stored information.
[0017]
  The writing means can write the second accompanying information indicating whether or not the special reproduction data written in the storage unit is a splice point in the storage unit.
[0022]
  The image processing method of the present invention generates a special reproduction data from a separation step of separating an intra frame from image data and the intra frame separated by the processing of the separation step.At the same time, first accompanying information that is time information corresponding to the special reproduction data is generated.Generation step, special reproduction data generated by the processing of the generation step, and first accompanying informationIs written to one of the multiple storage units, and the written storage unit is readable or writableStored informationUpdateBy the writing step and the processing of the writing stepCaseBased on the first accompanying information and stored information written in the storage section,CaseTo NobebuWritingRead the special playback dataAt the same time, the storage information of the read storage unit is updated.A read step;ReadingA recording step of recording the special reproduction data read by the reading step on a recording medium, and the processing of the writing step is based on the storage information.Out ofWritePossibleSelect the storageWrite special playback data and update the storage information of the selected storage unit to indicate that it can be read.,ReadingThe flooding step process is based on the stored information.CaseNabebeOut ofReadPossibleSelect storageWhen the comparison result between the time information converted from the recording position on the recording medium and the first accompanying information in the selected storage unit indicates that the special reproduction data can be recorded on the recording medium, Read the special playback data and update the storage information of the selected storage unit to indicate that it can be writtenIt is characterized by doing.
[0023]
  Of the present inventionRecording mediaThe program generates a special reproduction data from the separation step for separating the intra frame from the image data and the intra frame separated by the processing of the separation step.At the same time, first accompanying information that is time information corresponding to the special reproduction data is generated.Generation step, special reproduction data generated by the processing of the generation step, and first accompanying informationIs written to one of the multiple storage units, and the written storage unit is readable or writableStored informationUpdateBy the writing step and the processing of the writing stepCaseBased on the first accompanying information and stored information written in the storage section,CaseTo NobebuWritingRead the special playback dataAt the same time, the storage information of the read storage unit is updated.A read step;ReadingA recording step of recording the special reproduction data read by the reading step on a recording medium, and the processing of the writing step is based on the storage information.Out ofWritePossibleSelect the storageWrite special playback data and update the storage information of the selected storage unit to indicate that it can be read.,ReadingThe flooding step process is based on the stored information.CaseNabebeOut ofReadPossibleSelect storageWhen the comparison result between the time information converted from the recording position on the recording medium and the first accompanying information in the selected storage unit indicates that the special reproduction data can be recorded on the recording medium, Read the special playback data and update the storage information of the selected storage unit to indicate that it can be writtenIt is characterized by doing.
[0024]
  The program according to the present invention generates a special reproduction data from a separation step of separating an intra frame from image data and an intra frame separated by the processing of the separation step.At the same time, first accompanying information that is time information corresponding to the special reproduction data is generated.Generation step, special reproduction data generated by the processing of the generation step, and first accompanying informationIs written to one of the multiple storage units, and the written storage unit is readable or writableStored informationUpdateBy the writing step and the processing of the writing stepCaseBased on the first accompanying information and stored information written in the storage section,CaseTo NobebuWritingRead the special playback dataAt the same time, the storage information of the read storage unit is updated.A read step;ReadingA recording step of recording the special reproduction data read by the reading step on a recording medium, and the processing of the writing step is based on the storage information.Out ofWritePossibleSelect the storageWrite special playback data and update the storage information of the selected storage unit to indicate that it can be read.,ReadingThe flooding step process is based on the stored information.CaseNabebeOut ofReadPossibleSelect storageWhen the comparison result between the time information converted from the recording position on the recording medium and the first accompanying information in the selected storage unit indicates that the special reproduction data can be recorded on the recording medium, Read the special playback data and update the storage information of the selected storage unit to indicate that it can be writtenIt is characterized by doing.
[0025]
The image processing apparatus may be configured as a recording-dedicated apparatus, or may be configured as a block that performs recording processing of an apparatus that performs both recording and reproduction.
[0026]
  The present inventionInInIntra frames are separated from the image data, special reproduction data is generated from the separated intra frames, and first accompanying information that is time information corresponding to the special reproduction data is generated, and the generated special reproduction is generated. The data for storage and the first accompanying information are written in any of a plurality of storage units, and the storage information indicating that the written storage unit is readable or writable is updated. Further, based on the first accompanying information and storage information written in the storage unit, the special reproduction data written in the storage unit is read, and the storage information in the read storage unit is updated.
[0027]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 7 is a block diagram showing a configuration example of a digital VTR 30 to which the present invention is applied. In the figure, portions corresponding to those in FIG. 1 are denoted by the same reference numerals, and the description thereof will be omitted because it will be repeated.
[0028]
In this example, the special reproduction data generation unit 13 generates special reproduction data from the I frame and supplies it to the memory write control unit 31. The memory write control unit 31 controls writing of special reproduction data to the buffer memory 15A, the buffer memory 15B,... The memory read control unit 32 controls reading of special reproduction data from the buffer memory 15A, buffer memory 15B,..., Buffer memory 15N, and multiplexes the special reproduction data read from the buffer memories 15A to 15N. To the conversion unit 16.
[0029]
The data multiplexing unit 16 performs processing such as word length restriction on the special reproduction data supplied from the memory read control unit 32 and the normal reproduction data supplied from the buffer memory 14 and then illustrated. The audio data and the system data input from the input unit are multiplexed and supplied to the recording format processing unit 17. The recording format processing unit 17 performs processing such as error correction code addition and modulation on the supplied data, and records the data on the magnetic tape 18.
[0030]
Next, data recording processing in the digital VTR 30 will be described with reference to FIG. This process is started when the user instructs to record data by operating an operation unit (not shown).
[0031]
In step S1, the encoder 11 encodes the input video data. The encoded data is supplied to the buffer memory 14 and the intra frame separation unit 12. The intra frame separation unit 12 extracts intra frame video data from the input video data and supplies the extracted video data to the special reproduction data generation unit 13.
[0032]
In step S2, the buffer memory 14 stores the supplied data. The data stored in the buffer memory 14 is supplied to the data multiplexing unit 16.
[0033]
In step S3, the special reproduction data is written and read. That is, the special reproduction data generation unit 13 generates special reproduction data. The memory write processing unit 31 stores the special reproduction data in, for example, the buffer memory 15A. The memory read processing unit 32 reads this and supplies it to the data multiplexing unit 16. Details of the special reproduction data write / read processing will be described later with reference to FIG.
[0034]
In step S <b> 4, the data multiplexing unit 16 determines whether the normal reproduction data and the special reproduction data are supplied from the buffer memory 14 and the memory read control unit 32. If it is determined that the normal reproduction data and the special reproduction data have not been input yet, the data multiplexing unit 16 waits until the normal reproduction data and the special reproduction data are input.
[0035]
If it is determined in step S4 that normal reproduction data and special reproduction data have been input, the process proceeds to step S5, and the data multiplexing unit 16 restricts the word length for the normal reproduction data and special reproduction data. The data is multiplexed with audio data and system data, and supplied to the recording format processing unit 17.
[0036]
In step S 6, the recording format processing unit 17 adds an error correction code to the multiplexed data supplied from the data multiplexing unit 16 and modulates the multiplexed data.
[0037]
In step S 7, the recording format processing unit 17 adds the error correction code in step S 6 and records the modulated data on the magnetic tape 18.
[0038]
Next, the special reproduction data write / read processing in step S3 of FIG. 8 will be described with reference to FIG. This process is started when the data encoded in step S1 of FIG. 8 is supplied to the intra frame separation unit 12.
[0039]
In step S21, special reproduction data generation processing is executed. This special reproduction data generation processing will be described with reference to FIG.
[0040]
In step S <b> 41, the intra frame separation unit 12 receives the encoded video data supplied from the encoder 11.
[0041]
In step S <b> 42, the intra frame separating unit 12 extracts I frame (intra frame) video data from the received video data, and supplies this to the special reproduction data generating unit 13.
[0042]
In step S43, the special reproduction data generation unit 13 generates special reproduction data based on the I-frame video data supplied from the intra frame separation unit 12, and performs memory write control on the generated special reproduction data. To the unit 31.
[0043]
In step S44, the intra frame separation unit 12 determines whether or not the data input is completed. If it is determined that the data input has not ended, the process returns to step S41, and the subsequent processes are repeated.
[0044]
If it is determined in step S44 that the data input has been completed, the special reproduction data generation processing ends, and the processing proceeds to step S22 in FIG.
[0045]
Returning to FIG. 9, in step S22, a memory write process is executed. This memory writing process will be described with reference to FIG. This process is started when special reproduction data is supplied from the special reproduction data generation unit 13.
[0046]
In step S61, the memory write control unit 31 receives the special reproduction data generated by the process of step S21 of FIG. 9 (generated by the special reproduction data generation process shown in FIG. 10).
[0047]
In step 62, the memory write control unit 31 determines whether there is a usable (writable) buffer memory in the buffer memories 15A to 15N.
[0048]
That is, in the buffer memories 15A to 15N, as shown in FIG. 12, in addition to the special reproduction data, the corresponding DTS (Decoding Time Stamp) and flag are written. The DTS and flag information are shared between the memory write control unit 31 and the memory read control unit 32. DTS is time management information indicating the timing of decoding (decoding), and is DTS A to DTS N corresponding to the special reproduction data stored in each of the buffer memories 15A to 15N.
[0049]
The flag can be written when the buffer memory is in a writable (unreadable) state, and can be read when the buffer memory is readable (unwritable).
[0050]
Therefore, in the process of step S62, it is determined whether or not there is a buffer memory in which the flag is writable in the buffer memories 15A to 15N of FIG. In the example of FIG. 12, the buffer memory 15A and the buffer memory 15B are writable. If it is determined that there is a writable buffer memory, the process proceeds to step S63.
[0051]
In step S63, the memory write control unit 31 stores the special reproduction data in the buffer memory determined to be writable in step S62 (for example, the buffer memory 15A).
[0052]
In step S64, the memory write control unit 31 stores information specifying the buffer memory just written (for example, identification information of the buffer memory 15A) and the DTS of the video data.
[0053]
In step S65, the memory write control unit 31 enables reading of the flag of the buffer memory (in this example, the buffer memory 15A) used in the processing of step S63 and step S64 (disables the write flag).
[0054]
After the process of step S65 or when it is determined in step S62 that there is no writable buffer memory, the memory write process is terminated, and the process proceeds to step S23 of FIG.
[0055]
In the process of FIG. 11, regardless of the input rate of video data and the process of the memory read control unit 32 (the process of FIG. 13 described later), the I frame is extracted by the intra frame separation unit 12, and the special reproduction data generation unit 13 is repeated each time the special reproduction data is generated and supplied to the memory write control unit 31, and the process is independent of the process of the memory read control unit 32 described later.
[0056]
Returning to FIG. 9, in step S23, a memory read process is executed. This memory read processing will be described with reference to FIG.
[0057]
In step S81, the memory read control unit 32 determines whether there is a readable buffer memory (a buffer memory whose flag is readable). As described above, the DTS and the flag are information common to the memory write control unit 31 and the memory read control unit 32. For example, in the state shown in FIG. 12, the buffer memory 15C and the buffer memory 15N are readable. This is because, for example, the special reproduction data is stored in the buffer memory 15C and the buffer memory 15N by the memory write control unit 31 by the processing in step S65 of FIG. 11, and the special data is stored in the buffer memory 15C and the buffer memory 15N. Playback data is stored. If it is determined in step S81 that there is no readable buffer memory, the memory read control unit 32 waits until it is determined that there is a readable buffer memory.
[0058]
If it is determined in step S81 that there is a readable buffer memory, the process proceeds to step S82. The memory read control unit 32 acquires the DTS of the buffer memory determined to be readable (in this example, the buffer memory 15C or the buffer memory 15N).
[0059]
In step S <b> 83, the memory read control unit 32 compares the acquired DTS with the DTS converted from the current recording position of the track on the magnetic tape 18.
[0060]
In step S84, the memory read control unit 32 determines whether or not special reproduction data to be read exists. Specifically, it is determined from the result of the comparison in step S83 whether the acquired DTS is data that can be recorded on the magnetic tape 18 now. If it is determined that there is no data to be read, the process returns to step S81, and the subsequent processes are repeated (the DTS of the next buffer memory is acquired and compared).
[0061]
If it is determined in step S84 that there is special reproduction data to be read, the process proceeds to step S85, and the memory read control unit 32 determines whether or not the DTS acquired in step S82 is the same as the previously processed DTS. To do. Since the special reproduction data may be divided and recorded on different tracks of the magnetic tape 18, this determination is made. If it is determined in step S85 that the DTS is the same as the previously processed DTS, the process proceeds to step S86, and the memory read control unit 32 reads the special reproduction data from the previously processed buffer memory (for example, the buffer memory 15C). Is read.
[0062]
If it is determined in step S85 that the DTS read from the buffer memory is different from the previously processed DTS, the process proceeds to step S87, and the memory read control unit 32 stores the DTS in which the DTS is stored ( For example, the special reproduction data is read from the head of the buffer memory 15C).
[0063]
After the process of step S86 or after the process of step S87, in step S88, the memory read control unit 32 performs the special reproduction for all the buffer memories (for example, the buffer memory 15C) read in step S86 or step S87. It is determined whether or not data has been read. If it is determined that all the special reproduction data has not yet been read, the process returns to step S81, and the subsequent processes are repeated.
[0064]
If it is determined in step S88 that all data in the buffer memory has been read, the process proceeds to step S89, and the memory read control unit 32 determines that all data has been read in step S88 (for example, , The flag of the buffer memory 15C) is made writable (cannot be read), and the memory read processing is ended.
[0065]
Returning to FIG. 9, when the memory reading process is completed in step S23, the special reproduction data writing / reading process is ended, and the process proceeds to step S4 in FIG.
[0066]
As described above, a plurality of buffer memories for storing special reproduction data are provided, and the memory write control unit 31 and the memory read control unit 32 control the writing and reading of data to and from the plurality of buffer memories. Playback data is stored in a plurality of buffer memories. As a result, even when the special reproduction data generation rate (I frame input rate) is faster than the write rate to the magnetic tape 18 (for example, the I frame has a period of 9 frames), each buffer memory has each I Since special reproduction data generated from a frame can be stored, all special reproduction data can be stored.
[0067]
When the flag is writable, reading from the buffer memory is not possible. On the other hand, when the flag is readable, writing to the buffer memory is not possible. For this reason, even when the special reproduction data is processed in a pipeline and stored in the buffer memory, it is possible to prevent the data from being read from the same buffer memory until the data writing is completed.
[0068]
FIG. 14 is a diagram illustrating another processing example of the memory write control unit 31, the buffer memory 15A, the buffer memory 15B, the buffer memory 15C,..., The buffer memory 15N, and the memory read control unit 32.
[0069]
In this example, a specific flag is recorded in the buffer memory 15A, buffer memory 15B, buffer memory 15C,..., Buffer memory 15N in addition to the DTS and write flag stored in FIG. The specific flag is, for example, a flag indicating a joining point, and when it is a joining point, the specific flag is turned on. Further, the information on the specific flag is shared by the memory write control unit 31 and the memory read control unit 32 in the same manner as information on the DTS and write (read) flag. Other configurations are the same as those in FIG. 12 and are repeated, and thus the description thereof is omitted.
[0070]
FIG. 15 is a flowchart for explaining memory write processing in the memory write control unit 31 of FIG. This process is similar to FIG. 11 described above and describes the process in step S22 of FIG. 9, and is started when special reproduction data is supplied from the special reproduction data generation unit 13.
[0071]
In step S101, the memory write control unit 31 receives the special reproduction data generated in the process of step S21 of FIG. 9 (generated by the special reproduction data generation process of FIG. 10).
[0072]
In step S102, the memory write control unit 31 determines whether there is a usable (writable) buffer memory in the buffer memories 15A to 15N. Specifically, it is determined whether or not there is a buffer memory having a writable flag in the buffer memories 15A to 15N in FIG. In the example of FIG. 14, the buffer memory 15A and the buffer memory 15B can be used. If it is determined that there is a usable buffer memory, the process proceeds to step S103.
[0073]
In step S103, the memory write control unit 31 stores the special reproduction data in the buffer memory determined to be usable in step S102 (for example, the buffer memory 15A).
[0074]
In step S104, the memory write control unit 31 determines whether or not the special reproduction data stored in the buffer memory (in the present example, the buffer memory 15A) is the data for the joining point (the specific flag is on). Whether or not). If it is determined in step S104 that the data is a stitching point data, the process proceeds to step S105, and the memory write control unit 31 specifies information that identifies the buffer memory (for example, identification information of the buffer memory 15A), Stores DTS and turns on a specific flag indicating that it is a stitching point.
[0075]
In step S104, when it is determined that the data is not the data for the joint shooting point, the process proceeds to step S106, and the memory write control unit 31 specifies information for specifying the used buffer memory (for example, identification information of the buffer memory 15A). And memorize DTS.
[0076]
After the process of step S105 or after the process of step S106, in step S107, the memory write control unit 31 makes the currently used buffer memory (buffer memory 15A in this example) readable (write). Turn off the flag).
[0077]
After the process of step S107, or when it is determined that there is no usable buffer memory in step S102, the memory writing process is terminated, and the process proceeds to step S23 of FIG.
[0078]
FIG. 16 is a flowchart for explaining memory read processing in the memory read control unit 32 of FIG. This process is similar to FIG. 13 described above and describes the process in step S23 of FIG. 9 and starts when the recording position on the magnetic tape 18 comes to the position for recording the special reproduction data. Is done.
[0079]
In step S121, the memory read control unit 32 determines whether there is a readable buffer memory. For example, as shown in FIG. 14, the buffer memory 15C and the buffer memory 15N are readable. If it is determined in step S121 that there is no readable buffer memory, the process waits until it is determined that there is a readable buffer memory.
[0080]
If it is determined in step S121 that there is a readable buffer memory, the process proceeds to step S122, and the memory read control unit 32 determines that the buffer memory determined to be readable (in this example, the buffer memory 15C). Alternatively, the DTS of the buffer memory 15N) is acquired.
[0081]
In step S123, the memory read control unit 32 compares the acquired DTS with the DTS converted from the track recording position on the magnetic tape 18.
[0082]
In step S124, the memory read control unit 32 determines whether there is special reproduction data to be read. Specifically, it is determined from the result of comparison in step S123 whether the acquired DTS is data that can be recorded on the magnetic tape 18 now. If it is determined that there is no data to be read, the process proceeds to step S125, and the memory read control unit 32 is stored in the same buffer memory (in this example, the buffer memory 15C) as the buffer memory acquired in step S122. It is determined whether or not the special reproduction data that is included is data of the joining point (determines whether or not the specific flag is on). If it is determined that the data is not the data for the continuous shooting point, the process returns to step S121, and the subsequent processes are repeated.
[0083]
If it is determined in step S125 that the data is a joining point data, or if it is determined in step S124 that there is data to be read, the process proceeds to step S126, and the memory read control unit 32 acquires in step S122. It is determined whether the DTS performed is the same as the previously processed DTS. The special reproduction data may be divided and recorded on different tracks of the magnetic tape 18, so this is determined. If it is determined in step S126 that the DTS is the same as the previously processed DTS, the process proceeds to step S127, and the memory read control unit 32 performs special playback from the previously processed buffer memory (for example, the buffer memory 15C). Read data.
[0084]
If it is determined in step S126 that the DTS acquired in step S122 is different from the previously processed DTS, the process proceeds to step S128, and the memory read control unit 32 stores the DTS in the buffer memory (for example, The special reproduction data is read from the head of the buffer memory 15C).
[0085]
After the process of step S127 or after the process of step S128, in step S129, the memory read control unit 32 performs all special reproduction for the buffer memory (for example, the buffer memory 15C) read in step S127 or step S128. It is determined whether or not data has been read. If it is determined that all the special reproduction data has not yet been read, the process returns to step S121, and the subsequent processes are repeated.
[0086]
If it is determined in step S129 that all data in the buffer memory has been read, the process proceeds to step S130, and the memory read control unit 32 determines that all data has been read in step S129 (for example, a buffer memory). The memory 15C) is made writable (the write flag is turned on), and the memory read process is terminated.
[0087]
Returning to FIG. 9, when the memory reading process is completed in step S23, the special reproduction data recording process is terminated, and the process proceeds to step S4 in FIG.
[0088]
In this way, by adding a specific flag (a flag indicating the joining point) as shown in FIG. 14 to the information stored in the buffer memory in FIG. 12, for example, the first I frame of the joining point is selected. Even when recording on a recording medium, by referring to a specific flag (for example, data is read when the specific flag is set, and data is not read when the specific flag is not on (turned off)). (By waiting for the next processing request).
[0089]
FIG. 17 is a diagram showing another configuration example of the digital VTR 30 of the present invention. In the figure, portions corresponding to those in FIG. 7 are denoted by the same reference numerals, and the description thereof will be omitted because it will be repeated.
[0090]
The digital VTR 30 is newly provided with a data extraction unit 51, a buffer memory 52A, a buffer memory 52B, a buffer memory 52C,..., A buffer memory 52M, and a memory read control unit 53 in addition to the configuration of FIG. ing.
[0091]
The data extraction unit 51 includes data corresponding to a desired double speed (second special reproduction data) among the special reproduction data stored in the buffer memory 15A, the buffer memory 15B, the buffer memory 15C,. Data) is extracted from the buffer memory (for example, the buffer memory 15C) and stored in the buffer memory (for example, the buffer memory 52A).
[0092]
In the case of this example, the memory read control unit 32 reads the 8 × special reproduction data from the buffer memory 15A to the buffer memory 15N and outputs it to the data multiplexing unit 16. The data extraction unit 51 extracts data corresponding to 24 × speed data from the data (first special reproduction data) stored in the buffer memory 15A to buffer memory 15N, and extracts this data from the buffer memory 52A to buffer memory 52M (buffer memory for second special reproduction data). The memory read control unit 53 reads the second special reproduction data and supplies it to the data multiplexing unit 16.
[0093]
The data multiplexing unit 16 performs processing such as word length restriction on these special reproduction data (two types of 8 × speed and 24 × speed) and normal reproduction data stored in the buffer memory 14, and then performs audio processing. This is multiplexed with data and system data and supplied to the recording format processing unit 17. The recording format processing unit 17 performs processing such as error correction code addition and modulation on the supplied data, and records the data on the magnetic tape 18.
[0094]
Next, the data extraction process executed by the data extraction unit 51 of FIG. 17 will be described with reference to FIG.
[0095]
In step S151, the data extraction unit 51 determines whether it is time to write the second special reproduction data (in this example, 24 × special reproduction data). Specifically, this determination is performed based on the DTS converted from the track on the magnetic tape 18.
[0096]
If it is determined in step S151 that it is time to write the second special reproduction data, the process proceeds to step S152, and the data extraction unit 51 can read from the buffer memory 15A to the buffer memory 15N. Get DTS of buffer memory. Specifically, as shown in FIG. 12, the DTS of a readable buffer memory (a buffer memory whose read flag is on (write flag is off)) is acquired from the buffer memories 15A to 15N. .
[0097]
In step S153, the data extraction unit 51 compares the acquired DTS with the DTS converted from the track on the magnetic tape 18.
[0098]
In step S154, the data extraction unit 51 determines whether there is second special reproduction data to be transferred (extracted). Specifically, based on the result of the comparison in step S153, it is determined whether or not the acquired DTS is data that can be recorded on the magnetic tape 18 now. If it is determined that there is data to be transferred, the process proceeds to step S155, and the data extraction unit 51 stores the DTS acquired in step S152 in the buffer memory (the first special reproduction data is stored. Data is transferred to the writable buffer memory (buffer memory storing the second special reproduction data) in the buffer memories 52A to 52M.
[0099]
After step S155, if it is determined in step S154 that there is no data to be transferred, or if it is determined in step S151 that it is not time to write the second special reproduction data, the process proceeds to step S151. Return, and the subsequent processing is repeated.
[0100]
Thus, by adding the data extraction unit 51, the buffer memory 52A to the buffer memory 52M, and the memory read control unit 53, it is possible to easily record two types of special reproduction data.
[0101]
FIG. 19 is a diagram for explaining operations of the data extraction unit 51, the buffer memory 52A, the buffer memory 52B, the buffer memory 52C,... The buffer memory 52M, and the memory read control unit 53. Even in this case, the DTS and the flag are written in each buffer memory. The basic operation is the same as that in FIG.
[0102]
In FIG. 19, it is also possible to add a specific flag as shown in FIG. 14 to the data stored in the buffer memory 52A to the buffer memory 52M. Thereby, it is possible to record special reproduction data generated from the I frame at the head of the joint shooting point.
[0103]
Further, by providing a plurality of blocks as shown in FIG. 19, it is possible to record three or more special reproduction data.
[0104]
As described above, in the digital VTR 30, by adding a plurality of buffer memories and processing for controlling writing and reading to the buffer memories, special reproduction data can be generated and recorded from all input I frames. It becomes possible. Thereby, smoother (high update rate) Cue / Review can be realized.
[0105]
Also, by acquiring time axis information (DTS) in the generated special reproduction data, it is possible to correctly control the recording position and recording order on the recording medium.
[0106]
Furthermore, by appropriately increasing the buffer memory, even if the generation rate and recording rate of special reproduction data change, it is not necessary to change the memory write control unit 31 and the memory read control unit 32, and a system configuration is possible. It is.
[0107]
Further, as shown in FIG. 14, even with the same system configuration as that of FIG. 12, it is possible to cope with various trick plays by changing the algorithm in the block. For example, when the area allocated to the special reproduction data on the recording medium changes, a plurality of types of specific data used in the memory write control unit 31 and the memory read control unit 32 are prepared (a plurality of specific flags are prepared). Accordingly, it is possible to deal with a format in which the thinning rate (update rate) of special reproduction data is arbitrarily changed.
[0108]
Furthermore, when the recording rate of the special reproduction data is constant, the data amount per special reproduction data can be increased by lowering the update rate, so that the image quality can be improved. .
[0109]
Further, as shown in FIG. 19, by adding a data extraction unit 51, a buffer memory (buffer memory for storing second special reproduction data), and a memory read control unit 53 to the digital VTR 30 of FIG. Two types of special reproduction data can be recorded simultaneously. Since the special reproduction data is generated from all I frames by the special reproduction data generation unit 13 and stored in the buffer memory 15A to the buffer memory 15N, the recording rate of the special reproduction data on the magnetic tape 18 is recorded. Permits, it is possible to record two or more types of special reproduction data. In this case, the blocks as shown in FIG. 19 may be added as many times as the number of special reproductions to be recorded.
[0110]
In the above example, the DTS is stored in the buffer memory, but the DTS may be any other value as long as it is the only value on the time axis for the written special reproduction data.
[0111]
The series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. For example, the program is installed in a general-purpose personal computer from the program storage medium. In this case, for example, the digital VTR 30 is configured by a personal computer 100 as shown in FIG.
[0112]
20, a CPU (Central Processing Unit) 101 performs various processes according to a program stored in a ROM (Read Only Memory) 102 or a program loaded from a storage unit 108 to a RAM (Random Access Memory) 103. Execute. The RAM 103 also stores data necessary for the CPU 101 to execute various processes as appropriate.
[0113]
The CPU 101, ROM 102, and RAM 103 are connected to each other via a bus 104. An input / output interface 105 is also connected to the bus 104.
[0114]
The input / output interface 105 includes an input unit 106 including a keyboard and a mouse, a display including a CRT (cathode ray tube) and an LCD (Liquid Crystal Display), an output unit 107 including a speaker, a hard disk, and the like. A communication unit 109 including a storage unit 108, a modem, a terminal adapter, and the like is connected. The communication unit 109 performs communication processing via a network.
[0115]
In addition, a drive 110 is connected to the input / output interface 105 as necessary, and a magnetic disk 121, an optical disk 122, a magneto-optical disk 123, a semiconductor memory 124, or the like is appropriately mounted, and a computer program read from the disk is necessary. Is installed in the storage unit 108 according to the above.
[0116]
When a series of processing is executed by software, various functions can be realized by installing a program that constitutes the software in a dedicated dedicated hardware computer or by installing various programs. For example, a general-purpose personal computer that can be executed is installed from a network or a program storage medium.
[0117]
As shown in FIG. 20, the program storage medium includes a magnetic disk 121 (including a floppy disk) on which a program is recorded and an optical disk 122 (distributed to provide a program to a user separately from a computer) It is only composed of a package medium consisting of CD-ROM (compact disc-read only memory), DVD (including digital versatile disc), magneto-optical disc 123 (including MD (mini disc)), semiconductor memory 124, etc. Rather, it is provided with a ROM 102 in which a program is recorded and a hard disk including a storage unit 108 provided to the user in a state of being preinstalled in the apparatus main body.
[0118]
In the present specification, the step of describing a computer program includes not only processing performed in time series according to the described order but also processing executed in parallel or individually even if not necessarily processed in time series. Is also included.
[0119]
【The invention's effect】
As described above, according to the present invention, special reproduction data can be generated from encoded image data. Further, according to the present invention, special reproduction data can be generated from an arbitrary intra frame regardless of the input rate of the intra frame.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration example of a conventional digital VTR.
FIG. 2 is a diagram illustrating an arrangement example of frames in which 1 GOP is configured by 15 frames.
3 is a diagram illustrating an example of an occupied state of a buffer memory in the frame configuration of FIG. 2;
FIG. 4 is a diagram illustrating an arrangement example of frames in which 1 GOP is configured by 9 frames.
5 is a diagram illustrating an example of an occupied state of a buffer memory in the frame configuration of FIG.
FIG. 6 is a diagram illustrating an arrangement example of frames of a stream that has been shot together;
FIG. 7 is a block diagram showing a configuration example of a digital VTR to which the present invention is applied.
8 is a flowchart for explaining data recording processing in the digital VTR of FIG. 7;
FIG. 9 is a flowchart illustrating special reproduction data write / read processing in step S3 of FIG. 8;
FIG. 10 is a flowchart illustrating special reproduction data generation processing in step S21 of FIG.
FIG. 11 is a flowchart illustrating memory write processing in step S22 of FIG.
12 is a diagram for explaining processing related to the buffer memory in FIG. 7; FIG.
13 is a flowchart for explaining memory read processing in step S23 of FIG. 9;
14 is a diagram for describing processing related to the buffer memory in FIG. 7; FIG.
15 is a flowchart for explaining memory write processing in the memory write control unit of FIG. 14;
16 is a flowchart for explaining memory read processing in the memory read control unit of FIG. 14;
FIG. 17 is a block diagram showing another configuration example of the digital VTR of the present invention.
18 is a flowchart for explaining data extraction processing executed by the data extraction unit of FIG. 17;
FIG. 19 is a diagram for describing processing related to the buffer memory in FIG. 17;
FIG. 20 is a block diagram illustrating a configuration example of a personal computer.
[Explanation of symbols]
12 intra-frame separation unit, 13 special reproduction data generation unit, 15A buffer memory, 31 memory write control unit, 32 memory read control unit, 51 data extraction unit, 52 buffer memory, 53 memory read control unit

Claims (6)

In an image processing apparatus for recording encoded image data on a recording medium,
Separating means for separating an intra frame from the image data;
Generating means for generating special reproduction data from the intra frame separated by the separating means, and generating first accompanying information which is time information corresponding to the special reproduction data ;
The specific reproduction data generated by the generation unit, and the writes the first incidental information to one of the plurality of storing portions, the storage unit can be read or store information indicating the writable, writing Writing means to update;
Based on the first accompanying information and the storage information written in the storage unit by the writing means, the special reproduction data written in the storage unit is read, and the storage in the read storage unit is read out A reading means for updating the information;
Recording means for recording the special reproduction data read by the reading means on the recording medium,
The writing unit selects a writable storage unit from among the plurality of storage units based on the storage information, writes the special reproduction data, and reads the storage information of the selected storage unit Update to show possible,
The reading means selects a readable storage unit from the plurality of storage units based on the storage information, and converts the time information converted from the recording position on the recording medium and the selected storage unit. When the comparison result with the first accompanying information indicates that the special reproduction data can be recorded on the recording medium, the special reproduction data is read and the storage in the selected storage unit is performed. An image processing apparatus, wherein information is updated so as to indicate that writing is possible. The image processing apparatus according to claim 1, wherein the writing unit and the reading unit share the first attached information and the stored information. The writing means also writes second accompanying information indicating whether or not the special reproduction data written in the storage section is a splice point to the writing storage section. Image processing apparatus. In an image processing method of an image processing apparatus for recording encoded image data on a recording medium,
A separation step of separating an intra frame from the image data;
Generating special reproduction data from the intra frame separated by the processing of the separation step, and generating first accompanying information which is time information corresponding to the special reproduction data;
The special reproduction data generated by the process of the generation step and the first accompanying information are written in any of a plurality of storage units, and the storage indicating whether the storage unit that has been written is readable or writable A writing step to update the information;
Based on the first accompanying information and the storage information written in the storage unit by the processing of the writing step, the special reproduction data written in the storage unit is read out, and the read out of the storage unit A reading step for updating the stored information;
Recording the special reproduction data read by the reading step on the recording medium,
Based on the stored information, the writing step selects a writable storage unit from among the plurality of storage units and writes the special reproduction data, and stores the stored information in the selected storage unit. Is updated to indicate readability,
The process of the reading step selects the readable storage unit from the plurality of storage units based on the storage information, and converts the time information converted from the recording position on the recording medium and the selected storage. When the comparison result with the first accompanying information of the unit indicates that the special reproduction data can be recorded on the recording medium, the special reproduction data is read and the selected storage unit An image processing method, wherein the storage information is updated to indicate that writing is possible. A computer control program for recording encoded image data on a recording medium,
A separation step of separating an intra frame from the image data;
Generating special reproduction data from the intra frame separated by the processing of the separation step, and generating first accompanying information which is time information corresponding to the special reproduction data;
The special reproduction data generated by the process of the generation step and the first accompanying information are written in any of a plurality of storage units, and the storage indicating whether the storage unit that has been written is readable or writable A writing step to update the information;
Based on the first accompanying information and the storage information written in the storage unit by the processing of the writing step, the special reproduction data written in the storage unit is read out, and the read out of the storage unit A reading step for updating the stored information;
Recording the special reproduction data read by the reading step on the recording medium,
Based on the stored information, the writing step selects a writable storage unit from among the plurality of storage units and writes the special reproduction data, and stores the stored information in the selected storage unit. Is updated to indicate readability,
The process of the reading step selects the readable storage unit from the plurality of storage units based on the storage information, and converts the time information converted from the recording position on the recording medium and the selected storage. When the comparison result with the first accompanying information of the unit indicates that the special reproduction data can be recorded on the recording medium, the special reproduction data is read and the selected storage unit A recording medium on which a program is recorded, wherein the storage information is updated to indicate that writing is possible. A computer control program for recording encoded image data on a recording medium,
A separation step of separating an intra frame from the image data;
Generating special reproduction data from the intra frame separated by the processing of the separation step, and generating first accompanying information which is time information corresponding to the special reproduction data;
The special reproduction data generated by the process of the generation step and the first accompanying information are written in any of a plurality of storage units, and the storage indicating whether the storage unit that has been written is readable or writable A writing step to update the information;
Based on the first accompanying information and the storage information written in the storage unit by the processing of the writing step, the special reproduction data written in the storage unit is read out, and the read out of the storage unit A reading step for updating the stored information;
Recording the special reproduction data read by the reading step on the recording medium,
Based on the stored information, the writing step selects a writable storage unit from among the plurality of storage units and writes the special reproduction data, and stores the stored information in the selected storage unit. Is updated to indicate readability,
The process of the reading step selects the readable storage unit from the plurality of storage units based on the storage information, and converts the time information converted from the recording position on the recording medium and the selected storage. When the comparison result with the first accompanying information of the unit indicates that the special reproduction data can be recorded on the recording medium, the special reproduction data is read and the selected storage unit A program for causing a computer to execute processing characterized by updating the stored information so as to indicate that writing is possible.

Images