JP2010045862A - Recording/reproducing apparatus, recording apparatus, reproducing apparatus, recording method, reproducing method and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a novel and enhanced recording/reproducing apparatus, recording apparatus, recording method, and computer program, which record index information in common format, without reference to a recording system, in recording videos and audio and providing many functions based on the recorded index information. <P>SOLUTION: A recording/reproducing apparatus is provided which includes an imaging unit for photographing moving image; an audio recording unit for recording audio; a reproduction information recording unit for recording, at recording of moving images and audio, both of reproduction information on moving image and audio; and a reproducing unit for reproducing moving image and audio based on reproduction information. The reproduction information recording unit records, for each chunk of audio data, audio synchronization information for synchronizing video and audio when recording the reproduction information. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a recording / reproducing apparatus, a recording apparatus, a reproducing apparatus, a recording method, a reproducing method, and a computer program.

  Conventional recording / playback devices such as camcorders that record video and audio not only have the basic functions of recording and playback of video and audio, but also the It also has a function of audio file repair (salvage).

  There are various formats for recording video and audio. Examples of formats include RIFF (Resource Interchange Format), QuickTime, TS (Transport Stream), PS (Program Stream), MXF (Material Exchange Format), and the like. There are many cases where the format for recording video and audio with a camcorder is different from the format required for editing the recorded video and audio. In order to be able to edit video and audio in different formats, each format also records index information so that the position of video and audio in the recorded file can be understood when recording video and audio. (See Patent Documents 1 to 3).

  In this way, by recording index information together, even if the format used when recording video and audio is different from the format used when playing or editing video and audio, the index information is referenced. By doing so, it becomes possible to reproduce and edit video and audio between different formats.

JP 2007-20195 A JP-A-10-84525 JP 05-282380 A

  However, in the conventional method, it is necessary to prepare a processor individually for each format and to implement many functions. For video and audio recording, there are many places where processing can be shared, but since a processor must be prepared for each format, the processing is redundant. There was a problem of getting bigger.

  Also, with the conventional method, index information cannot be recorded at such a short interval that it can be used for salvage (corruption of damaged files), and synchronization information of video and audio is described at the beginning of the stream. For example, when playback is desired from an arbitrary point in the stream, it is necessary to integrate the elapsed time from the beginning of the index, and there is a problem that processing takes time.

  Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is to record index information in a common format regardless of the recording method when recording video and audio, and By recording information that synchronizes video and audio in information, a new and improved recording / reproducing apparatus, recording apparatus, reproducing apparatus, which can realize many functions based on the recorded index information, To provide a recording method, a reproducing method, and a computer program.

  In order to solve the above problems, according to an aspect of the present invention, the present invention relates to an imaging unit that captures a moving image, an audio recording unit that records audio, and reproduction of the moving image and audio during recording of the moving image and audio. A recording / reproducing apparatus comprising: a reproduction information recording unit that records reproduction information together; and a reproduction unit that reproduces a moving image and sound based on the reproduction information. The reproduction information recording unit records reproduction information. In addition, a recording / reproducing apparatus is provided that records audio synchronization information for synchronizing video and audio in parallel with reproduction information for each chunk of audio data.

  According to this configuration, the recording / reproducing apparatus records the reproduction information related to the reproduction of the moving image and the sound at the time of recording the moving image and the sound at the time of recording the image capturing unit that captures the moving image, the sound recording unit that records the sound. A reproduction information recording unit; and a reproduction unit that reproduces a moving image and sound based on the reproduction information. The reproduction information recording unit synchronizes video and audio when recording reproduction information. Information is recorded in parallel with playback information for each chunk of audio data. As a result, many functions can be realized based on the recorded index information by recording the index information in a common format regardless of the recording method including information for synchronizing video and audio.

  The reproduction unit may reproduce the moving image and the sound in synchronization based on the sound synchronization information recorded for each chunk of the sound data. As a result, by using the audio synchronization information for synchronizing the video and audio recorded for each chunk of audio data, the moving image and the audio can be reproduced in synchronization.

  In order to solve the above-described problem, according to another aspect of the present invention, an image capturing unit that captures a moving image, a sound recording unit that records sound, and a moving image and sound when recording a moving image and sound are recorded. A reproduction information recording unit that records reproduction information related to reproduction of the audio, wherein the reproduction information recording unit synchronizes video and audio when recording the reproduction information. Is recorded in parallel with the reproduction information for each chunk of the audio data.

  According to such a configuration, the recording apparatus records an image capturing unit that captures a moving image, an audio recording unit that records audio, and playback information related to playback of the moving image and audio when recording the moving image and audio. An information recording unit, and the reproduction information recording unit records audio synchronization information for synchronizing video and audio in parallel with the reproduction information for each chunk of audio data when recording the reproduction information. As a result, many functions can be realized based on the recorded index information by recording the index information in a common format regardless of the recording method including information for synchronizing video and audio.

  In order to solve the above-described problem, according to another aspect of the present invention, when playing back a moving image and sound, based on the reproduction information related to the reproduction recorded together with the recording of the moving image and sound. And a playback device including a playback unit that plays back the audio and synchronizes the moving image and the sound recorded in parallel with the playback information for each chunk of the audio data included in the playback information. A playback device is provided, which plays back a moving image and sound in synchronization based on the synchronization information.

  According to such a configuration, the playback device includes the playback unit that plays back based on the playback information related to playback recorded when the moving image and the sound are recorded when the moving image and the sound are played back. Reproduces the moving image and the sound in synchronization based on the sound synchronization information for synchronizing the moving image and the sound included in the reproduction information. As a result, by using the audio synchronization information for synchronizing the video and audio recorded in parallel with the reproduction information for each chunk of audio data, the moving image and the audio can be reproduced in synchronization.

  In order to solve the above problems, according to another aspect of the present invention, an imaging step for capturing a moving image, an audio recording step for recording audio, and a moving image and audio at the time of recording the moving image and audio are recorded. And a reproduction information recording step for recording reproduction information relating to reproduction of the audio, wherein the reproduction information recording step includes audio synchronization information for synchronizing video and audio when recording the reproduction information. Is recorded in parallel with the reproduction information for each chunk of the audio data.

  According to such a configuration, the imaging step captures a moving image, the audio recording step records audio, and the reproduction information recording step records the moving image captured in the imaging step and the audio recorded in the audio recording step. In addition, playback information relating to the playback of audio is recorded together. In the reproduction information recording step, audio synchronization information for synchronizing the video and audio when recording the reproduction information is recorded in parallel with the reproduction information for each chunk of audio data. As a result, many functions can be realized based on the recorded index information by recording the index information in a common format regardless of the recording method including information for synchronizing video and audio.

  In order to solve the above-described problem, according to another aspect of the present invention, when playing back a moving image and sound, based on the reproduction information related to the reproduction recorded together with the recording of the moving image and sound. A playback method including a playback step for playback, wherein the playback step includes audio for synchronizing the audio and video recorded in parallel with the playback information for each chunk of audio data included in the playback information. There is provided a playback method characterized in that a moving image and sound are played back synchronously based on the synchronization information.

  According to this configuration, in the playback step, when playing back the moving image and the sound, the playback is performed based on the playback information related to the playback that is recorded when the moving image and the sound are recorded. In the playback step, the video is based on the audio synchronization information for synchronizing the moving image and the audio recorded in parallel with the playback information for each chunk of the audio data included in the playback information at the time of playback. Play the image and sound in sync. As a result, by using audio synchronization information to synchronize the video and audio recorded for each chunk of audio data, the video and audio can be synchronized regardless of the video and audio recording method. Can be played.

  In order to solve the above problems, according to another aspect of the present invention, an imaging step for capturing a moving image, an audio recording step for recording audio, and a moving image and audio at the time of recording the moving image and audio are recorded. A reproduction information recording step for recording the reproduction information relating to the reproduction of the video, and a computer program for causing the computer to execute a process including the reproduction information recording step, wherein the reproduction information recording step synchronizes the video and the audio when recording the reproduction information. A computer program is provided that records audio synchronization information to be performed in parallel with reproduction information for each chunk of audio data.

  In order to solve the above-described problem, according to another aspect of the present invention, when playing back a moving image and sound, based on the reproduction information related to the reproduction recorded together with the recording of the moving image and sound. A computer program for causing a computer to execute a process including a playback step for playback, wherein the playback step includes a moving image and sound recorded in parallel with the playback information for each chunk of audio data included in the playback information. There is provided a computer program characterized in that a moving image and audio are reproduced in synchronization based on audio synchronization information for performing synchronization.

  As described above, according to the present invention, when recording video and audio, the index information in a common format is recorded regardless of the recording method, and the audio synchronization information that synchronizes the video and audio together with the index information is recorded as audio. A new and improved recording / reproducing apparatus, recording apparatus, reproducing apparatus, recording method capable of realizing many functions based on the recorded index information and audio synchronization information by recording each chunk of data, A playback method and a computer program can be provided.

It is explanatory drawing explaining the structure of the recording / reproducing apparatus 100 concerning one Embodiment of this invention. It is explanatory drawing explaining the internal structure of the reproduction | regeneration information file produced | generated by the reproduction | regeneration information generation part 110 concerning one Embodiment of this invention. It is explanatory drawing explaining the data structure of the file header concerning one Embodiment of this invention. It is explanatory drawing explaining the data structure of the data corresponding to each flame | frame concerning one Embodiment of this invention. It is explanatory drawing which shows an example of a structure of the image | video and audio | voice data recorded based on MXF. It is explanatory drawing explaining reproduction | regeneration of the image | video and audio | voice data recorded based on MXF. It is explanatory drawing explaining the example of the chunk of the audio | voice data recorded based on MXF. It is explanatory drawing explaining the data structure of the reproduction | regeneration information file produced | generated when recording a moving image file based on MXF. It is explanatory drawing explaining the case where audio | voice data is recorded as an audio | voice file independently, when audio | voice data is recorded based on MXF. It is explanatory drawing which shows an example of a structure of the image | video and audio | voice data recorded based on MP4 specification. It is explanatory drawing explaining the audio | voice data recorded based on MP4 specification. It is explanatory drawing explaining the data structure of the reproduction | regeneration information file produced | generated based on the image | video and audio | voice data recorded based on MP4 specification. It is explanatory drawing which shows an example of a structure of the data recorded based on MPEG-2 TS specification. It is explanatory drawing which shows the structure of the audio | voice data recorded based on MPEG-2 TS specification in detail. It is explanatory drawing which shows an example of the data recorded as video and audio | voice data based on MPEG-2 TS specification. It is explanatory drawing explaining the data structure of the reproduction | regeneration information file produced | generated based on the image | video and audio | voice data recorded based on MPEG-2 TS specification. It is explanatory drawing explaining the reproducing | regenerating apparatus 200 concerning one Embodiment of this invention. It is explanatory drawing explaining the reproducing | regenerating apparatus 300 concerning one Embodiment of this invention. It is explanatory drawing explaining the reproducing method of the moving image file concerning one Embodiment of this invention.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  FIG. 1 is an explanatory diagram for explaining the configuration of a recording / reproducing apparatus 100 according to an embodiment of the present invention. Hereinafter, the configuration of the recording / reproducing apparatus 100 according to an embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 1, a recording / reproducing apparatus 100 according to an embodiment of the present invention includes a camera 102, a microphone 104, a video / audio I / F unit 106, an encoding / decoding unit 108, and reproduction information generation. Unit 110, DRAM (Dynamic Random Access Memory) 111, recording unit 112, playback unit 114, display unit 116, audio output unit 118, system control unit 120, memory 122, user interface unit 124, , Including.

  The camera 102 captures a subject as a moving image or a still image, converts an image obtained as a result of the capturing into a digital signal, and sends the digital signal to the video / audio I / F unit 106. The microphone 104 records the sound around the recording / playback apparatus 100 at the time when the camera 102 has taken a picture, converts the recorded sound into digital data, and sends it to the video / audio I / F unit 106 as sound data. .

  The video / audio I / F unit 106 sends the image data captured by the camera 102 and the audio data recorded by the microphone 104 to the encode / decode unit 108. Also, it has a role of sending image data sent from the encoding / decoding unit 108 to the display unit 116 and sending audio data to the audio output unit 118.

  The encoding / decoding unit 108 encodes the image data and audio data sent from the video / audio I / F unit 106 based on various methods, and records the encoded image data and audio data with the reproduction information generation unit 110. To the unit 112. Examples of encoding methods include MPEG-1, MPEG-2, MPEG-4, and the like.

  Also, the encoding / decoding unit 108 reads out the image data and audio data recorded in the recording unit 112 and decodes them according to the encoded method, and the decoded image data and audio data is a video / audio I / F unit. It also has a role to send to 106.

  The reproduction information generation unit 110 inputs the image data and audio data encoded by the encoding / decoding unit 108, and creates a reproduction information file from the image data and audio data. The structure of the reproduction information file will be described later. The created reproduction information file is sent to the recording unit 112 and recorded.

  When recording is started by the recording / playback apparatus 100, the playback information file sequentially records the playback information in the playback information recording area included in the DRAM 111. When the recording ends, the playback information recorded in the playback information recording area of the DRAM 111 is played back. You may create by creating as an information file. Recording of reproduction information in the DRAM 111 is performed at predetermined intervals. As an example of the predetermined interval, it may be performed at intervals of 2 seconds, for example.

  The recording unit 112 records the image data and audio data encoded by the encoding / decoding unit 108 in a moving image file format. In addition, a reproduction information file created by the reproduction information generation unit 110 based on the image data and audio data encoded by the encoding / decoding unit 108 is also recorded.

  The system control unit 120 controls each unit of the recording / reproducing apparatus 100. As control of each part of the recording / reproducing apparatus 100 controlled by the system control unit 120, for example, when the user interface unit 124 instructs to start recording, the system control unit 120 performs recording and recording on the camera 102 and the microphone 104. Instruct the start of recording. Of course, the control performed by the system control unit 120 is not limited to this example.

  The user interface unit 124 receives an operation of an operation unit (not shown) from a user who uses the recording / reproducing apparatus 100, and sends an operation signal representing the operation to the system control unit 120. As the user operating with the operation unit, there are an instruction to start capturing a moving image, an instruction to reproduce the captured moving image and the like.

  The memory 122 stores data necessary for processing performed by each unit of the recording / reproducing apparatus 100. For example, a computer program is stored in the memory 122, and the computer program stored in the system control unit 120 is read and executed, whereby processing for a moving image file to be reproduced can be performed.

  The configuration of the recording / reproducing apparatus 100 according to the embodiment of the present invention has been described above with reference to FIG. Next, the internal structure of the reproduction information file generated by the reproduction information generation unit 110 according to an embodiment of the present invention will be described.

  FIG. 2 is an explanatory diagram illustrating the internal configuration of the reproduction information file generated by the reproduction information generation unit 110 according to an embodiment of the present invention. Hereinafter, the internal structure of the reproduction information file according to the embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 2, the reproduction information file according to the embodiment of the present invention is configured by 16 bytes of data as one block. From the top of the file, a file header, extended file headers 1 to n, and data corresponding to each frame are sequentially stored.

  The file header stores basic information regarding image data and audio data recorded by the recording / reproducing apparatus 100. As an example of basic information related to image data and audio data stored in the file header, version information, file basic information, video basic information, audio basic information, and time code information are recorded. Of course, the information recorded in the file header in the present invention is not limited to this example.

  The extended file header is not recorded in the file header, but stores information related to image data and audio data recorded by the recording / reproducing apparatus 100. In this embodiment, the number of frames to be hidden at the top, the number of frames to be reproduced, and the frame number of the representative image used for the thumbnail list are recorded in the extension file header. Of course, in the present invention, the information recorded in the extension file header is not limited to this example. Further, the number of extension file headers may be one, or two or more. FIG. 2 shows a data structure when n extension file headers are provided.

  Data corresponding to each frame stores information in each frame of image data and audio data. In the present embodiment, stored information includes a GOP (Group Of Picture) head flag, a picture type, video information, audio synchronization information, and audio information. As the video information, for example, the size of image data for each frame and the absolute address of the image data are stored, and as the audio information, for example, the audio data size for each frame, the relative address or the absolute address of the audio data is stored.

  Data corresponding to each frame is sequentially generated from the 0th frame (frame 0) based on the recorded data when the recording / playback apparatus 100 records image data and audio data. Then, when the number of frames increases, it is created by sequentially adding to the data corresponding to each frame already created as the number of frames increases. It is desirable to create data corresponding to each frame at a predetermined interval. In the present embodiment, data corresponding to each frame is created at intervals of 2 minutes.

  The internal configuration of the reproduction information file according to the embodiment of the present invention has been described above with reference to FIG. Next, the data structure of the file header according to the embodiment of the present invention will be described.

  FIG. 3 is an explanatory diagram illustrating the data structure of the file header according to the embodiment of the present invention. The data structure of the file header according to the embodiment of the present invention will be described below using FIG.

  As shown in FIG. 3 and as described above, the file header has a 16-byte area. In the file header, version information, file basic information, video basic information, audio basic information, and time code information are recorded.

  Basic file information includes video chunk header length and audio chunk header length. Basic video information includes frame rate, image aspect ratio, number of horizontal and vertical pixels, video compression standard, basic audio information. , Audio quantization bit number, audio track configuration, audio sampling frequency, and audio compression standard information. The location for storing these pieces of information is defined so as to fit in the 16-byte area of the file header. Note that the value of the video chunk header length may differ depending on the picture type to be described later. In this case, the video chunk header length data may be stored for each picture type. For example, when the picture chunk header length differs between the I picture and the non-I picture, two types of values are stored in the file basic information.

  The data structure of the file header according to the embodiment of the present invention has been described above using FIG. Next, a data configuration of data corresponding to each frame according to the embodiment of the present invention will be described.

  FIG. 4 is an explanatory diagram for explaining the data structure of data corresponding to each frame according to the embodiment of the present invention. Hereinafter, the data configuration of data corresponding to each frame according to the embodiment of the present invention will be described with reference to FIG.

  As shown in FIG. 4 and as described above, the data corresponding to each frame has a 16-byte area. Data corresponding to each frame includes a GOP (Group Of Picture) head flag, a picture type, video information, audio synchronization information, and audio information. In addition, the size of image data and the absolute address of image data in the frame are stored as video information, and the size of audio data and the relative address or absolute address of audio data in the frame are stored as audio information. In addition, a difference value between the time information of the image data and the time information of the sound data is stored as the sound synchronization information. The location for storing these pieces of information is defined so as to fit in the 16-byte area of data corresponding to each frame.

  By storing the GOP head flag and the picture type as data corresponding to each frame, even when playback is performed from the middle of the frame, by reading the playback information corresponding to the frame from which playback is to be started, the frame and the frame It is possible to read and decode image data of previous and subsequent frames.

  The data structure of the data corresponding to each frame according to the embodiment of the present invention has been described above using FIG. It should be noted that the data configuration shown in FIGS. 3 and 4 is an example of the present invention, and it goes without saying that the storage position of each data is not limited to the case shown in FIGS.

  Next, a method for generating a reproduction information file generated by the reproduction information generation unit 110 according to an embodiment of the present invention will be described.

  FIG. 5 is an explanatory diagram showing an example of the configuration of video and audio data recorded based on MXF (Material Exchange Format). As shown in FIG. 5, in MXF, audio data (A0, A1, A2,...) And image data (B0, B1, I2,..., P5,...) Are mixedly recorded. Is done. Here, B, I, and P each represent a picture type, and B0 represents the 0th frame whose picture type is B. The image data is recorded with a different size for each frame.

  Here, lenHA shown in FIG. 5 is the audio chunk header length, lenHI is the video chunk header length of a video frame whose picture type is I picture, and lenHV is the video chunk header of a video frame whose picture type is other than I picture. Each represents a length. Also, sizeV [n] represents the video data size of the nth frame, offsV [n] represents the video data address of the nth frame, sizeA [n] represents the audio data size of the nth frame, and offA [n ] Represents the audio data address of the nth frame. These notations are the same in the following drawings.

  Therefore, when video and audio data is recorded based on MXF, information for each frame of each data is recorded in the reproduction information file. Then, when reproducing a moving image file in which video and audio data are recorded, the moving image file can be reproduced from the middle of the file by referring to the generated reproduction information file.

  FIG. 6 is an explanatory diagram for explaining reproduction of video and audio data recorded based on MXF. Video means a video frame, Audio means an audio frame, and skip F represents the number of frames that are not displayed when a moving image file is reproduced due to inability to decode. fps represents the number of frames played back per second (frame per second), and 1 / fps represents the time of one frame. Information about fps is stored in the file header of the reproduction information file. When information about fps is stored in the reproduction information file, it may be stored as an actual value or as a parameter. In this embodiment, it is stored in the file header of the reproduction information file in the form of parameters.

  Similarly to FIG. 5, B, I, and P in the video frame each represent a picture type, and B0 represents the 0th frame having a picture type of B. A0 in the audio frame represents the 0th frame audio data. TC indicates a time code, and orgTC indicates an initial value of the time code. The values of skipF and orgTC are stored in the file header or extended file header of the reproduction information file, and when reproducing a moving image file, the information is read from the reproduction information file and reproduced.

  As shown in FIG. 6, in MXF, the playback timing of video and the playback timing of audio may be different (delayed) at the start of playback (the time indicated by PB begin in FIG. 6). DelA [2] shown in FIG. 6 represents the audio synchronization timing in the second frame. That is, as shown in FIG. 6, when the video playback timing and the audio playback timing are different, the video and the audio can be played back in synchronization by delaying the playback of the audio by delA [2]. In the example shown in FIG. 6, since the audio is delayed from the video, delA [2] indicates a negative value.

  Therefore, when video and audio data are recorded based on MXF, delay information for each frame of each data is recorded in the reproduction information file. When a moving image file in which video and audio data is recorded is reproduced, the video and audio can be reproduced in synchronization by referring to the delay information included in the generated reproduction information file.

  FIG. 7 is an explanatory diagram for explaining an example of chunks of audio data recorded based on MXF. FIG. 7 illustrates the kth frame as an example. As shown in FIG. 7, the mass of audio data recorded based on MXF may be in the case of using 2 tracks (stereo 2tracks) in stereo, or in the case of using 4 tracks (mono 4tracks) in monaural. .

  In FIG. 7, when two tracks are used in stereo, data is recorded with ch (channel) 1 and ch2 as one block and ch3 and ch4 as one block. When 4 tracks are used in monaural, data is recorded as one block for each channel. lenHA indicates the chunk size of the audio data and is information stored in the file header of the reproduction information file.

  In such a case, the audio data size sizeA [k] and relative address offsA [k] are recorded in the reproduction information file. Then, when playing back a moving image file in which video and audio data is recorded, by referring to the generated reproduction information file, even when the moving image file is played from the middle of the file, the sound is played from the playback location. Can do.

  FIG. 8 is an explanatory diagram illustrating a data configuration of a reproduction information file generated when a moving image file is recorded based on MXF according to an embodiment of the present invention.

  As shown in FIG. 8, image data size (sizeV []), image data absolute address (offsV []), delay information (delA []), audio data size (sizeA []) for each frame, Record the relative address (offsA []) of the audio data. Also, GOP head flag (1 or 0. 1 indicates that the frame is the head of GOP) and picture type (B, P, I) information are also stored for each frame.

  Thus, by generating a playback information file when recording a video file based on MXF, even when the video file is played from the middle of the file, information stored in the playback information file can be referred to. The video and audio can be reproduced from the reproduction location. And since the audio information is also recorded in the playback information file, even if the video file is played from the middle of the file, the video and audio are synchronized by referring to the playback information file, Video and audio can be played from the playback location.

  For example, when acquiring video data of the kth frame, if the frame is an I picture, the range from (offsV [k] + lenHI) to (offsV [k] + sizeV [k] −1) If the frame corresponds to video data of the kth frame and the frame is a P picture or a B picture, the range from (offsV [k] + lenHV) to (offsV [k] + sizeV [k] -1) is kth. Corresponds to the video data of the frame.

  Further, when acquiring the audio data of the kth frame, the audio track unit_lenA is _lenA = sizeA [k] / (trksA & 0xf), and the audio data address is offsA [k] + offsV [k] + (_ lenA * j) + lenHA, and the voice data length is represented by _lenA-lenHA. Here, trksA represents the number of audio tracks and is data stored in the file header of the reproduction information file.

  A reproduction information file can be generated not only when image data and audio data are recorded in one moving image file, but also when audio data is recorded as an audio file independently of the moving image file. FIG. 9 is an explanatory diagram for explaining a case where audio data is recorded as an audio file independently when audio data is recorded based on MXF. In the example shown in FIG. 9, the audio is monochrome 2 channels and the file names are xxxxA01. aud and xxxxA02. The case of recording as aud is shown.

  Even when audio data is recorded as an audio file independently of the video file, the data size and relative address of the audio data corresponding to each frame can be recorded, so that even if the video file is played from the middle of the file, it is generated By referring to the reproduced information file, the sound can be reproduced from the reproduction location.

  The data structure of the reproduction information file generated when recording a moving image file based on MXF has been described above. Since RIFF (Resource Interchange File Format) has a data structure similar to MXF, the index has the completely same format as MXF, and the processing using the index for reproduction and the like is the same as the processing in MXF. . Even when a moving image file is recorded based on a standard other than MXF, it is possible to reproduce video and audio by generating a reproduction information file and referring to the generated reproduction information file. Examples according to other standards will be described below.

(Example in the MP4 standard)
FIG. 10 is an explanatory diagram showing an example of the configuration of video and audio data recorded based on the MP4 standard. As shown in FIG. 10, in the MP4 standard, audio data (A0-A14, A15-A29,...) And image data (I2, P5, P8, P11, P14, I17,...) Are mixed. And recorded. Further, audio data recorded based on the MP4 standard is recorded as a set of 15 frames.

  In FIG. 10, stsz [] is the size of each frame of video and audio data recorded based on the MP4 standard, stco [] is a chunk of video and audio data, and stsc [] is video and audio data. Shows information about chunks.

  FIG. 11 is an explanatory diagram for explaining audio data recorded based on the MP4 standard. As described above, 15 frames of audio data recorded based on the MP4 standard are recorded in a lump. In the example shown in FIG. 11, therefore, the data size of 15 frames of audio data is recorded when the reproduction information file is generated.

  In this way, a reproduction information file is generated based on the video and audio data recorded based on the MP4 standard. FIG. 12 is an explanatory diagram illustrating a data structure of a reproduction information file generated based on video and audio data recorded based on the MP4 standard according to an embodiment of the present invention. As shown in FIG. 12, the reproduction information file generated based on the video and audio data recorded based on the MP4 standard includes the size (sizeV []) of the image data for each frame and the absolute address ( offsV []) is stored.

  Further, as described above, the audio data recorded based on the MP4 standard is recorded as a set of 15 frames. For this reason, audio data is recorded in units of 15 frames, not in units of 1 frame. That is, as shown in FIG. 12, the size of the audio data (sizeA [0]), the relative address (offsA [0]) of the audio data and the delay information (delA [del] [ When 0]) is recorded, 0 is recorded at a location where information relating to audio data of frames 1 to 14 is stored. Then, the size of the audio data (sizeA [15]), the relative address (offsA [15]) of the audio data, and the delay information (delA [15]) are recorded at the location where the information related to the audio data of the frame 15 is stored.

  Thus, even when a moving image file is generated based on the MP4 standard, a reproduction information file can be generated. By recording information related to the image data and audio data of the moving image file generated based on the MP4 standard in the reproduction information file, even when the moving image file is reproduced from the middle of the file, the image can be obtained by referring to the reproduction information file. And audio can be reproduced from the reproduction location. And since the audio information is also recorded in the playback information file, even if the video file is played from the middle of the file, the video and audio are synchronized by referring to the playback information file, Video and audio can be played from the playback location. In addition, since the QuickTime format has a data structure similar to that of MP4, the index has the completely same format as MP4, and the processing using the index for reproduction and the like is the same processing as in MP4.

(Example in the MPEG-2 TS standard)
FIG. 13 is an explanatory diagram showing an example of the structure of data recorded based on the MPEG-2 TS (Transport Stream) standard. As shown in FIG. 13, as data to be recorded based on the MPEG-2 TS standard, in addition to video and audio data, SIT (Selection Information Table; information on instruction of information related to transmitted program), PAT (Program Association Table; information for managing content transmitted in the stream), PMT (Program Map Table; information for managing video and audio data constituting the content transmitted in the stream), PCR (Program Clock Reference; program time) Information such as a reference value is also created.

  In addition, video and audio data generated based on the MPEG-2 TS standard are multiplexed and recorded (AUX-V, AUX-A).

  Even in the case of a moving image file generated based on the MPEG-2 TS standard in this manner, information on the position and size of each frame of video and audio data is recorded in the reproduction information file, so that the reproduction information file can be referred to. Thus, the moving image file can be played back.

  FIG. 14 is an explanatory diagram showing in detail the structure of audio data recorded based on the MPEG-2 TS standard. As shown in FIG. 14, audio packets in the MPEG-2 TS standard are intensively arranged in units of PES (Packetized Elementary Stream), and 4 to 5 PES (59.94i) corresponding to the Video Pack are collected to 1 One Audio Pack is configured. When audio data recorded based on the MPEG-2 TS standard is recorded as reproduction information of the present invention, it is possible to describe a general frame unit. However, in this embodiment, the configured audio pack is used. Are treated as a single block of audio data.

  FIG. 15 is an explanatory diagram showing an example of data recorded as video and audio data based on the MPEG-2 TS standard. In MPEG-2 TS and MPEG-2 PS, the first 32 bits of video data and audio data are assigned as a header. Therefore, what is actually recorded as the size of video data and audio data is the size excluding the leading 32 bits.

  In this way, a reproduction information file is generated based on the video and audio data recorded based on the MPEG-2 TS standard. FIG. 16 is an explanatory diagram for explaining the data structure of a reproduction information file generated based on video and audio data recorded based on the MPEG-2 TS standard according to an embodiment of the present invention.

  As shown in FIG. 16, the reproduction information file generated based on the video and audio data recorded based on the MPEG-2 TS standard includes the size (sizeV []) of the image data for each frame and the image data. An absolute address (offsV []) is stored.

  Audio data is recorded in units of three frames, not in units of one frame. That is, as shown in FIG. 16, the size of the audio data (sizeA [0]), the relative address (offsA [0]) of the audio data, and the delay information (delA [del] [ When 0]) is recorded, 0 is recorded at a location where information relating to audio data of frame 1 and frame 2 is stored. Then, the size of the audio data (sizeA [3]), the relative address (offsA [3]) of the audio data, and the delay information (delA [3]) are recorded in a location where information related to the audio data of frame 3 is stored.

  Thus, even when a moving image file is generated based on the MPEG-2 TS standard, a reproduction information file can be generated. By recording information related to image data and audio data of a moving image file generated based on the MPEG-2 TS standard in a reproduction information file, the reproduction information file is referred to even when the moving image file is reproduced from the middle of the file. Thus, video and audio can be reproduced from the reproduction location. Since the playback information file also records audio delay information, even when the video file is played from the middle of the file, the playback information file can be used to refer to the video using the audio delay information. And the audio can be synchronized and the video and audio can be reproduced from the reproduction location.

  The method for generating the reproduction information file generated by the reproduction information generating unit 110 according to the embodiment of the present invention has been described above.

  Thus, if a playback information file is generated so as to correspond to each standard, even if the playback device performs processing such as playback and editing of a moving image file with a standard different from the standard at the time of recording, By referring to the file, it is possible to play or edit the movie file. Next, a playback device that plays back a moving image file using a playback information file according to an embodiment of the present invention will be described.

  FIG. 17 is an explanatory diagram illustrating a playback device 200 that plays back a moving image file using a playback information file according to an embodiment of the present invention. As shown in FIG. 17, a playback apparatus 200 according to an embodiment of the present invention includes a recording unit 202, a playback information analysis unit 204, a decoding unit 206, a playback unit 208, a display unit 210, and an audio output. Unit 212, system control unit 214, memory 216, and user interface unit 218.

  The recording unit 202 records a moving image file created based on a predetermined standard and a reproduction information file generated based on the image data and audio data of the moving image file. Examples of the predetermined standard include standards such as MXF and MP4. As the recording unit 202, a recording medium such as a hard disk drive (HDD) fixed to the playback device 200 or various memory cards, a CD-ROM, a DVD-ROM, or the like used by being connected to the playback device 200 can be used. .

  The reproduction information analysis unit 204 reads and analyzes the reproduction information file recorded in the recording unit 202. The reproduction information analysis unit 204 receives an instruction for a reproduction start position from the user interface unit 218 via the system control unit 214, and reads reproduction information corresponding to the reproduction start position that has received the instruction. Then, the playback apparatus 200 plays back the moving image file that is the source of the playback information file, based on the playback information read and analyzed by the playback information analysis unit 204.

  For example, when the user interface unit 218 instructs the playback from the 10th frame of the moving image file, the playback information analysis unit 204 receives the playback information of the 10th frame from the user interface unit 218 via the system control unit 214. Instruct to get and analyze.

  Receiving the instruction to acquire and analyze the reproduction information of the 10th frame, the reproduction information analysis unit 204 receives the size of the image data of the 10th frame, the absolute address of the image data, the size of the audio data from the reproduction information file, Get the relative address and delay information of the audio data. Based on the acquired information, the reading position and reading size of the image data and audio data in the moving image file are determined.

  The decoding unit 206 decodes the moving image file recorded in the recording unit 202. When decoding is performed by the decoding unit 206, decoding is performed based on the reproduction information analyzed by the reproduction information analysis unit 204. For example, when the user interface unit 218 instructs to reproduce from the 10th frame of the moving image file, the reproduction information analysis unit 204 acquires the reproduction information of the 10th frame and performs decoding from the 10th frame.

  The reproduction unit 208 receives the data decoded by the decoding unit 206 and reproduces the moving image file. The moving image recorded in the moving image file to be reproduced is displayed on the display unit 210, and the sound of the moving image file to be reproduced is output to the audio output unit 212.

  The system control unit 214 controls each unit of the playback device 200. For example, when the reproduction start position of the moving image file is instructed from the user interface unit 218, the system control unit 214 instructs the reproduction information analysis unit 204 to reproduce the reproduction information file corresponding to the reproduction start position of the moving image file. Instructs the acquisition of information. Of course, the control performed by the system control unit 214 is not limited to this example.

  The user interface unit 218 receives an operation of an operation unit (not shown) from a user who uses the playback device 200, and sends an operation signal indicating the operation to the system control unit 214. The user operates the operation unit to select a moving image file to be reproduced and to specify a reproduction start position of the selected moving image file.

  The memory 216 stores data necessary for processing performed by each unit of the playback device 200. For example, a computer program is stored in the memory 216, and the computer program stored in the system control unit 214 is read and executed, so that the processing for the moving image file to be reproduced can be performed.

  In this way, the playback device 200 is configured, and the playback device 200 decodes the image data and the audio data from the moving image file and the playback information file, thereby being encoded and generated by a method different from the method of the playback device 200. Even video files can be easily played back. In addition, since the reproduction information file includes audio synchronization information, it is possible to synchronize the image and the audio by referring to the audio synchronization information.

  FIG. 18 is an explanatory diagram illustrating a playback device 300 that plays back a moving image file using a playback information file according to an embodiment of the present invention. As shown in FIG. 18, a playback apparatus 300 according to an embodiment of the present invention includes a recording unit 302, a switching unit 304, a TS buffer 306, a QT buffer 308, a DSP (Digital Signal Processor) 310, A video ES buffer 318, an MP2 buffer 320, an L-PCM buffer 322, and an encoder / decoder 324 are configured.

  Similar to the recording unit 202 in the playback apparatus 200 described above, the recording unit 302 includes a moving image file created based on a predetermined standard, and a reproduction information file generated based on image data and audio data of the moving image file. Is recorded. Examples of the predetermined standard include standards such as MXF and MP4. As the recording unit 302, a recording medium such as a hard disk drive (HDD) fixedly provided in the playback device 300 or various memory cards, CD-ROMs, DVD-ROMs, etc. used by being connected to the playback device 300 can be used. .

  The switching unit 304 reads the moving image file recorded in the recording unit 302 and switches the data destination depending on the type of the moving image file. In the present embodiment, the switching unit 304 sends data to either the TS buffer 306 or the QT buffer 308 depending on the type of the read moving image file.

  When data is sent from the switching unit 304, information (offV [], offA []) relating to the recording position of image data and audio data is read from the reproduction information file, and data is acquired from the moving image file based on the read information. To do.

  The TS buffer 306 receives data from the switching unit 304 and temporarily stores it. Similarly, the QT buffer 308 receives video and audio data from the switching unit 304 and temporarily stores them.

  The DSP 310 receives video and audio data temporarily stored in the TS buffer 306 and the QT buffer 308, and is necessary for reproduction of a moving image file such as multiplexing processing and separation processing on the received video and audio data. The processing is performed and output to the video ES buffer 318, the MP2 buffer 320, and the L-PCM buffer 322 in the subsequent stage.

  The DSP 310 performs processing for synchronizing video and audio on video and audio data, in addition to multiplexing processing and separation processing. Video and audio are synchronized by referring to the synchronization information in each frame recorded in the reproduction information file. The DSP 310 includes a TS separator 312, a multiplexer 314, and a demultiplexer 316.

  The video ES buffer 318 receives the data output from the DSP 310 and temporarily stores it. Similarly, the MP2 buffer 320 and the L-PCM buffer 322 receive the data output from the DSP 310 and temporarily store it.

  The encoder / decoder 324 receives data from the video ES buffer 318 and the MP2 buffer 320, decodes the received data, and outputs the decoded data. When decoding is performed by the encoder / decoder 324, decoding method information is acquired from the reproduction information file, and decoding processing is performed based on the acquired decoding information.

  Even when the playback device 300 is configured as described above, the playback device 300 decodes the image data and the audio data from the moving image file and the playback information file, thereby encoding with a method different from the method that the playback device 300 has. Thus, even a moving image file generated can be easily reproduced. In addition, since the reproduction information file includes audio synchronization information, it is possible to synchronize the image and the audio by referring to the audio synchronization information.

  Heretofore, the playback apparatus that plays back a moving image file using the playback information file according to the embodiment of the present invention has been described. Next, a method for reproducing a moving image file according to an embodiment of the present invention will be described.

  FIG. 19 is an explanatory diagram illustrating a moving image file playback method according to an embodiment of the present invention. Hereinafter, a method for reproducing a moving image file according to an embodiment of the present invention will be described with reference to FIG. In the following, a method for reproducing a moving image file with the reproducing apparatus 200 will be described.

  First, the reproduction information analysis unit 204 obtains the address on the reproduction information file of the f0th frame to be searched (step S102). Since the reproduction information file is a collection of 16 bytes, if the frame number f0 of the frame to be searched is known, the address on the reproduction information file can be obtained. Then, the reproduction information of the frame to be cued recorded from the address obtained in step S102 is read.

  Subsequently, the reproduction information analysis unit 204 reads the picture type included in the reproduction information (step S104). There are three types of picture types: an I picture (Intra Picture), a B picture (Bidirectionally Predictive Picture), and a P picture (Predictive Picture).

  The I picture is a screen obtained by encoding all the screens in the frame, and is a reference picture in the GOP. A P picture is a screen obtained by forward prediction between screens. The B picture is a screen obtained by forward prediction and / or backward prediction, that is, bidirectional prediction.

  In addition, for B pictures, encoding that does not perform prediction before and after a frame (intra encoding), forward prediction encoding that predicts from a previous playback screen (forward prediction encoding), and backward prediction that is predicted from the future It can be classified into four types of encoding (Backward predictive encoding) and bidirectional predictive encoding (Interpolative predictive encoding) in which both the front and rear are used for prediction.

  When the reproduction information analysis unit 204 reads the picture type in step S104, the reproduction information analysis unit 204 determines a frame to be decoded according to the read picture type. If the read picture type is an I picture, or a B picture and Closed B0 or Closed B1, the picture types of frame numbers f0 + 1 and f0 + 2 are read (step S110). On the other hand, when the picture type is other than this, reproduction information is read back by going back to the frame until the picture type is a frame of I picture (step S106).

  Here, Closed B0 is a frame in which the picture type of the current frame is reverse predictive coding in a B picture, and the picture type of the next frame is an I picture. Closed B1 is a frame in which the picture type of the current frame and the next frame is subjected to backward predictive coding in a B picture, and the picture type of the second frame is an I picture.

  When going back to a frame whose picture type is an I picture, the reproduction information of the frame is read, and based on the read reproduction information, image data is sent from the moving image file to the decoding unit 206 for decoding (step S108).

  When the decoding unit 206 performs decoding in step S108, the reproduction information analysis unit 204 moves down the frame while reading the picture type of the reproduction information from the frame to the f0th frame. When a frame with a picture type of P picture appears when going down the frame, the reproduction information of the frame is read, and based on the read reproduction information, image data is sent from the moving image file to the decoding unit 206 for decoding.

  When the f0th frame is reached, the reproduction information analysis unit 204 reads the picture types of frame numbers f0 + 1 and f0 + 2 (step S110). If the picture type of the frame is an I picture or a P picture, the playback information of the frame is read, and based on the read playback information, image data from the moving image file is sent to the decoding unit 206 for decoding.

  Subsequently, the reproduction information of the desired f0th frame is read, and based on the read reproduction information, image data is sent from the moving image file to the decoding unit 206 to be decoded (step S112).

  After that, the image data is sent from the moving image file to the decoding unit 206 in order from the smallest value of offsV [], that is, in ascending order of the absolute address of the image data in the moving image file to perform decoding (step S114).

  On the other hand, the audio data is read from the reproduction information of the desired f0th frame, and the audio data is sent from the moving image file to the decoding unit 206 and decoded based on the read reproduction information. Video and audio are synchronized by reading the synchronization information (delA [f0]) recorded in the reproduction information of the f0th frame and reflecting it in the decoding result of the decoding unit 206.

  As described above, by reading the reproduction information from the reproduction information file, it is possible to reproduce the moving image file from the desired frame. Also, since the audio information that synchronizes the video and audio is recorded in the playback information file, the video and audio are synchronized by reading the playback information from the playback information file when playing a video file. It can be played back.

  In the foregoing, the method for reproducing a moving image file according to an embodiment of the present invention has been described.

  As described above, according to an embodiment of the present invention, when a moving image is recorded as a moving image file by the recording / reproducing apparatus 100, a reproduction information file including reproduction information of the moving image is also created. When the moving image file recorded by the recording / reproducing apparatus 100 is reproduced, the reproduction is performed while referring to the reproduction information file created by the recording / reproducing apparatus 100 instead of the information related to reproduction included in the moving image file. By reproducing while referring to the reproduction information file, reproduction is possible even with a reproduction apparatus that performs decoding according to a different standard from the recording / reproduction apparatus 100.

  By generating the reproduction information file, various processes can be performed in addition to the reproduction of the moving image file. Below, an example of those processes is shown.

(Processing Example 1. Salvage)
Based on the playback information generated together with recording by the recording / reproducing apparatus 100, the recording / reproducing apparatus 100 is generated when the recording does not end normally due to the power being cut off due to a battery exhaustion or the like during recording. The moving image file can be restored from the information of each frame included in the reproduced information.

(Processing example 2. Division)
By using a reproduction information file that is also generated when the recording / playback apparatus 100 generates a moving image file, the moving image file can be divided. The division point is determined by the reproduction information file, and then the reproduction information file itself is divided. The stream portion of the moving image file is divided and partially duplicated according to the divided reproduction information file. Thereafter, a recording end process is performed on each of the divided moving image files to complete two moving image files.

  When dividing, it is necessary to decode a frame that does not need to be displayed depending on the case. In that case, an overlapping portion having a predetermined length is provided and divided. At this time, the reproduction information file is also divided by providing an overlap portion having a predetermined length, so that the moving image file can be divided.

(Processing example 3. Creation of reproduction information file from moving image file)
When a moving image file having no reproduction information file is given to the recording / reproducing apparatus 100, index information determined by each wrapper method can be read and converted into a reproduction information file. By using the reproduction information file obtained by conversion, normal reproduction, cueing, and further division can be realized by the same processing as a moving image file having a reproduction information file.

  As described above, according to an embodiment of the present invention, a reproduction information file is created together with a moving image file. In the reproduction information file, moving picture file standards, basic information of the moving picture file, information such as the size and address of each frame, and synchronization information for synchronizing video and audio are recorded. When playing or editing a movie file, the playback information file is referred to instead of the index information recorded in the movie file. It can be easily performed. As a result, even a system that handles different standards can realize a system that supports multiple formats by referring to the reproduction information file.

  As mentioned above, although preferred embodiment of this invention was described referring an accompanying drawing, it cannot be overemphasized that this invention is not limited to the example which concerns. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

  For example, in the above embodiment, when the playback information file is created together with the creation of the moving image file by the recording / playback apparatus 100, the playback information is recorded while being added to the DRAM 111 at a predetermined interval, and the recording ends. Although the reproduction information file is created from the reproduction information recorded in the DRAM 111, the present invention is not limited to such an example. When the recording / playback apparatus 100 creates a playback information file together with the creation of a moving image file, it creates the playback information file in the DRAM 111 at a predetermined interval, and opens and closes the playback information file at a predetermined interval. It may be repeated while adding reproduction information.

  The present invention is applicable to a recording / reproducing apparatus, a recording apparatus, a reproducing apparatus, a recording method, a reproducing method, and a computer program.

DESCRIPTION OF SYMBOLS 100 Recording / reproducing apparatus 102 Camera 104 Microphone 106 Video | audio / I / F part 108 Encoding / decoding part 110 Reproduction | regeneration information generation part 111 DRAM
112 Recording unit 114 Playback unit 116 Display unit 118 Audio output unit 120 System control unit 122 Memory 124 User interface unit 200 Playback device 202 Recording unit 204 Playback information analysis unit 206 Decoding unit 208 Playback unit 210 Display unit 212 Audio output unit 214 System control Unit 216 memory 218 user interface unit 300 playback device 302 recording unit 304 switching unit

Claims (8)

An imaging unit that captures a moving image, an audio recording unit that records audio, a reproduction information recording unit that records reproduction information related to reproduction of the moving image and the audio at the time of recording the moving image and audio, and a recording A recording / playback apparatus comprising: a playback unit that plays back the moving image and sound based on the playback information:
The reproduction information recording unit records the moving image, the audio, and the reproduction information at the same time, records video basic information and audio basic information in a header of the reproduction information, and records the reproduction information as a moving image. A recording / reproducing apparatus, wherein audio synchronization information for synchronizing an image and audio is recorded in parallel with the reproduction information for each chunk of audio data.   The recording / reproducing apparatus according to claim 1, wherein the reproduction unit reproduces the moving image and the audio in synchronization based on the audio synchronization information recorded for each chunk of audio data. An imaging unit that captures a moving image, an audio recording unit that records audio, and a reproduction information recording unit that records reproduction information related to reproduction of the moving image and the audio at the time of recording the moving image and audio. Recording device:
The reproduction information recording unit records the moving image, the audio, and the reproduction information at the same time, records video basic information and audio basic information in a header of the reproduction information, and moves the moving image when recording the reproduction information. A recording apparatus for recording audio synchronization information for synchronizing an image and audio in parallel with the reproduction information for each chunk of audio data. When playing back a moving image and audio, the video and audio are recorded at the same time, and video basic information and audio basic information are recorded in the header, and are played back based on playback information related to playback. A playback device comprising a playback unit:
The reproduction unit synchronizes the moving image and the audio based on audio synchronization information for synchronizing the moving image and the audio recorded for each chunk of audio data included in the reproduction information. A playback device characterized by playing back. An imaging step for capturing a moving image;
An audio recording step for recording audio;
A reproduction information recording step for recording the reproduction information relating to reproduction of the moving image and the sound at the time of recording the moving image picked up in the imaging step and the sound recorded in the sound recording step;
A recording method including:
In the reproduction information recording step, the moving image, the audio, and the reproduction information are simultaneously recorded, video basic information and audio basic information are recorded in a header of the reproduction information, and a moving image is recorded when the reproduction information is recorded. A recording method, wherein audio synchronization information for synchronizing an image and audio is recorded in parallel with the reproduction information for each chunk of audio data. When playing back a moving image and audio, the video and audio are recorded at the same time, and video basic information and audio basic information are recorded in the header, and are played back based on playback information related to playback. A playback method that includes a playback step:
The reproduction step includes the moving image based on audio synchronization information for synchronizing the audio and the moving image recorded in parallel with the reproduction information for each chunk of audio data included in the reproduction information. And the audio are reproduced in synchronization with each other. An imaging step for capturing a moving image;
An audio recording step for recording audio;
A reproduction information recording step for recording the reproduction information relating to reproduction of the moving image and the sound at the time of recording the moving image picked up in the imaging step and the sound recorded in the sound recording step;
A computer program for causing a computer to execute a process including:
In the reproduction information recording step, the moving image, the audio, and the reproduction information are simultaneously recorded, video basic information and audio basic information are recorded in a header of the reproduction information, and a moving image is recorded when the reproduction information is recorded. A computer program for recording audio synchronization information for synchronizing an image and audio in parallel with the reproduction information for each chunk of audio data. When playing back a moving image and audio, the video and audio are recorded at the same time, and video basic information and audio basic information are recorded in the header, and are played back based on playback information related to playback. A computer program that causes a computer to execute processing including a playback step,
The reproduction step includes the moving image based on audio synchronization information for synchronizing the audio and the moving image recorded in parallel with the reproduction information for each chunk of audio data included in the reproduction information. And a computer program for reproducing the sound in synchronization with each other.

Images