JPWO2005004476A1 - Video / audio recording apparatus for multiplexing and recording multiple video / audio data so that they can be easily reproduced and managed - Google Patents

Abstract

A video / audio recording apparatus for recording stream data obtained by multiplexing video / audio data of a plurality of channels on a recording medium according to the present invention is a multiplexing for multiplexing video / audio data of a plurality of channels based on an input from a user. Information is generated, and management data composed of the multiplexed information is generated. Based on the multiplexed information, the input video / audio data of a plurality of channels is multiplexed and the management data is recorded on a recording medium. When reading the recording medium recorded by the above video / audio recording apparatus and reproducing the video / audio, if management data is acquired, information on how the data is multiplexed can be obtained, so that it can be easily reproduced.

Description

  The present invention relates to a video / audio recording apparatus such as a hard disk / DVD combo video recorder, a DVD video recorder, a DVD stream recorder, and a hard disk video recorder, and a recording including a disk medium recorded by these video / audio recording apparatuses. The present invention relates to a medium and a video / audio reproduction device that reads data recorded on the recording medium and reproduces video / audio.

  Conventionally, with regard to video and stream-related application formats in DVD (Digital Versatile Disc), DVD-Video in DVD-Forum, DVD-VR (Video Recording) that is easy to record and reproduce and edit, broadcast or transmission stream The DVD-SR (Stream Recording) format that allows easy recording / reproduction of data is standardized. On the other hand, outside the DVD-Forum, a DVD + VR (Video Recording) format that is easy to record / reproduce and edit is standardized. In DVD-Forum, a new video stream recording format for HDTV (High Definition Television) is being studied.

  Here, DVD-Video is a disc playback-only format in which contents such as movies are recorded in advance, and has a home theater as a main target. DVD-VR and DVD + VR are formats mainly intended to digitize analog video and encode and record it using MPEG-2 (Moving Picture Experts Group 2), with analog broadcast recording and a video camera as main targets. Yes. The DVD-SR is a format that basically records data sent as an MPEG stream as it is, and the main target is direct recording of digital broadcasting.

  Currently, DVD-Video is widely used worldwide as products, and DVD-VR, DVD + VR, and the like are also spreading. Although DVD-SR has not been commercialized, it will be promising as a recording format if the broadcasting is shifted from analog broadcasting to digital broadcasting.

  When analog broadcasting is recorded by DVD + VR or DVD-VR, usually only one channel is recorded. That is, for example, only NTV (Nippon TV, 4 channels in Tokyo) can be recorded, or only TBS (Tokyo broadcast, 6 channels in Tokyo) can be recorded. DVD-Video is a read-only format, but it can also be applied to recording. Even when analog broadcasting is recorded by DVD-Video, usually only one channel is recorded. However, today, a two-screen television, a parent / child screen television, and the like are on sale, and if these are used, two screens can be displayed or recorded simultaneously.

  When digital broadcasting is directly recorded by DVD-SR, since one broadcast wave is composed of a plurality of streams in digital broadcasting, data of a plurality of streams are recorded simultaneously. Therefore, recording of a plurality of channels is possible without problems. A prior art document discloses an apparatus for compressing and multiplexing video signals of a plurality of channels and recording them on the same track (refer to Japanese Patent Laid-Open No. 6-268554).

  However, DVD video recorders that record multiple channels in these formats have the following problems.

  When recording an analog broadcast with DVD + VR, DVD-VR, or DVD-Video, it is possible to record two screens, that is, two or more channels of video audio at the same time, but it is possible to record multiple channels. There is no way to judge. Therefore, for example, when a screen in which the left half is NTV and the right half is TBS is recorded and played back, the user views the video including both NTV and TBS as it is, and automatically selected by the user. Cannot be viewed as NTV only, TBS only, or NTV as a parent screen and TBS as a parent / child screen of a child screen.

  Further, when recorded in this way, the video coding block performs video compression processing including MPEG in a form including NTV and TBS. Therefore, since it is possible to perform compression by predicting a part of the NTV video from a part of the TBS video, only the TBS data is deleted from the recorded data, or editing such as rewriting is performed. It becomes very difficult. In order to perform these editing operations, all stream data must be decoded once, erased and edited only for the TBS data, and then encoded again, which requires a lot of load and processing time.

  Even when a digital broadcast is directly recorded on a DVD-SR with a plurality of streams, the fact that the streams are a plurality of streams cannot be known without searching within the streams, and where the video audio data of one channel in the plurality of streams is recorded is determined by the user. Can no longer understand.

  Japanese Patent Application Laid-Open No. 6-268594 does not disclose how to manage compressed and multiplexed video data of a plurality of channels and how to reproduce a recording medium.

  It is an object of the present invention to provide a video / audio recording apparatus that performs recording so that multiplexed video / audio data of a plurality of channels or a plurality of stream data can be easily reproduced.

  In order to achieve the above object, according to the present invention, an audio / video recording apparatus for recording stream data obtained by multiplexing a plurality of channels of video audio data on a recording medium is provided on the basis of an input from a user. Is generated, and management data composed of the multiplexed information is generated. Based on the multiplexed information, the input video / audio data of a plurality of channels is multiplexed and the management data is recorded on a recording medium.

  Furthermore, on the basis of an input from the user, compression information for compressing multiplexed video / audio data of a plurality of channels may be generated, and management data composed of the compression information may be generated. . Then, the multiplexed video / audio data of a plurality of channels may be compressed based on the compression information.

  The video / audio recording apparatus for recording a plurality of different video / audio stream data on a recording medium according to the present invention records video from a plurality of input different video / audio data streams based on an input from a user. Recording selection information for selecting audio stream data is generated, and management data composed of the recording selection information is generated. Based on the recording selection information, video audio stream data to be recorded is selected from a plurality of different input video audio stream data, and the management data is recorded on the recording medium.

  When reading the recording medium recorded by the video / audio recording apparatus and reproducing the video / audio, when the management data is acquired, it is described how it is multiplexed, how it is compressed, and a plurality of video audio streams. Since information regarding where a one-channel video / audio stream is recorded can be obtained, reproduction can be easily performed.

  As described above, according to the present invention, in addition to the effect that the above-described object can be achieved, the multi-channel multiplexing status and the multi-stream recording status can be grasped, so that various displays can be performed during playback. The following effects can be obtained.

  In addition, when the multiplexed stream data of a plurality of channels is compressed using only the video audio data of the same channel, only the desired video audio data in the stream data is decompressed and erased, thereby There is also an effect that editing can be performed easily.

1 is a functional block diagram showing a configuration of a video / audio recording apparatus according to a first embodiment of the present invention. It is the figure which showed the example of RF input processing. 1 is a functional block diagram illustrating a configuration of a video / audio reproduction device according to a first embodiment of the present invention. It is the figure which showed the example of the stream data. It is the figure which showed arrangement | positioning of management data. It is the figure which showed the example (motion vector calculation from another video audio channel) spatially multiplexed. It is the figure which showed the example which has arrange | positioned 3 image | video in 2 upper vertical rows and 2 lower vertical rows. It is the figure which showed the example (motion vector calculation from another video audio channel) multiplexed temporally. It is the figure which showed the example (motion vector calculation only from the said video audio channel) spatially multiplexed. It is the figure which showed the example (motion vector calculation only from the said video audio channel) multiplexed temporally. It is the figure which showed the example (The spatial direction is from a different video audio channel, and the time direction is a motion vector calculation only from the said video audio channel) multiplexed spatially and temporally. It is the functional block diagram which showed the structure of the video / audio recording device of the 2nd Embodiment of this invention. It is the functional block diagram which showed the structure of the video / audio reproduction device of the 2nd Embodiment of this invention. It is the figure which showed the example of multiple stream data.

(First embodiment)
Referring to FIG. 1, the video / audio recording apparatus according to the first embodiment of the present invention includes an A / D conversion unit 103, a MUX unit 104, an MPEG encoder 105, a recording format unit 106, an HDD recorder 107, A DVD recorder 108 and a format determination / management data generation unit 109 are included. The video / audio recording apparatus of this embodiment records multi-channel video audio data (stream data) on an HDD or a DVD.

  The A / D conversion unit 103 receives an input signal 101 (analog video audio signal), performs A / D conversion on the input signal, and outputs the input signal to the MUX unit 104. The input signal 101 is a multi-channel video audio analog signal, and the input 1, input 2,..., Input n are video audio analog signals of different channels. Accordingly, the A / D conversion unit 103 individually A / D converts the video audio analog signal of each channel. The A / D conversion unit 103 may include Y / C separation, a filter, and the like.

  The MUX unit 104 receives the output of the A / D conversion unit 103 as input, and multiplexes the video / audio digital data of the designated channel by the designated method in accordance with the designation of the format determination / management data generation unit 109. The multiplexing process will be described later.

  The MPEG encoder 105 receives the video audio digital data (stream data) multiplexed by the MUX unit 104, encodes it into the MPEG compression method according to the designation of the format determination / management data generation unit 109, and stores it in the recording format unit 106. Output. In this embodiment, the MPEG compression method is used, but other compression methods may be used, or the compression may be left uncompressed. The MPEG encoder 105 also receives a designation from the format determination / management data generation unit 109 to compress data using the same channel data in the same stream or to use different channel data.

  The recording format unit 106 receives the stream data encoded by the MPEG encoder 105 as input, and performs formatting corresponding to the HDD or DVD as specified by the format determination / management data generation unit 109. Formatting is performed in accordance with the video application format, file format, and physical format of HDD and DVD. The formatted video / audio data is output to the HDD recorder 107 or the DVD recorder 108.

  HDD recorder 107 and DVD recorder 108 record the stream data received from recording format unit 106 on the HDD and DVD, respectively. Also, the management data received from the format determination / management data generation unit 109 is recorded in the HDD and DVD, respectively. The data recorded on the HDD and DVD is dubbed between the two, and is output as a reproduction signal 110 when read out by the video / audio reproduction device. As shown in FIG. 1, the playback signal 110 may be output as the playback signal 1 for the HDD and the playback signal 2 for the DVD, and after passing through a selector for selecting the playback signal 1 and the playback signal 2, as one system It may be output.

  The format determination / management data generation unit 109 receives the control signal 102 and makes various designations to the MUX unit 104, the MPEG encoder 105, and the recording format unit 106. The control signal 102 is user operation data for designating a channel for multiplexing, a multiplexing method, an MPEG compression method, and a format. Further, the format determination / management data generation unit 109 outputs management data including information such as a channel to be multiplexed, a multiplexing method, an MPEG compression method, and a format to the HDD recorder 107 and the DVD recorder 108. .

  Referring to FIG. 2, a configuration for obtaining an input signal 203 (corresponding to the input signal 101 in FIG. 1) is shown.

  The tuner 202 receives the RF input signal 201 from the antenna, selects the frequency of the RF input signal 201, and outputs the input signal 203. Each tuner 202 is assumed to select a different frequency. The input signal 203 is a video audio analog signal of a different channel for each input signal, for example, the input signal 1 is NHK (Japan Broadcasting Corporation, 1 channel in Tokyo), the input signal 2 is NTV, and the input signal 3 is TBS.

  Referring to FIG. 3, the video / audio reproduction device according to the first embodiment of the present invention includes a reproduction format decoding unit 303, an MPEG decoder 304, a reproduction video reconstruction unit 305, a D / A conversion unit 306, a management A data decoding / video reconstruction method determination unit 307 is included. The video / audio playback apparatus of this embodiment plays back multi-channel video audio data (stream data) from an HDD or a DVD.

  The reproduction format decoding unit 303 receives the reproduction signal 301, separates the stream data and management data included in the reproduction signal 301, outputs the stream data to the MPEG decoder 304, and decodes the management data into the management data decoding / video reconstruction method. The data is output to the determination unit 307. Note that the reproduction signal 301 is the same as the reproduction signal 110. That is, it is read from the HDD or DVD.

  The MPEG decoder 304 receives the stream data output from the reproduction format decoding unit 303 and decodes the stream data using the MPEG compression method. A stream compressed by a compression method other than the MPEG compression method is decoded by the compression method.

  The playback video reconstruction unit 305 receives the output of the MPEG decoder 304 as input, and reconstructs the decoded stream data as specified by the management data decoding / video reconstruction method determination unit 307. Reconfiguration is an inverse operation process of multiplexing. The reproduction video reconstruction unit 305 receives a designation of a display method such as a channel to be selectively displayed and a display position with respect to the reconstructed multi-channel video audio digital data from the management data decoding / video reconstruction method determination unit 307. Is output to the D / A converter 306.

  The D / A conversion unit 306 receives the output of the reproduction video reconstruction unit 305 and converts it into an analog video audio signal. The D / A conversion unit 206 may include a noise reducer, a filter, and the like. The D / A converter 306 outputs the converted analog video audio signal as the output signal 308.

  The management data decoding / video reconstruction method determination unit 307 receives the control signal 302 and the management data from the reproduction format decoding unit 303 as input, and performs a reconstruction method (that is, multiplexed channels, multiplexed methods). ) And a display method such as a channel to be selectively displayed and a display position for the reconfigured multi-channel video audio digital data are designated to the reproduction video reconstruction unit 305. The control signal 302 is user operation data that specifies a display method.

  Referring to FIG. 4, stream data recorded by the HDD recorder 107 or the DVD recorder 108 is shown. FIG. 4 shows the program stream, but the transport stream is the same.

  Reference numeral 401 denotes a program stream pack, which includes a pack header 402 and a video audio packet 403.

  Referring to FIG. 5, management data and stream data are shown.

  Reference numeral 501 denotes management data. Management data such as video attribute, audio attribute, compression I picture address map, and multiplexing method for stream data consisting of video and audio may be recorded in the management data area such as the innermost circumference of the disc separately from the stream data. Good.

  Reference numeral 502 denotes stream data. The stream data is video audio data compressed by, for example, the MPEG system as shown in FIG.

  Next, the multiplexing process of the MUX unit 104 (reconstruction processing is performed as an inverse operation process of the multiplexing process in the playback video reconstruction unit 305) will be described.

  Referring to FIG. 6, there is shown an example in which one stream of video data is composed of a plurality of channels (in the case of compression using different video data in the same stream by spatial multiplexing).

  Reference numeral 601 constitutes one stream (720 pixels × 480 lines) from one channel of video data as normal video data.

  602 constitutes one stream of video data (704 pixels × 480 lines) by horizontally arranging 2 channels of video data (each 352 pixels × 480 lines).

  Reference numeral 603 constitutes one stream of video data (720 pixels × 480 lines) by vertically arranging two channels of video data (720 pixels × 240 lines each).

  604 constitutes one stream of video data (720 pixels × 480 lines) by horizontally arranging three channels of video data (each 240 pixels × 480 lines).

  Reference numeral 605 forms one stream of video data (720 pixels × 480 lines) by vertically arranging three channels of video data (720 pixels × 160 lines each).

  606 constitutes one stream of video data (704 pixels × 480 lines) by horizontally arranging four channels of video data (each of 176 pixels × 480 lines).

  Reference numeral 607 constitutes one stream of video data (720 pixels × 480 lines) by vertically arranging four channels of video data (720 pixels × 120 lines each).

  608 constitutes one stream of video data (704 pixels × 480 lines) by arranging four channels of video data (each 352 pixels × 240 lines) vertically and horizontally.

  Here, regarding a 704 pixel image, dummy data may be inserted to obtain 720 pixels × 480 lines.

  Moreover, it is good also as 1 / integer in a pixel / line direction. For example, six channels of video data may be arranged vertically and three horizontally to form one stream of video data.

  Reference numeral 609 denotes a motion vector calculation example when MPEG compression is performed by the MPEG encoder 105. In 602 to 608, compression is performed using different video data in the same stream as indicated by 609. Accordingly, since the optimum compression processing is performed, the entire video can be obtained with high image quality, but on the other hand, processing such as erasure and editing of only one video data in one stream becomes very difficult. That is, all the data of one stream must be MPEG decoded, and only one video data is deleted and edited, and then one stream is formed again and MPEG encoded.

  Reference numeral 610 denotes management data for multi-channel recording.

  The flag 1 is a flag indicating whether a plurality of video data are spatially arranged or temporally multiplexed. For example, the flag 1 is “1” when spatially arranged and “2” when temporally multiplexed. “3” when spatially and temporally multiplexed. Since 602 to 608 are all arranged spatially, they are “1”. Since 601 is not multiplexed, “0” is set.

  The flags 2 to 4 are valid only when the flag 1 is “1” or “3”. Therefore, 601 is invalid.

  The flag 2 is the number of video data multiplexed in the vertical direction in the multiplexed data. Reference numeral 602 denotes one sheet, 603 denotes two sheets, and so on.

  The flag 3 is the number of video data multiplexed in the horizontal direction in the multiplexed data. 602 indicates two sheets, 603 indicates one sheet, and so on.

  The flag 4 indicates that in the multiplexed data, one video data is predicted only from the video data, that is, a motion vector or the like is calculated, or is predicted by other video data, that is, a motion vector or the like is calculated. It is a flag indicating whether it has been set, and is “0” for the former and “1” for the latter. Since all of “602” in “602” to “608” are “1”, in order to delete and edit only one video data, decoding and encoding of all data of one stream is essential.

  Although not shown, control data corresponding to when flag 1 is “1” or “3” is defined.

For example, as “multiplexed video data pixel, number of lines”, when the number of video data to be multiplexed is n,
・ Number of first video data pixels, number of lines ・ Number of second video data pixels, number of lines
Record the number of nth video data pixels, the number of lines, the number of dummy video data pixels, and the number of lines.

  This makes it possible to multiplex video data having different numbers of pixels and lines, and to perform normal decoding and display.

  In this case, the order of the first video data and the second video data must be specified in advance from left to right in the upper stage and further from the upper stage to the lower stage.

For example, as shown in FIG. 7, when one screen is composed of three video streams, flags 1 to 4 are set to “1”, “2”, “2”, and “1”, respectively.
・ The first video data pixel number of 701 is “352” and the number of lines is “320”.
The number of second video data pixels of 702 is “352” and the number of lines is “320”.
The number of the third video data pixels in 703 is “704”, and the number of lines is “160”.
・ The number of dummy video data pixels of 704 is “16” and the number of lines is “480”.
By doing so, the first, second and third video data can be normally decoded and displayed.

  Similarly, although not shown, control data corresponding to when flag 1 is “1” or “3” is defined.

For example, as the “predicted video data number”, when the number of video data to be multiplexed is n,
Whether or not the first video data is predicted from the second video data. Whether or not the first video data is predicted from the third video data.
Whether the first video data is predicted from the nth video data, whether the second video data is predicted from the first video data, or the second video data is predicted from the third video data Whether or not ………………………
Whether the second video data is predicted from the nth video data. Whether the nth video data is predicted from the first video data. The nth video data is predicted from the second video data. Whether or not ………………………
Record data indicating whether or not the nth video data is predicted from the (n−1) th video data.

  As a result, the system can determine that data whose prediction is not used anywhere can be deleted and edited freely.

  Next, a case where the flag 1 is “2” in the video / audio multiplexing operation will be described.

  Referring to FIG. 8, there is shown an example in which one stream of video data is configured from a plurality of channels (when compression is performed using different video data in the same stream by time multiplexing).

  Reference numeral 801 constitutes one stream of video data by arranging two channels of video data (720 pixels × 480 lines each) in the time direction by three frames.

  802 constitutes one stream of video data by arranging three channels of video data (720 pixels × 480 lines each) in the time direction by two frames.

  803 constitutes one stream of video data by arranging four channels of video data (720 pixels × 480 lines each) in the time direction frame by frame.

  804 constitutes one stream of video data by arranging two channels of video data (720 pixels × 240 lines each) in the time direction one field at a time. That is, the top field is the first video and the bottom field is the second video.

  Reference numeral 805 denotes that the video is multiplexed in units of frames or fields in the time direction.

  Reference numeral 806 denotes a frame number for 801 to 803, and a field number for 804.

  Similarly to 609, reference numeral 807 denotes an example of motion vector calculation when MPEG compression is performed. In 801 to 804, compression is performed using different video data in the same stream as indicated by 807.

  Reference numeral 808 denotes management data for multi-channel recording.

  The flag 1 is a flag indicating whether a plurality of video data is spatially arranged or multiplexed in time. Since all of 801 to 804 are temporally arranged, the flag 1 is “2”.

  The flags 5 to 8 are valid only when the flag 1 is “2” or “3”.

  The flag 5 is the number of video data multiplexed in the time direction in the multiplexed data. Reference numeral 801 indicates two sheets, 802 indicates three sheets, and so on.

  The flag 6 is a flag indicating whether each video data is arranged in a frame unit or a field unit in the multiplexed data, and is “0” in the former case and “1” in the latter case. Become. “0” in 801 to 803 and “1” in 804.

  The flag 7 is the number of frames or fields in which each video data is continuous. 801 switches after 3 consecutive frames, 802 switches after 2 consecutive frames, and so on.

  Similarly to the flag 4, the flag 8 is one in which the video data is predicted from only the video data in the multiplexed data, that is, the motion vector or the like is calculated, or is predicted by the other video data. , A flag indicating whether a motion vector or the like is calculated, and is “0” in the former case and “1” in the latter case. Since all of 801 to 804 are “1”, in order to delete and edit only one video data, decoding and encoding of all data of one stream is indispensable.

  As the control data not shown, “multiplexed video data pixels, number of lines”, “predicted video data number”, and the like can be considered as in the case of FIG.

  Referring to FIG. 9, another example of the video audio multiplexing operation in the case where flag 1 is “1” (spatial multiplexing and compression using only the same video data in the same stream) is shown. Has been.

  Reference numeral 901 denotes the same diagram as 601.

  902 is the same video data structure as 602, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  903 is the same video data configuration as 603, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  904 is the same video data configuration as 604, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  905 is the same video data configuration as 605, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  906 has the same video data configuration as 606, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  907 is the same video data configuration as 607, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  908 has the same video data configuration as 608, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  Here, regarding a 704 pixel image, dummy data may be inserted to obtain 720 pixels × 480 lines.

  Moreover, it is good also as 1 / integer in a pixel / line direction. For example, six channels of video data may be arranged vertically and three horizontally to form one stream of video data.

  Reference numeral 909 denotes an example of motion vector calculation when MPEG compression is performed. At 902-908, compression is performed using the same video data in the same stream, as indicated at 909. Therefore, the entire image may not obtain the highest image quality, but on the other hand, only one video data in one stream can be easily deleted and edited. That is, only one video data in one stream can be MPEG-decoded, erased, edited, and MPEG-encoded again to form one stream.

  Reference numeral 910 denotes management data for multi-channel recording.

  Flags 1 to 3 are the same as in FIG.

  The flag 4 indicates that in the multiplexed data, one video data is predicted only from the video data, that is, a motion vector or the like is calculated, or another video data is predicted, that is, a motion vector is calculated. It is a flag indicating whether it has been set, and is “0” for the former and “1” for the latter. In 902 to 908, since all are “0”, only one video data can be easily deleted and edited. The video / audio reproduction device may be provided with a configuration in which the flag 4 is read and only one video data in one stream is MPEG-decoded and deleted.

  Further, as the control data not shown, “multiplexed video data pixels, number of lines” and the like can be considered as in the case of FIG.

  Referring to FIG. 10, another example of the video audio multiplexing operation when flag 1 is “2” (time multiplexing and compression using only the same video data in the same stream) is shown. Has been.

  1001 has the same video data configuration as 801, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  1002 is the same video data configuration as 802, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  1003 is the same video data configuration as 803, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  1004 has the same video data configuration as 804, but the video data of each channel is predicted only from the video data. That is, compression is performed using only the same video data in the same stream.

  Reference numeral 1005 indicates that video is multiplexed in the time direction in units of frames or fields.

  Reference numeral 1006 denotes a frame number for 1001 to 1003 and a field number for 1004.

  Similarly to 807, reference numeral 1007 shows an example of motion vector calculation when MPEG compression is performed. In 1001 to 1004, as indicated by 1007, compression is performed using the same video data in the same stream.

  Reference numeral 1008 denotes management data for recording a plurality of channels.

  Flag 1 and flags 5 to 7 are the same as in FIG.

  Similarly to the flag 4, the flag 8 is one in which the video data is predicted from only the video data in the multiplexed data, that is, the motion vector or the like is calculated, or is predicted by the other video data. , A flag indicating whether a motion vector or the like is calculated, and is “0” in the former case and “1” in the latter case. Since 1001 to 1004 are all “0”, only one video data can be easily deleted and edited.

  Further, as the control data not shown, “multiplexed video data pixels, number of lines” and the like can be considered as in the case of FIG.

  Next, a case where video audio is multiplexed in both space and time will be described.

  Referring to FIG. 11, an example (spatial multiplexing and time multiplexing) in which one stream of video data is configured from a plurality of channels is shown.

  1101 indicates that video is multiplexed in units of frames in the space and time directions.

  Reference numeral 1102 denotes a frame number.

  1103 shows an example of motion vector calculation when MPEG compression is performed. As shown in 1103, an example is shown in which compression is performed using other video data in the same frame.

  Reference numeral 1104 denotes management data for multi-channel recording.

  Flag 1 is set to “3” when video audio is multiplexed in both spatial and temporal directions.

  Flags 2 to 4 are the same as in FIG. 6, and flags 5 to 8 are the same as in FIG.

  The flag 4 is a flag indicating whether one video data is predicted only from the video data in the spatial direction or from other video data in the spatial direction. is there.

  A flag 8 is a flag indicating whether one video data is predicted only from the video data in the time direction or another video data in the time direction. is there.

The flag 9 is a flag indicating whether one video data is predicted only from the video data or another video data in the space time direction, and is “1” in FIG. 11 because of the latter.

  Further, as the control data not shown, “multiplexed video data pixel, number of lines”, “predicted video data number” and the like can be considered as in the case of FIG.

(Second Embodiment)
The case where the MPEG encoder is one circuit has been described above. Next, a case where a plurality of MPEG encoders are mounted and a plurality of video streams are recorded will be described.

  Referring to FIG. 12, the video / audio recording apparatus according to the second embodiment of the present invention includes an A / D converter 1203, an MPEG encoder 1204, a switch 1205, a recording format unit 1206, an HDD recorder 1207, and a DVD. A recorder 1208 and a format determination / management data generation unit 109 are included. The video / audio recording apparatus of the present embodiment records multi-channel video audio data in a plurality of streams on an HDD or DVD.

  1 is different from the video / audio recording apparatus of the first embodiment in FIG. 1 in that an MPEG encoder 1204 is provided for each input system and does not receive designation from the format determination / management data generation unit 1209 (in this embodiment, Since encoding is performed for each channel, encoding is not performed using data of other channels), the MUX unit 104 is not included, and a switch 1205 is included instead. In FIG. 12, each input signal 1201 is a different video audio analog signal, but the set of the A / D conversion unit 1203 and MPEG encoder 1204 of one or a plurality of input systems is omitted, and the direct digital stream is switched to the switch 1205. It is also conceivable to input to In FIG. 1 and FIG. 12, DVD + VR, DVD-VR, and DVD-Video are assumed as DVD formats. However, in the form in which a digital stream is directly input to the switch 1205, DVD-SR can also be supported.

  The A / D converter 1203 receives the input signal 1201 as input, performs A / D conversion on the input signal 1201, and outputs the converted signal to the MPEG encoder 1204. The MPEG encoder 1204 receives the output of the A / D converter 1203 as an input, and encodes it.

  The switch 1205 receives the output of the MPEG encoder 1204 as an input, and selects stream data from the MPEG encoder 1204 according to the designation from the format determination / management data generation unit 109.

  The recording format unit 1206 performs formatting in the same manner as in the first embodiment of FIG. 1 and outputs the formatted data to the HDD recorder 1207 and the DVD recorder 1208.

  The format determination / management data generation unit 1209 receives a control signal, specifies a stream to be selected in the switch 1205, and outputs management data including information on the selected stream to the HDD recorder 1207 and the DVD recorder 1208. The control signal 1202 includes a channel to be multiplexed (in the case of FIG. 12, since data of one channel corresponds to one stream data, designation of the channel to be multiplexed is the same as selection of stream data), format It is user operation data that specifies.

  Referring to FIG. 13, the video / audio reproduction device according to the second embodiment of the present invention includes a reproduction format decoding unit 1303, a decode stream selection unit 1304, an MPEG decoder 1305, a reproduction video reconstruction unit 1306, a D / A A conversion unit 1307 and a management data decoding / video reconstruction method determination unit 1308 are included. The video / audio playback apparatus of this embodiment plays back multiple stream data of multiple channels from an HDD or a DVD.

  The difference from the video / audio reproduction device of the first embodiment of FIG. 1 is that a decode stream selection unit 1304 is provided, and the reproduction video reconstruction unit 1306 is a reconstruction process (inverse operation process of multiplexing process). Is not performed, but only reconstructed video for screen display is performed.

  The playback format decoding unit 1303 receives the playback signal 1301, outputs a plurality of stream data to the decode stream selection unit 1304, and outputs management data to the management data decoding / video reconstruction method determination unit 1308. The reproduction signal 1301 corresponds to the reproduction signal 1210.

  The decode stream selection unit 1304 selects stream data to be decoded according to the designation of the management data decoding / video reconstruction method determination unit 1308. The selected stream data is output to the MPEG decoder. The MPEG decoder 1305 decodes this data and outputs it to the reproduction video reconstruction unit 1306.

  The reproduction video reconstruction unit 1306 receives the designation of the display method from the management data decoding / video reconstruction method determination unit 1308 and reconstructs the reproduction video. The reconstructed data is output to the D / A converter 1307. The D / A converter 1307 D / A converts this data and outputs a video audio analog signal as an output signal 1309.

  The management data decoding / video reconstruction method determination unit 1308 receives the control signal 1302 and the management data output from the reproduction format decoding unit 1303 as input, specifies a stream to be selected by the decode stream selection unit 1304, and reproduces the video reconstruction unit A display method is designated in 1306. The control signal 1302 is user operation data that designates a stream to be selected and a display method.

  Referring to FIG. 14, an example of a plurality of streams is shown.

  1401 is TS Pack, 1402 is TS header, 1403 is Payload. As shown in the figure, in the case of MPEG, a plurality of stream data is TS (Transport Stream). The TS is composed of TS Pack 1401, and the TS is composed of TS header 1402 and Payload 1403 for each stream.

  When the number of streams is 3, as shown in the figure, it is composed of stream 1, stream 2, and stream 3 in units of TS Pack 1401. Each stream becomes one video audio channel.

  The plurality of streams correspond to the stream data in FIG.

(Third embodiment)
As a video / audio recording apparatus according to the third embodiment of the present invention, a combination of the video / audio recording apparatus according to the first embodiment and the video / audio recording apparatus according to the second embodiment is conceivable. That is, the A / D converter 1203 and the MPEG encoder 1204 of one or more input systems of the video / audio recording apparatus of the second embodiment of FIG. 12 are the same as those of the video / audio recording apparatus of the first embodiment of FIG. In this embodiment, the A / D conversion unit 103, the MUX unit 104, and the MPEG encoder 105 are replaced.

  By the video / audio recording apparatus of the third embodiment of the present invention, a plurality of stream data obtained by multiplexing a plurality of channels of video audio data in one or a plurality of streams may be recorded on an HDD or a DVD. It becomes possible.

  Further, as a video / audio reproduction device according to the third embodiment of the present invention, a configuration in which the video / audio reproduction device according to the first embodiment and the video / audio reproduction device according to the second embodiment are combined is conceivable. In this case, video audio data of a plurality of channels is multiplexed on one or a plurality of streams among a plurality of streams to be reproduced. Therefore, in the video / audio reproduction device of the second embodiment of FIG. 13, the reproduction video reconstruction unit 1306 reconstructs the video audio data of a plurality of channels multiplexed into one stream, as shown in FIG. It must have the same function as the reconstruction unit 305.

  If the set of one or a plurality of input system A / D converters and MPEG encoders is omitted and a digital stream is directly input to the switch, DVD + VR and DVD-VR are also used as DVD formats in this embodiment. In addition to DVD-Video, DVD-SR can be supported.

  Next, an example of management data in consideration of a case where a plurality of channels and a plurality of channels are also arranged in some streams is shown.

MPEG is applied as the compression method, and GOP (Group of Pictures) is changed to VOBU (Video Object).
Unit) defines the following management data for each VOBU.

・ Multi_rec (1 bit)
0: 1 stream 1 channel video audio recording 1: Multiple streams or multiple channel video audio recording Multi_rec: Ends when 0, and the following continues when 1.

Multi_Str_cha (2 bits)
00: On hold or prohibited 01: 1 stream, and there are streams including multi-channel video audio 10: Multiple streams, and all of the streams are 1-channel video audio 11: Multiple streams, and among them Stream with multi-channel video audio.

・ Str_nr (8 bits)
Multi_Str_cha: When 00 or 01, hold (00H). At this time, the number of streams m = 1
When Multi_Str_cha: 10 or 11, the number of streams in a plurality of streams (m streams).

Multi_cha_data #i (1 ≦ i ≦ m)
When Multi_Str_cha: 00, hold (00H)
When the Multi_Str_cha is 01, the video / audio channel data in the first stream is Multi_Str_cha: When the multi-str_cha is 10, the video / audio channel data in the i-th stream is Multi_Str_cha: 11. The video / audio channel data Multi_cha_data #i is in the i-th stream.

・ Cha_nr (8 bits)
Number of video audio channels in the i-th stream (n channels).

・ Spttemp_fg (2 bits)
Multi-video audio channel arrangement method in the i-th stream 0: 1 channel 1: multiple channels, spatial multiplexing 2: multiple channels, temporal multiplexing 3: multiple channels, spatial and temporal multiplexing.

・ Clmn_vnr (4 bits)
When Spttemp_fg is 1 or 3, the number of video channels in the vertical (row) direction. When Stemptemp_fg is 0 or 2, it is reserved (0H).

-Row_vnr (4 bits)
When Spttemp_fg: 1, 3, the number of video channels in the horizontal (column) direction Septemp_fg: 0, 2, hold (0H).

・ Spt_det (1 bit)
When Spttemp_fg is 1, 3, prediction range in video compression is 0: Predicted only in the video channel with respect to the spatial direction 1: Predicted from the video channel and other video channels with respect to the spatial direction Spttemp_fg: 0, 2 When, when, hold (0H).

Tmp_vnr (4 bits)
When Spttemp_fg: 2 or 3, the number of video channels in the time direction Spttemp_fg: 0 or 1, hold (0H).

・ Frmfld_fg (1 bit)
When Spttemp_fg is 2, 3, a unit for arranging multi-channel video audio 0: Arranged in a frame unit 1: Arranged in a field unit Spttemp_fg: 0, 1, hold (0H).

Rpt_nr (4 bits)
When Spttemp_fg is 2 or 3, the number of frames / fields in which multi-channel video audio is arranged. How many frames or how many fields are arranged. When Stemptemp_fg is 0, 1 is reserved (0H).

・ Tmp_det (1 bit)
When Spttemp_fg: 2, 3, prediction range in video compression 0: prediction only in the video channel with respect to the temporal direction 1: prediction from the video channel and other video channels with respect to the temporal direction Spttemp_fg: 0, 1 When on hold (0H).

-Total_det (1 bit)
When Spttemp_fg: 3, prediction range in video compression 0: prediction only in the video channel with respect to both spatial and temporal directions 1: prediction from the video channel and other video channels with respect to both spatial and temporal directions Spttemp_fg: 0, 1, When 2, hold (0H).

・ Chavd_fg (1 bit)
The following Channel_data is invalid: 0 / valid: 1
chavd_fg: Ends when 0, and continues when 1.

・ Channel_data #j (1 ≦ j ≦ n)
Data per channel Channel_data #j.

・ Pel_pos (16 bits)
The pixel start position in the horizontal direction of the upper left pixel of the jth channel data.

-Line_pos (16 bits)
The number of pixels in the horizontal direction of the jth channel data.

・ Pel_nr (16 bits)
The line start position in the vertical direction of the upper left pixel of the jth channel data.

・ Pel_pos (16 bits)
Number of vertical lines of jth channel data.

・ Forecast_fg # 1
The first channel data is not used for prediction of the jth channel data: 0 / used: 1
・ Forecast_fg # 2
Second channel data is not used for prediction of jth channel data: 0 / used: 1
:
:
・ Forecast_fg #n
The nth channel data is not used for prediction of the jth channel data: 0 / used: 1.

  Although the example has been shown above, the label name, the number of bits, and the data arrangement order may not be the same as illustrated, and even if all the illustrated data does not exist, only a part thereof may exist. . The hold data may be a value other than “0”.

  The management data is generated and recorded in units of VOBU. However, the management data is not limited thereto, and may be a larger unit such as a plurality of VOBUs or a smaller unit less than VOBU.

  Also, the start address, end address, and data length when these management data are recorded on the recording medium may be recorded as appropriate.

  Further, the management data may be recorded not in the management data area but in the user data area. Alternatively, it may be recorded in the user data area in addition to the management data area.

  Although the recording apparatus and the reproducing apparatus have been described as separate ones, they may of course be integrated.

Claims (34)

A video / audio recording apparatus for recording stream data obtained by multiplexing video / audio data of a plurality of channels on a recording medium,
First means for generating and outputting multiplexed information for multiplexing video audio data of a plurality of channels based on an input from a user, and generating and outputting management data configured from the multiplexed information;
Second means for receiving the multiplexing information output by the first means and multiplexing the input video audio data of a plurality of channels based on the multiplexing information;
A video / audio recording apparatus comprising: third means for receiving management data output by the first means and recording the management data on a recording medium. The video / audio recording apparatus according to claim 1, wherein the multiplexing information generated by the first means is information for spatially multiplexing video audio data of a plurality of channels. 2. The video / audio recording apparatus according to claim 1, wherein the multiplexing information generated by the first means is information for temporally multiplexing video audio data of a plurality of channels. 2. The video / audio recording apparatus according to claim 1, wherein the multiplexing information generated by the first means is information for multiplexing video audio data of a plurality of channels spatially and temporally. 5. The video / audio recording apparatus according to claim 2, wherein the multiplexing information generated by the first means further includes information for multiplexing dummy data with video audio data of a plurality of channels. 6. . The first means generates and outputs compressed information for compressing multiplexed video audio data of a plurality of channels based on an input from a user, and management data composed of the compressed information is generated. Further comprising means for generating and outputting;
A fourth means for receiving the compressed information output by the first means and compressing the multiplexed video audio data of the plurality of channels received from the second means based on the compressed information; The video / audio recording apparatus according to any one of claims 1 to 5, further comprising: The video / audio recording apparatus according to claim 6, wherein the compression information generated by the first means is information for compression using video audio data of another channel in the same stream data. The video / audio recording apparatus according to claim 6, wherein the compression information generated by the first means is information for compression using only video audio data of the same channel in the same stream data. The first means further comprises means for providing a management data area on a recording medium and transmitting a signal to the third means for instructing to record the management data in the management data area. The video / audio recording apparatus according to any one of claims 1 to 8. The said 1st means further has a means to transmit to the said 3rd means the signal which instruct | indicates to include the said management data in the user data area | region in stream data, The any one of Claim 1 to 8 2. The audio / video recording apparatus described in 1. 11. A computer-readable data recording medium on which the management data is recorded by the third means of the video / audio recording apparatus according to any one of claims 1 to 10. A video / audio reproduction device for reading information recorded on the data recording medium according to claim 11 and reproducing video / audio,
A fifth means for separating the information read from the data recording medium according to claim 11 into the management data and stream data in which video audio data of a plurality of channels is multiplexed, and outputting each of them,
Sixth means for receiving the management data output by the fifth means, and generating and outputting reconstructed information for demultiplexing the stream data based on the management data;
A video / audio reproduction apparatus having seventh means for receiving the reconstructed information output by the sixth means and demultiplexing the input stream data. The sixth means further includes means for generating and outputting display information for displaying video audio data of a plurality of channels after demultiplexing based on an input from a user,
The seventh means further includes means for receiving the display information output from the sixth means and configuring video audio data of a plurality of channels after demultiplexing for display based on the display information. The video / audio reproduction device according to claim 12, comprising: When the stream data read from the data recording medium according to claim 11 is compressed using only video audio data of the same channel, only desired video audio data in the stream data is decompressed, edited, or 14. The video / audio reproduction device according to claim 12, further comprising an eighth means for erasing. A video / audio recording apparatus for recording a plurality of different video / audio stream data on a recording medium,
Based on the input from the user, it generates and outputs recording selection information for selecting a plurality of different video audio stream data to be recorded from among the plurality of input video audio data streams, and comprises the recording selection information First means for generating and outputting the generated management data;
The second means for receiving the recording selection information output by the first means and selecting a plurality of different video audio stream data to be recorded from the plurality of input video audio stream data based on the recording selection information. Means of
A video / audio recording apparatus comprising: third means for receiving management data output by the first means and recording the management data on a recording medium. The first means further comprises means for providing a management data area on a recording medium and transmitting a signal to the third means for instructing to record the management data in the management data area. 2. The audio / video recording apparatus described in 1. The video / audio recording apparatus according to claim 15, wherein the first means further includes means for transmitting a signal to the third means for instructing to include the management data in a user data area in stream data. . 18. A computer-readable data recording medium on which the management data is recorded by the third means of the video / audio recording apparatus according to claim 15. A video / audio reproduction device for reading information recorded on the data recording medium according to claim 18 and reproducing video / audio,
A fourth means for separating the information read from the data recording medium according to claim 18 into the management data and video audio stream data, and outputting each of the management data and video audio stream data,
Fifth means for receiving management data output by the fourth means, and generating and outputting reproduction selection information for selecting video / audio stream data to be reproduced based on the management data and an input from a user; ,
A video / audio reproduction device having sixth means for selecting video / audio stream data to be reproduced based on the reproduction selection information output by the fifth means. The fifth means further comprises means for generating and outputting display information for displaying the video audio data stream after being selected by the sixth means based on an input from the user,
7th means which receives the display information which the said 5th means output, and comprises for display the video audio stream data after having been selected by the said 6th means based on this display information, The video / audio reproduction device according to claim 19. A video / audio recording apparatus for recording a plurality of video / audio stream data obtained by multiplexing video / audio data of one or a plurality of channels together on a recording medium,
First means for generating and outputting multiplexed information for multiplexing video audio data of a plurality of channels based on an input from a user, and generating and outputting management data configured from the multiplexed information;
Second means for receiving the multiplexing information output by the first means and multiplexing the input video audio data of a plurality of channels based on the multiplexing information;
Generate and output recording selection information for selecting a plurality of different video audio stream data to be recorded from a plurality of video audio stream data multiplexed by the second means based on an input from the user A third means for generating and outputting management data composed of the record selection information;
The recording selection information output by the third means is received, and based on the recording selection information, a plurality of different video audio stream data to be recorded is selected from the multiplexed video audio stream data. A fourth means;
A video / audio recording apparatus comprising: fifth means for receiving management data output by the first means and the third means and recording the management data on a recording medium. The video / audio recording apparatus according to claim 21, wherein the multiplexing information generated by the first means is information for spatially multiplexing video audio data of a plurality of channels. The video / audio recording apparatus according to claim 21, wherein the multiplexing information generated by the first means is information for temporally multiplexing video audio data of a plurality of channels. The video / audio recording apparatus according to claim 21, wherein the multiplexing information generated by the first means is information for spatially and temporally multiplexing video audio data of a plurality of channels. The video / audio recording apparatus according to any one of claims 22 to 24, wherein the multiplexing information generated by the first means further includes information for multiplexing dummy data to video audio data of a plurality of channels. . The first means generates and outputs compressed information for compressing multiplexed video audio data of a plurality of channels based on an input from a user, and management data composed of the compressed information is generated. Further comprising means for generating and outputting;
A sixth means for receiving the compressed information output from the first means and compressing the multiplexed video audio data of the plurality of channels received from the second means based on the compressed information; The video / audio recording apparatus according to any one of claims 21 to 25. 27. The video / audio recording apparatus according to claim 26, wherein the compression information generated by the first means is information for compression using video audio data of another channel in the same stream data. 27. The video / audio recording apparatus according to claim 26, wherein the compression information generated by the first means is information for compression using only video audio data of the same channel in the same stream data. The first means and the third means include means for providing a management data area on a recording medium and transmitting a signal to the fifth means for instructing to record the management data in the management data area. The video / audio recording apparatus according to any one of claims 21 to 28, further comprising: The first means and the third means further include means for transmitting a signal to the fifth means to instruct to include the management data in a user data area in stream data. 28. The video / audio recording apparatus according to any one of 28. A computer-readable data recording medium on which the management data is recorded by the fifth means of the video / audio recording apparatus according to any one of claims 21 to 30. A video / audio reproduction device for reading information recorded on the data recording medium according to claim 31 and reproducing video / audio,
A seventh means for separating the information read from the data recording medium according to claim 31 into the management data and video audio stream data, and outputting each of them,
Eighth means for receiving management data output by the seventh means and generating and outputting playback selection information for selecting video / audio stream data to be played back based on the management data and an input from a user; ,
Ninth means for selecting video / audio stream data to be reproduced based on the reproduction selection information output by the fifth means;
Reconfiguration information for receiving the management data output by the seventh means and demultiplexing the video audio stream data in which the video audio data of a plurality of channels is multiplexed based on the management data. A tenth means for generating and outputting;
The eleventh means for receiving the reconstructed information output from the tenth means and demultiplexing the video audio stream data selected by the ninth means and multiplexed with video audio data of a plurality of channels. A video / audio reproduction apparatus having the means described above. The tenth means has display information for displaying the video / audio stream data selected by the ninth means and demultiplexed by the eleventh means based on an input from the user. Further comprising means for generating and outputting;
The display information output from the tenth means is received, and the video / audio stream data selected by the ninth means and demultiplexed by the eleventh means is displayed based on the display information. 33. The video / audio reproduction device according to claim 32, further comprising twelfth means configured for use. When the video audio stream data in which video audio data of a plurality of channels read from the data recording medium according to claim 31 is multiplexed is compressed using only video audio data of the same channel, 34. The video / audio reproduction device according to claim 32, further comprising thirteenth means for decompressing, editing, or deleting only desired video audio data in the video audio stream data.

Images