JP2006197336A - Audio video signal recording apparatus, audio video signal reproducing apparatus, audio video signal recording method, audio video signal reproducing method, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving picture still picture simultaneous recording apparatus capable of efficiently recording a progressive image while keeping compatibility with a format for permitting reproduction of an ordinary interlace moving picture. <P>SOLUTION: The moving picture still picture simultaneous recording apparatus including: an optical path splitter for splitting a ray made incident from an imaging lens; at least one light receiving element for receiving split rays and providing an output of a first moving picture signal; at least one light receiving element for receiving the split rays and providing an output of a second moving picture signal; a first moving picture signal recording unit for recording the first moving picture signal to a recording medium; and a second moving picture signal recording unit for recording the second moving picture signal to the recording medium, records the second moving picture to the recording medium as supplementary moving picture information for complementing information of the corresponding first moving picture data. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an audio / video signal recording apparatus, an audio / video signal reproducing apparatus, an audio / video signal recording method, an audio / video signal reproducing method, and a recording medium. Or it is related with the apparatus which implement | achieves suitably reproducing | regenerating both the moving image which comprises the image with a high density of an image time direction, and reproduces | regenerates.

  Conventional camcorders record moving images and still images simultaneously using a single CCD. However, if a CCD with a large number of pixels is used to increase the number of pixels of a still image, the S / N ratio of the moving image is lowered. Therefore, it is possible to simultaneously record a high-resolution still image and a moving image having an excellent S / N ratio. It was difficult.

  In view of this, Japanese Patent Laid-Open No. 5-292445 discloses a technique for simultaneously recording an image pickup signal from a wide-angle lens and an image pickup signal from a zoom lens on the same recording medium and recording two types of images with two optical systems. It is disclosed.

  In Japanese Patent Laid-Open No. 2004-72148, incident light is split into prisms and received by a moving image shooting CCD and a still image shooting CCD, and a moving image is MPEG-compressed using two CCDs in one optical system. A technique is disclosed in which a still image is JPEG compressed and simultaneously recorded on a memory card.

  Similarly, in Japanese Patent Laid-Open No. 2000-23094, recorded data input by an input means for the purpose of providing an image information recording or reproducing device capable of recording a moving image and recording a desired scene as a still image. Is compressed as moving image data by an encoder, and when a signal is input from the operation button, the scene at the time when the signal is input is also compressed as still image data and output to the memory. A technique for generating a timing signal for recording moving image data and still image data in synchronization with a synchronization signal and simultaneously recording moving image data and still image data on a magneto-optical recording medium is disclosed. ing.

  Japanese Patent Application Laid-Open No. 11-76159 discloses a method in which two separation optical paths of a half mirror that separates an optical path of an objective optical system into two are used to form image signals composed of data at different pixel positions. A technique is disclosed in which a missing pixel other than a set pixel is calculated from surrounding pixel signals from one CCD to generate a high-resolution image.

  Also, in Japanese Patent Laid-Open No. 2002-152743, even when an error occurs in input encoded data or insufficient supply of the encoded data itself due to damage to the recording medium or communication failure, the normal decoding operation cannot be performed. A timer is provided, and if the control from the CPU cannot be timed appropriately with respect to the timer, the selector of the display unit automatically switches to select the output of the still image generator, A technique for outputting a high-quality still image is disclosed.

Also, MPEG used here will be described.
MPEG is the name of the organization that examines video coding standards established in 1988 in ISO / IEC JTC1 / SC2 (International Organization for Standardization / International Electrotechnical Standards Meeting Technical Committee 1 / Technical Committee 2, now SC29) ( Abbreviation for Moving Pictures Expert Group. MPEG1 (MPEG Phase 1) is a standard for storage media of about 1.5 Mbps, and is intended for video compression for low transfer rates of JPEG and ISDN video conferences and videophones for the purpose of still image coding. H.261 (CCITT SGXV, standardized by the current ITU-T SG15), the new technology was introduced for storage media. These were established in August 1993 as ISO / IEC 11172.

  MPEG2 (MPEG Phase 2) was established as ISO / IEC 13818, H.262 in November 1994 for the purpose of general-purpose standards so as to be compatible with various applications such as communication and broadcasting.

  MPEG is created by combining several technologies. The input image is time-redundant by taking the difference between the image decoded by the motion compensator and the input image. There are three modes of prediction from the past and the future. These can be used by switching every 16 pixels × 16 pixels MB (macroblock). The prediction direction is determined by the picture type given to the input image. There are two modes in which prediction from the past and two modes that independently encode the MB without prediction are P pictures. In addition, the B picture has four modes in which prediction from the future, prediction from the past, prediction from both, and independent encoding are performed. It is the I picture that all MBs are encoded independently. In motion compensation, the motion region is subjected to pattern matching for each MB, a motion vector is detected with half-pel accuracy, and prediction is performed after shifting by the motion amount. The motion vector has a horizontal direction and a vertical direction, and is transmitted as additional information of the MB together with an MC (Motion Compensation) mode indicating where the motion vector is predicted. A group from an I picture to a picture before the next I picture is called a GOP (Group Of Picture), and when used in a storage medium or the like, about 15 pictures are generally used.

  The difference image is subjected to orthogonal transformation in the DCT unit. DCT (Discrete Cosine Transform) is an orthogonal transformation that discretely transforms an integral transformation with a cosine function as an integral kernel into a finite space. In MPEG, MB is divided into four and two-dimensional DCT is performed on an 8 × 8 DCT block. In general, video signals have many low-frequency components and few high-frequency components. Therefore, when DCT is performed, coefficients are concentrated in the low frequency range.

  The image data (DCT coefficient) subjected to DCT is quantized by a quantizer. Quantization is a quantized value obtained by multiplying the 8 × 8 two-dimensional frequency called the quantization matrix by the visual characteristics and the value of the quantization scale that multiplies the whole by a scalar, and the DCT coefficient is quantized. Calculate by value. When inverse quantization is performed by the decoder, a value approximating the original DCT coefficient is obtained by multiplying by the quantized value.

  The quantized data is variable length encoded by a VLC unit. Among the quantized values, the direct current (DC) component uses DPCM (differential pulse code modulation) which is one of predictive coding. Also, AC (AC) components are zigzag scanned from low to high, with zero run length and effective coefficient value as one event, and Huffman coding assigning codes with short code lengths from those with high appearance probability. Is done.

  The variable length encoded data is stored in a temporary buffer and output as encoded data at a predetermined transfer rate. The generated code amount for each macroblock of the output data is transmitted to the code amount controller, and the error code amount with respect to the generated code amount with respect to the target code amount is fed back to the quantizer to adjust the quantization scale. By doing so, the code amount is controlled. The quantized image data is inversely quantized by an inverse quantizer, inversely DCTed by an inverse DCT device, temporarily stored in an image memory, and then used as a reference for calculating a difference image in a motion compensated predictor. Used as a decoded image. An example of the overall coding configuration is shown in FIG.

  The encoded stream is buffered, and the data from the buffer is input to the VLD unit. The VLD unit performs variable length decoding to obtain a direct current (DC) component and an alternating current (AC) component. The alternating current (AC) component data is arranged in an 8 × 8 matrix in the order of zigzag scan from low to high. This data is input to an inverse quantizer and is inversely quantized by a quantization matrix. The inversely quantized data is input to an inverse DCT unit, inversely DCTed, and temporarily output as image data (decoded data). The decoded data is temporarily stored in an image memory, and then used as a reference decoded image for calculating a difference image in a motion compensation predictor. An example of the decoding configuration is shown in FIG.

Next, a description will be given of a format technology for a next-generation disk medium in which the recording capacity developed in recent years is several times to a dozen times that of a conventional medium such as a CD. One is a DVD-ROM disc (read-only optical disc compliant with DVD Specifications for Read-Only Disc). Discs) and DVD-RAM discs (rewritable discs compliant with DVD Specifications for Rewritable Disc). A standard for recording video data on DVD-RW or DVD-RAM discs has also been established, and a method for recording high-quality video and still images using their large capacity and playing them through various editing is provided. The
Video data is recorded on a DVD-RW or DVD-RAM disc (hereinafter abbreviated as DVD-RW / RAM disc), VIDEO RECORDING standard (hereinafter abbreviated as DVD-VR), video data is VOB (Video Object). User-defined management for playing back all or part of the original VGC selected by the user and the original management data, the original PGC (Original Program Chain), and the VOBs recorded in the desired order. Data, user defined PGC (User Defined PGC) is defined. There can be only one original PGC and multiple user-defined PGCs on the disk. Therefore, the user can perform desired playback using the user-defined PGC edited according to his / her preference.
As shown in "DVD Specifications for Rewritable / Re-recordable Discs, Part 3 VIDEO RECORDING, Version 1.0", DVD-VR records multiple files as files on DVD-RW / RAM. FIG. 10 shows the configuration. There is a DVD_RTAV directory under the root directory, under which a VR_MANGER.IFO file for recording all recording / playback management data such as original PGC and user-defined PGC is recorded. Video data is recorded in the VR_MOVIE.VRO file, still image data is recorded in the VR_STILL.VRO file, and additional audio data accompanying the still image is recorded in the VR_AUDIO.VRO file. Thus, since the actual reproduction data and the recording / reproduction management data are recorded separately, an arbitrary reproduction procedure can be constructed by the user-defined PGC without changing the reproduction data. Each still image in VR_STILL.VRO is recorded as an MPEG intra image conforming to the MPEG Video standard.

  FIG. 11 shows a conceptual diagram of the structure of the original PGC. When recording video data on a DVD-VR disc, for example, when recording one television program, the continuous video data is recorded as one program (Program), and the program is stored in one or more cells (Cell). ). In general, a program is composed of a plurality of cells when paused in the middle of recording or when an intermediate part of a program is deleted after editing. Each cell is associated with one VOB. Each VOB is a unit that is recorded as a program stream conforming to the MPEG-2 system and continuously reproduced. The program and cell structure is the recording / playback management data of the original PGC, and the VOB group is the video data itself. The first program recorded on the disc is Program1, and each time an additional program is recorded, Program2, 3, ... are added in the recording order. The reproduction of the original PGC is equivalent to reproducing all programs recorded on the disc in the order of program numbers, that is, in the order of recording. It is also possible to designate and reproduce a specific program on the original PGC.

  On the other hand, FIG. 12 shows a structural conceptual diagram of the user-defined PGC. An arbitrary part of the VOB group recorded as the original PGC is registered as a user-defined PGC cell, and a user-defined PGC is configured. Each cell refers to all or part of any VOB. For example, it is suitable for applications such as cutting VOB commercials recorded as original PGCs and unnecessary scenes, or connecting a part of two or more programs (Programs). Playing a newly defined user-defined PGC is equivalent to playing all the cells in the PGC continuously. There is no program hierarchy in the user-defined PGC. That is, it can be interpreted that the user-defined PGC itself corresponds to one program in the original PGC.

  Table 5 shows specific definition contents of the original and user-defined PGC information (PGCI). PGCI is PGC_GI indicating general information of PGC, one or more PGIs defining auxiliary information of each program (in the case of original PGC, not defined in user-defined PGC), search pointer CI_SRP of each cell information in PGC, and Each cell information M_CI (in the case of a moving image cell. S_CI in the case of a still image cell) is included.

  Next, the contents of each element in Table 5 will be described. In PGC_GI, PG_Ns that stores the number of programs in PGC and CI_SRP_Ns that stores the number of CI_SRPs are defined. In the case of user-defined PGC, PG_Ns is zero because there is no program.

  There are a number of PGIs indicated by PG_Ns. In each PGI, C_Ns indicating the number of cells in the program, primary text information (PRM_TXTI) containing text information about the program, item text information related to the program (not PGCI but another data structure in VR_MANGR.IFO Search pointer number (IT_TXT_SRPN), representative still image information (REP_PICTI) designating the position of a still image representing the program, and the like are defined.

There are a number of CI_SRPs indicated by CI_SRP_Ns. Each CI_SRP consists of the start address CI_SA of the cell information CI.
M_CI includes cell general information M_C_GI and zero or more cell entry point information M_C_EPI. In M_C_GI, cell type C_TY, the number of cell entry points C_EPI, and the like are defined. In M_C_EPI, entry point type EP_TY (A and B, A is without PRM_TXTI, B is with PRM_TXTI), entry point playback time EP_PTM, and primary text information (PRM_TXTI) regarding the entry point are defined.

  Here, an entry point is a structure that designates an arbitrary time in a cell and enables access to a program or an arbitrary intermediate point of the cell. FIG. 11 and FIG. 12 show examples of entry points specified in the cell (arrows indicated as EP).

Note that when reproducing a still image cell, S_CI is used instead of M_CI. (The contents of S_CI are omitted here.) Therefore, when a moving image and a still image are recorded on the original PGC, they are mixed for each cell. On the user-defined PGC, video cells and still image cells can be mixed for each cell.
JP-A-5-292445 JP 2004-72148 A JP2000-23094A JP 11-76159 A JP-A-2002-152743

  The problem to be solved is that the two video data simultaneous recording apparatuses efficiently record progressive images while maintaining compatibility with a format capable of reproducing a normal interlaced moving image. Or, while maintaining compatibility with formats that can play progressive moving images, there is no system that records double-density progressive images in the time direction efficiently and does not perform high-quality real-time playback or high-quality slow motion playback. It was.

In order to solve the above problems, the present invention provides the following audio video signal recording apparatus, audio video signal reproducing apparatus, audio video signal recording method, audio video signal reproducing method, and recording medium.
(1) an imaging lens, an optical path separator that separates light incident from the imaging lens, and at least one light receiving element that receives the light separated by the optical path separator and outputs the light as a first moving image signal; Receiving at least one light receiving element that receives the light separated by the distribution unit and outputs the light as a second moving image signal; a first moving image signal recorder that records the first moving image signal on a recording medium; An audio video data simultaneous recording apparatus including a second moving image signal recorder for recording a second moving image signal on a recording medium, wherein the second moving image is information included in the corresponding first moving picture picture data. Is recorded as supplementary moving image information.
(2) The recording medium, wherein the second moving image is recorded as supplementary moving image information that supplements information of the corresponding first moving picture picture data.
(3) an imaging lens, an optical path separator that separates light incident from the imaging lens, and at least one light receiving element that receives the light separated by the optical path separator and outputs the light as a first moving image signal; Receiving at least one light receiving element that receives the light separated by the distribution unit and outputs the light as a second moving image signal; a first moving image signal recorder that records the first moving image signal on a recording medium; An audio video data simultaneous recording apparatus including a second moving image signal recorder for recording a second moving image signal on a recording medium, wherein the second moving image is information included in the corresponding first moving picture picture data. Is recorded on the recording medium as supplementary moving image information, and when the first moving image corresponding to the second moving image signal is entered, the supplementary moving image information and the moving image information are used. Than the first moving image data, constitute a dense image in the image plane or the image temporal audio video signal reproducing apparatus characterized by play.
(4) A moving image input step of separating a light beam incident from the imaging lens into two parts, receiving one of the separated lights and inputting it as a moving image signal, and another light separated by the distribution unit Audio having a still image input step for receiving light and outputting as a still image signal, a moving image signal recording step for recording the moving image signal on a recording medium, and a still image signal recording step for recording the still image signal on a recording medium In the video data simultaneous recording method, an audio video signal recording method comprising a step of recording the second moving picture as supplementary moving picture information that supplements information of the corresponding first moving picture picture data.
(5) A moving image input step of separating a light beam incident from the imaging lens into two parts, receiving one of the separated lights and inputting it as a moving image signal, and another light separated by the distributor Audio having a still image input step for receiving light and outputting as a still image signal, a moving image signal recording step for recording the moving image signal on a recording medium, and a still image signal recording step for recording the still image signal on a recording medium In the video data simultaneous recording method, the second moving image supplements the information of the corresponding first moving image picture data, and is recorded on the recording medium as supplemental moving image information. From the supplemental moving image information and the moving image information, An audio video signal comprising a step of constructing and reproducing an image having a higher density in the image plane or in the image time direction than the first moving image data. Playback method.
(6) An imaging lens, a light receiving element that receives a light beam incident from the imaging lens and outputs it as a moving image signal, and simultaneously outputs it as a still image signal, and a first that records the first moving image signal on a recording medium An audio video data simultaneous recording apparatus comprising a moving image signal recorder and a second moving image signal recorder for recording the second moving image signal on a recording medium, wherein the second moving image corresponds to a corresponding first An audio video signal recording apparatus which is recorded as supplemental moving image information which supplements information of moving picture picture data.
(7) A still image input step for receiving a light beam incident from the imaging lens and inputting the moving image as a moving image signal, and simultaneously outputting the moving image signal, and a moving image signal recording step for recording the moving image signal on a recording medium; In the audio video data simultaneous recording method, comprising the still image signal recording step of recording the still image signal on a recording medium, the second moving image supplements information included in the corresponding first moving picture picture data. An audio video signal recording method comprising a step of recording as moving image information.

  The present invention has two light receiving elements, generates two moving picture data (moving picture data and supplementary moving picture data), and the supplementary moving picture compresses and records supplementary moving picture information that supplements the information of the corresponding moving picture picture data on a recording medium. In addition, when entering the moving picture corresponding to the supplementary moving picture signal, the supplementary moving picture information and the moving picture information form an image having a higher density in the image plane or in the image time direction than the moving picture data. Therefore, the information amount can be reduced as compared with the information amount obtained by adding the information amounts of the two moving images recorded by the conventional method, and the recording medium can be used efficiently. . In particular, when the video is interlaced, the corresponding supplemental video information has only the information of the other field that does not exist at the time of the video interlace, so that the field decoded from the video (a ) And information on the other field (b) that does not exist at that time of the video interlace as supplementary video information, and (a) + (b) = (c) as a high-definition progressive video ( c) can be obtained. Still further, when the moving image is a progressive image, the corresponding supplemental video information is captured at a timing intermediate between the imaging timings in the time direction of the video image, and two video display images of the video and the supplemental video are displayed. By alternately displaying the images, a moving image having a double density in the time direction can be reproduced. These make it possible to reproduce a new moving image while maintaining the compatibility of the format of the original moving image, and to realize an efficient recording / reproducing system with a minimum recording capacity.

Hereinafter, the best mode for carrying out the invention will be described with reference to the drawings.
FIG. 1 is a block diagram of a preferred audio video recorder of an embodiment of the present invention. The input video light is input to the optical path separator 102 through the lens 101. The lens 101 and the optical path separator 102 are separated into two optical paths using a lens group and, for example, a prism as shown in FIG. A half mirror may be used instead of a prism. The separated light enters the first light receiving element 104 and the second light receiving element 105. The light receiving element is, for example, a CCD or a CMOS. Data from the light receiving element 106 is A / D converted and input to the moving image encoder 115 as digital data. The data from the light receiving element 107 is A / D converted and input to the supplementary moving image encoder 114 as digital data. On the other hand, audio data from the audio input device 103 is converted into digital data by the A / D converter 108 and input to the speech encoder 113. The speech encoder 113 performs compression such as Dolby AC3.

  On the other hand, in the user interface 109, in the middle of recording a moving image as a movie, the user inputs timing information when the button is pressed in cooperation with an operation of pressing a button or the like. Via the CPU 110, in the supplementary moving image capturing timing signal generator 111, the supplementary video recording start signal, the program number of the linked video being recorded at the same time, and the leading picture time code of the linked video, It transmits to the supplementary moving image encoder 114.

  The video program number is the value of the second PR_number of V_PR_IFO in Table 1 in the Linked_video_program area of Table 3. The picture time code of the video is a so-called time code of the linked video that is recorded at the same time. In MPEG or the like, it may be the same as the time code described in the GOP header as the GOP header in the number of frames per hour, minute, and second. In addition, this information can be the number of frames from the beginning or the address from the beginning (number of bytes), even if it is not a time code, as long as it is information that can identify a picture in moving image data (position information of a moving picture picture). ).

  At the same time, a supplemental video recording start signal and supplementary video identification information (S_PRN, which will be described later) are also transmitted to the video encoder 115, and recorded in the MPEG user data area where each picture of the video encoded data can be recorded. The supplementary moving image identification information (S_PRN, which will be described later) encoded in synchronization with the timing is described. This is the number of the supplemental video program described for each scene of the supplemental video in the supplemental video information of Table 3. With this information, the head position of the supplementary moving image shot at the same timing as the moving image frame can be specified during moving image reproduction. The writing of data into the moving image is described in the user data area in the MPEG picture data as shown in FIG. User data uses User_data () in the syntax of the MPEG2 video layer shown in Table 3. user_data () starts with a uniquely determinable byte-aligned start code user_start_code and can continue with user_data until the next 3 bytes of 0x000001 are received. Here, still image identification information (S_PRN described later) is described. At that time, there is a possibility that user_data () is used in another application. Therefore, after the user_start_code of user_data (), a unique code 0x22220204 of about 4 bytes indicating the data of this method is described. . This prevents confusion with user data used for other purposes.

  Further, the CPU 110 transmits a control signal such as writing of supplementary moving image identification information (S_PRN described later) to the management data memory 112. Further, the supplemental moving image shooting timing signal generator 111 writes still image identification information (S_PRN described later) in the management data memory 112 in accordance with the control signal. The data recorded in the management data 112 is recorded on the recording medium 120 by the recording medium writing unit 118 in accordance with the control signal from the CPU 110 together with the multiplexed audio video signal data from the disk formatter 118. In addition, a supplemental video imaging timing signal is input to the video encoder 115 from the supplemental video imaging timing signal generator 111. The supplemental still image encoder 114 and the moving image encoder 115 perform compression in MPEG2, for example. Each encoded encoded data is multiplexed into one data by a multiplexer 116. The multiplexed data is formatted by the disk formatter 117 in the disk format described later and input to the recording medium writer 118.

  Note that this recording apparatus may not be separated into two optical paths by using an optical path separator as shown in FIG. An element having a specification capable of reading with sufficiently high resolution using a CCD, a CMOS, or the like, such as a switch 105, a means for switching between a moving image and a supplemental moving image, and a resolution converter 107 for reducing the resolution for a normal moving image If there is an equivalent circuit (such as reading out an element by adding a plurality of pixels by devising the element), the present invention can be realized with one element.

  Next, a supplemental moving image information generation method will be described with reference to FIG. FIG. 4A is a conceptual explanatory diagram when a supplementary moving image is recorded during shooting of a normal moving image. The moving image of 5 frames is a continuous moving image. The right direction is the time axis. If the frame (a) of the central image has a supplementary moving image capturing timing, the user presses the shutter button for the supplemental moving image at that timing. As a result, the timing of the beginning of the supplemental video recording and imaging and the recording data are captured. First, in FIG. 4 (2), the definition of field expression at the time of interlace will be described. An interlaced moving image usually has a field composed of odd lines and a field composed of even lines. Here, the field (a) including the top line when merged into the frame is defined as Top_field, and the field (b) including the second line is defined as bottom_field. Further, as shown in FIG. 4C, top_field and bottom_field are merged and an image captured at the same time is defined as progressive_frame.

  The case of Example 1 will be described. For example, assume that the moving image is a progressive image. For example, in the case of a 60 Hz progressive image, a supplementary moving image is captured at a time timing that fills the supplementary moving image as shown in (b) of FIG. Both the moving image and the supplementary moving image are images composed of 60 Hz progressive frames, and are encoded with the same image size. At the time of reproduction, as shown in (a), a supplementary moving image is displayed between the moving images. This can be realized easily by using Presentation_Time_Stamp indicating the display timing according to a multiplexing standard such as MPEG2 when multiplexing. As a result, as shown in (a), it is possible to reproduce a 120 Hz progressive frame moving image having twice the density in the time direction.

  The case of Example 2 will be described. For example, the moving image is an interlaced image. For example, in the case of a 60 Hz field image, the supplementary moving image is imaged and recorded as the other field of the field in which the moving image data exists, as shown in FIG. 4B (b). That is, if the moving image is top_field, the supplemental moving image is bottom_field. Further, since the time direction density is not changed, a supplementary moving image is shot at the field time timing of the moving image. Both the moving image and the supplementary moving image are images composed of 60 Hz interlaced fields, and are encoded with the same image size. At the time of reproduction, as shown in (a), the supplemental video display timing is given at the same time as the video field. This can be realized easily by using Presentation_Time_Stamp indicating the display timing according to a multiplexing standard such as MPEG2 when multiplexing. As a result, a progressive frame moving image of 60 Hz having the same time and a double density in the vertical direction can be reproduced as shown in (a).

FIG. 3 is a block diagram of a preferred audio video player of an embodiment of the present invention. First, audio video data and management data are read from the recording medium 201 by the recording medium reader 202 in accordance with a control signal from the CPU 204. Management data is recorded in the management data memory 206. The audio video data is input to the disc format decoder unit 205. In the disk format decoder 205, a disk format described later is format decoded and input to the demultiplexer 207. The demultiplexer 207 separates the data of each element from the multiplexed state into each element data, the audio data is the audio decoder 209, the supplemental video data is the supplemental video decoder 210, and the video data is the video Input to the decoder 211. When reproducing a moving image, the moving image and audio data are transmitted to the moving image output unit 214 and the audio output unit 213, respectively, and are displayed and output.
In the case of high-density moving image display, the decoded supplemental moving image from the supplemental moving image decoder 210 is transmitted to the high-density moving image composer 212.

  This is because, when the user selects high-density moving image display on the screen by exchanging control signals with the CPU 204, the information of the management data memory 206 is used to determine the position of the head of high-density moving image playback in the corresponding moving image. Random access location information (linked_video_program_number and linked_video_entry_time in Table 3) is obtained. Position information for random access from the CPU is transmitted to the random access time controller 208. The random access time controller 208 specifies linked video program data to be accessed using linked_video_program_number in the position information to be accessed, and uses the linked_video_entry_time to send a control signal to the access position information to the recording medium reader 202. Transmit to. The moving image decoder 211 transmits the decoded moving image data to the high-density moving image composer 212. In the high-density moving image composer 212, for example, in the case of the first embodiment shown in FIG. 4 (4), the decoded moving image is a 720 × 480 pixel 120 Hz progressive frame moving image. The supplemental still image is the image (b) (60 Hz progressive frame moving image of 720 × 480 pixels). The high-density moving image composer 212 composes an image of a high-density moving image (a) by merging these two progressive images alternately in the time direction. As another example, in the case of Example 2 in FIG. 4 (5), the decoded moving image is an interlaced image of 720 × 240 pixels. The supplemental still image (b) is also an interlaced image of 720 × 240 pixels, but the phases of top_field and bottom_field are reversed from the decoded moving image. The high-density moving image composer 212 merges these two images progressively to form a high-density moving image (a) image.

Next, a data structure that is formatted by the disk formatter 117 and format-decoded by the disk format decoder 205 will be described.
FIG. 15 shows an example of the directory and file structure according to the embodiment of the present invention. Directory names and file names are used for the purpose of describing embodiments of the present invention, and other names are not negated. There is a JVC_HDVD_SYSTEM directory under a root directory (not shown), under which all management data, audio, video, and supplemental video data related to the present invention are stored.

  TMG.ifo (Total Manager Information) is a file for recording original management data (hereinafter also referred to as a program set) and user-defined management data (hereinafter also referred to as a playlist). The structure is shown in FIG. Details will be described later.

V_PR_SET is a directory for recording a video program as a video object, and each video program is recorded therein as V_PRn.dat (where n is a program number starting from 1). Video objects are recorded in the program as MPEG-2 system standard program streams or transport streams.
A_PR_SET is a directory for recording an audio program as an audio object, and each audio program is recorded as A_PRn.dat (where n is a program number starting from 1). Audio objects are recorded in the program as MPEG-2 system standard program streams or transport streams.

  When a video or audio object is recorded as a program stream, it is packed for each element data according to the format of the MPEG multiplexing standard as shown in FIG. Objects are recorded as a set of packs, each pack has a pack header, followed by a packet. A packet header and at least video or audio data are recorded in the packet, and a private header may be recorded immediately after the packet header as necessary.

S_PR_SET is a directory for recording a supplemental video program as a supplemental video object, in which each program of the supplemental video is recorded as S_PRn.jpg (where n is a program number starting from 1). . Here, MPEG still image recording is assumed. Each MPEG file corresponds to one supplementary moving image object.
Although FIG. 15 shows an example in which file groups related to video, audio, and supplementary video programs are recorded under different directories, all three file groups are recorded under the same directory, for example, AVS_PR_SET. However, it does not differ from the gist of the present invention. Further, an example in which each video program is recorded as one file V_PRn.dat and an example in which each audio program is recorded as one file A_PRn.dat are shown. It is also possible to record continuously in V_PR.dat and hold as separate information which part in V_PR.dat corresponds to which program data. The same applies to A_PR.dat.

  Next, FIG. 16 shows an example of the data structure of TMG.ifo. TOTAL_MAN_IFO (Total Manager Information) includes GENERAL_IFO (General Information), CNTNT_IFO (Content Information), and STATUS_IFO (Status Information).

GENERAL_IFO may include general information of TOTAL_MAN_IFO such as System ID, Version number, and the start address of CNTNT_IFO and STATUS_IFO. Details are described in Table 6. The STATUS_IFO may include information regarding the status such as the type and number of the last played program.
CNTNT_IFO is a video program information table V_PR_IFOT (Video Program Information Table), an audio program information table A_PR_IFOT (Audio Program Information Table), a still picture program information table S_PR_IFOT (Still picture Program Information Table), and a play corresponding to user-defined management data It consists of a list information table PL_IFOT (Play List Information Table). Three of V_PR_IFOT, A_PR_IFOT, and S_PR_IFOT correspond to the original management data (conventional example).

Furthermore, V_PR_IFOT includes video program information V_PR_IFO_i (i is an integer from 1 to n) of each video program.
A_PR_IFOT includes audio program information A_PR_IFO_j (j is an integer from 1 to m) of each audio program. S_PR_IFOT includes still picture program information S_PR_IFO_k (k is an integer from 1 to q) of each still picture program. PL_IFOT includes information PL_IFO_p (p is an integer from 1 to r) of each playlist. In the following, i, j, k, and p are referred to as PR_IFO numbers.

  Table 1 shows an example of data fields and contents of V_PR_IFO_i. In the data field, PR number (V_PRN) indicates the number of this video program and is equal to the V_PR_IFO number. Video Group number (V_GRN) indicates the number of the video group to which this program belongs. In V_ATR, syntax as shown in the table below Table 1 is described. Here, Video_compression_mode indicating what compression method the video image is recorded in, TV_system information identifying the PAL or NTSC TV system, aspect information, and the number of horizontal and vertical pixels are recorded. . Description of other data fields is omitted here. It should be noted that V_PR_IFO is for storing address information, attribute information, and accompanying information such as text necessary for playback of the video program, and can take various information structures other than the example in Table 1.

  Table 2 shows an example of data fields and contents of A_PR_IFO_j. In the data field, PR number (A_PRN) indicates the number of this audio program and is equal to the A_PR_IFO number. Audio Group number (A_GRN) indicates the number of the audio group to which this program belongs. Track number (TKN) indicates the track number in the audio group. Description of other data fields is omitted here. It should be noted that A_PR_IFO is for storing address information, attribute information, and accompanying information such as text necessary for reproduction of the audio program, and can take various information structures other than the example in Table 2.

  Table 3 shows an example of data fields and contents of S_PR_IFO_k. This structure is basically the same structure as V_PR_IFO. The difference is the following two parameters. Linked_video_program_number describes the PR_number of the video linked to this still picture. If it is not linked, 0 is described. Also, Linked_video_entry_time describes the time code of the linked video picture. As shown in the syntax in the table below Table 3, S_ATR indicates Video_compression_mode indicating the compression format of the video image, TV_system information identifying the PAL or NTSC TV system, and aspect information. Is recorded. Also, in supplement_info, when supplemental video data is recorded as the other field image of the corresponding video, information for identifying whether the field starts with top_field or bottom_field, Alternatively, information identifying whether it is recorded as a progressive frame (progressive_frame) is recorded. Description of other data fields is omitted here. It should be noted that S_PR_IFO is for storing attribute information necessary for reproduction of a still picture program, accompanying information such as text, and can take various information structures other than the example in Table 3.

  Table 4 shows an example of the data field and contents of PL_IFO_p. In the data field, PL number indicates the number of this playlist. num_of_ud_programs indicates the number of user-defined programs included in this playlist. In one user-defined program UD_PR (User Defined Program), one or more video programs, one or more audio programs, or one or more still image programs are recorded. Alternatively, one or more audio programs and one or more still picture programs to be played back may be recorded. UD_PR_mode indicates whether the UD_PR to be reproduced includes a video, audio, or still image program. Description of other data fields is omitted here. The function of each program, the relationship between the program and user-defined program, the playlist, etc. will be described later. It should be noted that PL_IFO is for storing information necessary for associating and reproducing each program, and can take various information structures other than the example in Table 4.

  Next, the recording method of the present invention will be described with reference to the flowchart of FIG. First, in step 601, recording is started. Next, in step 602, video and audio data recording is started. Next, in step 603, it is determined whether to record a high-density moving image. In the case of recording (YES), for example, it is performed by a user interface such as a button for instructing high-density moving image recording from the user. For example, it is preferable to implement a button operation interface that is easy for the user to use, such as recording a moving image when the button is pressed once and recording a high-density moving image when the same button is pressed a second time. Next, in step 604, high-density moving image data is captured. Next, in step 605, supplemental moving image data is created by the method described above. In the next step 606, a high-density moving image capturing timing signal is generated. In step 607, the input data is stored and encoded. The moving image data and supplemental moving image data are temporarily stored in memory and subjected to MPEG2 compression encoding. The audio data is continuously stored together with the moving image, and after being stored for a predetermined unit time, compression encoding such as Dolby AC3 or MPEG audio encoding is performed. Next, in step 608, the encoded data is packed with element data (elements such as video and audio), and multiplexed by adding an identification header and a time stamp. Next, at step 609, a corresponding supplementary moving image identification signal is recorded in the user data area for each picture of the moving image data. As described above, this is identification information (S_PRN described later) of the supplementary moving image encoded in synchronization with the timing. This is the program number of the supplementary moving picture information in Table 3. In step 610, the multiplexed data and the user data are formatted and buffered according to the format of FIG. When a certain amount of data is accumulated in the buffer, it is recorded on a recording medium. Next, in step 611, it is determined whether or not the recording is completed. If the recording is completed (YES), the process proceeds to step 612. Based on the recording result, management data (an IFO including Linked_video_program and Linked_video_entory_time for each supplementary video) is shown in FIG. Format according to the format and record on the recording medium. Next, the process proceeds to step 613 and ends. If NO in step 611, the process returns to step 602.

  The playback method of the present invention will be described with reference to the flowchart of FIG. First, in step 801, playback is started. Next, in step 802, management data (IFO) is read from the recording medium and developed in the memory. Next, in step 803, it is selected whether normal movie playback or high-density movie playback. In the case of moving image reproduction, moving image data is reproduced in step 805. In step 811, moving image data is displayed. Next, in step 812, it is determined whether or not the moving image reproduction is finished. In the case of end (Y), the process proceeds to step 813 and ends. If not completed (NO), the process returns to step 805. On the other hand, in the case of high-density moving image reproduction in step 803, supplemental moving image data is reproduced in step 804. Next, in step 806, the Linked_video_program value and the Linked_video_entry_time value for each supplementary video are read out. In step 807, moving image data corresponding to the supplementary moving image is reproduced. Next, in step 808, the supplementary moving image data reproduction image and the corresponding moving image reproduction image are merged. In step 809, the merged high-density image data is reproduced. Next, in step 810, it is determined whether or not the high-density image data reproduction is finished. If NO (NO), the process returns to step 804. When all the processes are completed (YES), the process proceeds to step 813 and ends.

In this embodiment, the recording medium is not specified, but any recording medium may be used as long as it is a randomly accessible recording medium such as a hard disk or an optical disk.
In addition, data can be transmitted via any transmission medium such as communication and broadcasting without recording data on the recording medium. In that case, the recording apparatus can also be used as a transmission apparatus. The playback device can also be used as a receiving device.

  Further, the recording medium on which the signal data of the present invention is recorded has the format structure shown in FIGS. 15, 16, Table 1, Table 2, Table 3, Table 4, and Table 6, and further supplementary moving images are recorded. When the supplementary moving image information that supplements the information included in the corresponding moving image picture data is compressed and recorded on a recording medium and the moving image picture corresponding to the supplemental moving image signal is entered, the supplementary moving image information and the moving image information are used. Since an image having a higher density in the image plane or in the image time direction than the moving image data is constructed and reproduced, the information amount of the value obtained by adding the information amounts of the two moving images recorded by the conventional method is used. However, the amount of information can be reduced, and the recording medium can be used efficiently. These make it possible to reproduce a new moving image while maintaining the compatibility of the format of the original moving image, and it is possible to preferably realize an efficient system of the recording medium.

  In addition, the definition of the medium includes not only a narrowly-defined medium that can record data, but also an electromagnetic wave and light for transmitting signal data. In addition, the information recorded on the recording medium includes data itself such as an electronic file in a state where the information is not recorded.

It is a block diagram which shows the 1st Example of this invention recording device. It is explanatory drawing of the data structure recorded in the user data of MPEG relevant to this invention. It is a block diagram which shows the Example of this invention reproducing | regenerating apparatus. It is explanatory drawing of the structural example of the supplement moving image relevant to this invention. It is a block diagram which shows one Example of the optical system part which comprises this invention apparatus. It is a flowchart for demonstrating operation | movement of this invention apparatus. It is a block diagram which shows the 2nd Example of this invention recording device. It is a flowchart for demonstrating operation | movement of this invention apparatus. It is explanatory drawing which shows the data pack structure of the MPEG specification in a prior art. It is a block diagram of the MPEG encoder in a prior art. It is a block diagram of the MPEG decoder in a prior art. It is explanatory drawing of the example of a directory and file structure in a prior art. It is explanatory drawing which shows the structure of the original PGC in a prior art. It is explanatory drawing which shows the structure of the user definition PGC in a prior art. It is a figure which shows the example of the directory and file structure relevant to this invention. It is a figure which shows the example of a data structure of TMG.ifo relevant to this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Lens 102 Optical path separator 103 Audio input device 104 Light receiving element 105 Light receiving element 106 A / D converter 107 A / D converter 108 A / D converter 109 U / I
110 CPU
111 Supplementary video imaging timing signal generator 112 Management data memory 113 Audio encoder 114 Still image encoder 115 Video encoder 116 Multiplexer 117 Disk formatter 118 Recording medium writer 119 Recording medium

Claims (7)

An imaging lens; an optical path separator that separates light incident from the imaging lens; at least one light receiving element that receives light separated by the optical path separator and outputs the light as a first moving image signal; and the distribution At least one light receiving element that receives the light separated by the unit and outputs the light as a second moving image signal, a first moving image signal recorder that records the first moving image signal on a recording medium, and the second An audio video data simultaneous recording apparatus including a second moving picture signal recorder for recording a moving picture signal on a recording medium, wherein the second moving picture supplements information of the corresponding first moving picture picture data; An audio video signal recording apparatus which is recorded as supplementary moving picture information. The recording medium, wherein the second moving image is recorded as supplemental moving image information that supplements information of the corresponding first moving picture picture data. An imaging lens; an optical path separator that separates light incident from the imaging lens; at least one light receiving element that receives light separated by the optical path separator and outputs the light as a first moving image signal; and the distribution At least one light receiving element that receives the light separated by the unit and outputs the light as a second moving image signal, a first moving image signal recorder that records the first moving image signal on a recording medium, and the second An audio video data simultaneous recording apparatus including a second moving picture signal recorder for recording a moving picture signal on a recording medium, wherein the second moving picture supplements information of the corresponding first moving picture picture data; When recording in the recording medium as supplementary moving image information and entering a picture of the first moving image corresponding to the second moving image signal, the first information is obtained from the supplementary moving image information and the moving image information. Than video data, audio-video signal reproducing apparatus characterized by play constitutes a dense image in the image plane or the image temporal direction. Separating a light beam incident from the imaging lens into two parts, receiving one of the separated lights and inputting it as a moving image signal; receiving another light separated by the distributor; Simultaneous audio / video data comprising a still image input step for outputting as a still image signal, a moving image signal recording step for recording the moving image signal on a recording medium, and a still image signal recording step for recording the still image signal on a recording medium In the recording method, an audio video signal recording method comprising a step of recording the second moving image as supplementary moving image information that supplements information of the corresponding first moving picture picture data. Separating a light beam incident from the imaging lens into two parts, receiving one of the separated lights and inputting it as a moving image signal; receiving another light separated by the distributor; Simultaneous audio / video data comprising a still image input step for outputting as a still image signal, a moving image signal recording step for recording the moving image signal on a recording medium, and a still image signal recording step for recording the still image signal on a recording medium In the recording method, the second moving image is recorded on a recording medium as supplemental moving image information that supplements information of the corresponding first moving picture picture data, and from the supplemental moving image information and the moving image information, Audio video signal reproduction characterized by comprising and reproducing an image having a higher density in the image plane or in the image temporal direction than moving image data Law. An imaging lens, a light receiving element that receives light incident from the imaging lens and outputs it as a moving image signal, and simultaneously outputs it as a still image signal, and a first moving image signal recording that records the first moving image signal on a recording medium And a second video signal recorder for recording the second video signal on a recording medium, wherein the second video is a corresponding first moving picture picture An audio video signal recording apparatus which is recorded as supplemental moving image information which supplements information held by data. A moving image input for receiving a light beam incident from an imaging lens and inputting it as a moving image signal, and simultaneously outputting a still image signal as a moving image signal; a moving image signal recording step for recording the moving image signal on a recording medium; In the audio video data simultaneous recording method including a still image signal recording step for recording an image signal on a recording medium, the second moving image is supplementary moving image information that supplements information of the corresponding first moving image picture data. An audio video signal recording method comprising a step of recording.