JP4809451B2 - Image file generating apparatus and method, and image file reproducing apparatus and method - Google Patents

Description

  The present invention relates to an image file generation apparatus and method, and an image file reproduction apparatus and method.

  In a digital still camera, an image file storing image data representing a subject image is generated by capturing the subject and is recorded on a memory card. There are many different formats of image data stored in the image file, but the image data stored in the image file is only one type having a specific format as long as it represents a still image. For example, if either compression mode or non-compression mode is specified and the compression mode is specified, a JPEG file is formed and recorded on the memory card. If the non-compression mode is specified, the TIFF file is It is formed and recorded on a memory card (see Patent Document 1).

  Also, in order to be able to reproduce image data recorded in different color spaces, there is a relationship between one image data in one color space and image data in another color space different from the one color space. Some of them record data indicating the difference (see Patent Document 2).

  However, in order to obtain a difference, basic specifications such as the number of pixels of images in different color spaces must match, and images having different numbers of pixels cannot be obtained.

  Further, since the image data format corresponds to each image file, a new image file is generated when image data of a different format is recorded on the memory card. In this way, the number of image files increases corresponding to the format type.

JP 2001-352515 A U.S.P.6,282,311B1

  An object of the present invention is to enable recording of image data of a large number of formats without increasing the number of image files.

  Another object of the present invention is to make it possible to reproduce the image data thus recorded.

  Another object of the present invention is to obtain two types of image data having different basic specifications from one image file.

  An image file generation device according to a first aspect of the present invention is a first header data generation means for generating first header data for given first image data, and the first image data at the head of the first image data. First header data adding means for adding first header data generated by one header data generating means, and second for generating second header data for given second image data Header data generating means, second header data adding means for adding the second header data generated by the second header data generating means to the head of the second image data, the first image data The third header data adding means for adding the second header data following the image data of the image data, and the first header data adding means by the first header data adding means. An image file is generated from the first image data to which the second header data is added and the second image data to which the second header data is added by the second header data adding means. Image file writing means for writing to a recording medium, and extension recording control means for recording data representing an extension determined based on the first image data on the recording medium as data representing the extension of the image file It is characterized by having.

  The first invention also provides a method suitable for the image file generating apparatus. That is, this method generates first header data for given first image data, adds the generated first header data to the head of the first image data, and gives the first header data. Second header data for the second image data is generated, the generated second header data is added to the head of the second image data, and the first image data is followed by the above-mentioned One image file from the first image data to which the second header data is added and the first image data to which the first header data is added and the second image data to which the second header data is added Is recorded on the recording medium, and data representing an extension determined based on the first image data is recorded on the recording medium as data representing the extension of the image file. It is.

  According to the first aspect of the invention, first header data for the given first image data is generated. The generated first header data is added to the head of the first image data. Conventionally, one image file is generated by adding header data to the head of image data in this way. According to the first aspect of the invention, second header data for the given second image data is further generated and added to the head of the second image data. A second header data is added to the first image data, and a series of image data following the first header data, the first image data, the second header data, and the second image data. Is generated. Writing to the recording medium is performed so that one image file is generated from the image data generated in this way. Furthermore, data representing an extension determined based on the first image data is recorded on the recording medium as data representing the extension of the image file.

  According to the first invention, two types of image data (same format or different formats) each having header data added thereto are stored in one image file. Image data having various formats can be recorded without increasing the number of image files. Since the extension of the image file is determined based on the first image data, the image file can be handled in the same way as a conventional image file, assuming that the first image data is stored. For example, in a conventional apparatus that cannot reproduce an image file in which two types of image data each having header data added are stored, only the first image data can be reproduced based on the extension. become able to.

  The first image data is preferably image data (JPEG image data generation means) based on, for example, JPEG (joint photographic expert group). Image data based on JPEG is being standardized in practice and can be reproduced by many image reproducing apparatuses. Therefore, even in a conventional apparatus that cannot reproduce an image file in which two types of image data each having header data added are stored, if the first image data is based on JPEG, An image represented by the first image data can be reproduced.

  The second image data is, for example, image data compressed by a compression method other than JPEG (either a moving image or a still image, compressed image data generating means), uncompressed image data (first image data data). Data having a data amount larger than the data amount or data having a smaller data amount) and image data representing a stereoscopic image (stereoscopic image data generating means).

  The first image data may be one image data of two image data constituting a stereoscopic image, and the second image data may be the other image data of the two image data. . A reproducing apparatus capable of reproducing the first image data and the second image data can display a stereoscopic image using these two image data. Even an apparatus that cannot reproduce the second image data can display an image represented by the first image data.

  The first image data is, for example, data representing a reduced image of the second image represented by the second image data (reduced image data generating means). The size of the reduced image can be arbitrarily determined.

  The first header data adding means includes, for example, data indicating the address of the second header data in the image file, and recording presence / absence indicating whether or not the second image data is recorded in the image file. At least one of the identification data and the image type identification data indicating whether the image represented by the second image data is a moving image or a still image is added to the first image data. By recognizing the content recorded as the first header data, the characteristics of the image represented by the second image data can be understood.

  At least one of recording presence / absence identification data indicating whether or not the second image data is recorded in the image file, and image type identification data indicating whether the image represented by the second image data is a moving image or a still image Electronic watermark means for embedding one of the data in the first image data as an electronic watermark may be further provided. In this case, the first header data adding means will add the first header data to the first image data in which the electronic watermark is embedded by the electronic watermark means.

  It can be seen that the second image data is stored in the image file when the image file is reproduced in the reproducing apparatus capable of reading the electronic watermark.

  First file name generating means for generating a file name of the image file, identification code generating means for generating an identification code representing the characteristics of the second image data, and a file generated by the first file name generating means An identification code adding means for adding the identification code generated by the identification code generating means to the name, and file name data representing the file name to which the identification code is added by the identification code adding means represents the file name of the image file It is preferable to further include file name recording control means for recording on the recording medium.

  Since the file name includes an identification code representing the characteristics of the second image data, the existence and characteristics of the second image data can be known by checking the file name.

  According to a second aspect of the present invention, there is provided an image file reproducing apparatus comprising a first recording area and a second recording area, each having a header recording area and an image data recording area. The first header data is recorded in the header recording area of the first recording area, and the first image data is recorded in the image data recording area of the first recording area. In addition, one image file in which the second header data is recorded in the second header recording area and the second image data is recorded in the second image data recording area, and an extension of the image file are indicated. The first image data, the first header data, and the extension data are read from a recording medium on which extension data corresponding to the first image data is recorded as data. First reading means, first reproducing means for reproducing the first image data read by the first reading means based on the header data and the read extension data, and the first reproduction First display control means for controlling the display device to display the first image represented by the first image data reproduced by the means, the header area of the second recording area, and the image data recording area The determination means for determining whether or not the second header data and the second image data are recorded, and the determination means determines the second header data in the header area and the image data recording area of the second recording area. And the second header recorded in the header recording area of the second recording area in response to the determination that the second image data is recorded. And second image data recorded in the image data recording area of the second recording area, second image data read by the second reading means, Second reproduction means for performing reproduction based on the header data, and second for controlling the display device to display the second image represented by the second image data reproduced by the second reproduction means. The display control means is provided.

  The second invention also provides a method suitable for the image file reproducing apparatus. That is, in this method, the first recording area and the second recording area, each having a header recording area and an image data recording area, are defined so that the second recording area follows the first recording area. The first header data is recorded in the header recording area of the first recording area, the first image data is recorded in the image data recording area of the first recording area, and the second One image file in which the second header data is recorded in the header recording area, and the second image data is recorded in the second image data recording area, and data representing the extension of the image file are the first data. The first image data, the first header data, and the extension data are read from the recording medium on which the extension data corresponding to the image data is recorded. Is reproduced based on the header data and the read extension data, a first image represented by the reproduced first image data is displayed on the display device, and the second recording is performed. It is determined whether or not the second header data and the second image data are recorded in the header area and the image data recording area of the area, and the second header data and the image data recording area in the second recording area In response to the determination that the header data and the second image data are recorded, the second header data and the second recording recorded in the header recording area of the second recording area The second image data recorded in the image data recording area of the area is read, and the read second image data is reproduced based on the header data and reproduced. The one in which the second image is displayed on a display device represented by the second image data.

  A second invention is an apparatus for reproducing an image file written on a recording medium based on the first invention.

  According to the second invention, the first image data, the first header data, and the extension data are read from the image file. The first image data is reproduced based on the first header data and the extension data. Further, it is determined whether or not the second header data and the second image data are recorded. If it is determined that the second header data and the second image data are recorded, the second header data and the second image data are read. It is done. The read second image data is reproduced based on the second header data. Even in the case where the first image data and the second image data each having header data are recorded in one image file, the first image data and the second image data respectively. Image data can be reproduced.

  You may further provide the designation means which designates the extension of the image file which should be reproduced. In this case, the first reading means reads the first image data recorded in the first image data recording area of the image file having the extension designated by the designation means. Let's go.

  Data indicating that the second image data is recorded in the second recording area may be recorded in the first image data. The user can recognize that not only the first image data but also the second image data is recorded in the image file. When the second image data is reproduced using an apparatus that cannot reproduce the second image data, the user knows that there is the second image data and the second image data can be reproduced using the apparatus that can also reproduce the second image data. 2 image data can be reproduced.

  Data indicating that the second image data is recorded in the second recording area may be embedded in the first image data with an electronic watermark. In this case, the electronic watermark reproducing means for reproducing the embedded electronic watermark data and the second image presence information represented by the electronic watermark data reproduced by the electronic watermark reproducing means are displayed. The display device may further include third display control means for controlling the display device.

  By reproducing the electronic watermark, the presence of the second image data can be known.

The file structure of an image file is shown. It is a block diagram which shows the electric constitution of a digital still camera. It is a flowchart which shows the process sequence of a still image recording. It is a flowchart which shows the process sequence of a still image recording. (A) to (C) show the file structure of the image file. (A) to (D) show the file structure of the image file. 2 shows the data structure of a memory card. 2 shows an electrical configuration of an image file playback device. It is a flowchart which shows the reproduction | regeneration processing procedure. It is a flowchart which shows the reproduction | regeneration processing procedure. It is an example of a 1st image. It is an example of a 1st image.

  FIG. 1 shows a file structure (data structure) of an image file generated by the embodiment of the present invention.

  In the image file generated by this embodiment, a first data recording area is formed at the head of the image file, and an indefinite data recording area is formed following the first data recording area. Subsequently, a second data recording area is formed. In the first data recording area, a first header data recording area is formed at the head, and a first image data recording area is formed following the first header data recording area. In the second data recording area, a second header data recording area is formed at the head, and a second image data recording area is formed following the second header data recording area. As described above, in the image file according to this embodiment, one header data recording area and one image data recording area are not included in the image file as in the prior art, but two header data recording areas are included. An area and two image data recording areas are included in the image file. In other words, it can be said that two image files are included in one image file.

  An SOI (start of image) is stored using the first area of the first header data recording area. In the first header data recording area, an application area is formed following the area where the SOI is stored, and finally an area for storing various tables is formed. The SOI is data indicating that the first data area starts. As will be described in detail later, the application area stores information about the first image data recorded in the first image data recording area. Various tables include a quantization table and a Huffman coding table used for image data compression processing. In the first image data recording area, first image data corresponding to the header data recorded in the first header data recording area is recorded. Any data may be stored in the indefinite data recording area, and the indefinite data recording area itself may not exist.

  Similarly to the first header / data recording area, the second header / data recording area also has an area in which the SOI is stored in the head area and an application area and various tables are stored in the next area. . Image data corresponding to various data recorded in the second header data recording area is stored in the second image data recording area.

  In the application area included in the first header data recording area, the first image data overall characteristic of the first image data recorded in the first image data recording area and the second image data recording area are included. The second image data individual characteristic for the second image data to be recorded is stored. The first overall image data characteristic is a characteristic mainly related to the shooting situation when the first image data is obtained. The first image data comprehensive characteristic includes the number of pixels of the image represented by the first image data, the color space, the photographing date and time, the photographing condition, and a pointer to the second image data individual characteristic. The second image data individual characteristic is a characteristic obtained mainly from the second image data obtained by photographing. The second image data individual characteristic stores the presence or absence of the second image data, the number, the first type, the second type, the third type, and a pointer to the start address of the second header data. The The first type includes whether the image represented by the second image data is a still image (0 is stored), a moving image (1 is stored), or audio (for convenience, audio is also included). ) Or (2 is stored), 3D still image (3 is stored), or 3D moving image (4 is stored). The second type includes whether the second image data is compressed based on JPEG (0 is stored), uncompressed luminance color difference data (1 is stored), or uncompressed RGB data. There is data indicating the presence / absence and type of compression, such as (CCD RAW data) (2 is stored) or compressed based on JPEG2000 (3 is stored). The third type includes the color space of the second image data and the number of bits (bit depth) representing each pixel of the second image represented by the second image data.

  In the application area included in the second header data recording area, data such as the number of pixels and the color space is stored as in the first image data overall characteristic. However, the pointer to the second image data individual attribute is not stored.

  In FIG. 1, the image file defines two data areas, a first data area and a second data area, but not two data areas but three or more data areas. May be. When three or more data areas are defined in one image file, the third image data individual characteristic is stored in the application area of the first header data recording area, and the third image data individual A pointer to the characteristic is also stored.

  Considering the first data area (and the indefinite data area), a first header data recording area is defined at the head as in a so-called conventional image file. Since one image data recording area is defined, the first image data stored in the image file shown in FIG. 1 can be reproduced using a conventional image file reproducing apparatus.

  FIG. 2 is a block diagram showing an electrical configuration of a digital still camera (image file generation device) capable of generating the image file shown in FIG.

  The entire operation of the digital still camera is controlled by the CPU 6.

  The digital still camera is provided with an operating device 7 including a power button, a shutter release button (a two-stroke type is used), and the like. The operation device 7 also includes a mode switching dial 8. This mode switching dial 8 is used to set the recording mode (still image recording mode, moving image recording mode, audio recording mode, 3D still image recording mode or 3D moving image recording mode), playback mode, setup mode for setting the camera setup, etc. Switching is performed. Set compression or non-compression of image data (set in setup mode). The compression / non-compression mode includes a JPEG compression mode, a luminance / chrominance data non-compression mode, and a CCD RAW mode. An operation signal from the operation device 7 is input to the CPU 6.

  A ROM 9 is connected to the CPU 6. In addition to the operation program, the ROM stores various data for generating the header data described above. The digital still camera includes a power supply circuit 17 from which power is supplied to each circuit.

  It is assumed that the still image recording mode is set by the mode switching dial 8. Then, a subject image is formed on the light receiving surface of the CCD 2 by the zoom lens 1. The CCD 2 has about 6 million pixels, and a video signal representing a subject image is output from the CCD 2 and input to the analog signal processing circuit 3. The analog signal processing circuit 3 performs predetermined analog signal processing such as gamma correction and white balance adjustment. The video signal output from the analog signal processing circuit 3 is converted into digital image data in the analog / digital conversion circuit 4. The digital image data is given to the memory buffer 10 by the memory controller 5 and temporarily stored. According to the setup mode setting, the image data stored in the memory buffer 10 is read, and the read image data is given to the digital signal processing circuit 11 to generate and read luminance data and color difference data. The compressed image data is applied to the compression / decompression circuit 12 to perform compression processing. Luminance data and color difference data generated in the digital signal processing circuit 11, compressed image data generated in the compression / decompression circuit 12, and the like are given to the memory buffer 10 and temporarily stored. The memory buffer 10 does not overwrite the data, but the given data is sequentially stored in a new area.

  The image data read from the memory buffer 10 is supplied to the digital / analog conversion circuit 13 and converted into an analog video signal. The converted analog video signal is supplied to the display device 14, whereby the captured subject image is displayed on the display screen.

  When the shutter release button is depressed at the first stage, the image data output from the analog / digital conversion circuit 4 as described above is given to the CPU 5 by the memory controller 5. The CPU 6 performs automatic exposure control by controlling the shutter time of the CCD 2 (so-called electronic shutter) and automatic focus control by adjusting the lens position of the zoom lens 1 based on the input image data.

  When the shutter release button is depressed in the second stage, the image data stored in the memory buffer 10 is read as described above, header data is added, and the connector 16 is connected via the media interface 15. Is written as an image file in the memory card 18 connected to the. This writing will be described later in detail. Depending on the JPEG compression mode, luminance / chrominance data non-compression mode, CCD RAW mode, etc. set for the digital still camera, the image data recorded on the memory card 18 may vary in compression and compression method. Needless to say.

  3 and 4 are flowcharts showing the processing procedure of the still image recording mode of the digital still camera.

  In this processing procedure, first image data and second image data are generated, header data is added to each, stored in one image file, and recorded on the memory card 18. Thumbnail image data compressed as JPEG as first image data is stored in an image file, and image data compressed as JPEG according to the setting of a digital still camera, uncompressed luminance data, and color difference as second image data Data or CCD RAW data is stored in the image file.

  When the power button is pressed, power is supplied to necessary circuits such as the CCD 2 among the circuits constituting the digital still camera, and the remaining circuits are set to the standby mode. When the still image recording mode is set by the mode switching dial 8 and the shutter release button is depressed at the first stage (YES in step 21), power is supplied to each circuit in the standby mode. . Further, as described above, automatic exposure control and automatic focusing control are performed based on the image data output from the analog / digital conversion circuit 4 (step 22). By imaging the subject, the subject image is displayed on the display screen of the display device 14. When the camera angle is determined, the shutter release button is depressed in the second stage.

  When the shutter release button is depressed in the second stage (YES in step 23), the image data output from the analog / digital conversion circuit 4 is applied to the memory buffer 10 as described above, and temporarily. Stored (temporary storage of CCD RAW data: step 24). The CCD RAW data is read from the memory buffer 10 by the memory controller 5 and applied to the digital signal processing circuit 11. In the digital signal processing circuit 11, luminance data and color difference data (YCbCr data) are generated from the CCD RAW data (step 25). The generated YCbCr data is temporarily stored by being applied to the memory buffer 10 (step 26).

  The YCbCr data recorded in the memory buffer 10 is read by the memory controller 5 while being thinned. This thinning readout is image resizing processing, and thumbnail image data having 640 pixels in the horizontal direction and 480 pixels in the vertical direction is generated (step 27). The thumbnail image data is sequentially given to the compression / decompression circuit 12 by the memory controller 5 and JPEG compressed (step 28). The JPEG-compressed thumbnail image data is given to the memory buffer 10 and temporarily stored (step 29). As described above, since the memory buffer 10 is controlled by the memory controller 5 so as not to overwrite data, the CCD RAW data, YCbCr data, and JPEG-compressed thumbnail image data (first image data) are stored in the memory buffer 10. Image data) is stored.

  Data for generating first header data is read from the ROM 9. The header data such as the number of pixels is added by the CPU 6 to generate first header data, which is added to the head of the first image data stored in the memory buffer 10 (step 30). It goes without saying that the data (see FIG. 1) regarding the second image data individual characteristic is also written in the first header data in accordance with the setting of the digital still camera.

  Subsequently, the processing for the second image data added following the first image data is started. Processing changes depending on whether the compression mode set in the setup mode is JPEG compression, YCC non-compression, or CCD RAW. Of course, when JPEG2000 is set, it goes without saying that processing according to the setting is performed.

  When JPEG compression is set as the digital still camera compression / non-compression mode (step 31), YCbCr data of about 6 million pixels stored in the memory buffer 10 is read while being thinned. , YCbCr data representing the main image of about 3 million pixels is generated (step 32). The YCbCr data is sequentially given to the compression / decompression circuit 12 and JPEG compression is performed (step 33). The JPEG compressed YCbCr data (second image data) is given to the memory buffer 10 and temporarily stored.

  Data for generating second header data (JPEG header data) is read from the ROM 9. By adding header data such as the number of pixels by the CPU 6, second header data is generated and added to the head of the second image data stored in the memory buffer 10 (step 34).

  Following the thumbnail image data (first image data) with the first header data added at the head, main image data (second image data) with the second header data added at the head is added. (Step 35), it is written in the memory card 18 as one image file. The extension (JPG) corresponding to the first image data is used as the extension constituting the file name of the image file, and is recorded in the memory card 18 (step 42).

  FIG. 5A shows the file structure of an image file when JPEG-compressed image data is stored as the second image data.

  As described above, the image file can be divided into a first data area and a second data area.

  JPEG-compressed thumbnail image data is recorded in the first image data recording area, and the JPEG-compressed thumbnail image recorded in the first image data recording area is recorded in the first header data recording area. Header data corresponding to the data (as described above, the second image data individual characteristic is also included) is recorded. The second image data recording area stores JPEG compressed image data of the main image, and the second header data recording area stores the JPEG compressed data recorded in the second image data recording area. Header data corresponding to the recorded main image data is recorded.

  Furthermore, the file name of the image file is “SCM ABCD 0001.JPG”. The file name is automatically generated. As described above, the extension corresponding to the first image data compression method is used. In addition, a character string indicating that the second image data represents a still image and is compressed (SCO: S indicates a still image and CO is compressed) at the beginning of the file name )It is included.

  Returning to FIG. 4, when YCC non-compression is set as the compression mode of the digital still camera (step 31), YCbCr data of about 6 million pixels stored in the memory buffer 10 is thinned out. The read YCbCr data representing the main image of about 3 million pixels is generated (step 36). The generated YCbCr data representing the main image of about 3 million pixels is given to the memory buffer 10 and stored.

  Data for generating second header data (TIFF: Tagged Image File Format header data) is read from the ROM 9. Second header data is generated by adding header data such as the number of pixels by the CPU 6, and stored in the memory buffer 10 is YCbCr data representing an uncompressed main image of about 3 million pixels. It is added to the head of (second image data) (step 37). The extension (JPG) corresponding to the first image data is used as the extension, and is written as one image file on the memory card (step 42).

  FIG. 5B shows the file structure of an image file when uncompressed YCbCr image data is stored as the second image data.

  Similar to FIG. 5A, JPEG-compressed thumbnail image data is recorded in the first image data recording area, and recorded in the first image data recording area in the first header data recording area. The header data corresponding to the thumbnail image data compressed with JPEG is recorded. Further, uncompressed YCbCr image data is recorded in the second image data recording area, and uncompressed YCbCr image recorded in the second image data recording area is recorded in the second header data recording area. Header data corresponding to the data is recorded.

  Furthermore, the file name of the image file is “SUC ABCD 0002.JPG”. In the image file shown in FIG. 5B, the file name extension corresponding to the first image data compression method is used. In addition, a character string indicating that the second image data represents a still image and is not compressed (SUC: S indicates a still image and UC is compressed) at the beginning of the file name )It is included.

  Returning to FIG. 4, when CCD RAW is set as the compression mode of the digital still camera (step 31), the CCD RAW data of about 6 million pixels stored in the memory buffer 10 is thinned out. This is read out (step 39), and CCD RAW data of about 3 million pixels is generated. The generated CCD RAW data is given to the memory buffer 10 and stored.

  Data for generating second header data (CCD RAW header data) is read from the ROM 9. Second header data is generated by adding header data such as the number of pixels by the CPU 6 and added to the head of CCD RAW (second image data) stored in the memory buffer 10 ( Step 40). The extension (JPG) corresponding to the first image data is used as the extension, and is written as one image file on the memory card (step 42).

  FIG. 5C shows the file structure of an image file when CCD RAW data is stored as the second image data.

  Similar to FIG. 5A, JPEG-compressed thumbnail image data is recorded in the first image data recording area, and recorded in the first image data recording area in the first header data recording area. The header data corresponding to the thumbnail image data compressed with JPEG is recorded. Further, CCD RAW data is recorded in the second image data recording area, and a header corresponding to the CCD RAW data recorded in the second image data recording area is recorded in the second header data recording area. Data is recorded.

  Further, the file name of the image file is “RAW ABCD 0003.JPG”. Also in the image file shown in FIG. 5C, the file name extension corresponding to the compression method of the first image data is used. The beginning of the file name includes a character string (RAW) indicating that the second image data is CCD RAW data.

  Thus, the compression method as the second image data changes according to the compression mode set in the digital still camera, but the extension of the image file is the first image data in the first data area. The JPG corresponds to the first image data recorded in the recording area. The first data area is the same as the structure of a conventional image file, and JPEG compression is a standard data compression method, so that it can be reproduced by many image file reproduction apparatuses. Even if the second image data stored in the image file cannot be reproduced, the first image data can be reproduced. Further, although the size of the conventional thumbnail image is fixed, the size of the thumbnail image represented by the thumbnail image data recorded as the first image data can be arbitrarily determined. A thumbnail image having a desired size can be obtained.

  FIGS. 6A, 6B, 6C and 6D show the file structures of other image files.

  FIG. 6A is an example of an image file generated when the moving image recording mode is set by the mode switching dial 8.

  JPEG-compressed thumbnail image data is recorded in the first image data recording area, and the JPEG-compressed thumbnail image recorded in the first image data recording area is recorded in the first header data recording area. Header data corresponding to the data is recorded. In the second image data recording area, moving image data based on AVI (Audio Video Interleaved) is recorded. In the second header data recording area, header data corresponding to the AVI moving image data recorded in the second image data recording area is recorded.

  Furthermore, the file name of the image file is “MOV ABCD 0004.JPG”. The beginning of the file name includes a character string (MOV) indicating that the second image data is moving image data based on AVI.

  FIG. 6B is an example of an image file generated when the stereoscopic still image recording mode is set by the mode switching dial.

  JPEG-compressed thumbnail image data is recorded in the first image data recording area, and the JPEG-compressed thumbnail image recorded in the first image data recording area is recorded in the first header data recording area. Header data corresponding to the data is recorded. In the second image data recording area, right-eye image data and left-eye image data for displaying a stereoscopic still image are recorded. In the second header data recording area, header data corresponding to right-eye image data and left-eye image data for a stereoscopic still image recorded in the second image data recording area is recorded.

  Furthermore, the file name of the image file is “3DI ABCD 0004.JPG”. In addition, the beginning of the file name includes a character string (3DI) indicating that the second image data is for displaying a stereoscopic image.

  In order to obtain the image data for the right eye and the image data for the left eye, for example, the same subject may be photographed twice while being shifted from each other by a predetermined distance.

  FIG. 6C shows another example of an image file generated when the stereoscopic still image recording mode is set by the mode switching dial.

  JPEG-compressed thumbnail image data is recorded in the first image data recording area, and the JPEG-compressed thumbnail image recorded in the first image data recording area is recorded in the first header data recording area. Header data corresponding to the data is recorded. In addition, unlike the one shown in FIG. 6C, one frame of stereoscopic still image data is recorded in the second image data recording area in order to display a stereoscopic still image. In the second header data recording area, image data for a stereoscopic still image recorded in the second image data recording area is recorded.

  Furthermore, the file name of the image file is “3DI ABCD 0006.JPG”. The beginning of the file name includes a character string (3DI) indicating that the second image data is for displaying a stereoscopic image.

  In order to obtain image data for one frame of stereoscopic image, the image data stored in the memory buffer 10 is addressed so that an image separated by a predetermined distance can be obtained left or right. You just have to do the operation. The image representing the image obtained by superimposing the right-eye image represented by the right-eye image data obtained by the addressing operation and the left-eye image represented by the left-eye image data is used as the second image data. That's fine.

  FIG. 6D is another example of an image file generated when the stereoscopic still image recording mode is set by the mode switching dial.

  In the first image data recording area, unlike in FIGS. 6A to 6C, JPEG-compressed right-eye image data for generating a stereoscopic still image is recorded. In the first header data recording area, header data corresponding to the JPEG-compressed right-eye image data recorded in the first image data recording area is recorded. Also, left-eye image data for displaying a stereoscopic still image is recorded in the second image data recording area. In the second header data recording area, left-eye image data for a stereoscopic still image recorded in the second image data recording area is recorded.

  Furthermore, the file name of the image file is “3DI ABCD 0007.JPG”. The beginning of the file name includes a character string (3DI) indicating that the second image data is for displaying a stereoscopic image.

  In FIGS. 6A to 6D, JPEG-compressed image data is recorded in the first image data recording area of the first data area, and the file name extension is the first. It is set to JPG corresponding to the image data recorded in the image data recording area. Even if the image data recorded in the second image data recording area cannot be reproduced, the image data recorded in the first image data recording area can be reproduced.

  FIG. 7 shows a data structure (file structure) in the memory card 18 (semiconductor memory in the memory card). This data structure follows the DOS-FAT (Disk Operating System-File Allocation Table) based file system. This DOS-FAT system is included in PCMCIA (Personal Computer Memory Card International Association) standards and can be read by almost all personal computers.

  The file on the memory card 18 is divided into a header area and a data area. The size of the header area is predetermined. The data area is divided into many clusters. The header area consists of a header, a FAT (File Allocation Table), and a directory. The image file generated as described above is stored in a plurality of clusters.

  The header describes the cluster size. The FAT describes a chain of clusters in which one image file is stored. Even if one image file is stored in discrete clusters, all image data can be read out by following the chain of clusters. The directory stores the file name, file type (extension), file attribute, file update date, initial cluster number, and file size for each image file stored in the data area.

  As described above, the extension stored in the memory card corresponds to the first image data even if the first image data and the second image data are stored in one image file. .

  In the digital still camera described above, data indicating the presence and type of the second image data may be inserted into the first image data. For example, an on-screen device may be used. Since the presence and type of the second image data is displayed in the image represented by the first image data, the image file is reproduced using an image file reproducing apparatus that cannot reproduce the second image data. It can also be seen that the second image data exists. The second image data can be played back using an image file playback device that can also play back the second image data.

  Further, by using a CPU 6 having a function of embedding an electronic watermark, data indicating the presence and type of the second image data may be embedded in the first image data with an electronic watermark. Good.

  Further, in the above-described embodiment, the image data recorded in the first data area of the image file is all thumbnail image data obtained by JPEG compression, but the image data obtained by compression other than JPEG compression is used. Data uncompressed image data may be used. In such a case, an extension corresponding to compression or non-compression other than JPEG compression will be added to the image file.

  8 to 12 relate to the reproduction of the image file generated as described above.

  FIG. 8 is a block diagram showing the electrical configuration of the image file playback apparatus.

  The overall operation of the image file playback device is controlled by the CPU.

  The operation device 55 includes a power button, a mode setting dial, a numeric keypad, and the like. An operation signal output from the operation device 55 is input to the CPU 54. In addition, the image file reproduction device includes a power supply circuit 64, and power is supplied from the power supply circuit 64 to each circuit.

  When the memory card 18 is connected to the connector 51, the image file recorded on the memory card 18 is read and supplied to the memory controller 52 via the media interface 52. The read image file is given to the memory buffer 58 by the memory controller 52 and temporarily stored.

  If the first image data recorded in the image file read from the memory card 18 is compressed, it is supplied to the decompression circuit 59 and decompressed. If the decompressed first image data is necessary, it is given to the signal processing circuit 60 and predetermined signal processing is performed. The first image data that has undergone signal processing is applied to the digital / analog conversion circuit 56 to be converted into an analog video signal. The converted analog video signal is supplied to the display device 57, whereby the first image represented by the first image data is displayed. Similarly, the second image data is read from the image file temporarily stored in the memory buffer 58, and the second image represented by the second image data is also displayed on the display device 57. Displayed on the screen.

  The image file playback apparatus also includes a communication interface 61. By using the communication interface 61, an image file can be transmitted to another apparatus.

  Further, the image file playback device includes a hard disk drive 63. The image file temporarily stored in the memory buffer 58 is transferred to the hard disk drive 63 via the media interface 62. By being given, the image file recorded on the memory card 18 can be recorded on a hard disk (not shown).

  9 and 10 are flowcharts showing the playback processing procedure of the image file playback apparatus.

  When the memory card 18 is loaded into the image file playback device, the file type (extension) recorded in the header area of the memory card 18 is read. File names having extensions that can be played back by the image file playback device among the read extensions are displayed in a list on the display screen of the display device 57 (step 71). The file name of the image file to be reproduced is designated by the user from the file names displayed in the list (step 72). Then, an image file having the designated file name is read from the memory card 18 and temporarily stored in the memory buffer 58 as described above. The first header data and the first image data recorded in the first data area of the image file are read (step 73). Then, the reproduction process of the first image data is performed based on the first header data and the extension of the image file (step 74). If the first image data is JPEG-compressed image data, the decompression circuit 59 performs decompression processing based on JPEG.

  The first image data subjected to signal processing in the signal processing circuit 60 is converted into an analog video signal by the digital / analog conversion circuit 56. The converted analog video signal is supplied to the display device 57, whereby the first image represented by the first image data is displayed on the display screen of the display device 57 (step 75).

  If the second image data individual characteristic data, the pointer to the second image data individual characteristic data, etc. are recorded in the first header data recording area of the image file (YES in step 76), it is read. The second image data is recorded in the image file. For this purpose, it is confirmed whether or not the second image data can be reproduced by the image file reproducing apparatus based on the second individual image data characteristic (step 77).

  If it is reproducible (YES in step 77), it is recorded as the second image data individual characteristic after the display of the first image has passed for a certain period of time or when a frame advance command is given from the operation device 55. Whether the second image data type is JPEG-compressed 3D image data (right-eye image data and left-eye image data), video data compressed based on H.264, or CCD RAW data (Step 78). Of course, other types of judgments may be made.

  If it is 3D image data compressed by JPEG, 3D image data as the second image data is read from the image file and decompressed by the decompression circuit 59. The expanded 3D image data is subjected to stereoscopic still image processing in the signal processing circuit 60 (step 79). The 3D image data subjected to the stereoscopic still image processing is supplied to the digital / analog conversion circuit 56. A stereoscopic still image is displayed on the display screen of the display device 57.

  If it is moving image data, moving image data, which is second image data, is read from the image file, decompressed by the decompression circuit 59, and applied to the signal processing circuit 60. In the signal processing circuit 60, a moving image reproduction process is performed. The moving image data subjected to the moving image reproduction process is sequentially applied to the digital / analog conversion circuit 56, whereby the moving image represented by the second image data is displayed on the display screen of the display device 57 (step 80). .

  If it is CCD RAW data, the CCD RAW data, which is the second image data, is read from the image file and applied to the signal processing circuit 60. In the signal processing circuit 60, predetermined reproduction processing is performed on the CCD RAW data. The CCD RAW data after the signal processing in the signal processing circuit 60 is given to the digital / analog conversion circuit 56. The analog video signal output from the digital / analog conversion circuit 56 is given to the display device 57, whereby a second image represented by the CCD RAW data is displayed on the display screen of the display device 57 (step 81).

  The above-described reproduction processing procedure is performed when the second image data to which the header data is added is stored in addition to the first image data to which the header data is added to the image file. When the image file in which the first image data and the second image data are recorded is read by a conventional reproducing apparatus that can reproduce the second image data but cannot reproduce the second image data. , Even if a pointer to the second image data individual characteristic included in the overall characteristic of the first image data is read, it cannot be recognized. For this reason, only the reproduction process of the first image data is performed, and the reproduction process of the second image data is not performed. The first image data is reproduced, and compatibility with a conventional image file reproduction apparatus can be maintained.

  In addition, the first header data and the first header data from the image file storing the first image data to which the first header data is added and the second image data to which the second header data is added are stored. Image data can be extracted and recorded on the hard disk as a new conventional image file.

  FIG. 11 and FIG. 12 are examples of images represented by the first image data read from the image file in which both the first image data and the second image data are recorded.

  In FIG. 11, the first image 90 represented by the first image data is displayed on the display screen of the display device 57. In the lower right of the first image 90, the second image data is recorded in the same image file as the image file in which the first image data is recorded, and the second image data is moving image data. A character 91 of “MOVIE” indicating that it is present is displayed. By inserting image data representing the “MOVIE” character 91 into the first image data, the first image 90 with the “MOVIE” character 91 inserted can be displayed.

  Since the character 91 of “MOVIE” is displayed, it can be seen that even if the image file reproducing apparatus cannot reproduce the second image data, the user is notified that the second image data exists. If necessary, the second image data can be reproduced using an apparatus capable of reproducing the second image data.

  Also in FIG. 12, the first image 90 represented by the first image data is displayed on the display screen of the display device 57. In the first image data, image data representing a character 92 “an image that can be played back by another playback device” is embedded by an electronic watermark.

  When the first image data is given to the signal processing circuit 60 and the electronic watermark data embedded in the first image data is reproduced, “an image that can be reproduced by other reproduction devices is included. The image data representing the character 92 is obtained. Characters 92 represented by the obtained image data are displayed below the first image.

  It can be seen that even an image file playback device that cannot play back the second image data informs the user that there is the second image data. If necessary, the second image data can be reproduced using an apparatus capable of reproducing the second image data. The character 92 is not inserted into the first image, so the user is not confused.

5,53 Memory controller 6,54 CPU
8 Mode switching dial 9 ROM
10, 58 Memory buffer
11 Digital signal processing circuit
12 Compression / decompression circuit
18 Memory card
59 Decompression circuit
60 Signal processing circuit

Claims (13)

First header data generation means for generating first header data for given first image data;
First header data adding means for adding the first header data generated by the first header data generating means to the head of the first image data;
Second header data generating means for generating second header data for second image data to be given and having the same format as the format of the first image data;
Second header data adding means for adding the second header data generated by the second header data generating means to the head of the second image data;
Third header data adding means for adding the second header data following the first image data;
The first image data to which the first header data is added by the first header data adding means and the second header data to which the second header data is added by the second header data adding means. An image file writing means for writing to a recording medium so that one image file is generated from the second image data, and data representing an extension determined based on the first image data are extended from the image file. Extension recording control means for recording on the recording medium as data representing a child,
The first header data adding means includes data indicating an address of the second header data in the image file, and recording presence / absence identifying data indicating whether or not the second image data is recorded in the image file. , And at least one of image type identification data indicating whether the image represented by the second image data is a moving image or a still image is added to the first image data.
Image file generator.   The image file generation device according to claim 1, wherein both the first image data and the second image data are image data based on JPEG. The first image data is one of two pieces of image data constituting a stereoscopic image;
The second image data is the other of the two image data,
The image file generation device according to claim 1. The first image data is image data for the right eye constituting a stereoscopic image,
The image file generation device according to claim 3, wherein the second image data is image data for a left eye constituting a stereoscopic image.   5. The image file generation device according to claim 1, wherein the first image data is data representing a reduced image of the second image represented by the second image data. 6. At least one of recording presence / absence identification data indicating whether or not the second image data is recorded in the image file, and image type identification data indicating whether the image represented by the second image data is a moving image or a still image Electronic watermark means for embedding one of the data in the first image data as an electronic watermark;
The first header data adding means is:
The first header data is added to the first image data in which the electronic watermark is embedded by the electronic watermark means.
The image file generation device according to any one of claims 1 to 5. First file name generation means for generating a file name of the image file;
Identification code generating means for generating an identification code representing the characteristics of the second image data;
An identification code adding means for adding the identification code generated by the identification code generating means to the file name generated by the first file name generating means, and a file name with the identification code added by the identification code adding means. File name recording control means for recording file name data to be recorded on the recording medium as representing the file name of the image file;
The image file generation device according to any one of claims 1 to 6, further comprising: A first recording area and a second recording area, each having a header recording area and an image data recording area, are defined such that the second recording area follows the first recording area. The first header data is recorded in the header recording area of the first recording area, the first image data is recorded in the image data recording area of the first recording area, and the second is recorded in the second header recording area. Are one image file in which the second image data having the same format as the format of the first image data is recorded in the second image data recording area, and the extension of the image file. From the recording medium on which extension data corresponding to the first image data is recorded as data representing the first image data, the first header data, and the expansion First reading means for reading the child data,
First reproduction means for reproducing the first image data read by the first reading means based on the header data and the extension data;
First display control means for controlling a display device to display a first image represented by first image data reproduced by the first reproduction means;
Determining means for determining whether the second header data and the second image data are recorded in the header area and the image data recording area of the second recording area;
When the determination means determines that the second header data and the second image data are recorded in the header area and the image data recording area of the second recording area, Second reading means for reading the second header data recorded in the header recording area of the recording area and the second image data recorded in the image data recording area of the second recording area;
The second image data read by the second reading means is represented by second reproducing means for reproducing based on the header data, and second image data reproduced by the second reproducing means. Second display control means for controlling the display device so as to display the second image to be displayed;
An image file playback device comprising: A specifying means for specifying the extension of the image file to be reproduced;
The first reading means reads the first image data recorded in the first image data recording area of the image file having the extension designated by the designation means.
The image file reproduction device according to claim 8.   10. The image file reproduction device according to claim 8, wherein data indicating that the second image data is recorded in the second recording area is recorded in the first image data. Data indicating that the second image data is recorded in the second recording area is embedded in the first image data by an electronic watermark,
Electronic watermark reproducing means for reproducing the embedded electronic watermark data, and a display device for displaying the second image presence information represented by the electronic watermark data reproduced by the electronic watermark reproducing means Third display control means for controlling
The image file reproducing device according to claim 8, further comprising: Generating first header data for given first image data;
Add the generated first header data to the top of the first image data,
Generating second header data for second image data to be given and having the same format as the format of the first image data;
Add the generated second header data to the top of the second image data,
The second header data is added following the first image data,
Write to a recording medium so that one image file is generated from the first image data to which the first header data is added and the second image data to which the second header data is added. ,
Recording data representing an extension determined based on the first image data on the recording medium as data representing an extension of the image file;
The first header data addition processing includes data indicating an address of the second header data in the image file, and recording presence / absence identification data indicating whether or not the second image data is recorded in the image file. , And at least one of image type identification data indicating whether the image represented by the second image data is a moving image or a still image is added to the first image data.
Image file generation method. A first recording area and a second recording area, each having a header recording area and an image data recording area, are defined such that the second recording area follows the first recording area. The first header data is recorded in the header recording area of the first recording area, the first image data is recorded in the image data recording area of the first recording area, and the second is recorded in the second header recording area. Are one image file in which the second image data having the same format as the format of the first image data is recorded in the second image data recording area, and the extension of the image file. From the recording medium on which extension data corresponding to the first image data is recorded as data representing the first image data, the first header data, and the expansion Read the child data,
The read first image data is reproduced based on the header data and the extension data,
Displaying a first image represented by the reproduced first image data on a display device;
Determining whether the second header data and the second image data are recorded in the header area and the image data recording area of the second recording area;
In response to the determination that the second header data and the second image data are recorded in the header area and the image data recording area of the second recording area, the header recording of the second recording area Reading the second header data recorded in the area and the second image data recorded in the image data recording area of the second recording area;
The read second image data is reproduced based on the header data,
Displaying a second image represented by the reproduced second image data on a display device;
Image file playback method.

Images