JP2006287588A - Image processing apparatus and method, data file structure, computer program, and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide image data which can make compatible size reduction in outputting data of a plurality of compression schemes and versatility for reproduction using a personal computer or the like. <P>SOLUTION: The image processing apparatus comprises an image acquisition means for acquiring first image data resulting from photographing an object to be photographed, a conversion means for converting the first image data into second and third image data, and a file generating means for generating an image data file containing the first to the third image data. The image data file contains first position information for specifying the starting position of the first image data in the image data file and is generated so as to position the first image data between the text of the second image data and a code indicating the end of the second image data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image processing method, a data file structure, a computer program, and a storage medium.

  In recent years, digital cameras that generate files of photographed data using a plurality of compression methods have been put into practical use. These digital cameras can be handled by many general applications. JPEG (Collaborated by the International Organization for Standardization (ISO), the United Nations organization, and the International Telegraph and Telephone Consultative Organization (CCITT: now ITU-T)) Compression standard mainly for lossy conversion method.The extension is written as “XX.jpg” and its name is derived from the name of the study group “Joint Photograph Expert Group”.) Needless to say, it can generate data, Many of them can generate so-called RAW data output without deteriorating the output from the image sensor. Note that this RAW data may be compressed by a lossless compression method to reduce the amount of generated data.

  FIG. 6 is a diagram showing an outline of the structure of DCF data that can be output by the most digital cameras at present. As shown in FIG. 6, DCF data includes metadata called a DCF header portion 601, a thumbnail image portion 602, between a marker (SOI marker) indicating the beginning of JPEG data and a marker (EOI marker) indicating the end of JPEG data. A JPEG image portion 603 is included. Among them, the DCF header 601 can embed not only information standardized as DCF (Design rule for Camera File system) but also information unique to the manufacturer. The extension is written as “XX.jpg”.

  Next, FIG. 7 is a diagram showing an outline of the structure of RAW data. In FIG. 7, the RAW data includes a RAW header portion 701, a thumbnail image portion 702, a reproduction JPEG image portion 703, and a RAW data portion 704. The extension is often written as "XX.RAW". Since the RAW data itself stored in the RAW data portion 704 has a large amount of data and is not usually suitable for image confirmation etc., a thumbnail image portion 702 and a playback JPEG image portion 703 are provided and a reference image is attached. There are many. In addition, the resolution, gradation, compression method, etc. of RAW data differ depending on each manufacturer or device.

In recent digital cameras, it is possible to generate desired data by setting the user to output the above DCF data and / or RAW data. In particular, when both can be output by one shooting, there is a method of outputting two of DCF data and RAW data. That is, this is a method for outputting both the DCF data of FIG. 6 and the RAW data of FIG. Another method is to embed a JPEG image in RAW data. In this case, as shown in FIG. 8, the RAW data is composed of a RAW header portion 801, a thumbnail image portion 802, a JPEG image portion 803 having a resolution designated by the user, and a RAW data portion 804 instead of the reproduction JPEG image. (See Patent Document 1).
JP 2003-244507 A

  However, the RAW data as shown in FIGS. 7 and 8 is not limited to the extension, and unlike the general-purpose data structures such as DCF data and JPEG data shown in FIG. There's a problem.

  Also, when outputting both DCF data and RAW data in a single shooting, header information including the necessary metadata for each, and the same image may be included in both files, the overall data size There is a problem that increases. For example, when both DCF data having the structure of FIG. 6 and RAW data having the structure of FIG. 7 are output, the thumbnail image portions 602 and 702 overlap, and the playback JPEG image portion 703 is the JPEG image portion 603. It is useless because it can be substituted. Such duplication and waste leads to problems such as a decrease in the number of images that can be taken and an increase in recording and transfer time.

  In addition, when a JPEG image is embedded in RAW data as shown in FIG. 8, there is no data size problem. However, as described above, RAW data is not a general-purpose data structure. The problem is that editing cannot be performed, and even if a JPEG image is embedded, it cannot be played back.

  The present invention has been made to solve the above-described problems, and provides image data that can achieve both size reduction when outputting data of a plurality of compression methods and versatility that can be reproduced by a personal computer or the like. Objective.

  In order to solve the above problems, the present invention provides image acquisition means for acquiring first image data obtained by imaging a subject to be imaged, and converts the first image data into second and third image data. Conversion means and file generation means for generating an image data file including the first to third image data, wherein the image data file specifies a start position of the first image data in the image data file And the first image data is generated so that the first image data is positioned between the main body of the second image data and a code indicating the end of the second image data. It is characterized by that.

  According to the present invention, it is possible to provide image data that can achieve both size reduction when outputting data of a plurality of compression methods and versatility that can be reproduced by a personal computer or the like.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
In FIG. 1, reference numeral 100 denotes an image processing apparatus according to this embodiment. The image processing apparatus 100 may be any one of a digital camera, a digital video camera, and a camera-equipped mobile terminal (including a camera-equipped mobile phone). Hereinafter, a case where the image processing apparatus 100 is a digital camera will be described.

  In the image processing apparatus 100, 10 is an imaging lens, 11 is a stop, 12 is a shutter, 14 is an image sensor that converts an optical image into an electrical signal, and 16 is an A / A that converts an analog signal output of the image sensor 14 into a digital signal. D converter. A timing generator 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the display controller 26, and is controlled by the memory controller 22 and the system controller 50.

  Reference numeral 20 denotes an image processing unit which performs predetermined pixel interpolation processing and color processing on image data from the A / D converter 16 or image data from the memory control unit 22 based on processing data added to the image data. Perform the conversion process. The image processing unit 20 performs predetermined calculation processing using the image data output from the A / D converter 16, and the system control unit 50 controls the shutter control unit 34 and aperture control based on the obtained calculation result. The TTL (through-the-lens) type autofocus (AF) process, automatic exposure (AE) process, and strobe pre-flash (EF) process are performed on the unit 40 and the distance measurement control unit 42. Further, the image processing unit 20 performs predetermined calculation processing using the image data output from the A / D converter 16, and also performs TTL auto white balance (AWB) processing based on the obtained calculation result. ing.

  A memory control unit 22 controls the A / D converter 16, the timing generation unit 18, the image processing unit 20, the image display memory 24, the display control unit 26, the memory 30, and the compression / decompression unit 32. The image data output from the A / D converter 16 is written into the image display memory 24 or the memory 30 via the image processing unit 20, the memory control unit 22, or only through the memory control unit 22.

  Reference numeral 24 denotes an image display memory, 26 denotes a display control unit, and 28 denotes an image display unit having a TFT LCD (Liquid Crystal Display). The display image data written in the image display memory 24 is displayed on the image display unit 28 via the image display unit 26.

  If the image data captured using the image display unit 28 is sequentially displayed, the electronic viewfinder function can be realized. The image display unit 28 can be turned on or off according to an instruction from the system control unit 50. When the display of the image display unit 28 is turned off, the power consumption of the image processing apparatus 100 can be greatly reduced. Further, the image display unit 28 displays information related to focusing, camera shake, shutter speed, aperture value, exposure correction, and the like in accordance with instructions from the system control unit 50.

  Reference numeral 30 denotes a memory for storing captured still images and moving images, and has a storage capacity sufficient to store a predetermined number of still images and a predetermined time of moving images. Thereby, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, a large amount of images can be written in the memory 30 at high speed. The memory 30 can also be used as a work area for the system control unit 50. Further, the image data is read from the recording medium, which will be described later, into the memory 30, and the image data is written into the image display memory 24 via the image processing unit 20 and the memory control unit 22. Also used when displaying.

  Here, the outline of the configuration of the memory 30 is as shown in FIG. In FIG. 15, the memory 30 temporarily stores captured still images and moving images, and in particular, an image storage buffer area 1501 for caching thumbnail images and JPEG images, and thumbnail images cached in the image storage buffer 1501. A thumbnail image cache list 1502 for listing information, a JPEG image cache list 1503 for listing information of JPEG images cached in the image storage buffer area 1501, and a work area 1504 as a work area of the system control unit 50. .

  32 is a function and memory for compressing image data read out from the memory 30 into, for example, JPEG data according to a predetermined image compression method (for example, adaptive discrete cosine transform (ADCT), etc.), and writing the compressed image data into the memory 30 The compression / decompression unit has a function of decompressing image data read from the memory 30 and writing the decompressed image data into the memory 30.

  Reference numeral 34 denotes a shutter control unit that controls the shutter 12, and reference numeral 40 denotes an aperture control unit that controls the aperture 11. Reference numeral 42 denotes a distance measurement control unit that controls focusing of the imaging lens 10, 46 denotes a strobe, and 48 denotes a strobe control unit that controls light emission of the strobe 46.

  A system control unit 50 controls the entire image processing apparatus 100. Reference numeral 52 denotes a memory such as a ROM that stores constants, variables, programs, and the like for operation of the system control unit 50. Realizes and executes a multi-task configuration of the program to be recorded in the program, a program for reading the image file data from the recording medium, various programs shown in the flow of FIGS. 3 to 5, 9 to 11, and FIG. Various programs such as OS to be recorded are recorded. A message queue is created for each program, messages are stacked in the message queue in a FIFO (First In First Out) manner, and each program is controlled in cooperation by exchanging messages between each program. Control is being performed.

  Reference numerals 60, 62, 64, 66, 67, 68, 69 denote operation means for inputting various operation instructions of the system control unit 50, such as switches, dials, touch panels, pointing by line-of-sight detection, voice recognition devices, and the like. Consists of a single or a plurality of combinations.

  Here, a specific description of these operating means will be given.

  Reference numeral 60 denotes a mode dial switch that turns on / off the power, playback mode, automatic shooting mode, program shooting mode, shutter speed priority shooting mode, aperture priority shooting mode, manual shooting mode, portrait shooting mode, landscape shooting mode, and close-up shooting mode. It is possible to switch and set each function mode such as a sports shooting mode, a night scene shooting mode, a playback mode, a multi-screen playback / erase mode, an editing mode, a file read-only attribute change mode, and a PC connection mode.

  Reference numeral 62 denotes a release switch SW1, which is turned on during the operation of a release button (not shown), and performs AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (strobe pre-flash) processing, and the like. Instruct to start operation.

  A release switch SW2 is turned on when a release button (not shown) is operated, and an exposure process of writing image data to the memory 30 via the A / D converter 16 and the memory control unit 22 when the signal read from the image sensor 14 is read. , A series of development processes using operations in the image processing unit 20 and the memory control unit 22, a recording process of reading out image data from the memory 30, compressing the image in the compression / decompression unit 32, and writing the image data in the recording medium 100. Instructs the start of processing operation.

  Reference numeral 66 denotes a menu operation switch, which is composed of a combination of a menu key, a set key, a cross key (not shown), and the like to change various settings such as camera shooting conditions and development conditions and to display image files. This can be done while looking at the part 28.

  Reference numeral 67 denotes an editing operation switch, which includes a combination of an editing key (not shown), a set key, a cross key, and the like, and can edit an image data file while viewing the image display unit 28.

  Reference numeral 68 denotes an erasing operation switch, which is composed of a combination of an erasing key (not shown), a cross key, and the like, and can erase an image data file while viewing the image display unit 28.

  Reference numeral 69 denotes a read-only attribute change operation switch, which is configured by a combination of a set key, a cross key, and the like (not shown).

  A power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like. In addition, the DC-DC converter is controlled based on an instruction from the system control unit 50, and a necessary voltage is supplied to each unit including the recording medium for a necessary period.

  Reference numeral 90 denotes an input / output interface with a recording medium such as a memory card or hard disk, and reference numeral 92 denotes a connector for connecting to a recording medium such as a memory card or hard disk.

  In the present embodiment, it is assumed that there is one interface and connector for attaching a recording medium. Of course, the interface and the connector for attaching the recording medium may have a single or a plurality of systems and any number of systems. Moreover, it is good also as a structure provided with combining the interface and connector of a different standard.

  The interface and connector can be configured using a PCMCIA card, a compact flash (registered trademark) card, or the like that conforms to a standard. When the interface 90 and the connector 92 are configured using a PCMCIA card, a CF card or the like conforming to a standard such as a LAN card, a modem card, a USB card, an IEEE 1394 card, a P1284 card, a SCSI card, a PHS, etc. By connecting these various communication cards, image data and management information attached to the image data can be transferred to and from other computers and peripheral devices such as a printer.

  Reference numeral 100 denotes a recording medium such as a memory card or a hard disk. The recording medium 100 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, or the like, an interface 104 with the image processing apparatus 100, and a connector 106 that connects to the image processing apparatus 100.

  Next, the structure of the image data file corresponding to this embodiment will be described with reference to FIG. FIG. 2 shows an image when the image processing apparatus corresponding to the present embodiment is set to generate a DCF file including RAW data, and image data in the memory 30 created by shooting processing is recorded on the recording medium 101. It is a figure which shows an example of the structure of a data file.

  In the present embodiment, the image data file 200 is a DCF file format that is generally used in digital cameras, and is roughly divided into a DCF header portion 201, a thumbnail image portion 202, a JPEG image portion 203, a RAW header portion 204, and a RAW data portion. 209 and a marker (EOI marker) 210 indicating the end of JPEG data.

  Here, the DCF header section 201 is an area for storing DCF header information, and is given a predetermined data size in advance. The DCF header information includes metadata such as shooting information and parameters related to the image data stored in the JPEG image unit 203, an offset value A (205) to the JPEG image, and an offset to the RAW header unit 204. A value B (206) and an offset value D (207) to the thumbnail image are included. The offset values A, B, and D specify the start positions of the image data and the header part, that is, the delimiters of the data and the header part. The thumbnail image unit 202 is an area for storing a thumbnail image that has been resized by thinning out the JPEG image stored in the JPEG image unit 203 to be used when displaying a plurality of (index) images on the image display unit 28. It is. The JPEG image unit 203 is an area for storing JPEG image data obtained by processing the RAW data with the image processing unit 20 and then compressing the RAW data.

  The RAW header section 204 is an area for storing RAW header information, and is given a predetermined data size in advance. The RAW header information includes shooting information of RAW data, metadata such as parameters, and an offset value C (208) to the RAW data. The position of the RAW data in the image data file 200 can be specified by the offset value B and the offset value C. The RAW data unit 209 is an area for storing RAW data, which is image data read from the image sensor 14 and having a large capacity before development / compression. Since the RAW data has a marker (EOI marker) 210 indicating the end of the JPEG data, the validity as the DCF format is maintained. Further, information on the presence or absence of RAW data or information on the RAW header section 204 indicating the position of RAW data may be stored in the DCF header section 201. In that case, the offset value B is a value representing an offset to the RAW data.

  For reference, the data size when the image sensor 14 having 8 million pixels outputs both the DCF data of FIG. 2 as the present embodiment and the DCF data of FIG. 6 as the conventional example and the RAW data of FIG. 7 is compared. The size of the DCF header portions 201 and 601 and the RAW header portions 204, 701, and 801 is about 10 KB, the size of the thumbnail image portions 202, 602, 702, and 802 is about 10 KB, the JPEG image portions 203 and 803 are about 4 MB, and the playback JPEG The image part is about 2 MB as the resolution of 1/2 of the JPEG image, and the RAW data part is about 6 MB. In this case, the size is about 10 MB in this embodiment and about 12 MB in the conventional example, and a size reduction of about 2 MB is achieved. As a result, according to the present embodiment, it is possible to output image data files for six sheets, which is one sheet larger than the conventional data amount for five sheets. In the above description, the embodiment in which the image processing apparatus of the present invention generates a DCF file (image data file 200) including RAW data is described. However, the present invention is not limited to RAW data. It goes without saying that the embodiment of generating a DCF file (image data file 200) including the result as a bitmap data without compressing the result is also effective.

  Furthermore, since the start position of each image data and header part is specified by the offset values A, B, and D included in the DCF header information, for example, RAW (or bitmap) header part 204 and RAW (or bitmap) data The unit 209 may be immediately after the DCF header unit 201 or the thumbnail image unit 202.

  Next, an image data file recording operation in the present embodiment will be described with reference to FIG. FIG. 3 is a flowchart for explaining a series of sequences from shooting to image data file recording on the recording medium 100. Here, regarding the processing when the photographer has previously set the output of the RAW data necessary for performing his / her favorite image processing by the operation of the menu operation switch 66 before photographing, and when not so, I am explaining.

  First, in step S301, as described above with reference to FIG. 1, in response to the operation of SW1 (62) and SW2 (64) constituting a release switch (not shown), AF processing, AE processing, and exposure processing are performed. A series of shooting processes are performed.

  Next, in step S302, it is determined whether or not the setting for outputting RAW data has been made. If it is determined that the setting for outputting RAW data has been made (“YES” in step S302), the process branches to step S303 and processing is performed. On the other hand, if it is determined that the setting for not outputting RAW data has been made ("NO" in step S302), the process branches to step S304 and the process is performed.

  In step S <b> 303, the image data file 200 that is a DCF file including RAW data is generated, and the generated image data file 200 is temporarily stored in the memory 30. Details of the DCF file generation processing including RAW data will be described later with reference to FIG. In step S304, a DCF file (image data file 200) that does not include RAW data is generated, and the generated image data file 200 is temporarily stored in the memory 30. Details of the DCF file generation process not including RAW data will be described later with reference to FIG.

  In step S305, a process of writing the image data file 200 generated in step S303 or step S304 and temporarily stored in the memory 30 to the recording medium 100 is performed.

  Next, the DCF file generation process corresponding to step S303 in the flowchart of FIG. 3 will be described with reference to FIG. FIG. 4 is a flowchart corresponding to an example of a generation process for generating a DCF file (image data file 200) including RAW data, corresponding to the present embodiment.

  First, in step S 401, the DCF header part 201 and the RAW header part 204 are secured in the work area 1504 of the memory 30 via the memory control part 22. Next, in step S402, the image storage buffer of the memory 30 through the A / D converter 16, the image processing unit 20, the memory control unit 22, or directly from the A / D converter 16 through the memory control unit 22. A photographing process for writing the photographed RAW data in the area 1501 is executed.

  The system control unit 50 reads out the RAW data in the image storage buffer area 1501 of the memory 30 through the memory control unit 22 and performs WB (white balance) integration calculation processing, OB (optical black) necessary for developing processing. ) Perform integral calculation processing and store the calculation result in the internal memory of the system control unit 50 or the memory 52.

  In step S403, the system control unit 50 reads out the RAW data in the image storage buffer area 1501 of the memory 30 using the memory control unit 22 and, if necessary, the image processing circuit 20, and the system control unit. Various development processes including AWB (auto white balance) processing, gamma conversion processing, and color conversion processing are performed using the calculation results stored in the internal memory 50 or the memory 52. In step S403, dark correction calculation processing for canceling dark current noise and the like of the image sensor 14 is also performed by performing subtraction processing using the dark image data captured in the dark capturing processing.

  In step S404, the system control unit 50 further reads out the result of processing the RAW data in the image storage buffer area 1501 of the memory 30, and performs image compression processing according to the set mode by the compression / decompression circuit 32. In step S <b> 405, the JPEG image and the thumbnail image that have been photographed and completed a series of processing are transferred to an empty area in the image storage buffer area 1501 of the memory 30.

  In step S406, the system control unit 50 creates the image data file 200 in the image storage buffer area 1501 from the DCF header, thumbnail image, JPEG image, RAW header, and RAW data stored in the memory 30. At this time, a marker (EOI marker) 210 indicating the end of the JPEG data is stored after the RAW data portion 209 of the image data file 200. Also, an offset 205 to the JPEG image, an offset 206 to the RAW header 204 and an offset 207 to the thumbnail image are set in the DCF image header 201, and an offset 208 to the RAW data is set in the RAW header 204.

  More specifically, metadata is generated from shooting information such as shutter speed and exposure time for thumbnail images, JPEG images, and RAW data temporarily stored in the image storage buffer area 1501, and further, based on each data size. Offsets 205-208 are generated. As a result, DCF header information and RAW header information are generated and set in the DCF header part 201 and the RAW header part 204, respectively.

  As a result, information (offset 206) indicating the presence / absence and location of RAW data is stored in the DCF header section 201. For example, if the offset value B of the offset 206 is “0” (or a predetermined value indicating that RAW data is not included in the image data file 200, otherwise, the offset 206 itself is the DCF header section 201. RAW data is not stored in the image data file 200. In this case, since a predetermined offset value is given to the offset value B, the RAW data is stored in the image data file. 200, and the storage location can be specified using the offset value B.

  Next, the DCF file generation process corresponding to step S304 in the flowchart of FIG. 3 will be described with reference to FIG. FIG. 5 is a flowchart corresponding to an example of a generation process for generating a DCF file (image data file 200) that does not include RAW data, corresponding to the present embodiment.

  First, in step S <b> 501, a thumbnail image and a JPEG image are generated from the output data obtained by the shooting process according to the settings of the image processing and the compression method, and are temporarily stored in the memory 30. The processing here is the same as steps S401 to S405 in FIG.

  In step S502, metadata is generated from shooting information such as shutter speed and exposure time for thumbnail images and JPEG images temporarily stored in the memory 30, and offsets 205 to 207 are generated based on each data size. The As a result, DCF header information is generated and temporarily stored in the memory 30. Here, since the RAW data is not included in the image data file 200, the RAW header information is not generated, and the offset value B stored in the offset 206 is “0” or the RAW data is in the image data file 200. Is set to a predetermined value indicating that it is not included. Further, when the RAW data is not included in the image data file 200, it may be controlled not to generate the offset 206 itself.

  Next, in step S503, each area of the DCF header part 201, the thumbnail image part 202, and the JPEG image part 203 is generated based on the thumbnail image, JPEG image, and DCF header information temporarily stored in the memory 30, and the RAW data Is generated.

  In the present embodiment, the case where the image data file is recorded on the recording medium 100 has been described. However, the image data and the management information attached to the image data may be transferred to / from other computers and peripheral devices such as a printer. It is the same.

  As described above, the invention corresponding to the present embodiment relates to an image processing apparatus that can generate shooting data by a plurality of compression methods. By including images of other compression methods in JPEG data, a plurality of images can be obtained. It is possible to achieve both size reduction when outputting data in the compression method and versatility that can be reproduced by a personal computer or the like.

  More specifically, according to the image processing apparatus corresponding to the present embodiment, the validity of JPEG data that can be played back by a personal computer or the like is maintained even in the recording of RAW data, which differs depending on the manufacturer and device. RAW data can be attached and recorded. Furthermore, when both JPEG data and RAW data are output, header information and thumbnail images are not duplicated, so the overall data size is reduced, increasing the number of shootable images and recording / transferring. This has the effect of reducing time.

[Second Embodiment]
The image processing apparatus corresponding to the embodiment of the present invention may be configured not to cache the display image or the main image in the internal memory. However, in this case, since the image file is read from the recording medium each time during reproduction, the display image or the main image is extracted and displayed, it takes time for reproduction.

  On the other hand, the image processing apparatus can be configured to cache the display image and the main image in the internal memory to speed up the reproduction. In this case, in order to extract the JPEG image from the image data file, a marker indicating the start is searched from the data of the JPEG image, and all subsequent data can be cut out and cached. However, if one image data file is composed of multiple image data such as thumbnail images, JPEG images, and RAW data, it is necessary to cache the entire image data file or all the data after the JPEG image during playback after shooting. Since even RAW data with no data is cached together, there is a problem that the available capacity is reduced and the number of images that can be cached is greatly reduced, so that the memory cannot be used efficiently.

  Therefore, in the present embodiment, an image data file in a DCF file format including thumbnail images, JPEG images, RAW data, and headers storing offsets to the respective images, generated corresponding to the first embodiment is used. In addition, it is possible to independently extract a plurality of image data included in the image data file, and by separating only the display image or the main image by separating the development image that is not necessary for reproduction, A description will be given of an invention that enables quick reproduction after shooting to improve the use efficiency of a memory.

  Hereinafter, cache update processing in the memory 30 in the image processing apparatus corresponding to the present embodiment will be described with reference to FIG. FIG. 9 is a flowchart corresponding to an example of the cache update process corresponding to the present embodiment. Here, in the memory 30, the thumbnail image cache list 1502 and the JPEG image are stored as independent caches each including JPEG images, thumbnail images and DCF header information constituting the image data file 200, or data including a part of the parameters. It is managed by the cache list 1503, and the cache update method is common. The cache update process will be described below by taking a thumbnail image cache as an example.

  When image data is transferred to the image storage buffer area 1501 of the memory 30 at the time of shooting or reproduction, the system control unit 50 determines whether or not the memory 30 is free in step S901. If it is determined that there is a free space in the memory 30 (“YES” in step S901), the flow advances to step S903 to write a thumbnail image in the free space and information on the thumbnail image in the thumbnail image cache list 1502 Add On the other hand, if it is determined that there is no space in the image storage buffer area 1501 (“NO” in step S901), the thumbnail image stored in the head (older one) of the thumbnail image cache list 1502 in step S902 is displayed as an image. In step S903, the thumbnail image is written in the newly created empty area, and the information of the image transferred to the predetermined area in the memory 30 is newly added to the cache list, and the cache is released from the storage buffer area 1501. Also update the list.

  With the above processing, even when the memory 30 has no free space, the memory 30 can be efficiently used by refilling the cache. Also, by releasing from the top (older one) of the cache list when refilling, since the newer image data is displayed during playback, the cache hit rate is increased and high-speed playback is possible.

  Next, with reference to FIG. 10, the cache processing at the time of shooting in the image processing apparatus corresponding to the present embodiment will be described. FIG. 10 is a flowchart corresponding to an example of the cache processing operation at the time of shooting in the image processing apparatus corresponding to the present embodiment.

  First, in step S1001, when the user of the image processing apparatus presses the release switch SW2 (64) to perform shooting, the system control unit 50 reads out an image pickup signal that has been picked up and accumulated for a predetermined time from the image pickup device 14. . Hereinafter, steps S1002 to S1007 are the same as steps S401 to S406 in FIG.

  In step S <b> 1008, the system control unit 50 writes to the recording medium 101 via the interface 90 and the connector 92.

  In step S1009, the system control unit 50 adds the thumbnail image information of the image data file 200 in the image storage buffer area 1501 to the thumbnail image cache list 1502, and then in step S1010, adds the JPEG image information to the JPEG image. Add to the cache list 1503 and update the cache list.

  Through the above processing, when it is desired to display a photographed image immediately after photographing, the image display unit 28 displays the thumbnail image information in the thumbnail image cache list 1502 or the JPEG image information in the JPEG image cache list 1503. Therefore, it is possible to instantly acquire image data for this purpose. Finally, in step S1011, the area corresponding to the RAW header section 204 and the RAW data section 205 in the image storage buffer area 1501 is released, so that a memory for RAW data having a large capacity is freed. It is possible to cache thumbnail images and JPEG images, and the memory usage efficiency can be improved.

[Third Embodiment]
In the present embodiment, an operation at the time of reproducing an image file created by the processing procedure in the second embodiment and stored in the recording medium 101 will be described.

  FIG. 11 is a flowchart for explaining the operation at the time of reproduction of an image file in the image processing apparatus corresponding to the present embodiment.

  In FIG. 11, when the user of the image processing apparatus receives an instruction to reproduce an image file through the operation of the menu operation switch 66, the system control unit 50 instructs the reproduction from the thumbnail image cache list 1502 of the memory 30 in step S1101. Search for thumbnail images corresponding to. In step S1102, it is determined whether or not the search for the target thumbnail image has succeeded. If the search has succeeded (“YES” in step S1102), the process proceeds to step S1007. On the other hand, if the search fails, that is, if the target thumbnail image is not found (“NO” in step S1102), the recording medium 101 is connected via the interface 90 and the connector 92 in step S1103. In the image data file 200, the DCF header part 201 is read into the image storage buffer area 1501 of the memory 30.

  In step S1104, the system control unit 50 analyzes the read DCF header unit 201, and the system control circuit 50 determines the value A stored in the offset 205 to the JPEG image based on the DCF header unit 201, the RAW header unit. The value B stored in the offset 206 up to 204 and the value D stored in the offset 207 up to the thumbnail image unit 202 are acquired. Further, the RAW header section 204 is read from the storage medium 101 based on the offset value B, and the value C stored in the offset 208 up to the RAW data is acquired. However, since the offset value C is not necessary when index reproduction is performed, it may be acquired when displaying a JPEG image described later.

  In step S1105, based on the acquired offset values A and D, only the thumbnail image stored in the thumbnail image portion 202 is extracted from the image data file 200 in the storage medium 101, and in the subsequent step S1106, FIG. Based on the update processing to be performed, the information is stored in the image storage buffer area 1501 and information on the thumbnail image is added to the thumbnail image cache list 1502.

  In step S1107, it is determined whether there are a plurality of thumbnail images (indexes) to be reproduced. If it is determined that a plurality of images are to be displayed (“YES” in step S1107), the process proceeds to step S1112 to determine whether or not the required number of thumbnail images has been cached. If it is determined that the necessary number of sheets is cached (“YES” in step S1112), the process proceeds to step S1113, and the cached image is transferred to the image via the memory control unit 22. Write to display memory 24. In step S 1114, the image data written in the image display memory 24 is displayed by the image display unit 28 via the display control unit 26.

  On the other hand, if it is determined to display one image (“NO” in step S1107), in step S1108, the system control unit 50 searches the JPEG image cache list 1503 in the memory 30 for a JPEG image that is symmetrically reproduced. To do. If the target JPEG image is found (“YES” in step S1109), the process proceeds to step S1113, and the cached JPEG image is written to the image display memory 24 via the memory control unit 22, In step S1114, the image display unit 28 displays an image.

  On the other hand, when the target JPEG image is not found (“NO” in step S1109), in step S1110, if acquired in step S1104, the storage medium is based on the offset values A, B, and C. The RAW header part 204 and the RAW data part 209 are cut out from the image data file 200 in 101 to read out only the JPEG image. In step S1111, the system control unit 50 stores the read JPEG image in the image storage buffer area 1501 according to the cache update process corresponding to FIG. 9, and stores information on the JPEG image in the JPEG image cache list 1503. to add. Thereafter, the process proceeds to step S1113, the above-described process is executed, and the process is terminated.

  With the above processing, when reproducing a plurality of images (indexes), it is possible to omit the processing of acquiring only the thumbnail image from the storage medium 101 and acquiring the JPEG image, so that it is possible to shorten the time until displaying on the TFT. It becomes. In addition, when reproducing a JPEG image, not only the offset of the JPEG image but also the offset of the RAW data is known. Therefore, it is possible to read out only the JPEG image from the storage medium 101 by discarding excess data other than the JPEG image. Read time can be shortened. In addition, since only the JPEG image can be cached in the memory 30, the memory efficiency can be improved.

[Fourth Embodiment]
In the second and third embodiments described above, thumbnail images other than RAW data and JPEG images are read out to the image storage buffer area 1501 and then added to the cache list. A case where the user can select the type of image to be added in advance using a UI (user interface) will be described.

  12 and 13 are diagrams illustrating examples of UI screens corresponding to the present embodiment. FIG. 14 is a flowchart corresponding to an example of processing for selecting an image to be cached using a UI screen in the image processing apparatus corresponding to the present embodiment. Hereinafter, a flow of processing for selecting an image to be cached in the present embodiment will be described with reference to FIGS.

  First, in step S1401, when the user accepts an operation of the menu operation switch 66 (“YES” in step S1401), in step S1402, the system control unit 50 displays a menu screen 1201 corresponding to FIG. 12 on the image display unit 28. indicate.

  In FIG. 12, a plurality of items are displayed as selectable items. In step S1403, it is determined whether or not “cache image selection 1202” has been selected by operating the menu operation switch 66 on the menu screen 1201. If it is determined that “cache image selection 1202” has been selected (“YES” in step S1403), an image list display screen 1301 as shown in FIG. 13 is displayed on the image display unit 28 in step S1404. .

  On the other hand, if it is determined that an item other than “cache image selection 1202” has been selected (“NO” in step S1403), the process proceeds to step S1407, and a screen corresponding to the selected item is displayed and predetermined. After executing the process, the process is terminated.

  In step S1405, based on the operation of the menu operation switch 66, it is determined whether or not the image 1303 is selected on the image list display screen 1301. If it is determined that one of the images 1303 has been selected (“YES” in step S1405), in step S1406, the image corresponding to the image type 1303 for which selection has been accepted in the image list display screen 1301. A mark is displayed in the check box 1302. A plurality of image type designations can be accepted. In this case, a plurality of image types are cached.

  Through the above processing, according to the present embodiment, the user can select in advance the type of image to be cached in the memory 30, and, for example, when bitmap data is selected in advance as a cache target. Since the time for reading from the recording medium 100 and processing during enlargement playback is reduced, high-speed and high-definition image display is possible.

[Other Embodiments]
Note that the present invention can be applied to a system including a plurality of devices (for example, a host computer, an interface device, a digital camera, and the like), and an apparatus (for example, a digital camera and a digital video camera) including a single device. You may apply to.

  Another object of the present invention is to supply a storage medium (or recording medium) in which a program code of software that realizes the functions of the above-described embodiments is recorded to a system or apparatus, and the computer (or CPU or CPU) of the system or apparatus. Needless to say, this can also be achieved by the MPU) reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Furthermore, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function is based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion card or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

It is a figure which shows an example of a structure of the image processing apparatus corresponding to the 1st Embodiment of this invention. It is a figure which shows an example of the DCF file structure containing the RAW data produced | generated with the image processing apparatus corresponding to the 1st Embodiment of this invention. It is a flowchart explaining an example of the imaging | photography sequence corresponding to the 1st Embodiment of this invention. 6 is a flowchart for explaining an example of a DCF file generation process including RAW data in a shooting sequence corresponding to the first embodiment of the present invention. 6 is a flowchart illustrating an example of a DCF file generation process that does not include RAW data in a shooting sequence corresponding to the first embodiment of the present invention. It is a figure which shows an example of a general purpose DCF file structure. It is a figure which shows an example of the conventional RAW data structure. It is a figure which shows an example of the RAW data structure containing the conventional JPEG data. It is a flowchart corresponding to an example of the cache update process corresponding to the 2nd Embodiment of this invention. It is a flowchart corresponding to an example of the cache process at the time of imaging | photography in the image processing apparatus corresponding to the 2nd Embodiment of this invention. It is a flowchart explaining the operation | movement at the time of the reproduction | regeneration of an image file in the image processing apparatus corresponding to the 3rd Embodiment of this invention. It is a figure which shows an example of UI screen corresponding to the 4th Embodiment of this invention. It is a figure which shows an example of UI screen corresponding to the 4th Embodiment of this invention. It is a flowchart corresponding to an example of the process which selects the image to cache corresponding to the 4th Embodiment of this invention. It is a figure which shows the outline of a structure of the memory 30 corresponding to embodiment of this invention.

Claims (25)

Image acquisition means for acquiring first image data obtained by imaging the imaging target;
Conversion means for converting the first image data into second and third image data;
File generating means for generating an image data file including the first to third image data,
The image data file includes first position information for specifying a start position of the first image data in the image data file, and the main body of the second image data and the second image data An image processing apparatus, wherein the first image data is generated so as to be positioned between a code indicating the end of the first image data. A setting receiving means for receiving a setting as to whether or not to include the first image data in the image data file;
The file generation unit generates the image data file including the first image data when receiving a setting including the first image data from the setting reception unit. The image processing apparatus described.   The image processing apparatus according to claim 1, wherein the file generation unit generates the image data file in accordance with a DCF format.   The second image data is JPEG image data obtained by compressing and encoding the first image data after image processing, and the third image data is the JPEG image data or the first image data. 2. Thumbnail image data obtained by reducing an image processing result, and the image data file includes the third image data, the second image data, and the first image data in this order. Item 4. The image processing apparatus according to any one of Items 1 to 3. First storage means for temporarily storing the image data file and the image list;
Second storage means for storing the temporarily stored image data file;
After the image data file temporarily stored in the first storage means is stored in the second storage means, information on the second and third image data is added to the image list, and the first The image processing apparatus according to claim 1, further comprising a control unit that deletes the first image data from the storage unit. Reproduction instruction receiving means for receiving an instruction to reproduce image data included in the image data file stored in the second storage means;
Search means for searching for information of image data for which the reproduction instruction has been accepted in the image list;
A reading unit that reads out the corresponding image data from the first storage unit when information of the image data for which the reproduction instruction has been received is included in the image list;
6. The image processing apparatus according to claim 5, further comprising display means for displaying the read image data. The image data file further includes second and third position information for specifying the positions of the second and third image data in the image data file,
The image processing apparatus includes:
Reproduction instruction receiving means for receiving a reproduction instruction for the third image data included in the plurality of image data files stored in the second storage means;
Search means for searching for information of the third image data that has received the reproduction instruction in the image list;
When the information of the image data for which the reproduction instruction has been received is not included in the image list, the second and third position information is obtained from the second storage means, and the second and third position information is acquired. Reading means for reading only the third image data for which the reproduction instruction has been received based on position information from the second storage means to the first storage means;
Display means for displaying the third image data;
The image processing apparatus according to claim 5, wherein the control unit adds the information of the third image data read out to the first storage unit to the image list. The image data file further includes second and third position information for specifying the positions of the second and third images in the image data file;
The image processing apparatus includes:
Reproduction instruction receiving means for receiving a reproduction instruction for the second image data included in the image data file stored in the second storage means;
Search means for searching for information of the second image data that has received the reproduction instruction in the image list;
When the information of the image data for which the reproduction instruction has been received is not included in the image list, the first and second position information is acquired from the second storage means, and the first and second position information are acquired. Reading means for reading only the second image data for which the reproduction instruction has been received based on position information from the second storage means to the first storage means;
Display means for displaying the second image data;
The image processing apparatus according to claim 5, wherein the control unit adds the information of the second image data read to the first storage unit to the list of images. An image type accepting unit for accepting an image type to be added to the image list;
The image processing apparatus according to claim 5, wherein the control unit adds only image information corresponding to the type received by the image type reception unit to the image list. An image acquisition step of acquiring first image data obtained by shooting a shooting target;
A conversion step of converting the first image data into second and third image data;
A file generation step of generating an image data file including the first to third image data,
The image data file includes first position information for specifying a start position of the first image data in the image data file, and the main body of the second image data and the second image data An image processing method, wherein the first image data is generated such that the first image data is positioned between the first code data and a code indicating the end of the first image data. A setting reception step for receiving a setting as to whether or not to include the first image data in the image data file;
The said file generation process produces | generates the said image data file containing the said 1st image data, when the setting which includes the said 1st image data is received from the said setting reception process. The image processing method as described.   12. The image processing method according to claim 10, wherein the file generation step generates the image data file according to a DCF format.   The second image data is JPEG image data obtained by compressing and encoding the first image data after image processing, and the third image data is the JPEG image data or the first image data. 2. Thumbnail image data obtained by reducing an image processing result, and the image data file includes the third image data, the second image data, and the first image data in this order. The image processing method according to any one of 10 to 12. A first storage step of temporarily storing the image data file and the image list in a first storage unit;
A second storage step of storing the temporarily stored image data file in a second storage unit;
After the image data file temporarily stored in the first storage unit is stored in the second storage unit, the information of the second and third image data is added to the image list, and the first The image processing method according to claim 10, further comprising a control step of deleting the first image data from the storage step. A reproduction instruction receiving step for receiving an instruction to reproduce image data included in the image data file stored in the second storage unit;
A search step of searching for information of image data for which the reproduction instruction has been accepted in the image list;
A step of reading out the corresponding image data from the first storage unit when information on the image data for which the reproduction instruction has been received is included in the image list;
The image processing method according to claim 14, further comprising a display step of displaying the read image data. The image data file further includes second and third position information for specifying the positions of the second and third image data in the image data file,
The image processing method includes:
A reproduction instruction receiving step of receiving an instruction to reproduce the third image data included in the plurality of image data files stored in the second storage unit;
A search step of searching for information of the third image data that has received the reproduction instruction in the image list;
When the information of the image data for which the reproduction instruction has been received is not included in the image list, the second and third position information is acquired from the second storage unit, and the second and third position information is acquired. A reading step of reading only the third image data for which the reproduction instruction has been received based on position information from the second storage unit to the first storage unit;
A display step of displaying the third image data,
The image processing method according to claim 14, wherein in the control step, information of the third image data read out to the first storage unit is added to the list of images. The image data file further includes second and third position information for specifying the positions of the second and third image data in the image data file,
The image processing method includes:
A reproduction instruction receiving step for receiving a reproduction instruction for the second image data included in the image data file stored in the second storage unit;
A search step of searching for information of the second image data that has received the reproduction instruction in the image list;
When the information of the image data for which the reproduction instruction has been received is not included in the image list, the first and second position information is acquired from the second storage unit, and the first and second position information is acquired. A reading step of reading only the second image data for which the reproduction instruction has been received based on position information from the second storage unit to the first storage unit;
A display step of displaying the second image data,
The image processing method according to claim 14, wherein in the control step, information of the second image data read to the first storage unit is added to the list of images. An image type accepting step for accepting an image type to be added to the image list;
18. The image processing method according to claim 14, wherein in the control step, only information on an image corresponding to the type received in the image type reception step is added to the image list. Image acquisition means for acquiring first image data obtained by imaging the imaging target;
Conversion means for converting the first image data into second and third image data;
File generating means for generating an image data file including the first to third image data,
The image data file includes first position information for specifying a start position of the first image data in the image data file, and the end of the first position information and the second image data An image processing apparatus, wherein the first image data is generated so as to be positioned between a reference sign indicating the position of the first image data. An image acquisition step of acquiring first image data obtained by shooting a shooting target;
A conversion step of converting the first image data into second and third image data;
A file generation step of generating an image data file including the first to third image data,
The image data file includes first position information for specifying a start position of the first image data in the image data file, and the end of the first position information and the second image data An image processing method, wherein the first image data is generated such that the first image data is located between the first code data and the reference code indicating the number. Conversion means for converting the input first image data into second and third image data;
File generating means for generating an image data file including at least the second image data and the third image data;
The image data file includes first information regarding the presence of the first image data, and second information indicating the end of the second image data, and further includes the first information in the image data file. A control means for controlling the file generation means so that the first image data is stored between the first information and the second information when including image data. A featured image processing apparatus. Conversion means for converting the input first image data into second and third image data;
Determining means for determining whether to generate an image data file including the first image data;
If it is determined by the determining means that the image data file including the first image data is not generated, the second image data, the third image data, and the end of the second image data are terminated. Generating an image data file including first information to be shown;
When it is determined by the determination means that an image data file including the first image data is generated, the second image data, the third image data, and the second image data indicating the end of the second image data are displayed. An image data file including the first information and the first image data located before the first information. An image data file structure generated by the image processing apparatus according to any one of claims 1 to 4, 19, 21, and 22.   A computer program for causing a computer to execute the image processing method according to any one of claims 10 to 18 and 20.   A computer-readable storage medium storing the computer program according to claim 24.

Images