JP2007124150A - Apparatus and method for image processing, and for processing image data file, computer program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image data easy to divide, capable of improving operation speed by simplifying an image data managing method when outputting data of a plurality of compression systems, in a compatible manner with versatility of being reproducible even in an external device. <P>SOLUTION: An image processing apparatus 100 includes an image acquisition means for obtaining a first image data obtained by imaging an imaging object, a conversion means for converting the first image data into a second and a third image data, and a file generation means for generating a first image data file including the first to the third image data. With regard to each of the first to the third image data, the first image data file includes a header having first position information for identifying at least the start position of each image data, and second position information for identifying the start position of either one of the image data among the first to the third image data being positioned next in the first image data file. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing device, an image processing method, an image data file processing device, an image data file processing method, a computer program, and a storage medium.

  In recent years, digital cameras that generate files of photographed data using a plurality of compression methods have been put into practical use. It goes without saying that these digital cameras can generate JPEG images that can be handled by many general applications. In addition, there are many that can generate a so-called RAW type image (hereinafter referred to as “RAW image”) that is output without degrading the output from the image sensor. That is, by recording raw RAW images on the digital camera side and performing image reproduction (development) processing by an external device such as a personal computer, it is possible to achieve higher-quality prints and higher-level images that meet the user's purpose. Realizes image editing. Note that this RAW image may be compressed by a lossless compression method to reduce the amount of generated data.

  Here, JPEG is a compression standard mainly composed of irreversible conversion methods compiled by the International Organization for Standardization (ISO), which is a United Nations organization, and the International Telegraph and Telephone Consulting Organization (CCITT: now ITU-T). . Its extension is written as “XX.jpg”, and its name comes from the name of the study group “Joint Photograph Expert Group”.

  FIG. 6 is a diagram showing an outline of the data structure of DCF image data that can be output by a general digital camera. The DCF image data includes metadata called a DCF header portion 601, a thumbnail image portion 602, and a JPEG image between a marker (SOI marker) indicating the beginning of JPEG image data and a marker (EOI marker) indicating the end of JPEG image data. Part 603. Among these, in the DCF header portion 601, not only information standardized as DCF (Design rule for Camera File system) but also information unique to the manufacturer can be embedded. Note that the extension of such image data is expressed as “XX.jpg”.

  Next, FIG. 7 is a diagram showing an outline of the structure of RAW image data. In FIG. 7, the RAW image data includes a RAW header portion 701, a thumbnail image portion 702, a playback JPEG image portion 703, and a RAW image portion 704. The extension is written as “XX.RAW”. Since the RAW image data itself stored in the RAW image unit 704 has a large data size and is usually not suitable for image confirmation or the like, a thumbnail image unit 702 and a playback JPEG image unit 703 are provided, and an image for reference is provided. Often attached. In addition, the resolution, gradation, compression method, and the like of the RAW image vary depending on each manufacturer or device.

  The digital camera can generate desired image data by setting the user to output the DCF image data and / or the RAW image data. Here, when both can be output by one imaging, a method of outputting both the DCF image data and the RAW image data in FIG. 6 can be considered. As another method, there is a method of embedding a JPEG image in RAW image data. In this case, as shown in FIG. 8, the RAW image data is composed of a RAW header portion 801, a thumbnail image portion 802, a JPEG image portion 803 having a resolution designated by the user, and a RAW image portion 804 instead of the JPEG image for reproduction. (See Patent Document 1).

  However, in the case of RAW image data as shown in FIG. 7 and FIG. 8, not only the extension but also general-purpose data structures such as DCF image data and JPEG image data shown in FIG. There is a problem that cannot be edited.

  Also, when two image data (both DCF image data and RAW image data in FIGS. 7 and 8) are output in one shooting, the image that must be managed in the digital camera. The number of data increases. That is, twice as much image data management is required as compared with the case where only one image data (DCF image data or RAW image data in FIGS. 7 and 8) is output in one shooting.

  An increase in the number of image data to be managed leads to problems such as an increase in the amount of memory used and a decrease in operation speed when a digital camera system is constructed. In particular, when the DCF image data and the RAW image data are output with communication, the number of communication times is doubled in one shooting, resulting in extra overhead time.

  Here, with reference to FIG. 9, a description will be given by comparing the communication time when two image data are output in one shooting and the communication time when one image data is output. In FIG. 9, reference numeral 901 denotes a case where two image data are output in one shooting, and 902 denotes a case where one image data is output in one shooting.

  In the case of 901, when shooting is performed and image data is generated, communication for transmitting the image data is started at the timing t0. As a communication destination, for example, an external device such as a personal computer can be considered. In order to perform this communication, it is necessary to prepare for communication with the communication destination, so that a communication start overhead time (903) is generated in addition to the actual image data transmission time. The preparation for communication is completed, and the DCF image data is actually transmitted at the timing t1, and the time from t1 to t2 required for transmission is defined as a DCF image data communication time (905) here.

  In step S901, the DCF image data is transmitted first. However, the DCF image data does not necessarily have to be transmitted first, and the RAW image data may be transmitted first.

  Next, preparation for the end of communication with the communication destination is required at the timing t2 when the transmission of the DCF image data is completed, and therefore a communication end overhead time (904) occurs in addition to the DCF image data communication time (905). . Then, the DCF image data communication is completed at a timing t3 when preparation for communication completion is completed.

  When the DCF image data communication ends, preparation for communication with the communication destination is started at timing t3 in order to start communication for transmitting RAW image data. Thereby, apart from the actual transmission time of the RAW image data, the communication start overhead time (903) occurs again. RAW image data is actually transmitted at the timing of t4 when communication preparation is completed. Here, the time from t4 to t5 required for transmission is defined as a RAW image data communication time (906).

  Next, at the timing t5 when the transmission of the RAW image data is completed, it is necessary to prepare for the end of communication with the communication destination. Therefore, a communication end overhead time (904) occurs in addition to the RAW image data communication time (906). To do. Then, the RAW image data communication is completed at the timing t6 when the preparation for completion of communication is completed.

  In the case of 901, when the above series of processing ends, communication in the case of outputting two image data in one shooting is completed.

  On the other hand, in the case of 902, when shooting is performed and image data is generated, communication for transmitting the image data is started at timing t′0. As the communication destination, an external device such as a personal computer is conceivable as in the case of 901. In order to perform this communication, it is necessary to prepare for communication with the communication destination, so that a communication start overhead time (903) is generated separately from the actual image data transmission time. The communication preparation is completed and the DCF image data + RAW image data is actually transmitted at the timing of t′1, but the time from t1 ′ to t2 ′ required for transmission is the DCF image data + RAW image data communication here. It is defined as time (907).

  Next, since it is necessary to prepare for the end of communication with the communication destination at the timing t′2 when transmission of the DCF image data + RAW image data is completed, communication is performed separately from the DCF image data + RAW image data communication time (907). An end overhead time (904) occurs. Then, the DCF image data + RAW image data communication ends at the timing t′3 when the preparation for completion of communication is completed.

  Comparing the communication times 901 and 902, it can be seen that an increase in the number of times of communication creates extra overhead time (908), which causes a reduction in communication speed. That is, it can be said that an increase in the number of image data to be managed leads to a problem such as a decrease in operation speed in constructing a digital camera system.

  On the other hand, when a JPEG image is embedded in RAW image data as shown in FIG. 8, the number of image data managed by the digital camera does not increase, and thus the above-described influence on the speed does not occur. However, since the RAW image data transmitted as described above does not adopt a general-purpose data structure, it cannot be reproduced or edited by a general-purpose application. Therefore, the problem that a situation occurs in which a corner JPEG image cannot be reproduced even if it is embedded is the same.

Furthermore, image data after shooting is divided into DCF image data and RAW image data and managed in an external device, particularly a personal computer, which has a larger memory capacity and higher processing speed than digital cameras. If you want to. In this case, a JPEG image and a thumbnail image are cut out from the RAW image data, a header including shooting information is newly created based on the information in the RAW header portion, and a DCF image is added to the cut out JPEG image and the thumbnail image. Data will be created. This is a very complicated process, which leads to a problem that DCF image data and RAW image data cannot be easily divided.
JP 2003-244507 A

  SUMMARY OF THE INVENTION An object of the present invention is to achieve both improvement in operation speed by simplifying an image data management method at the time of outputting data of a plurality of compression methods and versatility that can be reproduced by an external device. It is another object of the present invention to provide image data that can easily divide a plurality of compression-type image data such as DCF image data and RAW image data.

  The present invention that solves the above-mentioned object as a whole or as a whole includes an image acquisition means for acquiring first image data obtained by imaging a subject to be imaged, and second and third image data as the first image data. An image processing apparatus comprising: a conversion unit that converts the first image data file; and a file generation unit that generates a first image data file including the first to third image data. For each of the first to third image data, at least first position information for specifying the start position of each image data, and the first to third positions next in the first image data file. A header portion including second position information for specifying a start position of any one of the image data.

  According to another aspect of the present invention, which achieves the above object in part or as a whole, the image data file processing apparatus converts the first image data file into a plurality of second image data files according to the second position information. Dividing means for dividing is provided.

  According to the present invention, it is possible to achieve both an improvement in operation speed by simplifying an image data management method when outputting data of a plurality of compression methods and versatility that can be reproduced even in an external device. Furthermore, it is possible to provide image data that can easily divide image data of a plurality of compression methods such as DCF image data and RAW image data.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
In FIG. 1, reference numeral 100 denotes an image processing apparatus according to this embodiment. The image processing apparatus 100 may be any one of a digital camera, a digital video camera, and a camera-equipped mobile terminal (including a camera-equipped mobile phone). Hereinafter, a case where the image processing apparatus 100 is a digital camera will be described.

  In the image processing apparatus 100, 10 is an imaging lens, 11 is a stop, 12 is a shutter, 14 is an image sensor that converts an optical image into an electrical signal, and 16 is an A / A that converts an analog signal output of the image sensor 14 into a digital signal. D converter. A timing generator 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the display controller 26, and is controlled by the memory controller 22 and the system controller 50.

Reference numeral 20 denotes an image processing unit which performs predetermined pixel interpolation processing and color processing on image data from the A / D converter 16 or image data from the memory control unit 22 based on processing data added to the image data. Perform the conversion process.
Further, the image processing unit 20 performs a predetermined calculation process using the image data output from the A / D converter 16. Based on the calculation result, the system control unit 50 performs TTL (through-the-lens) autofocus (AF) processing, automatic exposure (automatic exposure) on the shutter control unit 34, the aperture control unit 40, and the distance measurement control unit 42. AE) processing and strobe pre-flash (EF) processing are performed.

  Further, the image processing unit 20 performs predetermined calculation processing using the image data output from the A / D converter 16, and also performs TTL auto white balance (AWB) processing based on the obtained calculation result. ing.

  A memory control unit 22 controls the A / D converter 16, the timing generation unit 18, the image processing unit 20, the image display memory 24, the display control unit 26, the memory 30, and the compression / decompression unit 32. The image data output from the A / D converter 16 is written into the image display memory 24 or the memory 30 via the image processing unit 20, the memory control unit 22, or only through the memory control unit 22.

  Reference numeral 24 denotes an image display memory, 26 denotes a display control unit, and 28 denotes an image display unit having a TFT LCD (Liquid Crystal Display). The display image data written in the image display memory 24 is displayed on the image display unit 28 via the image display unit 26.

  If the image data captured using the image display unit 28 is sequentially displayed, the electronic viewfinder function can be realized. The image display unit 28 can be turned on or off according to an instruction from the system control unit 50. When the display of the image display unit 28 is turned off, the power consumption of the image processing apparatus 100 can be greatly reduced. Further, the image display unit 28 displays information related to focusing, camera shake, shutter speed, aperture value, exposure correction, and the like in accordance with instructions from the system control unit 50.

  Reference numeral 30 denotes a memory for storing captured still images and moving images, and has a storage capacity sufficient to store a predetermined number of still images and a predetermined time of moving images. Thereby, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, a large amount of images can be written in the memory 30 at high speed. The memory 30 can also be used as a work area for the system control unit 50. Further, the image data is read from the recording medium, which will be described later, into the memory 30, and the image data is written into the image display memory 24 via the image processing unit 20 and the memory control unit 22. Also used when displaying.

  Here, the outline of the configuration of the memory 30 is as shown in FIG. In FIG. 12, the memory 30 temporarily stores captured still images and moving images, in particular, an image storage buffer area 1201 for caching thumbnail images and JPEG images, and a work area for the system control unit 50. It consists of a work area 1202.

  A compression / decompression unit 32 compresses the image data read from the memory 30 into, for example, JPEG data according to a predetermined image compression method (for example, adaptive discrete cosine transform (ADCT)), and the compressed image data It has a function of writing to the memory 30. In addition, the image data read from the memory 30 is decompressed and the decompressed image data is written in the memory 30.

  Reference numeral 34 denotes a shutter control unit that controls the shutter 12, and reference numeral 40 denotes an aperture control unit that controls the aperture 11.

  Reference numeral 42 denotes a distance measurement control unit that controls focusing of the imaging lens 10, 46 denotes a strobe, and 48 denotes a strobe control unit that controls light emission of the strobe 46.

  A system control unit 50 controls the entire image processing apparatus 100. Reference numeral 52 denotes a memory such as a ROM for storing constants, variables, programs and the like for operation of the system control unit 50. The memory 52 stores a program for performing an imaging process, a program for performing an image process, a program for recording the created image file data on a recording medium, and a program for reading the image file data from the recording medium. Also recorded are various programs shown in the flow of FIGS. 3 to 5 described later, various programs such as an OS that implements and executes a multitask configuration of the above-described programs, and the like.

  A message queue is created in each program, and messages are stacked in the message queue in a FIFO manner. Each program is controlled in cooperation by exchanging messages between the programs, and the above functions are controlled. Yes.

  Reference numerals 60, 62, 64, 66, 67, 68, 69 denote operation means for inputting various operation instructions of the system control unit 50, such as switches, dials, touch panels, pointing by line-of-sight detection, voice recognition devices, and the like. Consists of a single or a plurality of combinations.

  Here, a specific description of these operating means will be given. Reference numeral 60 denotes a mode dial switch for switching and setting each function mode. This yesterday mode includes power ON / OFF, playback mode, automatic shooting mode, program shooting mode, shutter speed priority shooting mode, aperture priority shooting mode, manual shooting mode, portrait shooting mode, and landscape shooting mode. Also included are a close-up shooting mode, a sports shooting mode, a night scene shooting mode, a playback mode, a multi-screen playback / erase mode, an editing mode, a file read-only attribute change mode, a PC connection mode, and the like.

  Reference numeral 62 denotes a release switch SW1, which is turned on during the operation of a release button (not shown), and performs AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (strobe pre-flash) processing, and the like. Instruct to start operation.

  Reference numeral 64 denotes a release switch SW2, which is turned on when an operation of a release button (not shown) is completed, and instructs to start a series of processing operations. The process includes an exposure process in which a signal read from the image sensor 14 is written into the memory 30 via the A / D converter 16 and the memory control unit 22. Further, development processing using calculation in the image processing unit 20 and the memory control unit 22, and recording processing for reading the image data from the memory 30, performing image compression in the compression / decompression unit 32, and writing the image data in the recording medium 101 Is also included.

  Reference numeral 66 denotes a menu operation switch, which is composed of a combination of a menu key, a set key, a cross key (not shown), and the like to change various settings such as camera shooting conditions and development conditions and to display image files. This can be done while looking at the part 28. The menu operation switch 66 allows the photographer to set in advance whether or not to output RAW image data prior to shooting.

  Reference numeral 67 denotes an editing operation switch, which includes a combination of an editing key (not shown), a set key, a cross key, and the like, and can edit an image data file while viewing the image display unit 28.

  Reference numeral 68 denotes an erasing operation switch, which is composed of a combination of an erasing key (not shown), a cross key, and the like, and can erase an image data file while viewing the image display unit 28.

  Reference numeral 69 denotes a read-only attribute change operation switch, which is configured by a combination of a set key, a cross key, and the like (not shown).

  A power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like. Then, the presence / absence of a battery, the type of battery, the remaining battery level are detected, the DC-DC converter is controlled based on the detection result and the instruction of the system control unit 50, and the necessary voltage is recorded for a necessary period. To each part including

  Reference numeral 90 denotes an input / output interface with a recording medium such as a memory card or hard disk, and reference numeral 92 denotes a connector for connecting to a recording medium such as a memory card or hard disk.

  In the present embodiment, it is assumed that there is one interface and connector for attaching a recording medium. Of course, the interface and the connector for attaching the recording medium may have a single or a plurality of systems and any number of systems. Moreover, it is good also as a structure provided with combining the interface and connector of a different standard.

The interface and connector can be configured using a PCMCIA card, a compact flash (registered trademark) card, or the like that conforms to a standard.

When the interface 90 and the connector 92 are configured in accordance with a standard such as a PCMCIA card or a CF card, various communication cards are connected, and image data and attached management are performed with peripheral devices such as other computers and printers. Information can be transferred between each other. Various communication cards include, for example, LAN cards, modem cards, USB cards, IEEE 1394 cards, P1284 cards, SCSI cards, communication cards such as PHS, and the like.

  Reference numeral 101 denotes a recording medium such as a memory card or a hard disk. The recording medium 101 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, or the like, an interface 104 with the image processing apparatus 100, and a connector 106 that connects to the image processing apparatus 100.

  Next, the structure of image data corresponding to the embodiment of the present invention will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of a file structure of image data generated by the image processing apparatus 100 corresponding to the present embodiment. More specifically, when the image processing apparatus 100 is set to generate a DCF image data file including RAW image data, the image data in the memory 30 generated by the imaging process is recorded on the recording medium 101. An example of a data structure is shown.

  In the present embodiment, the image data file 200 has a DCF image data file format that is generally used in digital cameras. Accordingly, the image data file 200 is mainly composed of areas of a DCF image data section 210, a RAW image data section 220, a RAW thumbnail image data section 230, and a marker (EOI marker) 240 indicating the end of JPEG data.

  Hereinafter, the configuration of the DCF image data unit 210 will be described. The DCF image data unit 210 is an area in which image data that can be used when displaying for image confirmation or the like is stored in the digital camera of the present embodiment. In addition, since JPEG images that can be handled by many general applications are included, they can be used as image data that can be displayed by general-purpose applications.

  The DCF image data unit 210 includes a DCF header unit 211, a thumbnail image unit 212, and a JPEG image unit 213. The DCF header section 211 is an area for storing DCF header information, and is given a predetermined data size in advance. The DCF header information includes metadata A (214) such as shooting information and parameters related to the image data stored in the JPEG image portion 213. Further, an offset value B (215) to the thumbnail image, an offset value C (216) to the JPEG image, and an offset value D (217) to the next image data are also included.

  In the case of FIG. 2, the offset value D (217) indicates a start position (218) of a RAW image data portion (220) described later. That is, the offset values B, C, and D specify the start position of each image data or the next image data, that is, the delimiter between each data or header part.

  The thumbnail image unit 212 stores thumbnail images that are resized by thinning out JPEG images stored in the JPEG image unit 213 so as to be used when displaying a plurality of (index) images on the image display unit 28. It is an area. The JPEG image unit 213 is an area in which a JPEG image obtained by processing a RAW image with the image processing unit 20 and then compressing the RAW image is stored.

  Next, the configuration of the RAW image data unit 220 will be described. The RAW image data unit 220 is an area in which image data that is not used when displaying for image confirmation or the like by the digital camera in the present embodiment is stored. The RAW image data unit 220 is rather used to realize high-quality printing and more advanced image editing that matches the user's purpose by performing image reproduction (development) processing by an external device such as a personal computer. Is done.

  The RAW image data part 220 includes a RAW header part 221, a thumbnail image part 222, and a RAW image part 223. The RAW header portion 221 is an area for storing RAW header information, and is given a predetermined data size in advance. The RAW header information includes metadata A ′ (224) such as shooting information and parameters related to the image data stored in the RAW image unit 223. Further, an offset value B ′ (225) up to the thumbnail image, an offset value C ′ (226) up to the RAW image, and an offset value D ′ (227) up to the next image data are included.

  In the case of FIG. 2, the offset value D ′ (227) until the next image data indicates the start position (228) of the RAW thumbnail image data unit 230 described later. That is, the offset values B ′, C ′, and D ′ specify the start position of each image data or the next image data, that is, the delimiter between each data or header part.

  The thumbnail image unit 222 stores thumbnail images resized by thinning out JPEG images stored in the JPEG image unit 213 so as to be used when displaying a plurality of images (indexes) on the image display unit of the external device. It is an area to be done. Note that the thumbnail image portion 222 stores the same image as the thumbnail image stored in the thumbnail image portion 212.

  The RAW image unit 223 is an area in which a RAW image, which is image data having a large capacity before development and compression, read from the image sensor 14 is stored.

  Next, the RAW thumbnail image data unit 230 will be described. This is an area in which image data that is not used when displaying for image confirmation or the like with the digital camera in the present embodiment is stored. The RAW thumbnail image data unit 230 thins out the RAW image in order to efficiently display the image after the reproduction (development) process before performing the image reproduction (development) process for the RAW image data unit 220 in the external device. The resized image data. Further, since the data amount is small and the reproduction (development) process can be completed quickly, it is used for displaying a reproduction (development) preview image.

  The RAW thumbnail image data unit 230 includes a RAW thumbnail header unit 231, a thumbnail image unit 232, and a RAW thumbnail image unit 233. The RAW thumbnail header section 231 is an area for storing RAW thumbnail header information, and is given a predetermined data size in advance. The RAW thumbnail header information includes metadata A ″ (234) such as shooting information and parameters related to the image data stored in the RAW thumbnail image portion 233. Also, an offset value B ″ (235) to the thumbnail image. ), An offset value C ″ (236) up to the RAW thumbnail image and an offset value D ″ (237) up to the next image data.

  The offset value D ″ (237) up to the next image data is an offset value indicating that there is no image, for example, “0”, for example, since there is no next image in FIG. 2. This offset value B ″. , C ″ and D ″ specify the start position of each image data or the next image data, that is, the delimiter of each data or header part.

  The thumbnail image portion 232 stores thumbnail images that are resized by thinning out the JPEG images stored in the JPEG image portion 213 for use when displaying a plurality of (index) images on the image display portion of the external device. It is an area to be done. The thumbnail image portion 232 stores the same image as the thumbnail images stored in the thumbnail image portions 212 and 222. The RAW thumbnail image portion 233 is an area for storing a RAW thumbnail image that has been resized by thinning out a RAW image that is large-capacity image data before compression.

  In addition, since there is a marker (EOI marker) 240 indicating the end of the JPEG data after the RAW thumbnail image data portion 230, the validity as the DCF standard is maintained.

  By adopting such an image data file structure, there is no need to individually output DCF image data and RAW image data in one shooting, so that the number of image data to be managed in the digital camera can be reduced. By reducing the number of image data to be managed, it is possible to reduce the amount of memory used in the digital camera and improve the operation speed. In addition, the data structure of the image data file 200 corresponding to the present embodiment shown in FIG. 2 is a general-purpose data structure that retains the validity as the DCF standard, and therefore can be reproduced and edited by a general application.

  Next, an image data file recording operation according to the present embodiment will be described with reference to FIG. FIG. 3 is a flowchart for explaining an example of a series of sequences from shooting to image data file recording on the recording medium 101. This processing is realized by the system control unit 50 mainly executing a program corresponding to the flowchart shown in FIG. Note that the processes in FIGS. 4 and 5 to be described later, which describe a part of the processes in FIG. 3, are the same. Here, the case where the photographer has set the output of the RAW image data necessary for performing his / her favorite image processing by the operation of the menu operation switch 66 before and after the shooting is set. Both processes will be described.

  First, in step S301, as described above with reference to FIG. 1, in response to the operation of SW1 (62) and SW2 (64) constituting a release switch (not shown), AF processing, AE processing, and exposure processing are performed. A series of shooting processes are performed. Next, in step S302, it is determined whether or not the setting for outputting RAW image data has been made. If it is determined that the setting for outputting RAW image data has been made ("YES" in step S302), the process branches to step S303 and processing is performed. On the other hand, when it is determined that the setting for not outputting the RAW image data is made (“NO” in step S302), the process branches to step S304 and the process is performed.

  First, in step S <b> 303, an image data file 200 that is a DCF image data file including RAW image data is generated, and the generated image data file 200 is temporarily stored in the memory 30. Details of the DCF image data file generation processing including RAW image data in step S303 will be described later with reference to FIG.

  In step S <b> 304, generation processing of the image data file 200 that is a DCF image data file that does not include RAW image data is performed, and the generated image data file 200 is temporarily stored in the memory 30. Details of the DCF image data file generation process not including RAW image data in step S304 will be described later with reference to FIG.

  In step S305, the image data file 200 generated in step S303 or step S304 and temporarily stored in the memory 30 is written to the recording medium 101.

  Next, the DCF image data file generation process corresponding to step S303 in FIG. 3 will be described with reference to FIG. FIG. 4 is a flowchart corresponding to an example of generation processing for generating an image data file 200 that is a DCF image data file including RAW image data corresponding to the present embodiment.

  First, in step S <b> 401, the system control unit 50 secures the DCF header unit 211, the RAW header unit 221, and the RAW thumbnail header unit 231 in the work area 1202 of the memory 30 via the memory control unit 22.

  Next, in step S <b> 402, the system control unit 50 executes a shooting process for writing a shot RAW image in the image storage buffer area 1201 of the memory 30. This processing is performed via the A / D converter 16, the image processing unit 20, the memory control unit 22, or directly from the A / D converter 16 via the memory control unit 22.

  The system control unit 50 further reads out a RAW image in the image storage buffer area 1201 of the memory 30 using the memory control unit 22 and the image processing unit 20 as necessary. Then, a RAW thumbnail image generated by resizing the RAW image in the image storage buffer area 1201 of the memory 30 is generated and transferred to an empty area of the image storage buffer area 1201 of the memory 30. Further, WB (white balance) integration calculation processing and OB (optical black) integration calculation processing necessary for performing the development processing are performed, and the calculation result is stored in the internal memory or the memory 52 of the system control unit 50.

  In step S <b> 403, the system control unit 50 reads out a RAW image in the image storage buffer area 1201 of the memory 30 using the memory control unit 22 and the image processing unit 20 as necessary. Then, various development processes including an AWB (auto white balance) process, a gamma conversion process, and a color conversion process are performed using the calculation result stored in the internal memory of the system control unit 50 or the memory 52.

  In step S403, dark correction calculation processing for canceling dark current noise and the like of the image sensor 14 is also performed by performing subtraction processing using the dark image data captured in the dark capturing processing.

  In step S404, the system control unit 50 further reads out the result of processing the RAW image in the image storage buffer area 1201 of the memory 30, and the compression / decompression unit 32 performs image compression processing according to the set mode. In a succeeding step S405, the JPEG image and the thumbnail image that have been photographed and completed a series of processing are transferred to an empty area of the image storage buffer area 1201 of the memory 30.

  As described above, the DCF header, thumbnail image, JPEG image, RAW header, RAW image, RAW thumbnail header, and RAW thumbnail image are stored in the memory 30. In step S406, the system control unit 50 creates the image data file 200 in the image storage buffer area 1201 from these data. At this time, a marker (EOI marker) 240 indicating the end of the JPEG data is stored after the RAW thumbnail image portion 233 of the image data file 200.

  Further, in the DCF header section 211, metadata is created and set from metadata A (214) such as shooting information and parameters, and shooting information such as shutter speed and exposure time. Further, based on the data size, an offset value B (215) to the thumbnail image, an offset value C (216) to the JPEG image, and an offset value D to the next image data (in this case, to the RAW image data unit 220). (217) is also set.

  As described above, header information of the DCF header section 211 is generated. Thus, information (offset value D (217)) indicating the presence / absence and location of RAW image data is stored in the DCF header section 211. For example, if the offset value D (217) is “0”, the RAW image data is not stored in the image data file 200. However, in this case, since a predetermined offset value is given to the offset value D (217), the RAW image data is stored in the image data file 200, and the storage location is set to the offset value D (217). It can be specified by using.

  When indicating that RAW image data is not included in the image data file 200, not only “0” is set as the offset value, but also a predetermined value for indicating such a state may be set. . Further, by deleting the offset 217 itself from the DCF header section 211, it can be shown that the RAW image data is not included in the image data file 200.

  Similar to the DCF header portion, metadata is set in the RAW header portion 221 from shooting information such as shutter speed and exposure time in metadata A ′ (224) such as shooting information and parameters. Further, the offset value B ′ (225) to the thumbnail image, the offset value C ′ (226) to the JPEG image, and the offset value D ′ (227 to the RAW thumbnail image data unit 230 in this case) ) Is set. As described above, the header information of the RAW header portion 221 is generated.

  As a result, information (offset value D ′ (227)) indicating the presence / absence and location of RAW thumbnail image data is stored in the RAW header portion 221. For example, if the offset value D ′ (227) is “0”, the RAW thumbnail image data is not stored in the image data file 200. However, in this case, since a predetermined offset value is given to the offset value D ′, the RAW thumbnail image data is stored in the image data file 200, and the storage location is used using the offset value D ′. Can be identified. Note that the variation of the offset D ′ (227) when indicating that the RAW thumbnail image data is not stored in the image data file 200 is the same as the offset D (217).

  Similar to the DCF header part and the RAW header part, the RAW thumbnail header part 231 creates and sets metadata based on shooting information such as shutter speed and exposure time in metadata A ″ (234) such as shooting information and parameters. Further, an offset B ″ (235) to the thumbnail image, an offset C ″ (236) to the JPEG image, and an offset D ″ (237) to the next image data are set based on each data size. . The offset value D ″ (237) is set to “0” or a predetermined value indicating that the next image data does not exist. As described above, the header information of the RAW thumbnail header portion 231 is generated. Is done.

  Next, the DCF file generation process corresponding to step S304 in FIG. 3 will be described with reference to FIG. FIG. 5 is a flowchart illustrating an example of a generation process for generating an image data file 200 that is a DCF image data file not including RAW image data corresponding to the present embodiment.

  First, in step S <b> 501, a thumbnail image and a JPEG image are generated from the output data obtained by the shooting process according to the settings of the image processing and the compression method, and are temporarily stored in the memory 30.

  The processing here is the same as steps S401 to S405 in FIG. 4, but it is clear that unnecessary work area 1202 can be avoided by omitting creation of the RAW header portion 221 and the RAW thumbnail header portion 231. is there. In addition, it is clear that the work area can be avoided in vain by omitting the process of generating the RAW thumbnail image data by thinning and resizing the RAW image data.

  In step S502, metadata is created and set from the shooting information such as shutter speed and exposure time in the metadata A (214) such as shooting information and parameters in the DCF header section 211. Further, an offset value B (215) to the thumbnail image, an offset value C (216) to the JPEG image, and a next image data offset value D (217) are set based on each data size.

  Here, the RAW image data and the RAW thumbnail image data are not included in the image data file 200. Accordingly, RAW header information and RAW thumbnail header information are not generated, and the offset value D (217) is set to “0” or a predetermined value indicating that RAW image data is not included in the image data file 200. Is done. Further, when the RAW image data is not included in the image data file 200, it may be controlled not to generate the offset 217 itself.

  Next, in step S503, an image data file 200 that does not include RAW image data is generated from the generated DCF header portion 211, thumbnail image portion 212, and JPEG image portion 213.

  In the above embodiment, the case where the image data file 200 is recorded on the recording medium 101 has been described. However, image data and management information attached to the image data are transferred to / from peripheral devices such as other computers and printers. The same is true for matching.

  Particularly in the case of transferring each other, by using such an image data file structure, it is not necessary to individually output DCF image data and RAW image data in one shooting, so that the number of image data to be transferred can be reduced. it can. As a result, overhead time 908 associated with transfer as indicated by reference numeral 901 in FIG. 9 can be reduced. On the other hand, since the data structure of the image data file 200 generated by the processes of FIGS. 3 to 5 is a general-purpose data structure that retains the validity as the DCF standard, it can be reproduced and edited in a general application. It is.

  Next, processing when the image data file 200 corresponding to the present embodiment is divided will be described.

  As described above, when separately managing DCF image data and RAW image data in an external device after shooting, the image data file 200 must be divided. An external device as such an image data file processing device corresponds to an external device, particularly a personal computer, which has a larger memory capacity for image management and a higher processing speed than a digital camera system.

  Hereinafter, an example of processing when the image data file 200 corresponding to the present embodiment is divided in an external apparatus such as a personal computer will be described with reference to FIG. Such processing is realized in the external device by reading a program corresponding to the flowchart of FIG. 10 stored in the internal storage device of the external device into the RAM and executing it by the CPU as the arithmetic device. Is.

  The hardware configuration of the external device is as shown in FIG. 13, for example. In FIG. 13, the CPU 1301 controls the external device 1200 using programs, data, and the like stored in a RAM (Random Access Memory) 1302 and a ROM (Read Only Memory) 1305. The RAM 1302 has an area for reading a processing program stored in the internal storage device 1307 and corresponding to the flowcharts of FIGS. 10 and 11 described below, and also has a work area used when the CPU 1301 executes various processes. Prepare.

  The input unit 1303 is a user interface for receiving an input from the user of the external device 1300, and includes a keyboard and a mouse. A communication interface (I / F) 404 is an interface for connecting to the Internet 103 or the like. The ROM 1305 stores a program for controlling the entire external device 1300 (for example, a boot program). A display unit 1306 is a display for displaying RAW image data and DCF image data, and includes a CRT or a liquid crystal screen.

  The internal storage device 1307 is mainly composed of a hard disk, and stores programs and various application data for performing the processing shown in FIGS. 10 and 11 corresponding to this embodiment. The data stored here is read out to the RAM 1302 as necessary. A bus 1310 is a bus connecting the above-described units.

  Returning to the description of FIG. 10, first, in step S1001, it is determined whether or not the offset value D (217) up to the next image data exists in the DCF header section 211. If it does not exist (“NO” in step S1001), the image data file 200 has no RAW image data and cannot be divided. On the other hand, when the offset value D (217) exists (“YES” in step S1001), the process proceeds to step S1002, and it is determined whether the offset value D (217) is a valid value. Here, “effective value” means a value other than “0” as described above or a predetermined value indicating that RAW image data is not included in the image data file 200.

  If the offset value D (217) is not a valid value (“NO” in step S1002), it can be determined that there is no RAW image data in the image data file 200, and thus this division process ends as it is. On the other hand, if the offset value D (217) is a valid value, the process proceeds to step S1003, and the image data file 200 is divided at the position indicated by the arrow 218 in FIG. 2 based on the offset value D (217). Is done. At this time, the image data to which the reference position of the offset position 217 (the position where the offset value is 0) belongs is the DCF image data.

  In step S1004, a marker (EOI marker) indicating the end of the JPEG data is added to the DCF image data obtained by the division in step S1003. Thereafter, this process is terminated. It should be noted that the other image data generated by the division (the RAW image data still has the EOI marker 240 attached thereto, so that an appropriate data structure is maintained even by the division.

  In this way, the image data file 200 having the image data file structure corresponding to the present embodiment can be easily divided into DCF image data and RAW image data by the external device 1300. Further, since the divided DCF image data and RAW image data include shooting information, that is, header portions (211 and 221) and thumbnail image portions (212 and 222), respectively, the validity as the DCF standard is maintained. It will be.

  Next, a process for further dividing the RAW image data file divided by the dividing process in FIG. 10 into RAW image data and RAW thumbnail image data will be described with reference to FIG.

  First, in step S1101, it is determined whether or not an offset value D ′ (227) up to the next image data exists in the RAW header 221. If it does not exist (“NO” in step S1101), the RAW image data file does not contain RAW thumbnail image data and cannot be divided, and thus this processing is terminated.

  On the other hand, if the offset value D ′ (227) exists, the process proceeds to step S1102, and it is determined whether the offset value D ′ (227) is a valid value. Here, as in the case of FIG. 10, the “effective value” means a value other than “0” or a predetermined value indicating that RAW thumbnail image data is not included in the RAW image data file. If the offset value D ′ (227) is not a valid value (“NO” in step S1102), it can be determined that RAW thumbnail image data is not included in the RAW image data file, and thus the process ends. . On the other hand, if the offset value D ′ (227) is a valid value (“YES” in step S1102), the process proceeds to step S1103. In step S1103, the RAW image data file is divided at the position indicated by the arrow 228 in FIG. 2 based on the position of the offset value D ′ (227). At this time, the image data to which the reference position of the offset position 227 (the position where the offset value is 0) belongs is RAW image data.

  In step S1104, a marker (EOI marker) indicating the end of the JPEG data is added to the RAW image data obtained by the division in step S1103. Thereafter, this process is terminated. It should be noted that the other image data generated by the division (the RAW thumbnail image data is still provided with the EOI marker 240, so that an appropriate data structure is maintained by the division.

  In this manner, the image data file 200 having the image data file structure corresponding to the present embodiment can be easily divided into DCF image data, RAW image data, and RAW thumbnail image data by the external apparatus 1300. . Further, the divided DCF image data, RAW image data, and RAW thumbnail image data all include shooting information, that is, header portions (211, 221 and 231) and thumbnail image portions (212, 222 and 232). Therefore, the validity as the DCF standard is maintained.

  As described above, the invention corresponding to the present embodiment relates to an image processing apparatus capable of generating photographing data by a plurality of compression methods. In the present invention, by including images of other compression methods in JPEG data, the number of image data management at the time of data output by a plurality of compression methods can be reduced, and general-purpose data that can be reproduced by an external device such as a personal computer. It becomes possible to make the sex compatible. On the other hand, it is also possible to easily divide image data by a plurality of compression methods.

  Furthermore, according to the present invention, even when recording RAW image data that differs between manufacturers and devices, the RAW image data is attached and recorded while maintaining the validity as JPEG image data that can be reproduced by an external device such as a personal computer. it can. Further, the JPEG image data and RAW image data can be easily divided after recording.

  Furthermore, when both JPEG image data and RAW image data are output, since there is no image data output multiple times by one shooting, the total number of management data decreases, thereby increasing the number of shots that can be shot, This has the effect of reducing the transfer time.

[Other Embodiments]
Note that the present invention can be applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, and a printer), and a device (for example, a copying machine and a facsimile device) including a single device. You may apply to.

  The object of the present invention can also be achieved by supplying a storage medium storing software program codes for realizing the above-described functions to the system, and the system reading and executing the program codes. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. In addition, an operating system (OS) running on a computer performs part or all of actual processing based on an instruction of the program code, and the above-described functions are realized by the processing.

  Furthermore, you may implement | achieve with the following forms. That is, the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. Then, based on the instruction of the program code, the case where the above-described functions are realized by the CPU included in the function expansion card or the function expansion unit performing part or all of the actual processing is also included.

  When the present invention is applied to the storage medium, the storage medium stores program codes corresponding to the flowcharts described above.

It is a figure which shows an example of a structure of the image processing apparatus corresponding to embodiment of this invention. It is a figure which shows an example of the DCF image data file structure containing the RAW image data produced | generated with the image processing apparatus corresponding to embodiment of this invention. It is a flowchart which shows an example of the imaging | photography sequence corresponding to embodiment of this invention. It is a flowchart which shows an example of the DCF image data file production | generation process containing RAW image data in the imaging | photography sequence corresponding to embodiment of this invention. It is a flowchart which shows an example of the DCF image data file generation process which does not contain RAW image data in the imaging | photography sequence corresponding to embodiment of this invention. It is a figure which shows an example of a general purpose DCF image data file structure. It is a figure which shows an example of the conventional RAW image data structure. It is a figure which shows an example of the RAW image data structure containing the conventional JPEG image data. It is a figure for demonstrating the overhead time by the difference in the frequency | count of communication. It is a flowchart which shows an example of the process which divides | segments the image data file in embodiment of this invention into DCF image data and RAW image data. It is a flowchart which shows an example of the process which divides | segments the RAW image data file of the image data file into RAW image data and RAW thumbnail image data in embodiment of this invention. It is a figure which shows the outline of a structure of the memory 30 corresponding to embodiment of this invention. It is a figure which shows an example of the hardware constitutions of the external device corresponding to embodiment of this invention.

Claims (14)

Image acquisition means for acquiring first image data obtained by imaging the imaging target;
Conversion means for converting the first image data into second and third image data;
File generating means for generating a first image data file including the first to third image data,
The first image data file includes, for each of the first to third image data, at least first position information for specifying a start position of each image data, and next in the first image data file. And a second position information for specifying a start position of any one of the first to third image data located in the image processing apparatus. The converting means further converts any of the first to third image data into fourth image data,
The first image data file further includes the fourth image data at the same relative position with respect to each of the first to third image data, and each of the first to third image data. The image processing apparatus according to claim 1, wherein the corresponding header portion includes third position information for specifying a start position of the fourth image data.   The first image data is RAW type image data, the second and third image data are compressed image data and RAW type thumbnail image data that have been reproduced, and the fourth image data. The image processing apparatus according to claim 2, wherein the thumbnail image data is a compressed thumbnail image data that has been reproduced.   4. Image data, comprising: a dividing unit that divides the first image data file according to claim 1 into a plurality of second image data files according to the second position information. File processing device.   The plurality of second image data files each include any one of the first to third image data included in the first image data file to be divided. The image data file processing apparatus according to claim 4.   The dividing means includes determination means for determining whether or not the start position of the image data can be specified based on the second position information in the first image data file, and the start position can be specified. 6. The image data file processing apparatus according to claim 4, wherein the division is performed based on a position based on the second position information. An image acquisition step of acquiring, in the image acquisition unit, first image data obtained by imaging the imaging target;
A conversion step of converting the first image data into second and third image data in a conversion unit;
A file generation step of generating a first image data file including the first to third image data in a file generation unit;
The first image data file includes, for each of the first to third image data, at least first position information for specifying a start position of each image data, and next in the first image data file. And a second position information for specifying a start position of any one of the first to third image data positioned in the image processing method. In the conversion step, any one of the first to third image data is converted into fourth image data by the conversion unit,
The first image data file further includes the fourth image data at the same relative position with respect to each of the first to third image data, and each of the first to third image data. The image processing method according to claim 7, further comprising third position information for specifying a start position of the fourth image data in the corresponding header part.   The first image data is RAW type image data, the second and third image data are compressed image data and RAW type thumbnail image data that have been reproduced, and the fourth image data. 9. The image processing method according to claim 8, wherein is a compressed thumbnail image data that has been reproduced.   An image comprising a dividing step of dividing the first image data file according to claim 7 into a plurality of second image data files according to the second position information in an image data file processing apparatus. Data file processing method.   The plurality of second image data files each include any one of the first to third image data included in the first image data file to be divided. The image data file processing method according to claim 10.   The dividing step includes a determination step of determining whether or not the start position of the image data can be specified based on the second position information in the first image data file, and the start position can be specified. 12. The image data file processing method according to claim 10, wherein the division is performed based on a position based on the second position information.   A computer program for causing a computer to execute the method according to claim 7.   A computer-readable storage medium storing the computer program according to claim 13.

Images