JP2010051035A - Apparatus and method for processing image storage, and recording processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To facilitate storage processing of a file including main image data and sub-image data. <P>SOLUTION: Prior to generating the file including the main image data and the sub-image data from a picked-up image, an imaging apparatus 1 sets the number of sheets of sub-images to be included in the file (step SA2). A main image header 101 is then generated to which a sub-image identification IFD setting region corresponding to the set number of sub-images is set (step SA3). When a recording instruction is detected thereafter (step SA5: Yes), main image data and sub-image data are generated and the sub-image identification IFD setting region is modified (steps SA6-SA8). When sub-image data are generated for the set number or a filing instruction is detected, the file is generated and recorded in an image recording part 8 (steps SA9-SA11). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image storage processing apparatus, an image recording processing method, and a recording processing program for storing an image as a file.

  2. Description of the Related Art Conventionally, in an apparatus that records a captured image as a file, such as an imaging device, when recording an image, a camera file system standard (Design rule Camera File system, hereinafter referred to as DCF standard) or a combination thereof is used. It has been generally performed to file and record in an Exif (Exchangeable image file format for digital camera) format.

  Various improvement techniques have been devised in the process up to the file creation. As an example, for example, after shooting, main image data, uncompressed sub-image data, and compressed sub-image data are generated, and then the size of the main image data is determined. That is, when the resolution of the main image data is not high, a technique has been devised for reducing the file size by generating a file including the main image data and the compressed sub-image data (Patent Document).

JP 2000-261756 A

As described above, various improvement techniques have been proposed for image file forming techniques.
However, since the conventional filing technique is considered on the premise that only the main image data and the sub-image data are included in the same file for a single image, for example, a plurality of images taken continuously, 2 to For panoramic images generated by combining three images and a plurality of images taken from multiple viewpoints, a file corresponding to the number of images is generated, and these generated files are associated with each other. It takes time and effort to generate a management area other than the above and associate a plurality of image files in the management area.

  In addition, when trying to store and manage a plurality of image data in one file in order to solve such a problem, every time image data is newly added to this file or deleted. However, since the file system is changed, the problem that storage management of image files becomes complicated is expected.

  The present invention has been made in view of the above problems, and an object of the present invention is to facilitate storage processing of a file including main image data and sub image data.

  According to the first aspect of the present invention, there is provided an imaging unit, a first storage unit that temporarily stores an image captured by the imaging unit, and at least main image data from the image stored in the first storage unit, And first data generating means for generating sub-image data, second storage means for storing each image data generated by the first data generating means as one file, and this second storage means. Management area setting means for securing a predetermined number of pieces of management information of the sub-image data stored in the same file as the main image data in the management area of the main image data, and the second First storage control means for controlling to store the file on the basis of the contents set by the management area setting means when storing the file in the storage means. .

  According to a second aspect of the present invention, in the first aspect of the present invention, the image data is generated from at least one of the image captured by the imaging unit, the main image data, and the sub-image data. Whether the image data generated by the second data generation means can be included in the file as new sub-image data based on the number of management information set by the data generation means and the management area setting means When the first determination means determines that the file can be included in the file, the image data generated by the second data generation means is used as the sub-image data. A second storage control means for additionally storing in the second storage means and for controlling to rewrite the contents of the management area. And butterflies.

  According to a third aspect of the present invention, in the second aspect of the present invention, a display means for displaying an image based on a file stored in the second storage means, and a new image for the image displayed on the display means. First instruction means for instructing generation of sub-image data, and the second data generation means responds to an instruction by the first instruction means to display an image displayed on the display means. New image data is generated from main image data or sub-image data of a corresponding file.

  According to a fourth aspect of the present invention, in the second aspect of the invention, a display unit that displays an image based on a file stored in the second storage unit, and a sub-image of the image displayed on the display unit. A first instruction means for instructing generation of data, and an imaging control means for controlling the imaging means to take an image in order to newly acquire image data in response to an instruction by the first instruction means; The second data generation unit generates new image data from the image captured by the imaging control unit.

  According to a fifth aspect of the present invention, in the first aspect of the present invention, the display means for displaying an image based on the file stored in the second storage means, and the image displayed on the display means are deleted. Second instruction means for instructing, second determination means for determining whether an image instructed by the second instruction means is an image based on main image data or an image based on sub-image data, and this second determination When the image instructed to be deleted by the means is an image based on the sub-image data, the sub-image data is deleted from the file including the sub-image data, and the contents of the management area of the file are rewritten. And third storage control means.

  According to a sixth aspect of the present invention, in the first aspect of the present invention, a display unit that displays an image based on the image data stored in the second storage unit, and an image displayed on the display unit are not displayed. Third instruction means for instructing display, third determination means for determining whether an image instructed to be non-displayed by the third instruction means is an image based on main image data or an image based on sub-image data, When the image for which deletion has been instructed by the third determination means is an image based on the sub-image data, information for hiding the image based on the sub-image data is displayed in the management area of the file including the sub-image data. And a fourth storage control means for controlling writing.

  The invention according to claim 7 is the selection means for selecting whether to delete or hide the image displayed on the display means in the inventions according to claims 5 and 6, and the selection means. When the deletion of the image is selected by the step, the second instruction means is executed, and when the non-display of the image is selected, an execution control means is further provided for controlling the execution of the third instruction means. It is characterized by.

  The invention according to claim 8 includes the main image data in the case where the image instructed to be deleted by the second determination means is an image based on the main image data. An informing means for informing that the file itself is to be deleted, a detecting means for detecting the execution of the deletion in response to the informing by the informing means, and detecting the execution of the deletion by the detecting means, the second storage means And fifth storage control means for controlling to delete the file itself storing the main image data corresponding to the displayed image.

  The invention according to claim 9 is the invention according to any one of claims 2 to 8, wherein when the image is displayed on the display means, the capacity of a file including image data corresponding to the image is displayed together with the image. The image display apparatus further includes first display control means for controlling display.

  A tenth aspect of the present invention is the invention according to any one of the second to eighth aspects, wherein when an image is displayed on the display means, a file including image data corresponding to the image has sub-image data. The display device further includes third display control means for controlling the number of images to be displayed together with the image.

  According to an eleventh aspect of the present invention, in the tenth aspect of the present invention, the third display control unit further displays the number of sub-image data corresponding to a preset area of the management area. It is characterized by controlling.

  According to a twelfth aspect of the present invention, in the invention according to any one of the second to eighth aspects, the first data generation unit further generates thumbnail image data from the image stored in the first storage unit. The sub-image data is data having the same resolution as the main image data or a resolution larger than the thumbnail image data and smaller than the main image data.

  According to a thirteenth aspect of the present invention, there is provided a first storage step for storing a captured image in a first memory, and at least main image data and sub-image data from the image stored in the first storage step. A first data generation step for generating the image data, a second storage step for storing each image data generated in the first data generation step in the second memory as one file, and the second storage A management area setting step of securing a predetermined number of pieces of management information of the sub-image data stored in the same file as the main image data in the step, and setting the management information in the management area of the main image data. The second storing step stores the file in the second memory based on the contents set in the management area setting step. And features.

  According to a fourteenth aspect of the present invention, there is provided a computer having an image storage processing apparatus, a first storage unit for storing a captured image in a first memory, and at least a main image from an image stored by the first storage unit. First data generation means for generating data and sub-image data, second storage means for storing each image data generated by the first data generation means in a second memory as one file, Management area setting means for securing a predetermined number of pieces of management information of the sub image data stored in the same file as the main image data by the second storage means, and setting the management information in the management area of the main image data; When storing the file in the second memory by the second storage unit, the file is stored based on the contents set by the management area setting unit It is made to function as a memory | storage control means to control to do.

  According to the present invention, it is possible to facilitate storage processing of a file including main image data and sub image data.

It is a circuit block diagram of the imaging device which concerns on one embodiment of this invention. It is a flowchart of the imaging in the embodiment of the present invention, and a new file generation process. It is a figure which shows the file structure in the embodiment. It is a display example in the same embodiment. It is a flowchart of the imaging in embodiment of this invention, and a new file production | generation process (modification). It is a figure which shows the file structure in the embodiment. It is a flowchart of the additional recording process of the sub image data in the embodiment of the present invention. It is a figure which shows the file structure in the embodiment. It is a display example in the same embodiment. It is a flowchart of the deletion process of the image data in the embodiment of the present invention. It is a figure which shows the file structure in the embodiment. It is a display example in the same embodiment.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

A. Circuit Configuration FIG. 1 is a block diagram showing a schematic configuration of an imaging device 1 as an image storage processing device. The imaging apparatus 1 includes a control unit 11 connected to each unit via a bus line 14. The control unit 11 is a one-chip microcomputer that controls each unit of the image storage processing device 1.
In the figure, the imaging lens 2 is a lens unit in which an optical system member is mounted in detail.
The imaging unit 3 includes an image sensor such as a CMOS and is disposed on the optical axis of the imaging lens 2 described above. The unit circuit 4 is a circuit to which an analog imaging signal corresponding to the optical image of the subject output from the imaging unit 3 is input, and a CDS that holds the input imaging signal and a gain adjustment that amplifies the imaging signal. An amplifier (AGC), an A / D converter (ADC) that converts the amplified imaging signal into a digital imaging signal, and the like are configured.

The output signal of the imaging unit 3 is sent to the image processing unit 5 through the unit circuit 4 as a digital signal, subjected to various image processing, reduced by the preview engine 7, and supplied to the display unit 12. The When the supplied digital signal (imaging signal) and a drive control signal for driving a driver built in the display unit 12 are input to the display unit 12, the display unit 12 is based on the digital signal (imaging signal). Display the image as a through image on the lower layer.
At the time of image recording, the signal processed by the image processing unit 5 is compression-encoded by the encoding / decoding processing unit 6, filed in a file format described later, recorded in the image recording unit 8, and image At the time of reproduction, main image data and sub-image data included in the image file read from the image recording unit 8 are decoded by the encoding / decoding processing unit 6 and displayed on the display unit 12.

In addition to generating the through image, the preview engine 7 performs necessary control when displaying the image immediately before being recorded in the image recording unit 8 on the display unit 12 during image recording. The key input unit 13 includes a shutter key, a cursor key, a determination key, a clear key, and the like.
Furthermore, a RAM 10 for temporarily storing work data and intermediate files, and a program memory 9 are connected to the bus line 14. The program memory 9 stores a program for executing processing shown in a flowchart described later.

B1. Imaging and New File Generation Processing Next, processing from imaging processing to file generation in the imaging device 1 will be described.
FIG. 2 is a flowchart showing processing from photographing (imaging) to recording in the image recording unit 8.
When the activation of the shooting mode is instructed by a predetermined operation detected by the key input unit 13, the control unit 11 reads out and executes a program related to the imaging process from the program memory 9, and executes the imaging unit 3, the unit circuit 5, The image processing unit 5, the RAM 10, the encoding / decoding processing unit 6, and the preview engine 7 are caused to perform initial operations (start state).
Then, based on the image formed on the imaging unit 3 through the imaging lens 2, the unit circuit 4 periodically converts it into a digital signal, and the image signal processing unit 5 processes it into image data. The video (image) obtained as a result is displayed through on the display unit 12 (step SA1).

  Next, in this through display state, it is determined whether or not a sub-image number setting operation is detected by a predetermined operation detected by the key input unit 13 (step SA2). If the operation for setting the number of sub-images has not been detected (step SA2 → No), the display again shifts to the through display state (step SA15) and waits for detection of the recording instruction for the image formed by the imaging unit 3 (step SA15). (SA16) When a recording instruction is detected (step SA16 → Yes), image data corresponding to the image formed by the imaging unit 3 at that time is temporarily stored in the RAM 10, and then the control of the control unit 11 is performed. The encoding / decoding processing unit 6 generates a file in a format conforming to the DCF standard (Exif format) (step SA17), and records the generated file in the image recording unit 8 (step SA18). Return to the through display state.

On the other hand, when an operation for setting the number of sub-images is detected (step SA2 → Yes), the number of sub-image identification IFD setting areas (Image File Directory) is set based on the set number of sub-images, and the main image header is set. Generate (step SA3). A detailed technical description including file generation will be described later with reference to FIG.
After the number of sub-images is set, the set number of sub-images is displayed together with the image displayed in the through display state (step SA4).

  FIG. 4A shows the display state of the display unit 12 at this time. In the figure, the display unit 12 displays the total number of sub-images (number of sub-image data) set in the information display area 120 together with the racing car image as “Total” and the number of sub-images recorded (sub-data). The number of image data) is defined as “Use”, and each number is displayed. In the figure, the number of sub-images is 10 (the number of sub-image identification IFD setting areas is 10), and the number of recorded sub-images is 0 (the number of recorded sub-image identification IFD setting areas). Is displayed as 0).

In this through display state, the imaging unit 3 waits for detection of a recording instruction for an image formed by the imaging unit 3 (step SA5). When the recording instruction is detected (step SA5 → Yes), the imaging unit 3 connects at that time. Image data corresponding to the imaged image is temporarily stored in the RAM 10, and then the encoding / decoding processing unit 6 performs compression encoding processing (generation of main image data) based on the control of the control unit 11 ( Step SA6).
Then, the image formed by the imaging unit 3 and the image data temporarily stored in the RAM 10 are stored by the operator's operation separately from the above setting operation or stored in the program memory 9. The encoding / decoding processing unit 6 performs compression encoding processing (generation of sub-image data) for the number of sub-images set in advance by the existing shooting program (step SA7).

  The operator's operation different from the setting operation includes, for example, an operation for executing continuous shooting, panoramic shooting, multi-viewpoint (multi-angle) shooting, and the like. On the other hand, in the shooting program stored in the program memory 9, a program for automatically shooting a predetermined number of images automatically, and shooting conditions such as exposure value, shutter speed, and white balance are automatically switched for shooting. A program is included. The process of generating sub-image data for the image data temporarily stored in the RAM 10 includes, for example, resolution, storage capacity, storage size, and the like for the temporarily stored image data. A process of generating another image data with a different compression rate is included.

When the generation of the sub-image data is completed, the control unit 11 sets the number of sub-image identification IFD setting areas set (generated) in the main image header in step SA3 by the number of generated sub-image data. The non-use (unused) ”is modified to“ Active (recorded) ”, and the SOI marker (information indicating the head of the data) of the generated sub-image data is associated (step SA8).
Thereafter, the control unit 11 determines whether or not the number of sub-images set in advance in step SA3 has been recorded, that is, whether or not all the sub-image identification IFD setting areas are “Active” (step SA9). . If all are “Active” (step SA9 → Yes), a file including the main image header, main image data, and sub-image data is generated (step SA10), and the generated file is recorded on the image. Record in section 8 (step SA11), and return to the through display state.

  On the other hand, if it is determined that the sub-image identification IFD setting areas are not all “Active” (step SA9 → No), the control unit 11 waits for detection of the file formation instruction by detecting the operation of the key input 13 without immediately generating a file. (Step SA12). When the file conversion instruction is detected (step SA12 → Yes), the file conversion process is performed at step SA10. When the file conversion instruction is not detected (step SA12 → No), the image is displayed on the display unit 12 together with the image in the through display state. The set number of sub-images, the number of recorded sub-images, and the number of unused sub-images (the number of remaining sub-images) are displayed (step SA13).

  FIG. 4B shows the display state of the display unit 12 at this time. In the figure, the display unit 12 displays the number of sub-images (number of sub-image data) set in the information display area 121 together with the racing car image as “Total”, and the number of recorded sub-images (sub-image data). The number of sub-images that can be recorded (the number of sub-image data) is defined as “REM”, and each number is displayed. In the figure, the number of sub-images is 10 (the number of sub-image identification IFD setting areas is 10), and the number of recorded sub-images is 3 (the number of recorded sub-image identification IFD setting areas). 3), and the number of recordable sub-images is 7 (the number of recorded sub-image identification IFD setting areas is 7).

Then, in this through display state, it waits for detection of a recording instruction (step SA14), and when a recording instruction is detected (step SA14 → Yes), the process returns to step SA7, The image data temporarily stored in the RAM 10 is encoded by the number of sub-images set in advance by the operator's operation separately from the above setting operation or by the shooting program stored in the program memory 9. / Decoding processing unit 6 performs compression encoding processing (generation of sub-image data).
Next, the generation process of the file generated in the above flowchart will be described in detail with reference to FIG.

3A to 3D show the file structure during the generation process generated in the flowchart of FIG.
In this figure, this file is in a format compliant with the DCF standard (Exif format). However, the main image header includes a management area for sub image data, and is associated with the main image data by one to a plurality of sub images. The difference is that image data is included.

  The file 100 includes a main image header 101, a main image data setting area 102, and sub image data setting areas 1030, 1031, 1032,. The main image header 101 includes a manufacturer name, model name, generation date and time of original image data, generation date and time of digital data, a compatibility identification index, a version, and a version that comply with the DCF standard (Exif format). Basic information setting area 1010 in which an Exif essential tag is set, thumbnail image data setting area 1011 in which thumbnail image data of main image data is set, information for managing the number of sub image data, and sub image index IFD tags And a management area 1012 for setting and managing the sub-image identification IFD setting areas 200 to 209 is written. The sub-image identification IFD setting areas 200 to 209 each include areas for storing a sub-image type, sub-image data offset, sub-image unique ID, subordinate sub-image identification IFD, and Offset of Next IFD. ing.

  The main image data is written in the main image data setting area 102. Further, the sub image data setting areas 1030 to 1039 are sub image header 301 and sub image data setting areas in which thumbnail image data and sub image attribute information of the sub image and Exif essential tags of the sub image data alone are set. 302 is written. Note that, since the thumbnail image data is set in the sub image header 301, it is assumed that the sub image data itself has a size substantially larger than the size of the thumbnail image data (vertical 120 × horizontal 160).

  The content illustrated in FIG. 3A indicates the time point of step SA3 in the flowchart of FIG. That is, when the number of sub-images is set in step SA3, the number of sub-image identification IFD setting areas is set in the management area 1012 based on this. When 10 are set, the sub-image identification IFD setting areas are 10 to 200 to 209, and these sub-image identification IFD No. In (IFD00 to 09), “Non-use” is set. Then, a file configuration (assuming a case where a setting area (up to line A) of the main image header 101 including the management area 1012 is secured and a maximum of 10 sub-image data is generated in accordance with the above setting operation ( In FIG. 3C, the area corresponding to the area drawn with a broken line is provisionally determined.

The content illustrated in FIG. 3B indicates the time point of step SA6 in the flowchart of FIG. That is, when the main image data is generated in step SA6, the thumbnail image data of the main image data is written in the thumbnail image data setting area 1011 and the main image data is written in the main image data setting area 102, respectively. (B line) is secured.
The content illustrated in FIG. 3C indicates the time point of step SA7 in the flowchart of FIG. That is, when sub image data (for example, three) is generated in step SA7, the sub image data is written in the three regions of the sub image data setting regions 1030 to 1032. That is, for these three sub-images, thumbnail image data is written in the area where the thumbnail image data of the sub-image header 301 is set, and each sub-image data is written in the sub-image data setting area 302. C line) is secured.

The content illustrated in FIG. 3D indicates the time point of step SA8 in the flowchart of FIG. That is, when the sub image data is written in step SA7, the configuration of the file including the main image data and the sub image data is determined at that time (the area drawn with a solid line in FIG. 3C). “Non-use” in the sub-image identification IFD setting area (IFD 00 to 02) is corrected to “Active”, and the SOI markers of the sub-image data are associated with each other.
When the file is generated in step SA10, the file is generated in the area drawn by the solid line in FIG. 3D and recorded in the image recording unit 8.

As described above, according to this flowchart, when a file including sub-image data is generated by the imaging apparatus, the number of sub-image data (the number of sub-images) is set in advance so that the subsequent file construction can be performed. The effect that the burden of the required process can be reduced is obtained.
In addition, when the number of sub-image data recorded at the time of imaging is less than a preset number, it is possible to continuously record new sub-images.

Furthermore, in the through display state, the number of sub-image data set in advance, the number of recorded sub-image data, and the number of sub-image data that can be newly added are displayed. It is possible to easily grasp how many sub-images can be recorded.
Furthermore, there is an effect that the process up to file generation can be easily terminated without recording a preset number of sub-image data.

B2. Imaging and new file creation processing (variation)
Next, a modified example of processing from imaging processing to file generation in the imaging device 1 will be described.
FIG. 5 is a flowchart showing processing from photographing (imaging) to recording in the image recording unit 8. Note that the description of the circuit configuration of the imaging apparatus 1 and the parts common to the flowchart of B1 are omitted.

First, when the control unit 11 detects Yes in step SA3 in FIG. 2, that is, when an operation for setting the number of sub-images is detected, as shown in FIG. 4A, along with the image displayed in the through display state, The set number of sub-images is displayed (step SA21).
Then, in this through display state, it waits for detection of a recording instruction of an image formed by the imaging unit 3 (step SA22), and when a recording instruction is detected (step SA22 → Yes), the imaging unit 3 at that time The image data corresponding to the image formed in this manner is temporarily stored in the RAM 10, and an intermediate file of the main image header is generated in the RAM 10 (step SA23).

Next, the main image data and the sub image data corresponding to the image formed by the imaging unit 3 are generated by the encoding / decoding processing unit 6 (step SA24), and the generated main image data is generated. Each information including the setting / writing of the sub-image identification IFD setting area for the sub-image data is written in the main image header (step SA25), and it is determined whether or not the writing is completed (step SA26).
If writing has not been completed, the process returns to step SA25. If it is determined that writing has been completed, step SA10 in FIG. 2, that is, generation of a file including the main image header, main image data, and sub-image data is generated. Process.

6A to 6D show the file structure during the generation process generated in the flowchart of FIG.
In this figure, the configuration defined by each reference number is the same as in FIGS. 3 (a) to 3 (d), and a description thereof will be omitted. However, the contents shown in FIG. 6 (a) are the steps in the flowchart of FIG. The time point of SA23 is shown. That is, when the number of sub-images is set in step SA3, the control unit 11 detects this, determines that the file generated from this is a file including main image data and sub-image data, and stores it in the RAM 10. An intermediate file of the main image header corresponding to this file format is written to secure a storage area (area surrounded by a broken line in the figure).

  The content illustrated in FIG. 6B shows a state in the middle of step SA25 in the flowchart of FIG. That is, when the main image data and the sub image data are generated in step SA24, the thumbnail image data of the main image data is in the thumbnail image data setting area 1011 and the main image data is in the main image data setting area 102. Each written. In a similar manner, when sub-image data (for example, four) is generated, provisional reservation is made for four areas of the respective sub-image data setting areas 1030 to 1033, of which 1030 to 1031 are written. , D1 line is secured. Furthermore, since the number of sub-image data written is fixed, “Active” is set for the sub-image identification IFD setting area (IFD00 to 01), and the line up to D2 is secured.

  Note that dummy data (0x00) is added to the data setting area of the main image data and sub-image data in the RAM 10 so that the start offset is aligned with the cluster boundary and the size of each data is a multiple of the cluster size. The problem that the data is moved inadvertently at the time of writing and the file structure is greatly rewritten is eliminated.

  The content illustrated in FIG. 6C shows the final state of step SA25 in the flowchart of FIG. That is, the sub-image data that was in the middle of writing in FIG. 6B is written, and the four sub-image data setting areas 1030 to 1033 are reserved (E1 line), and the written sub-image data is further reserved. In the sub-image identification IFD setting area (IFD00 to 03) corresponding to the image data, “Active” is set and the line up to E2 is secured.

The content illustrated in FIG. 6D shows the state of step SA26 (Yes) in the flowchart of FIG. That is, processing for deleting dummy data is performed to combine the main image header 101 completed as an intermediate file, the main image data setting area 102, and the sub image data setting areas 1030 to 1033 as one file.
As described above, according to this flowchart, it is possible to shorten the time in the process up to file generation.
Therefore, it is effective when a large number of image data is generated in a short time such as continuous shooting processing.

C. Sub Image Data Additional Recording Process Next, sub image data addition / recording process in the imaging apparatus 1 will be described.
FIG. 7 is a flowchart showing the sub image data adding process.
In the figure, the image pickup apparatus 1 operates in a shooting mode or a playback mode. In this flowchart, each of the files recorded in the image recording unit 8 is detected by detecting a predetermined operation from the key input unit 13. The state in which the display of the image stored in (indicating the read-out display of the preview image) is instructed is the start state.

  When instructed to display an image (reading display of a preview image), the control unit 11 reads main image data from a file recorded in the image recording unit 8 in accordance with a selection operation detected by the key input unit 13. (Step SB1). Then, it is determined whether or not the management area 1012 is set in the main image header 101 of the read file (step SB2).

If it is determined that the management area 1012 is not set (step SB2 → No), the process proceeds to normal image file reading / display processing (step SB3), but if it is determined that the management area 1012 is set (step SB2). (Yes), it is determined that this file contains main image data and sub-image data. Then, the main image data is resampled (decimation processing) in accordance with the resolution requested by the display unit 12 to generate a preview image and display it on the display unit 12.
At the same time, each information recorded in the main image header 101, each information in the sub-image header 301 of the sub-image data, and setting contents in the sub-image identification IFD setting area of the management area 1012 are read out. Based on the information, the capacity of this file, the set number of sub image data, the number of recorded sub image data, and the number of unused sub images (remaining number of sub images) are displayed (step SB4).

  FIG. 8A shows the display state of the display unit 12 at this time. In the figure, the display unit 12 displays the racing car image, and the information display area 122 displays the file capacity (5.25 MB), the set number of sub-images (the number of sub-image data “Total 10”). ), The number of recorded sub-images (the number of sub-image data “Use 3”), and the remaining number of sub-images that can be additionally recorded (the number of sub-image data “REM 7”).

  Next, in this state, it is determined whether or not an instruction to add sub-image data is detected by detecting a predetermined operation of the key input unit (step SB5). If the sub-image data addition instruction is not detected (step SB5 → No), the process proceeds to the deletion process (step SC1 and later), but if the sub-image data addition instruction is detected (step SB5 → Yes), Based on the setting contents of the sub-image identification IFD setting area, whether or not the set number = recorded number, that is, whether or not all of the sub-image identification IFD setting areas are “Active” or “Skip (non-display)” Is determined (step SB6).

When all of the sub-image identification IFD setting areas are not “Active” or “Skip (not displayed)” (step SB6 → No), that is, there is a sub-image IFD in which “Non-use” is set. If so, it is determined that additional recording is possible, and the process proceeds to additional processing.
On the other hand, if all of the sub-image identification IFD setting areas are “Active” or “Skip (not displayed)” (step SB6 → Yes), it is necessary to newly manage the sub-image data. The process proceeds to a process of additionally setting a predetermined number of sub-image identification IFD setting areas set to 1012 (step SB7).

  Next, when a predetermined operation or the like by the key input unit 13 is detected, an instruction to select whether to add by editing the main image data and sub-image data, or to add a new image (taken) is added. It is determined whether or not (step SB8). When an instruction to add by editing the main image data and the sub image data is instructed, the main image data or the sub image data corresponding to the image displayed as the preview image on the display unit 12 is read (step SB9), and the program The editing program stored in the memory 9 is read, and a predetermined operation is detected by the key input unit 13 or an automatic editing process is performed (step SB10).

  This editing process includes parameter changing processes such as resizing, trimming, and filtering. However, various processes such as recognizing a specific image such as a face image included in the image data and trimming it to a predetermined size are performed. included. The edited image is added to the file as sub-image data upon detection of a predetermined operation by the key input unit 13 (step SB11).

  On the other hand, when a new photographing (imaging) selection instruction is given, the control unit 11 reads out and executes a program related to the imaging process from the program memory 9, and executes the imaging unit 3, the unit circuit 5, the image processing unit 5, the RAM 10, and the encoding. / Decoding processing unit 6 and preview engine 7 perform initial operation, and in the through display state, the number of sub-images set and the number of sub-images recorded are set together with images periodically captured on display unit 12 And the number of unused sub-images (the number of remaining sub-images) is displayed (step SB12).

  Then, in this through display state, it waits for detection of a recording instruction for an image formed by the imaging unit 3 (step SB13). When a recording instruction is detected (step SB13 → Yes), the imaging unit 3 is The encoding / decoding processing unit 6 performs compression encoding processing (generation of sub-image data) on the image formed in this manner (step SB14). Further, when sub-image data is added to the file by the above-described editing or new photographing by this processing, processing for rewriting and correcting the setting contents of the sub-image identification IFD setting area of the main image header 101 of this file is performed (step S1). SB15).

  FIG. 8B shows a state in which sub-image data is newly added in the through display state from FIG. 8A. In the figure, the sub-image data (data amount 1.03 MB) is additionally recorded by editing or new photographing. The display unit 12 displays the racing car image in the information display area 123. The capacity of this file (6.28 MB (5.25 MB + 1.03 MB)), the set number of sub-images (number of sub-image data “Total 10”), the number of recorded sub-images (number of sub-image data) “Use 4”) and the remaining number of sub-images that can be additionally recorded (the number of sub-image data “REM 6”) are displayed.

  Thereafter, by detecting a predetermined operation from the key input unit 13, it is determined whether or not the end of the process is instructed (step SB16). If the end is not instructed (step SB16 → No), step SB4 When the end is instructed (step SB16 → Yes), the file is re-recorded in the image recording unit 8 (step SB17), and the process is terminated.

FIGS. 9A and 9B show the file structure of the editing process of the file edited in the flowchart of FIG.
In the figure, the structure defined by each reference number is the same as that shown in FIGS. 3A to 3D and FIGS. 6A to 6D, and the description thereof is omitted, but is shown in FIG. 9A. The contents to be shown indicate step SB4 in the flowchart of FIG. 7 or before (the state recorded in the image recording unit 8). That is, the sub-image identification IFD setting areas (IFD 00 to 09) of the file 100 are written and stored in the main image header 101 in a state where 10 to 200 to 209 are preset. Since the sub image data setting areas 1030 to 1032 are already included in the file, “Active” is set for the sub image identification IFD setting areas 200 to 202, and “Non-use” is set thereafter. Yes.

  On the other hand, the content shown in FIG. 9B shows the file structure in step SB15 of the flowchart of FIG. That is, since the sub image data setting areas 1030 to 1033 are already included in the file by editing and new shooting, “Active” is set for the sub image identification IFD setting areas 200 to 203, and “Non-use” is thereafter set. "Is set.

  As described above, according to this flowchart, when sub-image data is newly recorded in a file including sub-image data in the imaging apparatus, an image based on the image data of the file to be added is displayed, and then the sub-image is displayed. Since the data can be edited or newly photographed and additionally recorded, the additional image can be easily recorded without losing sight of the relationship between the main image data and the sub-image data or the sub-image data.

  In addition, when adding a new image, it is possible to smoothly shift from image display to imaging processing, and to easily include the recorded image as sub image data. Therefore, main image data and sub image data, or sub image The effect that additional recording can be easily performed without losing sight of the relationship between data is obtained.

  Furthermore, in the through display state, the capacity of the file before additional recording, the number of set sub-image data, the number of recorded sub-image data, and the number of newly added sub-image data Is displayed, so that the operator can easily grasp “how many sub-images can be recorded afterwards”.

In this flowchart, it is assumed that the sub image data is set in the sub image identification IFD setting area as a form subordinate to the main image data, but the sub image data to be newly added is already included in the file. It may be included in a form depending on the existing sub-image data. In this case, information that is associated with the already included sub-image data is set in the sub-image identification IFD setting area that is newly set to “Active”.
For the sub-image data to be additionally recorded, the sub-image identification IFD No. May be set arbitrarily. In this case, the control unit 11 sets the arbitrarily set sub-image identification IFD No. Corresponding to the above, processing for newly adding and sorting (inserting) the sub-image data setting area is performed.

D. Image Data Deletion Processing Next, image data deletion processing in the imaging apparatus 1 will be described.
FIG. 10 is a flowchart showing image data deletion processing.
This figure is a process that continues from the state where it is determined No in step SB5 of FIG. 7, that is, it is detected that no additional recording is performed.

  The control unit 11 determines whether an instruction to delete image data (file) is detected by detecting a predetermined operation of the key input unit (step SC1). When the deletion instruction is not detected (step SC1 → No), the process proceeds to other file operation processing (step SC14). However, when the deletion instruction is detected (step SC1 → Yes), the deletion target is the main image data, That is, it is determined whether the file itself or sub-image data included in the file (step SC2).

  When the deletion target is a file, the file corresponding to the image (preview image) displayed on the display unit 12 is deleted from the image recording unit 8 in accordance with the selection instruction operation and the deletion instruction operation detected by the key input unit 13. This process is terminated. When the deletion target is sub-image data, a file corresponding to the most recent image displayed as a preview image on the display unit 12 is read from the image recording unit 8 (step SC3). The management area 1012 of the main image header 101 of the read file is read, and the sub image identification IFD No. of the sub image identification IFD setting areas 200 to 209 is read. The sub-image data set to “Active” is read in ascending order of (number) (step SC4).

  Then, together with the sub-image corresponding to the read sub-image data, the sub-image identification IFD No. of the sub-image data corresponding to the sub-image is displayed. The file data amount, the file amount of the sub-image data, the set number of sub-images, the number of recorded sub-images, and the number of unused sub-images (the number of remaining sub-images) are displayed (step SC5). .

  FIG. 11A shows the display state of the display unit 12 at this time. In the figure, the display unit 12 displays the racing car image, and the information display area 124 displays the sub image identification IFD No. of the sub image data. (IFD 01), the data amount of this sub-image data (1.25 MB), the file amount of the file containing this sub-image data (5.25 MB displayed in () in the figure), the set sub-image (The number of sub-image data “Total 10”), the number of recorded sub-images (the number of sub-image data “Use 3”), and the remaining number of sub-images that can be additionally recorded (the number of sub-image data “ REM 7 ") is displayed.

In this through display state, it waits for the instruction content by the predetermined operation detection of the key input unit 13 (step SC6), and when the instruction is not detected (step SC6 → No), the process proceeds to step SC4 and the instruction is detected. (Step SC6 → Yes), it is determined whether the instruction content is hidden or deleted (step SC7).
If it is determined that the instruction content is deletion, the sub-image data of the sub-image displayed on the display unit is deleted from the file (step SC8), and the sub-image data from which the main image header 101 of this file is deleted A correction process for writing “Non-use” for the setting content “Active” in the sub-image identification IFD setting area corresponding to is performed (step SC9).

  Thereafter, by detecting a predetermined operation from the key input unit 13, it is determined whether or not the end of this process is instructed (step SC 10). If the end is not instructed (step SC 10 → No), step SC 4. When the end is instructed (step SC10 → Yes), the file is re-recorded in the image recording unit 8 (step SB11), and the process is terminated.

On the other hand, if it is determined in step SC7 that the instruction content is not displayed, “Skip” is set for the setting content “Active” in the sub-image identification IFD setting area corresponding to the sub-image data of the sub-image displayed on the display unit. Is performed (step SC12).
Thereafter, by detecting a predetermined operation from the key input unit 13, it is determined whether or not the end of this process is instructed (step SC 10). If the end is not instructed (step SC 10 → No), step SC 4. When the end is instructed (step SC10 → Yes), the file is re-recorded in the image recording unit 8 (step SB11), and the process is terminated.

  FIG. 11B shows a display state of the display unit 12 when the process proceeds to step SC4 through step SC12. In the figure, the display unit 12 displays a racing car image, the information display area 125 includes a file amount (5.25 MB), the set number of sub-images (the number of sub-image data “Total 10”), Number of recorded sub-images (total number of recorded sub-image data “Use 3” and non-display-set sub-image data number “Skip 1” 4), of which sub-images are set to non-display The number of images (the number of non-displayed sub-image data “Skip 1” displayed in parentheses in FIG. 6) and the remaining number of sub-images that can be additionally recorded (the number of sub-image data “REM 6” ”) Is displayed.

  12A to 12C show the file structure of the editing process of the file edited in the flowchart of FIG.

  In the figure, the configuration defined by each reference number is the same as that in FIGS. 3 (a) to 3 (d), 6 (a) to (d), and FIGS. 9 (a) and 9 (b). Although not shown, the content illustrated in FIG. 12A indicates step SB4 in the flowchart of FIG. 10 or before (the state recorded in the image recording unit 8). That is, the sub-image identification IFD setting areas (IFD 00 to 09) of the file 100 are written and stored in the main image header 101 in a state where 10 to 200 to 209 are preset. Since the sub image data setting areas 1030 to 1032 are already included in the file, “Active” is set for the sub image identification IFD setting areas 200 to 202, and “Non-use” is set thereafter. Yes.

On the other hand, the content shown in FIG. 12B shows the file structure in step SC9 of the flowchart of FIG. That is, the sub image data set in the sub image data setting area 1032 is deleted, and the sub image identification IFD setting area corresponding to the sub image data setting area 1032 is changed from “Active” to “Non-use”. Yes.
Further, the content illustrated in FIG. 12C shows the file configuration in step SC12 of the flowchart of FIG. That is, the sub-image identification IFD setting area corresponding to the sub-image data setting area 1032 is changed from “Active” to “Skip”.

  As described above, according to this flowchart, when deleting a file including sub-image data in the imaging apparatus, if the main image data is to be deleted, the file itself including the main image data is recorded as an image. When deleting from the unit 8 and sub-image data is to be deleted, only the sub-image data can be deleted after displaying the sub-image based on the sub-image data to be deleted. There is an effect that unnecessary sub-image data can be easily deleted without losing sight of the relationship between data or sub-image data.

  Also, if you want to hide a specific sub-image without deleting it, display the sub-image based on the sub-image data to be hidden, and then hide only that sub-image data, as in the above deletion process. Since the display can be set, there is an effect that the sub image data can be easily manipulated without losing sight of the relationship between the main image data and the sub image data or the sub image data.

  Furthermore, in the through display state, what sub-image data the displayed sub-image is based on, the amount of sub-image data and the amount of files, the number of sub-image data set, and the recording The number of sub-image data that has already been added, the number of sub-image data that can be newly added, and the number of sub-image data that has been set not to be displayed are displayed. Can be easily grasped together with the displayed image.

  In the present embodiment, the new creation, additional recording, and deletion processing of the file in the imaging apparatus has been described, but the present invention is not limited to this, and a new file is created from the captured image, additional recording, and Any device, method, and program that can be edited are applicable without limitation.

DESCRIPTION OF SYMBOLS 1 Imaging device 3 Imaging part 4 Display part 6 Encoding / decoding processing part 8 Image recording part 9 Program memory 10 RAM
DESCRIPTION OF SYMBOLS 11 Control part 12 Display part 13 Key input part 100 File 101 Main image header 102 Main image data setting area 120-125 Information display area 200-209 Sub image identification IFD setting area 1012 Management area 1030-1033 Sub image data setting area

Claims (14)

Imaging means;
First storage means for temporarily storing an image picked up by the image pickup means;
First data generation means for generating at least main image data and sub-image data from the image stored in the first storage means;
Second storage means for storing each image data generated by the first data generation means as one file;
Management area setting for securing a predetermined number of management information of the sub-image data stored in the same file as the main image data in the second storage means and setting it in the management area of the main image data Means,
First storage control means for controlling to store based on the content set by the management area setting means when storing the file in the second storage means;
An image storage processing apparatus comprising: Second data generation means for generating image data from at least one of the image captured by the imaging means, the main image data, and the sub-image data;
Based on the number of management information set by the management area setting means, it is determined whether or not the image data generated by the second data generation means can be included in the file as new sub-image data. 1 judging means,
When it is determined by the first determination means that it can be included in the file, the image data generated by the second data generation means is additionally stored in the second storage means as sub-image data, Second storage control means for controlling to rewrite the contents of the management area;
The image storage processing apparatus according to claim 1, further comprising: Display means for displaying an image based on the file stored in the second storage means;
A first instruction means for instructing generation of new sub-image data for the image displayed on the display means;
The second data generation means generates new image data from the main image data or the sub image data of the file corresponding to the image displayed on the display means in response to the instruction by the first instruction means. The image storage processing device according to claim 2. Display means for displaying an image based on the file stored in the second storage means;
A first instruction means for instructing generation of sub-image data for the image displayed on the display means;
Imaging control means for controlling the imaging means to take an image in order to newly acquire image data in response to an instruction by the first instruction means;
3. The image storage processing apparatus according to claim 2, wherein the second data generation unit generates new image data from the image captured by the imaging control unit. Display means for displaying an image based on the file stored in the second storage means;
Second instruction means for instructing deletion of the image displayed on the display means;
Second determination means for determining whether the image instructed by the second instruction means is an image based on main image data or an image based on sub-image data;
When the image instructed to be deleted by the second determination means is an image based on the sub-image data, the sub-image data is deleted from the file including the sub-image data, and the contents of the management area of the file Third storage control means for controlling to rewrite
The image storage processing apparatus according to claim 1, further comprising: Display means for displaying an image based on the image data stored in the second storage means;
Third instruction means for instructing non-display of the image displayed on the display means;
Third determination means for determining whether the image instructed to be hidden by the third instruction means is an image based on main image data or an image based on sub-image data;
When the image for which deletion has been instructed by the third determination means is an image based on the sub-image data, information for hiding the image based on the sub-image data is displayed in the management area of the file including the sub-image data. Fourth storage control means for controlling to write,
The image storage processing apparatus according to claim 1, further comprising: Selection means for selecting whether to delete or hide the image displayed on the display means;
Execution control means for controlling the execution of the second instruction means when the selection means selects deletion of the image and the execution of the third instruction means when non-display of the image is selected. The image storage processing apparatus according to claim 5 or 6, further comprising: A notification means for notifying that the file itself containing the main image data is deleted, when the image instructed to be deleted by the second determination means is an image based on the main image data;
Detecting means for detecting execution of deletion in response to notification by the notification means;
When the detection means detects the execution of the deletion, the fifth storage control means for controlling to delete the file itself in which the main image data corresponding to the displayed image is stored from the second storage means. When,
8. The image storage processing apparatus according to claim 5, further comprising:   The image display apparatus further comprises first display control means for controlling to display the capacity of a file including image data corresponding to the image together with the image when the image is displayed on the display means. The image storage processing device according to any one of 2 to 8.   When the image is displayed on the display means, a third display control means for controlling to display the number of sub-image data included in a file including image data corresponding to the image together with the image is provided. The image storage processing device according to claim 2, wherein the image storage processing device is a device.   11. The image storage processing apparatus according to claim 10, wherein the third display control means further controls to display together the number of sub-image data corresponding to a preset area of the management area. The first data generation means further generates thumbnail image data from the image stored in the first storage means,
13. The image storage according to claim 1, wherein the sub-image data is data having the same resolution as the main image data or a resolution larger than the thumbnail image data and smaller than the main image data. Processing equipment. A first storage step of storing the captured image in a first memory;
A first data generation step for generating at least main image data and sub image data from the image stored in the first storage step;
A second storage step of storing each image data generated in the first data generation step in the second memory as one file;
Management area setting for securing a preset number of management information of the sub-image data stored in the same file as the main image data in the second storage step, and setting it in the management area of the main image data And including steps,
The second storage step stores the file in the second memory based on the contents set in the management area setting step. A computer included in the image storage processing device,
First storage means for storing a captured image in a first memory;
First data generation means for generating at least main image data and sub-image data from the image stored by the first storage means;
Second storage means for storing each image data generated by the first data generation means in the second memory as one file;
Management area setting means for securing a predetermined number of pieces of management information of the sub-image data stored in the same file as the main image data by the second storage means and setting the management information in the management area of the main image data ,
A storage control means for controlling to store the file in the second memory by the second storage means based on the contents set by the management area setting means;
A storage processing program characterized by functioning as

Images