JP3679796B2 - camera - Google Patents

Description

  The present invention relates to recording of image data with a camera having an image sensor.

  Digital still cameras that record image data, audio data, control data, and the like as recording files on recording media such as IC memory cards, magnetic media (hard disks and floppy disks), and magneto-optical media have been put into practical use.

The digital still camera as described above is expected to expand the field of use in the future because it can take an image as image data and can easily perform processing and image data transmission by a computer. However, it has not been done so far specific proposal of the techniques particularly can contribute to high-speed image reproduction processing.

Accordingly, an object of the present invention is to provide a camera that is useful when performing high-speed image reproduction .

In order to solve the above-described problems, the camera according to the present invention employs the following characteristic configuration.

(1) The camera of the present invention includes an optical system for obtaining a subject image,
An imaging circuit that photoelectrically converts an object image obtained through the optical system into an electrical signal;
An A / D conversion circuit for converting an electrical signal from the imaging circuit into digital data;
A coder for encoding the digital data converted by the A / D conversion circuit;
Recording control means for recording image data encoded by the coder in a storage means;
Have
A main image file having main image data and a sub image file having a sub image reduced or compressed than the main image are recorded as separate files in the storage means, and a directory for recording only the main image; A directory structure having a directory for recording only the sub-image is provided, and sub-image data is stored in a batch file so that index display and batch erasure are possible .

In the present invention, a main image file having main image data and a sub image file having a sub image composed of a reduced image of the main image are recorded as separate files in the storage means, while only the main image is recorded. And a directory structure having a directory for recording only the sub-image. Furthermore, the directory for recording only the main image and the directory for recording only the sub-image can be structured in a hierarchical structure in which they are recorded in parallel on the same hierarchy.
Furthermore, it is possible to easily perform index display for reproducing only the sub-image and batch erasure of the sub-image.

As described above, in the camera according to the present invention, when performing processing and image data transmission by a computer, the types of image files are clearly separated in advance for each directory, so image data is copied from the camera to a computer or the like. Or when transmitting and editing, main images and sub-images can be easily gathered together for quick editing such as pasting to an electronic album, or unnecessary images. It is possible to easily perform operations such as extraction and erasure of the image. Furthermore, since the directory for recording only the main image and the directory for recording only the sub-image are recorded in parallel on the same hierarchy, the same level hierarchy is used when working while looking at the hierarchy structure on the computer. In addition, since all of the main image and the sub-image can be displayed in parallel, it is possible to look down on all of the data at one time, which can greatly improve the efficiency of editing work.
Furthermore, it is possible to easily perform index display for reproducing only the sub-image and batch erasure of the sub-image.

Next, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing an application example of an image handling apparatus according to the present invention to a digital still camera.
A subject image is converted into an electric signal by an imaging circuit 2 having an imaging element such as a CCD, which is a photoelectric conversion means, through an optical system (lens) 1. The converted electric signal is subjected to a predetermined clamping process by the clamp circuit 3, converted to digital data by the A / D conversion circuit 4, and written in the frame memory 11. Writing to and reading from the frame memory 11 is controlled by the memory controller 10 under the control of the system controller 16. Image data read from the frame memory 11 is digitally processed together with character data sent from the character generator 9 in the digital process circuit 5, and then converted into an analog signal by the D / A conversion circuit 6. The converted analog image signal is amplified by the amplifier circuit 7 and then supplied to the external terminal EXT and the electronic viewfinder 8.

  At the time of data recording, the image data read from the frame memory 11 is orthogonally transformed by a DCT / IDCT (Discrete Cosine Transform / Inverse Discrete Cosine Transform) circuit 12, and the obtained orthogonal coefficient is encoded by a coder / decoder 13. The compression processing is performed by a compression method compliant with the JPEG method or the like. The compressed image data is recorded in the IC memory card 15 as a storage unit. Here, the memory card may be detachable from the apparatus main body, or may be fixed in advance.

  At the time of reproduction, the image data read from the IC memory card 15 is decompressed through the processing of the coder / decoder 13 and the DCT / IDCT circuit 12 and written into the frame memory 11. The image data read from the frame memory 11 is output to the external terminal EXT and the electronic viewfinder 8 via the digital process circuit 5, the D / A conversion circuit 6, and the amplification circuit 7.

  The system controller 16 exchanges data via the data bus B1 and controls the entire camera operation. For example, the display of the display unit 17 such as an LCD is controlled, and the camera operation is controlled based on operation information from the operation unit 18. The system controller 16 also controls the character generator 9 to control desired character information output, and controls communication with the outside via the data bus B 2 and the data input / output unit 19. The auxiliary memory 14 is a work memory used for various data processing.

  In the configuration as shown in FIG. 1, in the present invention, a sub-image (for example, a thinned image, a reduced image) composed of partial image information obtained by extracting a part of image information for one image (hereinafter referred to as a main image). Image, etc.), and the generated image is stored in a memory and transmitted to another image handling apparatus.

  The recording of the sub-image in the memory is performed through the operation of the system controller 16, and there are various recording modes as described below.

  By the way, in a digital still camera that records image data, audio data, control data, etc. as a file on a recording medium such as a memory card, magnetic medium (hard disk or floppy disk) and magneto-optical medium, the data is also stored in a file format on the recording medium. May be recorded. At this time, the memory management is preferably performed in a standard DOS (disk operating system) format on a personal computer or the like in terms of data compatibility. In the recording medium, control information for controlling the operation and associating each file is recorded as a control file (also referred to as a control file or a relational file, but hereinafter referred to as a relational file). Has also been considered.

In the first recording mode, main image data and sub-image data are recorded in an image file at the time of recording in the file format. FIG. 2 shows three types of recording modes. By recording in such an image file, frame numbers can be managed as usual, and movement, copying, deletion, etc. can be handled together without being conscious of the main image and the sub-image.
In FIG. 2A, when one piece of image data is recorded, a file header portion, a main image data portion, and then a sub image data portion are sequentially recorded in the image file. As a result, it is easy to delete only the sub-image, and when creating a plurality of sub-images, it is easy to add and the main image can be easily reproduced. In FIG. 2B, a file header portion, a sub-image data portion, and then a main image data portion are recorded sequentially. Therefore, a higher-speed search is possible when searching in the sub-image playback mode. FIG. 2C shows a recording mode when there are a plurality of sub-images. Following the file header portion, main image data is written from the main data start address, and sub-image data 1 starts from the sub-image. After the data 1 is written, the sub image data 2 is written from the start address of the sub image data 2.

  FIG. 3 shows an example of entry in the file header. Following the standardized format tuple and recording date tuple, the parameter of the sub-image data 1 is stored in the option tuple 1, and the sub-image data is stored in the option tuple 2. Two parameters are recorded, and main image data and sub-image data are continuously recorded as image data. The sub-image data parameters include sub-image data start address, sub-image data type (compressed / uncompressed, pixel size, etc.), and a reduction ratio 1 / (2 to the power of 2) for the main image. It can be. When a reduced sub-image is created, it is easier to record only the reduction rate and the amount of data is smaller than recording the pixel size as a parameter. There is a creation date of sub-image data. Thus, in addition to the effects described above, it is easy to extract only the main image.

  FIG. 4 shows an example of a recording format for the file header. Subsequent to the format tuple and the recording date tuple, the sub-image data parameters recorded are recorded in the option tuple 1, the main body of the sub-image data 1 is recorded in the option tuple 2, and the sub-image data 2 is stored in the option tuple 3. Is recorded. The main image data body is recorded in an area other than the file header of the image file. Examples of the sub-image data parameters include the presence / absence and number of sub-image data, the type of sub-image data (compression / non-compression, pixel size, reduction rate, etc.), and the like.

FIG. 5 is a diagram showing an example of recording on an image header (JPEG header) when main image data is compressed and recorded by the JPEG method which is one method of an image data format for a personal computer.
The JPEG header that follows the file header includes data such as an SOI (Start of Image) marker, APP (Application Marker) the sub-image data body, and the SOS marker the main image data body is the EOI (End
of Image) Recorded up to the marker section. By doing so, the same effect as in the example shown in FIG. 2 can be obtained. As image data formats for personal computers, there are TIFF, PICT, BMP, etc. in addition to JPEG, but the present invention can also be applied to these systems.

  FIG. 6 shows an example in which the sub image data is recorded in a separate file from the main image data, and the association data of the data is recorded in the relational file described above. Since one image becomes one file by recording to another file, image management can be performed using the file management image. According to the relational file, the association information is managed in a lump, and data management becomes easy.

  As shown in FIG. 4A, the file (FILE) 1 is a main image file composed of a file header and main image data main body. As shown in FIG. A sub-image 1 file consisting of the main body of data 1 is prepared as file 3, and a sub-image 2 file consisting of a file header and the main body of sub-image data 2 is prepared as shown in FIG. A relational file as shown in (D) is prepared. In the relational file in FIG. 4D, for example, “MAIN5” indicates that the main image data of the fifth frame is recorded in the file (FILE) 1 in FIG. 5A, and “SUB5” indicates 5 It shows that the sub-image data of the frame is recorded in file 2 and file 3 in FIGS.

  In FIG. 7, the sub-image data is recorded in a separate file from the main image data main body, and related information about the sub-image data file is recorded in the file header of the main image data file ((A) in FIG. 7). An example is shown. This file header includes a format tuple, a recording date tuple, an option tuple 1 in which a sub-image file name 1 is recorded, and an option tuple 2 in which a sub-image file name 2 is recorded. FIG. 5B shows a file in which the main body of the sub-image data 1 is recorded, and FIG. 10C shows a file in which the main body of the sub-image data 2 is recorded. In this way, if the main image is read, the sub-image is inevitably known. If the file header of the sub image data and the related information about the main image data file are recorded, the relationship of the main image can be known from the sub image, and it is not necessary to read an extra file.

  FIG. 8 shows an example in which main image data and sub-image data are recorded in separate files, and the identification and association of these data is performed using file names. In this example, the main image data file and the sub image data file are distinguished by the extension. As a result, it is easy to reproduce only the main image or only the sub-image. Further, since the file name can be discriminated without reproducing the image of the file, image management by file operation becomes possible to some extent.

On the left side of the figure, an example of a main image data file with an extension “J6I” is shown. Among the extensions “J6I”, “J” indicates JPEG as a compression method, “6” indicates 68 Pin, and “I” indicates Image.
Also, on the right side of the figure, an example of a sub-image data file with an extension “T6N” (N is a natural number) is shown. Of the extension “T6N”, “T” indicates “Thumbnail” (thumbnail), “6” indicates 68 Pin, and “N” indicates the frame number of the subimage data.

  FIG. 9 shows an example of a directory structure in which main image data and sub-image data are similarly recorded in separate files, and each file is associated with a directory. By using this directory, not only the same effects as when file names are used, but also frame number management becomes easy. Unlike other examples of recording different files, a directory in which only the main image is recorded is created, so that frame number management in the conventional directory entry can be performed as it is.

  In this example, the directory “MAIN” includes the main image data group, the directory “SUB1” includes the sub image 1 data group, and the directory “SUB2” includes the sub image 2 data group. Show. For example, the sub image 1 of the file “DSC002.J6I” is displayed as “¥ SUB1 ¥ DSC002.J6T”, and the subimage 2 of the file “DSC002.J6I” is displayed as “¥ SUB2 ¥ DSC002.J6T”.

  FIG. 10 shows an example in which main image data and sub-image data are recorded in separate files, and the main image file is a separate file, but the sub-image files are stored in a batch file. According to this method, index display (reproduction of only a sub-image) can be easily performed by making sub-image data into a batch file. In addition, the sub-image can be easily erased at once.

  In FIG. 9A, a main image file DSC001.DSB in which main image data is recorded following a header portion in which a format tuple, a recording date tuple, an option tuple, and a sub-image data offset address are recorded. An example of J6I is shown, and FIG. 5B shows a main image file in which main image data is recorded following a header portion in which a format tuple, a recording date tuple, an option tuple, and a sub-image data offset address are recorded. DSC011. An example of J6I is shown, and FIG. 8C shows only one sub image file for recording sub image data for these main image data. In the sub-image file of FIG. 8C, the file DSC001. A sub image of J6I is recorded as sub image data 1 as sub image data 2, sub image data 3,... A J6I sub-image is recorded as sub-image data 11 and sub-image data 12 is recorded.

  The file header of the sub-image batch file includes the number of sub-images, sub-image image parameters, the start address and end address of each sub-image data, the file name of the main image for each sub-image, etc. When a batch file is used as an index file, a main image can be searched from sub-images.

  FIG. 11 shows an example in which the image data recording start address is designated in cluster units. The file header is recorded in cluster 1, the main image data is recorded in clusters 2, 3,..., The sub image data 1 is recorded in clusters 10, 11,. According to this embodiment, when sub-image data 1 is erased, the sub-image data itself is not manipulated at all, and it is only necessary to erase the sub-image portion in the FAT chain of the image file and rewrite the FAT chain. On the other hand, when the conventional recording start address is designated, in order to erase only the sub-image data 1, it is necessary to pack the sub-image data 2 in the erased place after erasing the sub-image data 1. Therefore, by setting the recording start address to 2 n bytes, high-speed image search, extraction of only the main image is facilitated, and erasure of the sub-image data is facilitated.

  Next, the operation sequence of the digital still camera in the embodiment of the present invention will be described with reference to the flowchart of FIG.

  After the power is turned on, the camera operation condition initialization process such as zooming initialization is performed (step S1), and it is determined whether or not the sub image creation mode is set (step S2). Is displayed on the display unit 17 and a flag indicating that is set (step S3), and it is then determined whether or not the mode is an area selection mode for selecting an area to be extracted from the main image as a sub-image (step S4). If it is not the sub-image creation mode in step S2, the process proceeds to step S13 described later.

  In step S4, if it is the area selection mode, the area selection mode is displayed, and a flag indicating that is set (step S5), and it is determined whether or not the image reduction mode is to reduce the image (step S5). Step S6). Also, when not in the area selection mode, the process proceeds to step S6. Here, in the image reduction mode, after the display indicating that the image reduction mode is set and the flag is set (step S7), and when the mode is not the image reduction mode, whether or not the image compression mode is set next. Is determined (step S8). By the above reduction, the entire image can be grasped with a small size.

  In step S8, in the image compression mode, as a method used for compression, which method is set, that is, a method for making the compression rate constant or a method for making the size (data amount) constant. In order to determine, it is determined whether or not the mode is the constant size mode (step S9). If the mode is the constant size mode, the fact that the size is constant after compression is displayed and a flag is set (step S10). If the mode is not the constant size mode, the mode is the constant compression rate mode. A message to that effect is displayed and a flag is set (step S11). If it is determined in step S8 that the mode is not the image compression mode, a message indicating that the mode is the non-compression mode is displayed and a flag is set (step S12).

  After the processing of steps S10 to S12, an operation input by an operation from the operation unit 18 is detected (step S13), power OFF is determined (step S14), and if it is power OFF, the power is turned OFF and the operation is terminated. If the power is not OFF, various processes corresponding to the input operation are executed (step S15), and the process returns to step S13.

  FIG. 13 is a flowchart showing an image data recording processing sequence when sub image data is recorded after main image data is recorded.

  For example, a process is started in response to a recording instruction by an operation from the operation unit 18, and first, a frame memory following the process by the optical system 1, the imaging circuit 2, the clamp circuit 3, and the A / D conversion circuit 4 shown in FIG. 11 is executed (step S21), and main image compression processing by the DCT / IDCT circuit 12 and the coder / decoder 13 is executed on the main image data read from the frame memory 11 (step S22). ) The compressed main image data is recorded on the IC memory card 15 (step S23). Next, it is determined whether or not a sub image is to be created (step S24). This determination is made based on, for example, the presence / absence of the flag set as the sub-image creation mode in step S3 in FIG.

  If it is determined in step S24 that a sub-image is to be created, a sub-image creation process is executed (step S25). After the sub-image recording process (step S26) on the IC memory card, a file maintenance process is executed. (Step S27), the process ends. If it is determined in step S24 that no sub-image is to be created, the file maintenance process in step S27 is executed as it is. As the file maintenance process, for example, when a file is managed and recorded in the DOS format, there is a format writing process such as directory entry and FAT.

FIG. 14 is a flowchart showing a creation sequence of the sub-image creation process in step S25 of FIG.
First, it is determined whether or not the mode is an area selection mode for selecting a sub-image creation area for the main image (step S31). If the mode is the area selection mode, an area size changing process for changing the size of the area (step S32) is performed. After executing the area position changing process (step S33) for changing the position of step S34, the determination in step S34 is performed. In this case, if it is determined in step S31 that the mode is not the area selection mode, the image is similarly reduced. It is determined whether or not to do. Here, when it is determined that the image is to be reduced, after the image reduction process is performed by thinning and reading out the image data from the frame memory 11 (step S35), the image is not reduced in step S34. If it is determined, it is determined whether or not to compress the image (step S36). Here, if it is determined that the image is to be compressed, it is determined whether or not a constant size is instructed in order to determine whether the compression rate is constant or the size (data amount) is constant at the time of compression ( Step S37).

  If it is determined in step S37 that the size is constant, a compression process is performed with a constant size after compression (step S38). If it is not determined that the size is constant, the compression process is performed with a constant compression rate ( Step S39) and the process is terminated. If it is determined in step S36 that the image is not to be compressed, the image data read from the frame memory 11 is not compressed and, for example, uncompressed data conversion processing such as conversion to a format necessary for personal computer processing is executed. (Step S40), the process ends. In this case, when the image data is handled in the camera, the image data is directly written in the IC memory without executing the conversion process. In creating a reduced compressed image, a 1/8 reduced image may be obtained by recording only the DC component of the orthogonal coefficients output from the DCT / IDCT circuit 12. This process not only provides good image quality with higher reproducibility than the reduced image obtained by the normal thinning process, but also allows the memory control to be the same for the main image and the sub-image, thereby simplifying the circuit.

  In the example shown in FIG. 14 described above, there are three specific sub-image generation means, that is, an area selection means, an image reduction means, and an image compression means as the sub-image generation means. However, the present invention is not limited to the above-described example, and, for example, of the above three means. Of course, one having two or two means, or the processing order of the three means may be appropriately changed. In this case, the sub-image generating means processed first is the first sub-image generating means, and the sub-image generating means processed thereafter is the second sub-image generating means. The processing timing of actual data by the sub-image generation unit and the second sub-image generation unit includes both processing at the same time on the previous frame memory 11 and processing by time division.

The procedure of this uncompressed data conversion process is shown in the flowchart of FIG. In FIG. 15, first, it is determined whether or not to store in the format of the computer (step S41). If it is not in the format of the computer, the processing is ended as it is. Conversion is performed (step S42), and the process is terminated.
As the data recording method at the time of non-compression, the RGB method and the YCbCr method are generally used. However, the RGB method is suitable for reproduction on a personal computer, and the YCbCr method is suitable for reproduction on a camera.

  The sub-image recording process in step S26 of FIG. 13 is executed according to the procedure of the flowchart shown in FIG. That is, an image write address is created (step S51), sub-image data is written to the created address (step S52), and a sub-image start address is written to the file header (step S53), thereby enabling quick reproduction.

  Although the writing of data to the file header has been described with reference to FIG. 4, as shown in FIG. 17, the processing procedure first interprets the file header (step S61) and creates an optional tuple for each sub-image (step S62). ), Sub-image data is written to this tuple (step S63), tuple maintenance is executed (step S64), and the process is terminated. This tuple maintenance is a process of writing the size of the file header determined after the writing is completed.

  FIG. 18 is a flowchart showing a procedure for recording the sub-image data shown in FIG. 5 in the JPEG header. First, the JPEG header is interpreted (the JPEG format is interpreted) (step S71), an application (APP) marker is created (step S72), and the sub-image data is written to the created APP marker (step S73).

FIG. 19 is a flowchart showing a sub-image recording sequence for associating image data using the relational file shown in FIG.
First, a sub-image data file is created (step S81), and the presence or absence of a relational file is determined (step S82). If there is a relational file, the relational file is read and interpreted (step S83). For example, after creating the relational file (step S85), the information related to the main image data is written (step S84), and the process is terminated.

FIG. 20 is a flowchart showing a sub-image recording sequence for performing association using the file header shown in FIG.
In this sequence, a sub-image data file is created (step S91), the main image data file header is interpreted (step S92), related information is written in the main image file header (step S93), and the process is terminated.

FIG. 21 is a flowchart showing a sub-image recording sequence for performing association by the file name shown in FIG.
In this sequence, the file name configuration is confirmed, an appropriate file name consistent with the configuration is created (step S101), a sub-image data file is created with the created file name (step S102), and the process is performed. finish.

FIG. 22 is a flowchart showing a sub-image recording sequence for performing association in the directory as shown in FIG.
First, the presence / absence of a directory is determined (step S111). If there is a directory, a sub-image directory is searched (step S112), and then the presence / absence of a sub-image is determined (step S113). If there is a sub-image, the process returns to step S111 to search the next directory. If there is no sub-image, a sub-image data file writing process is executed (step S114), and the process ends. If it is determined in step S111 that there is no directory, a sub-image directory is created (step S115), and the process proceeds to step S114.

FIG. 23 is a flowchart showing a sequence for recording sub-image data using the sub-image batch file as shown in FIG.
In this sequence, first, the presence / absence of a sub-image file is determined (step S121). If there is, a sub-image batch file is searched (step S122), and the number of sub-images and the data written in the file header are searched. The sub image data recording start address is created (step S123). If it is determined in step S121 that there is no sub-image file, a sub-image batch file is created (step S124), and the process proceeds to step S123. After the process of step S123, the sub image data is written (step S125), the related information with the main image data is written (step S126), and the process is terminated.

Next, the operation during continuous shooting by the digital still camera will be described with reference to FIG.
A recording operation is started in response to pressing of the shutter button or the like. First, an imaging process for obtaining main image data is executed (step S131), and the obtained main image data is compressed (step S132). Is recorded (step S133), it is determined whether or not it is a sub-image creation mode (step S134). Here, if it is the sub-image creation mode, it is determined whether or not continuous shooting is set (step S135), and if continuous shooting is set, the sub-image creation conditions are determined (step S136). This determination is a process for determining which image of the main image obtained by continuous shooting is to be created.

  Thereafter, it is determined by detecting a flag whether or not a sub-image is to be created (step S137). If a sub-image is to be created, sub-image creation and recording processing is executed (step S138). A file maintenance process is executed (step S139). If it is determined in step S134 that the sub-image creation mode is not selected, or if it is determined in step S137 that no sub-image is created, the process proceeds to step S139, and in step S135, file maintenance is performed in step S139. If it is determined that the continuous shooting is not performed continuously after the process is executed, the process proceeds to step S138. It is determined whether it is a step (continuous shooting operation is continued) or not (step S140). If it is determined that recording is to be continued, the process returns to the imaging processing in step S131, and if it is determined that recording is not to be continued, processing is performed. Exit.

FIG. 25 is a flowchart showing a sequence example for determining sub-image creation conditions at the time of continuous shooting in step S136 of FIG.
This example shows the operation when a sub-image is created for the first main image among a plurality of main images obtained by continuous shooting, and the sub-image to be created is targeted for any one of the plurality of main images. It is also good.

  That is, first, it is determined whether or not the main image for which a sub-image is to be created is obtained, whether it is the first continuous shooting (step S141). If it is the first continuous shooting, the sub-image creation flag is set. The image is set (step S142), the process is terminated, and if it is not the first sheet, the sub-image creation flag is cleared (step S143), and the process is terminated. In this example, the main image for which the sub-image is to be created may be set as the last one in the continuous shooting.

  Unlike FIG. 25, FIG. 26 is a flowchart showing a sequence for automatically selecting and creating a main image for creating a sub-image from a plurality of main images in accordance with the continuous shooting speed. In this example, the high-speed continuous shooting mode and the low-speed continuous shooting mode are set as the continuous shooting mode, one main image per four images in the high-speed continuous shooting mode, and one main image in every two images in the low-speed continuous shooting mode. An example of obtaining a sub-image for an image is shown.

  After the operation starts, it is determined whether or not continuous shooting is the first image (step S151). If it is the first image, the counter value i is initialized to 0 (step S152). It is determined whether or not (step S153). If it is determined in step S151 that it is not the first sheet, the process proceeds to step S153 as it is.

  If it is determined in step S153 that the mode is the high-speed continuous shooting mode, it is determined whether or not the counter value i is greater than 2 (step S154). If larger, the sub-image creation flag is set to instruct the sub-image creation. (Step S155), the counter value i is set to 0 (Step S156), and the process is terminated.

  If it is determined in step S153 that the low-speed continuous shooting mode is set, it is determined whether or not the counter value i is greater than 0 (step S157). If larger, the process proceeds to step S155. Then, the sub-image creation flag is cleared (step S158), the counter value i is incremented by 1 (step S159), and the process ends. If the counter value i is not greater than 2 in step S154, the process proceeds to step S158.

  In this embodiment, the counter value i is first reset to 0, and is compared with “2” in step S154 during high-speed continuous shooting, and is compared with “0” in step S157 during low-speed continuous shooting. It is possible to automatically instruct and create one sub-image recording for every four images during shooting and one for every two images during low-speed continuous shooting.

  Sub-image data is recorded on a recording medium such as an IC memory card by the above-described processing. The recorded sub-image data is reproduced on a monitor screen connected to the electronic viewfinder 8 and the external terminal EXT shown in FIG. Thus, the searchability of recorded image information is improved.

  FIG. 27 shows a so-called picture-in-picture display example in which a sub-image is displayed simultaneously on a screen on which a main image is displayed on a monitor.

  FIG. 28 shows an example in which the frame number and the number information of sub-images are displayed as characters on a part (upper right part) of the main image screen displayed on the monitor.

  Further, an example of setting an area to be extracted as a sub-image as desired from the main image displayed on the monitor together with the size of the area is shown in FIGS. 29 and 30. FIG.

  With respect to the display main image of FIG. 29A, the image of the central portion designated in the selection area is taken out based on the size designation of the area and is taken as a sub-image as shown in FIG. Is displayed.

  Also, the image of the selected area selected for the main image in FIG. 30A is displayed as shown in FIG. 5B based on the area large / small designation and the area position designation.

  FIG. 31 shows an example in which a part of the main image is a sub-image in FIG. 29 and FIG. 30, but an image obtained by reducing the main image and further compressing it is used as the sub-image. The main image is reduced to a data size of 30 kB, and the sub-image reduced to a data size of 30 kB is further compressed to a data size of 1 kB. ing.

  FIG. 32 is a flowchart showing an image playback sequence. This reproduction sequence will be described below. When the playback mode (including frame advance) is set and the playback operation is started, first a file discrimination process is performed (step S161), the file of the frame to be played back is discriminated and whether or not playback is possible. Is determined (step S162). Here, if it is reproducible, it is determined whether or not the image is a main image (step S163). If it is a main image, after the main image is reproduced (step S164), the presence / absence of a sub image is determined. (Step S165). If it is determined in step S165 that there is a sub-image, processing for displaying sub-image information is performed as shown in FIGS. 27 and 28 (step S166), and the processing is terminated. If it is determined in step S165 that there is no sub-image, display processing without a sub-image is executed (step S167).

  If it is not the main image in step S163, it is a sub-image, so only the sub-image is reproduced (step S168), and the process is terminated. If it is determined in step S162 that reproduction is impossible, a warning display process is executed to indicate that reproduction cannot be performed because the file is an audio file or a data file on a personal computer (step S162). S169), the process ends.

  FIG. 33 shows a flowchart of a sub-image creation sequence during reproduction. This sequence assumes an example in which a main image has already been reproduced and displayed, and a sub-image is created from this. According to this example, the sub-image can be selected as desired while observing the main image slowly as compared with the case where the sub-image is generated when the apparatus is in the recording state, so that a more accurate sub-image can be obtained. It is done.

  When the sub-image creation operation is started, it is determined whether or not a sub-image already exists (step S171). If a sub-image already exists, a sub-image addition preparation process is executed (step S172). This preparation process is a preparation process such as a sub image data writing format and embedding the sub image data in the main image data. In step S171, when there is no sub-image, step S172 is skipped and the process proceeds to step S173. After executing the sub-image creation process (step S173) and the sub-image recording process (step S174), the file maintenance process (step S175) is executed and the process ends.

  By the way, at the time of interval playback or multi-playback, only the sub-image is played back and becomes effective at high-speed playback search. When there is no sub-image, skip, mute, character display, etc. can be performed.

Next, the sub-image data erasing sequence will be described with reference to the flowchart of FIG.
When the erasing operation is started by inputting an erasing command or the like, first, it is determined whether or not the mode is for erasing only the sub-image (step S181). If so, the presence / absence of the sub-image is determined (step S182). ). Here, if there is a sub-image, it is determined whether or not there is one sub-image (step S183). If there is one sub-image, the sub-image is deleted (step S184), the process is terminated, and one sheet is stored. Otherwise, a sub-image selection process for selecting which sub-image to delete among the plurality of sub-images is executed (step S186), and the process proceeds to step S184.

If it is determined in step S182 that there is no sub-image, a warning that there is no sub-image is displayed on the monitor (step S187). If it is determined in step S181 that the mode is not the sub-image erasure mode, the main image and sub-image are erased (step S188), and the process ends.
Of course, it is possible to delete only the main image in the above processing.

  FIG. 35 is a flowchart showing a sequence of an embodiment for performing batch erasure when a sub-image is written in another file.

  When sub-images are recorded in a batch file, the batch file can be erased at the same time, but there is a desire to delete sub-images accompanying the erasure of the main image in the case of separate files. The present embodiment is a sequence that satisfies this demand.

  First, a process of searching for a sub image and searching for a sub image corresponding to the main image to be deleted is executed using, for example, a file header of the main image or a relational file (step S191). Next, the presence / absence of a sub-image is determined (step S192). If there is a sub-image, the sub-image is deleted (step S193), and the process returns to step S191. If it is determined in step S192 that there is no sub-image, the main image is deleted (step S194), and the process ends.

  Next, an embodiment of an image handling apparatus that transmits sub-image data obtained by the above-described processing via a wired line such as a telephone line or a wireless line will be described.

  FIG. 36 is a flowchart showing a transmission procedure of sub-image data and main image data. In the figure, on the transmission side, after starting the transmission operation, first, only the sub-image data is transmitted (step S201). The receiving side receives the sub-image data and reproduces it (step S301), selects a necessary image (step S302), and transmits designation information such as a frame number and a file name of the selected image to the transmitting side. (Step S303).

  The transmitting side that has received this designation information transmits the main image data of the designated frame number to the receiving side (step S202). On the receiving side, the designated main image data is received, reproduced and confirmed, and then an end signal notifying the end of the operation is transmitted to the transmitting side (step S304), and the processing is ended.

  FIG. 37 is a flowchart of an embodiment in which a sub-image is automatically created and transmitted in real time in response to a request from the receiving side.

  On the transmission side, the reduced sub-image data is automatically created (step S211), and the created sub-image data is transmitted (step S212). The receiving side receives this sub-image and reproduces it (step S311), selects a sub-image creation mode (for example, area selection) of the image (step S312), and transmits the selected creation mode to the transmission side (step S312). Step S313).

On the transmission side, a sub-image is automatically created in the received creation mode (step S213), and the created sub-image is transmitted (step S214).
On the receiving side, after receiving this sub-image, it is reproduced (step S314), a communication end signal is transmitted to the transmitting side (step S315), and the processing is ended.

  The sequence shown in FIG. 37 will be specifically described with reference to FIG. 38. A reduced image (A2) is automatically created from the main image (A1) by thinning-out processing on the transmission side and transmitted as a sub-image (steps S211 and S212). ).

  The receiving side receives and reproduces this sub-image, selects a necessary region portion by area selection based on the reproduced sub-image (B1) (B2), and transmits the area selection information to the transmitting side (step). S311 to S313).

  On the transmission side, based on the received area information, a sub-image (C2) for the area selection unit of the main image (C1) is automatically created and transmitted to the reception side (steps S213 and S214).

  Finally, the receiving side reproduces the received sub-image, reproduces the sub-image that matches the request as shown in (D), and transmits a communication end signal (steps S314 and S315).

It is a configuration block diagram showing an application example of the image handling device according to the present invention to a digital still camera. It is a figure which shows the example of three types of recording aspects in the Example of this invention. It is a figure which shows the example of entry of the file header in the Example of this invention. It is a figure which shows the example of a recording format to the file header in the Example of this invention. It is a figure which shows the recording to a JPEG header in case the main image data in the Example of this invention is compressed and recorded by a JPEG system. It is a figure which shows the example which records the subimage data in the Example of this invention in a separate file from main image data, and records the correlation data of the said data in a relational file. It is a figure which shows the example which records the sub-image data in the file header of the file for main image data, and the sub-image data file in the file header of the file for main image data in the Example of this invention. It is a figure which shows the example which records the main image data and the sub image data in the Example of this invention as a separate file, respectively, and performs identification and correlation of these data by a file name. It is a figure which shows the example of a directory structure which records main image data and sub-image data in a separate file in the Example of this invention, and associates each file with a directory. FIG. 4 is a diagram illustrating an example in which main image data and sub image data are recorded in separate files in the embodiment of the present invention, and the main image file is a separate file, but the sub image files are stored in a batch file. It is a figure which shows the example which designates the image data recording start address in the Example of this invention per cluster. 6 is a flowchart illustrating an operation sequence of the digital still camera according to the embodiment of the present invention. 6 is a flowchart showing an image data recording processing sequence when sub image data is recorded after main image data is recorded in an embodiment of the present invention. It is a flowchart which shows the creation sequence of the sub image creation process in step S25 of FIG. It is a flowchart which shows the procedure of the uncompressed data conversion process in FIG. It is a flowchart which shows the sub image recording process procedure in step S26 of FIG. It is a flowchart which shows the process sequence of writing of the data to a file header. 15 is a flowchart showing a recording processing procedure for sub-image data shown in FIG. 14 in a JPEG header. It is a flowchart which shows the subimage recording sequence which performs the correlation between the image data using the relational file shown in FIG. It is a flowchart which shows the subimage recording sequence which performs the correlation by the file header shown in FIG. It is a flowchart which shows the subimage recording sequence which performs the correlation by the file name shown in FIG. 10 is a flowchart showing a sub-image recording sequence for performing association in the directory shown in FIG. 9. 11 is a flowchart showing a sequence for recording sub image data using the sub image batch file shown in FIG. 10. It is a flowchart which shows the operation | movement sequence at the time of the continuous shooting of the digital still camera in the Example of this invention. FIG. 25 is a flowchart illustrating a sequence example for determining sub-image creation conditions during continuous shooting in step S136 of FIG. 24. FIG. It is a flowchart which shows the sequence which produces a sub image from several main images according to the continuous shooting speed in the Example of this invention. It is a figure which shows the example of a picture IN picture display which displays a sub image simultaneously on the screen in which the main image on the monitor in the Example of this invention is displayed. It is a figure which shows the example which character-displays the frame number and the number information of a subimage in a part (upper right part) of the main image screen currently displayed on the monitor in the Example of this invention. It is a figure which shows the example which sets the area taken out as a sub image from the main image currently displayed on the monitor in the Example of this invention as a selection area with the size of an area as a selection area. It is a figure which shows the example which sets the area taken out as a sub image from the main image currently displayed on the monitor in the Example of this invention as a selection area with the size of an area as a selection area. It is a figure which shows the example which uses the image which reduced and further compressed the main image in the Example of this invention as a subimage. It is a flowchart which shows the reproduction | regeneration sequence of the image in the Example of this invention. It is a flowchart which shows the subimage preparation sequence at the time of reproduction | regeneration in the Example of this invention. It is a flowchart which shows the deletion processing sequence of the sub image in the Example of this invention. It is a flowchart which shows the sequence which performs batch erasure | elimination when a subimage is written by another file in the Example of this invention. It is a flowchart which shows the transmission procedure of the sub image data in the Example of this invention, and main image data. It is a flowchart which shows the process sequence which automatically produces and transmits the subimage in real time according to the request | requirement from the receiving side in the Example of this invention. It is a figure which shows the sequence of FIG. 37 concretely.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Optical system lens 2 Imaging circuit 3 Clamp circuit 4 A / D conversion circuit 5 Digital process circuit 6 D / A conversion circuit 7 Amplification circuit 8 Electronic viewfinder 9 Character generator 10 Memory controller 11 Frame memory 12 DCT / IDCT (discrete cosine conversion) / Inverse discrete cosine transform)
13 Coder / Decoder 14 Auxiliary Memory 15 IC Memory Card 16 System Controller 17 Display Unit 18 Operation Unit 19 Data Input / Output Unit

Claims (1)

An optical system for obtaining a subject image;
An imaging circuit that photoelectrically converts an object image obtained through the optical system into an electrical signal;
An A / D conversion circuit for converting an electrical signal from the imaging circuit into digital data;
A coder for encoding the digital data converted by the A / D conversion circuit;
Recording control means for recording image data encoded by the coder in a storage means ;
Have
A main image file having main image data and a sub image file having a sub image reduced or compressed than the main image are recorded as separate files in the storage means, and a directory for recording only the main image; A camera having a directory structure having a directory for recording only the sub-images, wherein the sub-image data is stored in a batch file so that index display and batch erasure are possible .

Images