JP2003259257A - Method and device for image data processing - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method and a device for image data processing, which easily retrieve an original picture from an index picture and eliminate a need of generating the index picture again even in the case that the original picture has been erased. <P>SOLUTION: A picture recording means records each photographed picture and each of reduction pictures obtained by reducing photographed pictures in a memory card as independent files. A management file for defining the location on the index picture of each reduction picture is generated, and unequivocal correspondence is given to the page number and location information of the index picture between each photographed picture and each reduction picture. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image data processing device and an image data processing method including a digital camera, a printer and the like.

[0002]

2. Description of the Related Art In recent years, a digital camera for digitizing a photographed image to generate a digital image, a printer for displaying a digital image on a monitor, and a print process have been widely used. These digital cameras and printers generally have a function of creating and displaying an index image in which a list of reduced images of captured images is listed as a function of retrieving captured images.

As a publication disclosing an index image recording method in a digital camera, Japanese Patent Application Laid-Open No. 7-143426,
There is Japanese Patent Laid-Open No. 2000-175147. The technical contents of both cases are to create a reduced image of a captured image at the time of capturing an image and record the index image together with the captured image in a recording medium. This index image is created as one unit image by collecting a plurality of reduced images (for example, 9 images).

These two cases are the page number of the index and the layout of a certain reduced image on the index (for example, 2
Since there is no information for associating the photographed image with the third from the left in the column), there are multiple index images for searching the original image of the reduced image specified by the user on the index image. In some cases, it takes time and effort. Furthermore, for these two cases, it is necessary to recreate the entire index image when the captured image is deleted.

[0005]

SUMMARY OF THE INVENTION In consideration of the above circumstances, the present invention makes it possible to easily retrieve a reduced image property on an index, easily retrieve an original image from the index, and even if the original image is deleted. An object of the present invention is to provide an image data processing device and method that do not need to recreate index images.

[0006]

According to a first aspect of the present invention, there is provided an image data processing device for processing a photographed image by an image pickup device, the compiling means for producing a reduced image of the photographed image together with the photographed image, and an image. A recording unit that records data, an image recording unit that records each of the captured image and each of the reduced images in the recording unit as an independent file, and uniquely associates each captured image with each reduced image. Corresponding recording means for recording in the recording section, management file creating means for creating a management file for arranging reduced images of the photographed images for each reduced image and defining an arrangement on an index image, and recording the management file An image data processing device including a management file recording unit for recording in a unit.

According to the first aspect of the present invention, the photographic image (original image) photographed by the imaging device and the reduced image of the photographic image are created by the creating means. The image recording unit records each of the captured image and each of the reduced images in the recording unit as an independent file. The correspondence recording unit uniquely associates each captured image with each reduced image and records them in the recording unit. The unique correspondence means that a specific photographed image and a specific reduced image are associated with each other. The management file creating means creates a management file that defines the arrangement of each reduced image on the index image. The management file recording means records the management file in the recording unit.

Since the arrangement of the reduced image on the index image and the original image can be uniquely specified by using the management file, if an image object on the index in the management file is designated and the original image is searched, the index is searched. You can search for the desired image without displaying multiple images. If there is no management file, the original image can be found only after calculating the frame number of the image specified on the index image from the beginning and searching the original image for that frame.

By using the management file,
When the original image is deleted or added, the management file defines the arrangement of the reduced image that is uniquely associated with the original image. Therefore, the management file only needs to be updated, and the time required to update the index image is shortened. If there is no management file, it is necessary to recreate the index image because it is necessary to update all the index images including the deleted image as well as the index images after that as well.

The recording section includes a built-in fixed recording section and a removable recording section.

According to the present invention of claim 2, in addition to the invention of claim 1, the index image creating means creates an index image from the management file and the reduced image.

According to the present invention of claim 3, the same operation as that of the invention of claim 1 is brought about.

According to the present invention of claim 4, a photographed image is recorded in a recording section such as a removable recording member, and the recorded photographed image is read by the reading means. The creating means creates a reduced image of the read captured image. Other than these, the same effect as the invention of claim 1 is produced.

[0014]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

First, an embodiment in which the image data processing device is a digital camera will be described as a first embodiment.

FIG. 8 is an external view of the digital camera 2.
(A) is a front view and (b) is a rear view.

The digital camera 2 is a digital camera capable of recording and reproducing still images and moving images, and is provided with a retractable lens 66, a finder 68 and a strobe 62 on the front surface of the camera. A CCD image sensor (not shown in FIG. 8, reference numeral 6 in FIG. 1 as an image sensor is provided behind the lens 66.
, And hereinafter referred to as “CCD”. ) Is placed,
The image signal read from the CCD 6 is converted into digital image data through predetermined signal processing.

On the side surface of the digital camera 2, a digital (USB) terminal, a video output terminal, a power input terminal (for example, a terminal for DC IN 3V) and a memory card slot cover (card lid) are provided.

A shutter 6 is provided on the upper surface of the digital camera 2.
4 are provided. The shutter 64 is means for instructing the start of image recording, and is also used as a video recording start / stop button.

A dial key 56 is provided on the rear surface of the camera. The dial key 56 is composed of a dial switch rotatably provided. The dial key 56 is a means for selecting a shooting system mode and a reproduction mode, and further selecting each of continuous shooting mode, manual shooting mode, auto shooting mode, scene position mode, and moving image mode. On the upper surface of the dial key 56, a symbol mark representing each mode (a pictogram or a symbol symbolizing the mode or a combination thereof) is attached. By aligning the mark of the desired mode with the position of an index not shown, Set to mode.

A finder 6 is further provided on the rear surface of the camera.
8, mode display LCD 74, display mode switching key 58,
A cancel key 72, an enter key 70, an arrow key 60, a liquid crystal display 38, etc. are provided.

A mark indicating the operation mode (main mode) of the digital camera 2 is displayed on the mode display LCD 74.

The liquid crystal display 38 is composed of a color liquid crystal display, and displays an image captured via the CCD 6 and a reproduced image read from the memory card 12, and also displays mode information, a battery remaining amount warning, a photographing date and time, Various information such as the standard number of shots and playback frame number is also displayed. Also, various menu displays, arrow keys 6
Menu selection using 0, setting of various setting items in each menu, and the like are also performed using the display screen of the liquid crystal display 38.

The display mode switching key 58 is an operating means for switching between single screen reproduction and index reproduction.

The enter key 70 is used when the normal screen of each mode is changed to the menu screen, or in the menu screen of each mode, the selection items are validated and the normal screen (when there are a plurality of menu layers, It is used when transitioning to the previous screen). Specifically, menu display in shooting mode and playback mode, selection item confirmation, deletion item selection confirmation and deletion execution, protection item selection confirmation execution, print designation item selection confirmation execution, menu item selection It is used for confirmation, selection confirmation of date and time setting, return to the shooting menu, and the like.

For example, in the setup menu, various setting items such as recording image quality (quality), number of pixels, ON / OFF selection of the liquid crystal display 38 at startup, auto power off time, opening screen display setting, date and time setting, etc. There is. The photographer operates the up / down keys of the arrow key 60 to select the item to be changed from the setup screen, change the setting contents with the left / right keys, and then press the enter key 70.
Confirm with.

The cancel key 72 is used to cancel (cancel) the item selected from the menu or to return to the previous operation state (undo).

FIG. 1 is a block diagram of a digital camera 2 according to the first embodiment of the present invention.

The light that has passed through the taking lens enters the CCD 6. Photosensors are two-dimensionally arranged on the light-receiving surface of the CCD 6, and the subject image formed on the light-receiving surface of the CCD 6 via the taking lens is converted into signal charges of an amount corresponding to the amount of incident light by each photosensor. To be converted. In addition, CCD
Reference numeral 6 has a so-called electronic shutter function for controlling the charge storage time (shutter speed) of each photosensor according to the timing of the shutter gate pulse.

The signal charge accumulated in each photosensor is
The CCD controller 8 sequentially reads out as a voltage signal (image signal) corresponding to the signal charge, performs correlated double sampling (CDS) processing and color separation processing into each color signal of R, G, B, and the signal level of each color signal. Is adjusted (pre-white balance processing) and converted to a digital signal,
It is sent to the frame memory controller 26 and stored in the frame memory 36. The image data once stored in the frame memory 36 is stored in the frame memory controller 26.
Is sent to and stored in the work memory 24 via. The image data stored in the work memory 24 is processed by an AF (auto focus) control section 10 and an AE (auto exposure) control section 16 to generate luminance / color difference signals, gamma correction, sharpness correction, and contrast correction. Image signal processing such as white balance correction is performed by the CPU
The command from 20 is performed. AF control unit 10,
The image data input to the AE control unit 16 is converted into a luminance signal (Y signal) and a color difference signal (Cr, Cb signal), and subjected to a predetermined process such as gamma correction, and then stored in the work memory 24. Is stored.

When displaying and outputting a photographed image, the luminance / color difference signal (abbreviated as YC signal) stored in the work memory 24 is sent to the frame memory 36 via the system bus 18 and the frame memory controller 26. The data stored in the frame memory 36 is sent to the digital encoder 34 via the frame memory controller 26, where the OSD (On Screen Display) is performed.
y) A signal of a predetermined system for display together with character and symbol data supplied from the controller 32 (for example, NTSC
System color composite video signal) is converted. The OSD controller 32 is controlled by the CPU 20. The output of the digital encoder 34 is D / A converted into an analog signal and then output to an LCD (liquid crystal display) 38. In this way, the image content of the image data is displayed on the screen of the liquid crystal display 38.

The image data in the frame memory 36 is periodically rewritten by the image signal output from the CCD 6, and the video signal generated from the image data is supplied to the liquid crystal display 38 to be input via the CCD 6. The image to be displayed is the liquid crystal display 3 in real time.
8 is displayed. The photographer can see the image (through image) displayed on the liquid crystal display 38 or the viewfinder 68.
You can check the shooting angle of view.

When the photographing mode is selected by the dial key 56 and the shutter 64 is pressed, a photographing start instruction (release ON) signal is issued. In response to the reception of this instruction signal, the CPU 20 starts capturing image data for recording. The CPU 20 also sends a command to the compression / expansion engine 28, which causes the compression / expansion engine 28 to send the image data in the frame memory 36 to JPEG.
Compress according to another predetermined format.

The compressed image data is recorded in the memory card 12 via the memory card interface 14. In the digital camera 2 of this example, a smart media (Solid-Stat
e Floppy Disk Card) is applied. The form of the recording medium is not limited to this, and may be a PC card, a compact flash (registered trademark), a magnetic disk, an optical disk, a magneto-optical disk, a memory stick, or the like, and may be electronic, magnetic, or optical, or a combination thereof. Various types of readable and writable media can be used according to the above method. The signal processing means and interface according to the medium used are applied. Regardless of recording media of different types or the same type, a plurality of media may be mountable. The means for storing the data is not limited to the removable medium that can be attached to and detached from the camera body, but may be a recording medium (internal memory) built in the digital camera 2.

When the reproduction mode is selected by the dial key 56, the final file recorded on the memory card 12 (the last recorded file) is read out. When the final file is an image file, the image data of the image file (the first frame in the case of a moving image) is expanded by the compression / expansion engine 28, and the liquid crystal is passed through the frame memory 36 and the digital encoder 34. It is output to the display 38.

By operating the left / right keys of the arrow keys 60, frame advance (file advance) in the forward or reverse direction
The next file that has been frame-advanced can be read from the memory card 12, and a still image can be read in the same manner as above.
The video is played.

The CPU 20 is a control unit that controls the camera system. The CPU 20 controls the operation of the corresponding circuit based on the input signal received from the power switch, the shutter 64, and other operation units, and controls the display on the liquid crystal display 38, the flash emission control, the AF control, the AE control, and the auto white. Balance (AWB) control, electronic zoom control, etc. are performed. CPU20 is CCD6
Various calculations such as focus evaluation calculation and AE calculation are performed based on the image data input via the, and the lens 66 is moved to the in-focus position based on the calculation result, or the aperture is set to an appropriate aperture value. , The zoom 4 is driven, and the charge storage time of the CCD 6 is controlled.

The ROM 22 stores a program processed by the CPU 20 and various data necessary for control, and the work memory 24 has a work area in which the CPU 20 performs various arithmetic processings in addition to the image processing area.

FIG. 2 is a diagram showing a file structure of image data stored in the memory card 12. In the folder “ROOT”, DCIM which is a holder of a photographed image (original image), THUM which is a holder of an image (index image) which is a reduced photographed image, and INDEX. There is TXT.

The index image, which is a collection of reduced images, is used for the overview and retrieval of photographed images.

The DCIM has a plurality of holders, and each holder has a plurality of image files in which the information of one photographed image is directly recorded. The name of this holder is composed of a 3-digit numerical value and a 5-character arbitrary character string. The 3-digit number is always different from other holders on the same level holder. The name of the image file is composed of an arbitrary character string of 4 characters and a 4-digit numerical value. The 4-digit number is always different from other image files in the same folder.

The holder and file structure of the reduced image are similar to those of the photographed image. However, the numerical part of each holder name and each file name of the reduced image is the same as the numerical part of the holder name and file name of the corresponding captured image.

The index management file is the INDEX. It is stored in a holder called TXT.
The index management file records which frame of which holder of the index (reduced image) each frame of the captured image is in.

The structure of the index management file will be described. FIG. 3 is a diagram for explaining the structure of the index management file, and FIG. 4 is a diagram for showing the arrangement of reduced images on the index screen.

The index management file is recorded in text format. In the recording portion, first, the frame arrangement per screen of the index image is written. Here, it is written as 3 * 3, and it is indicated that the image is an index image of three vertical and horizontal frames. Next, the page number, the layout on the index screen, the holder name constant, and the file name constant are described in this order. The page number is a number indicating which page the index reduced image is. The arrangement on the index screen shows where the reduced image is arranged on the index screen.
The layout numbers on the index screen are shown in FIG.
The constant of the holder name is the same as the numerical part of the holder name of the reduced image in FIG. The file name constants are also the same as the numerical part of the file name of the reduced image in FIG. Therefore, the index management file describes in which page and in which frame each reduced image is written, and a one-to-one correspondence with the photographed image (original image) is obtained by the constant of the holder name and the constant of the file name. Correspondence is clear.

The flow of recording a reduced image with the digital camera 2 in the first embodiment will be described below.
FIG. 5 is a flowchart showing the flow of recording a reduced image.

When an image is taken by the digital camera 2, the taken image (original image) is recorded in the memory card 12, and when the original image (taken image) is taken into the frame memory 36, the original image is thinned out on the work memory 24. To create a reduced image (step 40). The created reduced image is compressed by the compression / expansion engine 28 in the same format as the original image to create a JPEG file (step 42).
The compressed reduced image is recorded in the memory card 12 (step 44). Memory card 1 for captured images and reduced images
The index management file is updated by recording the data in step 2 (step 46). Information about the newly recorded image is recorded in the index management file as the last image of the index.

Next, the flow of displaying the index image on the liquid crystal display 38 of the digital camera 2 will be described. FIG. 6 is a flowchart showing the flow when the index image is displayed.

Reduced images are sequentially read from the first frame of the display page from the index management file, expanded, and arranged on the index screen (step 48). This procedure is repeated for one page (step 50). That is, in this embodiment, 9 frames are performed. As a result, the index image is formed on the frame memory 36 and displayed on the liquid crystal display 38.

Next, the flow of erasing the original image on the liquid crystal display 38 of the digital camera 2 will be described. FIG. 7 is a flowchart showing the flow when the original image is erased.

The original image or reduced image to be erased is designated on the liquid crystal display 38 to erase the original image and reduced image (step 52). The index management file is updated by deleting the photographed image and the reduced image from the memory card 12 (step 54). In the index management file, the information of the erased image is erased, and the succeeding images are arranged frontward. At this time, the arrangement number of the subsequent reduced image on the index screen is incremented by one in the index management file, but the constants of the holder name and the file name of the subsequent reduced image must match the constants of the original image. There is no change.

When a reduced image is newly added or deleted as described above, the index management file is updated and the index image is automatically updated accordingly, so that the reduced image is collected as in the conventional case. It is not necessary to recreate the index image as one image.

An operation of the digital camera 2 when an image is designated by displaying an index on the liquid crystal display 38 for reproducing and displaying the original image and deleting the original image will be described. FIG. 9 shows the liquid crystal display 38 of the digital camera 2.
It is a figure when an index screen is displayed above. FIG. 10 is a flowchart showing the flow of a method of designating an image on the index screen.

First, the digital keypad 56 is set to the reproduction mode of the digital camera 2 (step 76). Index reproduction is selected by the display mode switching key 58 (step 78). The first page of the index screen is displayed.
At the upper left of the index screen, a page number indicating the page number of the index display is displayed. At the upper right of the index screen, the frame number of the currently specified frame is displayed. In the image of the index screen, a red frame is attached to the currently designated reduced image.

Next, the image is designated on the index with the arrow keys 60 (step 80). When designating the image on the index page currently displayed, the arrow keys 60 up, down, left and right are pressed once to request. The reduced image to be designated is directly designated as an image (step 82). When the enter key 70 is pressed at the designated reduced image, the original image corresponding to the reduced image is displayed. When it is desired to change the index page, the left and right arrow keys 60 are continuously pressed to continuously switch the page number display, and when the hand is released, the page number is fixed and the designated page is reproduced (step 84).

Therefore, for example, when the 86th page index screen is to be displayed, the left and right arrow keys 60 are continuously pressed and the arrow key 60 is released at the 86th page to display the target index screen, and the reduced image is displayed. Since the captured image and the captured image are associated with each other by the index management file, if the reduced image is designated and executed there, the original image is reproduced and displayed. Therefore, it is not necessary to search for the original image of the reduced image.

Next, an embodiment in which the image data processing device is a printer will be described as a second embodiment.
Here, a printer that prints an image captured by the digital camera 2 will be described. The same configuration as in the first embodiment,
The description of the operation will be omitted, and the contents peculiar to the printer will be described.

FIG. 11 is a block diagram showing the structure of the printer 86.

The memory card 12 storing the photographed image is inserted into the memory card interface 88. It is assumed that the memory card 12 does not store index images (reduced images).

The image data read from the memory card 12 is sent to the frame memory controller 94 and temporarily stored in the frame memory 90. Frame memory 9
The image data saved in 0 is sent to the work memory 112 and stored therein. The image data stored in the work memory 112 is subjected to image signal processing such as white balance correction according to a command from the CPU 108, compressed by the compression / expansion engine 92, and stored in the memory card 12.

In the work memory 112, photographed images (original images) are thinned out to create reduced images. The created reduced image is compressed by the compression / expansion engine 92, and a JPEG file is created and stored in the memory card 12. In addition, the index management file creation program is a ROM
The index management file is stored in 110, and an index management file is created in association with the creation of the reduced image and stored in the memory card 12.

When displaying and outputting the photographed image and the index (reduced) image, after the image data is read from the memory card 12 and expanded by the compression / expansion engine 92,
Stored in the frame memory 90 and stored in the OSD (On Scr
It is converted into a signal of a predetermined system for display together with the character and symbol data supplied from the een Display 96. The converted image data is converted into an analog signal and then output to the LCD (liquid crystal display) 98 of the printer 86. In this way, the captured image and the index image are displayed on the screen of the liquid crystal display 98.

The CPU 108 is a control unit for controlling the printer 86 as a whole. The CPU 108 controls the operation of the corresponding circuit based on an input signal received from a power switch or other operation unit, controls the compression / expansion engine 92, controls the display on the liquid crystal display 98, controls the image correction, and the like. . The ROM 110 stores a program processed by the CPU 108, various data necessary for control, and the like. The work memory 112 stores the image processing area and the CPU 1
Reference numeral 08 has a work area for performing various kinds of arithmetic processing.

The image data stored in the printer 86 is
Printing can be performed by the printer driving unit 104 via the SCSI interface 102.

In this way, the reduced image is automatically recorded on the memory card 12 once applied to the printer 86, and the index image processing can be speeded up in the next and subsequent operations. Therefore, even in the printer, the captured image (original image) and the index image can be associated with each other by the index management file.

Further, in the case of a printer which does not have a reduced image creation function, it is essential that the digital camera has a function of creating an index management file and a reduced image. If the printer has a function of generating an image in the index state, the function of the digital camera becomes more effective.

Further, when the number of frames of the index image differs between devices such as digital cameras and printers (for example,
By recording the index management file peculiar to the device, it is possible to absorb the difference between the devices, such as 9 for the A camera and 16 for the B camera.

[0068]

According to the present invention of claims 1 and 3, since the original image can be searched directly from the management file, the time from the designation of the image property on the index to the search of the original image can be shortened. Moreover, when the original image is deleted or the original image is added, the index image can be easily updated by using the management file, which is convenient.

According to the present invention of claim 2, since the index image can be created from the management file and the reduced image,
It is possible to easily create a new index image and recreate it when there is a change in the index image.

According to the present invention of claim 4, a reduced image can be created by reading a captured image. Therefore, even in a device such as a printer which does not directly create a captured image, the same effect as that of the invention of claim 1 can be obtained. be able to.

[Brief description of drawings]

FIG. 1 is a block diagram of a digital camera according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a file structure of image data stored in a memory card.

FIG. 3 is a diagram illustrating a configuration of an index management file.

FIG. 4 is a diagram showing an arrangement state of reduced images on an index screen.

FIG. 5 is a flowchart showing a flow of recording a reduced image.

FIG. 6 is a flowchart showing a flow when an index image is displayed.

FIG. 7 is a flowchart showing a flow at the time of erasing an original image.

FIG. 8 is an external view of a digital camera, (a) is a front view and (b) is a rear view.

FIG. 9 is a diagram when an index screen is displayed on a liquid crystal display of a digital camera.

FIG. 10 is a flowchart showing a flow of a method of designating an image on the index screen.

FIG. 11 is a block diagram showing the configuration of a printer.

[Explanation of symbols]

2 ... Digital camera, 6 ... CCD, 8 ... CCD control unit,
12 ... Memory card, 20 ... CPU, 24 ... Work memory, 28 ... Compression / expansion engine, 32 ... OSD controller, 34 ... Digital encoder, 36 ... Frame memory, 38 ... LCD, 90 ... Frame memory, 92 ... Compression / expansion Engine, 96 ... OSD, 98 ... Liquid crystal display, 108 ... CPU, 112 ... Work memory

Claims (4)

[Claims] 1. An image data processing device for processing a captured image by an imaging device, comprising: a creating means for creating a reduced image of the captured image together with the captured image; a recording section for recording image data; Image recording means for recording each and each of the reduced images as independent files in the recording section, and corresponding recording means for uniquely corresponding each captured image and each reduced image in the recording section, A management file creating unit that creates a management file that defines an arrangement on the index image that lists the reduced images of the captured images with respect to the reduced images, and a management file recording unit that records the management file in the recording unit. Image data processing device. 2. The image data processing apparatus according to claim 1, further comprising index image creating means for creating an index image from the management file and the reduced image. 3. An image data processing method for processing a picked-up image by an imaging device, wherein a reduced image of the picked-up image is created together with the picked-up image, and each of the picked-up image and each of the reduced images are made into independent files. The image is recorded in the recording unit, each photographed image and each reduced image are uniquely associated with each other, and recorded in the recording unit, and the arrangement on the index image for listing the reduced images of the photographed image for each reduced image is determined. An image data processing method for creating a management file and recording the management file in the recording unit. 4. An image data processing device for processing a picked-up image by an image pickup device, comprising: reading means for reading the picked-up image recorded in a recording section; and creating means for creating a reduced image of the read picked-up image. An image recording unit that records each of the captured images and each of the reduced images as independent files in the recording unit, and a corresponding record that uniquely associates each captured image with each reduced image in the recording unit. Means, management file creating means for creating a management file that defines an arrangement on the index image for listing the reduced images of the captured images for each reduced image, and management file recording means for recording the management file in the recording unit And an image data processing device.