JPH11262030A - Digital still camera and its operation control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To comparatively easily classify image data (image file) obtained by using a digital still camera to photograph an object and to store the image data. SOLUTION: This digital still camera 10 photographs a photographing reference board with a keyword described thereon together with an object. The keyword is extracted from object image data, denoting the object image and the image of the photographing reference board and stored in an image file and recorded on a memory card. The memory card is loaded to an image file automatic classifying system, and the keyword is read from the image file recorded on the memory card. The image file is classified to be stored in a corresponding folder, based on the read keyword.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a digital still camera, an operation control method thereof, an image data classifying device and method, a database creating device and method, and a photographing reference board used when photographing a subject with the digital still camera. About.

[0002]

2. Description of the Related Art When a subject is imaged by a digital still camera, image data representing the subject image is recorded on a recording medium such as a memory card. When the capacity of the memory card becomes full, the image data recorded on the memory card is read out by a personal computer or the like and recorded on a hard disk or other recording medium.

When image data is recorded on a recording medium by a personal computer or the like, if the number of image data increases, it becomes complicated and it becomes difficult to understand what kind of image is represented. Several folders are created correspondingly, and image data (image files) are stored in the corresponding folders. The storage of the image data in the corresponding folder is generally performed by dragging icons representing the image data one by one using a mouse.

However, such a drag operation is troublesome, and becomes more complicated as the number of image data increases.

[0005]

SUMMARY OF THE INVENTION It is an object of the present invention to relatively easily classify and store image data (image files) obtained by imaging using a digital still camera. I do.

Another object of the present invention is to relatively easily perform color correction of a subject image obtained by photographing.

[0007] A digital still camera according to a first aspect of the present invention is a digital still camera which outputs shooting target image data representing a shooting target image including an image of a reference board in which information about a subject is represented by a color and a subject image representing the subject. Means, subject information extracting means for extracting data representing subject information in the reference board image from the photographing target image data outputted from the photographing means, and photographing target image data outputted from the photographing means and the subject information And a means for outputting the object information data extracted by the extracting means in association with the object information data.

[0008] The first invention is the above digital still.
An operation control method suitable for a camera is also provided. That is, in this method, a reference board in which information about a subject is represented by a color is photographed together with the subject, and photographing target image data representing a photographing target image including the subject image representing the subject and the reference board image representing the reference board is obtained. Extracting data representing subject information in the reference board image from the obtained photographing target image data, and outputting the photographing target image data obtained by photographing in association with the extracted subject information data. It is characterized by.

The object image data and the subject information data recorded on the recording medium according to the first invention are read and classified as follows. The invention for this classification is the second invention.

An image data recording apparatus according to a second aspect of the present invention
The target image data representing the target image representing the target image including the subject image representing the subject and the reference board image representing the reference board in which information about the subject is represented by color is associated with the corresponding subject information data. Reading means for reading the subject image data and the subject information data from a recording medium recorded and recorded on the basis of the subject information represented by the subject information data read by the reading means. It is characterized by comprising a classification means for classifying the target image data.

The second invention also provides a method suitable for the image data recording device. That is, this method corresponds to shooting target image data representing a shooting target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by color. The photographing target image data and the subject information data are read from a recording medium in which the subject information data is recorded in association with the subject information data, and the photographing target is read based on the subject information represented by the read subject information data. It is characterized by classifying image data.

[0012] A program for implementing the image data classification method may be stored in a recording medium.

According to the present invention, the reference board is photographed together with the subject. By this photographing, the photographing target image data is obtained. The subject information is extracted from the obtained photographing target image data. The photographing target image data and the subject information are output in association with each other, and are recorded on, for example, a recording medium.

In the above, there is further provided reference board position information input means for inputting reference board position information indicating the position of the reference board image on the image to be captured.
It is preferable that the subject information extracting means extracts data representing the subject information based on the reference board position information input from the reference board position information input means.

Since the position information of the reference board is inputted by the reference board position input means, it is relatively easy to extract the data representing the subject information based on the inputted reference board position information.

When the photographing target image data and the subject image information are recorded on the recording medium, the photographing target image data and the subject image information are read. The shooting target image data is classified based on the read subject information.

The user can classify the icons representing the image data to be shot without dragging them one by one according to the type of image data.

Further, it is possible to create a database of the image data to be photographed based on the object information.

According to a third aspect of the present invention, there is provided a digital still camera for outputting shooting target image data representing a shooting target image including an image of a reference board in which information about a subject is represented by a color and a subject image representing the subject. Means, reference board position information input means for inputting reference board position information indicating the position of the reference board image on the image to be shot, and image data to be shot and reference board position information input means output from the image sensing means And a means for outputting the reference board position information corresponding to the corresponding reference board position information input from the server.

A third aspect of the present invention relates to the above digital still.
An operation control method suitable for a camera is also provided. That is, a reference board in which information on a subject is represented by a color is photographed together with the subject, and photographing target image data representing a photographing target image including a subject image representing the subject and a reference board image representing the reference board is obtained. Reference board position information indicating the position of the reference board image on the target image is input, and the target image data obtained by shooting and the corresponding reference board position information input are output in association with each other.

The target image data and the reference board position information recorded on the recording medium according to the third invention are read as follows, and the target image data is classified. The invention for this classification is the fourth invention.

An image data classification device according to a fourth aspect of the present invention
Imaging target image data representing an imaging target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a reference board position representing a corresponding position of the reference board image Reading means for reading the image data to be shot and the reference board position information from a recording medium in which information is recorded in association with the information; and the reading means based on the reference board position information read by the reading means. Subject information extracting means for extracting subject information in the reference board image from the photographing target image data read by the above, and classifying the photographing target image data based on the subject information extracted by the subject information extracting means It is characterized by having classification means.

The fourth invention also provides a method suitable for the image data classification device. That is, shooting target image data representing a shooting target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a reference representing the position of the corresponding reference board image. Reading the target image data and the reference board position information from a recording medium in which the board position information is recorded in association with the board position information,
Based on the read reference board position information, subject information in the reference board image is extracted from the read shooting target image data, and the shooting target image data is classified based on the extracted subject information. Things.

A recording medium storing a program for executing the above-described image data recording method may be configured.

According to the present invention, the reference board is photographed together with the subject. By this photographing, the photographing target image data is obtained. Further, the position information of the reference board is input. The input position information of the reference board and the image data to be shot are recorded in a recording medium in association with each other.

When the position information of the reference board and the image data to be photographed are recorded on the recording medium, the position information and the image data to be photographed are read.
The subject information in the reference board image is extracted from the photographing target image data based on the read position information. The imaging target image data is classified based on the extracted subject information.

According to the present invention, the user can classify the image data without dragging the icons representing the image data.

Preferably, the reference board includes a reference color for color correction. By the color correction, the photographing target image becomes an appropriate color. Since the photographing target image has an appropriate color, the extraction of the subject information is also accurate.

Before recording the image data to be captured on the recording medium, color correction may be performed, and the color-corrected image data to be captured may be recorded on the first recording medium,
The color correction may be performed before recording the image data to be captured on the recording medium, and the color-corrected image data to be captured may be recorded on the second recording medium. Also in this case, a database of the image data to be photographed can be created based on the extracted subject information.

In this case as well, a database of the image data to be photographed can be created based on the extracted subject information.

A digital still camera according to a fifth aspect of the present invention is a photographing means for photographing a subject and outputting image data representing the subject image, and a display screen for displaying a subject image represented by the image data output from the photographing means. A display device to be displayed on the top, cursor control means for controlling a surrounding cursor, which is specified by surrounding a part of the subject image displayed on the display screen of the display device, to be displayed on the display screen of the display device; And a means for outputting the image data output from the photographing means in association with data representing the position of the surrounding cursor.

According to the present invention, a subject image is displayed on the display screen of the display device by photographing. By surrounding a part of the subject image displayed on the display screen, a cursor for specifying the part of the subject image is displayed. When a subject is imaged, data representing a position surrounded by the cursor is output in association with data representing the subject image, and is recorded on, for example, a recording medium.

Since a partial image of the subject image is surrounded by the cursor, the partial image portion can be clearly specified.

A digital still camera according to a sixth aspect of the present invention is a digital still camera which outputs shooting target image data representing a shooting target image including a reference board image including a reference color for color correction and a subject image representing a subject. Means, reference color data extracting means for extracting data representing a reference color in the reference board image from the image data to be shot output from the image capturing means, and the reference color data extracted by the reference color data extracting means A color correction means for correcting the color of the photographing target image data by using the image processing means, and a means for outputting the photographing target image data color-corrected by the color correcting means.

According to the present invention, the subject image data is output by photographing the subject together with the reference board. The reference color data is extracted from the target image data, and the target image data is subjected to color correction using the extracted reference color data. The color-corrected target image data is output and stored in, for example, a recording medium.

The target image data recorded on the recording medium is image data on which appropriate color correction has been performed.

Information about the subject is represented by the color,
The photographing reference board representing the reference color for color correction of the subject image obtained by the photographing may be configured alone.

An image represented by image data obtained when a photographing reference board is photographed can be subjected to color correction using the image data of the above-mentioned reference color.

[0039]

DESCRIPTION OF THE EMBODIMENTS (1) First Embodiment FIG. 1 conceptually shows a procedure of automatic classification of image files according to a first embodiment.

In the first embodiment, a photographing reference board in which a keyword (information on a subject) is described is prepared, and the subject is photographed by the digital still camera 10 together with the photographing reference board. In the digital still camera 10, target image data representing a target image including the subject and the photographing reference board is obtained.

In the digital still camera 10,
A keyword described on the photographing reference board is extracted from the target image data, and an image file in which the keyword is stored in the header data recording area is obtained. The image file is recorded on a memory card mounted on the digital still camera 10.

When the memory card is removed from the digital still camera 10 and the memory card is inserted into the automatic image file classification system, the image file is stored in a folder corresponding to the keyword. The keywords are stored in the database. More details will become apparent from the description below.

FIG. 2 shows a photographing reference board photographed together with a subject.

On the photographing reference board, a reference color display area A1 in which a number of reference colors (gray, red, blue, yellow, white, black, etc.) are displayed, an application-specific description area A2 in which a user can freely write, and A keyword / card pasting area A3 is included. The size and position of each of these areas are predetermined.

In this embodiment, it is supposed that the subject is a construction site, and the use-specific description area A2 contains
The name of the construction, the type of construction, the contents of the construction, and the drawings are described. Needless to say, the subject is not limited to the construction site, but may be another object.

A plurality of keyword cards can be attached to the keyword card attaching area A3. A keyword is expressed by combining a plurality of keyword cards or by one keyword card. In this embodiment, the keywords are represented by numerals (of course, they may be represented by kanji, hiragana, etc.). A color is painted on the surface of the keyword card, and a corresponding numeral (keyword) is defined by the color. Therefore, a keyword card of a desired color is selected to express a desired keyword, and is attached to the keyword card attaching section of the photographing reference board.

In the example shown in FIG. 2, one red keyword card is affixed to the field of the construction name in the application section description section A2. The red keyword card indicates the keyword “1”. The keyword for the construction name "1" is XX
It is decided in advance that this is a new building construction,
By looking at the red keyword card affixed to the field of the construction name, it can be seen that the subject photographed together with the reference board is that of a new construction of the XX building.

In the column of construction type, a red keyword card indicating "1" and a keyword card indicating "2" are affixed, which indicates that it is a tile construction. . In addition, in the column of construction content, “1-12
A keyword card stating "-15" is affixed, indicating that this is mortar work.

In any case, a keyword card having a color painted on its surface is attached to the keyword card attaching section A3 of the photographing reference board, thereby indicating a keyword representing information on the subject.

FIG. 3 shows the relationship between a keyword and its meaning. The meaning of the keyword includes a folder classification and a database keyword. Folder classification is
This indicates whether the image file is stored in the folder, and if so, which folder name is stored in the folder. The database keyword indicates a keyword stored in the database.
For example, if the keyword is “1”, the image file having the keyword “1” is not stored in the folder,
The database keyword indicates that "new building of XX building". If the keyword is “1-12-15”, the image file having the keyword “1-12-15” is stored in a folder having a folder name of ○ new building construction ￥ tile construction ￥ mortar.

FIG. 4 shows the appearance of the digital still camera 10. FIG. 5 shows a liquid crystal screen provided on the back of the digital still camera.

A liquid crystal screen for displaying a subject image is provided on the back of the digital still camera 10.
In the digital still camera 10 according to this embodiment, a reference board position designation cursor C is displayed on the liquid crystal screen in order to designate the position of the photographing reference board photographed together with the subject.

On the upper surface of the digital still camera 10, there is provided a shutter release button which is pressed when shooting an object.
Button 11, reference board position designation cursor C on LCD screen 19
Reference board position specification cursor display button 12 that is pressed when displayed above, reference board position specification cursor display button 13 that is pressed when specifying the origin of the reference board position specification cursor, and vertical length of the reference board position specification cursor Vertical button 14, which is pressed to specify the size, horizontal button 15, which is used to specify the horizontal length of the reference board position specification cursor, plus button, which is pressed to increase the size of the reference board position specification cursor 17 and a minus button 18 which is pressed to reduce the size of the reference board position designation cursor are provided.

By operating these buttons 12 to 17, the user moves the reference board position designation C cursor so as to surround the photographing reference board image displayed on the liquid crystal display screen 19.

FIG. 6 is a block diagram showing the electrical configuration of the digital still camera.

The overall operation of the digital still camera is controlled by the CPU 1. Each of the above buttons 11 ~
A signal indicating the depression of 17 is input to the CPU 1. CP
Image data representing the cursor C is generated by U1, and the cursor is displayed on the display screen 19 in response to the depression of the buttons 12 to 17.

When the subject is imaged together with the reference board by the imaging circuit 2, a target image signal representing a target image including the subject image and the reference board image is output.
The target image signal output from the imaging circuit 2 is input to the analog processing circuit 3, amplified, and input to the analog / digital conversion circuit 4. The target image signal is converted into digital target image data in the analog / digital conversion circuit 4 and is temporarily stored in the frame memory 5.

The digital object image data is read from the frame memory 5 and returned to the analog object image signal in the digital / analog conversion circuit 6. When the analog target image signal is supplied to the liquid crystal display device 19, the target image captured is displayed on the display screen of the liquid crystal display device 19.

The digital still camera can also record the image data to be shot on the memory card 20.
The image data to be captured temporarily stored in the frame memory 5 is read out from the frame memory 5 and read out from the compression / expansion circuit 8.
To enter. The image data to be captured is subjected to data compression in a compression / expansion circuit 9. Under the control of the card control circuit 9, the data of the image data to be photographed, which has been compressed, is recorded on a memory card 20 mounted on the digital still camera.

FIG. 7 shows an example in which a target image is photographed using the digital still camera 10 and the digital still camera is used.
In step 10, keywords are extracted from the target image data,
When a keyword and target image data are recorded on a memory card, and the memory card is loaded into a personal computer, so that an image file storing the target image data is stored in an image file corresponding to the keyword. 6 is a flowchart showing the processing procedure of FIG.

A photographing reference board is prepared, and a keyword card for specifying a keyword corresponding to the subject is attached to the keyword card attaching area A3 of the photographing reference board (step 31).

Subsequently, the digital still camera 10
Is turned on (step 32), and the photographing reference board is placed near the subject. When the shooting reference board is shot with the subject, a digital still camera
The target image including the shooting reference board image in addition to the subject image is displayed on the LCD screen 19 of Step 10 (Step 3).
3).

When the arrangement of the photographing reference board is determined while looking at the photographing reference board image IB displayed on the liquid crystal screen (step 34), when the button 12 is pressed, the reference board position is displayed on the liquid crystal screen 19. The designated cursor C is displayed. By operating the buttons 13 to 17, the display position and size of the reference board position designation cursor C are determined so as to surround the photographing reference board image IB displayed on the liquid crystal screen 19 (step 35).

Specifically, after the origin button 13 is pressed, the plus button 16 is pressed to move the origin (the upper left vertex) of the cursor in the horizontal positive direction, and the minus button 17 is pressed. When pressed, the origin of the cursor moves in the horizontal negative direction. When the origin button 13 is pressed again, the X coordinate of the origin of the cursor is determined. Thereafter, when the plus button 16 is pressed, the origin of the cursor moves in the vertical positive direction, and when the minus button 17 is pressed, the origin of the cursor moves in the vertical negative direction. When the origin button 13 is pressed again, the Y coordinate of the cursor origin is determined. Thus, the origin position of the cursor is determined. The origin of the cursor is made to coincide with the origin of the photographing reference board image.

Next, after the vertical button 14 is pressed, the cursor height is raised by pressing the plus button 16 and the cursor height is lowered by pressing the minus button 17. By operating these buttons, the height of the cursor is matched with the height of the photographing reference board image. Further, if the plus button 16 is pressed after the horizontal button 15 is pressed, the horizontal width of the cursor increases, and if the minus button 17 is pressed, the horizontal width of the cursor narrows. The width of the cursor is made to match the width of the photographing reference board image.

When the photographing reference board image IB displayed on the liquid crystal display screen 19 coincides with the reference board position designation cursor C, the subject and the photographing reference board are photographed simultaneously (step 36). By photographing, photographing target image data representing a photographing target image including a subject image and a photographing reference board image is temporarily stored in the memory 7 (step 37).

When the image data to be photographed is temporarily stored in the memory 7, a keyword is extracted from the image data to be photographed (step 38). Details of this keyword extraction processing will be described later.

An image file is created, the image data to be photographed temporarily stored in the memory 7, data indicating the position coordinates of the origin of the reference board position designating cursor C determined by button operation, width and height, and The keyword is stored (step 39). The image file is recorded on the memory card 20 (Step 40).

Thus, the image file is stored in the memory
When recorded on the card 20, the memory card 20 is removed from the digital still camera 10 and mounted on the image file classification system. The image files recorded on the memory card 20 are stored in corresponding folders according to the keywords, thereby classifying the image files (step 41). Detailed processing of the image file classification processing will be described later.

FIG. 8 shows the format of an image file recorded on the memory card 20.

The image file includes a header data recording area and an image data recording area.

The header data recording area is an area for recording additional information of image data recorded in the image data recording area. In the header data recording area, an area for storing data representing an image size, an image file name, a photographing date and time, and a shutter speed indicating a data amount of image data recorded in the image data recording area, a reference board position designation cursor Area for storing the data representing the position coordinates of the origin, the data representing the width of the reference board position designation cursor and the data representing the height of the reference board position designation cursor, and the area for storing the extracted keywords (FIG. 8). (Five keyword recording areas from a first keyword recording area to a fifth keyword recording area are set).

FIG. 9 is a flowchart showing a processing procedure for extracting a keyword from image data to be captured.

The input reference board position designation cursor C
Assuming that the image in the area surrounded by is the image of the shooting reference board, image data representing the image surrounded by the cursor is extracted from the shooting target image data (step 51).

The positions and sizes of the areas A1, A2 and A3 of the reference board for photographing object are determined in advance, and the positions of the respective reference colors in the area A1 can be determined from the reference board image for photographing object. Data representing each reference color is extracted from the reference board image for photographing target (step 52).

When data representing each reference color is extracted,
Color correction parameters are created (step 53), and color correction of the image data to be captured is performed using the created parameters (step 54). The process of creating these color correction parameters and the color correction process will be described later in detail.

It is determined whether or not the keyword extraction processing has been completed for all of the keywords indicated on the photographing reference board (step 55). If there is any keyword for which extraction processing has not been completed, the extraction processing is terminated. The keyword start data representing the beginning of the keyword that has not been searched is searched (step 56).

When keyword start data is found (step 57), it is determined whether or not keyword extraction processing has been performed for all digits of the keyword (step 5).
8).

If the keyword extraction process has not been completed for all digits of the keyword, data representing the color of the keyword card is extracted as the reference board image data for photography (step 59). By comparing the correspondence table between the color represented by the extracted color data and the keyword, a search is performed to find which keyword the color represents (step 6).
0). Data representing the searched keyword is stored in the keyword recording area of the image file (step 61).

From step 55 on all the images of the keyword card represented by the photographing reference board image
The processing up to 61 is performed. When the processing for all keyword images included in the photographing reference board image ends, the keyword extraction processing from the photographing target image data ends (YES in step 55).

Next, color correction processing (steps 53 and 54 in FIG. 8)
) Will be described.

In the color correction processing, first, gradation correction is performed.

The reference color area A1 of the photographing reference board contains gray as a reference color. The density D of the gray color is measured in advance. In addition, the density D and the reflectance r are expressed by Equation 1.

[0084]

(Equation 1)

Further, it is assumed that an optimal luminance signal gradation curve (optimal luminance signal exposure curve) of the digital still camera is predetermined.

The gray color (other colors may be used instead of the gray color) of the photographing reference board is actually photographed, and luminance data (luminance signal) is obtained from the RGB data obtained by the photographing according to Equation 2 (FIG. 10). Shooting luminance signal level).

[0087]

(Equation 2)

From the photographing luminance signal level of the gray color and the optimum luminance signal gradation curve, the reflectance r1 when the gray color of the photographing reference board is actually photographed can be obtained. The theoretical reflectance r2 of the gray color of the photographing reference board can be obtained from the above equation (1).

In a digital still camera, γ
Assuming that the characteristics are constant, the reflectance r3 at a point on the optimum luminance signal gradation curve of an arbitrary gradation value and the reflectance r4 at a point on the estimated luminance signal gradation curve of the arbitrary gradation value
Satisfies the relationship of Equation 3.

[0090]

(Equation 3)

As shown in FIG. 10A, an estimated luminance signal gradation curve at the time of actual photographing is obtained by using the equation (3).

From the optimum luminance signal gradation curve and the estimated luminance signal gradation curve, image data (RGB data) obtained by photographing using the luminance signal conversion curve shown in FIG. (Image data).

The gradation correction is completed by the above processing.

A plurality of estimated luminance signal gradation curves may be calculated by photographing a plurality of colors, and the average may be used as the average luminance signal gradation curve.

Next, hue correction and saturation correction are performed.

The reference color of the photographing reference board is a reference condition (the reference condition may be a target gradation value when photographed under a condition of reference light such as daylight, or a target gradation value in a preferable color reproduction). , RGB tone values (target tone values) under any of the target tone values in colorimetric reproduction).

After the gradation correction, the RG of the reference color is
A conversion matrix A is calculated between the B gradation value and the target gradation value by the least square method or the like. Using the matrix A, the image data R2, G2,
And B2 data are obtained. Here, by including the gray color as the target gradation value, the gray balance adjustment is also performed.

[0098]

(Equation 4)

Next, the keyword extraction processing will be described.

It is assumed that the gradation value of the image data to be captured corrected as described above is G = (R ₂ , G ₂ , B ₂ ). The corrected gradation value G = (R ₂ , G ₂ , B ₂ ) and the target gradation value are converted into image data in the Lab space. La
In the b space, L indicates brightness, and a and b each represent a color signal. The image data in the RGB space and the image data in the Lab space can be converted as described below.

The nonlinear RGB data and the (corrected) RGB image data obtained by photographing have the relationship shown in equation (5).

[0102]

(Equation 5)

The relationship from the linear RGB data to the non-linear RGB data has the relationship shown in Expression 6. Here, the function f indicates the gamma characteristic of the display device.

[0104]

(Equation 6)

The tristimulus value XYZ and the linear RGB data have the relationship shown in equation (7). However, in the display device, red is (x, y) = (0.64, 0.35) at tristimulus value XYZ, blue is (x, y) = (0.30, 0.60) at tristimulus value XYZ, and green is tristimulus value XYZ. (X, y) = (0.15, 0.06) and the white chromaticity point is 6500K.

[0106]

(Equation 7)

Using the calculated XYZ, the image data to be photographed in the RGB space is converted into the image data to be photographed in the Lab space according to the equation (8).

[0108]

(Equation 8)

However,

[0110]

(Equation 9) And

[0111]

(Equation 10)

Is as follows. Here, P _n = X _n , Y _n , and Z _n are data at tristimulus values of white chromaticity points.

G = (L _c , a _c , b _c ) and the target gradation value Lab
It is assumed that the image data in the space is Fn = (L _n , a _n , b _n ). The color difference Δn in this case is represented by Expression 11.

[0114]

[Equation 11]

As shown in FIG. 11, a function, a color name, a target gradation value, and a keyword are determined in advance, and a color difference is obtained for all the functions F by using Expression 11. A function F that gives the minimum color difference in the set of color differences obtained {Δn}
Is determined to be the keyword (color) represented by the extracted keyword card (the color in which the RGB gradation value under the reference condition is output to the monitor, and the RGB gradation value which is captured and converted). If the difference between the tonal value and the color output to the monitor is small, the color is determined to be the same.

FIG. 12 shows the appearance of an image file classification system for automatically classifying image files according to keywords, and FIG. 13 shows an outline of the electrical configuration.

The image file classification system is a computer
Including 70. The computer 70 is connected to a CRT display device (or liquid crystal (LC) display panel) 71, a printer 72, and input devices (keyboard 73A and mouse 73B). FD drive 74, CD-
The ROM drive 75, the HD unit 76, and the memory card reader 80 are connected. FD drive 74
Performs writing of data to the FD79 and reading of data from the FD79. CD-ROM drive 75 is a CD-ROM drive.
The data is read from the ROM 78. HD unit
Reference numeral 76 writes data to a hard disk (not shown) and reads data from the hard disk. The memory card reader 80 reads out data recorded on the memory card 20 and writes data on the memory card 20. The computer 70 further includes an internal memory (such as a semiconductor memory) 77.

FIGS. 14 and 15 are flowcharts showing the processing procedure for automatic classification of image files.

A memory card on which an image file has been recorded by a digital still camera as described above is loaded into the image file classification system. Image files stored on the memory card are
It is determined whether the classification has been completed for all the image files read by the reader and stored in the memory card (steps 81 and 82).

It is determined whether or not a keyword is included in the image file read from the memory card 20 (step 83). In the first embodiment, since keywords are recorded in the keyword recording area of the image file, it is determined that the keyword is included in the image file (YES in step 83), and whether the extraction processing has been completed for all keywords. Is determined (Step 8
6).

The extracted keyword is searched from a keyword table for creating a database (step 87). If the keyword is found in the keyword table, it is determined whether or not the keyword specifies a folder into which the keyword is classified. (Step 89, see FIG. 3).
If a folder is designated, the image file is copied to the designated folder (step 90). This means that the image files have been automatically classified.
If the keyword does not specify a folder, the process of step 90 is skipped.

The keyword is converted into a database keyword represented by the keyword extracted with reference to the table shown in FIG. 3 (step 91), and the converted database keyword is registered in the database (step 92). If the extracted keyword is not in the keyword table (NO in step 88), the database
Keywords are registered in the database (step 9
3). As a result, the database is updated or created as shown in FIG. 16 (step 93).

(2) Second Embodiment In the above-described first embodiment, the digital still camera 10 performs the process of extracting the keyword from the image data of the photographing target including the subject image and the photographing reference board image. However, in the second embodiment, the process of extracting a keyword from the image data to be captured is performed in the automatic image file classification system (see FIG. 17).

FIG. 18 shows the file structure of an image file recorded on a memory card by the digital still camera 10B according to this embodiment.

The keyword data recording area is not provided in the header data recording area of the image file. As described above, data representing the origin position coordinates of the reference keyboard position designation cursor C input by the reference keyboard position designation cursor C, data representing the horizontal width of the reference position designation cursor C, and representing the vertical height of the reference position designation cursor C Areas for recording data are provided, and data input by button operation is stored in these areas.

The image data recording area stores image data of an object obtained by photographing the object and the photographing reference board. The image data to be photographed is read by the above-described image file automatic classification system, and keywords are extracted as described below.

FIG. 19 is a flowchart showing a processing procedure for extracting a keyword from image data to be captured.

When the processing from step 31 to step 36 in FIG. 7 is completed, the processing shifts to the processing in step 42 in FIG.

The image data to be photographed obtained by photographing the object image is stored in the image data recording area of the image file, and the data representing the position coordinates of the origin of the reference position designation cursor obtained by button operation, the reference position designation cursor Is stored in the image file. The data representing the width of the image and the data representing the height of the reference position designation cursor are stored in the image file (step
42). Then, the image file is recorded on the memory card 20 mounted on the digital still camera (step 40).

The memory card is loaded into the memory card reader 80 of the above-described automatic image file classification system, and the image file is read, so that the image file is stored in the folder corresponding to the keyword as described above (step). 41).

However, in the second embodiment, since no keyword is stored in the image file (NO in step 83 in FIG. 14), the keyword is extracted from the photographed image data in the automatic image file classification system (FIG. 14). Step 85, processing of FIG. 8). This keyword extraction process is shown in FIG.
Needless to say, the processing is the same as the processing shown in FIG.

(3) Third Embodiment In the first embodiment and the second embodiment described above, the photographing target reference board is photographed together with the subject, a keyword is extracted from the obtained photographing target image data, and the keyword is extracted according to the keyword. In the third embodiment, the keyword input device 100 is connected to the digital still camera, and the keyword input from the keyword input device 100 is stored in the image file. (See FIG. 20).

FIG. 21 shows a digital still camera 10B.
3 shows the appearance of a keyword input device 100 connected to the digital still camera 10B.

An external device connection terminal 21 is provided in the digital still camera 10B. The external device connection terminal 21 connects the camera 10B and the keyword input device 100 via a cable (for example, an RS232C cable). This allows the keyword input device 100 and camera 10B
Communication is possible with the device.

The keyword input device 100 includes a camera connection terminal 101, and is connected to the digital still camera 10B by a cable via the camera connection terminal 101.

A keyword input unit 102 for inputting a keyword is provided on the upper surface (the surface shown in FIG. 21) of the keyword input device 100. Keyword input section 10
2 is a number that represents a number from “0” to “9”.
A keypad and a "-" keypad are included.
The user of the keyword input device 100 has a keyword input section.
Enter a keyword using the numeric keypad included in 102.

The keyword input device 100 further includes a keyword transmission button 103 pressed by the user when transmitting the input keyword to the digital still camera 10B, and a clear button pressed by the user when clearing the input keyword. A button 104 and a keyword display section 105 for displaying the entered keyword are included.

FIG. 22 is a flowchart showing a processing procedure when a keyword is stored in an image file together with image data representing a subject image obtained by photographing by inputting a keyword using the keyword input device 100.

The connection terminal 21 of the digital still camera 10B and the connection terminal 101 of the keyword input device 100 are connected by a cable (step 111). Camera 10B
Is connected to the keyword input device 100, the camera 10
The power supply of B and the power supply of the input device 100 are respectively turned on (step 112).

The user operates the keypad of the keyword input section 102 of the keyword input device 100 to input a keyword (step 113). The entered keyword is
It is displayed on the keyword display section 105.

In the image file recorded in the digital still camera 10B according to this embodiment, as shown in FIG. 23, there are areas for recording five keywords from the first keyword recording area to the fifth keyword recording area. is there. Therefore, when entering a keyword, it is necessary to first specify a keyword recording area for storing the keyword. Therefore, first, a keyword recording area is designated using the keyword input unit 102. When the designation of the keyword recording area is completed, the "-" button is pressed, and the keyword for the designated keyword recording area is input.

When the keyword is input, the transmission button 103 is pressed by the user, and data representing the input keyword is transmitted from the keyword input device 100 to the digital still camera 10B (step 114).

Data representing a keyword transmitted from the keyword input device 100 is stored in the digital still camera 10.
B (data representing the keyword input via the connection terminal 21 is input to the CPU via an interface (not shown)) and is temporarily stored in the memory 7 of the camera (step 115).

The subject corresponding to the keyword temporarily stored in the memory 7 is photographed by the digital still camera 10B, and image data representing the subject image is obtained (step 116). The keyword data temporarily stored in the memory 7 is read out and stored in an image file together with image data representing a subject image (step 117). At this time, it goes without saying that the image data is stored in the image data storage area of the image file, and the keyword data is stored in the keyword data storage area of the header data storage area.

The image file is recorded on a memory card mounted on the digital still camera 10B (step 118).

When the memory card storing the image file is removed from the digital still camera and loaded into the image file classifying apparatus, the memory card shown in FIG.
The image files are classified in the same manner as in the processing procedure shown in FIG. 15 as in the first embodiment.

Since a keyword recording area can be designated, a keyword recorded in a desired recording area can be updated.

[Brief description of the drawings]

FIG. 1 shows an outline of automatically classifying image files.

FIG. 2 shows an imaging reference board.

FIG. 3 shows keywords and their meanings.

FIG. 4 shows the appearance of a digital still camera.

FIG. 5 shows a liquid crystal screen of a digital still camera.

FIG. 6 shows an electrical configuration of the digital still camera.

FIG. 7 is a flowchart illustrating a processing procedure for extracting a keyword.

FIG. 8 shows a configuration of an image file format.

FIG. 9 shows a processing procedure for extracting a keyword from a photographing target image.

FIG. 10A shows an optimum luminance signal gradation curve and an estimated luminance signal gradation curve, and FIG. 10B shows a relationship between a gradation value at the time of photographing and a converted gradation value.

FIG. 11 shows the relationship between keywords and colors.

FIG. 12 shows an appearance of an automatic image file classification system.

FIG. 13 shows an outline of an electrical configuration of the image file automatic classification system.

FIG. 14 shows a processing procedure for classifying image files.

FIG. 15 shows a processing procedure for classifying image files.

FIG. 16 shows a created database.

FIG. 17 shows an outline of classification of image files.

FIG. 18 shows an image file format.

FIG. 19 is a flowchart showing a processing procedure for extracting a keyword in the image file automatic classification system.

FIG. 20 shows an outline of automatic classification of image files.

FIG. 21 shows a digital still camera and a keyword input device.

FIG. 22 is a flowchart showing a processing procedure for inputting a keyword using the keyword input device.

FIG. 23 shows an image file format.

[Explanation of symbols]

 1 CPU 2 Imaging circuit 9 Card control circuit 10, 10A, 10B Digital still camera 12 Cursor display button 13 Origin button 14 Vertical button 15 Horizontal button 16 Plus button 17 Minus button 19 Liquid crystal display device 20 Memory card 70 Computer 71 Display device

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] April 20, 1998

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claims

[Correction method] Change

[Correction contents]

[Claims]

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0010

[Correction method] Change

[Correction contents]

An image data recording apparatus according to a second aspect of the present invention
Object image data representing an object image including an object image representing an object and a reference board image representing a reference board in which information about the object is represented by color, and corresponding object information data are recorded in association with each other. Reading means for reading the image data and the subject information data from the recording medium, and classifying the image data based on subject information represented by the object information data read by the reading means. It is characterized by having a classification means to perform.

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] 0011

[Correction method] Change

[Correction contents]

The second invention also provides a method suitable for the image data recording device. That is, in this method, the target object image data representing the target image including the subject image representing the subject and the reference board image representing the reference board in which the information about the subject is represented by color, and the corresponding subject information data The photographing target image data and the subject information data are respectively read from a recording medium recorded in association therewith, and the photographing target image data is classified based on the subject information represented by the read subject information data. It is characterized by the following.

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] 0079

[Correction method] Change

[Correction contents]

If the keyword extraction process has not been completed for all digits of the keyword, data representing the color of the keyword card is extracted from the photographing reference board image data (step 59). By comparing the correspondence table between the color represented by the extracted color data and the keyword, a search is performed to determine which keyword the color represents (step
60). Data representing the searched keyword is stored in the keyword recording area of the image file (step 61).

[Procedure amendment 5]

[Document name to be amended] Statement

[Correction target item name] 0105

[Correction method] Change

[Correction contents]

The tristimulus value XYZ and the linear RGB data have the relationship shown in equation (7). However, red of the display device is (x, y) = (0.64, 0.35) in xy chromaticity coordinates, blue is (x, y) = (0.30, 0.60) in xy chromaticity coordinates, and green is xy.
This is the case where (x, y) = (0.15, 0.06) in the chromaticity coordinates and the color temperature is 6500K.

[Procedure amendment 6]

[Document name to be amended] Statement

[Correction target item name]

[Correction method] Change

[Correction contents]

Using the calculated XYZ, the image data to be captured in the RGB space is expressed by CIELA
The data in the B space (data in the CIELAB space is generally denoted by *, but is omitted here).

[Procedure amendment 7]

[Document name to be amended] Statement

[Correction target item name] 0108

[Correction method] Change

[Correction contents]

[0108]

(Equation 8)

[Procedure amendment 8]

[Document name to be amended] Drawing

[Correction target item name] FIG.

[Correction method] Change

[Correction contents]

FIG. 14

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁶ Identification symbol FI // G06F 17/30 (72) Inventor Mikio Watanabe 3-11-46 Izumi, Izumimizu, Asaka-shi, Saitama

Claims (25)

[Claims] A photographing means for outputting photographing target image data representing a photographing target image including an image of a reference board in which information on a subject is represented by a color and a subject image representing the subject, and photographing output from the photographing means; Subject information extracting means for extracting data representing subject information in the reference board image from the target image data; and photographing target image data output from the photographing means and the subject information data extracted by the subject information extracting means And a means for outputting in association with the digital still camera. 2. The digital still camera according to claim 1, wherein said output means records on a recording medium. 3. A reference board position information input means for inputting reference board position information representing a position of the reference board image on the photographing target image, wherein the subject information extracting means is provided with the reference board position information input means. 2. The digital still camera according to claim 1, wherein data representing said subject information is extracted based on reference board position information input from said digital still camera. 4. A photographing means for outputting photographing target image data representing a photographing target image including an image of a reference board in which information on a subject is represented by a color and a subject image representing the subject, and the reference on the photographing target image. Reference board position information input means for inputting reference board position information representing the position of the board image, and image data to be shot output from the image pickup means and corresponding reference board position information input from the reference board position information input means And a means for outputting in association with the digital still camera. 5. The digital still camera according to claim 4, wherein said output means records on a recording medium. 6. The digital still camera according to claim 4, wherein the reference board includes a reference color for color correction. 7. The image processing apparatus according to claim 1, further comprising: a color correcting unit configured to perform color correction on the image data to be captured output from the capturing unit based on the reference color for color correction.
5. The digital still camera according to claim 4, wherein the digital still camera outputs the image data of the photographing target which has been color-corrected by the color correction means. 8. A photographing target image data representing a photographing target image representing a photographing target image including a subject image representing a subject and a reference board image representing a reference board in which information on the subject is represented by a color, and a corresponding subject Reading means for reading the image data to be shot and the subject information data from a recording medium in which information data is recorded in association with the information data; and subject information represented by the subject information data read by the reading means A classifying means for classifying the photographing target image data based on the image data. 9. A target image data representing a target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding position of the reference board image Reading means for reading the image data to be photographed and the reference board position information from a recording medium in which reference board position information representing the reference board position information is recorded in association with the reference board position information. Subject information extracting means for extracting subject information in the reference board image from the photographing target image data read by the reading means; and the subject information based on the subject information extracted by the subject information extracting means. An image data classification device comprising: classification means for classifying image data. 10. The reference board image data includes reference color data for color correction, and is represented by image-capturing target image data read by the reading unit based on the reference color data for color correction. The image data classification device according to claim 9, further comprising a color correction unit configured to correct a color of the image to be captured. 11. A target image data representing a target image representing a target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding subject. Reading means for reading the image data to be shot and the subject information data from a recording medium in which information data is recorded in association with the information data; and subject information represented by the subject information data read by the reading means Means for creating a database for the image data to be captured based on the database. 12. A target image data representing a target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding position of the reference board image Reading means for reading the image data to be photographed and the reference board position information from a recording medium in which reference board position information representing the reference board position information is recorded in association with the reference board position information. Subject information extracting means for extracting subject information in the reference board image from the photographing target image data read by the reading means; and the subject information based on the subject information extracted by the subject information extracting means. Means for creating a database of image data Database creation device. 13. A photographing means for photographing a subject and outputting image data representing the subject image, a display device for displaying a subject image represented by image data output from the photographing means on a display screen, and the display device Cursor control means for controlling a surrounding cursor, which is specified by surrounding a part of the subject image displayed on the display screen, to be displayed on the display screen of the display device, and image data output from the photographing means Means for outputting the data indicating the position of the enclosing cursor in association with the digital still camera. 14. A photographing means for outputting photographing target image data representing a photographing target image including a reference board image including a reference color for color correction and a subject image representing a subject, and photographing output from the photographing means. Reference color data extraction means for extracting data representing a reference color in the reference board image from the target image data, and colorizing the photographing target image data using the reference color data extracted by the reference color data extraction means A digital still camera, comprising: a color correcting unit for performing correction; and a unit for outputting image data to be captured which has been color-corrected by the color correcting unit. 15. A photographing reference board in which information about a subject is represented by a color, and a reference color for color correction of a subject image obtained by photographing is represented. 16. An image of a reference board in which information about a subject is represented by a color is taken together with the subject, and subject image data representing a subject image including the subject image representing the subject and a reference board image representing the reference board are obtained. Digital data for extracting data representing subject information in the reference board image from the obtained photographing target image data, and outputting the photographing target image data obtained by photographing in association with the extracted subject information data; -Still camera operation control method. 17. A reference board in which information on a subject is represented by a color is photographed together with the subject, and photographing target image data representing a photographing target image including a subject image representing the subject and a reference board image representing the reference board is obtained. Inputting reference board position information indicating the position of the reference board image on the image to be shot, and outputting the image data to be shot obtained by shooting in association with the input corresponding reference board position information; An operation control method for a digital still camera. 18. A target image data representing a target image representing a target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding subject The photographing target image data and the subject information data are respectively read from a recording medium recorded in association with information data, and the photographing target image data is read based on the subject information represented by the read subject information data. An image data classification method for classifying data. 19. A target image data representing a target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding position of the reference board image The image data to be photographed and the reference board position information are respectively read from a recording medium recorded in association with reference board position information indicating the position of the reference board, and the read photographing is performed based on the read reference board position information. An image data classification method, wherein subject information in the reference board image is extracted from the target image data, and the shooting target image data is classified based on the extracted subject information. 20. Imaging target image data representing an imaging target image representing an imaging target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding subject The photographing target image data and the subject information data are respectively read from a recording medium recorded in association with information data, and the photographing target image data is read based on the subject information represented by the read subject information data. A database creation method that creates a database for data. 21. Imaging target image data representing an imaging target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding position of the reference board image Is recorded in association with reference board position information indicating
Reading the image data to be captured and the reference board position information from the recording medium, and extracting the subject information in the reference board image from the read image data to be captured based on the read reference board position information. A database creation method for creating a database of the image data to be photographed based on the extracted subject information. 22. An image of a subject, image data representing the subject image is obtained, the obtained subject image is displayed on a display screen of a display device, and one of the subject images displayed on the display screen of the display device is displayed. A surrounding cursor specified by surrounding the part is displayed on the display screen of the display device, and data representing a portion specified by the surrounding cursor is output in association with image data obtained by photographing.
An operation control method for a still camera. 23. A reference board including a reference color for color correction is photographed together with a subject, and photographing target image data representing a photographing target image including a subject image representing the subject and a reference board image representing the reference board is obtained. Extracting data representing a reference color in the reference board image from the obtained photographing target image data, performing color correction on the photographing target image data using the extracted reference color data, and performing color corrected photographing. An operation control method for a digital still camera that outputs target image data. 24. Imaging target image data representing an imaging target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding subject A program for reading each of the image data to be shot and the object information data from a recording medium in which information data is recorded in association with the object data, wherein the program stores the object information represented by the read object information data. A computer-readable recording medium storing a program for controlling a computer of the image data classification device to classify the image data to be captured based on the image data. 25. A target image data representing a target image including a subject image representing a subject and a reference board image representing a reference board in which information about the subject is represented by a color, and a corresponding position of the reference board image A program for reading the image data to be photographed and the reference board position information from a recording medium in which reference board position information indicating the reference board position information is recorded, based on the read reference board position information. Controlling the computer of the image data classification device to extract the subject information in the reference board image from the read image data of the photographed object, and to classify the image data of the photographed object based on the extracted object information. Computer-readable recording medium storing a program for executing the program.