JP4759498B2 - Camera, image recording method and program - Google Patents

Description

The present invention relates to a technique for recording a paragraph image that clearly displays a break of an image group.

Due to the increase in capacity and price of recording media, a large number of images can be stored in a camera or the like. On the other hand, since a large number of images can be stored, it takes a long time to search for a specific image. It takes a long time to search, which is a big problem for usability of cameras and players. Thus, as one method for reducing the search time, many proposals have been made to group images and display the grouped images as thumbnails.

For example, an image processing apparatus has been proposed in which an image captured first in a group is used as a representative image and the remaining group images are hidden and displayed on a thumbnail (Patent Document 1). In addition, an image pickup device has been proposed in which a representative image is not an initial image but a dedicated image (Patent Document 2). Furthermore, an image processing apparatus has been proposed in which characters are displayed in the same display size as other thumbnail images instead of actual images as group separation images (Patent Document 3).
JP 2000-041209 A JP 2004-364091 A JP 2000-217055 A

  A general user operation example regarding the shooting of an image and the reproduction of the shot image will be described with reference to the flowchart of FIG. The flowchart in FIG. 17A is a procedure for the user's photographing operation. If there is any event for the user (step S201 YES), shooting is performed (step S202). After shooting, a print reservation operation can be performed on the shot image. If a print reservation operation is performed (YES in step S203), the designation is performed (step S204). However, in many cases, there are few users who prefer such a troublesome operation for every shooting. In the first place, it is common to decide which image to print after looking at the entire captured image, such as when traveling, and if you specify print for each shooting, it is manageable how many sheets to print Because it becomes difficult, few users have these habits.

  The flowchart in FIG. 17B shows a user operation procedure in the playback scene. Usually, the camera is not used for a while after shooting, and even if there is an image that you want to see, it is not clear how to remember, and it is often unclear how to search. Therefore, users often come up with the idea of sorting and organizing only after coming here. When a classification operation for albums or the like is selected (YES in step S211), the screen is switched to a classification screen, and image classification is designated in response to an instruction or automatically (step S212).

  When searching for an image, a classified or unclassified list display screen (thumbnail screen) is used (step S213). If the target image is found during the list display, that image is selected (step S214). This is because each image on the list display is difficult to see on the small display screen of the camera, and it is possible to surely determine whether it is necessary or not by enlarging the images. When an enlargement instruction is given for the selected image (YES in step S215), the image is enlarged and displayed (step S216).

  If it is determined that the image is not good, the unnecessary image is deleted or deleted. If a deletion instruction is given (YES in step S217), the corresponding image is deleted (step S218). If there is no instruction for deletion, the list is again reduced and displayed (step S219). Furthermore, if there is an instruction to end reproduction (YES in step S220), an end process is performed. When there is no end instruction (NO in step S220), the state returns to a state where classification is possible (step S211).

  FIG. 18 is a diagram illustrating an example in which image groups classified by shooting date and time are displayed as thumbnails. FIG. 3A is a graph showing the temporal distribution of captured images stored in a medium, with a graph in which the horizontal axis indicates the shooting date and time and the vertical axis indicates the number of shots. Here, the images are grouped according to the shooting date and time, and the top of each group is a representative image, which is indicated by a black portion. FIG. 7B shows a part of the thumbnail display screen of the images grouped as shown in FIG. The number in the middle indicates the serial number of the image, and 17, 23, and 27 are representative images. Then, the thumbnail image of the representative image is displayed surrounded by a thick frame so that it can be seen at a glance.

  If the top image of the group is a representative image, the display is easy as described above. However, the first image which is the first image is not necessarily an image suitable for the representative image. As described in Patent Document 2, it is more convenient to set a representative image later. However, in normal playback software, the display order is determined by the order of shooting date and time, and therefore, dedicated display software is required for display in which the representative image of the subsequent shooting is arranged at the top of the classification. It is desirable that such dedicated software is not necessary.

  In other words, in order to easily use an image that is not at the top of the shooting date and time as a representative image of the classification (group), it is desirable that the representative image is displayed at the top of the classification even with normal reproduction software.

  SUMMARY OF THE INVENTION In view of the above problems, the present invention provides a camera that records an image indicating a classification break so that it is displayed at the beginning of the classification even if the image is not initially captured, and such an image recording method and program. To do.

In order to achieve the above object, the camera according to the first aspect of the invention records a captured image at the time of shooting because a paragraph image, which is an image for displaying an image classification break, is displayed at the position of the classification break during playback. Prior to the above, the paragraph image recording control unit for recording the paragraph image and the representative image representative of the classification of the image are displayed in the same order as the paragraph image instead of the recorded paragraph image. In addition, a representative image recording control unit for recording a representative image is provided.

The image recording method according to the second aspect of the present invention is such that a paragraph image, which is an image for displaying an image classification break, is displayed at the position of the classification break at the time of reproduction. Record this paragraph image on a recording medium, and in response to instructions, representative images that represent the classification of the images are displayed in the same order as the paragraph images instead of the recorded paragraph images. This is recorded in place of the management data of the paragraph image that can replace a part of the management data of the image.

According to a third aspect of the invention, there is provided a program for recording a recording medium prior to recording of a captured image at the time of shooting because a paragraph image, which is an image for displaying an image classification break, is displayed at the position of the break of the classification at the time of reproduction. The step of recording the paragraph image, and in response to the instruction, the representative image representative of the classification of the image is displayed in the same order as the paragraph image instead of the recorded paragraph image. A step of recording in place of part of the management data of the image instead of the management data of the paragraph image to be replaced is executed by the camera computer.

According to the present invention, it is possible to provide a camera that records an image indicating a classification break so that it is displayed at the beginning of the classification even if the image is not first captured, and such an image recording method and program. it can.

The best mode for carrying out the present invention will be described below with reference to the drawings.
(First embodiment)
The first embodiment will be described with reference to FIGS. The first embodiment is an invention in which a paragraph image or a representative image is assigned to images classified according to shooting date and time.

  FIG. 1 is a block diagram of a camera 1 to which the present invention is applied. The camera 1 includes a photographing lens unit 2, an AF control unit 2a, a diaphragm unit 3, a diaphragm control unit 3a, an image sensor 4, and an analog front end (hereinafter abbreviated as AFE) unit 5.

  The taking lens unit 2 forms an image of the incident subject 20 on the image sensor 4. The taking lens unit 2 has a focus lens inside. The AF (autofocus) control unit 2a detects the focus position, drives the focus lens, and moves the focus lens to the focus position. The AF control unit 2a detects the in-focus position (focus position) from the contrast signal peak of the captured image by a method called so-called hill-climbing detection.

  In or near the photographic lens unit 2, a diaphragm unit 3 that provides a shutter or diaphragm effect is provided. The diaphragm unit 3 opens to a predetermined aperture at the time of photographing, and closes to end the exposure when the exposure ends. The aperture control unit 3a drives the aperture unit 3 to set the aperture diameter. By changing the aperture, the depth of field of the lens changes, so you can adjust the blurring of the background, etc. to switch the expression, such as floating the subject or drawing the background firmly Can do.

  The image pickup device 4 is a CCD, a CMOS sensor, or the like including a large number of light receiving surfaces (pixels). The image sensor 4 receives an image from the subject 20 via the photographing lens unit 2 and converts it into an image signal.

  The AFE (analog front end) unit 5 includes AD (analog / digital conversion) means, and converts a signal from the image sensor 4 into a digital signal. The AFE unit 5 performs various processes on the image signal output from the image sensor 4. The AFE unit 5 is also provided with a function of reading several pixels of the image sensor 4 in a lump. For example, when the signal level of each pixel is small, such as 4 pixels (2 × 2) and 9 pixels (3 × 3), several pixel signals can be added to improve the S / N. Sensitivity can be increased by such an operation. In this way, S / N can be improved by adding and using several pixel signals of the same color of the image sensor.

Such an operation can increase sensitivity. As described above, when the sensitivity is increased, it is possible to devise in photographing such as increasing the shutter speed. When the shutter speed is high, it is possible to shoot as if the moving subject is stopped. For cameras that allow the user to switch the shutter speed and control the exposure appropriately by controlling the aperture and sensitivity, if the shutter speed is generally slowed down, for example, when shooting a river flow, the water flow is like a thread. This makes it possible to depict images that have been extended. If you increase the shutter speed, you can capture the same river flow, capture the moment, and make it possible to reproduce the moment when the splashes rise and the state of ripples. Even in sports photos, if the shutter speed is increased, the movement of the subject can be stopped, and the facial expression can be clearly captured.
The setting of the shutter speed, aperture, or in-focus position may be used when classifying captured images.

  The AFE unit 5 also has a function of selecting image signals output from the image sensor 4 and can extract a limited range of image data from all light receiving surfaces. If an image of only a predetermined area is recorded by this control, an effect similar to so-called trimming can be obtained.

  The camera 1 is provided with an image processing unit 6 and an image determination unit 17. The image processing unit 6 corrects the color, gradation, and sharpness of the input signal. The image processing unit 6 includes resizing means for processing the signal from the image sensor 4 into a size that can be displayed on the display unit so that the live image can be displayed on the display unit in real time. By this function, an image incident on the image sensor can be confirmed prior to shooting, and the timing and photo opportunity at the time of shooting can be determined while viewing this. The image processing unit 6 is also provided with a sensitizing unit 6a that automatically increases the ISO sensitivity for a dark subject.

  The image determination unit 17 is for determining a subject and a shooting theme shot by analyzing image data. The image determination unit 17 includes a color determination unit 17a, a contrast determination unit 17b, and a face detection unit 17c. The color determination unit 17a determines a color component included in the image information. The contrast determination unit 17b determines the contrast of the image signal. The contrast is also used for autofocus control of the AF control unit 2a. The distance of the subject, the distance of the background, and the like can also be determined based on the information on the lens position at the time of focusing. The face detection unit 17c examines the feature of the image and detects whether or not a face exists on the screen. A theme determination unit 14a described later determines the theme based on the result of the image determination unit 17.

  Further, the camera 1 includes a compression / expansion unit 7, a recording / reproducing unit 8, a recording medium 9, an input / output unit 10, a display control unit 11, a display unit 12, and a RAM 18. The compression / decompression unit 7 compresses the signal output from the image processing unit 6 during shooting. The compression / decompression unit 7 includes MPEG (Moving Picture Experts Group) 4 and H.264. A still image compression unit S 7b such as a moving image compression unit M 7a including a compression core unit such as H.264 and a JPEG (Joint Photographic Experts Group) core unit is provided. The recording / reproducing unit 8 records the image signal compressed as described above on the recording medium 9. The recording medium 9 is a storage recording medium that can be attached to and detached from the camera.

  The display unit 12 includes, for example, a liquid crystal or an organic EL, and displays a monitor image at the time of shooting, and displays a recorded image that has been subjected to expansion processing at the time of reproduction. The display control unit 11 controls display on the display unit 12. The display control unit 11 has a multi-control unit 11a. The multi-control unit 11a displays a thumbnail image on the display unit 12. The RAM 18 is a buffer memory serving as a work area for temporarily storing image data during image processing or compression / decompression processing.

  At the time of reproduction, the compression / decompression unit 7 decompresses the compressed data recorded on the recording medium 9, and the image processing unit 6 further performs conversion processing into an image suitable for display. The converted image is viewed as a reproduced image on the display unit 12 via the display control unit 11.

  The input / output unit 10 relays the exchange of image data and other data with an external person 30 via a network. It is also possible to input the image data 31 from the outside. Note that data exchange with the outside is not limited to transmission via the network, but may be performed via a memory card or a PC.

  The camera 1 includes an auxiliary light emitting unit 13, an MPU 14, a ROM 16, a release switch 15a, a mode switch 15b, and another switch 15c. The auxiliary light emitting unit 13 includes a white LED and a Xe discharge arc tube, and the amount of light can be controlled by the amount of current flowing. Depending on the situation, the subject 20 is irradiated with light to prevent lack of brightness and uneven brightness.

  The MPU 14 is a control unit that controls the entire camera. The release switch 15a, the mode switch 15b, the other switch 15c, and the ROM 16 are connected to the MPU 14. Each switch 15a-15c detects a user's operation, and notifies the result to MPU14 which is a calculation control means which consists of a microcontroller. The MPU 14 switches the operation according to the operation of these switches. The MPU 14 functions as a shooting control unit that controls the AF control unit 2a, the aperture control unit 3a, and the like during shooting.

  The ROM 16 is a non-volatile and recordable memory, and is composed of, for example, a flash ROM, and stores a control program for performing control processing of the camera 1 and paragraph image data to be described later. The MPU 14 reads a program from the ROM 16 and executes it.

  The MPU 14 also functions as the theme classification unit 14a, the date / time classification unit 14b, or the recording control unit 14d by reading and executing the program.

  The theme classification unit 14a determines the theme name of the captured image (subject) from the results of the image determination unit 17 including the color determination unit 17a, the contrast determination unit 17b, and the face detection unit 17c described above. The theme name is, for example, portrait, landscape, pet or the like.

  The theme classification unit 14a also uses shooting conditions such as a focus position of a subject or background, a zoom position, a shooting time, an exposure control parameter, distance information, and color information when classifying the theme. This is because various information about the subject can be obtained depending on the distance of the subject to be photographed. This is because, for example, macro photography does not take pictures of landscapes. By these, various classifications are possible. The date / time classification unit 14b classifies the images according to the interval between the shooting dates / times and the number of shots.

  The recording control unit 14d controls the recording / reproducing unit 8 according to the classification results by the theme classification unit 14a and the date / time classification unit 14b, and controls the paragraph 9 and the representative image to be recorded on the medium 9. The recording control unit 14d includes a paragraph image recording control unit that records a paragraph image and a representative image recording control unit that records a representative image. The paragraph image recording control unit controls to record the paragraph image prior to the photographed image when the photographed image is recorded. Then, the representative image recording control unit records the representative image instead of the paragraph image according to the instruction after the photographing. At that time, a part of the management data is replaced with the management data of the paragraph image to be exchanged. Details are left to the description of FIG.

  The MPU 14 has a built-in clock unit 14c. The photographing time measured by the clock unit 14c is very important, and the photographing time and photographing frequency are important factors for determining the theme of the photographing (for example, a night view for night scenery).

  FIG. 2 is a diagram illustrating an appearance of a camera held by a photographer at the time of photographing. Contrast information obtained from the subject when the camera 1 is held at the time of shooting (observation with the display unit 12 while reproducing the output of the image sensor and pointing the release button 15a with a finger toward the timing and composition) Information on a target that the user 20 wants to shoot is obtained based on color, background, focus information, and the like.

  First, a procedure for recording a paragraph image at the beginning of a photographed image classified by date and time will be described. FIG. 3 is a flowchart for explaining a procedure for classifying images by shooting date and recording a paragraph image at the top of the classification at the time of shooting. The following date / time classification and paragraph image recording processing is performed by the MPU 14, in particular, the date / time classification unit 14 b, the recording control unit 14 d, and the recording / reproducing unit 8. The display is performed by the display control unit 11 and the multi display control unit 11a. In this example, images are classified in order of shooting date and time while adjusting the date and time difference so that the number of images in one group does not become too large (for example, 20 images), and when shooting is first in the classification, This is a process for recording a paragraph image.

  First, photographing is performed according to a user instruction (step S11). The current date and time are read from the clock unit 14c, and the date and time are determined (step S12). It is confirmed whether there is a previous image on the medium 9, that is, an image already recorded (step S13). If there is no previous image (NO in step S13), there is only one image, so the current captured image is the first image in the classification, and the process proceeds to step S17.

  If the previous image exists (YES in step S13), the shooting date and time of the previous image is read from the medium 9 and determined (step S14). Then, the shooting date / time of this time is compared with the shooting date / time of the previous image (step S15).

  It is determined whether the date difference from the previous shooting is one week or more (step S16). If the date difference is more than one week (YES in step S16), the relationship between the current image and the previous image is considered to be weak regardless of the number of previous images, and the current image becomes the first image in the new classification. Judging. Then, a predetermined paragraph image is first recorded on the medium 9 (step S17). Then, the captured image is recorded (step S18). The paragraph image is, for example, a blue background image in which thumbnails can be seen at a glance in classification.

  FIG. 4 is a diagram showing two examples of the recorded paragraph images in thumbnail display. This figure is a 4 × 4 thumbnail display, the numbers in each area indicate image numbers, and specific images are omitted. p indicates a paragraph image. An example of a paragraph image is a single color, for example, a blue background ((A) in the figure). By displaying the paragraph image of No10, it can be seen that the images from No11 to No14 are a set of classifications. Similarly, the paragraph image No. 15 indicates that the images after No. 16 are a set of classifications. Further, the paragraph image may be a special shape different from other images instead of a simple blue background ((B) in the figure). No. 10, No. 18, and No. 24 are one example, and the shooting date and time that is the basis of classification is displayed inside. Such a paragraph image p is displayed by reading out paragraph data stored in advance in the ROM 15.

  Return to step 16. If the date and time difference from the previous image is within one week (YES in step S16), the paragraph image is recorded by the current shooting by combining the opening of the date and time and the number of images already included in the classification to which the previous image belongs. Judge whether or not. If the date / time difference is one day or more and there are already five or more images in the previous image classification (YES in step S19, step S20), the date / time difference is within one day and within one hour, and the previous image classification is 10 When there are already more than one image (NO at step S19, YES at step S22, YES at step 23), and when the date difference is within one hour and there are 20 or more images in the previous image classification (YES at step 19NO, step 22NO, step 24YES) If any of these three cases is satisfied, it is determined that it is appropriate to make a new classification from the current photographed image.

  Therefore, the paragraph image is recorded on the medium 9 (step S17). Thereafter, the photographed image is recorded on the medium 9 (step S18). The reason for judging that the date and time difference is within one day and within one hour and that there are already 10 or more images in the previous image classification is to separate the images from the wedding and the second party, This is to enable classification when moving to another location. Further, the condition that the date difference is within one hour and that there are 20 or more images in the classification of the previous image assumes an athletic meet scene that repeats continuous shooting and the like. This is because if there are already 20 images, even images in a series of events that do not elapse for one hour will not be organized if packed more than this.

  On the other hand, otherwise, it is determined that the current image should belong to the same category as the previous image (step S21), and the captured image is recorded on the medium 9 without recording the paragraph image (step S21). S18). It should be noted that data regarding the classification up to the previous image, the classification of the currently captured image, and the like are recorded on the medium as a classification data file.

  As described above, the classification of the images is sequentially determined at the shooting timing, and the paragraph image is attached to the head of the classification, so that it is possible to create the paragraph image without taking any special trouble when reproducing it. I can do it. In other words, every time a photo is taken, the relevance with the previous image is judged and a set of images (group or group) is formed. It becomes possible to quickly search for time.

  The user can easily know from where to where the group is related when displaying the image list. When the images are reduced and listed, even if each image is not visible, the contents can be inferred by looking at this paragraph image.

  FIG. 5 is a flowchart for explaining the procedure of the process for replacing the paragraph image recorded above with the representative image.

  First, it is assumed that the camera 1 is set to the paragraph image replacement mode in the playback mode and a thumbnail image is displayed on the display unit 12. On this screen, the paragraph image to be replaced is designated by the user. The designated paragraph image is determined (step S31). Here, the representative image can be selected from two types of new photographed images or group images. FIG. 6A shows an example in which a collective image is specifically displayed. A group image is an image obtained by reducing and grouping images belonging to a category to form one image, and No. 10 and No. 15 are thumbnails of the group image. The group image No. 10 is composed of images belonging to one group from No. 11 to No. 14. The group image of No. 15 is composed of 16 images after No. 16.

  Returning to FIG. It is determined according to the user's operation instruction whether the designated paragraph image is replaced with a captured image or a group image. First, assume that a captured image is selected as a representative image (YES in step S32). The photographer selects a subject suitable for the representative of the classification, and the image is photographed (step S33). After the captured image is subjected to image processing and compression processing, it is temporarily stored in the RAM 18 as representative image data (step S34).

  Next, the paragraph image data designated for replacement is read from the medium 9 (step S35). A part of the management information (shooting date and time) is extracted from the read paragraph image data (step S36). Then, on the RAM 18, the management information of the representative image data stored in the RAM 18 is replaced with the management information extracted from the paragraph image data (step S37). The current paragraph image data is deleted from the medium 9 (step S38). Then, instead of the deleted paragraph image data, the representative image data in which the management information is rewritten is recorded on the medium 9 (step S39). Thereby, the paragraph image is replaced with the representative image.

  FIG. 7 is a diagram for explaining management information to be rewritten by the above-described paragraph image replacement. FIG. 7A is a diagram showing the structure of an image file recorded on the medium 9. The captured image files (P001001.jpg,...) Are arranged in parallel under the root directory. P001001.jpg and others are file names based on the DCF standard. Here, P001010.jpg and P001015.jpg shown enclosed by squares are taken as paragraph image files, and this paragraph image file is also configured in the same manner as the photographed image file. FIG. 7B shows an example in which the file in FIG. 7A is displayed as a thumbnail.

  FIG. 7C is a diagram for explaining the contents of the management information rewritten from step 35 to step 37. C-1 is a paragraph image file structure, and is composed of a header portion and a main image. The main image is, for example, a blue only image. The header portion is determined based on the Exif standard, and stores various management data in addition to the thumbnail image. The management data includes shooting date / time T, file name N, number of pixels M, shooting condition F, and the like. Here, as described in step S36, the shooting date / time Td and the file name Nd are extracted from the management data in order to replace the shot image to be shot later.

  C-2 is a file structure of a captured image recorded on the RAM 18. The management information in the header is recorded as the actual shooting date / time Tc and file name Nc. The main image is a captured image. Here, as described in step S37, the shooting date / time is rewritten from Tc to Td, and the file name is rewritten from Nc to Nd. Thereafter, if the original paragraph image is deleted and the representative image is recorded, the representative image in which the photographing date and time are replaced is stored in the medium 9 instead of the original paragraph image.

  As a result, even an image taken later can be always placed at the top of the classification by thumbnail display or the like without using special reproduction software. In addition, FAT (File Allocation Table) type stamp data may be rewritten. In this replacement, the management information of the captured image is replaced with that of the original paragraph image. Instead, the main image data of the paragraph image is replaced with new captured image data. Also good. Further, the replacement data has been described with the shooting date and file name, but other management data may be replaced as necessary.

  Next, the process returns to step 32 in FIG. When the collective thumbnail display is selected (NO in step S32), the image belonging to the classification (group image) is read from the media 9 (step S40), decompressed, and developed in the RAM 18. Each image is appropriately resized and synthesized by the image processing unit 6, and a collective image is created on the RAM (step S41). After that, as described above, the collective image is recorded on the medium as a representative image (steps S35 to S39).

  FIG. 8 is a flowchart for explaining processing for automatically replacing a paragraph image with a collective image. In FIG. 5 described above, the paragraph image designated by the user is replaced with a representative image composed of a photographed image and a group image. However, the paragraph image may be automatically replaced if it is replaced by the collective image.

  It is assumed that an automatic replacement instruction is set by the user. The image file recorded on the medium 9 is read (step S51), and a paragraph image is detected. The paragraph image from the medium 9 may be detected by directly reading an image file recorded on the medium 9 to determine the presence or absence of a paragraph image, or a classification file in which the contents of classification are separately recorded is recorded. If necessary, this classification file may be referred to. If there is no paragraph image (NO in step S52), the process ends. If a paragraph image is found (step S52 YES), the paragraph image found as described above with reference to FIG. 5 is replaced with the collective image and recorded (step S53).

  Further, it is determined whether there is a paragraph image (step S54). If there is a next paragraph image (YES in step S54), the process returns to step S53, and the paragraph image is rewritten into a collective image. If there are no more paragraph images to be rewritten (NO in step S54), the process ends.

  The representative image used for rewriting may be a symbol image stored in advance in a ROM or the like in addition to the photographed image and the collective image. FIG. 9 shows three examples of the symbol image.

  As described above, paragraph images are recorded before classification, and can be replaced and recorded with representative images and collective images as necessary. This image can be easily displayed. Since images with stronger citations than paragraph images can be displayed at the top, classification breaks can be clearly understood. In addition, since it is possible to select an optimum target as the paragraph image at any time, it is possible to easily organize it according to personal preference. Of course, even if the default image is the default image, the shape of the paragraph image is clearly different from that of the photographed image as shown in FIG.

(Second Embodiment)
In the first embodiment, a paragraph image is recorded when it is determined that classification is at the end. However, a method is also conceivable in which a paragraph image and a photographed image are always recorded in pairs, and only necessary ones of the paragraph images are left at the end of photographing. As a result, there is always a paragraph image in front of each photographed image data, so that it is possible to delete unnecessary items later and leave only necessary ones.

  The second embodiment will be described with reference to FIGS. 10 to 12. Since the block diagram of the applied camera is the same as that of the first embodiment, a description thereof will be omitted. Processing such as date / time classification and paragraph image recording is performed by the MPU 14, particularly the date / time classification unit 14 b, the recording control unit 14 d, and the recording / reproducing unit 8. The display is performed by the display control unit 11 and the multi display control unit 11a.

  FIG. 10A is a flowchart for explaining the procedure of paragraph image recording in the second embodiment. Photographing is performed according to a user instruction (step S61). At the same time, the shooting date is determined (step S62). It is determined whether or not there is a previous image and whether or not an image is recorded on the medium 9 before the photographed image here (step S63). If there is no previous image (NO in step S63), that is, if this image is the first captured image, the paragraph image is recorded because it is the beginning of the classification (step S68), and then the captured image is recorded (step S69), and the process ends. . The paragraph image is the same image as described in the first embodiment.

  If there is a previous image (YES in step S63), the shooting date and time of the previous image is determined (step S64). Next, classification end determination is performed (step S65). FIG. 11 is a subroutine for explaining the procedure for determining the end of classification.

It is determined whether the shooting date / time of the current shot image has passed three hours or more from the shooting date / time of the previous image (step S71). If it is within 3 hours, the classification is not finished because it is connected to the previous image.
On the other hand, if 3 hours or more have elapsed (YES in step S71), the determination is made according to the number of unclassified images so far. First, if there are 10 or more unclassified images including the previous image (step S72 YES), the classification is finished (step S73). It should be noted that a signal indicating that the classification is completed is added to the classified (grouped) photographed image.

  Even if the number of images is less than 10 (NO in step S72), the classification is not completed unless the current image has passed more than one night from the previous image (NO in step S73). Conversely, if the current image has passed from the previous image overnight (step S73 YES) and there are five or more previous image classifications (step S75 YES), the classification ends (step S73). If there are more than 5 unclassified images at the end of the night, it will be easier to organize in your head because it will be taken on another day. is there.

  Further, if the classification of the previous image is less than 5 (NO in step S75) and one week has passed (YES in step S76), the classification ends (step S73). On the contrary, if it is less than 5 sheets and within one week (NO in step S76), the classification is not ended. It is determined whether a week has passed, and if it has passed, even if only a few images are collected, it is considered that the time has passed enough to be separated and organized from the next shooting. Even if only one image is stored, the image is classified from other images.

  Returning to FIG. It is selected because the paragraph of the previous image is deleted from the medium 9 depending on whether or not the classification is completed based on the classification completion determination result (step S66). If it is determined that the classification is completed (step S66 YES), only the first paragraph image is left and other paragraph images are deleted (step S67). On the other hand, if it is determined that the classification is not completed, the previous paragraph image is not deleted and a new paragraph image and captured image are recorded (steps S68 and S69). Note that the paragraph image is not actually deleted, but a signal that cannot be reproduced may be given during reproduction display control.

  FIG. 10B is a schematic diagram for explaining the previous paragraph image deletion in steps S67, S68, and S69. Each of B-1, 2, 3 indicates an image sequence in which the image files recorded on the medium 9 are arranged side by side. If the left side is an old image and new images are added toward the right side, Q, R, and S indicate classification. B-1 is the current file state, and after the classification-completed image of “Q”, three unclassified images of “R” are recorded. “X” is a newly added photographed image.

  When it is determined that the classification is finished (steps S67, 68, 69), an image sequence as shown in FIG. B-2 is obtained. The two paragraph images existing between “R” are deleted, and the current photographed image “X” is recorded as a new classification “S” across the paragraph images. If the classification is not completed, an image sequence as shown in FIG. B-3 is obtained. The halfway paragraph image is not deleted, and the current photographed image “X” is recorded as the classification “R” like the previous image.

FIG. 12 is a flowchart for explaining a paragraph recording procedure during continuous shooting. Although the example in the normal shooting mode has been described with reference to FIG. 10, it is an example in the case where the continuous shooting mode is set. After the release operation, shooting is performed (step S81), and shooting date / time is determined (step S82). The paragraph image recording (step S83) and the photographed image recording (step S84) are continuously performed. Steps S81 to S84 are repeated until a continuous shooting end instruction is issued by the photographer (step S85). If there is an end instruction (step S85 YES), paragraph images other than the head are deleted (step S86). The first paragraph image is the first paragraph image of the current continuous shooting. Delete unnecessary paragraph images and end continuous shooting.
As described above, according to the present embodiment, an appropriate number of images are automatically classified according to the passage of time, and even when a large amount of image data is recorded, the user can shoot at the same time. It is possible to provide a camera that can easily search the displayed images on a list display screen and can display them easily.

(Third embodiment)
In the first and second embodiments, paragraph images are recorded according to the classification based on the shooting date and time. In the third embodiment, an example in which a paragraph image is recorded according to the classification by theme will be described with reference to FIGS. Since the block diagram of the camera applied to this embodiment is the same as that of the first embodiment, the illustration is omitted. The following date and time classification and paragraph image recording processing is performed by the MPU 14, particularly the theme classification unit 14a, the date and time classification unit 14b, the recording control unit 14d, and the recording and reproduction unit 8. The display is mainly performed by the display control unit 11 and the multi display control unit 11a.

  FIG. 13 is a flowchart for explaining a procedure for recording a paragraph image at the time of theme classification. First, the theme classification determines whether or not the same theme, and the classification level is adjusted accordingly.

  Photographing is performed in accordance with a photographer's instruction (step S91). The previous image is compared with the shooting date (step S92). It is determined whether the theme is the same as that of the previous image (step S93). This theme determination process will be briefly described with reference to FIGS. This theme determination process is mainly performed by the MPU 14, the theme determination unit 14a, the image determination unit 17, and the like.

  FIG. 14 is a flowchart illustrating a subroutine for theme determination. First, the face detection unit 17c determines whether there is a face in the detection target image (step S121). FIG. 15 is a diagram for explaining the principle of face detection by the face detection unit 17c. FIG. 15A shows a template corresponding to the shadow of a human face. Three examples with different sizes are shown as templates (a-1, a-2, a-3). FIG. 15B shows the entire detected image. On this image, the image is moved within the screen while changing the size of the template, and it is determined whether there is a portion that matches the contrast of the template. If there is a place where the degree of coincidence with the template is high, it is determined that there is a face there. Then, the detected part is specified as a face region f in the image (FIG. 15C).

  When a face is included (YES in step S121), the size of the face in the image is determined (step S122). If the face is large (YES in step S122), the theme is determined to be a portrait (step S124). If the face is small (step S122 NO), the theme is determined to be a snap (step S123). In a scene that does not include a face (NO in step S121), when the subject distance is a long distance (YES in step S125), the theme is determined to be a landscape image from the distance based on the focusing result (AF) (step S131). . If the subject distance is close (YES in step S126), it is determined that the image is a flower image (step S128) or an accessory image (step S129) by color (step S127). Otherwise, it is determined as a pet image (step S130).

  Of course, the color of a landscape or the like may also be determined. For example, the sky or the sea may be determined depending on where there is a blue object. FIG. 16 shows an example in which images (portraits) in which the subject is only a face are collected.

  Returning to FIG. It is determined whether the theme determined by the theme determination process is the same as the previous image (step S93). If the theme is the same as the previous image (YES in step S93), it is determined whether the date / time difference from the previous image is within 1H (1 hour) (step S100). If it is not 1H or more (NO in step S100), it is determined whether the number of classified images to which the previous image belongs is 30 or more (step S101). If the number of images is 30 or more (YES in step S101), it is determined that the current captured image should be classified into a new category, and after recording a paragraph image as a break from the previous image (step S103), the captured image Is recorded (step S104). If the number is less than 30 (NO in step S101), the photographed image is recorded without recording the paragraph image (step S104) as the same classification as the previous image (step S99).

  If it is 1H or more (step S100 YES), it is determined whether the number of classified images up to the previous image is 20 or more (step S102). If there are more than 20 sheets (YES in step S102), it is determined that the photographed image should be classified into a new category, a paragraph image is recorded (step S103), and then the photographed image is recorded (step S104). If the number is less than 20 (NO in step S101), the captured image is recorded without recording the paragraph image (step S104) as the same classification as the previous image (step S99). The recorded paragraph image is the image as described with reference to FIG.

  Next, when the theme is different from the previous image (NO in step S93), it is first determined whether the date difference from the previous image is one day or more (step S94). If it is more than one day (YES in step S94) and the number of classified images to which the previous image belongs is 5 or more (YES in step S95), the current captured image is considered to be less related to the previous image, and the classification is terminated. For this purpose, the captured image is recorded after the paragraph image is recorded (step 103, step S104). If the number of classified images to which the previous image belongs is 4 or less (NO in step S95), the classification is continued (step S99) and the captured image is recorded without recording the paragraph image because the previous image is related. (Step S104).

  On the other hand, if the date and time difference with the previous image is within one day (step S94 NO), it is further determined whether the date and time difference with the previous image is within 1 H (one hour) (step S96 NO). Then, the end of classification is determined with a smaller number of sheets than in the case of the same theme. That is, within 1H (NO in step S96), it is determined whether the number of classified images to which the previous image belongs is 20 or more (step S97). If there are more than 20 sheets (YES in step S97), the captured image is recorded after recording the paragraph image (step S103, step S104). If the number is less than 20 (step S97 NO), the photographed image is recorded without recording the paragraph image (step S104) as the same classification as the previous image (step S99).

  If it is 1H or more (step S96 YES), it is determined whether the number of classified images up to the previous image is 10 or more (step S98). If the number is 10 or more (YES in step S98), the captured image is recorded after the paragraph image is recorded (step S103, step S104). If the number is less than 10 (NO in step S98), the captured image is recorded without recording the paragraph image (step S104) as the same classification as the previous image (step S99).

  Note that the paragraph image recorded as described above may be recorded after being replaced with a representative image as described in the first embodiment. In the above description, only the time difference and the number of images are used as a criterion for determination. However, naturally, the classification for each switching parameter at the time of shooting with the camera described above, the classification considering the information of the obtained image, etc. Positioning System) etc. may be installed to perform image classification that takes location information into account. As described above, the paragraph image is appropriately recorded even when the classification is based on the theme.

(Other embodiments)
Part or all of the processing (recording control unit 14d and the like) of the MPU 14 described in the above embodiments may be configured by hardware. Conversely, the hardware of the image determination unit 17 may be configured by software. The specific configuration is a design matter.

  Each control process by the MPU 14 is realized by a software program stored in the ROM 16 being supplied to the MPU 14 and operating according to the supplied program. Therefore, the software program itself realizes the functions of the MPU 14, and the program itself constitutes the present invention.

  A recording medium for storing the program also constitutes the present invention. As a recording medium, besides a flash memory, an optical recording medium such as a CD-ROM or DVD, a magnetic recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Moreover, although each embodiment demonstrated the example which applied this invention to the digital camera, you may apply not only to this but the camera part of a mobile telephone, for example.

  Furthermore, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

1 is an overall block diagram of a camera 1 to which the present invention is applied in a first embodiment. FIG. 3 is a diagram illustrating an appearance of a camera held by a photographer at the time of photographing in the first embodiment. 6 is a flowchart for describing a procedure for recording a paragraph image at the top of a classification at the time of shooting in the first embodiment. The figure which displays two examples of the recorded paragraph image with a thumbnail in 1st Embodiment. 5 is a flowchart for explaining a procedure of processing for replacing a paragraph image with a representative image in the first embodiment. The figure which shows the example in which the image replaced by the collective image as a representative image was displayed as a thumbnail in 1st Embodiment. The figure for demonstrating the management information of the representative image rewritten instead of a paragraph image in 1st Embodiment. 6 is a flowchart for describing processing for automatically replacing a paragraph image with a group image in the first embodiment. The figure which shows the example of representative images other than a picked-up image and a group image in 1st Embodiment. 9 is a flowchart for explaining a procedure when a paragraph image is recorded every time in the second embodiment. In the second embodiment, a subroutine for explaining the procedure for determining the end of classification. 9 is a flowchart for explaining a paragraph recording procedure during continuous shooting in the second embodiment. 14 is a flowchart for explaining a procedure for recording a paragraph image at the time of theme classification in the third embodiment. 9 is a flowchart for explaining a subroutine for theme determination in the third embodiment. The figure for demonstrating the principle of the face detection by the face detection part 17c in 3rd Embodiment. In the third embodiment, an example in which images (portraits) in which the subject is only a face are collected. 7 is a flowchart showing an example of a general user operation regarding shooting of an image and reproduction of the shot image in the problem to be solved by the invention. The figure which shows the example in which the image group classified by the imaging | photography date is displayed as a thumbnail in the subject which invention is going to solve.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Camera, 2 ... Shooting lens part, 2a ... AF control part, 3 ... Diaphragm part, 3a ... Diaphragm control part,
DESCRIPTION OF SYMBOLS 4 ... Imaging device, 5 ... AFE part, 6 ... Image processing part, 6a ... Sensitization part, 7 ... Compression / decompression part, 7a ... Compression part M, 7b ... Compression part S, 8 ... Recording / reproducing part, 9 ... Recording medium , 9a ... Classification file, 10 ... Input / output unit, 11 ... Display control unit, 11a ... Multi-control unit, 12 ... Display unit, 13 ... Auxiliary light emitting unit,
14 ... MPU, 14a ... Theme determination unit, 14b ... Date and time classification unit, 14c ... Clock, 14d ... Recording control unit,
15a ... Release switch, 15b ... Mode switch, 15c ... Other switches, 16 ... ROM,
17 ... Image determination unit, 17a ... Color determination unit, 17b ... Contrast determination unit, 17c ... Face detection unit,
18 ... RAM, 20 ... subject, 30 ... external human, 31 ... image data, p ... paragraph image,

Claims (10)

A paragraph image recording control unit that records a paragraph image prior to recording of a captured image at the time of shooting because a paragraph image, which is an image for displaying a division of an image classification, is displayed at the position of the classification division at the time of reproduction. When,
A camera comprising a representative image recording control unit for recording such that a representative image representative of image classification is displayed in the same order as the paragraph image instead of the recorded paragraph image. The representative image recording control unit records the representative image in place of the management data of the paragraph image that can replace a part of the management data of the representative image,
The camera according to claim 1, wherein the paragraph image recording control unit deletes the recorded paragraph image when recording the representative image. The camera according to claim 2, wherein the paragraph image recording control unit records a paragraph image based on image data stored in advance for a paragraph image. 3. The camera according to claim 2, wherein the representative image recording control unit records, as the representative image, an image that is newly captured after capturing the classified image. The camera according to claim 2, wherein the representative image recording control unit replaces at least data related to a shooting date and time as the management data to be replaced. The camera according to claim 2, wherein the representative image recording control unit records a collective image composed of reduced images of a plurality of images belonging to the category as the representative image. A classification unit for determining the classification to which the image belongs,
3. The paragraph image recording control unit according to claim 2, wherein the paragraph image recording control unit deletes a paragraph image other than the head of the classification to which the previous image belongs when it is determined that the classification is completed with the image before the captured image. Camera. A classification unit that determines whether the previous image and the current captured image belong to the same classification,
The paragraph image recording control unit records the paragraph image prior to the current photographed image when it is determined that they are not in the same category, and does not record the paragraph image when determined as the same category,
The camera according to claim 2. Since the paragraph image, which is an image that displays the image classification break, is displayed at the position of the classification break during playback, this paragraph image is recorded prior to the recording of the shot image at the time of shooting,
In response to an instruction, a part of the management data of the representative image can be replaced so that a representative image representing the classification of the image is displayed in the same order as the paragraph image instead of the recorded paragraph image. An image recording method comprising: recording instead of paragraph image management data. A step of recording the paragraph image prior to recording of the photographed image at the time of shooting, so that the paragraph image, which is an image for displaying the division of the image classification, is displayed at the position of the classification break at the time of reproduction;
In response to an instruction, a part of the management data of the representative image can be replaced so that a representative image representing the classification of the image is displayed in the same order as the paragraph image instead of the recorded paragraph image. A program for causing a camera computer to execute a step of recording instead of paragraph image management data.

Images