JP5916275B2 - Imaging apparatus, method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, method, and program, and more particularly, to an image storage technique in the imaging apparatus.

  Recent advances in digital technology have been remarkable, and imaging devices such as digital cameras and digital video cameras have become smaller, more functional, and higher in image quality. For this reason, an increasing number of mobile phones have an imaging function. In addition, although the number of pixels per image has increased with the increase in the number of pixels of the camera, a large-capacity recording medium for storing captured images has been developed. Therefore, the user can record the captured image without worrying about the number of stored images.

  As the capacity of recording media increases, a large number of images can be stored on the recording media. On the other hand, as the number of stored images increases, when looking back at a recorded image, the user may not find the image he wants to see, or when it takes time to search.

  Patent Document 1 describes a technique in which a large number of images recorded on a recording medium are grouped for each person in the image and stored again. In the technique described in the patent document, when a user specifies an image of a person on the screen, face recognition means extracts the feature point of the person from the image. Next, the search means extracts an image including a person having the feature point from the other plurality of images. The extracted image is re-saved in a folder prepared for the person. Further, in this patent document, when a display image on the touch panel of a person who is currently shooting is touched in a specific shooting mode, a number of images including the same person that has been recorded at that time and the same person already recorded are recorded. It is also described that the image is re-saved in one folder.

JP 2007-310813 A

  The technique described in Patent Document 1 is a technique for collecting and re-storing a large number of captured images in one folder according to user settings. With this technique, images of the same person cannot be combined into one folder unless the user intends to re-save and performs processing for that purpose. However, the process of re-recording an existing image is complicated for the user.

  The present invention has been made in view of the above circumstances, and an imaging apparatus, method, and method that can record an image taken by a user so that the user can easily find a desired subject image without burdening the user. The purpose is to provide a program.

In order to achieve the above object, the present invention provides:
Imaging means for photographing a subject and generating a subject image;
Accepting means for accepting a change of an image storage destination and a selection of a photographing mode by a user in a state where a preview image is displayed on a display device based on the subject image;
Selection means for accepting selection by the user as to whether or not to save the subject image;
Determining means for determining whether or not the selection means has accepted a selection to save the subject image by a user;
Feature point extraction means for extracting feature points from the image;
A determination unit that compares the feature points in the subject image with the feature points in the registered image stored in advance and determines whether or not the feature points in both images match;
An image recording unit that records the subject image in a folder corresponding to the registered image when the determination unit determines that they match,
When the determination unit determines that the selection unit has received a selection not to store the subject image by the user, the imaging unit re-photographs the subject,
The imaging unit shoots the subject according to the selection of the shooting mode by the user received by the receiving unit,
The image recording unit stores the subject image in a changed image storage destination related to a change of an image storage destination by a user received by the reception unit ;
As the registered image, one or more of a plurality of subject images captured by the imaging unit are selected in advance,
When the determination unit detects a match between a plurality of feature points, the image recording unit provides an imaging apparatus that selects one from a plurality of folders based on the priority order of the plurality of feature points .

The present invention also provides
Shooting a subject to generate a subject image;
Receiving a change of an image storage destination and a selection of a shooting mode by a user in a state where a preview image is displayed based on the subject image;
A selection step of accepting selection by the user as to whether or not to save the subject image;
Determining whether or not a selection to save the subject image by the user is accepted in the selection step;
Extracting feature points from the image;
Comparing feature points in the subject image with feature points in a pre-stored registered image to determine whether the feature points in both images match;
Recording the subject image in a folder corresponding to the registered image when it is determined to match in the determining step;
A step of re-photographing the subject when the determination step determines that the selection of not saving the subject image by the user has been accepted in the selection step;
In the step of generating the subject image, the subject is photographed according to the selection of the photographing mode by the user accepted in the step of accepting the change of the image storage destination and the selection of the photographing mode,
In the recording step, the subject image is stored in the image storage destination after the change related to the change of the image storage destination by the user received in the step of receiving the change of the image storage destination and the selection of the shooting mode ,
Selecting and registering one or more of a plurality of subject images;
When the determining step finds a match of a plurality of feature points, based on the priority of the plurality of feature points, a method of further have a step of selecting one of a plurality of folders.

The present invention further provides:
On the computer,
Processing to shoot a subject and generate a subject image;
A process of accepting a change of an image storage destination and a selection of a shooting mode by a user in a state in which a preview image is displayed based on the subject image;
A selection process for accepting selection by the user as to whether or not to save the subject image;
A process of determining whether or not a selection for saving the subject image by the user has been received in the selection process;
Processing to extract feature points from the image;
A process of comparing the feature points in the subject image with the feature points in the pre-stored registered image to determine whether the feature points in both images match;
A process of recording the subject image in a folder corresponding to the registered image;
In the selection process, when it is determined in the determination process that the selection not to store the subject image by the user has been received, a process of re-photographing the subject is executed,
In the process of generating the subject image, the subject is photographed according to the selection of the photographing mode by the user received in the process of accepting the change of the image storage destination and the selection of the photographing mode,
In the recording process, the subject image is stored in the changed image storage destination related to the change of the image storage destination by the user received in the processing of receiving the change of the image storage destination and the selection of the shooting mode ,
Processing for selecting and registering one or more of a plurality of subject images;
When a match between a plurality of feature points is detected in the determination process, a program for causing a computer to further execute a process of selecting one from a plurality of folders based on the priority order of the plurality of feature points is provided.

  According to the imaging apparatus, method, and program of the present invention, it is possible to record a photograph taken by a user so that the user can easily find a desired subject image without imposing a burden on the user.

1 is a block diagram of an imaging apparatus according to a first embodiment of the present invention. 2 is a flowchart showing processing of the imaging apparatus in FIG. 1. The block diagram of the imaging device which concerns on the 2nd Embodiment of this invention. The block diagram which shows the folder structure of a recording medium. FIG. 4 is a flowchart illustrating processing of the imaging apparatus in FIG. 3. FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram of an imaging apparatus according to the first embodiment of the present invention. The imaging apparatus 10 of the present embodiment includes an imaging unit 11 that shoots a subject and generates a subject image, a feature point extraction unit 12 that extracts a feature point from the image, a feature point in the subject image, and a registered image storage in advance. The feature point in the registered image stored in the unit 16 is compared to determine whether or not the feature points in both images match, and when the determination unit 13 determines that they match, the subject Image recording means 14 for recording an image in a folder of the recording medium 15 corresponding to the registered image. Each of the above means is constituted by a computer and a computer program, and the imaging means 11 includes hardware such as a lens (not shown).

  The imaging apparatus 10 of the above embodiment can store the image of the subject photographed by the imaging means 11 in a desired folder of the recording medium 15 without imposing a burden on the user by the function of the apparatus itself. For this reason, when the user later retrieves and reproduces an image of a desired subject from the recording medium 15, the subject image can be easily searched.

  FIG. 2 is a flowchart illustrating processing of the imaging apparatus 10 according to the embodiment. The method performed by the imaging apparatus 10 includes a step of shooting a subject to generate a subject image (S1), a step of extracting a feature point from the image (S2), a feature point in the subject image, and a prestored feature point. Compare the feature points in the registered image and determine whether the feature points in both images match (S3). If it is determined that the feature points match in the determination step, the subject image corresponds to the registered image. Recording in a folder (S4).

  The computer of the imaging apparatus 10 according to the embodiment includes a process for capturing a subject to generate a subject image, a process for extracting a feature point from the image, a feature point in the subject image, and a pre-stored registered image. The feature point is compared with each other to determine whether or not the feature points in both images match, and when it is determined to match in the determination processing, the subject image is recorded in the folder corresponding to the registered image And controlled by a program including:

  FIG. 3 shows an imaging apparatus according to the second embodiment of the present invention. The imaging device 20 of the present embodiment includes a camera 21, an A / D conversion unit 22, an image processing unit 23, a display device 24, a face recognition unit 25, a registered image storage unit 26, a determination unit 27, A selection unit 28, an image recording unit 29, and a recording medium 30 are included. On the recording medium 30, images are divided into folders A to E and recorded.

  The camera 21 generates an image of the subject and gives it to the A / D converter 22 before the shutter is pressed. The image of the subject converted into digital data by the A / D conversion unit 22 is given to the image processing unit 23. The image processing unit 23 performs necessary image processing on the input image and displays it on the display device 24 as a preview screen. The image processing unit 23 also gives the processed image of the subject to the face recognition unit 25 constituting the feature point extraction unit. The face recognizing unit 25 extracts a person image portion from the preview image of the subject, extracts a feature point from the extracted person image portion, and supplies the feature point to the determination unit 27. The face recognizing unit 25 extracts the feature points from the person images in the registered images registered in the registered image storage unit 26 in advance prior to photographing the subject, and provides them to the determining unit 27. .

  The determination unit 27 stores the feature points of the registered image input in advance from the face recognition unit 25, compares the feature points of the person image in the input preview image with the feature points of the registered image, and the feature points. It is determined whether or not. If the determination unit 27 determines that there are a plurality of person images having matching feature points in the preview image, the determination unit 27 gives the selection unit 28 IDs of the plurality of persons having the matching feature points. The selection means 28 internally stores the priority order assigned to each person having the ID, and when the determination means 27 detects matching of feature points for a plurality of person images, one of them is determined according to the priority order. Select one person image. The selection result is returned to the determination means 27. The determination means 27 uses the ID of one person whose feature points match in the preview image or the ID of one person selected by the selection means 28 as the determination result.

  The determination result of the determination unit 27 is given to the image recording unit 29. The image recording unit 29 waits for the shutter of the camera to be pressed, and displays an image showing the person determined by the determining unit 27 as the feature point match in the folder A of the recording medium 30 associated with the ID of the person. Save to ~ D. An image in which the person image for which the determination unit 27 determines that the feature points match is not present in the preview image is stored in the other holder E. It should be noted that the temporal order of the determination result by the pressing of the shutter and the determination means 27 does not matter. The image recording unit 29 records the photographed image in a predetermined folder of the recording medium 30 after both the pressing of the shutter and the determination result by the determination unit 27 occur.

  FIG. 4 illustrates the folder structure of the recording medium 30. Folder A, folder B, folder C, and folder D are provided for a specific person or corresponding to a specific group, respectively. The folder E is a folder for images in which only persons who do not belong to any of them are copied. Inside each folder, one or more reference face images are designated by the user by the user, and the designated face images are registered in the registered image storage unit 26, and the person image of the subject is specified. Used for comparison. The registered images may be taken for that purpose, or one or more of the registered images may be selected from existing images.

  FIG. 5 is a flowchart illustrating processing of the imaging device 20 according to the second embodiment. When shooting by the camera 21 starts, the imaging device 20 starts in the shooting mode set by the user in the previous shooting, for example, in the auto mode (step S11). An image of the subject photographed by the camera 21 is displayed as a preview on the display device 24 (step S12). Next, the imaging device 20 receives a change in the setting mode (step S13). If the setting mode is changed and setting change A is selected, the user can select an image storage destination (step S14). If setting change B is selected, the user selects a shooting mode (step S15). If the setting mode is not changed in step S13, the process proceeds to step S16 as it is with the auto mode setting.

  In step S16, when the auto mode is selected, the face recognition unit (face recognition system) 25 is activated. The face recognition unit 25 compares the currently previewed image with the registered image, and determines whether or not a pre-registered person's face image exists in the displayed image (step). S17). Next, assume that the shutter is pressed in step S18. In step S19, when the user confirms the photographed image and is satisfied with the photographed image and selects registration thereof, the process proceeds to step S20. If the user is not satisfied with the captured image and determines that re-imaging is necessary, the process returns to step S16.

  In step S20, the determination result by the face recognition unit 25 is checked. If the registered image is not included in the captured image, the process proceeds to step S22, the image is registered in the folder E, and the process ends. If a registered image is included, the process proceeds to step S21, and it is determined whether or not a plurality of registered images exist. If there is only one registered image, the process proceeds to step S24, where the image recording means 29 registers the photographed image in the designated folders A to D and ends the process. When there are a plurality of registered images in the photographed image in step S21, the determination unit 27 requests the selection unit 28 to select based on the priority order, and the selection unit 28 selects one of them. (Step S23). The image recording unit 29 registers the image in the folder corresponding to the selected registered image (step S24), and ends the process.

  In the second embodiment, similarly to the first embodiment, the user can save the captured image in a desired folder by the function of the imaging device 20 without specifying the storage destination. Further, in the second embodiment, even in the case of an image having a plurality of registered face images, it can be stored in a desired folder by setting priorities in advance. Therefore, the imaging device 20 can store images in an appropriate folder without imposing a burden on the user each time shooting is performed. An image including a plurality of persons having the same priority order or an image including a plurality of persons having a priority order equal to or higher than a predetermined value may be stored in each folder.

  In each of the above embodiments, an example in which a user designates a face image has been described. However, designation or registration itself by a user is not necessarily required. For example, face recognition is performed every time it is saved from the start of use of the imaging device 20, and if an image with a matching feature point is captured in the same folder, a folder is created each time an image with no matching feature point is taken. Is possible. In any case, at the time when shooting of one image is completed, the shot image is stored so that the user can easily find it later.

  In each of the above embodiments, an example in which a person image is registered has been described. However, the present invention is not necessarily limited to a person image. For example, images such as dishes, flowers, and night views may be automatically identified and a storage folder may be allocated. In either case, the captured image is stored so that the user can easily find the target image when the user reproduces or prints the image later.

  For example, when searching for a desired image taken in the past, the user usually searches for images by browsing the images in order from the newest or the oldest of the stored images. It is. At this time, in the case of the newest image or an image close to the oldest image, the burden on the user is small. However, it is not easy to search for a desired image when the number of stored images becomes hundreds as the capacity of the recording medium increases. Even in such a case, the image pickup apparatus of the present invention records a photographed image so that the user can easily find a desired image without the need for image arrangement by the user.

  Although the invention has been particularly shown and described with reference to illustrative embodiments, the invention is not limited to these embodiments and variations thereof. It will be apparent to those skilled in the art that various modifications can be made to the present invention without departing from the spirit and scope of the invention as defined in the appended claims.

10: imaging device 11: imaging means 12: feature point extraction means 13: determination means 14: image recording means 15: recording medium 16: registered image storage unit 20: imaging device 21: camera 22: A / D conversion unit 23: image Processing unit 24: Display device 25: Face recognition unit 26: Registered image storage unit 27: Determination unit 28: Selection unit 29: Image recording unit 30: Recording medium

Claims (5)

Imaging means for photographing a subject and generating a subject image;
Accepting means for accepting a change of an image storage destination and a selection of a photographing mode by a user in a state where a preview image is displayed on a display device based on the subject image;
Selection means for accepting selection by the user as to whether or not to save the subject image;
Determining means for determining whether or not the selection means has accepted a selection to save the subject image by a user;
Feature point extraction means for extracting feature points from the image;
A determination unit that compares the feature points in the subject image with the feature points in the registered image stored in advance and determines whether or not the feature points in both images match;
An image recording unit that records the subject image in a folder corresponding to the registered image when the determination unit determines that they match,
When the determination unit determines that the selection unit has received a selection not to store the subject image by the user, the imaging unit re-photographs the subject,
The imaging unit shoots the subject according to the selection of the shooting mode by the user received by the receiving unit,
The image recording unit stores the subject image in a changed image storage destination related to a change of an image storage destination by a user received by the reception unit ;
As the registered image, one or more of a plurality of subject images captured by the imaging unit are selected in advance,
When the determination unit detects a match between a plurality of feature points, the image recording unit selects one from a plurality of folders based on the priority order of the plurality of feature points.
Imaging device. The feature point extracting means includes a facial recognition system, according to claim 1 Symbol placement of the imaging device. Shooting a subject to generate a subject image;
Receiving a change of an image storage destination and a selection of a shooting mode by a user in a state where a preview image is displayed based on the subject image;
A selection step of accepting selection by the user as to whether or not to save the subject image;
Determining whether or not a selection to save the subject image by the user is accepted in the selection step;
Extracting feature points from the image;
Comparing feature points in the subject image with feature points in a pre-stored registered image to determine whether the feature points in both images match;
Recording the subject image in a folder corresponding to the registered image when it is determined to match in the determining step;
A step of re-photographing the subject when the determination step determines that the selection of not saving the subject image by the user has been accepted in the selection step;
In the step of generating the subject image, the subject is photographed according to the selection of the photographing mode by the user accepted in the step of accepting the change of the image storage destination and the selection of the photographing mode,
In the recording step, the subject image is stored in the image storage destination after the change related to the change of the image storage destination by the user received in the step of receiving the change of the image storage destination and the selection of the shooting mode ,
Selecting and registering one or more of a plurality of subject images;
When the determining step finds a match of a plurality of feature points, a method based on the priority of the plurality of feature points, further have a step of selecting one of a plurality of folders. The method of claim 3 , wherein extracting the feature points includes a face recognition step. On the computer,
Processing to shoot a subject and generate a subject image;
A process of accepting a change of an image storage destination and a selection of a shooting mode by a user in a state in which a preview image is displayed based on the subject image;
A selection process for accepting selection by the user as to whether or not to save the subject image;
A process of determining whether or not a selection for saving the subject image by the user has been received in the selection process;
Processing to extract feature points from the image;
A process of comparing the feature points in the subject image with the feature points in the pre-stored registered image to determine whether the feature points in both images match;
A process of recording the subject image in a folder corresponding to the registered image;
In the selection process, when it is determined in the determination process that the selection not to store the subject image by the user has been received, a process of re-photographing the subject is executed,
In the process of generating the subject image, the subject is photographed according to the selection of the photographing mode by the user received in the process of accepting the change of the image storage destination and the selection of the photographing mode,
In the recording process, the subject image is stored in the changed image storage destination related to the change of the image storage destination by the user received in the processing of receiving the change of the image storage destination and the selection of the shooting mode ,
Processing for selecting and registering one or more of a plurality of subject images;
A program for causing a computer to further execute a process of selecting one of a plurality of folders based on a priority order of a plurality of feature points when matching of a plurality of feature points is detected in the determination process .

Images