CN101431640A - Image indexing device, image indexing method and camera thereof - Google Patents
Image indexing device, image indexing method and camera thereof Download PDFInfo
- Publication number
- CN101431640A CN101431640A CNA2008101728701A CN200810172870A CN101431640A CN 101431640 A CN101431640 A CN 101431640A CN A2008101728701 A CNA2008101728701 A CN A2008101728701A CN 200810172870 A CN200810172870 A CN 200810172870A CN 101431640 A CN101431640 A CN 101431640A
- Authority
- CN
- China
- Prior art keywords
- image
- mentioned
- face
- images
- index
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
- Image Analysis (AREA)
- Collating Specific Patterns (AREA)
- Image Processing (AREA)
- Television Signal Processing For Recording (AREA)
- Studio Devices (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides an image retrieval device capable of easily retrieving classification images using less operation in a display unit, and an image retrieval method and a camera. A still image shot by a shooting part (2) is recorded as a photographic image (82) in a recording part (4). A face detection part (5) detects faces and an angle determinant part (5a) determines the face angles to left and right under the condition that the photographic image includes characters. A dynamic image display control part (8c) dynamically moves an index face image (83) face direction displayed in an index part (84) of the display part (8), and retrieves the photographic image (82) with the same facing direction as the face direction of the index face image (83) and displays the image. As a result, the photographic image (82) is switched according to the change of the face direction of the index face image (83).
Description
Technical field
The present invention relates to image retrieving apparatus and image search method and camera, specifically, relate to can be from a plurality of photograph images rapidly and understand the image retrieving apparatus and the image search method of ground retrieving images easily.
Background technology
In recent years, the digitlization of photograph image and the high capacity of recording medium make progress, and, comparing with the period of using the silver film camera, photographic frequency is also improving.Therefore, camera user has a large amount of images, the image retrieval spended time.
Therefore, the various image retrieving apparatus of image retrieval have been proposed to carry out easily.For example, such Electrofax being disclosed in patent documentation 1: in advance registration personage's face recognition data is registered, judged whether the personage of photographs is the personage who is registered.In addition, disclose such digital still camera in patent documentation 2: the icon that will represent personage's contour images is replaced as the icon image that is generated by photographs.
2007-No. 150604 communiques of [patent documentation 1] TOHKEMY
2007-No. 159152 communiques of [patent documentation 2] TOHKEMY
Known have a technology of so similar image being classified, but do not know the image retrieving apparatus with less operation classified image retrieved on display unit such as liquid crystal panel.
Summary of the invention
The present invention finishes in view of such situation just, the objective of the invention is to, provide a kind of can be on display unit with the image retrieving apparatus and the image search method of less processing ease ground searching classification image.
In order to achieve the above object, the 1st inventive images indexing unit has: the 1st display part, and it shows a plurality of images of same subject successively; Image recording portion, its record become a plurality of images of image retrieval object; Search part, it is retrieved from the image that is recorded in above-mentioned image recording portion and image like the images category that is presented on above-mentioned the 1st display part; And the 2nd display part, it shows the image that is retrieved by above-mentioned search part.
The 2nd inventive images indexing unit in above-mentioned the 1st invention, has deformation process portion, and above-mentioned deformation process portion is used for a plurality of images that are presented at the above-mentioned subject on above-mentioned the 1st display part are carried out deformation process and show.
The 3rd inventive images indexing unit, in above-mentioned the 1st invention, above-mentioned the 1st display part is selected from the observed a plurality of images of each different angle from dynamic image and is shown successively.
The 4th inventive images indexing unit, in above-mentioned the 1st invention, the image that is presented on above-mentioned the 1st display part is a face-image.
In order to achieve the above object, the 5th inventive images search method has following steps: the step that shows a plurality of images that obtain from each different angles observation specified image on the 1st display part successively; From a plurality of images that become the image retrieval object, retrieve step with image like the images category that is presented on above-mentioned the 1st display part; And the step that shows the above-mentioned image that retrieves.
In order to achieve the above object, the retrieval of the 6th inventive images comprises with program: the step that shows a plurality of images that obtain from each different angles observation specified image on the 1st display part successively; From a plurality of images that become the image retrieval object, retrieve step with image like the images category that is presented on above-mentioned the 1st display part; And the step that shows the above-mentioned image that retrieves.
The camera of the 7th invention has: image pickup part, and it comprises and is used for imaging apparatus etc. that shot object image is carried out the optical system of imaging and this shot object image carried out opto-electronic conversion, is used to obtain view data; The image recording portion, it stores above-mentioned view data; Facial test section, it detects facial parts from the above-mentioned view data of obtaining; And the angle detection unit, its judge by the detected facial parts of above-mentioned facial test section towards angle, above-mentioned image recording portion with above-mentioned angle with above-mentioned view data record.
The camera of the 8th invention, in above-mentioned the 7th invention, above-mentioned camera has similar detection unit, above-mentioned similar detection unit is when obtaining above-mentioned view data by above-mentioned image pickup part, whether judge with similar by above-mentioned facial test section detected face from the image that is stored in above-mentioned image recording portion, above-mentioned image recording portion be judged to be similar image by above-mentioned similar detection unit and carry out record explicitly.
The 9th inventive images indexing unit has: display part, and it has the 1st viewing area and the 2nd viewing area; Storage part, its storage index image and rest image; The dynamic image display control unit, it is used for that above-mentioned index is carried out dynamic image with image and shows; And search part, its index moving that dynamic image shows according to pass through the dynamic image display control unit on above-mentioned the 1st viewing area with image, retrieval and this index show the rest image that is retrieved by above-mentioned search part with rest image like the images category on the 2nd viewing area.
In addition, the 10th inventive images indexing unit, in above-mentioned the 9th invention, above-mentioned index generates with the specific part of image by above-mentioned rest image.
According to the present invention, can provide a kind of can be on display unit with the image retrieving apparatus and the image search method of less processing ease ground searching classification image.
Description of drawings
Fig. 1 illustrates the camera of an embodiment of the invention and the block diagram of its peripheral structure.
Fig. 2 is in an embodiment of the invention, the figure that the recording of information that the face of subject is relevant during with photography describes.
Fig. 3 is in an embodiment of the invention, the figure that the database photography describes.
Fig. 4 illustrates in an embodiment of the invention, the figure of the relation of the dynamic demonstration of index face-image and the corresponding with it photographs that shows, and Fig. 4 (a) and (b), (c) they are the index face-images, Fig. 4 (d), (e), (f) they are photographss.
Fig. 5 is in an embodiment of the invention, face-image is carried out deformation process obtain the figure that the gimmick of index face-image describes.
Fig. 6 is the flow chart that the camera control action in the camera of an embodiment of the invention is shown.
Fig. 7 is the flow chart that the retrieval reproducing movement in the camera of an embodiment of the invention is shown.
Fig. 8 illustrates the flow chart that deformation dynamics image in the camera of an embodiment of the invention generates action.
Fig. 9 illustrates in an embodiment of the invention, the figure of the show state of camera display part when retrieval is reproduced.
Figure 10 is illustrated in the variation of an embodiment of the invention, the figure of the show state of display part when retrieval is reproduced.
Symbol description
1 control part; The similar detection unit of 1a; The 1b timing control part; 2 image pickup parts; 3 optical system control parts; 4 recording portion; 4a feature (angle) data recording section; 4b face data storehouse (DB); 4c breviary display part; 5 facial test sections; 5a angle detection unit; 5b size detection unit; 6 cut out portion; 7 dynamic image handling parts; 8 display parts; The 8a display control unit; 8b multiple image display part; 8c dynamic image display control unit; 9 timing portions; 11 operation determination section; 12 6 axle sensors; 14 Department of Communication Forces; 15 internets; 20 external servers; 81 breviary display images; 82 photographss; 83 index face-images; 84 index portions; 85 retrieval display parts; 93 thumbnails; 8-1 display frame; 8-2 display frame; 8-3 display frame.
Embodiment
Below, the execution mode that camera of the present invention has been used in preferred use describes with reference to the accompanying drawings.Fig. 1 is the block diagram of structure that the camera 10 of an embodiment of the invention is shown.Camera 10 is digital cameras, has control part 1, similar detection unit 1a, timing control part 1b, image pickup part 2, optical system control part 3, recording portion 4, feature (angle) data recording section 4a, face data storehouse (DB) 4b, breviary display part 4c, facial test section 5, angle detection unit 5a, size detection unit 5b, cut out portion 6, dynamic image handling part 7, display part 8, display control unit 8a, multiple image display part 8b, dynamic image display control unit 8c, timing portion 9, operation determination section 11, six axle sensors 12 and Department of Communication Force 14, camera 10 can be connected with external server 20 by internet 15.
Each one in control part 1 and the camera 10 is connected, according to the operation of the functional unit of judging by operation determination section 11 etc., and, according to the timing controlled of timing control part 1b, carry out the integral body of camera 10 and control.In addition, control part 1 has image processing part (not shown), carries out the compression processing of image etc.In addition, control part 1 has similar detection unit 1a, to judging by the similar degree of facial test section 5 detected a plurality of face-images described later, is who determines to the personage who takes in the photographs.
In addition, recording portion 4 has face data storehouse (DB) 4b and breviary display part 4c.Face data DB4b is a database of having gathered the facial parts of the bust in the photographs that is recorded in recording portion 4, determines the personage according to each photographs, by constituting of image and person names.The face-image that breviary display part 4c record cuts out by the portion of cutting out 6 uses when guide look shows as facial index.
Comprise in photographs under the situation of bust that 5 pairs of face pattern of facial test section are judged, facial parts is detected.According to its testing result, expose control and auto-focus are regulated (AF) etc., in addition, and when determining the personage, according to facial test section 5 detected faces expose control and auto-focus adjusting (AF) etc.Facial test section 5 has angle detection unit 5a and big or small detection unit 5b.Angle detection unit 5a judges the direction (angle) of face orientation for the face by facial test section 5 detected personages.Size detection unit 5b judges the size of detected facial parts.
Cutting out portion 6 cuts out and the corresponding view data of facial parts by facial test section 5 detected busts.Data at this face-image that cuts out are recorded among the breviary display part 4c, in addition, are used in the similar judgement of carrying out in similar detection unit 1a etc.When dynamic image handling part 7 shows successively at the photographs to the personage that takes from all angles, not only show as rest image, also change a plurality of images gradually and reproduce, be used for the image processing that as dynamic image, shows thus by a little.
Next, the action to the camera 10 of the present embodiment of such formation describes.In the present embodiment, with the general together record in advance of photographs and personage towards the relevant information of angle, when breviary shows bust facial, show successively and the same directional image of angle of face orientation.
In the image processing part in control part 1, the rest image of taking by image pickup part 2 is implemented image processing such as compression processing, be recorded in the recording portion 4 as photographs.The photographs that is write down reproduces demonstration on display part 8.This photography control is judged by 11 couples of users' of operation determination section camera operation, according to its result of determination, is undertaken by control part 1 control.
In addition, as required, can pass through Department of Communication Force 14 and internet 15 to transmission photographss such as external servers 20.In addition, also can handle for the part of the control of the image processing in the present embodiment with outside computer generation by utilizing communication function.
Comprise in photographs under personage's the situation, facial test section 5 is judged face pattern, detects facial parts.In addition, detected face and the face that is recorded among the face data storehouse 4b in the recording portion 4 are compared, determine whom subject is by similar detection unit 1a.In addition, angle detection unit 5a analyzes the eyes of face and the shade of nose, judge which direction (detection angles) that waits about face orientation, the information of additional " whom angle of face orientation and the personage of subject be " records in the recording portion 4 in photographs.
Use the relevant recording of information of face of Fig. 2 pair of subject during with this photography to describe.When personage 100 was taken, similar detection unit 1a can compare photographs 100a and each image that is recorded in the facial DB4b, determines individual title (being referred to herein as " B ").The direction of the face of photographs judges by angle detection unit 5a, according to its result of determination, the relation of photographs 100a, subject and face angle as category signal, recorded among feature (angle) the data recording section 4a.
In addition, this moment, facial size was judged by big or small detection unit 5b.Use the data of the size of this face that determines that the size of face is revised, compare with the face-image that is recorded among the facial DB4b easily.
Thus, in the present embodiment, even identical personage, also the angle of record face orientation in facial DB4b is carried out data base system.Also can be when database generate, as shown in Figure 3, from all angles the personage 100 of subject is carried out continuous shooting in advance and take, record utilizes this continuous shooting to take the view data that obtains in facial DB4b.When the photography of this database, obtain moving of camera 10 by six axle sensors 12, according to this information, as with the angle information of the directional correlation of face, record in advance among the facial DB4b with photographs.
In addition, the face-image that continuous shooting obtains of passing through shown in Fig. 3 also can be used as image retrieval index of reference image and uses.That is, cut out the facial parts of photographs from view data, carry out facial thumbnailization, record among the breviary display part 4c in the recording portion 4, and it is used in the image retrieval by the portion of cutting out 6.In addition, except the continuous shooting of passing through shown in Fig. 3 obtains the face-image, it can also be the face-image of putting the identical personage who obtains when photographing usually according to each angle of face orientation in order, carry out the dynamic image processing successively so that face moves by dynamic image handling part 7, as facial index breviary display image.
As shown in Figure 1, the breviary display image that is recorded among the breviary display part 4c is presented in the index portion 84 of display part 8 as breviary display image 81.In the example shown in Fig. 1, the breviary display image 81 that longitudinally shows the facial thumbnail 83 of having arranged everyone, during subject (facial thumbnail 83) that the user selects to want to see from breviary display image 81, retrieval and the same directional image 82 of selecteed personage feature (angle) the data recording section 4a in recording portion 4 are presented on the retrieval display part 85.
In the present embodiment, as use Fig. 2 illustrates, during each the photography, compare with the facial thumbnail that is stored among the facial DB4b, to each character image in the photographs and which index facial corresponding, be categorized as which angle and judge, in characteristic recording portion 4a, write down result of determination.Thus, by with reference to these result of determination, can be to being that identical personage and same directional image 82 are retrieved with the index face-image of selecting 83.
In addition, the index face-image 83 that shows as breviary display image 81 on display part 8 moves or dynamically moves in reverse direction from right towards left to dynamic by dynamic image display control unit 83, according to moving of the face of index face-image 83, show and the facial same directional photographs 82 of direction.Thus, follow the direction of the face of index face-image 83 to change, photographs 82 also is switched.In addition, carry out such demonstration control by display control unit 8a, the multiple image display part 8b that is used for the picture segmentation control in the display control unit 8a and dynamic image display control unit 8c.
Use Fig. 4 that the dynamic image demonstration and the corresponding with it photographs 82 that shows of the index face-image 83 in the breviary display image 81 are described.Fig. 4 (a) and (b), (c) are the images of the A that takes with method illustrated in fig. 3, Fig. 4 (a) be facial angle for negative situation, Fig. 4 (b) be that facial angle is that situation, Fig. 4 (c) of 0 are that facial angle is positive situation.
According to each variation of the facial direction of this index face-image 83, retrieve identical personage and same directional photographs 82, show as at the photographs 82 shown in the row on Fig. 4 right side.Promptly, at index face-image 83 according to Fig. 4 (a) → when (b) → (c) → (b) → (a) changing, the condition of retrieval correspondence with it changes, and selects photographs 82 from feature (angle) data recording section 4a, shown photographs 82 according to Fig. 4 (d) → (e) →
(f) → (e) order → (d) changes.
The advantage of the index face-image 83 of Sheng Chenging is thus: can grasp this people's feature from personage of a plurality of angle shots; Make this image itself change the line index of going forward side by side and show, cause user's attention thus easily according to Fig. 4 (a) → (b) → (c) → (b) → (a).In addition, combine, show corresponding photographs 82, therefore be not once to show a plurality of images but the locking display image, so can put searching picture in order with the dynamic image demonstration of index face-image 83.
Display speed with this index face-image that moves can be selected by the user, also can change according to each operation.In addition, even do not photograph, also can from a plurality of images, assemble identical personage's face-image as thumbnail shown in Figure 3, each angle according to facial direction is classified, these face-images are carried out deformation process, as shown in Figure 5, obtain index face-image 83.Use the index face-image 83 after the deformation process, and illustrated in fig. 4 same, switch the image of photographs 82 as shown in Figure 4.
In addition, show at this each face angle according to the unique individual, if but be prerequisite with deformation process shown in Figure 5, also can classify to the personage's of uncertain majority image according to each angle of the direction of face, make the facial image change of index, show the image corresponding successively with this angle.In addition, under the dynamic image pattern, carry out index by the angle that changes facial direction and show and handle, but also can be under the dynamic image pattern angle of the direction of the size of face and health integral body or the variation of expression etc. be handled and indexation.In this case, similarly retrieve accordingly and show similar image with each coma (coma) of the thumbnail that under the dynamic image pattern, changes.
So in the present embodiment, can carry out the high speed retrieval to specific character image.Therefore in addition, the image of being retrieved changes according to the direction of face, when taking a plurality of identical personage as family's photo, also can easily retrieve the image as target by the conditions such as direction to the additional face of this personage.During image that discovery is liked,, can on the picture of display surface, full frame amplification show, appreciate by selecting this image.
Next, use flow chart shown in Figure 6, the action of the index face-image 83 that can use foregoing breviary demonstrationization being carried out the camera 10 of image retrieval describes.At first, the cameraman is set at common photograph mode, whether has carried out whole pushes of release-push, the judgement (S1) of promptly whether photographing usually.
, photograph for carrying out under the situation of photographing usually in the result who judges, obtain the view data (S2) of rest image by image pickup part 2.After this, in step S3～S6,, determine the personage, carry out the record of feature (angle) data as illustrated in fig. 2.At first, according to the view data that gets access to, carry out face by facial test section 5 and detect, in similar detection unit 1a, the face that whether has similar index face-image is judged (S3).When this is judged, also detect the angle of face orientation by angle detection unit 5a.Then, whether facial judgement back judgement has similar face (S4).
Result of determination in step S4 does not record in recording portion 4 (S6) with the image that photographs for having under the similarly facial situation.On the other hand, have under the situation of similar face, with similar face data, promptly be used for being recorded in (S5) in the recording portion 4 with the data of the facial image links of the identical personage's who is stored in facial DB4b index, the angle (characteristic) and the image of face orientation.When the record end of recording portion 4, return, get back to step S1.
Whether the result of determination in step S1 is the judgement (S11) of database photography for not being under the situation of photography usually.This database photography is that being used for from all angles is that the personage takes continuously to subject from right to left for example, obtains the photography of index face-image 83 thus as using Fig. 3 explanation.In this step,, judge whether having set this photograph mode according to the output of operation determination section 11.
Result of determination in step S11 is to have set under the situation of database photography, carries out obtain (S12) of view data by image pickup part 2, carries out face judgement (S13) in facial test section 5 and similar detection unit 1a.Then, according to the output of six axle sensors 12, judge (S14) on the angle of the photography direction of camera 10, whether changing.When result of determination is the angle variation, change, return step S12 and photograph according to each this angle.
When the result of determination in step S14 changes for there not being angle, judge whether camera 10 has moved predetermined angular (S15).If result of determination is to have moved predetermined angular, then cut out facial parts, can feel that only mobile face partly shows, puts in order and records in the recording portion 4 according to each angle from view data.Thus, record index face-image shown in Figure 4.On the other hand, under the situation of mobile predetermined angular not, warn demonstration (S17).Step S16, S17 return when finishing, and get back to step S1.In addition, as predetermined angular, be to get final product as the degree that the index face-image shows, for example, the angle about 15 degree gets final product.
Whether the result of determination in step S11 is the judgement (S21) that retrieval is reproduced for not being under the situation of database photography.In the present embodiment, have the reproduction of selection and two kinds of reproduction mode of retrieval reproduction.Reproduce if result of determination is retrieval, then in step S22, retrieve reproduction, under the situation that is not the retrieval reproduction, in step S23, select to reproduce.
Selecting to reproduce is common reproduction mode, reproduces successively or the view data of breviary displayed record in recording portion 4, amplifies to show the image of selecting.In addition, retrieval is reproduced, on display part shown in Figure 18, while make the direction of the face of the index face-image that breviary shows change the pattern that (Fig. 4 (a) and (b), (c)) shows same directional photographs (Fig. 4 (d), (e), (f)).Retrieval is reproduced or is selected to reproduce when finishing and return, and gets back to step S1.
Next, using flow chart shown in Figure 7 that retrieval among the step S22 is reproduced describes.When entering this flow process, at first, in the index portion 84 of display part 8, show the master drawing image, be breviary display image 81 (S31).Next, the user judges whether to have selected to want the index face-image 83 (S32) watched.In the result who judges is under the situation about having selected, and this selected index face-image 83 changes shown in Fig. 4 (a) → (b) → (c) like that circularly.
At this moment, nonoptional index face-image 83 keeps static.The user can grasp selecteed situation by being the dynamic image state with selected index face-image 83 from the rest image state exchange, can also appreciate dynamic image in the lump.
Then, retrieval judges whether have the photographs 82 (S34) of having taken and same directional face similarly facial with the index face-image 83 of dynamic image demonstration.Retrieved under the situation of photographs 82 in the result who judges, this photographs 82 has been shown (S35).Thus, the direction of the face of index face-image 83 changes successively, shows the photographs 82 of having taken identical personage and same directional face in linkage successively with this direction.
Next, whether selected the judgement (S36) of photographs 82 by the user.Carry out the demonstration of the photographs 82 among the step S35 by downscaled images, expect in order to appreciate photographs 82 to amplify under the situation about showing, select this photographs 82 the user.In the result who judges is under the nonoptional situation, jumps to step S38, on the other hand, under situation about having selected, amplifies demonstration this image (S37) in the display frame of display part 8.Then, the judgement that the retrieval that whether is through with shows under situation about finishing, is returned original process, on the other hand, under unclosed situation, returns step S32.
Result of determination in step S32 is not select from breviary display image 81 under the situation of index face-image 83, carries out the master drawing guide look, is the switching (S41) of breviary display image 81.Under the situation that can't show all images that writes down as breviary display image 81 simultaneously, on display part 8, show its part.In this step, carry out the demonstration of the breviary display image 81 of next priority level.
Result of determination in step S41 is under the situation that does not have to switch, and returns step S32, on the other hand, is carrying out under the situation about switching, and shows ensuing master drawing guide look, is breviary display image 81 (S42), jumps to step S38.Under the situation of retrieving reproduction continuously, return step S32 from step S38, below described step S33, retrieve and show.
In the flow chart of earlier figures 6, in step S12～step S16, carried out the database photography, use Fig. 8 illustrates the index face-image generation that the deformation dynamics image carries out of passing through that replaces.This generation method can not need the special photography of the following explanation of step S12 of method for imaging shown in Figure 3 and Fig. 6.
Enter the flow chart that this deformation dynamics image generates, when similarly photographing with step S2, whether the personage who carries out taking in this photographs is identical personage's judgement (S51).That is, to whether seemingly judging with the facial images category of index that is recorded in the recording portion 4.Next, according to the result of this judgement, judge whether identical with the index face-image that has write down, i.e. whether identical with master drawing (S52).If the result who judges is identical face-image, then below step S53, generate the deformation dynamics image.
At first, the angle of carrying out face-image is judged (S53).In this angle is judged, according to the balance of the position of the position of the eyes of face-image and nose etc. the angle of the direction of face orientation is judged by angle detection unit 5a.Next, carry out the extraction (S54) of face-image, personage and angle are carried out associated record (S55) by the portion of cutting out 6.Next, arrange the image of a plurality of faces that write down according to each angle, distortion generates the intermediate image of previous image and next image as shown in Figure 5, generates deformation dynamics image (S56) thus.At this moment, for unified facial size, in step S54, become the face of same size by big or small detection unit 5b.
For example, generating from the image shown in Fig. 4 (d), (e), (f) under the situation of deformation dynamics image, face is little in Fig. 4 (d), Fig. 4 (e) is middle facial big.Under the situation about varying in size of face, utilize the amplification of image and dwindle processing like this, cut out image, be unified into the face-image of identical size to become the face of identical size.
Result of determination in step S52 is under the personage's not identical with master drawing the situation, promptly, not with the index face-image 83 similar situations that are recorded in the recording portion 4 under because there is not identical personage's image, so can't generate index face-image 83 by the deformation dynamics image.In this case, when the photography of identical personage having been finished the 2nd, the step that execution in step S61 is following is can generate the deformation dynamics image.
At first, similarly carry out angle with step S53 and judge (S61), extract facial image, adjust size when showing, to become the size (S62) of regulation.Then, with step S55 similarly, personage and angle are carried out associated record (S63), carry out new master drawingization, promptly write down (S64) as the index face-image.Thus, when carrying out the deformation dynamics image, the image of only taking identical personage gets final product, and there is no need to carry out Fig. 3 and the following special photography action of step S12.
Next, carried out the user using Fig. 9 that the variation of the display frame of display part 8 is described under the situation of image retrieval operation.At first, when beginning to retrieve, on display part 8, show display frame 8-1, in index portion (the 1st search part) 84, show index face-image 83, as breviary display image 81 according to each personage.
The functional unit of user's operate camera 10 when selecting the index face-image 83 of A, shows on retrieval display part 85 and takes the photographs 82 that A is arranged.In addition, and become display frame 8-2 simultaneously, the facial direction that is presented at the index face-image 83 of the A in the index portion (the 2nd search part) 84 changes.The photographs 82 that retrieves accordingly with the variation of the facial direction of A is presented on the retrieval display part 85.
Next, when the user selects the index face-image 83 of B, switch to display frame 8-3, the photographs 82 that is presented at the A on the retrieval display part 85 disappears, and the face of the index face-image 83 of B changes as dynamic image.In addition, on retrieval display part 85, retrieval shows with the photographs 82 of the facial direction equal angular of the index face-image 83 of B.
Like this, the camera 10 in the present embodiment is not only retrieved in single personal images when carrying out image retrieval, considers that also this individual's move (particularly being facial direction) carried out the locking of image.In addition, dynamic image shows index face-image 83, therefore, differentiates easily when selecting, but also can appreciate dynamic image itself.
In the above description, only show the example that the direction of the face by the personage is retrieved,, as shown in figure 10, also can utilize fish and flower to wait theme to retrieve as modified embodiment of the present embodiment.In addition, also can be all images in the camera 10 not to be retrieved, and link, in the personal computer of connecting with network (PC) 21, carry out image retrieval by Department of Communication Force 14 and external server 20.
If the facial technology that detects then can be carried out abundant determination processing with the computer that group is gone in the camera 10.But, also can be to adopt the structure of handling by external server 20 and PC21 according to subject.
That is,, not only need to be undertaken the technology of extracting section by simple pattern according to subject, the technology that also needs the more main subject of height to extract, with its according to the moving of subject, not as the technology of effectively utilizing separating background and main subject etc. relatively good.For example, with the object of activity as main subject, the background separating method that inactive object is handled as a setting.For example as typical example, if in the image that extracts according to this processings, the image that is in picture central authorities carries out thematic map picture (thumbnail) change.
In variation shown in Figure 10, in the index portion 84 of display frame 8-1, selectively show “ Trout fish " and themes such as " multiflora roses ", as thumbnail 93.Under the situation of these subject thing activities, can carry out background separation.When selecting any one of thumbnail 93, main subject image (Shi Trout fish Zhong the example of Figure 10) goes round shown in display frame 8-1 → display frame 8-2 like that.In addition, on retrieval display part 85, show and photographs 82 like this main subject images category successively.
Next, when selecting the thumbnail 93 (in the example of Figure 10, being multiflora rose) of other themes, reproduce this subject thing of demonstration (in display frame 8-3, the state that flower waves with the wind etc.) with dynamic image.In addition, on retrieval display part 85, show and the similar photographs 82 of this subject thing (direction etc. are identical).
Thus, even identical theme also has the situation of wanting that the image observed changes along with its activity or composition, especially select a plurality of images and generate under the situation of a photograph album accepting or rejecting, whole atmosphere according to which image of combination and which image changes.Therefore, the expectation of wanting from a plurality of images to select the excellent images of aesthetic property is arranged, in the present embodiment, with dynamic image form activity index image, selection captures the rest image with the movable moment shown in this dynamic image.Therefore, can be when appreciating dynamic image, at the effective similar rest image of moment selection mode.Thus, when the various image of retrieval, adopt dynamic image to show as index, can handle a theme with various sections on same frame thus, by image retrieval, it is easy that the selection of image and locking become in addition.
As described above such, in the present embodiment, dynamically show the index image successively, to retrieving with the corresponding photographs of the dynamic change of image with this index and showing.Therefore can be on display part 8 with the direction (angle) of less processing ease ground retrieval face etc. and the image of being classified.
In addition, in the present embodiment,,, the angle of face is recorded in the recording portion 4 with view data according to part from the detected face of view data in when photography.Therefore, when image retrieval, can use this facial angle to retrieve and show, very convenient.In addition, from the image that is recorded in recording portion 4,, comprise this information in the interior record image data of carrying out to retrieving with the similar image of facial parts of the image of taking.Therefore, can realize the rapid of image retrieval.
In addition, in the present embodiment, on same frame, index portion 84 that shows breviary display image 81 and the retrieval display part 85 that shows photographs 82 are shown, but be not limited thereto, for example, can certainly on different pictures, show.In addition, detecting the facial parts of photographs 82, carry out that angle is judged, size is judged and similar judgement, but be not limited to face, also can be the position that the part etc. of whole health, eyes can be differentiated on health.
In addition, in the present embodiment, as the equipment that is used to photograph, the use digital camera is illustrated, but as camera, personal digital assistant) etc. also can use digital single-lens reflex camera and pocket digital camera, in addition, can certainly use to be built in mobile phone and portable information terminal (PDA:PersonalDigital Assist: the camera in.In addition, dynamically show comprise following any one: by showing a plurality of rest images successively, as dynamic image, show; And generate intermediate images by a plurality of rest images by image processing, show as dynamic image by showing these images successively.
The present invention not only is defined in above-mentioned execution mode, the implementation phase can in the scope that does not break away from its purport, inscape be out of shape and specialize.In addition, the appropriate combination by disclosed a plurality of inscapes in the above-mentioned execution mode can form various inventions.For example, also can delete several inscapes of the whole inscapes shown in the execution mode.In addition, the inscape that also can appropriate combination relates to different execution modes.
Claims (10)
1. an image retrieving apparatus is characterized in that, this image retrieving apparatus has:
The 1st display part, it shows a plurality of images of same subject successively;
Image recording portion, its record become a plurality of images of image retrieval object;
Search part, it is retrieved from the image that is recorded in above-mentioned image recording portion and image like the images category that is presented on above-mentioned the 1st display part; And
The 2nd display part, it shows the image that is retrieved by above-mentioned search part.
2. image retrieving apparatus according to claim 1 is characterized in that,
Above-mentioned image retrieving apparatus has deformation process portion, and above-mentioned deformation process portion is used for a plurality of images that are presented at the above-mentioned subject on above-mentioned the 1st display part are carried out deformation process and show.
3. image retrieving apparatus according to claim 1 is characterized in that,
Above-mentioned the 1st display part is selected from the observed a plurality of images of each different angle from dynamic image and is shown successively.
4. image retrieving apparatus according to claim 1 is characterized in that,
The image that is presented on above-mentioned the 1st display part is a face-image.
5. an image search method is characterized in that, this image search method has:
The step that on the 1st display part, shows a plurality of images that obtain from each different angles observation specified image successively;
From a plurality of images that become the image retrieval object, retrieve step with image like the images category that is presented on above-mentioned the 1st display part; And
The step that shows the above-mentioned image that retrieves.
6. an image retrieval program is characterized in that, this image retrieval comprises with program:
The step that on the 1st display part, shows a plurality of images that obtain from each different angles observation specified image successively;
From a plurality of images that become the image retrieval object, retrieve step with image like the images category that is presented on above-mentioned the 1st display part; And
The step that shows the above-mentioned image that retrieves.
7. a camera is characterized in that, this camera has:
Image pickup part, it comprises and is used for shot object image is carried out the optical system of imaging and this shot object image carried out imaging apparatus of opto-electronic conversion etc., is used to obtain view data;
The image recording portion, it stores above-mentioned view data;
Facial test section, it detects facial parts from the above-mentioned view data of obtaining; And
The angle detection unit, its judge by the detected facial parts of above-mentioned facial test section towards angle,
Above-mentioned image recording portion with above-mentioned angle with above-mentioned view data record.
8. camera according to claim 7 is characterized in that,
Above-mentioned camera has similar detection unit, and whether above-mentioned similar detection unit judge with similar by above-mentioned facial test section detected face from the image that is stored in above-mentioned image recording portion when obtaining above-mentioned view data by above-mentioned image pickup part,
Above-mentioned image recording portion be judged to be similar image by above-mentioned similar detection unit and carry out record explicitly.
9. an image retrieving apparatus is characterized in that, this image retrieving apparatus has:
Display part, it has the 1st viewing area and the 2nd viewing area;
Storage part, its storage index image and rest image;
The dynamic image display control unit, it is used for that above-mentioned index is carried out dynamic image with image and shows; And
Search part, with the moving of image, retrieval and this index be with rest image like the images category according to the index that shows by dynamic image display control unit and dynamic image on above-mentioned the 1st viewing area for it,
On the 2nd viewing area, show the rest image that retrieves by above-mentioned search part.
10. image retrieving apparatus according to claim 9 is characterized in that,
Above-mentioned index generates with the specific part of image by above-mentioned rest image.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2007287107 | 2007-11-05 | ||
| JP2007-287107 | 2007-11-05 | ||
| JP2007287107A JP5064173B2 (en) | 2007-11-05 | 2007-11-05 | camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101431640A true CN101431640A (en) | 2009-05-13 |
| CN101431640B CN101431640B (en) | 2011-05-18 |
Family
ID=40646770
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008101728701A Expired - Fee Related CN101431640B (en) | 2007-11-05 | 2008-11-05 | Image indexing device, image indexing method and camera thereof |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP5064173B2 (en) |
| CN (1) | CN101431640B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102316256A (en) * | 2010-07-09 | 2012-01-11 | 奥林巴斯映像株式会社 | Portable set and reproduction display packing |
| CN103534725A (en) * | 2011-05-23 | 2014-01-22 | 索尼公司 | Information processing device, information processing method, and computer program |
| WO2017032180A1 (en) * | 2015-08-27 | 2017-03-02 | 腾讯科技（深圳）有限公司 | Method and device for shifting angle of image captured by electronic terminal |
| CN107071270A (en) * | 2016-02-10 | 2017-08-18 | 奥林巴斯株式会社 | Camera device and its image capture method |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3960238B2 (en) * | 2003-03-03 | 2007-08-15 | 日本電信電話株式会社 | Image processing method, program, and recording medium recording the same |
| JP2005184348A (en) * | 2003-12-18 | 2005-07-07 | Canon Inc | Video image processor and representative image setting method |
| JP2005275979A (en) * | 2004-03-25 | 2005-10-06 | Fuji Photo Film Co Ltd | Image retrieving program |
-
2007
- 2007-11-05 JP JP2007287107A patent/JP5064173B2/en not_active Expired - Fee Related
-
2008
- 2008-11-05 CN CN2008101728701A patent/CN101431640B/en not_active Expired - Fee Related
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102316256A (en) * | 2010-07-09 | 2012-01-11 | 奥林巴斯映像株式会社 | Portable set and reproduction display packing |
| CN102316256B (en) * | 2010-07-09 | 2014-07-09 | 奥林巴斯映像株式会社 | Portable device and reproduction display method |
| CN103534725A (en) * | 2011-05-23 | 2014-01-22 | 索尼公司 | Information processing device, information processing method, and computer program |
| WO2017032180A1 (en) * | 2015-08-27 | 2017-03-02 | 腾讯科技（深圳）有限公司 | Method and device for shifting angle of image captured by electronic terminal |
| US10270963B2 (en) | 2015-08-27 | 2019-04-23 | Tencent Technology (Shenzhen) Company Limited | Angle switching method and apparatus for image captured in electronic terminal |
| CN107071270A (en) * | 2016-02-10 | 2017-08-18 | 奥林巴斯株式会社 | Camera device and its image capture method |
| CN107071270B (en) * | 2016-02-10 | 2020-07-10 | 奥林巴斯株式会社 | Image pickup apparatus and image pickup method |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2009118040A (en) | 2009-05-28 |
| CN101431640B (en) | 2011-05-18 |
| JP5064173B2 (en) | 2012-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9113134B2 (en) | Display control apparatus, display control method, and program | |
| US8078618B2 (en) | Automatic multimode system for organizing and retrieving content data files | |
| US8028249B2 (en) | Method and system for browsing large digital multimedia object collections | |
| US8315463B2 (en) | User interface for face recognition | |
| US8212911B2 (en) | Imaging apparatus, imaging system, and imaging method displaying recommendation information | |
| US6229566B1 (en) | Electronic photography system | |
| CN101453573B (en) | Image display device and camera, image display method and image display system | |
| CN102200992A (en) | Image display apparatus and image display method | |
| JP2005269604A (en) | Imaging device, imaging method, and imaging program | |
| CN101425133A (en) | Human image retrieval system | |
| US7672977B2 (en) | Image reproducing apparatus, method of controlling same and control program therefor | |
| JP2011109428A (en) | Information processing apparatus, information processing method, and program | |
| CN101431640B (en) | Image indexing device, image indexing method and camera thereof | |
| CN100370799C (en) | Imaging apparatus with communication function, image data storing method and computer program | |
| JP2007266902A (en) | Camera | |
| CN101982969A (en) | Image reproducing device, image reproduction program, recording medium, and image reproducing method | |
| JP5368614B2 (en) | Image search apparatus and image search method | |
| US20050052550A1 (en) | Image-file managing system and optical apparatus for observing object | |
| JP2005267609A (en) | Digital picture book system, and method and program for searching picture book | |
| JP5176776B2 (en) | camera | |
| JP2007156729A (en) | Retrieval device and retrieval method and camera having retrieval device | |
| JP2005175839A (en) | Image display device,image display method, program, and recording medium | |
| US7174095B2 (en) | Optical apparatus for observing object | |
| JP5613304B2 (en) | Image search apparatus and image search method | |
| JP2017184021A (en) | Content providing device and content providing program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20151124 Address after: Tokyo, Japan, Japan Patentee after: Olympus Corporation Address before: Tokyo, Japan Patentee before: Olympus Imaging Corp. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20110518 Termination date: 20191105 |