JP5634910B2 - Portable information terminal device - Google Patents

Description

  The present invention relates to a portable information terminal device, and more particularly to an improvement of a portable information terminal device capable of acquiring position information.

  2. Description of the Related Art Conventionally, a portable information terminal device that can capture position information by capturing a subject and generating image data and receiving a signal from, for example, a GPS (Global Positioning System) satellite Are known. In such a portable information terminal device, it is possible to display image data corresponding to the shooting position by holding the shooting position in association with the image data and designating the shooting position by the user. Further, when a map is displayed on the display screen and any position is designated on the map, image data photographed around the designated position can be displayed (for example, Patent Document 1). .

  Further, Japanese Patent Application Laid-Open No. 2004-228620 describes that, when acquisition of position information fails during shooting, the position information acquired before and after shooting is associated with image data as a shooting position. In this case, even image data for which position information acquisition has failed during shooting can be held in association with the shooting position.

JP 2001-289650 A JP 2009-147694 A

  Generally, in a portable information terminal device, when image data captured by another imaging device is input, the imaging position may not be associated with the image data. In this case, in the configuration described in Patent Document 2, position information acquired by the portable information terminal device at the time when shooting is performed by another imaging device is associated with image data as a shooting position. For this reason, when the portable information terminal device is at a position close to another imaging device at the photographing time, the photographing position can be associated with the image data. When the user is away from the camera, there is a problem that an incorrect shooting position is associated with the image data.

  The present invention has been made in view of the above circumstances, and a portable information terminal device capable of determining the shooting position of image data when image data shot by another imaging device is input. The purpose is to provide.

  The portable information terminal device according to the first aspect of the present invention includes a position information acquisition unit that acquires position information, a movement history storage unit that stores movement history information in which the position information acquisition time is associated with the position information. A feature information storage unit for storing user feature information; an image input unit for inputting image data associated with a shooting time; and the image data includes the user as a subject based on the feature information. Subject discrimination means for discriminating whether or not the image is detected, and imaging position discrimination means for associating the position information in the movement history storage means with the image data based on the discrimination result of the subject discrimination means, The photographing position determining means associates the position information with the image data by comparing the photographing time with the acquisition time in the movement history storage means. Constructed.

  According to such a configuration, it is determined whether or not the user is included as a subject in the input image data, and based on the determination result, the position where the image data is acquired before and after the shooting time. Corresponds to information. Therefore, it is possible to improve the reliability in determining the shooting position for image data captured by another person's imaging device.

  A portable information terminal device according to a second aspect of the present invention includes, in addition to the above configuration, an imaging unit for capturing an image of a subject based on a user operation, and the position information acquisition unit includes the position information based on the user operation. It is configured to obtain information.

  According to such a configuration, position information is acquired based on a user operation for photographing a subject. Normally, when a user operation for photographing a subject is performed, the user is often photographed by another imaging device. For this reason, position information is acquired based on the user's shooting operation and held as movement history information, so that when the image data being shot by the user is subsequently input, the position information can be associated. it can. In this case, the position information can be associated with high accuracy without acquiring the position information frequently, so that power consumption can be reduced.

  In addition to the above configuration, the portable information terminal device according to a third aspect of the present invention is configured so that the position information acquisition unit acquires the position information for each first period and is based on a user operation for photographing a subject. It is comprised so that the said positional information may be acquired for every 2nd period shorter than a 1st period.

  According to such a configuration, the frequency of acquiring the position information is increased based on the user operation for photographing the subject. For this reason, when it is predicted that the user is likely to be photographed by another person, the position information can be acquired with high frequency. Therefore, it is possible to accurately determine the imaging position of image data including a user as a subject while reducing power consumption.

  In addition to the above configuration, the portable information terminal device according to the fourth aspect of the present invention includes a time comparison unit in which the imaging position determination unit compares the imaging time with the acquisition time in the movement history storage unit, and the image data. Position information for selecting the position information in the movement history storage means as the shooting position of the image data based on the comparison result of the time comparison means when it is determined that the user is included as a subject And selecting means.

  According to such a configuration, when it is determined that the user is included as a subject in the image data, the image data is associated with the position information acquired before and after the shooting time, so the shooting position is determined. Reliability can be improved when doing so.

  In addition to the above configuration, the portable information terminal device according to the fifth aspect of the present invention is configured such that the position information selection unit selects the position information associated with the acquisition time closest to the shooting time.

  According to such a configuration, since the position information acquired at the time closest to the shooting time is selected as the shooting position, the shooting position can be selected with high accuracy.

  According to a sixth aspect of the present invention, in addition to the above configuration, the feature information storage unit holds the user feature information extracted from the face image, and the subject determination unit extracts the face image from the face image. By comparing the feature information obtained and the feature information extracted from the image data, it is configured to determine whether or not the user is included as a subject in the image data.

According to a seventh aspect of the present invention, in addition to the above- described configuration, the portable information terminal device is based on image data storage means for holding the image data associated with the position information by the photographing position determination means , and user operation input. Based on the comparison result of the area specifying means for specifying the area, the position comparing means for comparing the area with the position information of the image data held in the image data storage means, and the position comparing means. Image browsing screen generation means for generating screen data for browsing the image data.

  According to such a configuration, the user can display image data captured in this area by designating the area. Therefore, the user can easily display image data taken in an arbitrary area, which is highly convenient.

  In the portable information terminal device according to the present invention, it is determined whether or not the user is included as a subject in the input image data, and based on the determination result, the image data is acquired before and after the shooting time. Corresponding to position information. Therefore, it is possible to improve the reliability in determining the shooting position for image data captured by another person's imaging device.

  In particular, since position information is acquired based on a user operation for photographing a subject, the position information can be associated when image data of a photographed user is subsequently input. In this case, the position information can be associated with high accuracy without acquiring the position information frequently, so that power consumption can be reduced.

It is the external view which showed an example of schematic structure of the portable information terminal device by embodiment of this invention. 2 is a block diagram showing an example of an electrical configuration of the mobile phone 100 of FIG. FIG. 3 is a block diagram illustrating a configuration example of a main part of the mobile phone 100 in FIG. 2. FIG. 4 is a block diagram illustrating a configuration example of a subject determination unit 49 in FIG. 3. It is the figure which showed an example of the movement history information used for the mobile telephone 100 of FIG. It is a figure showing the example of a display of the registration screen of the picture showing a user. It is the figure which showed the example of a display of the confirmation screen which prompts a user to make an imaging | photography position match with image data. 3 is a flowchart illustrating an example of a shooting position addition process in the mobile phone 100 of FIG. 1. 3 is a flowchart showing an example of image selection processing in the mobile phone 100 of FIG. It is the block diagram which showed one structural example about the principal part of the mobile telephone 100 by Embodiment 2 of this invention. 11 is a flowchart showing an example of a shooting position addition process in the mobile phone 100 of FIG.

Embodiment 1 FIG.
FIG. 1 is an external view showing an example of a schematic configuration of a portable information terminal device according to an embodiment of the present invention. As an example of the portable information terminal device, a mobile phone 100 with a camera having a GPS function is shown. . FIG. 1A shows an open state in which the display housing 10 and the operation housing 20 are unfolded, and FIG. 1B shows a closed state in which both housings are folded. ing.

  In the mobile phone 100, position information is acquired based on GPS signal reception data and stored as movement history information. For this reason, when image data captured by another image capturing apparatus is input, position information acquired by the mobile phone 100 at the time of capturing the image data can be associated with the image data as a capturing position. At that time, it is determined whether or not the user is included as a subject in the image data, and by confirming that the image data has been photographed near the mobile phone 100, a photographing position associated with the image data. Reliability can be improved.

  The mobile phone 100 is a foldable mobile phone, and connects the display housing 10 having the main display 11, the operation housing 20 having a plurality of operation keys 21, the display housing 10 and the operation housing 20. It consists of a hinge part 30.

  The main display 11 is a display device arranged on one main surface of the display housing 10. In the display housing 10, a receiver 12 and a sub camera 15 for receiving are arranged on the same side as the main display 11, and a sub display 13 and a main camera 14 are arranged on the opposite side.

  The operation casing 20 is provided with two or more operation keys 21 and a microphone 22 for transmission. The main camera 14 and the sub camera 15 are imaging means for photographing a subject based on a user operation. Here, the camera image is taken in for storage by operating the operation key 21.

  FIG. 2 is a block diagram showing an example of the electrical configuration of the mobile phone 100 of FIG. The mobile phone 100 includes a terminal control unit 44 composed of a processor, a cellular communication unit 41, a short-range wireless communication unit 42, a GPS reception unit 43, an operation key 21, and a main display 11 that can be controlled by the terminal control unit 44, respectively. The main camera 14, the sub camera 15, and the data input / output unit 45 are provided.

  The cellular communication unit 41 transmits and receives radio waves to and from the base station via an antenna. The short-range wireless communication unit 42 is a short-range data communication processing unit that transmits and receives data to and from another mobile phone via a short-range communication antenna and an infrared light emitter / receiver. Here, image data is transmitted and received by Bluetooth (registered trademark) or infrared communication.

  The GPS receiving unit 43 performs an operation of receiving a signal from a GPS satellite at regular intervals and outputting received data of the GPS signal to the terminal control unit 44. The data input / output unit 45 is an external interface for inputting / outputting data to / from the memory card accommodated in the card slot.

  FIG. 3 is a block diagram showing a configuration example of a main part of the mobile phone 100 of FIG. 2, and shows an example of a functional configuration in the terminal control unit 44. The terminal control unit 44 includes a position information acquisition unit 46, a movement history storage unit 47, an image input unit 48, a subject determination unit 49, a feature information storage unit 50, a shooting position determination unit 51, an image data storage unit 52, and an area specification unit 53. The position comparison unit 54 and the image browsing screen generation unit 55 are configured.

  The position information acquisition unit 46 performs an operation of acquiring position information indicating the current position based on the reception data of the GPS signal by the GPS reception unit 43. The position information is determined by analyzing the reception results of signals from a plurality of GPS satellites, and is represented by latitude and longitude, for example. Further, the base station may be configured to determine in which service area the mobile phone 100 is located by acquiring position information for identifying a base station with which the cellular communication unit 41 communicates. Here, it is assumed that the position information acquisition unit 46 acquires position information at regular intervals.

  The movement history storage unit 47 holds movement history information in which the acquisition time is associated with the position information acquired by the position information acquisition unit 46. The image input unit 48 is an input unit for inputting image data. For example, image data attached to a received mail is input via the cellular communication unit 41. Alternatively, the image data held in the memory card may be input via the data input / output unit 45. Here, it is assumed that image data is input via the short-range wireless communication unit 42 by Bluetooth. The input image data is associated with the shooting time.

  The subject determination unit 49 performs an operation of determining whether or not the user is included as a subject in the image data based on the user feature information previously stored in the feature information storage unit 50. Specifically, by comparing the feature information extracted from the user's face image and stored in advance in the feature information storage unit 50 with the feature information extracted from the image data, the image data is used as a subject. It is determined whether or not a user is included. The feature information storage unit 50 holds user feature information. More specifically, feature information extracted from the user's face image, for example, feature information such as the shape and size of each part of the face such as the user's eyes, nose, mouth, and contour is held.

  The shooting position determination unit 51 performs an operation of associating position information held in the movement history storage unit 47 with image data based on the determination result of the subject determination unit 49. In this case, the position information is associated with the image data by comparing the photographing time of the image data with the acquisition time of the movement history information held in the movement history storage unit 47. Specifically, when the user is included as a subject in the image data, it is determined that the image data is taken near the mobile phone 100 and the position information held in the movement history storage unit 47 is determined. Corresponds to image data. On the other hand, when the user is not included as a subject in the image data, the shooting position of the image data is not determined.

  The photographing position determination unit 51 includes a time comparison unit 511 and a position information selection unit 512. The time comparison unit 511 performs an operation of comparing the image data capture time and the movement history information acquisition time. For example, the acquisition time closest to the imaging time of the image data among the acquisition times held in the movement history storage unit 47 is determined. Further, it may be configured to determine an acquisition time that is earlier than the image data shooting time and that is closest to the image data shooting time. Here, description will be made assuming that the time comparison unit 511 determines the acquisition time closest to the imaging time of the image data among the acquisition times held in the movement history storage unit 47.

  The position information selection unit 512 determines the position information in the movement history storage unit 47 based on the comparison result of the time comparison unit 511 when the subject determination unit 49 determines that the user is included in the image data. Is selected as the shooting position of the image data. For example, the position information associated with the acquisition time determined by the time comparison unit 511 to be closest to the image data shooting time is selected as the shooting position. On the other hand, if the subject discrimination unit 49 determines that the user is not included as a subject in the image data, the position information is not selected. The image data storage unit 52 holds the image data and the shooting position selected by the position information selection unit 512 in association with each other.

  The area designating unit 53 performs an operation of designating an area for selecting image data based on a user operation input. For example, an area around the position is designated based on a key operation for inputting a place name or a station name. Here, it is assumed that when a map image is displayed on the main display 11, an area around the position is designated by the user performing a key operation to select any position on the map.

  The position comparison unit 54 performs an operation of comparing the area specified by the area specification unit 53 with the shooting position of the image data held in the image data storage unit 52. Specifically, a shooting position included in the area is determined, and image data corresponding to the shooting position is selected.

  The image browsing screen generation unit 55 performs an operation of generating screen data for browsing the image data based on the comparison result of the position comparison unit 54. Here, screen data for displaying the browsing screen of the image data selected by the position comparison unit 54 is generated and displayed on the main display 11.

  FIG. 4 is a block diagram illustrating a configuration example of the subject determination unit 49 of FIG. The subject determination unit 49 includes a feature extraction unit 491, a matching degree calculation unit 492, and a matching degree determination unit 493. The feature extraction unit 491 performs an operation of extracting feature information such as the shape and size of each part of the face such as eyes, nose, mouth, and outline from the face image included in the image data.

  When the image data is a landscape image that does not include a face image, feature information cannot be extracted from the image data. In this case, it is determined that the user is not included as a subject in the image data. On the other hand, when the feature information is successfully extracted from the photographed image, the matching degree calculation unit 492 compares the extracted feature information with the user feature information held in the feature information storage unit 50, A numerical degree of coincidence is calculated.

  The degree of coincidence determination unit 493 compares the degree of coincidence calculated by the degree of coincidence calculation unit 492 with a predetermined threshold and outputs the comparison result. At this time, if the degree of coincidence exceeds a threshold value, it is determined that the user is included as a subject in the image data. If the degree of coincidence is smaller than the threshold value, it is determined that the user is not included in the image data. Determined. Here, the degree of coincidence is the ratio of the feature information that is matched among all the feature information that has been compared.

  If such a configuration is adopted, the subject determination unit 49 determines whether the input image data includes a user as a subject, and based on the determination result, the shooting position determination unit 51 The position information acquired at the time closest to the shooting time is selected as the shooting position of the image data, and is associated with the image data. That is, if the user of the mobile phone 100 is included as a subject, it can be determined that the image data is captured at a position close to the mobile phone 100, and therefore the location information of the mobile phone 100 corresponding to the shooting time is assigned. . Therefore, it is possible to improve the reliability when determining the shooting position of the image data captured by another person's imaging device.

  Further, since the position information can be selected simply by comparing the shooting time of the image data and the acquisition time of the position information, the shooting position of the image data can be determined by a simple process. Furthermore, since the position information acquired at the time closest to the shooting time is selected as the shooting position, the shooting position can be selected with high accuracy.

  FIG. 5 is a diagram showing an example of movement history information used in the mobile phone 100 of FIG. In this example, the position information indicating the latitude and longitude of the mobile phone 100 is acquired every minute by the GPS receiving unit 43 and held in association with the acquisition time. For example, the location information acquired at 22:10 on June 23, 2010 indicates that the mobile phone 100 was located at a point of 33.00 degrees north latitude and 131.00 degrees east longitude. The location information acquired at 22:14 on June 23, 2010 indicates that the mobile phone 100 was located at a point of 33.01 degrees north latitude and 131.01 degrees east longitude.

  FIG. 6 is a diagram illustrating a display example of an image registration screen representing a user. The image representing the user is an image for extracting the feature information of the user and is taken by the sub camera 15. This feature information of the user is stored in the feature information storage unit 50 and is used when it is determined whether or not the user is included as a subject in the input image data.

  When a user operation for instructing registration of an image representing a user is performed, the sub camera 15 is activated, and after the sub camera 15 is ready for photographing, an image of a subject with respect to the sub camera 15 is displayed in real time on the main display 11. (See FIG. 6). At this time, the main display 11 functions as a finder of the sub camera 15, and the face of the person who is performing the operation while viewing the main display 11 is displayed on the finder screen configured by the main display 11. The main display 11 displays an icon 111 for performing shooting by the sub camera 15.

  In the finder screen of FIG. 6, when the user performs registration operation by operating the operation key 21 corresponding to the icon 111 after positioning the user's face, the feature extraction unit 491 of the subject determination unit 49 is Then, processing for extracting user feature information from the image photographed by the sub camera 15 is performed. At this time, the extracted feature information is stored in the feature information storage unit 50.

  FIG. 7 is a diagram illustrating a display example of a confirmation screen that prompts the user to associate a shooting position with image data. This screen is an input screen for confirming to the user whether or not to associate the shooting position with the image data, and is displayed on the main display 11 when it is determined that the user is included in the image data. The

  The file name “IMG — 0001.JPG” of the image data is displayed in the upper end display area 61 of the confirmation screen, and the icon 112 and the icon 113 are displayed in the lower end display area 63. In the main display area 62, image data including the user as a subject is displayed, and a message for confirming to the user whether or not to associate a shooting position with the image data is displayed.

  Character strings “Yes” and “No” are displayed on the icon 112 and the icon 113, respectively, and whether or not to associate the shooting position with the image data is selected by the user selecting one of them. When the operation key 21 corresponding to the icon 112 is operated, the shooting position is associated with the image data and stored in the image data storage unit 52. On the other hand, when the operation key 21 corresponding to the icon 113 is operated, the image data and the shooting position are not associated with each other.

  Steps S101 to S109 in FIG. 8 are flowcharts showing an example of the shooting position addition process in the mobile phone 100 in FIG. First, when image data is input by the image input unit 48, it is determined whether the image data is associated with a shooting position (steps S101 and S102). If the shooting position is associated with the image data, it is not necessary to add the shooting position to the image data, and the process proceeds to step S109. On the other hand, if the shooting position is not associated with the image data, it is determined whether the shooting time is associated with the image data (step S103). If the shooting time is not associated with the image data, the process proceeds to step S109. On the other hand, when the shooting time is associated with the image data, the feature extraction unit 491 extracts feature information from the image data (step S104), and the matching degree calculation unit 492 extracts the feature extracted from the image data. The degree of coincidence between the information and the feature information of the user held in the feature information storage unit 50 is calculated. Further, the coincidence determination unit 493 determines whether or not the calculated coincidence is higher than a predetermined threshold (step S105).

  If the degree of coincidence between the feature information extracted from the image data and the user's feature information held in the feature information storage unit 50 is lower than the threshold, the process proceeds to step S109. On the other hand, when the degree of coincidence between the feature information extracted from the image data and the user's feature information held in the feature information storage unit 50 is higher than the threshold value, the time comparison unit 511 displays the shooting time of the image data. Then, the acquisition time held in the movement history storage unit 47 is compared, and the acquisition time closest to the photographing time is determined (step S106). Further, the position information selection unit 512 selects the position information associated with the acquisition time closest to the photographing time, associates this position information with the image data as the photographing position of the image data, and stores it in the image data storage unit 52. (Steps S107 and S108). When there is other input image data, the processing procedure of steps S102 to S109 is repeated (step S109).

  Steps S201 to S206 in FIG. 9 are flowcharts showing an example of image selection processing in the mobile phone 100 in FIG. First, a map image is displayed on the main display 11 (step S201). Next, when a user operation to select any position on the map image is performed, image data associated with the shooting position in the area around the position is read, and thumbnail images of these image data are displayed. A list is displayed (steps S202 to S204). For example, when a user operation is performed to select any prefecture from the map image, image data associated with the shooting position in the selected prefecture is read out, and thumbnail images of these image data are displayed in a list. Is done. Further, when a user operation for selecting any one of these image data is performed, the selected image data is displayed on the main display 11 (steps S205 and S206), and the process ends.

  In the conventional portable information terminal device, the position information acquired by the portable information terminal device at the time when the image is taken by another imaging device is uniformly associated with the image data as the shooting position. For this reason, when the portable information terminal device is at a position close to another imaging device at the photographing time, the photographing position can be associated with the image data. When the user is away from the camera, there is a problem that an incorrect shooting position is associated with the image data.

  On the other hand, according to the present embodiment, for example, when the user and the owner of another imaging device act together, the portable information terminal device 100 and the other imaging device are close to each other. By determining that the user is included as a subject in the image data captured by another imaging device, the imaging position can be associated with the image data. On the other hand, when the user and the owner of another imaging device act differently, when the portable information terminal device 100 is away from the other imaging device at the shooting time, the user is included in the image data as a subject. No, position information acquired by the portable information terminal device 100 is not associated with image data as a shooting position. For this reason, it can suppress that an incorrect imaging | photography position is matched with image data, and the reliability of the imaging | photography position matched with image data can be improved.

  Further, according to the present embodiment, the user can display image data captured in the designated area by designating any area from the map displayed on the main display 11. Therefore, the user can easily display image data taken in an arbitrary area, which is highly convenient.

  In the present embodiment, an example in which the image data is a still image has been described, but the present invention is not limited to this. For example, the image data may be a moving image composed of a series of frame images.

  Moreover, although the position information acquisition part 46 demonstrated the example in the case of acquiring position information for every fixed period in this Embodiment, this invention is not limited to this. For example, the configuration may be such that the location information is acquired when the base station with which communication is performed by the cellular communication unit 41 is switched. Further, when short-range wireless communication by the short-range wireless communication unit 42 is performed, when e-mail is transmitted / received by the cellular communication unit 41, or when a memory card is inserted into the card slot, the position information It may be the structure which acquires. Furthermore, the configuration may be such that the location information is acquired when the user creates a text-format memo or uses the navigation function.

Embodiment 2. FIG.
In the first embodiment, the subject determination unit 49 determines whether or not the user is included as a subject in the image data by comparing the feature information of the user regarding the face with the feature information extracted from the image data. An example of the case has been described. On the other hand, in this embodiment, the user is included as a subject in the image data by comparing the feature information of the user regarding clothes or a hat included in the image data with the corresponding feature information extracted from the image data. An example in the case of determining whether or not is present will be described.

  FIG. 10 is a block diagram showing an example of the configuration of the main part of the mobile phone 100 according to Embodiment 2 of the present invention, in which an example of the functional configuration in the terminal control unit 44 is shown. Since the configuration other than the subject determination unit 49 and the feature information addition unit 71 is the same as that in the first embodiment, a duplicate description is omitted.

  The subject determination unit 49 performs an operation of determining whether or not the user is included as a subject in the image data based on the user feature information previously stored in the feature information storage unit 50. Specifically, it is determined whether or not the user is included in the image data by comparing the feature information of the user regarding the face with the feature information extracted from the image data. Further, by comparing the feature information extracted from the image of the user's clothes or hat and stored in advance in the feature information storage unit 50 with the feature information extracted from the image data, the user can select the image data as a subject. It is determined whether or not it is included.

  When the position of the person's face included in the image data is specified, the position of the hat and clothes can be estimated, so that feature information regarding the color and pattern of the hat and clothes can be extracted. For this reason, it is possible to determine whether or not the user is included as a subject in the image data by comparing the extracted feature information with the feature information of the user stored in the feature information storage unit 50 in advance. it can.

  When it is determined that the user is included as a subject in the image data, the feature information adding unit 71 stores the feature information of the user regarding clothes or a hat extracted from the image data in the feature information storage unit 50. It is carried out. Specifically, when it is determined that the user is included as a subject in the image data by comparing the feature information of the user related to the face with the feature information extracted from the image data, The feature information regarding the extracted clothes or hat is stored in the feature information storage unit 50 as user feature information.

  FIG. 11 is a flowchart illustrating an example of the shooting position addition process in the mobile phone 100 of FIG. Since this flowchart is the same as steps S101 to S109 in FIG. 8 except for steps S304 to S306, a duplicate description will be omitted.

  In step S304, when the shooting time is associated with the image data, the feature extraction unit 491 extracts feature information regarding the face, clothes, and hat from the image data. Next, the coincidence degree between the feature information extracted from the image data and the user's feature information held in the feature information storage unit 50 is calculated by the coincidence degree calculation unit 492, and this coincidence degree is higher than a predetermined threshold value. Is determined by the coincidence determination unit 493 (step S305). At this time, the degree of coincidence calculation unit 492 calculates the degree of coincidence by comparing feature information regarding the face, clothes, or hat with the feature information of the user. For example, when feature information related to clothes or a hat is not held in the feature information storage unit 50, the degree of coincidence is calculated by comparing the feature information related to the face extracted from the image data with the feature information of the user. The When feature information about the face cannot be extracted from the image data, the degree of coincidence is calculated by comparing the feature information about clothes or a hat extracted from the image data with the feature information of the user.

  When the degree of coincidence between the feature information extracted from the image data and the user's feature information held in the feature information storage unit 50 is higher than a predetermined threshold, the feature information adding unit 71 is extracted from the image data. The feature information of the user concerning the clothes or hat is stored in the feature information storage unit 50 (step S306). On the other hand, when the degree of coincidence between the feature information extracted from the image data and the user's feature information held in the feature information storage unit 50 is lower than a predetermined threshold value, as in step S109 in FIG. It is determined whether or not there is image data (step S310).

  According to the present embodiment, feature information about clothes or a hat extracted from image data determined to include a user as a subject is stored in the feature information storage unit 50 by the feature information adding unit 71. Furthermore, using this feature information, the degree-of-match determination unit 493 determines whether or not the user is included as a subject in the other image data. Therefore, for example, when comparing the feature information about the face, such as when the back view of the user is photographed, it is not possible to correctly determine whether or not the user is photographed. It is possible to accurately determine whether or not the user is shooting.

  In the present embodiment, the example in which the feature information adding unit 71 stores the feature information related to the user's clothes or hat in the feature information storage unit 50 has been described, but the present invention is not limited to this. . For example, the feature information regarding the user's clothes or hat may be stored in the feature information storage unit 50 in advance.

Embodiment 3 FIG.
In the first and second embodiments, the example has been described in which the position information acquisition unit 46 acquires the position information at regular intervals. However, the present invention is not limited to this, and the position information acquisition unit 46 may be configured to acquire position information based on a user operation for photographing a subject by the main camera 14 or the sub camera 15. Good. For example, it is conceivable to acquire position information when a key operation for photographing a subject is performed.

  Since the user and other people often photograph each other as a subject, usually, when a user operation for photographing a subject is performed, the user is often photographed by another imaging device. Therefore, the position information acquisition unit 46 acquires the position information based on the user's shooting operation and stores it in the movement history storage unit 47 as movement history information, so that the image data in which the user is shot is subsequently input. If this occurs, this position information can be associated. In this case, the position information can be associated with high accuracy without acquiring the position information frequently, so that power consumption can be reduced.

  In addition, when the position information acquisition unit 46 acquires position information at regular intervals, the position information acquisition unit 46 acquires position information at a shorter period for a predetermined period after a user operation for photographing a subject is performed. May be.

  That is, the position information acquisition unit 46 acquires the position information for each first period, and also acquires the position information for each second period shorter than the first period based on a user operation for photographing the subject. The structure which acquires may be sufficient.

  By adopting such a configuration, the position information acquisition unit 46 increases the frequency of acquiring the position information based on the user operation for shooting the subject, so that the user can be shot from another person. When it is expected that the position is high, the position information can be acquired with high frequency. Therefore, it is possible to accurately determine the imaging position of image data including a user as a subject while reducing power consumption.

11 main display 14 main camera 15 sub camera 21 operation key 41 cellular communication unit 42 short-range wireless communication unit 43 GPS receiving unit 44 terminal control unit 45 data input / output unit 46 position information acquisition unit 47 movement history storage unit 48 image input unit 49 Subject determination unit 50 Feature information storage unit 51 Shooting position determination unit 52 Image data storage unit 53 Area specification unit 54 Position comparison unit 55 Image browsing screen generation unit 71 Feature information addition unit 100 Mobile phone 491 Feature extraction unit 492 Matching degree calculation unit 493 Matching degree determination unit 511 Time comparison unit 512 Position information selection unit

Claims (7)

Position information acquisition means for acquiring position information;
Movement history storage means for holding movement history information in which the acquisition time of the position information is associated with the position information;
Feature information storage means for storing user feature information;
Image input means for inputting image data associated with shooting time;
Subject determination means for determining whether or not the user is included as a subject in the image data based on the feature information;
Photographing position determining means for associating the position information in the movement history storage means with the image data based on the determination result of the subject determining means;
The portable information terminal device, wherein the photographing position determining means associates the position information with the image data by comparing the photographing time with the acquisition time in the movement history storage means. Based on a user operation, provided with an imaging means for photographing a subject,
The portable information terminal device according to claim 1, wherein the position information acquisition unit acquires the position information based on the user operation.   The position information acquisition means acquires the position information for each first period, and obtains the position information for each second period shorter than the first period based on a user operation for photographing the subject. The portable information terminal device according to claim 2, wherein the portable information terminal device is acquired.   The shooting position determination unit is configured to compare the shooting time with the acquisition time in the movement history storage unit, and when it is determined that the user is included as a subject in the image data. 2. The mobile phone according to claim 1, further comprising: a position information selection unit that selects the position information in the movement history storage unit as a shooting position of the image data based on a comparison result of the time comparison unit. Information terminal device.   The portable information terminal device according to claim 4, wherein the position information selection unit selects the position information associated with the acquisition time closest to the shooting time. The feature information storage means holds the user feature information extracted from the face image,
The subject determination means determines whether or not the user is included as a subject in the image data by comparing the feature information extracted from the face image and the feature information extracted from the image data. The portable information terminal device according to claim 1. Image data storage means for holding the image data associated with the position information by the photographing position determination means ;
An area designating means for designating an area based on a user operation input;
Position comparison means for comparing the area with the position information of the image data held in the image data storage means;
2. The portable information terminal device according to claim 1, further comprising image browsing screen generation means for generating screen data for browsing the image data based on a comparison result of the position comparison means.

Images