JP2014016811A - Information apparatus, person related information acquisition method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce user's time and labor for setting person related information such as a telephone number or an electronic mail address.SOLUTION: A display unit 120 displays images including figures of people. An operation input unit 130 receives a selection operation for selecting the image displayed by the display unit 120. A person related information acquisition unit 220 performs pattern matching of the person's figure included in the image selected by the selection operation received in the operation input unit 130 with pieces of person image information stored in a storage unit 300. The person related information acquisition unit 220 acquires person related information associated with the person image information that matches the person's figure included in the image selected by the selection operation in the pattern matching.

Description

  The present invention relates to an information device, a person related information acquisition method, and a program.

When making a call or generating an e-mail with a mobile phone, a smartphone, a personal computer (PC), or the like, it is troublesome for the user to input a telephone number, an e-mail address, or the like by key operation.
An address book is used to reduce such labor. The user only has to select a telephone number, an e-mail address, or the like in the address book, and the time and effort of key input can be reduced.

In addition, regarding the address book, in the information processing apparatus described in Patent Document 1, when the image is moved to the icon display position by drag and drop, the mailer is activated, and the mail creation screen is replaced with the address book screen. Is displayed. The e-mail address input field prepared on the e-mail creation screen automatically enters the e-mail address described in the e-mail address field linked to the image, and the e-mail text input field is linked to the image. The name and company name characters described in the name and company name fields are automatically entered.
Thereby, it is supposed that an application can be started by intuitive operation.

JP 2005-301647 A

However, when a telephone number or an e-mail address is specified using an address book, the user needs to open the address book and search for and select a desired telephone number or e-mail address, which is troublesome for the user.
Also in the information processing apparatus described in Patent Document 1, the user needs to open an address book, search for an image, and select an image, which is troublesome for the user.

  An object of the present invention is to provide an information device, a person-related information acquisition method, and a program that can solve the above-described problems.

  The present invention has been made to solve the above-described problem, and an information device according to an aspect of the present invention stores an address book in which image information of a person and person-related information of the person are associated with each other. A display unit that displays an image including an image of a person, an operation input unit that receives an operation of selecting an image displayed by the display unit, an image of a person included in the image selected by the selection operation, and the storage A person who performs pattern matching with the person's image information stored in the section and acquires person-related information associated with the person's image information that matches the person's image included in the image selected by the selection operation And a related information acquisition unit.

  In addition, a person related information acquisition method according to an aspect of the present invention provides a person related information acquisition method for an information device including a storage unit that stores an address book in which image information of a person and the person related information of the person are associated with each other. A display step for displaying an image including an image of a person, an operation input step for accepting an operation for selecting an image displayed in the display step, and an image of the person included in the image selected by the selection operation. And the person-related information associated with the image information of the person who matches the image of the person included in the image selected by the selection operation. And a person-related information acquisition step to be acquired.

  The program according to one embodiment of the present invention displays an image including a person image on an information device including a storage unit that stores an address book in which the person image information and the person related information are associated with each other. A display step for performing, an operation input step for receiving an operation for selecting an image displayed in the display step, an image of a person included in the image selected by the selection operation, and image information of the person stored in the storage unit A person related information acquisition step of acquiring the person related information associated with the image information of the person that matches the image of the person included in the image selected by the selection operation. It is a program for.

  According to the present invention, the user's trouble can be further reduced.

It is a schematic block diagram which shows the function structure of the communication terminal device in one Embodiment of this invention. It is explanatory drawing which shows typically the data structure of the address book which the memory | storage part in the same embodiment memorize | stores. It is explanatory drawing which shows the example of telephone call instruction | indication operation by the drag and drop of the image in the same embodiment. It is explanatory drawing which shows the example of the inquiry screen as to whether to perform the telephone call which the display part displays in the same embodiment. It is explanatory drawing which shows the example of the email production | generation screen display instruction | indication operation by the drag and drop of the image in the same embodiment. It is explanatory drawing which shows the example of the email production | generation screen which the display part in the embodiment displays. It is explanatory drawing which shows the example of map display instruction | indication operation by the drag and drop of the image in the same embodiment. It is explanatory drawing which shows the example of the map which the display part in the embodiment displays. 5 is a flowchart illustrating a procedure of processing in which a control unit performs a telephone call by dragging and dropping an image in the embodiment. 5 is a flowchart illustrating a processing procedure in which a control unit displays an e-mail generation screen on a display unit by dragging and dropping an image in the embodiment. In the embodiment, the control unit is a flowchart showing a procedure of processing for displaying a map and an address on a display unit by dragging and dropping an image. It is a schematic block diagram which shows the minimum structure of this invention in an information device.

  Embodiments of the present invention will be described below with reference to the drawings. Below, although the case where this invention is applied to communication terminal devices, such as a mobile telephone or a smart phone, is demonstrated to an example, the application range of this invention is not restricted to this. For example, the present invention can be applied to various information devices having a function of managing photographs, such as a personal computer, a personal digital assistant (PDA), and a digital camera having a communication function.

  FIG. 1 is a schematic block diagram showing a functional configuration of a communication terminal apparatus according to an embodiment of the present invention. In the figure, the communication terminal device 1 includes a wireless communication unit 110, a display unit 120, an operation input unit 130, a voice input unit 141, a voice output unit 142, an imaging unit 150, a control unit 200, and a storage. Part 300. The control unit 200 includes an image viewer function unit 210, a person related information acquisition unit 220, a mail function unit 230, a telephone function unit 240, and a map viewer function unit 250.

The communication terminal device 1 is a communication terminal device such as a mobile phone or a smartphone, and performs communication by connecting to a mobile phone network (a communication network provided by a communication carrier for mobile phones).
Under the control of the control unit 200, the wireless communication unit 110 connects to the mobile phone network and transmits and receives various data such as call voice data and e-mail data.

The wireless communication unit according to the present invention is not limited to the one connected to the mobile phone network. For example, a wireless communication unit connected to a wireless local area network (LAN) or a wireless communication unit wired to a communication network such as a LAN or the Internet may be used.
Furthermore, when the personal computer as the information device according to the present invention displays a map using the map data stored in the personal computer itself, the information device according to the present invention does not have a wireless communication unit. You can also.

  The display unit 120 has a display screen such as a liquid crystal display or an organic EL (Organic Electro-Luminescence) display, and displays various images such as a moving image, a still image, and text (characters) according to the control of the control unit 200. In particular, the display unit 120 displays an image including a human image. For example, the imaging unit 150 captures an image of a person as a subject, and the display unit 120 displays the image.

  The display unit 120 displays the position indicated by the position information acquired by the person related information acquisition unit 220 on a map. In addition, the display unit 120 displays the address information acquired by the person related information acquisition unit 220. These displays correspond to displaying the address of the person selected by the user from the address book stored in the storage unit 300. This display will be described later using a specific example.

  The operation input unit 130 includes a touch sensor (touch panel) provided on the display screen of the display unit 120, and detects a user operation by a touch operation on the display screen. In particular, the operation input unit 130 receives an operation for selecting an image displayed on the display unit 120. Specifically, the operation input unit 130 receives an operation of dragging and dropping an image displayed on the display unit 120 into a predetermined area as an operation for selecting the image.

  However, the input device included in the operation input unit 130 is not limited to the touch sensor, and may be any input device that allows the user to perform a drag-and-drop operation. For example, the operation input unit 130 may include an input device other than the touch sensor such as a mouse or a touch pad.

The voice input unit 141 has a microphone, collects ambient sounds, converts them into voice data, and outputs them to the control unit 200.
The audio output unit 142 includes a speaker, and outputs audio based on audio data from the control unit 200.
The imaging unit 150 includes a camera, converts incident light into image data, and outputs the image data to the control unit 200.

  The control unit 200 controls each unit of the communication terminal device 1 and executes various functions. The control unit 200 is realized by, for example, a CPU (Central Processing Unit) included in the communication terminal device 1 reading and executing a program from a storage device (eg, the storage unit 300) included in the communication terminal device 1. Is done. Each unit of the control unit 200 is realized, for example, as a module (subroutine or the like) of a program executed by the CPU.

The image viewer function unit 210 causes the display unit 120 to display various images such as an image captured by the imaging unit 150.
The person related information acquisition unit 220 includes a human image included in an image selected by a user's selection operation among images displayed on the display unit 120 by the image viewer function unit 210 and a person stored in the storage unit 300. Perform pattern matching with image information. Then, the person related information acquisition unit 220 acquires person related information associated with the image information of the person that matches the image of the person included in the image selected by the selection operation.

The person-related information here is information related to a certain person such as a telephone number or an e-mail address of the certain person. For example, the person related information acquisition unit 220 acquires an e-mail address as the person related information. Further, for example, the person related information acquisition unit 220 acquires a telephone number as the person related information. For example, the person related information acquisition unit 220 acquires position information as the person related information. For example, the person related information acquisition unit 220 acquires address information as the person related information.
The person related information acquisition unit 220 acquires the person related information, so that it is possible to save the user from inputting the person related information. A specific example in which the person related information acquisition unit 220 acquires the person related information will be described later.

The mail function unit 230 executes an electronic mail function. For example, an e-mail generation screen is displayed on the display unit 120 to generate a transmission mail, and the wireless communication unit 110 transmits the e-mail data in response to a user operation. Further, the mail function unit 230 displays the received mail on the display unit 120.
In particular, the mail function unit 230 generates a transmission mail in which the electronic mail address acquired by the person related information acquisition unit 220 is set as a transmission address when generating the electronic mail. This saves the user from having to input the transmission address.

The telephone function unit 240 executes a telephone function. For example, the telephone function unit 240 makes a telephone call in response to a user operation, and when a call is established, causes the wireless communication unit 110 to transmit and receive call voice data. In addition, the telephone function unit 240 notifies the user of the incoming call when receiving a call, performs an incoming call response process in response to the user's call start operation, and causes the radio communication unit 110 to transmit and receive call voice data when the call is established. .
In particular, the telephone function unit 240 makes a telephone call to the telephone number acquired by the person related information acquisition unit 220 when making a telephone call. This saves the user from having to enter a telephone number.

  The map viewer function unit 250 executes a map function. In particular, the map viewer function unit 250 causes the display unit 120 to display a map of the position indicated by the position information or address information acquired by the person related information acquisition unit 220. This saves the user from having to input position information or address information when displaying the map.

The storage unit 300 is realized by a storage device included in the communication terminal device 1 and stores various data. In particular, the storage unit 300 stores an address book in which image information of a person is associated with person-related information of the person.
FIG. 2 is an explanatory diagram schematically showing the data structure of the address book stored in the storage unit 300. As shown in the figure, for each person, the storage unit 300 associates the person's image data, name, telephone number, e-mail address, address information, and location information (latitude and longitude) of the address. I remember it.

  Here, the person image data stored in the storage unit 300 is an example of person image information in the present invention, and is not limited thereto. The person image information stored in the storage unit 300 may be information that can be pattern-matched with image data. For example, the storage unit 300 may store the feature vector of the image instead of the image data of the person.

  The feature vector here is a vector indicating a feature amount in pattern matching performed by the person related information acquisition unit 220. For example, the person related information acquisition unit 220 performs feature amount extraction for pattern matching from image data of each person registered in the address book in advance, and stores it in the storage unit 300 as a feature vector. It may be. By performing feature amount extraction in advance, the person-related information acquisition unit 220 can perform pattern matching more quickly.

  Note that the communication terminal device 1 may be configured to be able to mutually convert the position information and the address information. The position information is information suitable for the map viewer function unit 250 to display a map of the corresponding address on the display unit 120. Therefore, the map viewer function unit 250 may determine a place to display on the map based on the address information.

Next, the operation of the communication terminal device 1 will be described with reference to FIGS.
FIG. 3 is an explanatory diagram illustrating an example of a telephone call instruction operation by dragging and dropping an image.
In the figure, the image viewer function unit 210 displays thumbnails of images indicated by image data stored in the storage unit 300, such as images captured by the image capturing unit 150, in the area A11. In addition, the image viewer function unit 210 causes the display unit 120 to display a telephone call instruction operation icon I11, an e-mail generation screen display instruction icon I12, and a map display instruction operation icon I13. ing.

  A line L11 in FIG. 3 indicates a drag and drop operation of an image to the icon I11. The user gives an instruction to make a call by dragging and dropping one of the images displayed in the area A11 to the icon I11. Specifically, when the user touches the image and moves the finger while pressing the image, the image viewer function unit 210 moves the image according to the movement of the finger. Then, when the user lifts the finger with the image overlapped with the icon I11, the telephone function unit 240 inquires of the user whether or not to make a call to the person shown in the image.

FIG. 4 is an explanatory diagram illustrating an example of an inquiry screen displayed on the display unit 120 as to whether or not to make a call.
In the figure, the telephone function unit 240 displays, in a pop-up window, an inquiry screen as to whether or not to make a call to Mr. A who is a person shown in the image dragged and dropped onto the icon I11 (FIG. 3). Part 120 is displayed. When the operation input unit 130 detects a touch on the call button B11 on the inquiry screen, the telephone function unit 240 executes a telephone call. On the other hand, when the operation input unit 130 detects a touch on the cancel button B12, the telephone function unit 240 deletes the inquiry screen displayed on the display unit 120 without making a telephone call. As a result, the display unit 120 returns to the state where the images are displayed as thumbnails as shown in FIG.
The telephone function unit 240 may make a call as it is without making an inquiry as to whether or not to make a call.

FIG. 5 is an explanatory diagram showing an example of an e-mail generation screen display instruction operation by dragging and dropping an image.
In the same figure, as in the example of FIG. 3, the image viewer function unit 210 displays an image indicated by the image data stored in the storage unit 300, such as an image captured by the imaging unit 150, in the area A <b> 11 as a thumbnail display. . In addition, as in the example of FIG. 3, the image viewer function unit 210 includes an icon I11 for a call origination instruction operation, an icon I12 for an e-mail generation screen display instruction operation, and an icon I13 for a map display instruction operation. Are displayed on the display unit 120.

  In addition, a line L21 in FIG. 5 indicates an image drag-and-drop operation to the icon I12. The user instructs display of the e-mail generation screen by an operation of dragging and dropping one of the images displayed in the area A11 to the icon I12. Specifically, when the user touches the image and moves the finger while pressing the image, the image viewer function unit 210 moves the image according to the movement of the finger. Then, when the user lifts the finger with the image overlapped with the icon I12, the mail function unit 230 causes the display unit 120 to display an e-mail generation screen addressed to the person shown in the image.

FIG. 6 is an explanatory diagram illustrating an example of an e-mail generation screen displayed on the display unit 120.
In the figure, the mail function unit 230 displays an e-mail generation screen on the display unit 120 in a pop-up window. Then, the mail function unit 230 sets the electronic mail address of Mr. A who is a person shown in the image dragged and dropped onto the icon I12 (FIG. 5) as the transmission destination address.

FIG. 7 is an explanatory diagram illustrating an example of a map display instruction operation by dragging and dropping an image.
In the same figure, as in the example of FIG. 3, the image viewer function unit 210 displays an image indicated by the image data stored in the storage unit 300, such as an image captured by the imaging unit 150, in the area A <b> 11 as a thumbnail display. . In addition, as in the example of FIG. 3, the image viewer function unit 210 includes an icon I11 for a call origination instruction operation, an icon I12 for an e-mail generation screen display instruction operation, and an icon I13 for a map display instruction operation. Are displayed on the display unit 120.

  In addition, a line L31 in FIG. 7 indicates an image drag-and-drop operation to the icon I13. The user instructs display of the map by an operation of dragging and dropping one of the images displayed in the area A11 to the icon I13. Specifically, when the user touches the image and moves the finger while pressing the image, the image viewer function unit 210 moves the image according to the movement of the finger. Then, when the user releases the finger while the image is overlaid on the icon I13, the map viewer function unit 250 causes the display unit 120 to display a map showing the address of the person shown in the image and the address. .

FIG. 8 is an explanatory diagram illustrating an example of a map displayed on the display unit 120.
In the figure, the map viewer function unit 250 causes the display unit 120 to display a map showing the address of Mr. A who is a person in the image dragged and dropped onto the icon I13 (FIG. 7) in a pop-up window. ing. Further, the map viewer function unit 250 causes the display unit 120 to display Mr. A's address in the area A31 as text. It may be possible to set so as not to display the address by text.

FIG. 9 is a flowchart illustrating a procedure of processing in which the control unit 200 performs a telephone call by dragging and dropping an image. When the operation input unit 130 detects an operation of dragging and dropping an image onto the icon I11 (FIG. 3), the control unit 200 starts the process of FIG.
In the process of FIG. 9, first, the person related information acquisition unit 220 performs pattern matching between the image dragged and dropped onto the icon I11 and the image indicated by the image data included in the address book stored in the storage unit 300. This is performed (step S101).

  Then, based on the result of pattern matching in step S101, the person related information acquisition unit 220 determines whether there is a person shown in the dragged and dropped image among the persons registered in the address book. (Step S102). In the following, among the persons registered in the address book, the person determined by the person related information acquisition unit 220 to be the person shown in the dragged and dropped image is referred to as “matching person”.

For example, in step S101, the person related information acquisition unit 220 first extracts (cuts out) an image of a person from the dragged and dropped image. At that time, if a plurality of persons are shown, the person related information acquisition unit 220 extracts an image of each person.
Then, the person related information acquisition unit 220 performs pattern matching between the extracted person image and the image indicated by each image data included in the address book stored in the storage unit 300 to determine whether or not they are the same person. judge. When images of a plurality of persons are extracted, the process is performed for each image.

  Then, if there is even one person who is determined to be the same person, the person related information acquisition unit 220 determines that there is a matching person in step S102. On the other hand, if no person is determined to be the same person, the person related information acquisition unit 220 determines that there is no matching person in step S102.

  If it is determined in step S102 that there is a matching person (step S102: YES), the person-related information acquisition unit 220 reads the telephone number and name of the matching person from the address book stored in the storage unit 300, and It outputs to the function part 240 (step S111). At this time, if there are a plurality of matching persons, the person related information acquisition unit 220 reads the telephone number and name of each person from the address book, and outputs all the read telephone numbers and names to the telephone function unit 240.

Upon receiving the telephone number and name output from the person-related information acquisition unit 220, the telephone function unit 240 displays an inquiry screen as to whether or not to make a call to the telephone number on the display unit 120, as illustrated in FIG. It is displayed (step S112).
Then, the telephone function unit 240 waits for the operation input unit 130 to detect a call or cancel selection operation (step S113), and determines whether or not the call is selected (step S114).

When it is determined that the transmission is selected (step S114: YES), the telephone function unit 240 performs a telephone call to the corresponding telephone number and a call process (step S121). That is, the telephone function unit 240 makes a call connection request to the corresponding telephone number to the mobile phone network, and when a call is established, performs control of voice communication transmission / reception and the like.
When the call ends, the image viewer function unit 210 returns to a state in which the image viewer is displayed on the display unit 120 (step S141).
Then, the process of FIG. 9 is complete | finished.
Note that the timing at which the image viewer function unit 210 returns to the state in which the image viewer is displayed on the display unit 120 is not limited to the timing at which the call ends. For example, the image viewer function unit 210 may return to a state in which the image viewer is displayed on the display unit 120 before the call ends. The user may be able to set the return timing.

On the other hand, when it is determined in step S114 that transmission is not selected (that is, cancel is selected) (step S114: NO), the process proceeds to step S141.
On the other hand, if it is determined in step S102 that there is no matching person (step S102: NO), the person related information acquisition unit 220 displays a screen for notifying that there is no corresponding person on the display unit 120 (step S131). ).

  Then, the person related information acquisition unit 220 determines whether the operation input unit 130 has detected a user operation indicating confirmation (step S132). For example, the display unit 120 displays a “confirmed” button on a screen for notifying that there is no corresponding person, and the person related information acquisition unit 220 performs a touch on the “confirmed” button by the operation input unit 130. It is determined whether or not is detected.

If it is determined that a user operation indicating confirmation has not been detected (step S132: NO), the process returns to step S132. Return. That is, the person related information acquisition unit 220 waits for user confirmation completion.
On the other hand, if it is determined that a user operation indicating confirmation has been detected (step S132: YES), the person-related information acquisition unit 220 confirms that there is no corresponding person displayed on the display unit 120 in step S131. The screen to be notified is erased (step S133). Then, it progresses to step S141.

  If there are a plurality of matching persons, in step S121, the telephone function unit 240 inquires the user of which person to send the call, and makes a call to the person selected by the user. Alternatively, the telephone function unit 240 may have a conference call function capable of making a call to a plurality of other parties at the same time, and may make a call to all the corresponding persons.

  FIG. 10 is a flowchart illustrating a procedure of processing in which the control unit 200 causes the display unit 120 to display an e-mail generation screen by dragging and dropping an image. When the operation input unit 130 detects an operation of dragging and dropping an image onto the icon I12 (FIG. 5), the control unit 200 starts the process of FIG.

In the process of FIG. 10, first, the person related information acquisition unit 220 performs pattern matching between the image dragged and dropped onto the icon I12 and the image indicated by the image data included in the address book stored in the storage unit 300. This is performed (step S201).
The pattern matching in step S201 and the determination in step S202 are the same as steps S101 and S102 in FIG.

  If it is determined in step S202 that there is a matching person (step S202: YES), the person related information acquisition unit 220 reads out the e-mail address and name of the matching person from the address book stored in the storage unit 300. And output to the mail function unit 230 (step S211). At this time, when there are a plurality of matching persons, the person related information acquisition unit 220 reads the e-mail address of each person from the address book, and outputs all of the read e-mail addresses to the mail function unit 230.

Receiving the output of the e-mail address and name from the person related information acquisition unit 220, the mail function unit 230 displays an e-mail generation screen on the display unit 120 (step S212). Then, the mail function unit 230 sets the electronic mail address as a transmission address, and displays the name in the transmission destination name column of the electronic mail generation screen as illustrated in FIG. 6 (step S213).
Then, the mail function unit 230 determines whether or not the operation input unit 130 has detected an e-mail generation end operation (cancel operation) (step S214).

If it is determined that an e-mail generation end operation has been detected (step S214: YES), the image viewer function unit 210 returns to a state in which an image viewer is displayed on the display unit 120 (step S141).
On the other hand, when it is determined that the e-mail generation end operation has not been detected (step S214: NO), the mail function unit 230 determines whether or not the operation input unit 130 has detected an e-mail transmission operation (step S214). S221).

If it is determined that an e-mail transmission operation has been detected (step S221: YES), the mail function unit 230 transmits the generated e-mail (step S231). Thereafter, the process proceeds to step S261.
On the other hand, if it is determined in step S221 that an e-mail transmission operation has not been detected (step S221: NO), the mail function unit 230 sends an e-mail in response to a user operation such as inputting a subject or text in the body. The generation process is performed (step S241). Thereafter, the process returns to step S214.

On the other hand, if it is determined in step S202 that there is no matching person (step S202: NO), the process proceeds to step S251. Steps S251 to S253 are the same as steps S131 to S133 in FIG.
After step S253, the process proceeds to step S261.

  If there are a plurality of matching persons, in step S213, the mail function unit 230 sets the e-mail addresses of all the corresponding persons as transmission destination addresses. The user can select a transmission destination to actually send an e-mail by deleting an unnecessary e-mail address.

  FIG. 11 is a flowchart illustrating a procedure of processing in which the control unit 200 displays a map and an address on the display unit 120 by dragging and dropping an image. When the operation input unit 130 detects an operation of dragging and dropping an image onto the icon I13 (FIG. 7), the control unit 200 starts the process of FIG.

In the process of FIG. 11, first, the person related information acquisition unit 220 performs pattern matching between the image dragged and dropped onto the icon I13 and the image indicated by the image data included in the address book stored in the storage unit 300. This is performed (step S301).
The pattern matching in step S301 and the determination in step S302 are the same as steps S101 and S102 in FIG.

  If it is determined in step S302 that there is a matching person (step S302: YES), the person related information acquisition unit 220 reads the address information, position information, and name of the matching person from the address book stored in the storage unit 300. Is output to the map viewer function unit 250 (step S211). At this time, if there are a plurality of matching persons, the person related information acquisition unit 220 reads the address information, position information, and name of each person from the address book, and the map viewer function unit 250 reads all the read address information, position information, and names. Output to.

  Upon receiving the address information, position information, and name output from the person related information acquisition unit 220, the map viewer function unit 250 displays a map of the position indicated by the position information on the display unit 120 (step S312). Note that the map data used by the map viewer function unit 250 may be stored in the storage unit 300, or may be acquired by the wireless communication unit 110 through communication.

Next, as illustrated in FIG. 8, the map viewer function unit 250 displays the address indicated by the address information from the person related information acquisition unit 220 on the display unit 120 in addition to the display of the map in step S312 (step S312). S313).
Then, the map viewer function unit 250 determines whether or not the operation input unit 130 has detected an operation for instructing the end of the map display (step S314).

If it is determined that an operation for instructing the end of map display has been detected (step S314: YES), the image viewer function unit 210 returns to a state in which an image viewer is displayed on the display unit 120 (step S341).
On the other hand, when it is determined that an operation for instructing the end of map display has been detected (step S314: NO), the map viewer function unit 250 changes the display of the map in response to a user operation, such as map enlargement / reduction or scrolling. Is performed (step S321). Thereafter, the process returns to step S314.

On the other hand, if it is determined in step S302 that there is no matching person (step S302: NO), the process proceeds to step S331. Steps S331 to S333 are the same as steps S131 to S133 in FIG.
After step S333, the process proceeds to step S341.

If there are a plurality of matching persons, in step S312, the map viewer function unit 250 inquires the user which information of the corresponding person is displayed, and the address and name of the person selected by the user and the map of the address. Is displayed on the display unit 120.
Alternatively, the map viewer function unit 250 may indicate the addresses and names of all corresponding persons with markers on the map. In this case, in step S313, the map viewer function unit 250 may display all addresses of the corresponding person on the display unit 120, or the user may indicate the address and name indicated by the marker touched by the user. The selected address and name may be selected and displayed on the display unit 120.

As described above, the display unit 120 displays an image including an image of a person, and the operation input unit 130 receives an operation for selecting an image displayed by the display unit 120. Then, the person related information acquisition unit 220 performs pattern matching between the person image included in the image selected by the selection operation received by the operation input unit 130 and the person image information stored in the storage unit 300. In the pattern matching, the person related information acquisition unit 220 acquires person related information associated with the image information of the person that matches the image of the person included in the image selected by the selection operation.
Accordingly, the user selects person-related information (for example, a telephone number, an e-mail address, or address information) of a desired person by a simple operation of selecting one of images displayed on the display unit 120. can do. Therefore, in the communication terminal device 1, it is possible to save the user from having to input the person related information.

In particular, the user only has to select one of the images displayed on the display unit 120 and does not need to open the address book. Therefore, the communication terminal device 1 can save the user from opening the address book, and can further reduce the user's effort in this respect.
For example, when the user wants to send an e-mail to a person shown in the image while browsing the image captured by the image capturing unit 150 with the viewer, the user can select the corresponding image to display the address book. E-mail address can be easily set for outgoing mail without opening.
Moreover, when a plurality of persons are shown in the image, the e-mail addresses of all the members can be set.

Further, the operation input unit 130 accepts an operation of dragging and dropping an image displayed on the display unit 120 to a predetermined area as an operation for selecting the image. The predetermined area mentioned here may be an icon display area corresponding to a function executed by the communication terminal device 1 such as icons I11 to I13 shown in FIG. It may be a destination address field.
Thereby, the user can select the person related information by a simple and intuitive operation such as drag and drop of an image.

The person related information acquisition unit 220 acquires an e-mail address as the person related information, and the mail function unit 230 generates a transmission mail in which the e-mail address acquired by the person related information acquisition unit 220 is set as a transmission address. .
Thereby, the user can transmit an e-mail to a desired destination by a simple operation of selecting one of the images displayed on the display unit 120.

In addition, the person related information acquisition unit 220 acquires a telephone number as the person related information, and the telephone function unit 240 makes a telephone call to the telephone number acquired by the person related information acquisition unit 220.
Thereby, the user can talk with a desired partner by a simple operation of selecting one of the images displayed on the display unit 120.

The person related information acquisition unit 220 acquires position information as person related information, and the display unit 120 displays the position indicated by the position information acquired by the person related information acquisition unit 220 on a map.
Thereby, the user can confirm the address of a desired person on the map by a simple operation of selecting one of the images displayed on the display unit 120.

The person related information acquisition unit 220 acquires address information as the person related information, and the display unit 120 displays the address information acquired by the person related information acquisition unit 220.
Thereby, the user can know the address of a desired person by a simple operation of selecting one of the images displayed on the display unit 120.

  In the pattern matching performed by the person related information acquisition unit 220, when the image of the person included in the image selected by the user matches the image information of a plurality of persons in the address book, the person related information acquisition unit 220 The user may be inquired about whether or not to select information on the person. Thereby, the possibility that the person related information acquisition unit 220 may select inappropriate person related information due to an erroneous determination can be reduced. Similarly, when the score (degree of match) in pattern matching is lower than a predetermined threshold, the person related information acquisition unit 220 may inquire the user as to which person information should be selected.

Next, the minimum configuration of the present invention will be described with reference to FIG.
FIG. 12 is a schematic block diagram showing the minimum configuration of the present invention in the information equipment. In the figure, the information device 2 includes a display unit 120, an operation input unit 130, a person related information acquisition unit 220, and a storage unit 300. In the figure, portions having the same functions corresponding to the respective portions in FIG. 1 are denoted by the same reference numerals (120, 130, 220, 300), and description thereof is omitted.

12, the display unit 120 displays an image including a person image, and the operation input unit 130 selects an image displayed on the display unit 120, as in the case of the communication terminal device 1 in FIG. Accept. Then, the person related information acquisition unit 220 performs pattern matching between the person image included in the image selected by the selection operation received by the operation input unit 130 and the person image information stored in the storage unit 300. In the pattern matching, the person related information acquisition unit 220 acquires person related information associated with the image information of the person that matches the image of the person included in the image selected by the selection operation.
Accordingly, the user selects person-related information (for example, a telephone number, an e-mail address, or address information) of a desired person by a simple operation of selecting one of images displayed on the display unit 120. can do. Therefore, in the communication terminal device 1, it is possible to save the user from having to input the person related information.

In particular, the user only has to select one of the images displayed on the display unit 120 and does not need to open the address book. Therefore, the communication terminal device 1 can save the user from opening the address book, and can further reduce the user's effort in this respect.
For example, when the user wants to send an e-mail to a person shown in the image while browsing the image captured by the image capturing unit 150 with the viewer, the user can select the corresponding image to display the address book. E-mail address can be easily set for outgoing mail without opening.
Moreover, when a plurality of persons are shown in the image, the e-mail addresses of all the members can be set.

A program for realizing all or part of the functions of the control unit 200 or the person related information acquisition unit 220 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system. The processing of each unit may be performed by executing. Here, the “computer system” includes an OS and hardware such as peripheral devices.
Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design changes and the like without departing from the gist of the present invention.

DESCRIPTION OF SYMBOLS 1 Communication terminal device 2 Information apparatus 110 Wireless communication part 120 Display part 130 Operation input part 141 Voice input part 142 Voice output part 150 Imaging part 200 Control part 210 Image viewer function part 220 Person related information acquisition part 230 Mail function part 240 Telephone function Part 250 map viewer function part 300 storage part

Claims (8)

A storage unit for storing an address book in which the image information of the person and the person-related information of the person are associated;
A display unit for displaying an image including an image of a person;
An operation input unit for receiving an operation of selecting an image displayed by the display unit;
Performing pattern matching between the image of the person included in the image selected by the selection operation and the image information of the person stored in the storage unit, the image of the person included in the image selected by the selection operation A person related information acquisition unit for acquiring person related information associated with image information of a suitable person;
An information device comprising:   The information device according to claim 1, wherein the operation input unit accepts an operation of dragging and dropping an image displayed on the display unit into a predetermined area as a selection operation of the image. E-mail function part
The person related information acquisition unit acquires an email address as the person related information,
The mail function unit generates a transmission mail in which the email address acquired by the person related information acquisition unit is set as a transmission address;
The information device according to claim 1, wherein the information device is an information device. It has a telephone function part,
The person related information acquisition unit acquires a telephone number as the person related information,
The telephone function unit makes a telephone call to the telephone number acquired by the person related information acquisition unit.
The information device according to any one of claims 1 to 3, wherein The person related information acquisition unit acquires position information as the person related information,
The display unit displays a position indicated by the position information acquired by the person related information acquisition unit on a map;
The information device according to claim 1, wherein the information device is a device. The person related information acquisition unit acquires address information as the person related information,
The display unit displays the address information acquired by the person related information acquisition unit.
The information device according to any one of claims 1 to 5, wherein A person related information acquisition method for an information device comprising a storage unit that stores an address book in which image information of a person and person related information of the person are associated with each other,
A display step for displaying an image including an image of a person;
An operation input step of accepting an operation of selecting the image displayed in the display step;
Performing pattern matching between the image of the person included in the image selected by the selection operation and the image information of the person stored in the storage unit, the image of the person included in the image selected by the selection operation A person related information acquisition step of acquiring person related information associated with image information of a suitable person;
A person-related information acquisition method comprising: In an information device including a storage unit that stores an address book in which image information of a person and person-related information of the person are associated with each other,
A display step for displaying an image including an image of a person;
An operation input step of accepting an operation of selecting the image displayed in the display step;
Performing pattern matching between the image of the person included in the image selected by the selection operation and the image information of the person stored in the storage unit, the image of the person included in the image selected by the selection operation A person related information acquisition step of acquiring person related information associated with image information of a suitable person;
A program for running

Images