JP4827609B2 - Information processing device, information processing method, information processing program, and portable terminal device - Google Patents

Description

  The present invention is suitable for application to portable devices such as cellular phones, PHS phones (PHS: Personal Handyphone System), PDA devices (PDA: Personal Digital Assistant) having communication functions, and notebook personal computer devices. The present invention relates to a processing device, an information processing method, an information processing program, and a mobile terminal device, and more particularly to an information processing device, an information processing method, an information processing program, and a mobile terminal device that automate the registration of each user's person image in a telephone directory.

  Japanese Laid-Open Patent Publication No. 2002-92013 (Patent Document 1) discloses an information search apparatus for facilitating a search for a destination when making a call. This information retrieval apparatus stores the face image data of the destination in correspondence with the destination identification data in the telephone directory memory, and when making a call, a predetermined number of registrant names to be displayed, such as in the order of the Japanese syllabary. The face image data is displayed in the following order. Then, when the face image of the user who is the destination is selected from the face image data, the name and phone number of the user of the selected face image are displayed on the display unit, and a call is automatically made. It has been made.

Japanese Patent Application Laid-Open No. 2002-92013 (pages 5 to 6: FIGS. 5 and 6)

  However, in the case of the information search apparatus disclosed in Patent Document 1, it is necessary to register face image data of each user in advance in the telephone directory memory. The registration of the face image data is performed by capturing a face image for each user with the camera unit, and registering the captured face image in the corresponding user registration field in the phone book, or from the group photo of each user. This requires a very troublesome and active work of cutting out a face image and registering it in the corresponding user registration field in the telephone directory.

  The present invention has been made in view of the above-described problems, and is an information processing apparatus, an information processing method, an information processing program, and a mobile phone that can automatically register a face image of each user in a telephone directory. An object is to provide a terminal device.

The information processing apparatus according to the present invention is a means for solving the above-described problems.
A person image extraction unit for extracting a person image from an image stored in the storage unit ;
A phone book in which at least contact information of each contact and a person image of each contact are registered;
A matching person image detection unit that detects a person image that matches the person image extracted by the person image extraction unit from the person images registered in the phone book;
If the matching person image detection unit does not detect a person image that matches the person image extracted by the person image extraction unit from the telephone directory, the person image extraction unit extracts the person image extracted by the person image extraction unit. An unregistered person image storage control unit that stores and controls in the storage unit as an unregistered person image that is not registered in the book;
A matching unregistered person image detection unit that detects an unregistered person image that matches the received person image from the storage unit when a person image of the communication partner is received together with contact information of the communication partner via the communication unit. When,
When the unregistered person image matching the received person image is detected by the matching unregistered person image detection unit, the detected unregistered person image is associated with the contact information received via the communication unit. And a person image automatic registration unit for registering in the telephone directory as a person image of the contact to be made.

The information processing method according to the present invention is a means for solving the above-described problems.
A person image extracting unit extracting a person image from an image stored in the storage unit ;
The matching person image detection unit matches the person image extracted in the above step from the telephone book in which the contact information of each contact and the contact person image associated with each contact information are registered. Detecting a human image;
In the step, if the matching person image is not detected from the phone book, the unregistered person image storage control unit stores the person image extracted in the step not registered in the phone book. Storing and controlling in the storage unit as a person image;
When the person image of the communication partner is received together with the contact information of the communication partner via the communication unit, the matching unregistered person image detecting unit displays the unregistered person image that matches the received person image. Detecting from
In the above step, when an unregistered person image that matches the received person image is detected, the person image automatic registration unit converts the detected unregistered person image into the contact information received via the communication unit. Registering in the telephone directory as a person image of the corresponding contact.

In addition, an information processing program according to the present invention is provided to solve the above problems.
Causing the computer to function as a person image extraction unit that extracts a person image from an image stored in the storage unit ;
At least contact information of each contact and a person image extracted when the computer is made to function as the person image extraction unit from a telephone book in which person images of each contact associated with the contact information are registered The computer functions as a matching person image detecting unit that detects a matching person image.
When a computer functioning as the matching person image detection unit and a person image that matches the person image extracted when the computer functions as the person image extraction unit is not detected from the telephone directory, the computer The computer functions as an unregistered person image storage control unit that stores and controls the person image extracted by functioning as the person image extraction unit in the storage unit as an unregistered person image that is not registered in the telephone directory. Let
Matched unregistered person image detection for detecting an unregistered person image that matches the received person image from the storage unit when the person image of the other party of communication is received together with contact information of the other party of communication via the communication unit. The computer as a part,
When an unregistered person image that matches the received person image is detected by causing the computer to function as the matched unregistered person image detection unit, the detected unregistered person image is transmitted via the communication unit. The computer is caused to function as a person image automatic registration unit for registering in the telephone directory as a person image of a contact corresponding to the received contact information.

Moreover, the portable terminal device according to the present invention is a means for solving the above-described problems.
A storage unit for storing images;
A person image extraction unit for extracting a person image from the image stored in the storage unit ;
A phone book in which at least contact information of each contact and a person image of each contact associated with the contact information are registered;
A matching person image detection unit that detects a person image that matches the person image extracted by the person image extraction unit from the phone book;
If the matching person image detection unit does not detect a person image that matches the person image extracted by the person image extraction unit from the phone book, the person image extraction unit extracts the person image extracted by the person image extraction unit. An unregistered person image storage control unit for storing and controlling the registered person image in the storage unit;
Matched unregistered person image detection for detecting an unregistered person image that matches the received person image from the storage unit when the person image of the other party of communication is received together with contact information of the other party of communication via the communication unit. And
When the unregistered person image matching the received person image is detected by the matching unregistered person image detection unit, the detected unregistered person image is associated with the contact information received via the communication unit. And a person image automatic registration unit for registering in the telephone directory as a person image of the contact to be made.

In the present invention, of the person images stored in the storage unit, person images that are not registered in the telephone directory are stored as unregistered person images. Then, when performing communication in a form of receiving the communication partner person image together with the communication partner contact information, the unregistered person image that matches the received person image is detected, and the received person image and When a matching unregistered person image is detected, the detected unregistered person image is registered in the telephone directory as a contact person image corresponding to the contact information received via the communication unit. In addition to the effective use of images stored in the storage unit, the registration of person images for each contact is automated.

The present invention can automatically register each user's image in the telephone directory. Further, it is possible to effectively use the images stored in the storage unit.

  The present invention can be applied to a mobile phone.

[Electric configuration of mobile phone]
As shown in FIG. 1, the mobile phone according to the embodiment of the present invention has an antenna 1 and a communication circuit 2 that perform wireless communication with a base station, and an acoustic output such as a ringtone and a received voice. It has a speaker unit 3, a microphone unit 4 that collects transmission voice, and a display unit 5 for displaying images (moving images, still images, etc.), characters, and the like.

  In addition, the mobile phone includes an operation unit 6 for performing input operation of characters and the like, selection operation of a desired menu, and the like, a light emitting unit 7 (LED: Light Emitting Diode) for notifying light of incoming / outgoing calls, and the like, It has a camera unit 8 for capturing a still image or a moving image of a desired subject, and a vibration unit 9 for notifying the user of incoming / outgoing calls by vibrating the casing of the mobile phone.

  In addition to the timer 10 that counts the current time and the voice call communication, the mobile phone includes a communication processing program (communication program) for performing a videophone communication for making a call by transmitting and receiving voice and moving images. The memory 11 stores various application programs, various data handled by the application programs, and the like, and the control unit 12 that controls the entire mobile phone.

  In the memory 11, an e-mail management program for controlling the creation and transmission / reception of e-mails, imaging control of the camera unit 8, moving images captured by the camera unit 8 or captured via a network or input terminal A camera control program having a still image viewer function, a schedule book management program for managing a schedule book in which a user's schedule is registered, a phone book management program for managing a phone book, and music content And a music player program for reproducing the above.

Further, in the memory 11, a schedule book in which a user's desired schedule is registered, a phone book in which still images, phone numbers, e-mail addresses, birth dates, etc. of the user's acquaintances and friends are registered, Music content played based on the music player program, still and moving images played back based on the viewer function of the camera control program, sent / received e-mail, telephone, videophone and e-mail history Etc. are stored.

[Appearance structure of mobile phone]
Although it is an example, the mobile phone of this embodiment has a so-called foldable connection in which the upper housing 21 and the lower housing 22 are connected via a hinge portion 23 as shown in FIGS. It is a foldable mobile phone. 2A is a diagram of the mobile phone in the open state as viewed from the inner surface side (the surface side to be abutted in the closed state), and FIG. 2B is the mobile phone in the open state. It is the figure which looked at from the outer surface side.

  In FIG. 2A, this mobile phone has a display unit 5 in an upper housing 21. In addition, this mobile phone has a speaker unit 3 for calling and a second camera unit 8b (in-camera unit) between the upper end portion 21a of the casing 21 and the upper end portion 5a of the display unit 5. ing. In addition, the mobile phone has an operation unit 6 in the lower housing 22, and a microphone that is used for calling or collecting surrounding audio between the operation unit 6 and the lower end 22 a of the lower housing 22. Part 4.

  The operation unit 6 includes a cross key 24 that can be pressed up, down, left, and right, and an enter key 25 provided at the center of the cross key. The operation unit 6 normally performs a pressing operation when instructing a network connection such as the Internet, and the first soft key 26 that performs a pressing operation when instructing activation of the e-mail management program. And a second soft key 27. Further, the operation unit 6 normally includes a third soft key 28 that performs a pressing operation when instructing display of the main menu, and a fourth soft key 29 that is normally assigned and used with a desired command. Have.

  Further, the operation unit 6 normally inputs an off-hook key 30 that is pressed when making a call or an incoming call, and an on-hook key 31 that is normally pressed when the main power is turned on / off and when the call ends. A clear key 32 that is pressed to delete a character or correct a specified action, and twelve 12 keys 33 to which numbers 0 to 9 and alphabets, asterisks “*”, and sharp “#” are assigned. And have.

In addition, as shown in FIG. 2B, the mobile phone includes a first camera unit on the back side of the lower housing 22 (the surface opposite to the surface on which the operation unit 6 is provided). 8a (main camera part). That is, this mobile phone has a total of two camera units, a main camera unit 8a and an in-camera unit 8b, as the camera unit 8 shown in the block diagram of FIG. The main camera unit 8a is mainly used when imaging other users, landscapes, and the like, and the in-camera unit 8b is used when imaging the user of the mobile phone when performing videophone communication, for example. It is supposed to be.

[Automatic registration of person images]
In the mobile phone of this embodiment, contact information such as a telephone number and an e-mail address of each user is registered in the phone book stored in the memory 11, but a person such as a face image of each user is registered. This person image is automatically registered when no image is registered.

[Detection of unregistered face data]
First, the mobile phone of this embodiment is registered in the telephone directory from a still image (may be a moving image) captured by the camera unit 8 or a still image downloaded via a predetermined network such as the Internet. A person image that has not been detected is detected, and this person image is stored in the memory 11 as unregistered face data. The flowchart of FIG. 3 shows the flow of the detection operation for the unregistered face image data. This flowchart shows the control unit 12 at a timing when a still image (or moving image) is captured by the camera unit 8 or a still image (or moving image) is downloaded via a predetermined network such as the Internet. Is started based on the telephone directory management program stored in the memory 11.

  In step S1, the control unit 12 controls to store the still image captured by the camera unit 8 or the still image downloaded via the network in the memory 11, and advances the process to step S2. In step S2, the control unit 12 extracts the face portion of the person shown in the still image and advances the process to step S3. Note that when the still images include person images of a plurality of persons, the control unit 12 extracts each person's face portion.

  In step S3, the control unit 12 compares the extracted still image of the face portion with the person image of each user registered in the phone book. In step S4, the control unit 12 determines whether or not a person image that matches the extracted still image of the face portion is registered in the phone book, so that the extracted still image of the face portion is a phone call. It is determined whether or not it is already registered as a person image of any user in the book.

  In step S4, when a person image that matches the extracted still image of the face portion is detected from the phone book, the control unit 12 has already registered the extracted still image of the face portion in the phone book. And the entire process of the flowchart of FIG.

On the other hand, when a person image that matches the extracted still image of the face part is not detected from the phone book, the control unit 12 uses the extracted still image of the face part as unregistered face image data for the phone book. Are stored in the memory 11 and all the processes in the flowchart of FIG. As a result, among the still images captured by the camera unit 8 and the still images downloaded via a predetermined network, the still image of the face portion of the person who is not registered in the phone book is not registered. It is stored in the memory 11 as face data.

[Automatic registration to phone book]
Next, the unregistered face data stored in the memory 11 in this way is automatically registered in the telephone directory when it matches the person image of the other party of the videophone call. The flowchart of FIG. 4 shows the flow of the automatic registration operation to the telephone directory. This flowchart is started based on the telephone directory management program stored in the memory 11 at the timing when the control unit 12 starts a videophone call (incoming call timing or outgoing call timing).

  In step S11, the control unit 12 refers to the phone book based on the telephone number of the other party transmitted from the mobile phone of the other party of the videophone, and registers the person image in the registration field of the telephone number of the other party. The presence or absence of is detected. In step S12, it is determined whether the person image of the user is registered in the telephone number registration field of the call partner, and the user person image is displayed in the telephone number registration field of the call partner. If it is determined that the user is registered, the entire process shown in the flowchart of FIG. 4 is terminated, and it is determined that the person image of the user is not registered in the telephone number registration column of the other party. If so, the process proceeds to step S13.

  In step S13, the control unit 12 extracts a still image of the face portion from the person image of the other party transmitted from the mobile phone of the other party of the videophone, and advances the process to step S14. In step S14, the control unit 12 compares the still image of the face portion extracted from the person image of the videophone call partner and the unregistered face data stored in the memory 11, and the process proceeds to step S15. Proceed.

  In step S15, the control unit 12 determines the presence / absence of the unregistered face data that matches the still image of the face portion extracted from the person image of the video phone call partner, and matches the still image of the face portion. If the presence of unregistered face data is detected, the process proceeds to step S16. If the presence of the unregistered face data matching the still image of the face portion is not detected, the process is directly shown in the flowchart of FIG. End all processing.

  The fact that the unregistered face data matches the still image of the other party's face transmitted from the mobile phone of the other party of the videophone call means that the user stored as the unregistered face data It will be the other party. Therefore, in step S16, the control unit 12 automatically registers the unregistered face data in the registration field in the telephone directory in which the current telephone number of the other party is registered, and the flowchart of FIG. All processes shown in FIG. As a result, it is possible to automatically register the person image of the user who is the other party in the phone book simply by making a videophone call.

  In this example, the unregistered face data is automatically registered in the phone book. However, the still image of the face part of the calling party extracted in step S13 is automatically registered in the phone book. Also good.

  In addition, the person image is automatically registered in the phone book. For example, at the timing when the videophone call ends (or during the call), “the person image of the other party is registered in the phone book”. A message asking whether or not to register such as “Do you want to register?” Is displayed on the display unit 5, and when the user performs an operation to instruct the registration via the operation unit 6, The unregistered face data or the still image of the face part of the calling party extracted in step S13 may be registered in the phone book.

  In addition, as the videophone call history, the phone number of the call partner and the still image of the face of the call partner extracted in step S13 are stored, and when this call history is selected and operated by the user. A message asking whether or not to perform the registration is displayed on the display unit 5, and when the user gives an instruction to register, the unregistered face data or the face of the call partner extracted in step S13 is displayed. Partial still images may be registered in the phone book.

  In addition, when there are a plurality of unregistered face data that matches the still image of the face part of the call partner extracted in step S13, these unregistered face data are displayed in a list on the display unit 5 and selected from these by the user The registered unregistered face data may be registered in the phone book.

If a plurality of person images can be registered in the phone book, a plurality of unregistered face data that matches the still image of the face of the other party may be registered in the phone book, respectively. Along with the face data, the still image of the face part of the calling party extracted in step S13 may be registered in the phone book.

[Effect of the embodiment]
As is clear from the above description, the mobile phone of this embodiment extracts a person who is captured in a still image captured by the camera unit 8 or a still image downloaded via a network, and this extraction is performed. It is determined whether or not a person image of a person is already registered in the phone book. If it is not registered in the phone book, the extracted person image of the person is stored in the memory 11 as unregistered face data.

  Next, when a videophone call is made, the phonebook is referred to based on the telephone number of the other party transmitted from the other party's mobile phone, and the caller registration field corresponding to the telephone number is entered. It is determined whether or not a person image has been registered. Then, when the person image is not registered, the unregistered face data that matches the person image of the call partner transmitted from the mobile phone of the call partner is detected from the memory 11, and the detected unregistered face data is detected. Then, it is automatically registered in the telephone directory as a person image of the other party of the videophone call.

  As a result, it is possible to automatically register the person image of the user who is the other party in the phone book simply by making a videophone call. For this reason, it is possible to easily and automatically create a telephone book in which person images of each user are registered.

In addition, since unregistered face data extracted from a still image captured by the camera unit 8 or a still image downloaded via a network is registered in the phone book, the still image or network captured by the camera unit 8 is registered. It is possible to effectively use the still image downloaded via. In addition, the camera unit 8 that is a high-resolution camera unit can be effectively used.

[Modification]
In the above description of the embodiment, the present invention is applied to a mobile phone. However, the present invention is not limited to this mobile phone, but may be a PHS phone (PHS: Personal Handyphone System) or a PDA device (PDA: Even when applied to a portable device such as a personal digital assistant) or a notebook personal computer device, the same effect as described above can be obtained.

  Finally, the present invention is not limited to the above-described embodiment, which is disclosed as an example only. For this reason, as long as it is the range which does not deviate from the technical idea which concerns on this invention, it adds that it is needless to say that various changes are possible according to a design etc. also except the above-mentioned embodiment. .

1 is a block diagram of a mobile phone according to an embodiment to which the present invention is applied. It is a figure which shows the external appearance of the mobile telephone of embodiment. It is a flowchart for demonstrating the detection operation | movement of the unregistered face data of the mobile telephone used as embodiment. It is a flowchart for demonstrating the automatic registration operation | movement of the person image with respect to the telephone directory of the mobile telephone of embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Antenna 2 Communication circuit 3 Speaker part 4 Microphone part 5 Display part 6 Operation part 7 Light emission part (LED) 8 Camera part 8a Main camera part 8b In-camera part 9 Vibration unit 10 Timer , 11 Memory, 12 Control unit, 21 Upper case of mobile phone, 22 Lower case of mobile phone, 23 Hinge portion of mobile phone, 24 Cross key, 25 Enter key, 26 First soft key, 27 Second Soft key, 28 3rd soft key, 29 4th soft key, 30 Off-hook key, 31 On-hook key, 32 Clear key, 33 12 key

Claims (5)

A person image extraction unit for extracting a person image from an image stored in the storage unit ;
A phone book in which at least contact information of each contact and a person image of each contact are registered;
A matching person image detection unit that detects a person image that matches the person image extracted by the person image extraction unit from the person images registered in the phone book;
If the matching person image detection unit does not detect a person image that matches the person image extracted by the person image extraction unit from the telephone directory, the person image extraction unit extracts the person image extracted by the person image extraction unit. An unregistered person image storage control unit that stores and controls in the storage unit as an unregistered person image that is not registered in the book;
A matching unregistered person image detection unit that detects an unregistered person image that matches the received person image from the storage unit when a person image of the communication partner is received together with contact information of the communication partner via the communication unit. When,
When the unregistered person image matching the received person image is detected by the matching unregistered person image detection unit, the detected unregistered person image is associated with the contact information received via the communication unit. An information processing apparatus comprising: a person image automatic registration unit that registers in the telephone directory as a person image of a contact to be made. The information processing apparatus according to claim 1,
In the phone book, at least the telephone number of each contact and the person image of each contact are registered.
The unregistered person image detecting unit detects the unregistered person image based on the person image of the communication partner received together with the telephone number of the communication partner of the videophone communication. A person image extracting unit extracting a person image from an image stored in the storage unit ;
The matching person image detection unit matches the person image extracted in the above step from the telephone book in which the contact information of each contact and the contact person image associated with each contact information are registered. Detecting a human image;
In the step, if the matching person image is not detected from the phone book, the unregistered person image storage control unit stores the person image extracted in the step not registered in the phone book. Storing and controlling in the storage unit as a person image;
When the person image of the communication partner is received together with the contact information of the communication partner via the communication unit, the matching unregistered person image detecting unit displays the unregistered person image that matches the received person image. Detecting from
In the above step, when an unregistered person image that matches the received person image is detected, the person image automatic registration unit converts the detected unregistered person image into the contact information received via the communication unit. Registering in the telephone directory as a person image of a corresponding contact. Causing the computer to function as a person image extraction unit that extracts a person image from an image stored in the storage unit ;
At least contact information of each contact and a person image extracted when the computer is made to function as the person image extraction unit from a telephone book in which person images of each contact associated with the contact information are registered The computer functions as a matching person image detecting unit that detects a matching person image.
When a computer functioning as the matching person image detection unit and a person image that matches the person image extracted when the computer functions as the person image extraction unit is not detected from the telephone directory, the computer The computer functions as an unregistered person image storage control unit that stores and controls the person image extracted by functioning as the person image extraction unit in the storage unit as an unregistered person image that is not registered in the telephone directory. Let
Matched unregistered person image detection for detecting an unregistered person image that matches the received person image from the storage unit when the person image of the other party of communication is received together with contact information of the other party of communication via the communication unit The computer as a part,
When an unregistered person image that matches the received person image is detected by causing the computer to function as the matched unregistered person image detection unit, the detected unregistered person image is transmitted via the communication unit. An information processing program that causes a computer to function as a person image automatic registration unit that registers in the telephone directory as a person image of a contact corresponding to received contact information. A storage unit for storing images;
A person image extraction unit for extracting a person image from the image stored in the storage unit ;
A phone book in which at least contact information of each contact and a person image of each contact associated with the contact information are registered;
A matching person image detection unit that detects a person image that matches the person image extracted by the person image extraction unit from the phone book;
If the matching person image detection unit does not detect a person image that matches the person image extracted by the person image extraction unit from the phone book, the person image extraction unit extracts the person image extracted by the person image extraction unit. An unregistered person image storage control unit for storing and controlling the registered person image in the storage unit;
Matched unregistered person image detection for detecting an unregistered person image that matches the received person image from the storage unit when the person image of the other party of communication is received together with contact information of the other party of communication via the communication unit. And
When the unregistered person image matching the received person image is detected by the matching unregistered person image detection unit, the detected unregistered person image is associated with the contact information received via the communication unit. A personal digital assistant device comprising: a personal image automatic registration unit that registers in the telephone directory as a personal image of a contact person to be contacted.

Images