JP2007312262A - Information processing apparatus, information processing method, information processing program, and mobile terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display various human figure images each corresponding to a user who becomes a communicating party when displaying a human figure of the user who becomes the relevant communicating party, in sending/receiving a telephone call or electronic mail. <P>SOLUTION: When sending/receiving the telephone call or electronic mail, based on the human figure of the user, corresponding to the relevant transmission/reception, registered on a telephone directory, a still image in which the user corresponding to the transmission/reception is photographed, is detected out of still images stored in a memory 11, and displayed on a display unit. Thus, a range of the human figure image to be displayed can be expanded not only to human figure images registered on the telephone directory but also to still images stored in the memory 11. Therefore, when displaying the human figure of the user registered on the telephone directory, in addition to the human figure image registered on the telephone directory, various human figure images corresponding to that user can be displayed. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention is suitable for application to portable devices such as mobile phones, PHS phones (PHS: Personal Handyphone System), PDA devices with communication functions (PDA: Personal Digital Assistant), and notebook personal computer devices. The present invention relates to a processing device, an information processing method, an information processing program, and a mobile terminal device, and more particularly to an information processing device, an information processing method, an information processing program, and a mobile terminal device that automate the registration of each user's person image in a telephone directory.

  In Japanese Patent Laid-Open No. 2000-332878 (Patent Document 1), image information of a specified user is registered in a telephone directory in which user image information can be registered together with personal information such as the user's telephone number. There is disclosed a portable telephone device that can easily determine whether or not there is.

  That is, normally, data registered in the phone book is displayed after character information such as the telephone number of the designated user is displayed and after the time required for decoding the registered image information has elapsed. Is displayed. The display area of the image information is a black screen until the decoding process of the registered image information is completed. On the other hand, even when the image information of the user is not registered, the display area of the image information is a black screen.

  For this reason, the display area of the image information is a black screen because it takes time to decode the registered image information, or the image of the user is displayed. There is a problem that the user has difficulty in determining whether the screen is black because information is not registered.

  For this reason, in the portable telephone device disclosed in Patent Document 1, when the image information of the user who is designated to make a call is not registered in the phone book, the image information is registered. Display that there is no. Thereby, the user can easily determine whether or not the image information of the user designated from the telephone directory is registered.

JP 2000-332878 (page 4: FIG. 4, FIG. 5)

  However, in the case of the portable telephone device disclosed in Patent Document 1, the displayed user image information is only image information registered in the telephone directory. For this reason, there is a problem that the same image information continues to be displayed unless the image information to be registered in the telephone book is changed.

  The present invention has been made in view of the above problems, and when displaying image information of a user registered in the phone book, image information other than the image information registered in the user's phone book is also displayed. It is an object of the present invention to provide an information processing apparatus, an information processing method, an information processing program, and a mobile terminal device that can perform such processing.

The information processing apparatus according to the present invention is a means for solving the above-described problems.
At least contact information of each contact, and a telephone book in which a person image can be registered in association with each contact;
Among the person images registered in the telephone directory in association with the contact information, a still image in which a person image that matches the specified person image is shown among a plurality of still images stored in the storage unit. A matching person image detection unit to detect from,
A display control unit that controls display on the display unit of a still image that is detected by the matching person image detection unit and that includes a person image that matches the designated person image.

The information processing method according to the present invention is a means for solving the above-described problems.
A registration control unit that registers at least contact information of each contact and a person image in association with each contact with the phone book;
The matching person image detection unit stores a still image in which a person image that matches the specified person image among the person images registered in the telephone directory in association with the contact information is stored in the storage unit. Detecting from a plurality of still images,
A display control unit including a step of performing display control on the display unit of a still image in which a person image that matches the specified person image is detected.

In addition, an information processing program according to the present invention is provided to solve the above problems.
Let the computer function as a registration control unit that registers at least contact information of each contact and a person image in association with each contact with respect to the phone book,
By causing the computer to function as the registration control unit, among the person images registered in the telephone directory, a plurality of still images in which a person image that matches the designated person image is captured are stored in the storage unit. Let the computer function as a matching person image detection unit that detects from still images,
The computer is caused to function as a display control unit that controls display on the display unit of still images that are detected by causing the computer to function as the matching person image detection unit and that includes a person image that matches the designated person image.

Moreover, the portable terminal device according to the present invention is a means for solving the above-described problems.
At least contact information of each contact and a phone book in which a person image is registered in association with each contact;
A storage unit storing a plurality of still images;
A matching person image detection unit for detecting a still image in which a person image matching the person image specified from the telephone book is captured from a plurality of still images stored in the storage unit;
A display control unit that controls display on the display unit of a still image that is detected by the matching person image detection unit and that includes a person image that matches the designated person image.

  In the present invention, when any person image is designated from at least contact information of each contact and a telephone book in which person images are registered in association with each contact, the information is stored in the storage unit. A still image in which a person image that matches the designated person image is detected from a plurality of still images is detected and displayed. That is, a person image of the same person as the person registered in the phone book is retrieved from a plurality of still images stored in the storage unit and displayed. Thereby, the range of the person image to be displayed can be expanded not only to the person image registered in the phone book but also to the still image stored in the storage unit.

  According to the present invention, the range of person images to be displayed can be expanded not only to person images registered in the telephone directory but also to still images stored in the storage unit. For this reason, when displaying the contact person image registered in the phone book, the contact person image registered in the phone book is detected from the still image stored in the storage unit. Various person images corresponding to the contact information can be displayed.

  The present invention can be applied to a mobile phone.

[Electric configuration of mobile phone]
As shown in FIG. 1, the mobile phone according to the embodiment of the present invention has an antenna 1 and a communication circuit 2 that perform wireless communication with a base station, and an acoustic output such as a ringtone and a received voice. It has a speaker unit 3, a microphone unit 4 that collects transmission voice, and a display unit 5 for displaying images (moving images, still images, etc.), characters, and the like.

  In addition, the mobile phone includes an operation unit 6 for performing input operation of characters and the like, selection operation of a desired menu, and the like, a light emitting unit 7 (LED: Light Emitting Diode) for notifying light of incoming / outgoing calls, etc. It has a camera unit 8 for capturing a still image or a moving image of a desired subject, and a vibration unit 9 for notifying the user of incoming / outgoing calls by vibrating the casing of the mobile phone.

  In addition to the timer 10 that counts the current time and the voice call communication, the mobile phone includes a communication processing program (communication program) for performing a videophone communication for making a call by transmitting and receiving voice and moving images. The memory 11 stores various application programs, various data handled by the application programs, and the like, and the control unit 12 that controls the entire mobile phone.

  In the memory 11, an e-mail management program for controlling the creation and transmission / reception of e-mails, imaging control of the camera unit 8, moving images captured by the camera unit 8 or captured via a network or input terminal A camera control program having a still image viewer function, a schedule book management program for managing a schedule book in which a user's schedule is registered, a phone book management program for managing a phone book, and music content And a music player program for reproducing the above.

Further, in the memory 11, a schedule book in which a user's desired schedule is registered, a phone book in which still images, phone numbers, e-mail addresses, birth dates, etc. of the user's acquaintances and friends are registered, Music content played based on the music player program, still and moving images played back based on the viewer function of the camera control program, sent / received e-mail, telephone, videophone and e-mail history Etc. are stored.

[Appearance structure of mobile phone]
Although it is an example, the mobile phone of this embodiment has a so-called foldable connection in which the upper housing 21 and the lower housing 22 are connected via a hinge portion 23 as shown in FIGS. It is a foldable mobile phone. 2A is a diagram of the mobile phone in the open state as viewed from the inner surface side (the surface side to be abutted in the closed state), and FIG. 2B is the mobile phone in the open state. It is the figure which looked at from the outer surface side.

  In FIG. 2A, this mobile phone has a display unit 5 in an upper housing 21. In addition, this mobile phone has a speaker unit 3 for calling and a second camera unit 8b (in-camera unit) between the upper end portion 21a of the casing 21 and the upper end portion 5a of the display unit 5. ing. In addition, the mobile phone has an operation unit 6 in the lower housing 22, and a microphone that is used for calling or collecting surrounding audio between the operation unit 6 and the lower end 22 a of the lower housing 22. Part 4.

  The operation unit 6 includes a cross key 24 that can be pressed up, down, left, and right, and an enter key 25 provided at the center of the cross key. The operation unit 6 normally performs a pressing operation when instructing a network connection such as the Internet, and the first soft key 26 that performs a pressing operation when instructing activation of the e-mail management program. And a second soft key 27. Further, the operation unit 6 normally includes a third soft key 28 that performs a pressing operation when instructing display of the main menu, and a fourth soft key 29 that is normally assigned and used with a desired command. Have.

  Further, the operation unit 6 normally inputs an off-hook key 30 that is pressed when making a call or an incoming call, and an on-hook key 31 that is normally pressed when the main power is turned on / off and when the call ends. A clear key 32 that is pressed to delete a character or correct a specified action, and twelve 12 keys 33 to which numbers 0 to 9 and alphabets, asterisks “*”, and sharp “#” are assigned. And have.

In addition, as shown in FIG. 2B, the mobile phone includes a first camera unit on the back side of the lower housing 22 (the surface opposite to the surface on which the operation unit 6 is provided). 8a (main camera part). That is, this mobile phone has a total of two camera units, a main camera unit 8a and an in-camera unit 8b, as the camera unit 8 shown in the block diagram of FIG. The main camera unit 8a is mainly used when imaging other users, landscapes, and the like, and the in-camera unit 8b is used when imaging the user of the mobile phone when performing videophone communication, for example. It is supposed to be.

[Displaying a person image when making or receiving calls or emails]
The mobile phone of this embodiment searches and displays a still image in which a person corresponding to the incoming / outgoing call is shown from among the still images stored in the memory 11 at the time of outgoing / incoming call or e-mail. It is supposed to be. The flowchart of FIG. 3 shows the flow of such a human image display operation. In this flowchart, the control unit 12 is started based on a communication program stored in the memory 11 by detecting an incoming / outgoing call or e-mail.

  In step S1, the control unit 12 refers to the registration field of the telephone directory in which the incoming and outgoing telephone numbers are registered, so that the person of the user corresponding to the telephone number is displayed in the telephone number registration field. Detect images. In step S2, it is determined whether or not the person image of the user corresponding to the telephone number is registered in the registration column of the incoming and outgoing telephone numbers. If the person image is registered, the process is performed. The process proceeds to step S3, and if the person image is not registered, the process proceeds to step S6.

  When the process proceeds to step S6 by determining that the person image of the user who made and received the call is not registered, the control unit 12 obtains the name (or nickname, etc.) of the user corresponding to the call from the phone book. This is read out and displayed on the display unit 5, and all the processes shown in the flowchart of FIG.

  On the other hand, when the process proceeds to step S3 by determining that the person image of the user who made and received the call is registered, the control unit 12 stores the memory 11 based on the person image detected from the telephone directory. By searching for still images stored in the memory, a still image in which the same person as the person image registered in the telephone book is captured from the still images stored in the memory 11 is retrieved. Search using a predetermined face recognition technique or the like.

  In this example, the still image stored in the memory 11 which is the internal memory is the target of the search. However, if there is an external memory, the external memory may be searched. Alternatively, the user may be able to set in advance a memory or folder for performing the search.

  Next, in step S4, the control unit 12 determines whether or not a still image in which the same person as the person in the person image registered in the telephone directory is retrieved from the memory 11, and the retrieval can be performed. If so, the process proceeds to step S5. If the search cannot be performed, the process proceeds to step S7.

  When the search for the still image cannot be performed from the memory 11 and the process proceeds to step S7, the control unit 12 displays the person image of the user registered in advance in the phone book on the display unit 5. The process shown in the flowchart of FIG.

  On the other hand, when the process proceeds to step S5 when the still image is detected from the memory 11, the control unit 12 detects the person image of the user registered in the phone book in advance and the step S3. The still image thus displayed is randomly displayed on the display unit 5 at predetermined time intervals. Alternatively, the control unit 12 first displays the person image of the user registered in advance in the telephone directory on the display unit 5, and this search is performed each time a still image corresponding to the user is retrieved from the memory 11. The still images thus displayed are sequentially displayed on the display unit 5.

  Each display form of the random display and the sequential display can be designated in advance by the user, and the control unit 12 performs the random display or the sequential display based on the designation information stored in the memory 11. Any display control is performed. In this example, the entire searched still image is displayed. However, a partial display in which the face portion of the user is extracted from the searched still image may be performed.

  The control unit 12 continuously performs such display control until the end of the conversation or the end of transmission / reception of the e-mail is detected. As a result, during the call or while sending / receiving e-mail, various person images of the user who is the other party of the call or e-mail transmission / reception are switched and displayed on the display unit 5 at predetermined intervals. It becomes.

In this example, the control unit 12 performs such display control until the end of the talk or the end of transmission / reception of e-mail is detected. The above display control may be performed for a predetermined time.

[Human image display operation when making and receiving videophone calls]
Next, the mobile phone of this embodiment uses the person image of the call partner transmitted from the mobile phone of the user who is the call partner during a videophone call even when no person image is registered in the phone book. Based on the still image stored in the memory 11, a still image in which the person who is the other party is shown is retrieved and displayed. The flowchart of FIG. 4 shows the flow of such a human image display operation. In this flowchart, the control unit 12 is started based on a communication program stored in the memory 11 by detecting an incoming / outgoing videophone call.

  In step S11, the control unit 12 refers to the telephone directory based on the telephone number of the incoming / outgoing videophone, thereby detecting a person image registered in the telephone number registration field. In step S2, it is determined whether or not a person image is registered in the telephone number registration field of the incoming / outgoing videophone call. If the person image is registered, the process proceeds to step S13. If no person image is registered, the process proceeds to step S16.

  When the process proceeds to step S13 by determining that the person image is registered, the control unit 12 searches the still image stored in the memory 11 based on the person image, thereby A still image in which the same person as that of the person image registered in the telephone book is captured is searched from among the still images stored in 11, using a predetermined face recognition technique or the like.

  On the other hand, when the process proceeds to step S16 by determining that the person image is not registered, the control unit 12 stores the memory based on the person image received from the mobile phone of the videophone call partner. By searching for a still image stored in the memory 11, a person who is the same as the person in the person image received from the mobile phone of the other party of the videophone call is selected from the still images stored in the memory 11. A still image shown in the image is searched using a predetermined face recognition technique or the like. As a result, even when no person image is registered in the telephone directory, the above search can be performed using the person image received from the mobile phone of the videophone call partner.

  Next, in step S14, as a result of the search performed on the basis of the person image registered in the telephone directory in step S13 by the control unit 12, a still image of the same person has been searched or the television set in step S16. It is determined whether a still image of the same person has been searched as a result of searching based on the person image received from the mobile phone of the telephone call partner.

  If it is determined by this determination that no still image of the same person has been searched, the control unit 12 advances the process to step S17, and displays the person image received from the mobile phone of the videophone call partner on the display unit 5. All the processes shown in the flowchart of FIG. 4 are displayed.

  On the other hand, when it is determined that the still image of the same person has been searched by the above determination, the control unit 12 advances the process to step S15, and the person image of the user registered in advance in the phone book. Then, the still images detected from the memory 11 are randomly displayed on the display unit 5 at predetermined time intervals. Alternatively, the control unit 12 first displays the person image of the user registered in advance in the telephone directory on the display unit 5, and this search is performed each time a still image corresponding to the user is retrieved from the memory 11. The still images thus displayed are sequentially displayed on the display unit 5.

  As described above, each display form of the random display and the sequential display can be designated in advance by the user, and the control unit 12 performs the random display based on the designation information stored in the memory 11. Alternatively, display control of either sequential display is performed. In this example, the entire searched still image is displayed. However, as described above, the user's face portion or the like may be extracted from the searched still image. It is.

  The control unit 12 continues such display control until the end of the videophone call is detected. As a result, during a videophone call, various person images of the user who is the other party are switched and displayed on the display unit 5 at predetermined time intervals. Normally, when making a videophone call, the user makes a call while looking at the person image of the other party displayed on the display unit 5. For this reason, during this call, by switching and displaying various person images of the user who is the other party at predetermined time intervals, the user of the mobile phone makes a call while recalling the memories of the other party Can be possible.

  In this example, the control unit 12 performs such display control until the end of the videophone call is detected. However, during the videophone call, the control unit 12 receives the call from the other party's mobile phone. The display control may be performed for a predetermined time after the person image is displayed on the display unit 5 and the end of the videophone call is detected.

  In addition, during a videophone call, the person image received from the other party's mobile phone is displayed on the display unit 5, and the retrieved person image is displayed in an extra area such as the right corner of the display screen. May be.

  In addition, when the still image captured by the camera unit 8 is stored in the memory 11 or when the still image downloaded via the network is stored in the memory 11, the control unit 12 is configured to display the person in the still image. A feature point such as a face portion may be extracted in advance, and the feature point data may be added to the still image and stored in the memory 11.

As a result, the control unit 12 performs the above-described still image search based on the feature point data extracted from the person image registered in the telephone directory or the feature point data extracted from the person image of the video phone call partner. Since it can be performed, the time required for searching for the still image can be shortened. For this reason, the display of a person image can be speeded up.

[Effect of the embodiment]
As is clear from the above description, the mobile phone according to this embodiment has a human image of a user corresponding to the outgoing / incoming call out of the users registered in the phone book due to incoming / outgoing calls or e-mails. When the display is designated, the control unit 12 captures the person image of the user from the still images stored in the memory 11 based on the person image of the designated user registered in the telephone directory. The still image being detected is detected and displayed on the display unit 5.

  Thereby, the range of the person image to be displayed can be expanded not only to the person image registered in the telephone book but also to the still image stored in the memory 11. For this reason, when displaying a person image of a user registered in the phone book, various person images corresponding to the user can be displayed in addition to the person image registered in the phone book.

  In addition, since the person image corresponding to the user to be displayed can be retrieved from the still images stored in the memory 11 and displayed, the still image stored in the memory 11 can be used effectively.

  Further, when a plurality of still images corresponding to the user to be displayed are detected from the still images stored in the memory 11, the plurality of detected still images are selected at random and displayed. The detected still images are sequentially displayed at predetermined time intervals. For this reason, a still image with few opportunities to be displayed while being stored in the memory 11 may be displayed, and an effect of recalling a user's memories or past events can be expected.

Also, when a videophone call is made, the user who is the other party is shown from the still images stored in the memory 11 based on the person image transmitted from the mobile phone of the user who is the other party. Still images can be searched and displayed. For this reason, even if the person image of the user who is the call partner is not registered in the phone book, the person image of the user who is the communication partner is searched and displayed from the still images stored in the memory 11. can do.

[Modification]
In the above description of the embodiment, the present invention is applied to a mobile phone. However, the present invention is not limited to this mobile phone, but may be a PHS phone (PHS: Personal Handyphone System) or a PDA device (PDA: Even when applied to a portable device such as a personal digital assistant) or a notebook personal computer device, the same effect as described above can be obtained.

  Finally, the present invention is not limited to the above-described embodiment, which is disclosed as an example only. For this reason, as long as it is the range which does not deviate from the technical idea which concerns on this invention, it adds that it is needless to say that various changes are possible according to a design etc. also except the above-mentioned embodiment. .

1 is a block diagram of a mobile phone according to an embodiment to which the present invention is applied. It is a figure which shows the external appearance of the mobile telephone of embodiment. It is a flowchart which shows the flow of the display operation | movement of a person image at the time of the telephone of the mobile telephone used as embodiment or an e-mail transmission / reception. It is a flowchart which shows the flow of the display operation | movement of a person image at the time of the outgoing / incoming call of the videophone of the mobile telephone of embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Antenna 2 Communication circuit 3 Speaker part 4 Microphone part 5 Display part 6 Operation part 7 Light-emitting part (LED) 8 Camera part 8a Main camera part 8b In-camera part 9 Vibration unit 10 Timer , 11 Memory, 12 Control unit, 21 Upper case of mobile phone, 22 Lower case of mobile phone, 23 Hinge portion of mobile phone, 24 Cross key, 25 Enter key, 26 First soft key, 27 Second Soft key, 28 3rd soft key, 29 4th soft key, 30 Off-hook key, 31 On-hook key, 32 Clear key, 33 12 key

Claims (8)

At least contact information of each contact, and a telephone book in which a person image can be registered in association with each contact;
Among the person images registered in the telephone directory in association with the contact information, a still image in which a person image that matches the specified person image is shown among a plurality of still images stored in the storage unit. A matching person image detection unit to detect from,
An information processing apparatus comprising: a display control unit configured to display on a display unit a still image in which a person image that matches the designated person image detected by the matching person image detection unit is displayed. The information processing apparatus according to claim 1,
When the matching person image detection unit detects a plurality of still images in which a person image that matches the designated person image is detected, the display control unit randomly selects the plurality of still images detected. An information processing apparatus comprising: selecting and controlling display on a display unit, or sequentially controlling a plurality of still images detected on the display unit at predetermined time intervals. The information processing apparatus according to claim 1,
The matching person image detection unit detects the person image of the call partner from the phone book based on the phone number of the call partner transmitted from the communication device of the call partner when making a phone call. An information processing apparatus, wherein a still image in which a person image that matches the detected person image of the other party is reflected is detected from a plurality of still images stored in the storage unit. The information processing apparatus according to claim 1,
The phone book stores the email address of each contact as the contact information.
The matching person image detecting unit detects a person image of the other party from the telephone book based on an e-mail address of the transmitted and / or received e-mail, and matches the detected person image of the other party An information processing apparatus, wherein a still image in which an image is captured is detected from a plurality of still images stored in the storage unit. The information processing apparatus according to claim 1,
The matching person image detection unit is configured to store a still image in which a person image matching the person image of the communication partner received together with the communication partner's telephone number is received from the communication device of the communication partner of the videophone communication. An information processing apparatus that detects from among a plurality of still images stored in the computer. A registration control unit that registers at least contact information of each contact and a person image in association with each contact with the phone book;
The matching person image detection unit stores a still image in which a person image that matches the specified person image among the person images registered in the telephone directory in association with the contact information is stored in the storage unit. Detecting from a plurality of still images,
An information processing method including: a display control unit configured to display, on the display unit, a still image in which a person image matching the designated person image is detected, which is detected in the step. Let the computer function as a registration control unit that registers at least contact information of each contact and a person image in association with each contact with respect to the phone book,
By causing the computer to function as the registration control unit, among the person images registered in the telephone directory, a plurality of still images in which a person image that matches the designated person image is captured are stored in the storage unit. Let the computer function as a matching person image detection unit that detects from still images,
Causing the computer to function as a display control unit that controls display on the display unit of still images that are detected by causing the computer to function as the matching person image detection unit and that includes a person image that matches the designated person image. An information processing program characterized by At least contact information of each contact and a phone book in which a person image is registered in association with each contact;
A storage unit storing a plurality of still images;
A matching person image detection unit for detecting a still image in which a person image matching the person image specified from the telephone book is captured from a plurality of still images stored in the storage unit;
And a display control unit configured to display on the display unit a still image in which a person image that matches the specified person image is detected by the matching person image detection unit.

Images