JP4449939B2 - Mobile communication terminal device and program - Google Patents

Description

  The present invention relates to a portable communication terminal device and a program for storing and managing the address book data for each destination.

In general, when a sales representative attends a business card exchange meeting, a business meeting, etc. in addition to daily sales activities, a large number of business cards are obtained. In such a case, if the information in the business card is registered in the address book such as a mobile phone, the other party's information can be freely viewed at any time, but the information in the business card can be easily stored in the address book such as a mobile phone. Conventionally, a portable terminal with a camera function that can be registered in an address book simply by photographing a business card with a camera is known. In other words, item information such as “name”, “address”, and “mail address” is recognized by analyzing the business card image taken by the camera function, and the recognition result (character code) is registered as address book data. Such a technique is known (see Patent Document 1).
JP 2003-163736 A

 In this prior art, the business card is registered in the address book simply by taking a picture of the business card, so it is easier to enter the card than text input. However, all business cards obtained at business card exchanges, business meetings, etc. If you register in the address book, you will also register business cards for people who will not be associated with you in the future, leading to an enormous increase in the address book. Therefore, it is sufficient to select only the necessary business cards and register them in the address book. However, it is only intuitionally determined which business card is to be registered, and the contents of the address book become disordered.

  An object of the present invention is to be able to register only necessary business cards in a business card image group in an address book and to standardize selection criteria for registration.

The invention described in claim 1 is a portable communication terminal device for storing and managing the address book data for each partner, image storage means for acquiring and storing the business card image, and partner identification information for identifying the communication partner An acquisition means for acquiring a name card image, a selection means for selecting a business card image including partner identification information obtained by the acquisition means from the stored and stored business card image group, and a name card image selected by the selection means. Registration means for registering the item information included in the address book data corresponding to the destination.
Furthermore, a program for realizing the main functions shown in the invention described in claim 1 is provided to the computer (the invention described in claim 9).
Here, “business card image” refers to a captured image that has been taken by the camera and corrected for distortion when a business card or similar medium for self-introduction is received from the other party, and sent from the other party over the network. It means a transmitted image including a name, a telephone number and the like.

The invention described in claim 1 described above may be as follows.
The acquisition unit acquires partner identification information for identifying a communication partner at least during any communication among a call incoming, a mail transmission, a call transmission, and a mail reception (claim 2). invention).

 In a state in which a character code string obtained by character recognition of the partner identification information included in the business card image is stored and managed in association with the business card image, the selection unit displays a character code string corresponding to each business card image. The business card image is selected by referring to it (the invention according to claim 3).

 The registration means determines whether or not there is an unregistered item when registering the item information included in the selected business card image as address book data corresponding to the destination, and if there is an unregistered item, The item data is additionally registered (the invention according to claim 5).

 The registration means determines whether a face image of a person is included in a business card image, and if a face image is included, extracts the face image and a part of the address book data of the destination (Invention of claim 6).

 Prior to registration of the address book data, a message output means for outputting a message asking whether registration is possible is provided, and when receiving a user instruction for registration in response to the message output, the registration means receives the selected business card. Item information in the image is registered as address book data corresponding to the destination (the invention according to claim 7).

The invention according to claim 4 is a portable communication terminal device for storing and managing the address book data for each destination, and storing and managing the image storage means for acquiring and storing the business card image and the communication results for each destination. A communication result storage means for selecting, a selection means for selecting a business card image of the other party whose communication performance is a predetermined value or more from the stored and stored business card image group, and a business card image selected by the selection means Registration means for registering the item information included in the address book data corresponding to the destination.
Furthermore, a program for realizing the main functions shown in the invention described in claim 4 is provided to the computer (the invention described in claim 10).

  According to a fourth aspect of the invention, in addition to the fifth to seventh aspects of the invention described above, the communication performance storage means can store at least one of the number of communication times, the communication frequency, the communication time, and the communication data amount at the other end. You may make it memorize | store and manage as another communication performance (invention of Claim 8).

  According to the present invention, only necessary business cards can be selected from the business card image group and registered in the address book, and the selection criteria for registration can be unified, and the address book is prevented from being enlarged and disordered. It becomes possible.

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a mobile phone device as a mobile communication terminal device, and FIG. 1 is a block diagram showing basic components of the mobile phone device.
This mobile phone device is provided with a business card image management function and an address book management function in addition to a telephone call function, an electronic mail function, an Internet connection function (Web access function), a camera function, and the like. The business card image management function is a function for accumulating and managing business card images, and the address book management function is a function for storing and managing the address book data for each destination.

  The CPU 1 is a central central processing unit that controls the overall operation of the mobile phone device according to various programs in the storage unit 2. In addition to the main CPU 1, the mobile phone device includes, for example, video A structure having a plurality of sub CPUs (not shown) for each function such as a sound data transmission / reception function and a received video recording / playback function. The storage unit 2 is a non-volatile memory (internal memory), and is configured by, for example, a flash memory, and has a program area and a data area. In the program area, operations shown in FIGS. A program for realizing the present embodiment is stored according to the procedure, and a character recognition dictionary (not shown) and the like are stored in the data area.

  The recording medium 3 is a removable portable memory that supplies image data, various types of data, and programs to the outside. The recording medium 3 includes, for example, smart media and an IC card. The memory 4 is an internal memory having a work area, and is composed of, for example, DRAM, SDRAM (Synchronous DRAM) or the like. The memory 4 is provided with an image storage unit 21, an address book storage unit 22, a communication history storage unit 23, and the like which will be described later. Various data in the memory 4 are saved in the storage unit 2 as necessary. The

  The telephone communication unit 5 constitutes a mobile phone communication function. After the signal is received from the receiving side of the transmission / reception unit (baseband unit) connected to the antenna 5A and demodulated into a reception baseband signal, the acoustic control unit 6, the voice is output from the reception speaker 7. In addition, the telephone communication unit 5 takes in the voice data input from the transmission microphone 8 from the acoustic control unit 6, encodes it into a transmission baseband signal, gives it to the transmission side of the transmission / reception unit, and outputs the transmission from the antenna 5 </ b> A. Let On the other hand, the display data received and acquired via the telephone communication unit 5 by the mail transmission / reception function and the Web access function is given to the main display unit 10 having an LCD (liquid crystal display device) or the like via the display control unit 9 for display. Is output.

  The main display unit 10 displays character information, TV video data, various messages, and the like with high quality, and the sub display unit 11 provided on the back side of the apparatus main body displays the current date and time, simple messages, icons, and the like. To do. The key operation unit 12 performs dial input, character input, command input, and the like. The CPU 1 executes processing according to a key input signal from the key operation unit 12. The notification unit 13 includes a speaker for notification of incoming call notification, an LED (light emitting diode), and a vibration motor. The notification unit 13 is driven when an incoming call / mail is received, and is also driven when an alarm is notified.

The camera imaging unit 14 can shoot moving images in addition to still images. In addition to a photographing lens, a mirror / lens block such as a mirror, an imaging device, and a driving system thereof, a distance measuring sensor, a light amount sensor, an analog processing circuit A signal processing circuit, a compression / decompression circuit, and the like for adjusting and controlling the optical zoom and controlling drive control, shutter drive control, exposure, white balance, and the like during autofocus. Here, when the user receives a business card or similar medium for self-introduction from the other party, the user activates the camera imaging unit 14 and takes a picture of the business card. In this case, the CPU 1 controls the camera imaging unit 14 to automatically adjust the zoom magnification, focus, and the like so that the business card can be photographed in an optimal state, and has a rectangular distortion with respect to the business card image acquired from the camera imaging unit 14. Corrections, etc. are made and size changes are made.
The RTC (real time clock module) 15 constitutes a clock unit, and the CPU 1 acquires the current date and time from the RTC 15.

FIG. 2 is a diagram showing the contents of the image storage unit 21.
In addition to the business card folder 21A for accumulating and storing business card images, the image storage unit 21 is provided with a face photo folder 21B for accumulating and storing human face images extracted from the business card images and the like. The business card folder 21A has items of “telephone number” and “mail address” in addition to “image ID”, “file name”, and “actual data” for each business card image. ”,“ File name ”, and“ actual data ”.

 “Image ID” is a serial number for identifying a business card image, “File name” is the name of an image file, and “Real data” is an image file. “Telephone number” and “mail address” are information obtained by analyzing the business card image. When the CPU 1 acquires the business card image taken by the camera, the “image ID” and “file name” are obtained. In addition, the character information is extracted from the item area (telephone number area, mail address area) in the business card image, character recognition is performed, and the recognition result (character string code) is used as the telephone number and mail address for the business card folder 21A. It is set to.

FIG. 3 is a diagram showing the contents of the address book storage unit 22.
The address book storage unit 22 stores and manages the address book data for each communication partner. Each record includes “ID”, “name”, “read”, “phone number”, “mail address”, “address”. ”And“ Face Image ”. Address book data (address book record) is arbitrarily set based on data input from the key operation unit 12 or data supplied from the recording medium 3 or the like, or by analyzing a business card image as described above. It is automatically set. The “image ID” read from the face photo folder 21B is set in “face image”.

 Here, when the address book data is automatically set from the business card image, the CPU 1 designates this communication partner at the time of communication with the other party (call transmission / mail transmission) or communication from the other party (call incoming / mail reception). The identification information (telephone number / email address) to be identified is acquired, and the address book storage unit 22 is searched based on the identification information to determine whether the identification information is registered. Referring to the communication result with this partner (to be described later), if the number of communications is equal to or greater than the predetermined number of times, a business card image including the partner identification information is selected from the business card image group and included in this business card image Item information is registered as address book data corresponding to the destination.

 In this case, the item area of “phone number”, “email address”, “name”, “address” is specified from the selected business card image, and character information is extracted from each item to recognize the character. A new address book record with column code as the corresponding item data is generated. At that time, if a face photo is included in the business card, an item of “face image” is added to the generated record. . Further, even if the other party identification information (telephone number / email address) acquired at the time of communication is already registered in the address book storage unit 22, it is determined whether there is an unregistered item in the address book data. If there is, the corresponding item data obtained from the business card image is additionally registered in the unregistered item.

FIG. 4 is a diagram showing the contents of the communication history storage unit 23.
The communication history storage unit 23 stores and manages, as a communication record, the number of times of communication updated each time a call is made / mailed or a call is received / received by the same party. Each record is recorded as “phone number” or “ Corresponding to the “mail address”, there is an item of “number of calls” or “number of mails” which is the result data. In other words, the result record has an item “number of calls” corresponding to “telephone number” and an item “number of mails” corresponding to “mail address”. “Number of calls” is a count value that is updated each time a call is made / received with the same party, and “Number of mails” is a count that is updated each time a mail is sent / received with the same party. Value.

 The CPU 1 refers to the communication performance (number of calls / number of mails) with the other party during communication, and determines whether the number of calls / number of mails is equal to or greater than a predetermined number (reference value). In this embodiment, the reference value for the number of calls is 3 times or more and the reference value for the number of mails is 3 or more. However, these default values can be arbitrarily changed by a user operation. Further, when the number of calls or the number of mails exceeds the reference value, the CPU 1 selects a business card image including “telephone number” / “mail address” from the business card image group and includes it in the business card image. The registered item information is registered in the address book storage unit 22 as data corresponding to the destination.

  Next, the operation concept of the mobile phone device in this embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. It is also possible to sequentially execute the operation according to the program code transmitted through the transmission medium. In other words, in addition to the recording medium, an operation peculiar to this embodiment can be executed by using a program / data supplied externally via a transmission medium.

FIG. 5 is a flowchart showing the overall operation of the mobile phone device that is started to be executed when the power is turned on.
First, in a standby state for receiving a call or receiving a mail while displaying an image for standby (step A1), the CPU 1 is instructed by a user operation to start taking a business card (YES in step A2). 14 is activated, and the zoom magnification, focus, etc. are automatically adjusted so that the business card can be photographed in an optimal state without strict manual adjustment of the zoom magnification, focus, etc. When business card photography is performed in this state (step A3), the CPU 1 performs business card image storage processing for acquiring a business card image from the camera imaging unit 14 and storing it in the business card folder 21A (step A4).

 Further, in the standby state, the CPU 1 starts a call outgoing call process (step A6) when it is instructed by the user operation to start a call outgoing call (step A5), and detects an incoming call (YES at step A7). Then, the incoming call process is started (step A8). On the other hand, in the standby state, when the start of mail transmission is instructed by a user operation (YES in step A9), the CPU 1 starts mail transmission processing (step A10) and detects mail reception (YES in step A11). The mail reception process is started (step A12). And it returns to step A1 and will be in a standby state again. In response to a power OFF operation (step A13), a power OFF process is performed (step A14), and this flow ends.

FIG. 6 is a flowchart for explaining the business card image storing process (step A4 in FIG. 5) in detail.
First, the CPU 1 performs a rectangular distortion correction or the like on the business card image acquired from the camera imaging unit 14 or executes a process of converting the business card image into a common size (step B1), and then analyzes the business card image to analyze the business card image. Each item area (telephone number area, mail address area) in the business card is specified (step B2). Then, character information is extracted from each item area (step B3), and character recognition is performed for each item to convert it into a character string code (phone number, mail address) (step B4).

 In this case, in order to avoid duplicate storage of the same information, the business card folder 21A is searched based on this character string code (phone number, mail address) to check whether the same phone number and mail address are stored (step B5) If the data has been saved, the flow exits from this flow, but if not saved, a business card image file is generated (step B6), and the character string code (phone number, mail address) is entered together with this image file in the business card folder 21A. (Step B7). Thus, when a business card is photographed and the business card image is stored, the telephone number and mail address in the business card are stored together with the business card image.

FIG. 7 is a flowchart for explaining in detail the call transmission process (step A6 in FIG. 5).
When the user selects and designates the other party's telephone number from the address book storage unit 22 or inputs and designates it from the key operation unit 12 (step C1), a call to the other party's telephone number is made (step C2), and When the connection is established, call processing is performed in response thereto (step C3). In this state, when the end of the call is detected (step C4), it is checked whether or not this partner telephone number has already been set in the communication history storage unit 23 (step C5).

 If the other party telephone number is not set in the communication history storage unit 23 (NO in step C5), that is, if it is the first call with the other party, a result record including the other party telephone number is generated and the “number of calls” Is set to the initial value “1” and newly added to the communication history storage unit 23 (step C6). If the current telephone number is already set (YES in step C5), that telephone number is included. After adding “1” to “number of calls” in the record and updating the value (step C7), this updated value (number of calls) is read (step C8), and it is determined whether the number of calls is three or more. (Step C9).

 Here, if the number of calls is 3 or more (YES in step C9), it is determined whether or not the other party's telephone number is unregistered in the address book storage unit 22 (step C10), and will be described later on condition that it is not registered. The process proceeds to execution of image selection processing (step C11) and address book registration processing (step C12). If the other party telephone number is not set in the communication history storage unit 23 (NO in step C5), if the number of calls is less than three (NO in step C9), the other party telephone number is registered in the address book storage unit 22. If it has been completed (NO in step C10), the process leaves this flow, and the image selection process (step C11) and the address book registration process (step C12) are skipped.

FIG. 8 is a flowchart for explaining in detail the incoming call processing (step A8 in FIG. 5).
First, the CPU 1 drives the notification unit 13 to notify the incoming call (step D1), and when a connection with the other party is established, the CPU 1 performs a call process in response thereto (step D2). In this state, when the end of the call is detected (step D3), it is checked whether or not this partner telephone number has been set in the communication history storage unit 23 (step D4). A record is generated, the initial value “1” is set in the “number of calls”, and the record is newly added to the communication history storage unit 23 (step D5).

 If the current partner telephone number has been set (YES in step D4), “1” is added to “number of calls” in the record of records that includes the partner telephone number, and the value is updated (step D6). Then, this updated value (number of calls) is read (step D7), and it is determined whether the number of calls is 3 or more (step D8). If it is 3 or more, the current telephone number is stored in the address book storage unit 22. It is discriminated whether it is unregistered (step D9), and on the condition of unregistered, an image selection process (step D10), which will be described later, is executed, and an address book registration process is executed (step D11).

FIG. 9 is a flowchart for explaining the mail transmission process (step A10 in FIG. 5) in detail.
When the user selects and designates the other party's e-mail address from the address book storage unit 22 or inputs and designates it from the key operation unit 12 (step E1), and inputs and creates the e-mail body (step E2), the created e-mail is the other party's e-mail. It is transmitted to the address (step E3).

 When the end of mail transmission is detected (step E4), it is checked whether or not the current partner mail address is already set in the communication history storage unit 23 (step E5). Is generated and is added to the communication history storage unit 23 by setting the initial value “1” in the “number of mails” (step E6), but if the current partner mail address is already set (YES in step E4) ) After adding “1” to the “number of emails” in the record of records including the partner email address and updating the value (step E7), the updated value (number of emails) is read (step E8), and the number of emails Is determined three times or more (step E9).

 If the number of mails is 3 or more, it is determined whether or not the current mail address is unregistered in the address book storage unit 22 (step E10). ), The process proceeds to the execution of the address book registration process (step E12). If the other party mail address is not set in the communication history storage unit 23 (NO in step E5), and the number of mails is less than three (NO in step E9), the other party mail address is registered in the address book storage unit 22. If it has been completed (NO in step E10), the process goes out of this flow, and the image selection process (step E11) and the address book registration process (step E12) are skipped.

FIG. 10 is a flowchart for explaining the mail reception process (step A12 in FIG. 5) in detail.
First, the CPU 1 drives the notification unit 13 to notify the incoming call (step F1), receives the partner mail and stores it in a mail box (not shown) (step F2), and detects the end of reception (step F2) (step F2). In step F3), it is checked whether or not this partner mail address has been set in the communication history storage unit 23 (step F4). If it has not been set, an actual record including the partner mail address is generated and the “number of mails” is set. The initial value “1” is set and newly added to the communication history storage unit 23 (step F5).

 If the other party's mail address has been set (YES in step F4), "1" is added to "number of calls" in the record of performance that includes the other party's mail address and the value is updated (step F6). Then, the update value (number of mails) is read (step F7), and it is determined whether the number of mails is 3 times or more (step F8). Is determined (step F9), and on the condition that it is not registered, an image selection process (step F10), which will be described later, is executed, and an address book registration process is executed (step F11).

FIG. 11 is a flowchart for explaining in detail the image selection process executed in the above-described call transmission process, call reception process image, mail transmission process, and mail reception process.
First, the CPU 1 searches the business card folder 21A based on the current partner telephone number / mail address (step G1), and the partner telephone number / mail address corresponding to the character string code recognized when the business card image is saved. (Step G2), if there is no match, in other words, if the corresponding business card image is not saved, the flow exits from this flow, but if there is a corresponding phone number / mail address (YES in step G2), the corresponding business card image is selected from the business card image group in the business card folder 21A (step G3).

 Then, by analyzing the selected business card image, each item area (telephone number area, mail address area, name area, address area) in the business card is specified and character information is extracted from each item area (step G4). ), Character recognition is performed for each item and converted into a character string code (telephone number, mail address, name, address) (step G5). Note that “phone number” and “email address” are recognized when the business card image is saved, so only “name” and “address” items other than “phone number” and “email address” are recognized. You may do it. Here, by analyzing the business card image, it is checked whether or not “face photo” is included in the business card (step G6). If “face photo” is included, this image portion is extracted (step G7). The “face photo” is registered in the face photo folder 21B together with the “image ID” (step G8).

FIG. 12 is a flowchart for explaining in detail the address book registration process executed in the above-described call origination process, call incoming process image, mail transmission process, and mail reception process.
First, the CPU 1 checks whether or not a business card image has been selected by the image selection processing of FIG. 11 (step H1). If there is no image selection, the flow goes away from the flow of FIG. 12 at this point, but if there is an image selection, The address book storage unit 22 is searched based on the current partner telephone number / mail address (step H2), and whether or not a record including the partner telephone number / mail address is registered is checked (step H3).

 Here, if there is a corresponding record, check whether there is an unregistered item for which no data is registered in the items of "phone number", "email address", "name", "address" in the record If there are no unregistered items (step H4), the flow of FIG. 12 is exited at this point, but if there is no corresponding record (NO in step H3) or there is a corresponding record, there is at least one unregistered item. In this case (YES in step H4), the character string codes “phone number”, “mail address”, “name” obtained by the character recognition in the image selection process in FIG. 11 and the business card storage process in FIG. “Address” is read (step H5), and an address book data input screen is displayed and output together with the address book registration confirmation screen (step H6).

FIG. 13A is a diagram showing an address book registration confirmation screen and an address book data input screen for confirming whether item data obtained from a business card image is registered in the address book.
This address book registration confirmation screen displays and outputs a confirmation message asking whether or not to register in the address book the party that made the call this time (the party that received this time, the party that sent this mail, or the person who received this mail) In this confirmation image, “Yes” and “No” buttons (touch keys) are arranged and displayed. The address book data entry screen displays the above character recognition results corresponding to "phone number", "mail address", "name", and "address". The “Yes” button is operated, and the “No” button is operated when registration is not desired.

 If the “No” button is operated (NO in Step H7), the flow is exited, but if the “Yes” button operation (registration operation) is performed (YES in Step H7), the address The item data in the book data input screen is registered in the address book storage unit 22 (step H8). In this case, when it is determined in step H3 that there is no corresponding record, a new record is generated from each item data in the input screen and newly registered in the address book storage unit 22, but there is a corresponding record. When it is determined in step H4 that there is an unregistered item, data corresponding to the unregistered item is read from the input screen, and supplementary registration is performed on the corresponding item (unregistered item) in the address book storage unit 22.

 After performing such address book registration, it is checked whether or not a face photograph has been extracted by the image selection process of FIG. 11 (step H9). If no face photograph has been extracted, the flow of FIG. However, if there is a face photograph, a confirmation screen for confirming whether the face photograph is registered in the address book is displayed and output (step H10). FIG. 13B shows an address book registration confirmation screen for confirming whether or not a face photo extracted from a business card image is to be registered in the address book. In this confirmation screen, a confirmation message for inquiring whether or not to register a face photo. Is displayed. Here, when the “No” button is operated (NO in Step H11), the flow is exited. However, when the “Yes” button operation (registration operation) is performed (YES in Step H11), The “image ID” corresponding to the “face photo” is read from the face image folder 21B, and this “image ID” is registered in the corresponding item in the address book storage unit 22 (step H12).

 As described above, in this embodiment, in the state where the business card image is stored and managed in the business card folder 21A, the CPU 1 executes the call identification / mail transmission or the call incoming / mail reception whenever the caller identification information (phone number) is received. / Mail address), and a business card image including the telephone number / mail address is selected from the business card folder 21A, and item information included in the selected business card image is stored in the address book storage unit 22 Therefore, only necessary business cards can be selected from the business card image group and registered in the address book, and the selection criteria for registration can be unified. In other words, the fact that a call is made / mailed or a call is received / received is likely to occur in the future, so the address book data can be registered based on the business card image of the other party. it can. Therefore, it is possible to avoid unnecessary registration and disorderly registration, and to select and register only necessary business cards, and it is possible to prevent the address book from becoming enormous and disordered.

 In this case, when the business card image is saved, the character information is converted from the business card image into the character string code from the telephone number and mail address item areas and stored in the business card folder 21A. Each time a mail is sent or a call is received / received, a character string code (telephone number / email address) in the business card folder 21A can be searched based on the telephone number / email address to select a corresponding business card image. Quick selection of business card images becomes possible.

 If the number of business card images stored and managed is small, each time communication with the other party is performed, character recognition is performed while sequentially specifying the business card image, and the business card image including the telephone number / mail address used in this communication is obtained. However, when storing a business card image as in this embodiment, if a character number is recognized to obtain a telephone number and an e-mail address in advance, the image can be selected while performing character recognition. The selection can be made faster than the method of performing the above. This is particularly effective when a large number of business card images are stored and managed.

 When registering the address book data, the CPU 1 discriminates whether or not there is an unregistered item. If there is an unregistered item, the item data is supplementally registered, so that a part of the address book data is missing. Can be supplemented, and address book data can be enhanced. In addition, it is determined whether a face image of a person is included in a business card image, and if a face image is included, that portion is extracted and registered as a part of address book data. Further enhancement of data is possible. In addition, prior to registering address book data, a confirmation screen for inquiring whether registration is possible is displayed and output, and when addressable user instructions are received, address book data is registered so that the user's intention is reflected. Can be made.

 On the other hand, in a state in which “number of calls” / “number of mails” updated each time a call is made with the same partner is stored and managed in the communication history storage unit 23 as a communication result, the CPU 1 makes a call transmission / mail transmission or a call When receiving / mail receiving, the partner identification information (telephone number / mail address) is obtained, and when the communication result “number of calls” / “number of mails” of the telephone number / mail address is a predetermined value or more, Since the business card image of the partner is selected and the address book data is registered, it is possible to determine whether or not a future association will occur in consideration of the communication performance with the partner. Therefore, the address book data registration can be put on hold in the case of a partner who receives mail only once or who makes a call once, and in the case of a partner who exchanges mail / calls many times. Since there is a high possibility that an association will occur in the future, address book data can be registered at that time.

 In the above-described embodiment, the image selection process of FIG. 11 and the address book registration process of FIG. 12 are executed immediately after the end of call transmission / incoming or immediately after the end of mail transmission / reception. The execution timing is not limited thereto, and may be, for example, before voice transmission, during a voice call, before mail transmission, during mail transmission, during mail reception, or the like. Further, the image selection process and the address book registration process may be periodically executed by batch processing such as once a day, or may be executed separately in time.

 Business cards that are subject to camera photography are not limited to printed materials, and may be similar media. Items in the business cards include "phone number", "email address", "name", and "address". In addition, “FAX number”, “URL”, and the like may be included. The items in the business card are arbitrary, but at least “telephone number” or “mail address” may be recorded in addition to “name”. Further, the business card image is not limited to the one taken by the camera, but may be a business card image transmitted from the other party, or may be a business card image supplied externally via the recording medium 3.

  In the above-described embodiment, the address book record including the “telephone number” / “mail address” used in this communication is registered (YES in step H3 in FIG. 12), and there is no unregistered item. (NO in step H4), the registration process in the address book is skipped, but “phone number”, “mail address”, “name”, “address” in this address book record, and in the business card image "Phone number", "e-mail address", "name", "address" obtained by recognizing the characters are sequentially compared for each item to determine whether the item data matches or does not match. May exist, the content of the corresponding item in the address book record may be changed to the corresponding item data of the character recognition result after receiving confirmation from the user. In other words, based on the latest data obtained from the business card image, it is checked whether the other party's “address”, “mail address”, “phone number”, etc. have been changed. The item data before change (old data) may be rewritten with new item data (new data). In this case, it is possible to select in advance whether rewriting or automatic rewriting is performed after receiving confirmation from the user.

  In the above-described embodiment, when there is an unregistered item in the address book record, supplementary registration is performed for the unregistered item. However, all items in the address book record are updated with the latest data. You may make it rewrite to. In other words, if an address book record that includes the “telephone number” / “email address” used in the current communication is registered, the contents of the address book record of the other party are updated to the latest data each time communication is performed with that party. You may make it rewrite.

  Further, before registering the address book data, the editing process may be executed so that the user can arbitrarily modify the item data to be registered. In this case, a button for instructing “edit” is arranged on the address book registration confirmation screen shown in FIG. 13A, and when this “edit” button is operated, any address in the address book data input screen is displayed. If an item is designated as an editing target and the item data can be corrected, erroneous recognition data generated during character recognition can be corrected.

  In the above-described embodiment, “the number of calls” and “the number of mails” are stored in the communication history storage unit 23 as communication results, but not limited to the number of communication, for example, “communication frequency”, “communication time”. Any of “communication data amount” may be stored and managed as a communication record. Further, a combination of two or more of “the number of communication”, “communication frequency”, “communication time”, and “communication data amount” may be used as the communication performance. For example, a logical product condition of “number of times of communication” and “communication time” may be used as a communication result, or the total number of calls may be three or more and the total time of calls may be 15 minutes or more.

  In the above-described embodiment, the method for specifying the item area in the business card image is not particularly mentioned. However, while analyzing the business card image, the location where the data is collected is specified as the item area and the item area is specified. If the item type is identified by recognizing the positional relationship of the area and the character type in the item area, and the "phone number", "mail address", "name", and "address" are specified, the form will be different It can be used for various business cards.

  Corresponding to the business card image, the “saved date” when the image is saved and the “registered flag” indicating that the item data obtained by analyzing the business card image is already registered in the address book are stored in the business card folder The CPU 1 refers to the “save date and time” and “registered flag” for each business card image, and if the CPU 1 is not registered in the address book after a certain period (for example, half a year or more) The business card image may be deleted from the business card folder 21A after receiving confirmation from the user.

Further, for example, a business card folder and an address book may be provided for each classification such as a business card folder and an address book for business use and a business card folder and an address book for private use.
In addition, the present invention is not limited to a mobile phone device, and can be similarly applied to, for example, a mobile communication terminal device such as a PDA, an electronic camera, an electronic watch, and a music player having a business card image management function and an address book management function. .

The block diagram which showed the basic component of the mobile telephone apparatus applied as a mobile communication terminal device. The figure which showed the content of the image storage part. The figure which showed the content of the address book storage part 22. FIG. The figure which showed the content of the communication history storage part. The flowchart which showed the whole operation | movement of the mobile telephone apparatus started execution with power activation. 6 is a flowchart for explaining in detail a business card image storage process (step A4 in FIG. 5). 6 is a flowchart for explaining in detail a call transmission process (step A6 in FIG. 5). 6 is a flowchart for explaining in detail the incoming call processing (step A8 in FIG. 5). 6 is a flowchart for explaining mail transmission processing (step A10 in FIG. 5) in detail. 6 is a flowchart for explaining in detail mail reception processing (step A12 in FIG. 5). The flowchart for explaining in detail the image selection process performed in the above-mentioned call transmission process, call incoming process image, mail transmission process, and mail reception process. The flowchart for explaining in detail the address book registration process performed in the above-mentioned call transmission process, call incoming process image, mail transmission process, and mail reception process. (A) is a diagram showing a confirmation screen for confirming whether item data obtained from a business card image is registered in the address book and an address book data input screen, and (B) is an address for a face photograph extracted from the business card image. The figure which showed the confirmation screen which confirms whether it registers into a book.

Explanation of symbols

1 CPU
2 storage unit 5 telephone communication unit 10, 11 display unit 12 key operation unit 13 notification unit 14 camera imaging unit 21 image storage unit 21A business card folder 21B face image folder 22 address book storage unit 23 communication history storage unit

Claims (10)

A mobile communication terminal device for storing and managing the address book data for each destination,
Image storage means for acquiring and storing a business card image;
Acquisition means for acquiring partner identification information for identifying a communication partner;
Selecting means for selecting a business card image including partner identification information obtained by the acquiring means from the stored and stored business card image group;
Registration means for registering item information included in the business card image selected by the selection means as address book data corresponding to the destination;
A mobile communication terminal device comprising: The acquisition means acquires partner identification information for identifying a communication partner at least at the time of communication among a call incoming, a mail transmission, a call outgoing, and a mail reception;
2. The mobile communication terminal device according to claim 1, wherein the mobile communication terminal device is configured as described above. In a state in which a character code string obtained by character recognition of the partner identification information included in the business card image is stored and managed in association with the business card image, the selection unit displays a character code string corresponding to each business card image. Select a business card image by browsing,
2. The mobile communication terminal device according to claim 1, wherein the mobile communication terminal device is configured as described above. A mobile communication terminal device for storing and managing the address book data for each destination,
Image storage means for acquiring and storing a business card image;
A communication record storage means for storing and managing the communication record for each destination;
A selection means for selecting a business card image of a partner whose communication performance is a predetermined value or more from the stored and stored business card image group;
Registration means for registering item information included in the business card image selected by the selection means as address book data corresponding to the destination;
A mobile communication terminal device comprising: The registration means determines whether or not there is an unregistered item when registering the item information included in the selected business card image as address book data corresponding to the destination, and if there is an unregistered item, Register the item data additionally,
5. The mobile communication terminal device according to claim 1, wherein the mobile communication terminal device is configured as described above. The registration means determines whether a face image of a person is included in a business card image, and if a face image is included, extracts the face image and a part of the address book data of the destination Register as,
5. The mobile communication terminal device according to claim 1, wherein the mobile communication terminal device is configured as described above. Prior to registration of address book data, a message output means for outputting a message asking whether registration is possible is provided,
When receiving a user instruction that can be registered in response to the message output, the registration unit registers the item information in the selected business card image as address book data corresponding to the destination,
5. The mobile communication terminal device according to claim 1, wherein the mobile communication terminal device is configured as described above. The communication performance storage means stores and manages at least one of the number of communication times, communication frequency, communication time, and communication data amount as a communication performance by destination.
The mobile communication terminal device according to claim 4, which is configured as described above. Against the computer,
A function of acquiring partner identification information for identifying a communication partner;
A function of selecting a business card image including the acquired partner identification information from the business card image group stored and stored;
A function of registering item information included in the selected business card image as address book data corresponding to the destination;
A program to realize Against the computer,
A function for storing and managing the communication results for each destination,
A function of selecting a business card image of the other party whose communication performance is equal to or greater than a predetermined value from a group of business card images stored and stored;
A function of registering item information included in the selected business card image as address book data corresponding to the destination;
A program to realize

Images