JP2004343354A - Mobile communication apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a mobile communication apparatus capable of easily registering telephone directory data in a short time. <P>SOLUTION: An imaging section 3 of a mobile phone 1 images an image displayed on a display section 10 of another mobile phone 20 and an image processing section 4 extracts a character string in the imaged image. A character code conversion section 5 converts the character string extracted by the image processing section 4 into character code data. A data classification section 6 classifies the character code data by each prescribed item to generate classification data. The mobile phone 1 stores the generated classification data to a telephone directory data storage section 11 as telephone directory data 22 and transmits / receives a call on the basis of the telephone directory data 22. Thereby the user of the mobile phone 1 needs not to manually enter the telephone directory data 22 to the mobile phone 1 and can easily register the telephone directory data 22 in a short time. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a mobile communication device including an imaging unit that captures an image, such as a so-called camera-equipped mobile phone.
[0002]
[Prior art]
Conventionally, when managing business cards, since the management becomes complicated as the number of business cards increases, character data described variously on business cards, such as organization, title, first name, last name, address and telephone number, The user manually inputs the information to the computer using a keyboard and stores the data.
[0003]
In recent years, the use of mobile phones is not limited to telephone calls, but is expanding to various uses such as electronic telephone directories and schedule books, transmission and reception of e-mails, and Internet connection. When storing telephone directory data such as first and last name, telephone number, and e-mail address of an e-mail in a telephone directory (hereinafter sometimes referred to as “electronic telephone directory”), a user manually performs an input operation using an operation key. It is carried out.
[0004]
However, as the number of items of character data to be input to the computer and telephone directory data to be input to the mobile phone increases, the operation of inputting data becomes more complicated and burdens the user. For this reason, technology for reducing the input load of the user is being developed.
[0005]
According to the first conventional technique, character data described on a business card, for example, organization, title, first and last name, address and telephone number are read by a scanner, and a database is created and stored based on the read character data (for example, Patent Document 1).
[0006]
In a second prior art, in a mobile phone provided with a character reading unit and a character recognizing unit, a user traces a character of a telephone number written on a paper such as a telephone directory by using a character reading unit to thereby obtain a character. The reading unit reads the telephone number as a character shape image. The read character shape image is converted into a character code by a character recognition unit, and the telephone number recognized based on the character code is stored in a memory (for example, see Patent Document 2).
[0007]
According to a third related art, in a mobile phone having a camera function, a paper medium such as a telephone directory in which a telephone number is described is imaged by a camera, and information of the imaged image is displayed on a display unit of the mobile phone. When the image information of the telephone number is selected by the user from the displayed image information, the selected image information is converted into character information and stored in a memory (for example, see Patent Document 3).
[0008]
[Patent Document 1]
JP-A-59-47641
[Patent Document 2]
JP-A-6-303298
[Patent Document 3]
JP 2001-177622 A
[0009]
[Problems to be solved by the invention]
In the second and third prior arts described above, the operation of registering the telephone number in the electronic telephone directory of the mobile phone is simplified by reading the character information of the telephone number on paper and performing character recognition. However, the above-described second and third prior arts read a plurality of telephone directory data, for example, character information such as a telephone number, a first name and a last name, and an e-mail address of an e-mail at a time, and perform character recognition, thereby performing the character recognition. It is not configured to register phonebook data in the electronic phonebook of the mobile phone. Therefore, when registering a plurality of telephone directory data in the electronic telephone directory of the mobile phone in the second and third prior arts, it is necessary to individually read each character information of each telephone directory data and perform character recognition. There is a problem that registration of telephone directory data is very troublesome and takes a lot of time.
[0010]
An object of the present invention is to provide a portable communication device that can register telephone directory data quickly and easily.
[0011]
[Means for Solving the Problems]
The present invention provides an imaging unit that captures an image,
An image processing unit that extracts a character string from an image captured by the imaging unit;
A character code conversion unit that converts the character string extracted by the image processing unit into character code data,
A data classification unit that generates classification data in which the character code data is classified for each predetermined item,
A telephone directory data storage unit that stores the classification data generated by the data classification unit as telephone directory data,
A communication unit capable of making and receiving calls based on the phonebook data stored in the phonebook data storage unit;
A portable communication device comprising: a display unit for selectively displaying the image-related data from the imaging unit, the telephone directory data storage unit, and the communication unit.
[0012]
According to the present invention, a character string in an image captured by the imaging unit is extracted by the image processing unit. The character string extracted by the image processing unit is converted into character code data by a character code conversion unit. The character code data is classified by the data classification unit for each predetermined item, and classified data is generated. The portable communication device stores the classification data as telephone directory data in a telephone directory data storage unit, and performs outgoing and incoming calls based on the telephone directory data.
[0013]
As a result, it is not necessary for the user to manually input the telephone directory data to the portable communication device by key operation or the like, so that the user's trouble of inputting can be saved and erroneous input of the telephone directory data can be prevented. Further, even when there are a plurality of character strings in the image captured by the imaging unit, the portable communication device of the present invention performs the character recognition processing on all the character strings in the image at once, and performs the character recognition processing. The plurality of character strings obtained can be stored in the telephone directory data storage unit as telephone directory data.
[0014]
As a result, even when the number of pieces of telephone directory data stored in the telephone directory data storage unit is large, it is possible to easily register the telephone directory data in a relatively short time. Therefore, the portable communication device of the present invention is more convenient than the conventional portable communication device.
[0015]
The present invention also provides a Japanese dictionary database for identifying kanji, hiragana and katakana,
And a Japanese font database for identifying a plurality of fonts.
[0016]
According to the present invention, since the portable communication device is configured to include the Japanese dictionary database for identifying kanji, hiragana and katakana, the character type included in the character string extracted by the image processing unit, for example, kanji , Hiragana and katakana are accurately identified based on the Japanese dictionary database, so that the extracted character string can be converted into accurate character code data. In addition, since the mobile communication device is configured to include a Japanese font database, fonts of character strings extracted by the image processing unit, such as Mincho, Gothic, and line font, are based on the Japanese font database. Thus, the extracted character string can be converted into accurate character code data.
[0017]
Further, according to the present invention, the image processing unit determines that a character string displayed in a predetermined display area of the display unit among the extracted character strings is telephone number identification information, and stores the character string in the telephone directory data storage unit. It is characterized by making it.
[0018]
According to the present invention, the character string displayed in the predetermined display area of the display unit among the character strings extracted by the image processing unit is determined to be telephone number identification information for identifying a telephone number, for example, first name and last name. Then, it is stored in the telephone directory data storage unit. As a result, there is no need for the user to input the telephone number identification information, so that the user is not required to input the telephone number identification information, and erroneous input of the telephone number identification information is prevented. Therefore, the convenience of the portable communication device of the present invention is improved.
[0019]
Further, according to the present invention, when the character string displayed in the predetermined display area of the display unit among the extracted character strings is a character string of only half-width katakana characters, the image processing unit reads the character string and reads the character string. And storing the result in the telephone directory data storage unit.
[0020]
According to the present invention, when the character string displayed in the predetermined display area of the display unit among the character strings extracted by the image processing unit is a character string of only one-byte katakana, the character string is a reading kana. It is determined and stored in the telephone directory data storage unit. As a result, it is not necessary for the user to input the reading kana, so that the user's trouble of inputting can be saved, and erroneous input of the reading kana can be prevented. Therefore, the convenience of the portable communication device of the present invention is improved.
[0021]
Also, in the present invention, the image processing unit may be configured such that, among the extracted character strings, a character string displayed in a predetermined display area of the display unit is a continuous number starting from zero, and the continuous number includes an alphabetic character. If not, the character string is determined to be a telephone number and stored in the telephone directory data storage unit.
[0022]
According to the present invention, of the character strings extracted by the image processing unit, a character string displayed in a predetermined display area of the display unit is a continuous number starting from zero, and the continuous number includes an alphabetic character. If not, the character string is determined to be a telephone number and stored in the telephone directory data storage. As a result, it is not necessary for the user to input a telephone number, so that the user can save time and effort to input and prevent erroneous input of a telephone number. Therefore, the convenience of the portable communication device of the present invention is improved.
[0023]
Also, in the present invention, the image processing unit includes a case where a character string displayed in a predetermined display area of the display unit among the extracted character strings starts with a half-width alphabetic character or includes a predetermined symbol in the character string. In this case, the character string is determined to be a mail address of an electronic mail, and is stored in the telephone directory data storage unit.
[0024]
According to the present invention, when the character string displayed in the predetermined display area of the display unit among the character strings extracted by the image processing unit starts with a half-width alphabet, or when the character string includes a predetermined symbol The character string is determined to be a mail address of an electronic mail, and is stored in the telephone directory data storage unit. As a result, since the user does not need to input the e-mail address of the e-mail, the trouble of the user's input can be omitted, and erroneous input of the e-mail e-mail address can be prevented. Therefore, the convenience of the portable communication device of the present invention is improved.
[0025]
Further, in the present invention, the image processing unit may include a second character string following the character string based on a character string displayed in a predetermined display area of the display unit among the extracted character strings. , A telephone number or an e-mail address of an e-mail, and store it in the telephone directory data storage unit.
[0026]
According to the present invention, based on a character string displayed in a predetermined display area of the display unit among the character strings extracted by the image processing unit, a second character string following the character string is a first name, a pseudonym, It is determined which of the telephone number and the mail address of the e-mail is stored in the telephone directory data storage unit. As a result, the user does not need to input the first and last name, the reading pseudonym, the telephone number and the e-mail address, so that the user is not required to input the first name, the reading pseudonym, the telephone number and the e-mail address. Input can be prevented. Therefore, the convenience of the portable communication device of the present invention is improved.
[0027]
Further, the invention is characterized in that the telephone directory data storage section can store a plurality of telephone numbers and a plurality of e-mail addresses.
[0028]
According to the present invention, a plurality of telephone numbers and a plurality of e-mail addresses can be stored in the telephone directory data storage unit. The user simply selects the telephone number of the person to call or the mail address of the person to whom the e-mail is to be sent from a plurality of telephone numbers and a plurality of e-mail addresses stored in the telephone directory data storage unit. Thus, it is possible to easily send a call to the telephone number or send an e-mail to the mail address. Therefore, the convenience of the portable communication device of the present invention is improved.
[0029]
BEST MODE FOR CARRYING OUT THE INVENTION
FIG. 1 is a block diagram showing an electrical configuration of a mobile phone 1 according to one embodiment of the present invention. The mobile phone 1 performs wireless communication with a base station via a radio wave, and transmits and receives not only acoustic data but also character data and image data. The mobile phone 1 includes a communication unit 2, an imaging unit 3, an image processing unit 4, a character code conversion unit 5, a data classification unit 6, a central control unit 7, a voice input / output unit 8, a key operation unit 9, a display unit 10, and a telephone. It is configured to include a book data storage unit 11 and a ROM (Read Only Memory) 12. The image processing unit 4 includes an image storage unit 4a. The ROM 12 includes a Japanese dictionary database 12a and a Japanese font database 12b.
[0030]
The communication unit 2 performs a control process in wireless communication with a base station in a wireless telephone network and a process of modulating and demodulating data transmitted and received by wireless communication. The imaging unit 3 converts the incident light into an electric signal and captures an image. The imaging unit 3 is realized by, for example, a digital camera.
[0031]
The image processing unit 4 extracts a character string from the image captured by the imaging unit 3. Further, the image processing unit 4 identifies a character string displayed in a predetermined display area of the display unit 10 among the extracted character strings, and causes the telephone directory data storage unit 11 to store the character string. The image storage unit 4a is realized by, for example, a RAM (Random Access Memory), and stores an image captured by the imaging unit 3. The character code conversion unit 5 converts the character string extracted by the image processing unit 4 into character code data including individually allocated characters, numbers, and symbols so that the character string can be handled by a computer.
[0032]
The data classification unit 6 classifies the character code data generated by the character code conversion unit 5 for each predetermined item to generate classification data. The central control unit 7 controls the hardware resources including the communication unit 2, the imaging unit 3, the voice input / output unit 8, the key operation unit 9, the display unit 10, and the telephone directory data storage unit 11 that constitute the mobile phone 1. I do. In particular, data output from the communication unit 2, the imaging unit 3, the voice input / output unit 8, the key operation unit 9, the display unit 10, and the telephone directory data storage unit 11, and the communication unit 2, the imaging unit 3, the voice input / output unit 8, It controls data input to the key operation unit 9, the display unit 10, and the telephone directory data storage unit 11.
[0033]
The audio input / output unit 8 includes a microphone and a speaker. The audio input / output unit 8 performs a process of converting sound data by a speaker and a process of receiving sound by a microphone and converting the data into data. The key operation unit 9 includes one or more keys, and is operated by a user to give an operation instruction to the mobile phone 1. The key operation unit 9 includes, for example, a numeric keypad for inputting a telephone number and a name, an image capturing mode for capturing an image by the image capturing unit 3, and a character string such as a telephone number captured and read by the image capturing unit 3. There are various modes such as a telephone directory registration mode stored in the telephone directory data storage unit 11 and a transmission mode for transmitting a telephone number designated by the user based on the telephone directory data and transmitting an e-mail addressed to the mail address designated by the user. And a function key for setting the mode.
[0034]
The display unit 10 selectively displays image-related data from the communication unit 2, the imaging unit 3, and the telephone directory data storage unit 11. Here, the image-related data is transmitted from another mobile phone, and the character data and image data received by the communication unit 2, the image data imaged by the imaging unit 3 and subjected to image processing, and the telephone directory data storage unit 11 And character data and image data stored in the storage device.
[0035]
The telephone directory data storage unit 11 is realized by, for example, a RAM. The telephone directory data storage unit 11 stores, as telephone directory data, classification data generated by the data classification unit 6, such as first and last name data, phonetic data, telephone number data, and e-mail address data. The Japanese dictionary database 12a includes data of characters such as kanji, hiragana, katakana, numbers, alphabets, symbols, and pictograms. The Japanese font database 12b includes font data of each character such as kanji, hiragana, katakana, and alphabetic characters, for example, data such as Mincho, block, and line font.
[0036]
FIG. 2 is a diagram illustrating an example of a use state of the mobile phone 1. FIG. 2A is a diagram illustrating a display example of the display unit 10 in another mobile phone 20. FIG. 2B is a diagram illustrating a display example of an image displayed on the display unit 10 of the mobile phone 1 when the imaging unit 3 of the mobile phone 1 captures an image of the display unit 10 of another mobile phone 20. FIG. 3 is a flowchart illustrating an example of a procedure of extracting a character string in an image captured by the imaging unit 3 and identifying / identifying the character string. In the other mobile phones 20, the same components as those of the mobile phone 1 are denoted by the same reference numerals, and description thereof will be omitted.
[0037]
As shown in FIG. 2A, for example, an electronic telephone directory attached to the mobile telephone 20 (hereinafter, may be referred to as “electronic telephone directory”), for example, as shown in FIG. An item 21 of the electronic telephone directory and telephone directory data 22 corresponding to the item 21 are displayed. When the user of the mobile phone 1 captures an image of the electronic telephone directory displayed on the display unit 10 of another mobile phone 20 with the imaging unit 3, the user uses a predetermined function key of the key operation unit 9 in advance. Set the mode.
[0038]
After setting the imaging mode, in step A1 of FIG. 3, the user turns the imaging unit 3 to the display unit 10 on which the electronic telephone directory of another mobile phone 20 is displayed, and the electronic telephone directory is displayed. An image of the display unit 10 is taken. The user captures only the telephone directory data 22 of the electronic telephone directory, for example, as shown in FIG.
[0039]
In step A2, the image of the telephone directory data 22 captured by the image capturing unit 3 (hereinafter, sometimes referred to as “captured image”) is stored in the image storage unit 4a. Here, when a character string obtained by capturing an image by the image capturing unit 3 and storing the character string as telephone directory data in the telephone directory data storage unit 11, the user of the mobile phone 1 operates a predetermined function key of the key operation unit 9 in advance. To set the phonebook registration mode.
[0040]
After setting the telephone directory registration mode, in step A3, the image processing unit 4 performs a process of extracting a character string from the captured image stored in the image storage unit 4a. The character string extraction process is performed using, for example, an optical character recognition (OCR) technology.
[0041]
In step A4, the image processing unit 4 performs a process of extracting a character string indicating the first and last names from the character strings extracted from the captured image. A predetermined area of the display unit 10 of the character string extracted from the captured image, for example, the character string “Miho Keii” displayed at the top of the display unit 10 of the mobile phone 1 shown in FIG. , Extracted as a character string indicating the first and last name.
[0042]
In step A5, identification and identification are performed as to whether or not the leftmost character "Kage" of the character string extracted as the character string indicating the first and last names is any one of a kanji, a hiragana, and a full-width katakana. Specifically, the character code conversion unit 5 converts the leftmost character into character code data using a Japanese dictionary database 12a and a Japanese font database 12b stored in the ROM 12, and converts the leftmost character into character code data. Is identified and identified by performing a character recognition process on. If the leftmost character is identified as one of a kanji character, a hiragana character and a full-width katakana character, in step A5, each character of the character string indicating the family name is converted to character code data in the same manner as described above. By performing conversion and performing a character recognition process on each of the characters, identification and identification are performed.
[0043]
In step A6, the character string identified and identified as the character string indicating the first and last name in step A5 is classified by the data classification unit 6 into first and last name data.
[0044]
In step A7, the image processing unit 4 performs a process of extracting a character string indicating a reading kana from a character string extracted from the captured image. Of the character strings extracted from the captured image, in a predetermined area of the display unit 10, for example, in the display unit 10 of the mobile phone 1 shown in FIG. The character string "Kagei Miho" displayed in the line below the line is extracted as a character string indicating the reading kana.
[0045]
In step A8, identification / identification is performed as to whether or not the character "f" at the left end of the character string extracted as the character string indicating the reading kana is a half-size katakana. Specifically, the character code conversion unit 5 converts the leftmost character into character code data using a Japanese dictionary database 12a and a Japanese font database 12b stored in the ROM 12, and converts the leftmost character into character code data. Is identified and identified by performing a character recognition process on. If the leftmost character is identified as a half-width katakana character, in step A8, each character of the character string indicating the reading kana is converted into character code data in the same manner as described above, and the character corresponding to the character Identification and identification are performed by performing recognition processing.
[0046]
In step A9, the character string identified and identified as the character string indicating the reading kana in step A8 is classified by the data classification unit 6 into the reading kana data.
[0047]
In step A10, the image processing unit 4 performs a process of extracting a character string indicating a telephone number from the character strings extracted from the captured image. Of the character strings extracted from the captured image, in a predetermined area of the display unit 10, for example, in the display unit 10 of the mobile phone 1 shown in FIG. The character string “090123456” displayed one line below is extracted as a character string indicating a telephone number.
[0048]
In step A11, identification is performed to determine whether the character string extracted as the character string indicating the telephone number is a continuous number starting from zero, and whether the continuous number does not include an alphabetic character.
[0049]
In step A12, the character string identified and identified as the character string indicating the telephone number in step A11 is classified by the data classification unit 6 into telephone number data.
[0050]
In step A13, the image processing unit 4 extracts a character string indicating the mail address of the electronic mail (hereinafter, may be simply referred to as “mail address”) from the character strings extracted from the captured image. Is performed. A predetermined area of the display unit 10 of the character string extracted from the captured image, for example, the display unit 10 of the mobile phone 1 shown in FIG. The character string “ab@cd.com” displayed one line below is extracted as a character string indicating the mail address.
[0051]
In step A14, it is determined whether or not the character string extracted as the character string indicating the mail address starts with a half-width alphabetic character or whether the character string includes a predetermined symbol, for example, a symbol such as an at sign "@". Perform identification.
[0052]
In step A15, the character string identified and identified as the character string indicating the mail address in step A14 is classified by the data classification unit 6 into mail address data. In step A16, the first and second name data, phonetic data, telephone number data and mail address data classified by the data classifying unit 6 are stored as telephone directory data 22 in the telephone directory data storage unit 11.
[0053]
As described above, according to the present embodiment, when the user picks up the telephone directory data 22 displayed on the display unit 10 of another mobile phone 20 with the imaging unit 3 of the mobile phone 1, the image is captured by the imaging unit 3. The image of the telephone directory data 22 is stored in the image storage unit 4a of the mobile phone 1. The character string in the image stored in the image storage unit 4a is extracted by the image processing unit 4. The character string extracted by the image processing unit 4 is converted into character code data by a character code conversion unit 5. The character code data is classified by the data classification unit 6 for each predetermined item, and classification data such as first and last name data, reading pseudonym data, telephone number data, and mail address data is generated. The mobile phone 1 stores the classification data in the telephone directory data storage unit 11 as telephone directory data 22, and performs outgoing and incoming calls based on the telephone directory data 22.
[0054]
As a result, there is no need for the user to manually input the telephone directory data 22 to the mobile phone 1 using the numeric keypad of the key operation unit 9 or the like, so that the user's trouble of inputting can be reduced and erroneous input of the telephone directory data 22 can be prevented. can do. Further, even when there are a plurality of character strings in the image captured by the imaging unit 3, the mobile phone 1 performs the character recognition processing on all the character strings in the image at one time, and performs the character recognition processing. A plurality of character strings can be stored in the telephone directory data storage unit 11 as the telephone directory data 22.
[0055]
As a result, even when the number of pieces of the telephone directory data 22 stored in the telephone directory data storage unit 11 is large, the registration of the telephone directory data 22 can be easily performed in a relatively short time. Therefore, the mobile phone 1 is more convenient than the conventional mobile phone.
[0056]
In addition, the mobile phone 1 captures information required by the other mobile phone 20 and required by the user by imaging the display unit 10 on which information owned by the other mobile phone 20 is displayed as described above. Since it can be easily acquired and registered in the telephone directory data storage unit 11 or the like, the use of the mobile phone 1 is further expanded.
[0057]
Further, as described above, in step A5 and step A8 shown in FIG. 3, the character types included in the character string extracted from the captured image by the image processing unit 4, for example, kanji, hiragana and katakana, are written in the Japanese dictionary. Since the character string is accurately identified based on the database 12a, the extracted character string can be converted into accurate character code data. Further, the font of the character string extracted from the captured image by the image processing unit 4, such as Mincho, Gothic, and line font, is accurately identified based on the Japanese font database 12b. The converted character string can be converted into accurate character code data.
[0058]
Further, in the present embodiment, when making a call to a telephone number stored in the telephone directory data storage unit 11 and transmitting an e-mail to a mail address stored in the telephone directory data storage unit 11, the user is required to make a telephone call. By simply selecting the telephone number of the person to call and the mail address of the person to send the e-mail from the telephone numbers and e-mail addresses of the e-mail stored in the book data storage unit 11, the telephone number can be easily obtained. Or send an e-mail to the mail address. Therefore, the convenience of the mobile phone 1 is improved.
[0059]
In addition, when the user makes a call to the designated telephone number based on the telephone directory data 22 stored in the telephone directory data storage unit 11 and transmits an e-mail to the specified mail address, the key An outgoing call mode is set by using a predetermined function key of the operation unit 9.
[0060]
Further, in the present embodiment, when a call or an e-mail is received, it is determined whether or not the telephone number data of the called party and the mail address data of the called party are stored in the telephone directory data storage unit 11. Judge. When it is determined that the other party's telephone number data and the other party's mail address data are stored in the telephone directory data storage unit 11, the other party's telephone number data and mail are displayed on the display unit 10 in response to a call and an incoming e-mail. Display address data. When there is related data stored in the telephone directory data storage unit 11 in association with the telephone number data and the mail address data, for example, first and last name data, the telephone number data and the mail address data are combined with the related data. May be displayed on the display unit 10.
[0061]
FIG. 4 is a diagram illustrating an example of a use state of the mobile phone 1. FIG. 4A is a diagram illustrating a display example of the display unit 10 in another mobile phone 20. FIG. 4B is a diagram illustrating a display example of an image displayed on the display unit 10 of the mobile phone 1 when the imaging unit 3 of the mobile phone 1 captures an image of the display unit 10 of another mobile phone 20. FIG. 5 is a flowchart illustrating an example of a procedure of extracting a character string in an image captured by the imaging unit 3 and identifying / identifying the character string. In the other mobile phones 20, the same components as those of the mobile phone 1 are denoted by the same reference numerals, and description thereof will be omitted.
[0062]
As shown in FIG. 4A, for example, an electronic telephone directory attached to the mobile telephone 20 (hereinafter, may be referred to as “electronic telephone directory”), for example, as shown in FIG. An item 21 of the electronic telephone directory and telephone directory data 22 corresponding to the item 21 are displayed. When the user of the mobile phone 1 captures an image of the electronic telephone directory displayed on the display unit 10 of another mobile phone 20 with the imaging unit 3, the user uses a predetermined function key of the key operation unit 9 in advance. Set the mode.
[0063]
After setting the imaging mode, in step B1 of FIG. 5, the user turns the imaging unit 3 to the display unit 10 on which the electronic telephone directory of another mobile phone 20 is displayed, and the electronic telephone directory is displayed. An image of the display unit 10 is taken. The user takes an image of an electronic telephone directory item 21 and telephone directory data 22, for example, as shown in FIG.
[0064]
In step B2, the image of the telephone directory data 22 captured by the image capturing unit 3 (hereinafter, sometimes referred to as “captured image”) is stored in the image storage unit 4a. Here, when a character string obtained by capturing an image by the image capturing unit 3 and storing the character string as telephone directory data in the telephone directory data storage unit 11, the user of the mobile phone 1 operates a predetermined function key of the key operation unit 9 in advance. To set the phonebook registration mode.
[0065]
After setting the telephone directory registration mode, in step B3, the image processing unit 4 performs a process of extracting a character string from the captured image stored in the image storage unit 4a. The character string extraction process is performed using, for example, an optical character recognition (OCR) technology.
[0066]
In step B4, the image processing unit 4 performs a process of extracting a character string indicating the first and last names from the character strings extracted from the captured image. A predetermined area of the display unit 10 of the character string extracted from the captured image, for example, a character string “name” displayed at the top of the display unit 10 of the mobile phone 1 shown in FIG. Extract as a character string indicating first and last name. In step B4, the character string displayed at the top of the display unit 10 of the mobile phone 1 shown in FIG. 4B may be a character string other than "name", for example, "name" or "name". , Extracted as a character string indicating the first and last name.
[0067]
In step B5, identification and identification are performed to determine whether or not the character "Kage" located on the right side of the character string extracted as the character string indicating the first and last name is one of a kanji, a hiragana, and a full-width katakana. Specifically, the character code conversion unit 5 converts the character located on the right side into character code data using the Japanese dictionary database 12a and the Japanese font database 12b stored in the ROM 12, and Is identified and identified by performing a character recognition process for the character located at. If the character located on the right side is identified as one of kanji, hiragana and full-width katakana, in step B5, each character of the character string located on the right side of the character string In the same manner as described above, identification / identification is performed by converting the data into character code data and performing character recognition processing on each of the characters.
[0068]
In step B6, the character string identified and identified in step B5 is classified by the data classification unit 6 into first and last name data.
[0069]
In step B7, the image processing unit 4 performs a process of extracting a character string indicating a reading kana from a character string extracted from the captured image. In a predetermined area of the display unit 10 of the character string extracted from the captured image, for example, in the display unit 10 of the mobile phone 1 shown in FIG. The character string "kana" displayed in the line below the line is extracted as a character string indicating the reading kana. In step B7, on the display unit 10 of the mobile phone 1 shown in FIG. 4B, the character string displayed on the line below the line on which the character string indicating the first and last name is displayed is other than "kana". In the case of a character string, for example, "furigana", it is extracted as a character string indicating the reading kana.
[0070]
In step B8, identification and identification are performed to determine whether the character "f" located on the right side of the character string extracted as the character string indicating the reading kana is a half-size katakana character. Specifically, the character code conversion unit 5 converts the character located on the right side into character code data using the Japanese dictionary database 12a and the Japanese font database 12b stored in the ROM 12, and Is identified and identified by performing a character recognition process for the character located at. When the character located on the right side is identified as a half-width katakana character, in step B8, each character of the character string located on the right side of the character string indicating the reading kana is converted into character code data as described above. By performing conversion and performing a character recognition process on each of the characters, identification and identification are performed.
[0071]
In step B9, the character string identified and identified in step B8 is classified by the data classification unit 6 into reading kana data.
[0072]
In step B10, the image processing unit 4 performs a process of extracting a character string indicating a telephone number from the character strings extracted from the captured image. Of the character strings extracted from the captured image, in a predetermined area of the display unit 10, for example, in the display unit 10 of the mobile phone 1 shown in FIG. The character string “number” displayed one line below is extracted as a character string indicating a telephone number. In step B10, the character string displayed on the display unit 10 of the mobile phone 1 shown in FIG. , For example, "telephone number" is also extracted as a character string indicating a telephone number.
[0073]
In step B11, identification / identification of whether the character string located on the right side of the character string extracted as the character string indicating the telephone number is a continuous number starting from zero, and whether the continuous number does not include an alphabetic character. I do.
[0074]
In step B12, the character string identified and identified in step B11 is classified by the data classification unit 6 into telephone number data.
[0075]
In step B13, the image processing unit 4 extracts a character string indicating the e-mail address of the e-mail (hereinafter, may be simply referred to as “e-mail address”) from the character strings extracted from the captured image. Is performed. Of the character strings extracted from the captured image, a predetermined area of the display unit 10, for example, the display unit 10 of the mobile phone 1 shown in FIG. The character string “address” displayed one line below is extracted as a character string indicating a mail address. In step B13, on the display unit 10 of the mobile phone 1 shown in FIG. 4B, a character string displayed on a line one line below a line on which a character string indicating a telephone number is displayed is other than “address”. Is extracted as a character string indicating a mail address.
[0076]
In step B14, the character string located on the right side of the character string extracted as the character string indicating the mail address starts with a half-width alphabetic character, or includes a predetermined symbol in the character string, for example, a symbol such as an at sign "@". Identification of whether or not it has been performed.
[0077]
In step B15, the character string identified and identified in step B14 is classified into mail address data by the data classification unit 6. In step B16, the first and last name data, phonetic data, telephone number data and mail address data classified by the data classifying unit 6 are stored as telephone directory data 22 in the telephone directory data storage unit 11.
[0078]
As described above, according to the present embodiment, when the user picks up the telephone directory data 22 displayed on the display unit 10 of another mobile phone 20 with the imaging unit 3 of the mobile phone 1, the image is captured by the imaging unit 3. The image of the telephone directory data 22 is stored in the image storage unit 4a of the mobile phone 1. The character string in the image stored in the image storage unit 4a is extracted by the image processing unit 4. The character string extracted by the image processing unit 4 is converted into character code data by a character code conversion unit 5. The character code data is classified by the data classification unit 6 for each predetermined item, and classification data such as first and last name data, reading pseudonym data, telephone number data, and mail address data is generated. The mobile phone 1 stores the classification data in the telephone directory data storage unit 11 as telephone directory data 22, and performs outgoing and incoming calls based on the telephone directory data 22.
[0079]
As a result, there is no need for the user to manually input the telephone directory data 22 to the mobile phone 1 using the numeric keypad of the key operation unit 9 or the like, so that the user's trouble of inputting can be reduced and erroneous input of the telephone directory data 22 can be prevented. can do. Further, even when there are a plurality of character strings in the image captured by the imaging unit 3, the mobile phone 1 performs the character recognition processing on all the character strings in the image at one time, and performs the character recognition processing. A plurality of character strings can be stored in the telephone directory data storage unit 11 as the telephone directory data 22.
[0080]
As a result, even when the number of pieces of the telephone directory data 22 stored in the telephone directory data storage unit 11 is large, the registration of the telephone directory data 22 can be easily performed in a relatively short time. Therefore, the mobile phone 1 is more convenient than the conventional mobile phone.
[0081]
In addition, the mobile phone 1 captures information required by the other mobile phone 20 and required by the user by imaging the display unit 10 on which information owned by the other mobile phone 20 is displayed as described above. Since it can be easily acquired and registered in the telephone directory data storage unit 11 or the like, the use of the mobile phone 1 is further expanded.
[0082]
Further, as described above, in step B5 and step B8 shown in FIG. 5, the character types included in the character strings extracted from the captured image by the image processing unit 4, such as kanji, hiragana and katakana, are written in the Japanese dictionary. Since the character string is accurately identified based on the database 12a, the extracted character string can be converted into accurate character code data. Further, the font of the character string extracted from the captured image by the image processing unit 4, such as Mincho, Gothic, and line font, is accurately identified based on the Japanese font database 12b. The converted character string can be converted into accurate character code data.
[0083]
Further, in the present embodiment, when making a call to a telephone number stored in the telephone directory data storage unit 11 and transmitting an e-mail to a mail address stored in the telephone directory data storage unit 11, the user is required to make a telephone call. By simply selecting the telephone number of the person to call and the mail address of the person to send the e-mail from the telephone numbers and e-mail addresses of the e-mail stored in the book data storage unit 11, the telephone number can be easily obtained. Or send an e-mail to the mail address. Therefore, the convenience of the mobile phone 1 is improved.
[0084]
In addition, when the user makes a call to the designated telephone number based on the telephone directory data 22 stored in the telephone directory data storage unit 11 and transmits an e-mail to the specified mail address, the key An outgoing call mode is set by using a predetermined function key of the operation unit 9.
[0085]
Further, in the present embodiment, when a call or an e-mail is received, whether the telephone number data of the other party making the call and the mail address data of the other party sending the e-mail are stored in the telephone directory data storage unit 11. Determine whether or not. When it is determined that the other party's telephone number data and the other party's mail address data are stored in the telephone directory data storage unit 11, the other party's telephone number data and mail are displayed on the display unit 10 in response to a call and an incoming e-mail. Display address data. When there is related data stored in the telephone directory data storage unit 11 in association with the telephone number data and the mail address data, for example, first and last name data, the telephone number data and the mail address data are combined with the related data. May be displayed on the display unit 10.
[0086]
Furthermore, in the above-described embodiment, the character string located on the right side of the character string extracted as the first name, the last name, the reading pseudonym, the telephone number, and the mail address is determined by whether or not the last name, the reading pseudonym, the telephone number, and the mail address. Although the identification / identification processing is performed, this processing may be omitted.
[0087]
The above-described embodiment is merely an example of the present invention, and the configuration can be changed within the scope of the present invention. In the above-described embodiment, the telephone directory data has been described by taking the first and last name data, the phonetic data, the telephone number data, and the mail address data as an example. However, the telephone directory data is not limited thereto, and may be, for example, postal code data and address data. Other data may be used as telephone directory data.
[0088]
Further, in the above-described embodiment, the configuration in the case where the present invention is applied to the mobile phone 1 has been described. However, the present invention is not limited to the mobile phone 1, but an imaging unit that captures an image, and an image capturing unit that captures an image captured by the imaging unit. An image processing unit that extracts a character string from the inside, a character code conversion unit that converts the character string extracted by the image processing unit into character code data, and a data classification that generates classification data in which the character code data is classified for each predetermined item The present invention can be similarly implemented as long as the mobile communication device includes a storage unit that stores the classification data generated by the unit and the data classification unit.
[0089]
【The invention's effect】
As described above, according to the present invention, it is not necessary for the user to manually input telephone directory data by key operation or the like on the portable communication device, so that the user's labor of inputting can be reduced and erroneous input of telephone directory data can be prevented. can do. Further, even when there are a plurality of character strings in the image captured by the imaging unit, the character recognition processing is performed on all the character strings in the image at once, and the plurality of character strings subjected to the character recognition processing are transmitted to the telephone. It can be stored in the telephone directory data storage unit as book data. As a result, even when the number of pieces of telephone directory data stored in the telephone directory data storage unit is large, it is possible to easily register the telephone directory data in a relatively short time. Therefore, the convenience of the portable communication device is improved.
[0090]
Further, according to the present invention, the character types included in the character string extracted by the image processing unit, such as kanji, hiragana and katakana, are accurately identified based on the Japanese dictionary database. Can be converted into accurate character code data. In addition, fonts of character strings extracted by the image processing unit, such as Mincho, Gothic, and line fonts, are accurately identified based on the Japanese font database, so that the extracted character strings can be accurately identified. It can be converted to character code data.
[0091]
Further, according to the present invention, the character string displayed in the predetermined display area of the display unit among the character strings extracted by the image processing unit is telephone number identification information for identifying a telephone number, for example, first name and last name. It is determined and stored in the telephone directory data storage unit. This saves the user from having to input data and prevents erroneous input of telephone number identification information. Therefore, the convenience of the portable communication device is improved.
[0092]
According to the invention, when the character string displayed in the predetermined display area of the display unit among the character strings extracted by the image processing unit is a character string of only one-byte katakana, the character string is a reading kana. Is determined and stored in the telephone directory data storage unit. As a result, it is possible to save the user's trouble of inputting and prevent erroneous input of the reading kana. Therefore, the convenience of the portable communication device is improved.
[0093]
According to the present invention, among the character strings extracted by the image processing unit, the character strings displayed in the predetermined display area of the display unit are continuous numbers starting from zero, and the continuous numbers include alphabetic characters. If not, the character string is determined to be a telephone number and stored in the telephone directory data storage. This saves the user the trouble of inputting and prevents erroneous input of the telephone number. Therefore, the convenience of the portable communication device is improved.
[0094]
Further, according to the present invention, when a character string displayed in a predetermined display area of the display unit among character strings extracted by the image processing unit starts with a half-width alphabet, or the character string includes a predetermined symbol. In this case, the character string is determined to be a mail address of an electronic mail, and is stored in the telephone directory data storage unit. As a result, it is possible to save the user's trouble of inputting and prevent erroneous input of the e-mail address. Therefore, the convenience of the portable communication device is improved.
[0095]
Further, according to the present invention, based on a character string displayed in a predetermined display area of the display unit among the character strings extracted by the image processing unit, a second character string following the character string is a first name, a last name, and a reading pseudonym. , The telephone number or the mail address of the e-mail is determined and stored in the telephone directory data storage unit. As a result, it is possible to save the user's trouble of inputting, and to prevent erroneous input of the first and last names, reading pseudonyms, telephone numbers, and e-mail addresses of e-mails. Therefore, the convenience of the portable communication device is improved.
[0096]
Further, according to the present invention, the user can select a telephone number of a party to be called or a party to which e-mail is to be transmitted from among a plurality of telephone numbers and a plurality of e-mail addresses stored in the telephone directory data storage unit. By simply selecting the e-mail address, it is possible to easily call the telephone number or send an e-mail to the e-mail address.
[Brief description of the drawings]
FIG. 1 is a block diagram showing an electrical configuration of a mobile phone 1 according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of a use state of the mobile phone 1;
FIG. 3 is a flowchart illustrating an example of a procedure of extracting a character string in an image captured by an imaging unit 3 and identifying / identifying the character string.
FIG. 4 is a diagram illustrating an example of a use state of the mobile phone 1;
FIG. 5 is a flowchart illustrating an example of a procedure of extracting a character string in an image captured by the imaging unit 3 and identifying / identifying the character string.
[Explanation of symbols]
1,20 mobile phone
2 Communication unit
3 Imaging unit
4 Image processing unit
4a Image storage unit
5 Character code converter
6 Data Classification Division
7 Central control unit
8 Voice input / output unit
9 Key operation section
10 Display
11 Phonebook data storage
12 ROM (Read Only Memory)
12a Japanese dictionary database
12b Japanese font database

Claims (8)

An imaging unit that captures an image,
An image processing unit that extracts a character string from an image captured by the imaging unit;
A character code conversion unit that converts the character string extracted by the image processing unit into character code data,
A data classification unit that generates classification data in which the character code data is classified for each predetermined item,
A telephone directory data storage unit that stores the classification data generated by the data classification unit as telephone directory data,
A communication unit capable of making and receiving calls based on the phonebook data stored in the phonebook data storage unit;
A portable communication device comprising: a display unit for selectively displaying the image-related data from the imaging unit, the telephone directory data storage unit, and the communication unit. A Japanese dictionary database for identifying kanji, hiragana and katakana,
2. The portable communication device according to claim 1, further comprising a Japanese font database for identifying a plurality of fonts. The image processing unit determines that a character string displayed in a predetermined display area of the display unit among the extracted character strings is telephone number identification information, and stores the character string in the telephone directory data storage unit. The mobile communication device according to claim 1. The image processing unit, when the character string displayed in the predetermined display area of the display unit among the extracted character strings is a character string of only half-width katakana, determines that the character string is a reading kana, The portable communication device according to claim 1, wherein the portable communication device is stored in a telephone directory data storage unit. The image processing unit is a character string displayed in a predetermined display area of the display unit of the extracted character string is a continuous number starting from zero, and when the continuous number does not include alphabetic characters, 2. The portable wireless terminal device according to claim 1, wherein the character string is determined to be a telephone number and stored in the telephone directory data storage unit. The image processing unit may include, when a character string displayed in a predetermined display area of the display unit among the extracted character strings starts with a half-width alphabet or when the character string includes a predetermined symbol, the character string 2. The portable communication device according to claim 1, wherein the mobile communication device determines that is a mail address of the electronic mail and stores the mail address in the telephone directory data storage unit. The image processing unit, based on a character string displayed in a predetermined display area of the display unit among the extracted character strings, a second character string following the character string is a first name, a pseudonym, a telephone number, and an electronic name. 2. The portable communication device according to claim 1, wherein the mail address of the mail is determined, and the mail address is stored in the telephone directory data storage unit. 2. The mobile communication device according to claim 1, wherein the telephone directory data storage unit can store a plurality of telephone numbers and a plurality of e-mail addresses.

Images