JP5428911B2 - Mobile terminal device, telephone directory search method, and telephone directory search program - Google Patents

Description

  The present invention relates to a mobile terminal device, a telephone directory search method, and a telephone directory search program.

  2. Description of the Related Art Conventionally, mobile terminal devices such as mobile phones and PHS (Personal Handy-phone System) hold names, phone numbers, email addresses, company names, and the like as phone book data in association with each other. Such a portable terminal device provides information stored in the phone book data to the user in response to a search operation by the user.

  For example, when a name is input as a search keyword, the mobile terminal device provides the user with a name, a telephone number, an e-mail address, a company name, and the like corresponding to the name. For example, when a company name is input as a search keyword, the mobile terminal device provides a user with a name, a telephone number, an email address, a company name, and the like corresponding to the company name. As a result, the user can make a call or send a mail using the telephone number or mail address stored in the phone book data.

Japanese Patent Laid-Open No. 11-31215

  However, the above prior art has a problem that even if the organizations belong to the same group, if the names of the organizations are not related, these organizations cannot be recognized as the same group. there were. The “organization” referred to here indicates, for example, a company or an organization not for profit. The “organization belonging to the same group” indicates, for example, a set of a plurality of organizations called a group company or a consolidated subsidiary.

  The above problem will be described with an example. For example, a user of a conventional portable terminal device can search for information related to individuals belonging to the same organization by searching the phone book data by inputting the organization name or a part of the organization name as a search keyword. it can. If at least part of the names of both organizations belonging to the same group (XX in this example) match, as in XX Corporation and XX System, search for XX as a keyword. Thus, it is possible to search for information relating to individuals belonging to both groups. However, even if the organizations belong to the same group, there are cases where there is no character that matches the names of both organizations. In such a case, there has been a problem that information relating to individuals belonging to both organizations cannot be searched.

  The disclosed technology has been made in view of the above, and relates to individuals belonging to both organizations, even if the organizations belong to the same group and do not include characters that match the names of the respective organizations. It is an object of the present invention to provide a mobile terminal device, a telephone directory search method, and a telephone directory search program that can provide information.

  In one aspect, the mobile terminal device disclosed in the present application includes, in one aspect, a logo storage unit that stores association information about an organization, personal information about an individual belonging to the organization, and a logo indicating the organization, and the logo storage unit Inquiries to the user regarding the logo to be searched among the logos stored in the database, and group information and personal information corresponding to the logo selected by the user as a result of the inquiry by the inquiry unit. A display unit that displays the group information and personal information acquired from the logo storage unit.

  According to one aspect of the mobile terminal device disclosed in the present application, it is possible to provide information on organizations and individuals belonging to the group for each organization of the same group.

FIG. 1 is a block diagram illustrating a configuration example of the mobile terminal device according to the first embodiment. FIG. 2 is a block diagram illustrating a configuration example of the mobile terminal device according to the second embodiment. FIG. 3 is a diagram illustrating an example of a telephone directory storage unit. FIG. 4 is a diagram illustrating an example of a logo list. FIG. 5 is a diagram illustrating an example of a business card photographed by the reader unit. FIG. 6 is a diagram illustrating an example of a logo selection menu screen. FIG. 7 is a diagram illustrating an example of a search result screen. FIG. 8 is a flowchart illustrating a storage processing procedure performed by the mobile terminal device according to the second embodiment. FIG. 9 is a flowchart illustrating an image analysis processing procedure performed by the reader control unit. FIG. 10 is a flowchart illustrating a search processing procedure performed by the mobile terminal device according to the second embodiment. FIG. 11 is a diagram illustrating a computer that executes a telephone directory search program.

  Hereinafter, embodiments of a mobile terminal device, a telephone directory search method, and a telephone directory search program disclosed in the present application will be described in detail with reference to the drawings. In addition, the portable terminal device, the telephone directory search method, and the telephone directory search program disclosed in the present application are not limited by this embodiment.

  First, the configuration of the mobile terminal device according to the first embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating a configuration example of the mobile terminal device according to the first embodiment. As illustrated in FIG. 1, the mobile terminal device 100 according to the first embodiment includes an extraction unit 110, a storage unit 120, a logotype storage unit 130, a specification unit 140, and a display unit 150.

  The extraction unit 110 extracts group information about a group or personal information about an individual belonging to the group and a logo type (hereinafter, abbreviated as “logo” in some cases) indicating the group from the image data. To do. The “group information” referred to here indicates, for example, the name, address, address, telephone number, etc. of the group. “Personal information” indicates, for example, an individual's name, address, telephone number, mail address, and the like. The “logo type” indicates, for example, a character, a figure, a symbol, or a mark combined with a character, a figure, a symbol, or the like.

  The storage unit 120 stores the logotype in the logotype storage unit 130 in association with the group information or personal information extracted by the extraction unit 110.

  The specifying unit 140 specifies a logo type to be searched among the logo types stored in the logo type storage unit 130. For example, when a search operation is performed by the user, the specifying unit 140 inquires of the user about a logo to be searched, and sets the logo type designated by the user as the search target. The display unit 150 displays group information or personal information corresponding to the logotype specified by the specifying unit 140.

  As described above, the mobile terminal device 100 according to the first embodiment stores the association information or personal information and the logo indicating the association in association with each other. Then, the mobile terminal device 100 inquires the user about a logo to be searched, and displays group information and personal information corresponding to the logo selected by the user. In general, even when the organization names are different, the logos indicating the organizations belonging to the same group are the same. Since the portable terminal device 100 according to the first embodiment can search for group information and personal information using a logo as a key, for each group of the same group, information related to groups and individuals belonging to the group is provided to the user. be able to.

  Next, in a second embodiment, an example of a mobile terminal device that stores a logo, a company name, and the like read from a business card in association with each other and searches for various information using the logo as a key will be described. In the second embodiment, an example of reading a logo, a company name, and the like from a business card is shown. However, the portable terminal device disclosed in the present application can read information such as a logo, a company name, etc. from a paper medium other than the business card.

[Configuration of Mobile Terminal Device According to Second Embodiment]
First, the configuration of the mobile terminal device according to the second embodiment will be described with reference to FIG. FIG. 2 is a block diagram illustrating a configuration example of the mobile terminal device according to the second embodiment. 2 is, for example, a mobile phone, PHS, PDA (Personal Digital Assistant), or the like. As illustrated in FIG. 2, the mobile terminal device 200 according to the second embodiment includes an input unit 210, an output unit 220, a reader unit 230, a storage unit 240, and a control unit 250.

  The input unit 210 is an input device for inputting various information and operation instructions, and is, for example, a numeric keypad for inputting numbers and characters, a cursor key used for menu selection, display scrolling, and the like. The output unit 220 is an output device that outputs various types of information, such as a liquid crystal display or a speaker.

  The reader unit 230 is controlled by a reader control unit 252 to be described later, thereby reading information from an object on which characters, figures, symbols, and the like are described, and generating image data based on the read information. For example, the reader unit 230 is a camera or a scanner. In addition, the reader part 230 in Example 2 shall be a camera. For example, the reader unit 230 according to the second embodiment captures a paper medium such as a business card and generates image data of the captured still image.

  The storage unit 240 is a storage device that stores various types of information. In the example illustrated in FIG. 2, the storage unit 240 includes a telephone directory storage unit 241 and a logo list 242. The telephone directory storage unit 241 stores group information related to organizations such as companies, personal information related to individuals, and the like in association with each other. FIG. 3 shows an example of the phone book storage unit 241. As shown in FIG. 3, the phone book storage unit 241 includes items such as “name”, “phonetic”, “address”, “phone number”, “organization name”, and “logo ID”.

  “Name” indicates, for example, the name of an individual or the name of an organization. “Furigana” indicates the name and how to read the name stored in “Name”. “Address” indicates the address or residence of an individual or group stored in “Name”. “Telephone number” indicates a telephone number of an individual or an organization stored in “name”. “Organization name” indicates the name of the organization to which the individual stored in “Name” belongs. “Logo ID” indicates an identification number for identifying the logo of the organization stored in the “organization name”.

  For example, in the telephone directory storage unit 241 shown in FIG. 3, the name “Taro Taro” is “Tokyo ...”, the telephone number is “0001112222”, and the name of the affiliated organization is “○ Company”. ”And the logo ID of the logo indicating“ ○ Company ”is“ L001 ”. Further, in the telephone directory storage unit 241 shown in FIG. 3, the address of the name “Patent Jiro” is “Tokyo Metropolitan ...”, the telephone number is “0001113333”, and the name of the affiliated organization is “△ Company”. ”And the logo ID of the logo indicating“ △ Company ”is“ L002 ”.

  Here, as in the example illustrated in FIG. 3, even when the group names are different, the logo IDs of the logos indicating the groups may be the same. Specifically, in the example shown in FIG. 3, the name “Search Taro” belongs to the organization “Abc Company”, the name “Search Jiro” belongs to the organization “Abc subsidiary”, and the name “Search Saburo” belongs to the organization “Abc”. Belongs to "affiliates". In the example illustrated in FIG. 3, the logo IDs of the logos indicating “Abc company”, “Abc subsidiary”, and “Abc affiliated company” are the same “L003”. That is, “Abc company”, “Abc subsidiary”, and “Abc affiliated company” use the same logo, although their organization names are different. Even if an organization belongs to the same group as “Abc”, “Abc subsidiary”, and “Abc affiliated company” and uses the same logo as these organizations, it is a character common to these three organizations “ A case where “Abc” is not included is also conceivable.

  Note that the items stored in the telephone directory storage unit 241 illustrated in FIG. 3 are examples. The telephone directory storage unit 241 may store information other than the items shown in FIG. 3 or may not store all the information shown in FIG. For example, the telephone directory storage unit 241 may store an individual e-mail address, an organization FAX number, a name of a department to which the individual belongs, and the like.

  The logo list 242 stores logo image data. FIG. 4 shows an example of the logo list 242. As illustrated in FIG. 4, the logo list 242 includes items such as “logo ID”, “image”, and “name”.

  “Logo ID” corresponds to the logo ID of the telephone directory storage unit 241. “Image” indicates logo image data. FIG. 4 shows an example in which the logo list 242 stores image data in the item “image”. However, the logo list 242 is a folder or directory in which the logo image data is stored in the item “image”. And the file name of the image data may be stored. “Name” indicates the name of the organization indicated by the logo stored in “Image”. The “name” may be the name of a representative organization among a plurality of organizations indicated by a logo.

  The items stored in the logo list 242 shown in FIG. 4 are an example. The logo list 242 may store information other than the items shown in FIG. 4, or may not store all the information shown in FIG. For example, the logo list 242 may not store “name”.

  The control unit 250 controls the operation of the mobile terminal device 200. In the example illustrated in FIG. 2, the control unit 250 includes a communication control unit 251, a reader control unit 252, a logo search unit 253, a telephone directory management unit 254, and a display screen control unit 255.

  The communication control unit 251 controls communication processing performed between the mobile terminal device 200 and an external device such as a base station. For example, the communication control unit 251 performs call control, transmission / reception control of various data, and the like.

  The reader control unit 252, the logo search unit 253, the telephone directory management unit 254, and the display screen control unit 255 store the information included in the image data generated by the reader unit 230 in the storage unit 240 and the logo as a key In addition, a search process for searching for various information from the storage unit 240 is performed. In the following, processing by the reader control unit 252, logo search unit 253, telephone directory management unit 254, and display screen control unit 255 will be described separately as (1) storage processing and (2) search processing.

  First, (1) processing of the reader control unit 252, the logo search unit 253, the telephone directory management unit 254, and the display screen control unit 255 during the storage process will be described.

  The reader control unit 252 controls the reader unit 230 to cause the reader unit 230 to perform a shooting process when a user performs a shooting operation or the like using the input unit 210. Then, the reader control unit 252 acquires image data generated by the reader unit 230, and extracts character information and a logo from the acquired image data.

  Here, the processing performed by the reader control unit 252 when a business card is photographed by the reader unit 230 will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of a business card photographed by the reader unit 230. The business card 10M illustrated in FIG. 5 includes information 11M to 15M. The information 11M indicates a department name. The information 12M indicates a name. The information 13M indicates a company name. The information 14M indicates a company address or residence, a telephone number, and a FAX number described in the information 13M. The information 15M indicates a company logo described in the information 13M.

  When the reader controller 230 generates image data of the business card 10M shown in FIG. 5, the reader controller 252 extracts character information and a logo from the image data. Specifically, the reader control unit 252 first extracts, from the image data, a set of pixels in which the number of pixels whose background colors are continuously adjacent is equal to or less than a predetermined threshold. In the following, the number of pixels whose background colors are continuously adjacent to each other may be referred to as “continuous distance number”, and a set of pixels whose continuous distance number is equal to or less than a threshold value may be referred to as “block image”. .

  For example, in the example shown in FIG. 5, it is assumed that the background color of the business card 10M is white. And the character described in the information 11M-14M of the business card 10M is black, and the logo described in the information 15M shall be other than white. In such a case, the background color white and the character color black are mixed in the rectangle indicated by the information 11M. Here, it is assumed that the number of continuous distances in the rectangle indicated by the information 11M is equal to or less than a predetermined threshold. In such a case, the reader control unit 252 extracts a set of pixels within a rectangle indicated by the information 11M as a block image from the image data of the business card 10M. Similarly, it is assumed that the continuous distance number in the rectangle indicated by the information 12M to 15M is equal to or less than the threshold value. In such a case, the reader control unit 252 extracts a set of images within a rectangle indicated by the information 12M to 15M as a block image.

  Subsequently, the reader control unit 252 selects a block image including a logo from the block images extracted from the image data. Specifically, the reader control unit 252 measures the distance between the extracted block image and the four corners of the business card 10M. Then, the reader control unit 252 selects two block images having a short distance from the upper side of the business card 10M and a short distance from the left side or the right side of the business card 10M. In the example illustrated in FIG. 5, the reader control unit 252 has a block image of the information 11M and the information 15M as a block image having a short distance from the upper side of the business card 10M and a short distance from the left side or the right side of the business card 10M. Select the block image. The reason for selecting a block image in this manner is that, in general, a logo written on a business card is often placed at the top of the business card and at the end of the business card.

  Then, the reader control unit 252 analyzes the two selected block images, and measures the probability that the information included in the block images is recognized as characters (hereinafter, may be referred to as “character recognition rate”). To do. The reader control unit 252 cannot analyze the information included in the block image when the block image having a character recognition rate smaller than a predetermined threshold exists in the selected two block images. Is determined. In other words, the reader control unit 252 determines that the information included in the block image whose character recognition rate is smaller than the predetermined threshold is a logo. In the following, a block image including information whose character recognition rate is smaller than a predetermined threshold may be referred to as an “analyzable image”.

  On the other hand, the reader control unit 252 measures the font size of the character included in the block image when the block image having a character recognition rate equal to or higher than a predetermined threshold exists in the two selected block images. To do. When the font size is larger than a predetermined threshold, the reader control unit 252 determines that the block image is an unanalyzable image. On the other hand, when the font size is equal to or smaller than a predetermined threshold, the reader control unit 252 determines that the block image is not an unanalysable image. As described above, the reason for determining that the image cannot be analyzed when the font size is larger than a predetermined threshold value is that the font size of the character written on the business card is generally smaller than the predetermined value. Accordingly, it is possible to determine that characters whose font size is greater than or equal to a predetermined value among characters written on the business card are used in the logo.

  Then, the reader control unit 252 acquires character information from the block image determined not to be an unanalyzable image. In the example illustrated in FIG. 5, since the information included in the block image of the information 15M is not a character, the reader control unit 252 determines that the block image of the information 15M is an image that cannot be analyzed. That is, the reader control unit 252 acquires character information included in the block images of the information 11M to 14M that are determined not to be unanalyzable images. Specifically, the reader control unit 252 acquires the character information “XXX business unit” from the block image of the information 11M, acquires the character information “Taro Business Card” from the block image of the information 12M, and blocks the information 13M. Acquire character information “△△△ Inc.” from the image. Further, the reader control unit 252 reads the character information “TEL: xx-yyyy-zzzz” and the character information “FAX: xx-yyyy” from the block image of the information 14M. -Zzzzw ".

  In this way, the reader control unit 252 extracts a block image from the image data generated by the reader unit 230 and selects a non-analyzable image from the extracted block image, thereby specifying a block image including a logo. Then, the reader control unit 252 acquires character information from the block image that is determined not to be an image that cannot be analyzed.

  The logo search unit 253 searches the logos stored in the logo list 242 for logos having a degree of similarity greater than a predetermined threshold with a logo included in the unanalyzable image specified by the reader control unit 252.

  Specifically, when the reader control unit 252 specifies an image that cannot be analyzed, the logo search unit 253 inquires of the user whether or not to register the logo included in the image that cannot be analyzed in the logo list 242. At this time, the logo search unit 253 instructs a display screen control unit 255 (to be described later) to display on the output unit 220 an inquiry screen asking whether or not to register the logo.

  The logo search unit 253 is similar to the logo included in the unanalyzable image specified by the reader control unit 252 from the logo list 242 when the user performs an operation for registering the logo on the inquiry screen. Search for the logo you want. Subsequently, when a similar logo can be searched from the logo list 242, the logo search unit 253 notifies the reader control unit 252 of the logo ID of the searched logo. On the other hand, if the logo search unit 253 cannot search for a similar logo, the logo search unit 253 assigns a logo ID of the logo included in the image that cannot be analyzed. Then, the logo search unit 253 stores the logo included in the unanalyzable image and the numbered logo ID in the logo list 242 in association with each other. Then, the logo search unit 253 notifies the reader control unit 252 of the logo ID of the logo included in the image that cannot be analyzed.

  The phone book management unit 254 stores the character information acquired by the reader control unit 252 and the logo ID notified from the logo search unit 253 to the logo search unit 253 in the phone book storage unit 241.

  During the storage process, the display screen control unit 255 displays a screen for inquiring the user whether or not to register the logo included in the unanalyzable image in the logo list 242 in accordance with the instruction from the logo search unit 253 described above. Control display.

  Here, storage processing by the reader control unit 252, the logo search unit 253, and the telephone directory management unit 254 will be described using a specific example. It is assumed that the phone book storage unit 241 stores various types of information shown in FIG. 3 and the logo list 242 stores various types of information shown in FIG. Further, it is assumed that image data of the business card 10M shown in FIG. Further, as in the above example, the reader control unit 252 determines that the block images of the information 11M to 14M are not images that cannot be analyzed, and determines that the block image of information 15M is an images that cannot be analyzed.

  In this case, since the logo included in the block image of the information 15M is not stored in the logo list 242 illustrated in FIG. 4, the logo search unit 253 identifies the logo included in the block image of the information 15M. Number. Here, it is assumed that the logo search unit 253 assigns a logo ID “L004”. In this case, the logo search unit 253 stores the logo included in the block image of the information 15M and the logo ID “L004” in the logo list 242. At this time, the logo search unit 253 may store the character information “ΔΔΔ Inc.” acquired from the block image of the information 13M in the “name” of the logo list 242.

  Subsequently, the phone book management unit 254 stores the character information acquired from the block images of the information 11M to 14M by the reader control unit 252 and the logo ID “L004” numbered by the logo search unit 253. Stored in the H.241. For example, the phone book management unit 254 stores the character information “Taro Business Card” acquired from the block image of the information 12M in “Name” of the phone book storage unit 241. Further, for example, the phone book management unit 254 stores the character information “ΔΔΔ Corporation” acquired from the block image of the information 13M in the “organization name” of the phone book storage unit 241.

  Next, (2) processes of the logo search unit 253, the telephone directory management unit 254, and the display screen control unit 255 during the search process will be described. Note that the reader control unit 252 does not perform processing during search processing.

  First, the telephone directory management unit 254 activates the logo search unit 253 when the user performs an operation for searching various information using the logo as a search key. Then, the logo search unit 253 acquires the logo stored in the “image” from the logo list 242 when activated by the telephone directory management unit 254. Then, the logo search unit 253 instructs the display screen control unit 255 to display on the output unit 220 a screen that allows the user to select a logo acquired from the logo list 242. Hereinafter, a screen for allowing the user to select a logo may be referred to as a “logo selection menu screen”.

  Upon receiving the instruction from the logo search unit 253, the display screen control unit 255 controls display on the output unit 220 of a logo selection menu screen including the logo searched by the logo search unit 253. Here, FIG. 6 shows an example of the logo selection menu screen. As shown in FIG. 6, the display screen control unit 255 controls the display of the logo selection menu screen 10 </ b> G including the logo searched from the logo list 242 by the logo search unit 253 on the output unit 220. Thereby, the user can select a logo as a search key from the logo selection menu screen 10 </ b> G using the input unit 210.

  The phone book management unit 254 acquires various information corresponding to the logo ID of the logo selected on the logo selection menu screen from the phone book storage unit 241. Then, the phone book management unit 254 instructs the display screen control unit 255 to display various information acquired from the phone book storage unit 241 on the output unit 220. Upon receiving such an instruction, the display screen control unit 255 controls display on the output unit 220 of a screen including various information acquired from the phone book storage unit 241 by the phone book management unit 254. Hereinafter, a screen including various information acquired from the phone book storage unit 241 by the phone book management unit 254 may be referred to as a “search result screen”.

  Here, the search processing by the logo search unit 253, the telephone directory management unit 254, and the display screen control unit 255 will be described using a specific example. It is assumed that the phone book storage unit 241 stores various types of information shown in FIG. 3 and the logo list 242 stores various types of information shown in FIG. In addition, it is assumed that the display screen control unit 255 controls the display of the logo selection menu screen 10G illustrated in FIG. It is assumed that the logo including the characters “Abc” displayed at the lower right of the logo selection menu screen 10G is selected by the user.

  In this case, the logo search unit 253 notifies the phone book management unit 254 of the logo ID “L003” corresponding to the logo selected by the user from the logo list 242. Then, the phone book management unit 254 acquires various information corresponding to the logo ID “L003” from the phone book storage unit 241. Specifically, the phone book management unit 254 acquires three records with the logo ID “L003” from the phone book storage unit 241.

  Then, the display screen control unit 255 controls display on the output unit 220 of a search result screen including various information acquired by the telephone directory management unit 254. Here, FIG. 7 shows an example of the search result screen. As shown in FIG. 7, the display screen control unit 255 displays a list of various types of information acquired from the phone book storage unit 241 by the logo search unit 253 on the output unit 220. Specifically, the display screen control unit 255 controls the display of “logo” as a search key, and lists the “name” and “phone number” acquired from the phone book storage unit 241 by the logo search unit 253. indicate. Note that the display screen control unit 255 is not limited to the example of the search result screen 20G illustrated in FIG. 7, and may display a list of “phonetic”, “address”, “organization name”, and the like.

  Note that the storage unit 240 described above is, for example, a semiconductor memory device such as a random access memory (RAM), a read only memory (ROM), or a flash memory, or a storage device such as a hard disk or an optical disk. The control unit 250 described above is, for example, an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

[Storage Processing by Portable Terminal Device According to Second Embodiment]
Next, the procedure of the storage process performed by the mobile terminal device 200 according to the second embodiment will be described with reference to FIG. FIG. 8 is a flowchart illustrating a storage processing procedure performed by the mobile terminal device 200 according to the second embodiment.

  As illustrated in FIG. 8, the reader control unit 252 of the mobile terminal device 200 performs an image analysis process on the image data generated by the reader unit 230 when a photographing operation or the like is performed by the user (step S <b> 8). S101). In the image analysis process, the reader control unit 252 extracts a block image from the image data, and selects an unanalyzable image from the extracted block image. Further, the reader control unit 252 acquires character information from block images other than the images that cannot be analyzed. Note that the image analysis processing by the reader controller 252 will be described later with reference to FIG.

  Subsequently, when there is a block image determined as an image that cannot be analyzed in the image analysis process (Yes at Step S102), the reader control unit 252 notifies the logo search unit 253 of the image that cannot be analyzed (Step S103). In other words, when the image data generated by the reader unit 230 includes a block image including a logo, the reader control unit 252 notifies the logo search unit 253 of the block image.

  Subsequently, the logo search unit 253 of the mobile terminal device 200 instructs the display screen control unit 255 to display the inquiry screen when the reader control unit 252 is notified of the image that cannot be analyzed. Upon receiving such an instruction, the display screen control unit 255 controls the output unit 220 to display an inquiry screen asking whether or not to register the logo (step S104).

  Subsequently, when an operation for registering the logo is performed on the inquiry screen (Yes in step S105), the logo search unit 253 determines from the logo list 242 that the similarity to the logo included in the unanalyzable image is a predetermined value. A logo larger than the threshold is searched (step S106).

  When the logo search unit 253 can search for a similar logo from the logo list 242 (Yes in step S107), the logo search unit 253 notifies the reader control unit 252 of the logo ID of the searched logo (step S109). On the other hand, if the logo search unit 253 cannot search for a similar logo (No in step S107), the logo search unit 253 assigns a logo ID of the logo included in the image that cannot be analyzed, and displays the logo and the logo ID in the logo list. It is stored in 242 (step S108). Then, the logo search unit 253 notifies the reader control unit 252 of the logo ID stored in the logo list 242 (step S109).

  In addition, the logo search part 253 complete | finishes a process, when operation to the effect of registering a logo is not performed on an inquiry screen (step S105 negative). At this time, the logo search unit 253 may notify the reader control unit 252 that an operation for registering the logo has not been performed.

  Subsequently, the reader control unit 252 notifies the telephone book management unit 254 of the logo ID received from the logo search unit 253, the character information acquired from the block image in the image analysis processing, and the like (step S110). Then, the phone book management unit 254 stores the logo ID, character information, and the like received from the reader control unit 252 in the phone book storage unit 241 (step S111).

  Note that the telephone book management unit 254 may end the process when the reader ID is not notified of the logo ID from the reader control unit 252, and the phone book storage unit 241 stores the character information received from the reader control unit 252. May be stored.

[Image analysis processing procedure]
Next, the procedure of the image analysis process shown in step S101 of FIG. 8 will be described with reference to FIG. FIG. 9 is a flowchart illustrating an image analysis processing procedure performed by the reader control unit 252. In FIG. 9, a case where a business card is photographed by the reader unit 230 and image data of the business card is generated will be described as an example.

  As illustrated in FIG. 9, the reader control unit 252 extracts a block image in which the number of continuous distances of the background color is equal to or less than a threshold value from the image data generated by the reader unit 230 (step S201).

  Subsequently, the reader control unit 252 measures the distance between the block image and the four corners of the business card, which is image data, for each extracted block image (step S202). Then, the reader controller 252 selects two block images having a short distance from the upper side of the business card and a short distance from the left side or the right side of the business card (step S203).

  Subsequently, the reader control unit 252 measures the character recognition rate of the two selected block images (step S204). Then, when there is a block image whose character recognition rate is smaller than a predetermined threshold (Yes at Step S205), the reader control unit 252 determines that the block image is an unanalyzable image (Step S206).

  On the other hand, when there is a block image having a character recognition rate equal to or higher than a predetermined threshold (No at Step S205), the reader control unit 252 measures the font size of the character in the block image. When the font size is larger than the predetermined threshold (Yes at Step S207), the reader control unit 252 determines that the block image is an unanalyzable image (Step S206). On the other hand, when the font size is equal to or smaller than the predetermined threshold (No at Step S207), the reader control unit 252 determines that the block image is not an unanalyzable image (Step S208). Then, the reader control unit 252 acquires character information from the block image that is determined not to be an unanalyzable image (step S209).

[Search Process by Mobile Terminal Device According to Second Embodiment]
Next, a search process procedure performed by the mobile terminal device 200 according to the second embodiment will be described with reference to FIG. FIG. 10 is a flowchart illustrating a search processing procedure performed by the mobile terminal device 200 according to the second embodiment. In FIG. 10, processing for searching various information using a logo as a search key will be described, and description of search processing in which the search key is information other than the logo will be omitted.

  As illustrated in FIG. 10, the telephone directory management unit 254 of the mobile terminal device 200 activates the logo search unit 253 when an operation for searching various information is performed using the logo as a search key (Yes in step S301). (Step S302).

  The logo search unit 253 activated by the telephone book management unit 254 searches for a logo stored in the “image” of the logo list 242 and displays a logo selection menu screen on the output unit 220 for the display screen control unit 255. To instruct. Upon receiving the instruction, the display screen control unit 255 controls display of the logo selection menu screen on the output unit 220 (step S303).

  And the logo search part 253 acquires logo ID of the logo selected by the user in the logo selection menu screen from the logo list 242 (step S304). Then, the logo search unit 253 notifies the phone book management unit 254 of the logo ID acquired from the logo list 242 (step S305).

  Subsequently, the phone book management unit 254 acquires various information corresponding to the logo ID notified from the logo search unit 253 from the phone book storage unit 241 (step S306). Then, when various information can be acquired from the phone book storage unit 241 (Yes in step S307), the phone book management unit 254 instructs the display screen control unit 255 to display the search result screen. Upon receiving the instruction, the display screen control unit 255 controls display on the output unit 220 of a search result screen including various information acquired from the phone book storage unit 241 by the phone book management unit 254 (step S308).

  On the other hand, when the phone book management unit 254 cannot acquire various types of information from the phone book storage unit 241 (No in step S307), the process ends. At this time, the telephone directory management unit 254 may instruct the display screen control unit 255 to display information indicating that there is no information corresponding to the logo selected on the logo selection menu screen.

[Effect of Example 2]
As described above, the mobile terminal device 200 according to the second embodiment stores group information and personal information in association with a logo. Then, the mobile terminal device 200 displays a list of group information and personal information acquired using the logo selected by the user as a search key. That is, the user using the mobile terminal device 200 according to the second embodiment can search for group information and personal information for each logo. In general, even when the organization names are different, the logos indicating the organizations belonging to the same group are the same. Therefore, the user can search for group information and personal information for each group in the same group.

  In the mobile terminal device 200 according to the second embodiment, the reader control unit 252 extracts character information and a logo from the image data generated by the reader unit 230. Then, in the mobile terminal device 200, the phone book management unit 254 stores the character information extracted by the reader control unit 252 and the logo in the storage unit 240 in association with each other. Thereby, the user who uses the mobile terminal device 200 according to the second embodiment captures the business card and stores the character information and the logo written on the business card in the phone book data of the mobile terminal device 200. be able to.

  In addition, the mobile terminal device 200 according to the second embodiment extracts information having a character recognition rate smaller than a predetermined threshold from the information included in the image data generated by the reader unit 230 as a logo. Thereby, the mobile terminal device 200 can accurately extract a logo from various information described on a business card or the like.

  In addition, the mobile terminal device 200 according to the second embodiment extracts information having a font size larger than a predetermined threshold from the information included in the image data generated by the reader unit 230 as a logo. Thereby, the mobile terminal device 200 can accurately extract a logo from various information described on a business card or the like.

  Further, when a logo similar to a logo extracted from a business card or the like exists in the logo list 242, the mobile terminal device 200 according to the second embodiment displays the logo, group information extracted from the business card or the like, and personal information. The data are stored in the storage unit 240 in association with each other. Thereby, the portable terminal device 200 can manage group information and personal information in association with similar logos.

  By the way, the mobile terminal device, the telephone directory search method, and the telephone directory search program disclosed in the present application may be implemented in various different forms other than the above-described embodiments. Therefore, in the third embodiment, another embodiment of the mobile terminal device, the telephone directory search method, and the telephone directory search program disclosed in the present application will be described.

[Image analysis processing (1)]
In the second embodiment, the reader control unit 252 performs the image analysis process illustrated in FIG. 9 to determine whether the block image is an unanalyzable image. However, the reader control unit 252 may determine whether or not the block image is an unanalyzable image without performing all the processes shown in FIG.

  For example, the reader control unit 252 analyzes, from among the block images extracted from the image data, a block image whose character recognition rate is smaller than a predetermined threshold value as an unanalyzable image and analyzes a block image whose character recognition rate is equal to or higher than the predetermined threshold value An unacceptable image may be used. In such an example, the reader control unit 252 does not determine whether the block image is an unanalyzable image based on the position of the block image in the image data and the font size of the characters included in the block image. become. Further, for example, the reader control unit 252 may determine whether or not the block image is an unanalyzable image based only on the font size of characters included in the block image among the block images extracted from the image data. Good.

[Image analysis processing (2)]
In the second embodiment, the reader control unit 252 performs the image analysis process illustrated in FIG. 9 to determine whether the block image is an unanalyzable image. In other words, in the second embodiment, the reader control unit 252 performs a process of extracting a logo from the image data. However, the reader control unit 252 may display a list of block images extracted from the image data on the output unit 220 and allow the user to select which block image contains the logo. Similarly, the reader control unit 252 may display a list of block images on the output unit 220 and allow the user to select which block image includes a name, an address, a telephone number, and the like.

[Image analysis processing (3)]
In the second embodiment, as shown in step S203 in FIG. 9, the reader control unit 252 selects two block images based on the position of the block image in the image data. However, the reader controller 252 may select one block image or three or more block images based on the position of the block image in the image data in step S203 of FIG.

[Storage process (1)]
Moreover, in the said Example 2, as shown to step S106 of FIG. 8, the logo search part 253 showed the example which searches the logo similar to the logo extracted from the business card etc. from the logo list | wrist 242. However, the logo search unit 253 may not search the logo list 242 for a logo similar to the logo extracted from a business card or the like. For example, the logo search unit 253 may display a list of logos stored in the logo list 242 and allow the user to select a logo similar to or the same as the logo extracted from a business card or the like.

[Storage process (2)]
In the second embodiment, as shown in steps S106, S108, and S111 in FIG. 8, after searching the logo list 242 for a logo similar to the logo extracted from a business card or the like, the logo search unit 253 or the phone book management unit In the example shown in FIG. However, the logo search unit 253 and the phone book management unit 254 do not perform a process of searching for a similar logo from the logo list 242, but associates the group information, personal information, logo, and the like extracted from the business card with the logo list 242. Or may be stored in the telephone directory storage unit 241. In such a case, the phone book management unit 254 acquires various information corresponding to the logo ID of the logo selected on the logo selection menu screen from the phone book storage unit 241, and the logo ID of the logo similar to the selected logo. Various pieces of information corresponding to may be acquired from the telephone directory storage unit 241. Then, the display screen control unit 255 may display-control the search result screen including various information acquired from the phone book storage unit 241 by the phone book management unit 254 on the output unit 220.

[System configuration, etc.]
Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each device is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, the telephone directory storage unit 241 and the logo list 242 illustrated in FIG. 2 may be integrated.

[program]
The various processes described in the above embodiments can be realized by executing a prepared program on a computer. In the following, an example of a computer that executes a telephone directory search program having the same function as that of the mobile terminal device 100 shown in FIG. 1 will be described with reference to FIG.

  FIG. 11 is a diagram illustrating a computer that executes a telephone directory search program. As illustrated in FIG. 11, the computer 1000 includes a RAM 1010, a cache 1020, an HDD 1030, a ROM 1040, a CPU 1050, and a bus 1060. The RAM 1010, cache 1020, HDD 1030, ROM 1040, and CPU 1050 are connected by a bus 1060.

  The ROM 1040 stores in advance a telephone directory search program that exhibits the same function as the portable terminal device 100 shown in FIG. Specifically, the ROM 1040 stores an extraction program 1041, a storage program 1042, a specific program 1043, and a display program 1044.

  Then, the CPU 1050 reads and executes the extraction program 1041, the storage program 1042, the specific program 1043, and the display program 1044. As a result, the extraction program 1041 becomes the extraction process 1051 and the storage program 1042 becomes the storage process 1052 as shown in FIG. Further, the specific program 1043 becomes the specific process 1053, and the display program 1044 becomes the display process 1054. The extraction process 1051 corresponds to the extraction unit 110 illustrated in FIG. 1, the storage process 1052 corresponds to the storage unit 120 illustrated in FIG. 1, and the identification process 1053 corresponds to the identification unit 140 illustrated in FIG. 1. Correspondingly, the display process 1054 corresponds to the display unit 150 shown in FIG.

  Further, the HDD 1030 is provided with a logotype storage unit 1031 as shown in FIG. The logotype storage unit 1031 corresponds to the logotype storage unit 130 illustrated in FIG.

  Note that the programs 1041 to 1044 described above are not necessarily stored in the ROM 1040. For example, the programs 1041 to 1044 may be stored in a “portable physical medium” such as a flexible disk (FD), a CD-ROM, an MO disk, a DVD disk, a magneto-optical disk, or an IC card inserted into the computer 1000. . Alternatively, the programs 1041 to 1044 may be stored in a “fixed physical medium” such as a hard disk drive (HDD) provided inside or outside the computer 1000. Alternatively, the programs 1041 to 1044 may be stored in “another computer (or server)” connected to the computer 1000 via a public line, the Internet, a LAN, a WAN, or the like. Then, the computer 1000 may read and execute each program from the above-described flexible disk or the like.

100, 200 Mobile terminal device 110 Extraction unit 120 Storage unit 130 Logotype storage unit 140 Identification unit 150 Display unit 210 Input unit 220 Output unit 230 Reader unit 240 Storage unit 241 Phonebook storage unit 242 Logo list 250 Control unit 251 Communication control unit 252 Reader control unit 253 Logo search unit 254 Phonebook management unit 255 Display screen control unit 1000 Computer 1010 RAM
1020 Cache 1030 HDD
1031 Logotype storage unit 1040 ROM
1041 Extraction program 1042 Storage program 1043 Specific program 1044 Display program 1050 CPU
1051 Extraction process 1052 Storage process 1053 Specific process 1054 Display process 1060 Bus

Claims (7)

An extraction unit that extracts group information or personal information and a logotype from image data;
A storage unit that stores a logotype in a logotype storage unit in association with group information or personal information extracted by the extraction unit;
Among the logo types stored in the logo type storage unit, a specific unit for selecting and specifying a logo type to be searched from a list of logo types ;
And a display unit for displaying group information or personal information corresponding to the logotype specified by the specifying unit.   The extraction unit extracts information having a character recognition rate, which is a probability of being recognized as a character, smaller than a predetermined threshold among information included in the image data as a logotype, and the character recognition rate is equal to or higher than a predetermined threshold. 2. The portable terminal device according to claim 1, wherein certain information is extracted as group information or personal information. The logo type storage unit further includes a search unit that searches for a logo type whose similarity with the logo type extracted by the extraction unit is greater than a predetermined threshold,
When the logo type is searched by the search unit, the storage unit associates the logo type searched by the search unit with the group information or personal information extracted by the extraction unit and stores the logo type When the logo type is not searched by the search unit, the logo type extracted by the extraction unit is associated with the group information or personal information extracted by the extraction unit and the logo type The portable terminal device according to claim 1, wherein the portable terminal device is stored in a storage unit.   The extraction unit extracts, as a logotype, information having a size larger than a predetermined threshold among information included in the image data, and extracts information having a size equal to or smaller than a predetermined threshold as group information or personal information. The mobile terminal device according to claim 1, wherein:   2. The mobile phone according to claim 1, wherein the display unit displays group information or personal information corresponding to a logotype whose similarity with the logotype specified by the specifying unit is larger than a predetermined threshold. Terminal device. A telephone directory search method executed in a mobile terminal device,
An extraction step of extracting group information or personal information and logotype from the image data;
A storage step of storing the logotype in the logotype storage unit in association with the group information or personal information extracted by the extraction step;
Among the logo types stored in the logo type storage unit, a specific step of selecting and specifying a logo type to be searched from a list of logo types ;
And a display step of displaying group information or personal information corresponding to the logotype specified in the specifying step. A phone book search program executed on a mobile terminal device,
In the portable terminal device,
Extraction procedure to extract group information or personal information and logotype from image data,
A storage procedure for storing a logotype in a logotype storage unit in association with group information or personal information extracted by the extraction procedure;
Among the logo types stored in the logo type storage unit, a specific procedure for specifying and specifying a logo type to be searched from a list of logo types ;
And a display procedure for displaying group information or personal information corresponding to the logotype specified in the specifying procedure.

Images