JP2012015657A - Communication device, communication method and communication program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method with which user can easily perform communication based on image data.SOLUTION: A communication device comprises a storage unit, a pattern extraction unit, an identifier acquisition unit, and a communication unit. The storage unit stores an image pattern in correlation with identification information which identifies a communication destination. The pattern extraction unit extracts an image pattern from picked-up image data. The identifier acquisition unit refers to the storage unit and acquires identification information correlated with the image pattern extracted by the pattern extraction unit. The communication unit starts communication with a communication destination identified by the identification information acquired by the identifier acquisition unit.

Description

  The present invention relates to a method in which a communication device transmits to a communication destination device.

  In recent years, mobile phone terminals have become more and more multifunctional, and for example, terminals equipped with a digital camera, a business card reader, and the like have become popular. A user of such a mobile phone terminal can store information described on the business card in the mobile phone terminal by acquiring data such as a phone number and a name from the business card using a business card reader. In this case, since the user can make a call using the data stored in the mobile phone terminal via the business card reader, the user can easily make a call to a business partner or the like.

  A business card may include not only text information such as a phone number but also an image such as a company logotype (logo) and a company emblem. A company logo or corporate emblem is useful information for identifying the company. Therefore, user interfaces that can associate graphic identifiers such as logos and photographs with telephone numbers are known. A user of a cellular phone terminal incorporating this interface scrolls the graphic stored in the cellular phone terminal, finds a graphic identifier related to the person who is making a call, and presses the send button. Then, the mobile phone terminal makes a call to a specific telephone number associated with the selected graphic identifier.

JP 10-285263 A

  A user of a mobile phone terminal in which the interface described in the background art is incorporated allows communication by selecting a graphic identifier associated with a communication destination telephone number from a list of graphic identifiers stored in the mobile phone terminal. You can make a call first. In other words, even if the user of the mobile phone terminal does not search for a graphic identifier from the list stored in the mobile phone terminal even if he / she looks at a logo identifying the company or the like of the communication destination, I can't do it. Therefore, for example, even when the user is in front of the communication company or when looking at the catalog of the company that is trying to make a call, the user makes a call using information on the logo that is being viewed. It cannot be said that user convenience is sufficient.

  In the background art, as an example, the case where a call is made from a mobile phone terminal to a communication destination has been described. Further, not only when the communication device is a mobile phone terminal but also in the case of a computer, a fixed phone, a facsimile, etc., it is desired to improve the convenience of the user.

  An object of the present invention is to provide a method by which a user can easily communicate based on image data.

  A communication apparatus according to an embodiment includes a storage unit, a pattern extraction unit, an identifier acquisition unit, and a communication unit. The storage unit stores the image pattern in association with identification information for identifying the communication destination. The pattern extraction unit extracts the image pattern from the captured image data. The identifier acquisition unit refers to the storage unit and acquires identification information associated with the image pattern extracted by the pattern extraction unit. The communication unit starts communication with the communication destination identified by the identification information acquired by the identifier acquisition unit.

  The user can simply communicate based on the image data.

It is a figure which shows the example of the hardware constitutions of a communication apparatus. It is a figure which shows the example of a structure of a control part. It is a figure which shows the example of the business card containing a logo. It is a figure which shows the example of a logo telephone book. It is a flowchart explaining the example of the operation | movement performed when a logo telephone directory is produced. It is a figure which shows the example of a registration number list | wrist. It is a figure which shows the example of the photograph which the user imaged. It is a figure explaining the example of the method of extracting an image pattern from the image data currently displayed on the touch panel. It is a figure explaining the example of the method of extracting an image pattern from the image data currently displayed on the touch panel. It is a figure which shows the example of a position data table. It is a figure which shows the example by which the outline of the display area was displayed in image data. It is a figure which shows the example of the list produced | generated by the communication part. It is a figure which shows the example of a selection screen. An example of an identification area table is shown. It is a flowchart explaining the example of operation | movement when the transmission by the selection of a logo is performed by the communication apparatus which concerns on 1st Embodiment. It is a flowchart explaining the example of operation | movement when the transmission by selection of a logo is performed by the communication apparatus which concerns on 2nd Embodiment. It is a figure which shows the example of a selection screen.

  In the following description, a case where the communication device is a mobile phone terminal provided with a touch panel will be described as an example. Further, the communication device is not limited to a device including a touch panel, and can be any device including a display device and a pointing device.

  The communication apparatus according to the embodiment stores an image pattern in association with information such as a telephone number that specifies a communication destination. In the following description, an image stored in a communication device in association with information for specifying a communication destination may be referred to as an “image pattern”. The communication apparatus searches for image patterns included in the image data displayed on the touch panel, and extracts the image patterns. Furthermore, the communication device specifies a position where the extracted image pattern is displayed. When the user contacts the position where the image pattern is displayed, the communication device starts communication with the communication destination associated with the image pattern displayed at the position where the contact is detected. For this reason, the user of the communication apparatus according to the embodiment can transmit to the communication destination by selecting a position where the image pattern associated with the communication destination is displayed. Therefore, according to the present embodiment, for example, the user can communicate by touching the position where the logo of the communication destination company is displayed in the state where the image of the communication company logo is displayed on the touch panel. You can call the other company.

<Device configuration>
FIG. 1 is a diagram illustrating an example of a hardware configuration of the communication device 10. The communication device 10 includes an antenna 11, a wireless communication unit 12, a display unit 13, a microphone 14, a speaker 15, a voice input / output unit 16, an input unit 17, a position input unit 18, a camera 19, a storage unit 20, and a processor 30. Prepare. Moreover, the communication apparatus 10 can also be provided with the location acquisition part 35 as an option. The storage unit 20 includes a read only memory (ROM) and a random access memory (RAM) 23, and the ROM includes a program storage unit 21 and a data storage unit 22.

  The wireless communication unit 12 transmits / receives data to / from the base station via the antenna 11. The display unit 13 is a display such as a liquid crystal display or a touch panel. The display unit 13 can display image data, character data, and the like stored in the storage unit 20 on the screen, and can display data acquired via the camera 19 and the wireless communication unit 12 on the screen. You can also. Here, the image data acquired via the camera 19 includes image data captured by the camera 19 and image data displayed to indicate to the user the imaging target of the camera 19.

  The voice input / output unit 16 controls voice input from the microphone 14 and voice data output to the speaker 15. The input unit 17 receives an input of data from the user to the communication device 10. The input unit 17 can be an arbitrary input device such as a key or a button, for example. The position input unit 18 is an arbitrary pointing device such as a touch panel, and receives input of information specifying a position on the screen of the display unit 13 from the user. That is, the user can input the position of the screen of the display unit 13 through the position input unit 18. Here, in the communication device 10 on which the touch panel is mounted, the touch panel is included in both the position input unit 18 and the display unit 13. In the case of the communication device 10 equipped with a touch panel, the position specified by the information acquired by the position input unit 18 is a position where a contact by the user is detected. The camera 19 is an arbitrary camera such as a digital camera.

  The program storage unit 21 stores a program used for processing by the processor 30. The data storage unit 22 stores data and a database used in the communication device 10. The RAM 23 also stores data used for processing by the processor 30. For example, in the mobile phone terminal according to the embodiment, a logo phone book 24, a registered number list 25, a position data table 26, and the like are stored. The RAM 23 may be used for processing of the processor 30. The logo phone book 24, the registered number list 25, and the position data table 26 will be described later.

  The location acquisition unit 35 can calculate the position information by an arbitrary method such as Global Positioning System (GPS) or Assisted GPS, for example. As will be described later, in the communication device 10 including the location acquisition unit 35, when a plurality of communication destinations associated with the image pattern are detected, communication presented to the user based on the position information of the communication device 10 Prior priorities may be determined.

  FIG. 2 is a diagram illustrating an example of the configuration of the control unit 40. The processor 30 operates as the control unit 40 by executing a program stored in the program storage unit 21. The control unit 40 includes, for example, a wireless control unit 41, a call control unit 42, a camera control unit 43, a business card reader unit 44, a logo phone book management unit 45, a display control unit 46, an input control unit 47, and a logo transmission unit 50. Is provided. The logo transmission unit 50 includes a pattern extraction unit 51, a position data acquisition unit 52, an identifier acquisition unit 53, a communication unit 54, and a communication destination notification unit 55.

  The wireless control unit 41 controls wireless communication between the mobile phone terminal and the base station. The call control unit 42 controls voice communication performed at the mobile phone terminal. The camera control unit 43 adjusts the camera 19 according to parameters and the like used for setting the camera 19. Further, the camera control unit 43 outputs an image to be captured by the camera 19 to the business card reader unit 44 and the display control unit 46. The camera control unit 43 can output the image data captured by the camera 19 to the display control unit 46 and can also store the image data in the storage unit 20.

  The business card reader unit 44 performs character recognition on the image data input from the camera control unit 43 by, for example, optical character recognition (OCR). The business card reader unit 44 acquires description contents of a business card such as a name and a telephone number based on the information recognized as characters, and outputs it to the logo phonebook management unit 45. Further, the business card reader unit 44 outputs, to the logo phonebook management unit 45, information in which character recognition has failed among the image data input from the camera control unit 43 in the form of image data.

  The logo phone book management unit 45 records the information input from the business card reader unit 44 in the logo phone book 24. At this time, the logo phonebook management unit 45 also records the image data input from the business card reader unit 44. Note that image data such as a logo registered in the logo telephone directory 24 is used as an image pattern. Further, when the location information is input from the business card reader unit 44, the logo phonebook management unit 45 obtains the latitude and longitude of the point specified by the information. The operation of the logo telephone directory management unit 45 will be described in detail later.

  The display control unit 46 outputs image data and character data to the display unit 13, and the display unit 13 displays the data on the screen. Furthermore, the display control unit 46 outputs data for displaying lines, graphics, characters, and the like on the screen to the display unit 13 in accordance with the notification from the logo transmission unit 50 and the like. For example, the display control unit 46 outputs data for displaying a display that the user can visually recognize around the image pattern extracted by the pattern extraction unit 51 to the display unit 13. The input control unit 47 specifies data input via the input unit 17 and the position input unit 18 and notifies the logo transmission unit 50 of the input data as appropriate. Further, the input control unit 47 notifies the display control unit 46 of data input by the input unit 17 and the position input unit 18. For example, when a part of the character string displayed on the display is selected by the input unit 17, the display control unit 46 highlights the selected character string in accordance with the notification from the input control unit 47. 13 is instructed.

  The logo transmitter 50 controls communication using the logo phone book 24. The pattern extraction unit 51 reads an image pattern from the logo phone book 24. Further, the pattern extraction unit 51 confirms whether an image pattern is included in the data displayed on the screen of the display unit 13. When the image pattern is displayed on the screen of the display unit 13, the pattern extraction unit 51 extracts the image pattern. An image pattern extraction method will be described later.

  The position data acquisition unit 52 acquires the position on the screen of the display unit 13 in the area where the extracted image pattern is displayed. For example, the position data acquisition unit 52 acquires the position of an area where a certain image pattern is displayed using XY coordinates with the upper left corner of the screen of the display unit 13 as the origin. In the following description, an area on the screen where an image pattern is displayed may be referred to as “display area”, and information for specifying the position of the display area may be referred to as “position data”.

  The identifier acquisition unit 53 determines whether the position where the input from the position input unit 18 is detected is included in the display area. First, the identifier acquisition unit 53 acquires coordinates when the position where the input from the position input unit 18 is detected is represented by the same coordinates as the XY coordinates used by the position data acquisition unit 52. Furthermore, by comparing the acquired coordinates with the position data, it is determined whether the coordinates of the position where the input is detected are included in the display area. When the position where the input is detected is included in the display area, the identifier acquisition unit 53 uses the position data table 26 to acquire an identifier for identifying the image pattern displayed at the position where the input is detected. . In order to help understanding, in the following description, the image pattern displayed at the position where the input is detected is described as the image pattern selected by the user or the selected image pattern. There is. The identifier acquisition unit 53 notifies the communication unit 54 of an identifier for identifying the image pattern selected by the user.

  When there is one communication destination associated with the identifier notified from the identifier acquisition unit 53, the communication unit 54 starts communication with the specified communication destination. On the other hand, when there are a plurality of communication destinations associated with the notified identifier, the communication unit 54 notifies the communication destination notification unit 55 of the communication destinations. The communication destination notification unit 55 displays a display for selecting the communication destination notified by the user from the communication unit 54 on the screen of the display unit 13 and notifies the communication unit 54 of the selection result of the user. The communication unit 54 starts communication with the communication destination notified from the communication destination notification unit 55. The operation of the communication destination notification unit 55 will be described in detail later.

<First Embodiment>
The first embodiment will be described below. The communication device 10 used in the first embodiment may not include the location acquisition unit 35. In the first embodiment, a logo telephone directory 24 that does not include location information can also be used. The communication device 10 used in the first embodiment includes a touch panel, and the display unit 13 and the position input unit 18 are realized by a touch panel. Here, a photograph taken by the user of the mobile phone terminal according to the first embodiment is displayed on the touch panel, and by selecting a logo in the photograph, the user registers in association with the logo selected in advance. An example will be described in which a call is made to a contact address.

  First, as an example of reading a business card shown in FIG. 3A, an example of a method of storing an image pattern in association with a telephone number or the like in the communication device 10 will be described. Here, it is assumed that the image pattern is a logo printed on a business card.

  (1) With the business card reader unit 44 activated, the user images the business card shown in FIG. The camera control unit 43 outputs the business card image to the business card reader unit 44. The business card reader unit 44 performs character recognition of the input image data. Assume that the name, location information, telephone number, fax number, and mail address described on the business card shown in FIG. Here, the location information may be any information representing the location, for example, a zip code or an address.

  (2) The business card reader unit 44 extracts data that has failed in character recognition as image data. For example, when the character recognition of the business card shown in FIG. 3A is performed, the business card reader unit 44 fails to recognize the character indicated by the broken line in FIG. Therefore, the business card reader unit 44 extracts a portion indicated by a broken line in FIG. 3B as image data. In the following description, it is assumed that the business card reader unit 44 extracts image data serving as an image pattern in the form of a rectangle in contact with the image data.

  (3) The business card reader unit 44 outputs the extracted image data and data such as the name acquired in the procedure (1) to the logo phonebook management unit 45. The logo phone book management unit 45 records the input information in the logo phone book 24. FIG. 4 shows an example of the logo phone book 24. In the logo phonebook 24 shown in FIG. 4, the extracted image data is recorded in the logo field, and is recorded in association with the location information, telephone number, etc. described on the business card. Each recorded image data is given an identifier (logo ID) for specifying the image data and registered in association with the logo. The record for the business card shown in FIG. 3A is as shown in the fifth data.

  (4) When the location information can be acquired, the logo phone book management unit 45 obtains the latitude and longitude of the obtained location and records them in the logo phone book 24. For example, from the business card location 5 shown in FIG. 3, the logo phone book management unit 45 calculates that the location 5 is 35.581 degrees north latitude and 139.64 degrees east longitude, and records it in the logo phone book 24.

  FIG. 4 is an example of the logo phone book 24, and the data to be recorded may be changed depending on the implementation. For example, the logo phone book 24 may include only a logo, a logo ID, a phone number, and a name. Furthermore, some of the items included in the logo telephone directory 24 can be made optional. If the location information is optional, the location and its latitude and longitude items are not recorded in the business card etc. where the location is not described, as in the fourth registration in the logo phonebook 24 shown in FIG. 4) is also omitted. The procedures (1) to (4) are also examples of operations and may be changed depending on the implementation. For example, the logo phone book management unit 45 can obtain the latitude and longitude and register them in the logo phone book 24 together with data such as name.

  FIG. 5 is a flowchart for explaining an example of operations performed when the logo telephone directory 24 is created. When the business card is captured by the camera 19, the camera control unit 43 outputs the captured data to the business card reader unit 44 (step S1). The business card reader unit 44 performs character recognition of the image data input from the camera control unit 43 and extracts an image (logo) (step S2). When the phone number is successfully recognized by the character recognition, the business card reader unit 44 outputs the acquired phone number and the extracted logo to the logo phone book management unit 45. The logo phone book management unit 45 associates the telephone number input from the business card reader unit 44 with the image data and registers it in the logo phone book 24 (step S3).

  The logo phonebook management unit 45 inquires of the business card reader unit 44 whether information indicating a location such as an address has been acquired from the business card from which the logo registered in step S3 has been extracted (step S4). When the location information is acquired in step S2, the business card reader unit 44 notifies the logo phone book management unit 45 of the location information. The logo phone book management unit 45 registers the location information notified from the business card reader unit 44 in the logo phone book 24 in association with the logo registered in step S3 (step S5). Further, the logo phone book management unit 45 obtains the latitude and longitude of the location described on the business card and registers them in the logo phone book 24 in association with the logo registered in step S3 (step S6).

  On the other hand, if the location information has not been acquired in step S2, the business card reader unit 44 notifies the logo phonebook management unit 45 that the location information has not been acquired. The process for the imaged business card is terminated.

  The logo phone book management unit 45 updates the registered number list 25 every time processing for one business card is completed. FIG. 6 is a diagram illustrating an example of the registration number list 25. The registered number list 25 represents the number of communication destinations registered in association with the logo for each of the logos registered in the logo phone book 24. In the example of FIG. 6, the number of communication destinations registered in association with each logo is recorded in association with the logo ID for identifying each logo. FIG. 6 shows an example of the registration number list 25. The registration number list 25 can be arbitrarily changed according to the implementation, such as including information such as a logo image.

  Next, an example of a method in which the user selects a logo shown in a photographed image and places a call to a communication destination associated with the selected logo will be described. In the following description, a communication method for determining a communication destination by selecting a logo or the like registered in the logo telephone directory 24 may be referred to as “image selection communication”.

  FIG. 7 is a diagram illustrating an example of a photograph taken by the user. The photograph of FIG. 7 includes the logos of M Corporation and Q Corporation. Assume that the user designates image selection communication as the transmission method by inputting from the input unit 17 after the photograph of FIG. 7 is captured by the camera 19 and displayed on the touch panel. Then, the pattern extraction part 51 extracts an image pattern from the image data displayed on the touch panel.

  FIG. 8 is a diagram illustrating an example of a method for extracting an image pattern from image data displayed on the touch panel. Here, the coordinates on the touch panel are expressed using XY coordinates with the upper left corner of the screen of the touch panel as the origin as shown in FIG. The pattern extraction unit 51 selects an area having the same size and the same shape as the display area from the image data, and compares it with the image pattern. An area in the image data to be compared with the image pattern may be described as a “comparison area”. Further, when comparing the pixels included in the image pattern with the pixels included in the comparison area 60, the coordinates of the pixel are i on the horizontal axis as shown in FIG. 8B with the upper left corner of the image pattern as the origin. It is expressed using the axis and the j-axis of the vertical axis.

  The pattern extraction unit 51 uses one of the images (logos) registered in the logo phone book 24 as an image pattern, and checks whether the image pattern is included in the image data. When a plurality of logos are registered in the logo phone book 24, the pattern extraction unit 51 confirms whether or not the first logo is included, and then confirms the second logo in the same manner. It is confirmed whether all logos registered in 24 are included in the image data. In order to confirm whether the logo is included in the image data, the pattern extraction unit 51 scans the image data displayed on the touch panel and compares a part of the image data with the image pattern.

  Here, an example of the image data scanning method will be described. Here, the touch panel screen is assumed to have G pixels in the X-axis direction and H pixels in the Y-axis direction. The size of the image pattern is assumed to be K pixels in the i-axis direction and L pixels in the j-axis direction.

  First, as shown in FIG. 8A, the pattern extraction unit 51 indicates the degree of coincidence between the comparison area 60 and the image pattern when the origin of the comparison area 60 is matched with the origin of the screen of the touch panel. Find the value of the evaluation function. By this processing, the pattern extraction unit 51 acquires the value of the evaluation function when the XY coordinates of the comparison area 60 are (0, 0). The pattern extraction unit 51 stores the obtained evaluation function value in the RAM 23 or the like in association with the XY coordinate value of the origin of the comparison region 60. A specific example of the evaluation function calculation method will be described later. Next, the pattern extraction unit 51 changes the XY coordinate of the origin of the comparison area 60 to (1, 0), and obtains and stores the evaluation function values of the comparison area 60 and the image pattern. Similarly, the pattern extraction unit 51 increments the X coordinate of the origin of the comparison area 60 by 1 until the coordinate of the origin of the comparison area 60 becomes (G−K, 0), and the comparison area 60 and the image pattern. The evaluation function is calculated, and the obtained value is stored as appropriate.

  When the processing when the XY coordinate of the origin of the comparison area 60 is (G−K, 0) is completed, the pattern extraction unit 51 performs the process when the Y coordinate of the comparison area 60 is 1 and the Y coordinate is 0. Process in the same way. That is, the evaluation function of the comparison area 60 and the image pattern was calculated while increasing the X coordinate of the origin of the comparison area 60 by 1 from the case where the value of the X coordinate is 0 to GG. Store the value as appropriate. Furthermore, the pattern extraction unit 51 increments the Y coordinate value of the comparison area 60 by 1 and repeats the same processing as when the Y coordinate value of the origin of the comparison area 60 is 0 or 1. The calculation is repeated until the value of the origin of the comparison area 60 becomes (G−K, H−L). That is, the image pattern matches the comparison area 60 for each of the comparison areas 60 when the XY coordinates of the origin of the comparison area 60 are shifted by 1 pixel from (0, 0) to (GK, HL). A value of the evaluation function indicating the degree is obtained. Further, the value of the obtained evaluation function is appropriately stored in the RAM 23 or the like.

  With the above processing, the pattern extraction unit 51 scans the image data so that all pixels on the touch panel are compared with the image pattern in order to calculate the evaluation function in one or more comparison regions 60. Note that the scanning method described here is an example, and the scanning method may be arbitrarily changed depending on the implementation. For example, the pattern extraction unit 51 can repeat scanning by increasing the value of the X coordinate after scanning while changing the Y coordinate when the X coordinate is 0. Furthermore, the timing at which the pattern extraction unit 51 stores the value of the evaluation function, the storage location, and the like may be arbitrarily changed.

  The pattern extraction unit 51 extracts a position where the same image as the image pattern is displayed by comparing the obtained evaluation function values. Next, examples of evaluation function calculation methods and comparison methods will be described. The pattern extraction unit 51 can use an arbitrary evaluation function such as Sum of Absolute Difference (SAD) or Sum of Squared Difference (SSD). When processing using SAD, the pattern extraction unit 51 calculates a difference in which the luminance of the first pixel in the image pattern is compared with the luminance of the second pixel included in the comparison region 60, The sum of the obtained differences is obtained. As described above, assuming that the image pattern has a size of K pixels in the horizontal direction and L pixels in the vertical direction, the value of the evaluation function for a certain comparison region 60 is obtained based on the following equation.

Vp (i, j) in the equation is the luminance of the pixel located at the coordinate (i, j) in the image pattern when the coordinate of the pixel at the upper left corner of the image pattern is (0,0). Vg (i, j) is the luminance of the pixel located at the coordinates (i, j) of the comparison region 60 when the coordinates of the upper left corner pixel of the comparison region 60 are (0,0). Therefore, here, the smaller the value of the evaluation function, the higher the degree of matching between the image pattern and the image displayed in the comparison area 60. The pattern extraction unit 51 compares the evaluation function values obtained for each of the comparison regions 60 to obtain the minimum value of the evaluation function. Further, the pattern extraction unit 51 specifies the position of the comparison region 60 when the evaluation function becomes the minimum value by using the XY coordinates of the origin of the comparison region 60.

  The pattern extraction unit 51 compares the minimum value of the evaluation function obtained by scanning the image data with a threshold value stored in advance. When the minimum value of the evaluation function is smaller than the threshold value, the pattern extraction unit 51 determines that the data displayed in the comparison area 60 matches the image pattern for the comparison area 60 in which the evaluation function is the minimum value. judge. In this case, the comparison area 60 determined to match the image pattern is a display area in the image data. For example, when the photograph of FIG. 7 is scanned using the logo of Q Corporation as an image pattern, a display area 70 surrounded by a dotted line in FIG. 9A is extracted. When the display area 70 is extracted, the pattern extraction unit 51 notifies the position data acquisition unit 52 of an identifier for identifying the image pattern displayed in the display area 70. For example, in the case of the display area 70 in FIG. 9A, the image pattern is a logo of Q Corporation, so the pattern extraction unit 51 indicates that the display area 70 of “Logo 4” has been extracted. Notify

  When the display area 70 is extracted, the position data acquisition unit 52 represents the position of the display area 70 using XY coordinates with reference to the upper left corner of the touch panel. FIG. 9B is an enlarged view of a portion surrounded by the rectangle (80) in FIG. For example, the position data acquisition unit 52 can obtain the XY coordinates of the upper left corner 71 and the lower right corner 72 of the display area 70 as shown in FIG. The position data acquisition unit 52 can also access the pattern extraction unit 51, the display control unit 46, and the like as appropriate when obtaining the coordinates of the upper left corner 71 and the lower right corner 72 of the display area 70. The position data acquisition unit 52 records the XY coordinates of the upper left corner 71 and the lower right corner 72 in the position data table 26 in association with the logo ID that identifies the logo displayed in the display area 70. In the example of FIG. 9B, as shown in A of FIG. 10, the coordinates (x1, y1) of the upper left corner 71 and the coordinates (x2, y2) of the lower right corner 72 of the display area 70 are the identifier of the logo 4 and Correspondingly recorded.

  Next, it is assumed that the pattern extraction unit 51 scans an image pattern corresponding to a logo of N Corporation with the logo 3 identifier. The scanning method and the evaluation function calculation method are as described above. Here, it is assumed that the minimum value of the evaluation function obtained by scanning is larger than the threshold value. In this case, the pattern extraction unit 51 determines that the image pattern is not included in the image data, and ends the process for the image pattern to be processed.

  The pattern extraction unit 51 scans image data using each logo registered in the logo telephone directory 24 as an image pattern. Further, the position data acquisition unit 52 specifies the position of the display area 70 in response to the notification from the pattern extraction unit 51 and records it in the position data table 26 together with the logo identifier. FIG. 10 is an example of the position data table 26 generated based on the photograph shown in FIG. In the example of FIG. 10, information about the logo of Q Corporation is recorded in A, and information about the logo of M Corporation is recorded in B.

  When the generation of the position data table 26 is finished, the position data acquisition unit 52 notifies the identifier acquisition unit 53 and the display control unit 46 that the position data table 26 has been generated. Upon receiving the notification, the display control unit 46 refers to the coordinates included in the position data table 26 and instructs the display unit 13 to display the outline of the display area 70 on the screen of the touch panel. When the display unit 13 displays the outline of the display area 70, the user can easily recognize the position of the display area 70. For example, the display control unit 46 can instruct the display unit 13 to display the outline of the display region 70 with a blue line. When the outline of the display area 70 is displayed, the user can communicate with the communication destination associated with the logo image by inputting the position where the logo image displayed in the display area 70 is displayed. Can be recognized. For example, the user visually recognizes the outline of the display area 70 and touches the position where the logo image displayed in the display area 70 is displayed with a finger, so that the communication destination associated with the logo image is displayed. Recognize that you can communicate.

  FIG. 11 is a diagram illustrating an example in which the outline of the display area 70 is displayed in the image data. The example of FIG. 11 illustrates a case where the display control unit 46 displays the outlines of the display area 70a and the display area 70b.

  When the notification from the position data acquisition unit 52 is received, the identifier acquisition unit 53 requests the input control unit 47 to notify the coordinates of the position where contact with the screen is detected. When the coordinates at which contact is detected are notified, the identifier acquisition unit 53 refers to the position data table 26 and determines whether the notified coordinates are included in the display area 70. When the input coordinates are included in the display area 70, the identifier acquisition unit 53 further specifies an identifier for identifying the logo displayed in the display area 70 based on the position data table 26.

For example, when the position data table 26 shown in FIG. 10 is used, the identifier acquisition unit 53 specifies the coordinates included in each display area 70 as follows.
Coordinates included in region A: x1 ≦ x ≦ x2 and y1 ≦ y ≦ y2
Coordinates included in region B: x3 ≦ x ≦ x4 and y3 ≦ y ≦ y4

  In FIG. 11, it is assumed that the position where the user touches with a finger is (x5, y5) on the touch panel. Then, the identifier acquisition unit 53 determines that the user is in contact with the display area 70a by determining that x1 ≦ x5 ≦ x2 and further y1 ≦ y5 ≦ y2. Furthermore, the identifier acquisition unit 53 also recognizes that the logo identified by the logo 4 is displayed in the display area 70 a by referring to the position data table 26. The identifier acquisition unit 53 notifies the communication unit 54 of the acquired logo ID.

  On the other hand, when it is determined that the display area 70 is not touched or the identifier of the display area 70 cannot be specified, the identifier acquisition unit 53 discards the notified coordinates and notifies the input control unit 47 of new coordinates. Wait for.

  Upon receiving the logo ID, the communication unit 54 refers to the registered number list 25. When the number of telephone numbers registered in association with the notified logo ID is one, the communication unit 54 refers to the logo telephone book 24 and makes a call to the telephone number associated with the logo ID. Request to the call control unit 42. For example, when the logo 4 is notified from the identifier acquisition unit 53, the number of registered telephone numbers associated with the logo 4 is one in the registration number list 25 shown in FIG. Therefore, when the communication unit 54 recognizes that the telephone number 5 is associated with the logo with the identifier of the logo 4 by referring to the logo telephone directory 24 shown in FIG. The call control unit 42 is requested to make a call.

  On the other hand, in FIG. 6, three telephone numbers are associated with the logo 1. Therefore, when the identifier notified to the communication unit 54 is the logo 1, the communication unit 54 cannot uniquely identify the communication destination from the logo ID. As described above, when the communication destination cannot be uniquely identified from the notified logo ID, the communication unit 54 searches the logo telephone directory 24 for a communication destination corresponding to the notified logo ID and generates a list.

  FIG. 12 is a diagram illustrating an example of a list generated by the communication unit 54. The communication unit 54 outputs the generated list to the communication destination notification unit 55. The communication destination notification unit 55 displays a selection screen for selecting a communication destination on the screen of the display unit 13.

  FIG. 13 is a diagram showing an example of a selection screen displayed based on the search result shown in FIG. In the example of FIG. 13, the telephone number and name associated with the logo 1 are shown for each communication destination, but the type of information and the number of information displayed on the selection screen to identify each communication destination May be arbitrarily changed according to the implementation. The communication destination notification unit 55 generates the same number of identification regions 90 (90a to 90c) on the screen of the display unit 13 as the number of communication destinations included in the input list. The communication destination notification unit 55 displays identification information one by one in each identification area 90. Further, the communication destination notification unit 55 holds an identification area table in which information specifying the position of the identification area 90 is associated with identification information such as a displayed telephone number. FIG. 14 shows an example of the identification area table.

  When the communication destination notification unit 55 displays the selection screen, the communication destination notification unit 55 requests the input control unit 47 to notify the coordinates of the position where contact with the screen of the mobile phone terminal is detected. When the coordinates at which contact is detected are notified, the communication destination notification unit 55 recognizes the selected telephone number based on the result of comparing the notified coordinates with the identification area table. The process for recognizing the telephone number selected based on the notified coordinates or the like is the same as the method described in the operation of the identifier acquisition unit 53. The communication destination notification unit 55 notifies the communication unit 54 of the telephone number selected by the user. The communication unit 54 requests the call control unit 42 to make a call to the notified telephone number. A call to the selected telephone number is performed by processing of the call control unit 42 and the like.

  FIG. 15 is a flowchart illustrating an example of an operation when transmission is performed by selecting a logo in the communication device according to the first embodiment. In the flowchart of FIG. 15, steps S <b> 11 to S <b> 13, S <b> 15, and S <b> 16 are processes of the pattern extraction unit 51, and step S <b> 14 is a process of the position data acquisition unit 52. Step S17 is performed by the display control unit 46, step S18 is performed by the identifier acquisition unit 53, steps S19 to S21 and S23 are performed by the communication unit 54, and step S22 is performed by the communication destination notification unit 55. In the flowchart of FIG. 15, the variable n is used to specify the logo to be processed. N is a constant representing the total number of logos registered in the logo phone book 24.

  The pattern extraction unit 51 sets the variable n to 1 when the image selection communication is selected by the user (step S11). The pattern extraction unit 51 acquires an image of the logo recorded in the nth in the logo telephone directory 24 and uses it as an image pattern (step S12). The pattern extraction unit 51 checks whether or not the acquired image pattern is included in the display data displayed on the screen of the display unit 13 (step S13). When the display pattern includes an image pattern, the position data acquisition unit 52 represents the position where the image pattern is displayed using coordinates based on the upper left corner of the screen of the touch panel. The coordinates are recorded in the position data table 26 (step S14). When the scanning of the image data for the nth logo is completed, the pattern extraction unit 51 compares the value of n with N. If n is less than or equal to N, the pattern extraction unit 51 increments n by 1 and then returns to step S12 (step S15). , S16). Steps S12 to S16 are repeated until image data is scanned using all logo images recorded in the logo phone book 24. If n is greater than or equal to N in step S15, it is confirmed whether all logos included in the logo phone book 24 are included in the image data. Therefore, the display control unit 46 displays the outline of the display area 70 specified by the position data table 26 so that the user can visually recognize it (step S17).

  The identifier acquisition unit 53 acquires an identifier for identifying the logo selected by the user (step S18). When the logo is selected, the communication unit 54 searches the telephone number associated with the selected logo from the logo phone book 24, and when one telephone number is obtained by the search, the obtained telephone number is displayed. It is displayed on the screen of the unit 13 (steps S19 and S20). When a plurality of telephone numbers are obtained by the search, the communication unit 54 notifies the communication destination notification unit 55 of the obtained numbers. The communication destination notification unit 55 displays the notified telephone number on the screen of the display unit 13, and notifies the communication unit 54 of the telephone number selected by the user (steps S20 to S22). The communication unit 54 calls the selected telephone number (step S23). If only one number is displayed in step S21, the communication unit 54 calls the displayed telephone number (steps S21 and S23). When the communication destination responds after the transmission in step S23, the user talks with the communication destination.

  The operation illustrated in FIG. 15 is an example, and can be changed according to the implementation. For example, the mobile phone terminal may be changed so that step S20 is performed when there are two or more telephone numbers registered in association with one logo.

  As described above, according to the present embodiment, when the image data captured by the user with the camera 19 includes the logo image of the communication destination, the user specifies information for specifying the position where the logo image is displayed. By inputting, it is possible to make a call to a communication destination. Therefore, when the user is in front of the communication company, the user picks up the logo image he is viewing with the camera 19 and touches the position where the logo image on the touch panel screen is displayed, so that the user can easily make a call. Can be applied. That is, in an environment in which the user can capture a logo attached to a building or a catalog, the user of the mobile terminal device according to the present embodiment can easily perform without searching for image data or a telephone number associated with a communication destination. You can make a call to the other party.

  In the above example, the case of making a call to the communication destination has been described. However, the user may send a fax or an e-mail, for example, by touching the position where the logo of the communication destination is displayed on the touch panel screen. it can. In this case, the communication unit 54 acquires a fax number or mail address from the logo telephone directory 24 according to the communication means selected by the user.

<Second Embodiment>
The communication device 10 according to the second embodiment includes a location acquisition unit 35, and changes the display order of communication destinations as selection candidates using the location information of the user and the location information of the communication destination. be able to. In the second embodiment, a mobile phone terminal provided with a touch panel will be described as an example. In the following description, a point where the communication device 10 such as a mobile phone terminal is located may be referred to as “device location”.

  FIG. 16 is a flowchart for explaining an example of an operation when transmission is performed by selecting a logo in the communication device according to the second embodiment. Steps S31 to S39 in FIG. 16 are the same as steps S11 to S19 described with reference to FIG. That is, also in the second embodiment, the procedure from the generation of the logo phone book 24 to the search of the logo phone book 24 using the logo image displayed in the display area 70 where the user contact is detected is the first procedure. This is the same as the embodiment.

  The communication unit 54 checks whether or not a plurality of telephone numbers are obtained as a result of searching the logo phone book 24 using the logo image displayed in the display area 70 where the user's contact is detected (step S40). . Here, it is assumed that the logo of M Corporation is selected in step S38, and three telephone numbers shown in FIG. 12 are searched. As described above, when a plurality of telephone numbers are acquired, the communication unit 54 notifies the communication destination notification unit 55 of the obtained telephone number. The communication destination notification unit 55 requests the location acquisition unit 35 for information specifying the device location. For example, the communication destination notification unit 55 requests the location acquisition unit 35 for the latitude and longitude of the device location. The location acquisition unit 35 acquires the latitude and longitude of the device location by GPS positioning (step S41). The location acquisition unit 35 notifies the communication destination notification unit 55 of the acquired information.

The communication destination notification unit 55 obtains the difference between the latitude and longitude of the location associated with each telephone number and the latitude and longitude of the device location. Further, the communication destination notifying unit 55 requests the display control unit 46 to display the screens of the display unit 13 in order from the telephone number associated with the location close to the device location. For example, assume that the device location is 35.575 degrees north latitude and 139.65 degrees east longitude. The latitude and longitude of the location associated with the searched three telephone numbers are as shown in FIG. Then, the difference between latitude and longitude is as follows.
Difference from location 1: latitude difference 0.111 degrees, longitude difference 0.08 degrees Difference from location 2: latitude difference 0.006 degrees, longitude difference -0.01 degrees Difference from location 6: latitude difference -0. 873 degrees, longitude difference -4.15 degrees

  Therefore, the sum of the absolute values of the latitude difference and the longitude difference is the smallest at location 2 and the largest at location 6. Accordingly, the communication destination notification unit 55 determines that, of the locations 1, 2, and 6, location 2 is the closest to the device location and location 6 is the farthest from the device location. Therefore, the communication destination notification unit 55 requests the input control unit 47 to display the telephone number on the screen as shown in FIG. 17, and waits for an input from the user (step S42). Further, the communication destination notification unit 55 holds an identification area table associated with the telephone number displayed in the identification area 91 as in the first embodiment. The processes in steps S43, S45, and S46, such as the method for recognizing the selected telephone number and the method for communicating with the selected communication destination, are the same as steps S22 to S24 described in the first embodiment.

  On the other hand, when there is one telephone number recorded in association with the logo image displayed in the display area 70 where the user's contact is detected, the communication unit 54 displays the obtained telephone number on the display unit 13. The display unit 13 displays the data on the screen (step S44). Thereafter, the communication unit 54 makes a call to the selected communication destination (step S45). Note that the operation of the communication unit 54 is modified to make a call after confirming that the user has selected a call via the input unit 17 or the like after outputting the telephone number to the display unit 13 in step S44. Sometimes.

  Note that the operation described with reference to FIG. 16 is an example, and may be modified depending on the implementation. For example, the communication destination notification unit 55 determines the location associated with the device location and the telephone number notified from the communication unit 54 from the difference between the latitude and longitude between the device location and the location associated with the searched telephone number. The distance between can also be obtained. In this case, the communication destination notification unit 55 determines the order in which the telephone numbers notified from the communication unit 54 are displayed on the screen using the obtained distance length.

  As described above, in the second embodiment, as in the first embodiment, by selecting the logo displayed on the screen of the display unit 13, the user can make a call to the communication destination. Further, when a plurality of telephone numbers are registered in the logo selected by the user, the telephone numbers associated with the logo selected by the user are displayed in order from the telephone number associated with the position near the device location. . Therefore, the user can select and communicate with the nearest communication destination without confirming the locations associated with the plurality of telephone numbers.

<Others>
The present invention is not limited to the above-described embodiment, and can be variously modified. Some examples are described below.

  The pattern extraction unit 51 can confirm whether an image pattern is included for arbitrary image data displayed on the screen of the display unit 13 as well as the image data captured by the camera 19. For example, even when the image data stored in the storage unit 20 in advance by the communication device 10 is displayed on the touch panel, the pattern extraction unit 51 is displayed on the touch panel by the same operation as in the first embodiment. An image pattern can be extracted from the image data. In addition, even before a landscape or the like is imaged by the camera 19, an imaging target may be displayed on the screen of the display unit 13 such as a touch panel. In this case, the pattern extraction unit 51 can similarly extract an image pattern from an image displayed on the screen as an imaging target.

  The method described with reference to FIGS. 8 and 9 is an example of extracting an image pattern from image data displayed on the touch panel, and the operation of the pattern extraction unit 51 can be changed according to the implementation. For example, in order to cope with the case where the image pattern registered in the logo phone book 24 and the logo included in the display unit 13 such as the touch panel are different, the pattern extraction unit 51 sets the size of the image pattern. It can be deformed so that it can be enlarged or reduced. In this case, the size of the comparison area 60 and the display area 70 also varies according to the size of the image pattern. Furthermore, the pattern extraction unit 51 can appropriately add a modification that can rotate the image pattern when comparing the image pattern with the comparison region 60.

  In addition, the pattern extraction unit 51 converts an image or an image pattern displayed on the screen of the display unit 13 into a binary binary image, and the image pattern is likely to be included in the image data. The display area 70 can be obtained after the area is specified in advance. In this case, since the pattern extraction unit 51 performs comparison with the image pattern only for the region identified as having a high possibility of including the image pattern, the processing load on the pattern extraction unit 51 is reduced.

  In addition, the pattern extraction unit 51 may be modified so that any image processing technique useful for confirming whether the image pattern is included in the image data can be used.

  Furthermore, when generating the logo phone book 24, the mobile phone terminal can also send the address information to another device such as a base station and receive the calculation result of latitude and longitude. In this case, the logo telephone directory management unit 45 does not calculate latitude and longitude, so the processing load on the mobile phone terminal is reduced.

  Even in the case of the communication apparatus 10 that does not include a touch panel, the communication described in the embodiment can be performed by the communication apparatus 10 that includes an arbitrary display device and an arbitrary pointing device such as a mouse or a pen tablet. In this case, the user inputs a position on the screen using a pointing device.

  In the above description, the case where the business card reader unit 44 reads the business card and generates the logo phone book 24 is described as an example of the creation method of the logo phone book 24. In addition, information from the input control unit 47 or the camera control unit 43 can be received and registered in the logo telephone directory 24. In this case, the user can also register an image recorded on something other than a business card such as a photo in the logo phonebook management unit 45. In the above description, the case where the image pattern is a logo has been described as an example. However, the image pattern is not limited to a logo, and may be, for example, a landscape or a human face photo. Further, the shape of the image pattern may be changed according to the mounting, and the shape of the comparison area 60 and the display area 70 and the contents of the data registered in the position data table 26 are also changed according to the shape of the image pattern. Sometimes. For example, when the shape of the image pattern is a circle, the shape of the comparison region 60 and the display region 70 is also a circle. Further, the coordinates of the center of the display area 70 and the radius of the display area 70 are recorded in the position data table 26.

DESCRIPTION OF SYMBOLS 10 Communication apparatus 11 Antenna 12 Wireless communication part 13 Display part 14 Microphone 15 Speaker 16 Voice input / output part 17 Input part 18 Position input part 19 Camera 20 Storage part 21 Program storage part 22 Data storage part 23 RAM
24 logo phone book 25 registration number list 26 position data table 30 processor 40 control unit 41 wireless control unit 42 call control unit 43 camera control unit 44 business card reader unit 45 logo phone book management unit 46 display control unit 47 input control unit 50 logo transmission Unit 51 pattern extraction unit 52 position data acquisition unit 53 identifier acquisition unit 54 communication unit 55 communication destination notification unit 60 comparison area 70 display area 90, 91 identification area

Claims (3)

A storage unit for storing an image pattern in association with identification information for identifying a communication destination;
A pattern extraction unit for extracting the image pattern from the captured image data;
An identifier acquisition unit that refers to the storage unit and acquires identification information associated with the image pattern extracted by the pattern extraction unit;
A communication device comprising: a communication unit that starts communication with a communication destination identified by the identification information acquired by the identifier acquisition unit. A communication method executed by a communication device,
The communication device is
Referring to a storage unit that stores an image pattern in association with identification information for identifying a communication destination, and extracting the image pattern from the captured image data;
Obtaining identification information associated with the extracted image pattern from the storage unit;
Communication with the communication destination identified by the acquired said identification information is started. The communication method characterized by the above-mentioned. On the computer,
A pattern extracting step of referring to a storage unit that stores an image pattern in association with identification information for identifying a communication destination, and extracting the image pattern from captured image data;
An identifier acquisition step of acquiring identification information associated with the image pattern extracted in the pattern extraction step from the storage unit;
A communication step of starting communication with a communication destination identified by the identification information acquired in the identifier acquisition step;
A communication program characterized in that