JP2014215965A - Information processing apparatus, information processing method and information processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing apparatus and an information processing method which enable smooth purchase of a commodity whose price is displayed with a foreign currency by simplifying price calculation at different currency units.SOLUTION: There is provided a mobile terminal 1 which includes: a camera 11 which inputs a price image; an image recognition part 13 which recognizes the image of the number shown in the price image inputted by the camera 11; a conversion rate specification part 14 which specifies a conversion rate between a currency unit corresponding to price information and a currency unit different from the currency unit on the basis of currency unit specification information; a calculation part 15 which calculates the price at the different currency unit corresponding to the price information on the basis of the conversion rate specified by the conversion rate specification part 14; and a notification part 17 which notifies of the price at the different currency unit calculated by the calculation part 15.

Description

  The present invention relates to an information processing apparatus that recognizes money, an information processing method, and an information processing program.

  2. Description of the Related Art Conventionally, a technique for acquiring the price of a product using a camera such as a mobile terminal or a QR code (registered trademark) is known. For example, Patent Document 1 describes that a price is acquired based on price tag information taken with a camera of a mobile terminal. In Patent Document 1, the price of peripheral stores based on the position information is also acquired by acquiring the position information of the shooting location along with the price tag information.

JP2011-48591A

  Here, it is conceivable to acquire the price displayed in the foreign currency using the technique described above. However, for example, if the price is displayed in the price of a currency unit in a country that is not familiar to the purchaser, the purchaser does not know the exchange rate of the currency, so immediately when looking at the price I can't get a sense of the price. In such a case, the purchaser needs to check the exchange rate and calculate the price of the home currency unit based on the exchange rate. This makes it troublesome to purchase products overseas.

  The present invention has been made in view of the above problems, and provides an information processing apparatus and an information processing method that can facilitate the purchase of products displayed in prices in foreign currencies by simplifying the calculation of prices in different currency units. The purpose is to do.

  In order to solve the above problems, an information processing apparatus according to the present invention includes an input unit that inputs a price image including price information that is information indicating a price, and a number indicated in the price image input by the input unit. The image recognition means for image recognition, the conversion rate specifying means for specifying the conversion rate between the currency unit corresponding to the price information and the currency unit different from the currency unit based on the currency unit specifying information, and the conversion rate specifying means Based on the converted rate, a calculation unit that calculates a price of a different currency unit corresponding to the price information and a notification unit that notifies the price of a different currency unit calculated by the calculation unit are provided.

  According to this invention, the conversion rate of the currency unit shown in the price image is specified based on the currency unit specifying information. By using the currency unit specifying information, it is possible to easily specify the conversion rate of the currency unit. In addition, since the price of different currency units calculated by the calculation unit is notified to the purchaser of the product by the notification unit, the purchaser of the product can grasp the different currency unit without performing rate calculation or the like. That is, it is possible to simplify the price calculation for different currency units, and to smoothly purchase products displayed in prices in foreign currencies.

  In the information processing apparatus of the present invention, the image recognition means recognizes the currency symbol shown in the price image, and the conversion rate identification means uses the currency symbol recognized by the image recognition means as currency unit identification information. Use. Thereby, the specific precision of a currency unit and by extension, the specific precision of a conversion rate can be made high.

  The information processing apparatus according to the present invention further includes position acquisition means for acquiring position information indicating the position of the information processing apparatus, and the conversion rate specifying means uses the position information acquired by the position acquisition means as currency unit specifying information. Use. Thereby, the specific precision of a currency unit and by extension, the specific precision of a conversion rate can be made high.

  In the information processing apparatus according to the present invention, the notifying unit superimposes and displays the price of the different currency unit calculated by the calculating unit on the price image input by the input unit. By superimposing and displaying on the image input by the input means, it becomes easier for the purchaser of the product and the like to more intuitively understand the price in different currency units.

  The information processing apparatus according to the present invention further includes storage means for storing the exchange rate for each currency unit, and the conversion rate specifying means is configured to convert the currency unit corresponding to the price information based on the exchange rate stored in the storage means. Specify the conversion rate. By specifying the conversion rate of the currency unit from the exchange rate stored in the information processing apparatus, the conversion rate specifying process can be performed quickly.

  The information processing method of the present invention includes an input step of inputting a price image including price information which is information indicating a price, an image recognition step of recognizing a number indicated in the price image input in the input step, and a price The conversion rate specifying step for specifying the conversion rate between the currency unit corresponding to the information and the currency unit different from the currency unit based on the currency unit specifying information, and the price based on the conversion rate specified in the conversion rate specifying step A calculation step of calculating a price of a different currency unit corresponding to the information; and a notification step of notifying a price of the different currency unit calculated in the calculation step. This information processing method can achieve the same effects as the information processing apparatus described above.

  An information processing program of the present invention includes an input module for inputting a price image including price information which is information indicating a price, an image recognition module for recognizing a number indicated in the price image input by the input module, and a price A conversion rate specifying module for specifying a conversion rate between a currency unit corresponding to the information and a currency unit different from the currency unit based on the currency unit specifying information, and a price based on the conversion rate specified by the conversion rate specifying module. A calculation module that calculates a price of a different currency unit corresponding to the information; and a notification module that notifies the price of a different currency unit calculated by the calculation module. The information processing program can achieve the same effects as the information processing apparatus and the information processing method described above.

  According to the present invention, by simplifying price conversion between different currencies, it is possible to smoothly purchase products displayed in prices in foreign currencies.

It is a block diagram which shows the function of the portable terminal which concerns on this embodiment. It is a figure which shows the example of the exchange rate memorize | stored in the memory | storage part. It is a figure which shows the superimposed display image by a notification part. It is a hardware block diagram of a portable terminal. It is a flowchart which shows the process of the portable terminal which concerns on this embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Where possible, the same parts are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 is a block diagram illustrating functions of the mobile terminal 1 according to the present embodiment. As shown in FIG. 1, the mobile terminal 1 includes a camera 11, a position acquisition unit 12, an image recognition unit 13, a conversion rate specifying unit 14, a calculation unit 15, a storage unit 16, a notification unit 17, It has. The portable terminal 1 is an information processing apparatus, and is a portable device such as a smartphone or a communication terminal such as a PC terminal. Hereinafter, each functional block will be described based on the functional blocks shown in FIG.

  The camera 11 has a function as an input means for inputting a price image including price information, which is information indicating the price of a product or service (hereinafter referred to as a product), to the image recognition unit 13 and the notification unit 17. . Price information is, for example, a price tag of a product or the like. Price information such as merchandise may include information including both numbers and currency symbols (for example, $ 100), or may include only numbers (for example, 100). The camera 11 inputs the price image to the image recognition unit 13 and the notification unit 17 at intervals of several ms to several tens of ms.

  The position acquisition unit 12 functions as a position acquisition unit that acquires position information of the mobile terminal 1 by base station positioning using the reception status of radio waves transmitted from the base station, GPS positioning using GPS, or the like. It is what has. The position acquisition unit 12 acquires the position information of the mobile terminal 1 at intervals of, for example, several seconds to several tens of seconds, and inputs the acquired position information to the conversion rate specifying unit 14.

  The image recognizing unit 13 has a function as image recognizing means for recognizing the number indicated in the price image input by the camera 11. Image recognition by the image recognition unit 13 is performed by a conventionally known technique, for example, an OCR (Optical Character Recognition) technique, and is displayed on a price display by referring to a plurality of pre-registered number patterns. Recognize numbers.

  Moreover, the image recognition part 13 is good also as image-recognizing the currency symbol shown by the price image. In this case, it is necessary to register in advance also the patterns of currency symbols of a plurality of currencies. The image-recognized currency symbol becomes currency unit specifying information described later. The image recognition unit 13 inputs the result of image recognition to the calculation unit 15 and the conversion rate specifying unit 14.

  Further, when recognizing a price image, the image recognition unit 13 acquires price display position information indicating a position where price information is displayed in the price image. Then, the image recognition unit 13 associates the price image with the price display position information in the price image and inputs the linked image to the calculation unit 15.

  The conversion rate specifying unit 14 has a function as a conversion rate specifying means for specifying a currency unit corresponding to price information and a conversion rate between the currency unit and a different currency unit based on the currency unit specifying information. Specifically, the conversion rate specifying unit 14 performs a currency unit specifying process for specifying the currency unit based on the currency unit specifying information and a conversion rate specifying process for specifying the conversion rate of the specified currency unit.

  The currency unit specifying information used for the currency unit specifying process by the conversion rate specifying unit 14 is information that uniquely specifies the currency unit by acquiring the information. The conversion rate specifying unit 14 specifies a currency unit using, for example, the currency symbol recognized by the image recognition unit 13 as currency unit specifying information. Moreover, the conversion rate specific | specification part 14 specifies a currency unit, for example using the positional information on the portable terminal 1 acquired by the position acquisition part 12 as currency unit specific information. Since at least the country in which the mobile terminal 1 is located can be specified from the position information of the mobile terminal 1, the currency unit distributed in the country can be specified.

  The conversion rate specifying unit 14 uses both the currency symbol recognized by the image recognition unit 13 and the position information of the mobile terminal 1 acquired by the position acquisition unit 12 as currency unit specifying information. Units can also be specified. According to this, even when there are a plurality of currency symbol candidates image-recognized by the image recognition unit 13 (when one currency symbol cannot be identified by image recognition), the position of the mobile terminal 1 Since the country in which the mobile terminal 1 is located can be identified from the information, it is possible to identify a suitable currency unit by excluding the currency symbol of the currency unit that is not the currency unit of the country by using the location information as an auxiliary.

  The conversion rate specifying process by the conversion rate specifying unit 14 is performed based on the currency unit specified in the currency unit specifying process and the exchange rate stored in the storage unit 16. The conversion rate specifying unit 14 inputs the conversion rate of the specific currency unit specified in the conversion rate specifying process to the calculation unit 15. The exchange rate stored in the storage unit 16 is a conversion rate with another currency for each currency unit. The exchange rate stored in the storage unit 16 will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of the exchange rate stored in the storage unit 16. For example, when the currency unit is specified to be $ (dollar), the dollar conversion rate can be specified from the US column (second line of the table) in FIG. That is, the conversion rate can be specified as 1 dollar is 93.1 yen, 0.767 euro, and 1.02 Canadian dollars.

  Returning to FIG. 1, the storage unit 16 is a storage unit that communicates with the exchange rate update device 21 provided on the cloud via the Internet line or the like, and acquires and stores the latest exchange rate. The exchange rate update device 21 updates the exchange rate in real time. The storage unit 16 communicates with the exchange rate update device 21 every few minutes to several tens of minutes, for example, and updates the exchange rate to the latest rate. Even if the storage unit 16 cannot communicate with the exchange rate update device 21, the storage unit 16 stores the exchange rate at the time of the last communication with the exchange rate update device 21. The conversion rate can be specified by the conversion rate specifying unit 14.

  Based on the number indicated in the price image input from the image recognizing unit 13 and the conversion rate of the specific currency unit input from the conversion rate specifying unit 14, the calculation unit 15 refers to the specific currency unit. It has a function as a calculation means for calculating a price in different currency unit conversion. For example, assume that the conversion rate specifying unit 14 specifies the currency unit as dollars, and the conversion rate specifying unit 14 inputs the conversion rate in the American column (second row of the table) in FIG. The conversion rate represents the amount of each currency unit for 1 dollar. For example, when the number shown in the price image input from the image recognition unit 13 is 100, the price in yen is calculated as 100 dollars = 93.1 yen × 100 = 9310 yen. The currency unit for which the price is to be calculated (different currency units) may be set in advance or may be set for each price calculation. Such settings are input to the calculation unit 15.

  The calculation unit 15 associates the calculated price in different currency units with the price image input from the image recognition unit 13 and the price display position information in the price image, and inputs them to the notification unit 17.

  The notification unit 17 has a function as a notification unit that superimposes and displays the price of the currency unit (different currency unit) to be calculated input from the calculation unit 15 on the price image input from the camera 11. AR (AUGMENTED REALITY) technology that has been conventionally known is used for superimposed display on a price image.

  Specifically, since the price display position information in the image is input from the calculation unit 15 together with the price display position information from the calculation unit 15, the notification unit 17 displays the vicinity of the position indicated in the price display position information in a different currency unit. The price is specified as the position to be superimposed. And the price of the different currency unit input from the calculation part 15 is superimposed and displayed on the specified position for superimposed display.

  It should be noted that different currency unit prices may be superimposed and displayed not at the vicinity of the position indicated in the price display position information but at the location of the price display position itself. In this case, the local price is not displayed on the screen, and only the price in a different currency unit displayed in a superimposed manner is displayed.

  Here, the image for which the notification unit 17 superimposes and displays the price in different currency units is created based on the price image input from the camera 11, but as described above, the camera 11 has several ms to several Since the price images are input at intervals of 10 ms, even if the superimposed display position is determined based on the price image input from the camera 11, the actual position may be different. It is not preferable to superimpose and display prices in different currency units based on the input price display position information.

  Therefore, the notification unit 17 specifies how much the price display position in the price image input from the camera 11 has changed compared to the price display position in the price image input from the calculation unit 15 (tracks the price display position). The amount of change is specified), and the price in different currency units is superimposed on the price image input from the camera 11 in consideration of the amount of change. As described above, such superimposed display is realized by the AR technology that has been conventionally known.

  Since the calculation unit 15 associates the price in different currency units with the price display position information in the price image input from the image recognition unit 13 and inputs it to the notification unit 17, for example, as shown in FIG. As described above, even when two or more pieces of price information are included in one image, it is possible to appropriately display the superimposed display portions 201 and 202 of the price.

  For parts other than the price image, for example, “SAVE” in FIG. 3, the translation result into the designated language may be displayed as “discount”. In this case, the translation result by the dictionary may be displayed in a superimposed manner without referring to the real-time conversion rate as in the price image. Note that there are already services such as “Depress and Translate” made by NTT Docomo and “Google Translate” made by Google as examples for translating the language in the image into another language and displaying it.

  Next, the hardware configuration of the mobile terminal 1 will be described with reference to FIG. FIG. 4 is a hardware configuration diagram of the mobile terminal 1. As shown in FIG. 4, the portable terminal 1 shown in FIG. 1 physically includes a CPU 101, a RAM 102 and a ROM 103, which are main storage devices, an input device 104, which is an input device, an output device 105 such as a display, and a network card. The communication module 106 is a data transmission / reception device such as an auxiliary storage device 107 such as a semiconductor memory. Each function in FIG. 1 operates the input device 104, the output device 105, and the communication module 106 under the control of the CPU 101 by loading predetermined computer software on the hardware such as the CPU 101 and the RAM 102 shown in FIG. In addition, it is realized by reading and writing data in the RAM 102 and the auxiliary storage device 107.

  Next, the process of the portable terminal 1 according to the present embodiment configured as described above will be described. FIG. 5 is a flowchart showing processing of the mobile terminal 1 according to the present embodiment.

  First, a currency unit whose price is to be calculated is input to the calculation unit 15 by a user operation (S1). After setting the currency unit, a price image including price information such as a price tag of the product is input to the image recognition unit 13 and the notification unit 17 by the camera of the mobile terminal 1 (S2, input step).

  Subsequently, the image recognition unit 13 recognizes the number and the currency symbol shown in the price image input by the camera 11 (S3, image recognition step). The image recognition result is input to the calculation unit 15 and the conversion rate specifying unit 14. Further, the price display position information in the price image is acquired by the image recognition unit 13, and the price image and the price display position information in the price image are input to the calculation unit 15.

  Subsequently, it is determined whether or not the position information of the portable terminal 1 can be acquired by the position acquisition unit 12 (S4). If the position information can be acquired, the position information is acquired and input to the conversion rate specifying unit 14. And the conversion rate specific | specification part 14 uses the positional information on the portable terminal 1 as currency unit specific information, and specifies a currency unit (S5, conversion rate specific step).

  On the other hand, when the position information cannot be obtained in S4, the conversion rate specifying unit 14 uses the currency symbol shown in the price image recognized by the image recognition unit 13 as the currency unit specifying information to specify the currency unit. (S6, conversion rate specifying step).

  Subsequently, the conversion rate specifying unit 14 acquires the exchange rate for each currency unit stored in the storage unit 16 (S7, conversion rate specifying step). Based on the exchange rate, the conversion rate specifying unit 14 specifies the conversion rate of the currency unit indicated in the price image (S8, conversion rate specifying step). The conversion rate is input to the calculation unit 15 by the conversion rate specifying unit 14.

  Subsequently, using the number indicated in the price image input by the image recognition unit 13 and the conversion rate input by the conversion rate specifying unit 14, the currency unit to be calculated by the calculating unit 15 (a currency different from the specific currency unit) Unit price) is calculated (S9, calculation step). The calculation result and the price image input by the image recognition unit 13 and the price display position in the price image are input to the notification unit 17 by the calculation unit 15.

  Finally, the notification unit 17 superimposes and displays the price of the different currency unit input by the calculation unit 15 on the price image input by the camera 11 (S10, notification step). With the above, a series of processing of the mobile terminal 1 ends.

  Next, an information processing program for causing a computer to function as the portable terminal 1 will be described. The information processing program is provided by being stored in a computer-readable recording medium. Specifically, the information processing program includes an input module for inputting a price image including price information that is information indicating a price, and an input module. Conversion that identifies the image recognition module that recognizes the number indicated in the input price image and the conversion rate between the currency unit corresponding to the price information and the currency unit different from the currency unit based on the currency unit identification information Based on the rate identification module, the conversion rate identified by the conversion rate identification module, a calculation module that calculates the price of different currency units corresponding to the price information, and the price of the different currency units calculated by the calculation module A notification module. Each of the modules described above operates according to the flowchart shown in FIG.

  Next, the effect of the portable terminal 1 of this embodiment is demonstrated. According to the mobile terminal 1 of the present embodiment, the conversion rate of the currency unit indicated in the price image is specified based on the currency unit specifying information. By using the currency unit specifying information, it is possible to easily specify the conversion rate of the currency unit. In addition, since the price of different currency units calculated by the calculation unit 15 is notified to the purchaser of the product by the notification unit 17, the purchaser of the product etc. can select a different currency unit without calculating the rate by himself / herself. I can grasp. That is, it is possible to simplify the price calculation for different currency units, and to smoothly purchase products and the like whose prices are displayed in foreign currencies.

  In the mobile terminal 1 of the present embodiment, the image recognition unit 13 recognizes the currency symbol indicated in the price image, and the conversion rate identification unit 14 identifies the currency symbol recognized by the image recognition unit 13 as a currency unit. By specifying the currency unit as information, the currency unit can be specified from the currency symbol that is actually image-recognized, so that the accuracy of specifying the currency unit, and thus the accuracy of specifying the conversion rate, can be increased.

  The mobile terminal 1 of the present embodiment further includes a position acquisition unit 12 that acquires position information indicating the position of the mobile terminal 1, and the conversion rate specifying unit 14 uses the position information acquired by the position acquisition unit 12 as currency. By using it as unit specifying information, it is possible to increase the accuracy of specifying the currency unit, and hence the accuracy of specifying the conversion rate.

  Further, in the mobile terminal 1 of the present embodiment, the notification unit 17 displays the price in a different currency unit on the price image input by the camera 11, thereby displaying the currency unit in an image that can be visually recognized by a purchaser such as a product. Since the price is displayed in a superimposed manner, it becomes easier to grasp the price of different currency units more intuitively.

  Further, the mobile terminal 1 of the present embodiment further includes a storage unit 16 that stores the exchange rate for each currency unit, and the conversion rate specifying unit 14 uses the exchange rate stored in the storage unit 16 to calculate price information. Identify the conversion rate for the corresponding currency unit. By specifying the conversion rate of the currency unit from the exchange rate stored in the mobile terminal 1, the conversion rate specifying process can be performed quickly.

  The preferred embodiments of the present invention have been described above. However, the present invention is not limited to the above-described embodiments. The present invention is modified without departing from the scope described in the claims or applied to others. It may be.

  For example, the notification of the price in different currency units by the notification unit 17 is not necessarily limited to the superimposed display on the image, but may be anything that can notify the purchaser of the product etc. of the price in different currency units. That is, you may notify the price of a different currency unit with another display method, an audio | voice, etc.

  Further, the information processing apparatus is not limited to the portable terminal 1 and may be a server apparatus or the like. Each function of the information processing apparatus may be implemented by a plurality of terminals. For example, each function other than the storage unit 16 may be held by a mobile terminal, and the storage unit 16 may be held by a server device. Good.

  Further, the information processing apparatus may be a glasses-type terminal including a head mounted display. In the portable terminal 1 described above, the price in a different currency unit is superimposed and displayed on the price image input by the camera 11, but when the information processing apparatus is a glasses-type terminal, the user actually uses the glasses-type terminal. A superimposed image is displayed on a real-world object visually recognized. Therefore, when the information processing apparatus is a glasses-type terminal, the position where the superimposed image is superimposed is determined based on the price image, and the superimposed image is displayed on the head-mounted display display surface of the glasses-type terminal.

  DESCRIPTION OF SYMBOLS 1 ... Portable terminal, 11 ... Camera, 12 ... Position acquisition part, 13 ... Image recognition part, 14 ... Conversion rate specific | specification part, 15 ... Calculation part, 16 ... Memory | storage part, 17 ... Notification part, 21 ... Exchange rate update apparatus, 101 ... CPU, 102 ... RAM, 103 ... ROM, 104 ... input device, 105 ... output device, 106 ... communication module, 107 ... auxiliary storage device.

Claims (7)

Input means for inputting a price image including price information which is information indicating the price;
Image recognition means for recognizing the number indicated in the price image input by the input means;
A conversion rate specifying means for specifying a conversion rate between a currency unit corresponding to the price information and a currency unit different from the currency unit based on the currency unit specifying information;
Calculation means for calculating a price of the different currency unit corresponding to the price information based on the conversion rate specified by the conversion rate specifying means;
Notification means for notifying the price of different currency units calculated by the calculation means;
An information processing apparatus comprising: The image recognition means recognizes the currency symbol indicated in the price image,
The information processing apparatus according to claim 1, wherein the conversion rate specifying unit uses a currency symbol image-recognized by the image recognition unit as the currency unit specifying information. It further comprises position acquisition means for acquiring position information indicating the position of the information processing device,
The information processing apparatus according to claim 1, wherein the conversion rate specifying unit uses the position information acquired by the position acquiring unit as the currency unit specifying information.   The information processing apparatus according to claim 1, wherein the notification unit superimposes and displays the price of a different currency unit calculated by the calculation unit on the price image input by the input unit. A storage means for storing the exchange rate for each currency unit;
The information processing according to any one of claims 1 to 4, wherein the conversion rate specifying unit specifies a conversion rate in a currency unit corresponding to the price information based on an exchange rate stored in the storage unit. apparatus. An input step for inputting a price image including price information which is information indicating a price;
An image recognition step for recognizing the number indicated in the price image input in the input step;
A conversion rate specifying step of specifying a conversion rate between a currency unit corresponding to the price information and a currency unit different from the currency unit based on the currency unit specifying information;
A calculation step of calculating a price of the different currency unit corresponding to the price information based on the conversion rate specified in the conversion rate specifying step;
A notification step of notifying the price of the different currency unit calculated in the calculation step;
An information processing method including: An input module for inputting a price image including price information which is information indicating a price;
An image recognition module for recognizing the number indicated in the price image input by the input module;
A conversion rate specifying module for specifying a conversion rate between a currency unit corresponding to the price information and a currency unit different from the currency unit based on the currency unit specifying information;
A calculation module for calculating a price of the different currency unit corresponding to the price information based on the conversion rate specified by the conversion rate specifying module;
A notification module for notifying prices of different currency units calculated by the calculation module;
An information processing program comprising:

Images