GB2560877A - Improvements in or relating to currency conversion - Google Patents

Improvements in or relating to currency conversion Download PDF

Info

Publication number
GB2560877A
GB2560877A GB1702130.4A GB201702130A GB2560877A GB 2560877 A GB2560877 A GB 2560877A GB 201702130 A GB201702130 A GB 201702130A GB 2560877 A GB2560877 A GB 2560877A
Authority
GB
United Kingdom
Prior art keywords
operable
image
user device
identified
engine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB1702130.4A
Other versions
GB201702130D0 (en
Inventor
Pye Robert
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to GB1702130.4A priority Critical patent/GB2560877A/en
Publication of GB201702130D0 publication Critical patent/GB201702130D0/en
Publication of GB2560877A publication Critical patent/GB2560877A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/12—Hotels or restaurants
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/38—Payment protocols; Details thereof
    • G06Q20/381—Currency conversion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0283—Price estimation or determination

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Strategic Management (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Engineering & Computer Science (AREA)
  • General Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Health & Medical Sciences (AREA)
  • Primary Health Care (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Character Discrimination (AREA)

Abstract

A method of using a user device 100 comprises; capturing an image containing listed prices; performing optical character recognition (OCR) on the image to identify alphanumeric characters; identifying which character relate to price information; converting the identified price information into a price in a desired currency; outputting the converted price information on a display unit 10. The currency conversion could use a locally stored or online exchange rate. The image could be captured using a camera. The display could show the image with the converted price information placed over the relevant location. The method could be used to convert prices on a menu 1. An alternative method of using a user device comprises capturing images; extracting and converting information within the image and determining the location of the extracted and converted information; and displaying the image but with the converted information displayed over the determined location.

Description

(54) Title of the Invention: Improvements in or relating to currency conversion Abstract Title: Converting the currency of prices in a captured image (57) A method of using a user device 100 comprises; capturing an image containing listed prices; performing optical character recognition (OCR) on the image to identify alphanumeric characters; identifying which character relate to price information; converting the identified price information into a price in a desired currency; outputting the converted price information on a display unit 10. The currency conversion could use a locally stored or online exchange rate. The image could be captured using a camera. The display could show the image with the converted price information placed over the relevant location. The method could be used to convert prices on a menu 1. An alternative method of using a user device comprises capturing images; extracting and converting information within the image and determining the location of the extracted and converted information; and displaying the image but with the converted information displayed over the determined location.
fO(7 ,/ / /' / /// , /// / .//
(0 ,, I
IMPROVEMENTS IN OR RELATING TO CURRENCY CONVERSION
Technical Field of the Invention
The present invention relates to currency conversion. In particular, the present invention relates to providing currency conversion of prices listed in menus or the like.
Background to the Invention
When travelling to countries that use a different currency, travellers often prefer to convert costs to their local currency. This provides the traveller with a better idea of the actual cost of items and/or the impact of proposed spending on their budget. Traditionally, travellers may achieve this conversion by calculation based on the exchange rate between the currencies.
Carrying out the currency conversion calculations mentally can be prone to error, particularly for instances where the exchange rate is not a simple fraction.
Accordingly, many travellers prefer to use an electronic calculator, or a calculator app on a smartphone or the like, to calculate currency conversions. This can however be 15 inconvenient, particularly when presented with a large number of different prices to convert. Such a situation may typically occur when presented with a menu in a restaurant, cafe or the like.
A further issue is that the traveller may not know the current exchange rate. Accordingly, the traveller (or their conversion app) may need to either approximate the calculation or look up the current exchange rate. Looking up the rate may involve utilising mobile data. In many instances mobile data roaming charges could add a significant additional expense.
It is therefore an object of the invention to address the above problems.
Summary of the Invention
According to a first aspect of the present invention there is provided a user device operable to convert listed prices to a desired currency, the device comprising: a 5 camera operable to capture images containing the listed prices; an OCR (optical character recognition) engine operable to process the images captured by the camera and identify alphanumeric characters therein; a price extraction engine operable to process the alphanumeric characters identified by the OCR engine and identify which such characters relate to price information; a conversion engine operable to convert the identified price information into price information in a desired currency; and a display unit operable to output converted price information.
The device of the above application thus allows for identification and conversion of multiple prices within a captured image into a desired currency. As such, a user may be directly able to view and compare multiple converted prices on a menu or the like.
The user device is preferably a portable user device. Suitable portable user devices include, but are not limited to: smartphones, tablet computers, laptop computers augmented reality goggles or the like. The device may be provided with user actuable input means. Such input means may comprise one or more keys, buttons, pointing 20 devices or the like. Additionally or alternatively, the input means may comprise a touchscreen.
The conversion engine may be operable to convert the identified price information by looking up a stored exchange rate in internal device storage. The stored exchange rate may be input by a user. In this manner, the conversion engine may be operable to use a stored exchange rate determined by the user. This can beneficially ensure that the device can carry out conversions without requiring a data connection.
Accordingly, a cost conscious user does not have to make provision for data roaming charges to use the present invention when travelling.
The exchange rate may be looked up on demand from a remote device or system. This can enable variations in the exchange rate to be tracked. The remote look up may take place in response to user input. In this manner, the user can ensure that the device does not perform a look up unless user initiated. This thereby prevents use of data connections without user input and thus, a cost conscious user does not have to make provision for data roaming charges to use the present invention when travelling.
The camera may be operable to capture a single still image for processing. Alternatively, the camera may be operable to capture a series of still images for processing. In such embodiments, one captured image may be selected periodically for processing. For example, every 25th captured image may be selected. This can provide an updated price output approximately every second with a typical camera. This can allow a balance between updating output as the camera moves without overburdening the processing capacity of the device.
The OCR engine may be operable to perform OCR by any suitable method. The
OCR engine may be operable to output an array of alphanumeric strings. The OCR engine may be operable to determine any or all of the colour, background colour, size, location, font or stylisation of the identified alphanumeric characters within the captured image.
The price extraction engine may be operable to identify price information by identifying strings within the array that comprise adjacent sequences of numeric characters and separator characters. In this context, separator characters may comprise commas, periods, hyphens or the like. The price extraction engine may additionally or alternatively be operable to identify price information by identifying strings within the array that contain a currency character or a substring of characters that identify a currency. Currency characters may include $, £, € or the like. Substrings of characters that identify a currency may include USD, GBP, EUR or the like.
The price extraction engine may then be operable to determine whether the price 10 information relates to an integer value of currency or a combination of an integer value and a fractional value. For currencies where fractional values of one hundredth of the currency unit are permitted, the price extraction engine may be operable to determine that a separator character followed by two numeric characters is indicative that the value comprises an integer value and a fractional value. The price extraction engine may be operable to determine that a separator character followed by three numeric characters is indicative that the value comprises an integer value. This might typically occur where the separator character is used as a thousand delimiter within an integer value. Where a string comprises different separator characters, the price extraction engine may be operable to determine that one separator character is a thousand delimiter and the other separation character is a fraction delimiter.
The display unit may be operable to display the converted price information alongside or over the captured image. In a preferred embodiment, the display unit is operable to display the converted price information over the locations within the captured image containing identified price information. In order for this to be achieved, the display unit may be operable in response to the location information derived by the
OCR engine. Additionally or alternatively, the device may comprise a location engine operable in response to the OCR engine to determine the location of each string of alphanumeric characters within the captured image. This allows the location of each item of identified price information within the captured image to be accurately determined or verified. The location engine may further be operable to determine the extent of the area occupied by each item of identified price information within the captured image.
The display unit may be operable to vary any or all of the colour, background 10 colour, size, location, font or stylisation of the displayed converted price information in response to the OCR engine. This can enable the displayed converted price information to, as closely as is practical, correspond to the appearance of the captured price information. The displayed price information may include a currency character or currency substring identifying the currency into which the price is converted.
In embodiments wherein the device is operable to capture a series of still images for processing, the device may be provided with a history filter operable to increase the stability of the displayed price information. The history filter may be operable to store information relating to identified image features following processing of an initial captured image. When a subsequent captured image is processed, the image features identified in the subsequent image may be compared to the stored information. This can enable determination that image features identified in successive captured images are the same and may be used to filter out anomalous outputs. In a preferred embodiment image features suitable for comparison comprise blocks or strings of alphanumeric characters. In such cases, the image features may be identified by a particular sequence or spacing of alphanumeric characters and/or particular location within the captured image.
In a preferred embodiment, the history filter may be able to identify and store details of separate image features in an initial captured image. The history filter may be operable to assign a presence coefficient to each identified image feature in the initial image. In one embodiment, the history filter may be operable to assign a presence coefficient value of 1 for each separate identified image feature in the initial image.
The history filter may be operable to identify image features within each subsequent image. Once image features are identified in a subsequent captured image, the history filter may be operable to compare the image features identified in the subsequent image to the stored image features. Where image features identified within the new image match stored image features, the history filter may be operable to increment the presence coefficient value for the matching features. Where image features identified within the new image do not match any stored image features, the history filter may be operable to assign a new presence coefficient to each unmatched image feature. Where stored image features do not match any image features identified within the subsequent image, the history filter may be operable to decrement the presence coefficient value for the unmatched image features.
The history filter may be operable to determine that an identified image feature matches a stored image feature if the sequence or spacing of alphanumeric characters is identical or differs by less than a character threshold value. The character threshold value may be determined in relation to the number of characters that differ and/or in respect of the nature of any differences between characters. Additionally or alternatively, the history filter may be operable to determine that an identified image feature matches a stored image feature if the location is identical or differs by less than a location threshold value. The use of thresholds reduces false identification of new features in subsequent images.
The history filter may be operable to automatically delete details of identified image features having a presence coefficient of less than a deletion threshold value. Additionally or alternatively, the history filter may be operable to automatically delete all stored information related to all identified blocks upon restart.
The history filter may be operable to output the presence coefficient for each 10 identified block or string. The price extraction engine, conversion engine and/or display unit may be operable in response to the output presence coefficients to block processing and/or display of specific image features. In particular, the processing or display of image features with a presence coefficient of less than a display threshold value may be blocked.
The information stored by the history filter may be reset automatically when a new sequence of captured images is initiated. Additionally or alternatively, the information stored by the history filter may be reset in response to user input.
The device may comprise a motion engine operable to determine motion of the device. The motion engine may be operable to determine motion in response to the output of a suitable motion sensor. Suitable motion sensors include but are not limited to accelerometers, gyroscopes and the like. Typically, the motion engine may be operable to determine the motion that occurs between successive polling intervals. If the motion between successive polling intervals exceeds a motion threshold value, the motion engine may be operable to halt operation of the camera, price extraction engine, conversion engine, location engine, history filter and/or display unit. This halts processing where it is determined that the device is too unstable to capture suitable images.
The history filter may be operable in response to the motion engine to vary the location threshold value. This can allow the history filter to compensate for motion in assessing whether locations of identified image features match.
The display unit may be operable in response to the motion engine to vary the location of displayed price information. This can enable the display unit to compensate for motion of the device when displaying price information in a suitable position.
According to a second aspect of the present invention there is provided a method of converting listed prices to a desired currency, the method comprising the steps of capturing an image containing the listed prices; performing OCR on the captured image to identify alphanumeric characters therein; identifying which such characters relate to price information; converting the identified price information into a price in a desired currency; and outputting the converted price information on a display unit.
The method of the second aspect of the invention may incorporate any or all features of the device of the first aspect of the present invention as desired or as appropriate.
According to a third aspect of the present invention there is provided a user device operable to output converted information extracted from captured images on a display unit, the user device comprising: a camera operable to capture images; means for extracting and converting information within the captured images; a location engine operable to determine the location of extracted and converted information within the captured image; and a display unit operable to output converted information over the captured image, the converted information displayed over the locations within the captured image containing extracted and converted information.
The device of the third aspect of the present invention may incorporate any or all features of the first two aspects of the present invention as desired or as appropriate.
According to a fourth aspect of the present invention there is provided a method for outputting converted information extracted from captured images, the method comprising: capturing images; extracting and converting information within the captured images; determining the location of extracted and converted information within the captured image; and displaying converted information over the captured image, the converted information displayed over the locations within the captured image containing extracted and converted information
The method of the fourth aspect of the present invention may incorporate any or all features of the first three aspects of the present invention as desired or as appropriate.
Detailed Description of the Invention
In order that the invention may be more clearly understood one or more embodiments thereof will now be described, by way of example only, with reference to the accompanying drawings, of which:
Figure 1 is a schematic illustration of the device in use for implementing the present invention;
Figure 2a is a schematic illustration of an image captured by the device in figure 1
Figure 2b is a schematic illustration of the converted display output of figure 2a resulting from the implementation of the present invention; and
Figure 3 is a schematic block diagram of a device operable to implement the 5 present invention.
The present invention relates to providing automated price conversion into a desired currency of prices contained in a captured image. In the example of figure 1, a user is presented with a menu 1, listing the prices of various meal options. The prices are listed in a local currency, say US dollars ($).
In order to achieve conversion, the user utilises a suitably adapted device 100 such as a smartphone or tablet computer to capture an image of all or part of the menu with an integral camera. Typically, the camera may have a field of view 21 as illustrated in figure 1.
In non-conversion operation, capture of an image would result in the integral 15 display unit 10 of the device 100 outputting an image as shown in figure 2a. The captured image comprises a series of image features 11-16. The image features 11-13 are descriptions of items on the menu. The image features 14-16 are the prices of the listed items.
In conversion operation, image features comprising price information are 20 extracted from the image and converted from the local currency to a desired currency using the relevant exchange rate. Subsequently, the converted price information is displayed over the captured image as is shown in figure 2b. In this example, the prices have been converted to pounds sterling and the converted price information is displayed in boxes 17-19 over image features 14-16. This therefore provides for identification and conversion of multiple prices within a captured image into a desired currency. As such, the user may be directly able to view and compare multiple converted prices on the menu 1.
Turning now to figure 3, a schematic block diagram of the device for implementing the invention is shown. As indicated previously, the device 100 is provided with a display unit 10 and a camera 20. The display unit 10 is typically a touchscreen and thus provides user input means. The skilled man will however appreciate that other forms of user input means may additionally or alternatively be provided.
The camera 20 is connected to an OCR engine 30 operable to process the captured image and identify alphanumeric characters therein. In particular, the OCR engine 30 outputs an array of alphanumeric strings and can determine any or all of: the colour, background colour, size, location, font or stylisation of the identified alphanumeric characters within the captured image. In addition, the OCR engine is connected to a location engine 70 operable to determine or verify the location of each of the strings in the array within the captured image. The location engine 70 can ensure greater accuracy in location output than the OCR engine 30.
The OCR engine 30 is connected to a price extraction engine 40 operable to identify price information by identifying strings within the array that comprise adjacent sequences of numeric characters and separator characters (e.g. , . - or the like). In instances where the currency is identified for each price, the price extraction engine 40 may identify price information by identifying strings within the array that contain a currency character (e.g. $, £, € or the like) or a substring of characters that identify a currency (USD, GBP, EUR or the like).
Once price information is extracted, the price extraction engine 40 is then operable to determine whether the price information relates to an integer value of currency or a combination of an integer value and a fractional value. This is to ensure that the correct value is used for conversion.
For many currencies (e.g. $, £, € or the like), the only fractional values permitted are hundredths of the base unit. In such cases the price extraction engine 40 is operable to determine that a separator character followed by two numeric characters is indicative that the value comprises an integer value and a fractional value. Unless the currency permits fractional values of one thousandth of the base unit, the price extraction engine 40 is operable to determine that a separator character followed by three numeric characters is indicative that the value comprises an integer value and the separator character is used as a thousand delimiter within an integer value. Where a string comprises different separator characters, the price extraction engine 40 is operable to determine that one separator character is a thousand delimiter and the other separation character is a fraction delimiter. Typically, the rightmost separator character may be identified as the fraction delimiter.
The output of the price extraction engine 40 is input to a conversion engine 50 operable to convert the identified price information into price information in a desired currency. This is achieved by applying the appropriate exchange rate between the respective currencies. The conversion engine 50 may use an exchange rate from internal device storage. The stored exchange rate can be input by a user, thus ensuring that the device can perform conversions without requiring a data connection. Accordingly, a cost conscious user does not have to make provision for data roaming charges to use the present invention when travelling.
In alternative embodiments, the conversion engine may be operable to utilise a 5 device data connection (not shown) to enable an exchange rate to be looked up from a remote source periodically. This can enable variations in the exchange rate to be tracked.
The output of the conversion engine 50 is then passed to the display unit 10, which is operable to display the converted price information over the captured image as shown in figure 2b. In order for this to be achieved, the display unit 10 may utilise the output of the location engine 70 to determine the location of each item of identified price information within the captured image and the extent of the area occupied by each item of identified price information within the captured image. Where the OCR engine 30 provides information as to the colour, background colour, size, font or stylisation of the displayed converted price information, the display unit 10 is operable to display the converted price information in a format that corresponds, as closely as is practical, to the appearance of the captured price information.
Whilst the above description adequately covers implementation of the invention using a single captured image, it is envisaged that the invention will be implemented using a series of captured images. This would enable the invention to operate with the cameras 20 that are operable to output a succession of still images. Additionally, it allows a user to sweep the device 100 over the menu (or the like) to enable conversion of any prices within the field of view 21. This is particularly helpful if it is not feasible to output a comfortably readable image of the whole menu on the display unit 10 of the device 100.
In embodiments implemented using a series of captured images, the OCR engine 30 may be operable to periodically select one image for processing. In a typical example this may be every 25th captured image. This can provide an updated price output approximately every second with a typical camera 20.
In such implementations, in order to increase the stability of the output price information, the device 100 is provided with a history filter 60. The history filter 60 is operable to store information relating to identified image features following processing 10 of an initial captured image. The image features are typically blocks or strings of alphanumeric characters such as those identified as features 11-16 in figure 2a. The image features can be defined by reference to a particular sequence or spacing of alphanumeric characters and/or particular location within the captured image.
In order to carry out this analysis, the history filter 60 stores details of separate 15 image features in an initial captured image and assigns a presence coefficient value of 1 to each identified image feature in the initial image. Subsequently, the history filter 60 identifies image features within each subsequent image and the identified image features are compared to the stored image features.
The history filter 60 is operable to determine that an identified image feature 20 matches a stored image feature if the sequence or spacing of alphanumeric characters is identical or differs by less than a character threshold value. The character threshold value may relate to an absolute number of characters that differ, a proportion of characters that differ or may relate to the nature of any differences in characters. For instance, where the differing characters are an upper case I and a lower case L, the difference may be assigned less weight than the difference between less similar characters. In addition or alternatively, the history filter 60 is operable to determine that an identified image feature matches a stored image feature if the location is identical or differs by less than a location threshold value.
Where image features identified within the new image match stored image features, the history filter 60 is operable to increment the presence coefficient value for the matching features. Where image features identified within the new image do not match any stored image features, the history filter 60 is operable to assign a new presence coefficient value of 1 to each unmatched image feature. Where stored image features do not match any image features identified within the subsequent image, the history filter 60 is operable to decrement the presence coefficient value for the unmatched image features.
The display unit 10 is operable in response to the history filter 60 so as to display 15 only image features with a presence coefficient of equal to or greater than a display threshold value, say 2. In this manner only converted price information based on image features clearly captured in multiple images are output to a user. This minimises the chances that unclear or incorrect information will be output. In particular, this prevents the output of information when the captured images are unstable, for instance due to excessive movement of the device 100 between successive processed images.
To reduce processing load and memory load, the history filter 60 automatically deletes details of identified image features having a presence coefficient of less than a deletion threshold value. The deletion threshold value may be, say, zero or may be a negative value.
In some embodiments, the device 100 comprises a motion engine 80 operable to determine motion of the device 100 in response to the output of a suitable motion sensor 81. Typically, the motion sensor 81 might be an accelerometer or gyroscope. The motion engine 80 can monitor small movements of the device 100 so that these can be compensated for in processing extracted price information and/or in correctly locating output price information on the display unit 10.
The motion engine 80 is operable to monitor motion that occurs between 10 successive polling intervals. If the motion between successive polling intervals exceeds a motion threshold value, then the device 100 may be considered too unstable to capture and/or process suitable images. In such circumstances, the motion engine 80 may halt operation of any one or more of the camera 20, price extraction engine 40, conversion engine 50, location engine 70, history filter 60 and/or display unit 10.
Where the motion is non-zero but does not exceed the motion threshold, the history filter 60 can use the determined motion to vary the location threshold value. This allows the history filter 60 to compensate for motion in assessing whether locations of identified image features match.
Where the motion is non-zero but does not exceed the motion threshold, the display unit 10 is operable in response to vary the location of displayed price information to match the determined movement. This enables the display unit 10 to compensate for motion of the device 100 when displaying price information.
The above embodiment is described by way of example only. Many variations are possible without departing from the scope of the invention as defined in the appended claims.

Claims (67)

1. A user device operable to convert listed prices to a desired currency, the device comprising: a camera operable to capture images containing the listed prices; an OCR (optical character recognition) engine operable to process the images
5 captured by the camera and identify alphanumeric characters therein; a price extraction engine operable to process the alphanumeric characters identified by the OCR engine and identify which such characters relate to price information; a conversion engine operable to convert the identified price information into price information in a desired currency; and a display unit operable to output
10 converted price information.
2. A user device as claimed in claim 1 wherein the conversion engine is operable to convert the identified price information by looking up a stored exchange rate in internal device storage.
3. A user device as claimed in claim lor claim 2 wherein the exchange rate is
15 looked up on demand from a remote device or system.
4. A user device as claimed in any preceding claim wherein the camera is operable to capture a single still image for processing.
5. A user device as claimed in any one of claims 1 to 3 wherein the camera is operable to capture a series of still images, one captured image selected
20 periodically for processing.
6. A user device as claimed in any preceding claim wherein the OCR engine is operable to output an array of alphanumeric strings.
7. A user device as claimed in claim 6 wherein the price extraction engine is operable to identify price information by identifying strings within the array that comprise adjacent sequences of numeric characters and separator characters.
8. A user device as claimed in any preceding claim wherein the price extraction
5 engine is operable to determine whether the price information relates to an integer value of currency or a combination of an integer value and a fractional value.
9. A user device as claimed in any preceding claim wherein the display unit is operable to display the converted price information over the locations within the
10 captured image containing identified price information.
10. A user device as claimed in any one of claims 6 to 9 wherein the device comprises a location engine operable in response to the OCR engine to determine the location of each string of alphanumeric characters within the captured image.
15
11. A user device as claimed in any preceding claim wherein the OCR engine is operable to determine any or all of the colour, background colour, size, font or stylisation of the identified alphanumeric characters within the captured image and the display unit is operable to vary any or all of the colour, background colour, size, location, font or stylisation of the displayed converted price
20 information in response to the OCR engine.
12. A user device as claimed in any preceding claim wherein the device is provided with a history filter operable to increase the stability of the displayed price information.
13. A user device as claimed in claim 12 wherein the history filter is operable to store information relating to identified image features following processing of an initial captured image.
14. A user device as claimed in claim 13 wherein the history filter is operable to
5 assign a presence coefficient value of 1 to each identified image feature in the initial image.
15. A user device as claimed in claim 13 wherein the history filter is operable, when a subsequent captured image is processed, compare the image features identified in the subsequent image to the stored information.
10
16. A user device as claimed in claim 15 wherein the history filter is operable to determine that an identified image feature matches a stored image feature if the sequence or spacing of alphanumeric characters is identical or differs by less than a character threshold value.
17. A user device as claimed in claim 15 or claim 16 wherein the history filter is
15 operable to determine that an identified image feature matches a stored image feature if the location is identical or differs by less than a location threshold value.
18. A user device as claimed in any one of claims 15 to 17 wherein if image features identified within the new image match stored image features, the history filter
20 is operable to increment the presence coefficient value for the matching features.
19. A user device as claimed in any one of claims 15 to 18 wherein if image features identified within the new image do not match any stored image features, the history filter is operable to assign a new presence coefficient to each unmatched image feature.
20. A user device as claimed in any one of claims 15 to 19 wherein if stored image features do not match any image features identified within the subsequent
5 image, the history filter is operable to decrement the presence coefficient value for the unmatched image features.
21. A user device as claimed in any one of claims 15 to 20 wherein the history filter is operable to automatically delete details of identified images features having a presence coefficient of less than a deletion threshold value.
10
22. A user device as claimed in any one of claims 15 to 21 wherein the history filter is operable to block the processing or display of image features with a presence coefficient of less than a display threshold value.
23. A user device as claimed in any preceding claim wherein the device comprises a motion engine operable to determine motion of the device.
15
24. A user device as claimed in claim 23 wherein the motion engine is operable to determine the motion that occurs between successive polling intervals.
25. A user device as claimed in claim 24 wherein if the motion between successive polling intervals exceeds a motion threshold value, the motion engine is operable to halt operation of the camera, price extraction engine, conversion
20 engine, location engine, history filter and/or display unit.
26. A user device as claimed in any one of claims 23 to 25 wherein the history filter is operable in response to the motion engine to vary the location threshold value.
27. A user device as claimed in any one of claims 23 to 26 wherein the display unit is operable in response to the motion engine to vary the location of displayed price information.
28. A method of converting listed prices to a desired currency, the method
5 comprising the steps of capturing an image containing the listed prices;
performing OCR on the captured image to identify alphanumeric characters therein; identifying which such characters relate to price information; converting the identified price information into a price in a desired currency; and outputting the converted price information on a display unit.
10
29. A method as claimed in claim 28 wherein the identified price information is converted by looking up a stored exchange rate in internal device storage.
30. A method as claimed in claim 28 or claim 29 wherein the exchange rate is looked up on demand from a remote device or system.
31. A method as claimed in any one of claims 28 to 30 wherein a single still image
15 is captured for processing.
32. A method as claimed in any one of claims 28 to 30 wherein a series of still images is captured, one captured image being selected periodically for processing.
33. A method as claimed in any one of claims 28 to 32 wherein the OCR output is an array of alphanumeric strings.
34. A method as claimed in claim 33 wherein price information is identified by identifying strings within the array that comprise adjacent sequences of numeric characters and separator characters.
35. A method as claimed in any one of claims 28 to 34 wherein the method includes
5 determining whether the price information relates to an integer value of currency or a combination of an integer value and a fractional value.
36. A method as claimed in any one of claims 28 to 35 wherein the method includes displaying the converted price information over the locations within the captured image containing identified price information.
10
37. A method as claimed in any one of claims 33 to 36 wherein the method includes determining the location of each string of alphanumeric characters within the captured image.
38. A method as claimed in any one of claims 28 to 37 wherein the OCR output includes any or all of the colour, background colour, size, location, font or
15 stylisation of the identified alphanumeric characters within the captured image and the displayed converted price information varies any or all of the colour, background colour, size, font or stylisation in response.
39. A method as claimed in any one of claims 28 to 38 wherein information relating to identified image features is stored following processing of an initial captured
20 image.
40. A method as claimed in claim 39 wherein a presence coefficient value of 1 is assigned to each identified image feature in the initial image.
41. A method as claimed in claim 40 wherein when a subsequent captured image is processed, image features identified in the subsequent image are compared to the stored information.
42. A method as claimed in claim 40 wherein an identified image feature is
5 determined to match a stored image feature if the sequence or spacing of alphanumeric characters is identical or differs by less than a character threshold value.
43. A method as claimed in claim 40 or claim 41 wherein an identified image feature is determined to match a stored image feature if the location is identical 10 or differs by less than a location threshold value.
44. A method as claimed in any one of claims 40 to 43 wherein if image features identified within the new image match stored image features, the history filter is operable to increment the presence coefficient value for the matching features.
15
45. A method as claimed in any one of claims 40 to 44 wherein if image features identified within the new image do not match any stored image features, a new presence coefficient is assigned to each unmatched image feature.
46. A user device as claimed in any one of claims 40 to 45 wherein if stored image features do not match any image features identified within the subsequent
20 image, the presence coefficient value for the unmatched image features is decremented.
47. A method as claimed in any one of claims 40 to 46 wherein details of identified image features having a presence coefficient of less than a deletion threshold value are automatically deleted.
48. A method as claimed in any one of claims 40 to 46 wherein the processing or
5 display of image features with a presence coefficient of less than a display threshold value is blocked.
49. A method as claimed in any one of claims 28 to 48 wherein the method includes determining motion of the device.
50. A method as claimed in claim 49 wherein the motion that occurs between
10 successive polling intervals is determined.
51. A method as claimed in claim 50 wherein if the motion between successive polling intervals exceeds a motion threshold value, the motion engine is operable to halt processing operation.
52. A method as claimed in any one of claims 49 to 51 wherein the location
15 threshold value is varied in response to the determined motion.
53. A method as claimed in any one of claims 49 to 52 wherein the location of displayed price information is varied in response to the determined motion.
54. A user device operable to output converted information extracted from captured images on a display unit, the user device comprising: a camera operable to 20 capture images; means for extracting and converting information within the captured images; a location engine operable to determine the location of extracted and converted information within the captured image; and a display unit operable to output converted information over the captured image, the converted information displayed over the locations within the captured image containing extracted and converted information.
55. A user device as claimed in claim 54 wherein the device comprises a motion
5 engine operable to determine motion of the device.
56. A user device as claimed in claim 55 wherein the motion engine is operable to determine the motion that occurs between successive polling intervals.
57. A user device as claimed in claim 55 or claim 56 wherein the display unit is operable in response to the motion engine to vary the location of displayed price
10 information.
58. A user device as claimed in any one of claims 54 to 57 wherein the device comprises an OCR (optical character recognition) engine operable to process the images captured by the camera and identify alphanumeric characters therein.
59. A user device as claimed in claim 58 wherein the OCR engine is operable to
15 determine any or all of the colour, background colour, size, font or stylisation of the identified alphanumeric characters within the captured image and the display unit is operable to vary any or all of the colour, background colour, size, location, font or stylisation of the displayed converted price information in response to the OCR engine.
20
60. A user device as claimed in any one of claims 56 to 59 wherein if the motion between successive polling intervals exceeds a motion threshold value, the motion engine is operable to halt operation of one or more device features.
61. A method for outputting converted information extracted from captured images, the method comprising: capturing images; extracting and converting information within the captured images; determining the location of extracted and converted information within the captured image; and displaying converted
5 information over the captured image, the converted information displayed over the locations within the captured image containing extracted and converted information.
62. A method as claimed in claim 61 wherein the method includes determining motion of the device.
10
63. A method as claimed in claim 62 wherein the motion that occurs between successive polling intervals is determined.
64. A method as claimed in claim 62 or claim 63 wherein the location of displayed price information is varied in response to the determined motion.
65. A method as claimed in any one of claims 61 to 64 wherein the method includes
15 the step of performing OCR on the captured image to identify alphanumeric characters therein.
66. A method as claimed in claim 65 wherein the OCR output includes any or all of the colour, background colour, size, font or stylisation of the identified alphanumeric characters within the captured image and the displayed converted
20 price information varies any or all of the colour, background colour, size, location, font or stylisation in response.
67. A method as claimed in any one of claims 63 to 66 wherein if the motion between successive polling intervals exceeds a motion threshold value, the motion engine is operable to halt operation of one or more device features.
Intellectual
Property
Office
Application No: GB 170213 0.4 Examiner: Peter Doenhoff
GB1702130.4A 2017-02-09 2017-02-09 Improvements in or relating to currency conversion Withdrawn GB2560877A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB1702130.4A GB2560877A (en) 2017-02-09 2017-02-09 Improvements in or relating to currency conversion

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB1702130.4A GB2560877A (en) 2017-02-09 2017-02-09 Improvements in or relating to currency conversion

Publications (2)

Publication Number Publication Date
GB201702130D0 GB201702130D0 (en) 2017-03-29
GB2560877A true GB2560877A (en) 2018-10-03

Family

ID=58462106

Family Applications (1)

Application Number Title Priority Date Filing Date
GB1702130.4A Withdrawn GB2560877A (en) 2017-02-09 2017-02-09 Improvements in or relating to currency conversion

Country Status (1)

Country Link
GB (1) GB2560877A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3816908A1 (en) * 2019-11-01 2021-05-05 NTT Communications Corporation Settlement system and settlement method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004318434A (en) * 2003-04-15 2004-11-11 Nec Saitama Ltd Portable telephone set with character recognizing function
JP2010103694A (en) * 2008-10-22 2010-05-06 Seiko Precision Inc Camera with translation function, and method of displaying text
JP2014081888A (en) * 2012-10-18 2014-05-08 Zenrin Datacom Co Ltd Order support device, order support method and order support program
JP2014215965A (en) * 2013-04-30 2014-11-17 株式会社Ｎｔｔドコモ Information processing apparatus, information processing method and information processing program
JP2014215964A (en) * 2013-04-30 2014-11-17 株式会社Ｎｔｔドコモ Information processing apparatus, information processing method, and information processing program

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004318434A (en) * 2003-04-15 2004-11-11 Nec Saitama Ltd Portable telephone set with character recognizing function
JP2010103694A (en) * 2008-10-22 2010-05-06 Seiko Precision Inc Camera with translation function, and method of displaying text
JP2014081888A (en) * 2012-10-18 2014-05-08 Zenrin Datacom Co Ltd Order support device, order support method and order support program
JP2014215965A (en) * 2013-04-30 2014-11-17 株式会社Ｎｔｔドコモ Information processing apparatus, information processing method and information processing program
JP2014215964A (en) * 2013-04-30 2014-11-17 株式会社Ｎｔｔドコモ Information processing apparatus, information processing method, and information processing program

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3816908A1 (en) * 2019-11-01 2021-05-05 NTT Communications Corporation Settlement system and settlement method
US20210133716A1 (en) * 2019-11-01 2021-05-06 Ntt Communications Corporation Settlement system and settlement method
US20220261780A1 (en) * 2019-11-01 2022-08-18 Ntt Communications Corporation Settlement system and settlement method
EP4060585A1 (en) * 2019-11-01 2022-09-21 NTT Communications Corporation Settlement system and settlement method
US11829974B2 (en) 2019-11-01 2023-11-28 Ntt Communications Corporation Settlement system and settlement method
US11880816B2 (en) 2019-11-01 2024-01-23 Ntt Communications Corporation Settlement system and settlement method

Also Published As

Publication number Publication date
GB201702130D0 (en) 2017-03-29

Similar Documents

Publication Publication Date Title
US10126825B2 (en) Method for recognizing handwriting on a physical surface
CN112637629B (en) Live content recommendation method and device, electronic equipment and medium
CN105517679B (en) Determination of the geographic location of a user
CN109189879B (en) Electronic book display method and device
US20140247997A1 (en) Information processing system, information processing method, and computer program product
JP2018524678A (en) Business discovery from images
CN107766349B (en) Method, device, equipment and client for generating text
JP2017187850A (en) Image processing system, information processing device, and program
US20180157682A1 (en) Image information processing system
US20150026012A1 (en) Systems and methods for online presentation of storefront images
EP4254222A2 (en) Visual menu
US9607216B2 (en) Identifying updated content in images
CN113705390B (en) Positioning method, positioning device, electronic equipment and storage medium
US10229320B1 (en) Method and system to provide the details about the product item that the user is looking for and providing the navigation map for the selected item presented in the store
GB2560877A (en) Improvements in or relating to currency conversion
WO2023138546A1 (en) Information processing method and apparatus, electronic device, and storage medium
CN111552829A (en) Method and apparatus for analyzing image material
KR20150101846A (en) Image classification service system based on a sketch user equipment, service equipment, service method based on sketch and computer readable medium having computer program recorded therefor
JP7098689B2 (en) Information processing equipment, information processing methods and information processing programs
CN109084750B (en) Navigation method and electronic equipment
JP5541868B2 (en) Image search command system and operation control method thereof
CN112200190A (en) Method and device for determining position of point of interest, electronic equipment and storage medium
EP4060521A1 (en) Method for providing tag, and electronic device for supporting same
CN112035692B (en) Picture information searching method and device, computer system and readable storage medium
US12008221B2 (en) Method for providing tag, and electronic device for supporting same

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)