WO2023010152A1

WO2023010152A1 - Processing of financial transactions using a video communication system

Info

Publication number: WO2023010152A1
Application number: PCT/AU2021/050866
Authority: WO
Inventors: Abbas Talanehzar; Mahtab Lahijany
Original assignee: Abbas Talanehzar; Mahtab Lahijany
Priority date: 2021-08-06
Filing date: 2021-08-06
Publication date: 2023-02-09

Abstract

This invention relates generally to the processing of financial transactions using a video communication system. Summary of the Disclosure [0002] There is provided herein a video communication system comprising a communication server which establishes video and bidirectional audio communication between at least one viewer terminal on a mobile recording device across a wide area network. [0003] The mobile recording device comprises audio and video Interfaces for capturing audio and video. [0004] The viewer terminal comprises a digital display to display a video feed captured by the mobile recording device. Furthermore, the viewer terminal comprises an audio capture interface for bidirectional audio communication with the mobile recording device. [0005] The digital display of the viewer terminal is controlled to display a user interface operable to display information regarding a retail item detected as being in proximity of the mobile recording device and wherein the user interface is operable to initiate a financial transaction in relation to the retail item using a payment processing network which processes payment for the financial transaction according to a payment instrument or tokenisation thereof associated with the viewer terminal. [0006] Other aspects of the invention are also disclosed. Brief Description of the Drawings [0007] Notwithstanding any other forms which may fall within the scope of the present invention, preferred embodiments of the disclosure will now be described, by way of example only, with reference to the accompanying drawings in which: [0008] Figure 1 shows a video communication system in accordance with an embodiment; and [0009] Figure 2 shows an exemplary user interface displayed by a digital display of the viewer terminal of the system in accordance with an embodiment.

Description

Processing of financial transactions using a video communication system

Field of the Invention

[0001 ] This invention relates generally to the processing of financial transactions using a video communication system .

Summary of the Disclosure

[0002] There is provided herein a video communication system comprising a communication server which establishes video and bidirectional audio communication between at least one viewer terminal on a mobile recording device across a wide area network.

[0003] The mobile recording device comprises audio and video Interfaces for capturing audio and video.

[0004] The viewer terminal comprises a digital display to display a video feed captured by the mobile recording device. Furthermore, the viewer terminal comprises an audio capture interface for bidirectional audio communication with the mobile recording device.

[0005] The digital display of the viewer terminal is controlled to display a user interface operable to display information regarding a retail item detected as being in proximity of the mobile recording device and wherein the user interface is operable to initiate a financial transaction in relation to the retail item using a payment processing network which processes payment for the financial transaction according to a payment instrument or tokenisation thereof associated with the viewer terminal. [0006] Other aspects of the invention are also disclosed.

Brief Description of the Drawings

[0007] Notwithstanding any other forms which may fall within the scope of the present invention, preferred embodiments of the disclosure will now be described, by way of example only, with reference to the accompanying drawings in which:

[0008] Figure 1 shows a video communication system in accordance with an embodiment; and

[0009] Figure 2 shows an exemplary user interface displayed by a digital display of the viewer terminal of the system in accordance with an embodiment. Description of Embodiments

[0010] A video communication system 100 is given in Figure 1 in accordance with an exemplary embodiment. The system 100 comprises a communication server 102 which establishes communication between at least one viewer terminal 103 and a mobile recording device 101 across a wide area network, such as the Internet. In accordance with a preferred embodiment described herein, the mobile recording device 101 takes the form of a headset as is illustrated in Figure 1.

[001 1 ] Each of the mobile recording device 101 , communication server 102 and viewer terminal 103 comprises a processor 1 1 1 for processing digital data. In operable communication with the processor 1 1 1 across a system bus 104 is a memory and/or storage device 105 configured for storing digital data including computer program code instructions. In use, the processor 1 1 1 fetches these computer program code instructions and associated data from the memory/storage 105 for interpretation and execution of the functionality described herein.

[0012] The viewer terminal 103 may execute a software application having data 1 06 and computer program code instructions which may be logically divided into a plurality of controllers 107.

[0013] The viewer terminal 103 comprises an I/O interface 1 12 for interfacing with one or more ancillary devices and/or sending and receiving data across the wide area network. The viewer terminal may comprise an audio interface 122 for recording and playing out audio.

[0014] The communication server 102 may further comprise an I/O interface 1 12 for communicating with the viewer terminal 103 and the recording device 101 across the wide area network.

[0015] The server 102 may store a plurality of virtual retail item objects 108 which will be described in further detail below. The server 102 may further store a plurality of user accounts 109, including those associated with one or more recording devices 101 and viewer terminals 103. The server 102 may further store payment instrument tokens 110 for use for processing financial transactions associated with the viewer terminals 103 using a payment processing network 121 .

[0016] The mobile recording device 101 similarly may execute a software application having data 106 and associated controllers 107 for controlling the operational functionality of the mobile recording device 101.

[0017] The I/O interface 1 12 of the recording device 101 may interface with an audio interface 122 for recording and playing out audio. Furthermore, the headset recording device 101 may comprise a video interface 1 18 for capturing video which is displayed as a video feed on the digital display device 1 13 of the viewer terminal 103.

[0018] The recording device 101 may further comprise a short-range communication interface 116 which may receive periodic short-range communications from one or more short-range beacons 1 19.

[0019] Furthermore, the recording device 101 may comprise gyroscopic sensors 1 16 to determine a gaze orientation of the recording device 101 , especially when the recording device 101 is worn as a headset.

[0020] The recording device 101 may comprise a GPS receiver 116 for sensing a location of the recording device 101.

[0021 ] The recording device may further comprise a handset 116 having a digital display 113 which displays a user interface thereon for configuration of ancillary information as will be described in further detail below.

[0022] Exemplary utilisation of the system 100 will now be described with reference to the application for virtual tour guiding wherein a tour guide visits remote locations using the recording device 101 to capture audio and video which is played out and displayed by a plurality of viewer terminals 103 in remote locations.

[0023] The user of the viewer terminal 103 may register with the communication server 102 and configure user account information 109 accordingly. The communication server 102 may store a list of upcoming virtual tours which may be browsed and selected by users of the viewer terminal 103. [0024] At the time of a selected tour, the communication server 102 may establish communication between the recording device 101 associated with the tour and a plurality of viewer terminals 103 joining the virtual tour wherein audio and video recorded by the respective audio interface 122 and video interface 1 18 of the recording device 101 is transmitted across the wide area network for playout and displayed by the viewer terminal 103.

[0025] Generally, the video feed is unidirectional from the recording device 101 to the viewer terminal 103. However, audio communication may be bidirectional wherein audio recorded by either the recording device 101 of viewer terminal 103 may be transmitted in both directions. The controllers 107 may detect audio input via the audio interface 122 and transmit audio to the recording device 101 such that viewers associated with the viewer terminals 103 may take turns in posing questions to the tour guide having the recording device 101 .

[0026] In accordance with a preferred embodiment, during a virtual tour, the system 100 is configured for causing the digital display 1 13 of the viewer terminal 103 to display information regarding a retail item detected as being in proximity with the mobile recording device 101 and wherein the user interface is operable to initiate a user initiated financial transaction in relation to the retail item wherein the system 100 uses the payment processing network 121 for processing payment for the financial transaction according to a payment instrument or payment instrument token 1 10 associated with the viewer terminal 103.

[0027] Figure 2 illustrates an exemplary user interface 123 displayed by the digital display 1 13 of the viewer terminal 103. In accordance with the embodiment shown, the user interface 123 may display a video feed of video captured by the video interface 1 18 of the recording device 101. In this particular exemplary embodiment, the video feed shows a bazaar scene.

[0028] The interface 123 may display a plurality of user selectable icons 127 of available retail items detected as being in proximity of the mobile recording device

101. [0029] The user may select one of the items 127 to display further information 124 in relation to the retail item including product name or identifier, description 131 and price 129 and which may comprise a user control 128 to initiate a financial transaction if the user wishes to purchase the particular retail item.

[0030] The mobile recording device 101 may be configured for detecting when the mobile recording device 101 is in proximity of the retail item.

[0031 ] In accordance with an embodiment, the system 100 encodes a plurality of virtual retail item objects 108 in relation to respective locations. As such, the mobile recording device 101 uses a location sensor (such as the GPS receiver 1 16) for sensing a location of the mobile recording device 101 and wherein the location of the mobile recording device 101 is used to determine proximity with the retail item according to the location of the associated virtual retail item object 108. As such, using the present example, as the mobile recording device 101 moves through the bazaar, encoded retail items within, for example, 10 m of the mobile recording device 101 may be displayed by the display devices 103 of the viewer terminal 103.

[0032] In embodiments, the system 100 may implement shopping cart functionality wherein users of the viewer terminals 103 may use the interfaces thereof to add available retail items to a shopping cart for subsequent purchase.

[0033] In further embodiment, the mobile recording device 101 uses the short-range communication interface 1 16 to receive periodic broadcasts from short-range beacons associated with the retail item.

[0034] For example, a retail outlet may install a plurality of short-range communication beacons 1 19 in relation to each retail item or shelf .

[0035] As such, receipt of short-range communication from the beacon 1 19 may be used by the system 100 to infer proximity of the retail item. The short-range communication from the beacon 190 may comprise an ID which indicates a specific retail item (such as an SKU number) or alternatively a type of retail item.

[0036] In embodiments, the mobile recording device 1 10 may determine distance from the beacon 1 19 using the received signal strength (RSSI) indication. The distance may be used to infer a distance between the retail item and the recording device 101 and/or a location of the recording device 101 within a retail outlet.

[0037] The video communication interface 1 16 and the short-range communication beacon 1 19 may implement the Bluetooth BLE standards.

[0038] In further embodiments, the system 100 comprises an image processing controller which processes the video feed captured by the video interface 1 18 detect the retail item within the field of view of the recording device.

[0039] In one embodiment, the image processing controller comprises an optical character recognition sub controller which extracts text from the video feed. The extracted text may be used to identify a retail item, such as one stored within the storage 105 of the communication server 102. Alternatively, the extracted text may be used to obtain information about a retail item, such as at least one of name, description and/or price obtained from a label thereof.

[0040] In a further embodiment, an optical computer readable media may be associated with each retail item. For example, a QR code may be adhered to each retail item or an adjacent shelf. In accordance with this embodiment, the image processing controller may comprise an optical computer readable media decoding sub controller which decodes information encoded within the optical computer readable media associated with the retail item to either identify the retail item or obtain information in relation thereto.

[0041 ] In embodiments shown in Figure 2, the user interface of the viewer terminal 103 may display the retail item icons 125 or information 124 augmented with the video feed. For example, the system 100 may determine display coordinates of the retail item within a field of view of the mobile recording device 101 to display the icons 125 or information 124 according to the display coordinates.

[0042] In one embodiment, the system uses the aforedescribed image processing techniques to identify a retail item within the field of view to calculate the display coordinates. [0043] In alternative embodiments, the system uses the gyroscopic sensors 1 15 to determine the gaze orientation so as to calculate the display coordinates with reference to a location of the recording device 101 (which may be determined by the GPS receiver 1 16 or received signal strength indication from Bluetooth beacons 1 19) and the determined gaze orientation.

[0044] As alluded to above, the mobile recording device 101 may be associated with a handset 1 14 having a digital display 1 13 display a tour guide operator interface thereon. The handset 1 14 may be in operable communication with the recording device 101 across a short-range wireless network. In alternative embodiments, the functionality of the handset 1 14 and that of the recording device 101 may be provided by a single computer device.

[0045] The system 100 may be configured for processing the payment for the financial transaction for the retail item according to auxiliary information input into the user interface of the handset 1 14. For example, an operator of the recording device 101 may input pricing information which is used for the financial transaction. By way of a further example, the system 100 may determine a price for retail item but wherein a user of the viewer terminal 103 may communicate with the operator of the recording device 101 to negotiate a lower price which, if successful, is entered into the handset 1 14 to adjust the price for the processing of the financial transaction. By way of yet further example, the operator of the recording device 101 may control the handset 1 14 to adjust the quantity of the retail item as instructed by the user of the viewer terminal 103 wherein the system 100 processes the financial transaction accordingly. [0046] A handset 1 14 for the recording device 101 may indicate successful processing of the transaction so that, for example, the operator of the recording device 101 may pay a vendor of the retail item separately.

[0047] The foregoing description, for purposes of explanation, used specific nomenclature to provide a thorough understanding of the invention. However, it will be apparent to one skilled in the art that specific details are not required in order to practise the invention. Thus, the foregoing descriptions of specific embodiments of the invention are presented for purposes of illustration and description. They are not intended to be exhaustive or to limit the invention to the precise forms disclosed as obviously many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, thereby enabling others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated. It is intended that the following claims and their equivalents define the scope of the invention.

[0048] The term “approximately” or similar as used herein should be construed as being within 10% of the value stated unless otherwise indicated.

Claims

1 . A video communication system comprising: a communication server which establishes video and bidirectional audio communication between at least one viewer terminal and a mobile recording device across a wide area network, the mobile recording device comprising audio and video capture interfaces for capturing audio and video, the viewer terminal comprising a digital display to display a video feed captured by the mobile recording device and wherein the viewer terminal comprises and audio capture interface for bi-directional audio communication with the mobile recording device, the digital display controlled to display a user interface operable to display information regarding a retail item detected as being in proximity of the mobile recording device and wherein the user interface is operable to initiate a financial transaction in relation to the retail item using a payment processing network which processes payment for the financial transaction according to a payment instrument associated with the viewer terminal.

2. A system as claimed in claim 1 , wherein the mobile recording device is configured to detect when the mobile recording device is in proximity of the retail item.

3. A system as claimed in claim 2, wherein the system encodes a plurality of virtual retail item objects in relation to respective locations and wherein the mobile recording device comprises a location sensor for sensing a location of the mobile recording device and wherein the location of the mobile recording device is used to determine proximity with the retail item according to the location of the associated virtual retail item object.

9

4. A system as claimed in claim 2, wherein the mobile recording device comprises a short-range communication interface which receives periodic broadcasts from a short-range beacon associated with the retail item.

5. A system as claimed in claim 4, wherein the mobile recording device determines proximity of the short-range beacon according to a received signal strength indication.

6. A system as claimed in claim 1 , wherein the system comprises an image processing controller which processes the video feed and which detects the retail item within a field of view of the recording device.

7. A system as claimed in claim 1 , wherein the image processing controller comprises an optical character recognition sub controller which extracts text from the video feed and which identifies the retail item in accordance with the text.

8. A system as claimed in claim 1 , wherein the image processing controller comprises an optical computer readable media decoding sub controller which decodes information from optical computer readable media associated with the retail item.

9. A system as claimed in claim 1 , wherein the user interface displays retail item information augmented with the video feed.

10. A system as claimed in claim 9, wherein the system determines display coordinates of the retail item within a field of view of the mobile recording device and displays the information according to the display coordinates.

1 1. A system as claimed in claim 10, wherein the recording device comprises gyroscopic sensors which determine a gaze direction of the recording device and wherein the display coordinates are cultivated in accordance with the gaze direction and the location of the recording device.

12. A system as claimed in claim 10, wherein the system comprising an image processing controller which processes the video feed to detect the retail item therein and wherein the display coordinates are calculated at a detection location of the retail item.

13. A system as claimed in claim 1 , wherein the system is configured for querying an inventory management system for information associated with the retail item.

14. A system as claimed in claim 13, wherein the information comprises at least one of pricing and stock level data.

15. A system as claimed in claim 1 , wherein the recording device comprises a handset having a digital display digital display a user interface thereon and wherein the system is configured for processing payment for the financial transaction according to auxiliary information input into the user interface of the handset.

16. A system as claimed in claim 15, wherein the information includes at least one of price and quantity.

17. A system as claimed in claim 15, wherein the handset indicates successful processing of the financial transaction.

11