WO2015141051A1 - 取引システム及び取引装置 - Google Patents

取引システム及び取引装置 Download PDF

Info

Publication number
WO2015141051A1
WO2015141051A1 PCT/JP2014/078664 JP2014078664W WO2015141051A1 WO 2015141051 A1 WO2015141051 A1 WO 2015141051A1 JP 2014078664 W JP2014078664 W JP 2014078664W WO 2015141051 A1 WO2015141051 A1 WO 2015141051A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
operation screen
image
displayed
customer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2014/078664
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
悠介 柴崎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Oki Electric Industry Co Ltd
Original Assignee
Oki Electric Industry Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oki Electric Industry Co Ltd filed Critical Oki Electric Industry Co Ltd
Publication of WO2015141051A1 publication Critical patent/WO2015141051A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F19/00—Complete banking systems; Coded card-freed arrangements adapted for dispensing or receiving monies or the like and posting such transactions to existing accounts, e.g. automatic teller machines
    • G07F19/20—Automatic teller machines [ATMs]
    • G07F19/201—Accessories of ATMs
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07F—COIN-FREED OR LIKE APPARATUS
    • G07F7/00—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus
    • G07F7/08—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus by coded identity card or credit card or other personal identification means
    • G07F7/10—Mechanisms actuated by objects other than coins to free or to actuate vending, hiring, coin or paper currency dispensing or refunding apparatus by coded identity card or credit card or other personal identification means together with a coded signal, e.g. in the form of personal identification information, like personal identification number [PIN] or biometric data
    • G07F7/1025—Identification of user by a PIN code
    • G07F7/1033—Details of the PIN pad

Definitions

  • the present invention relates to a transaction system and a transaction apparatus, for example, a transaction system including an ATM (Automated Teller Machine).
  • a transaction system including an ATM (Automated Teller Machine).
  • ATM Automatic Teller Machine
  • AR Augmented Reality
  • the first method is a specifying method based on position information using GPS or the like
  • the second method is a specifying method using image analysis by a camera.
  • image analysis by cameras there are a method for adding information to 2D data called “markers” that can be recognized by a computer, and a method for recognizing images of actual objects and figures and adding information. .
  • a security technology for a personal identification number using AR even in a transaction device such as ATM Location information is used as a method for identifying a real landscape. Based on the position information, the ATM to be overlaid is specified. Even on the password input screen, the password input button is not displayed on the ATM customer operation screen. Instead of display, virtual buttons are displayed in a superimposed manner through a head mounted display attached by the ATM user. The user touches the ATM customer operation screen using the superimposed video and performs input.
  • the transaction system includes a transaction device that performs a transaction with an operator, and a terminal device that includes an imaging unit and a display unit that displays an image acquired by the imaging unit.
  • the transaction apparatus presents an operation screen for receiving the operation of the operator and displaying information related to the transaction, and at least an object that can accept the operation on the operation screen, the terminal An operation screen presentation unit capable of attaching an encoded image in which tag data for identifying content to be displayed on the device is encoded, and (2) the terminal device is (2-1) content data (2-2)
  • the encoded image is detected by analyzing the image captured by the imaging unit, the content data corresponding to the encoded image is stored in the container. Acquired from the data tree holding portion is held, a composite image in which the imaging unit is superposed the image of the contents acquired in the image captured and an image processing unit for displaying on the display unit.
  • the transaction device presents an operation screen for receiving information on the transaction and accepting the operation of the operator, and is an object that can accept the operation on the operation screen.
  • an operation screen presenting unit capable of attaching an encoded image in which tag data for identifying content to be displayed on the terminal device possessed by the operator is encoded.
  • a transaction system and a transaction apparatus that can support an operation related to a customer transaction using a terminal device that displays augmented reality.
  • FIG. 1 is an explanatory diagram showing the overall configuration of the WebATM system 1 of this embodiment.
  • the WebATM system 1 includes an ATM 10, a smartphone terminal 20 as a terminal device, a customer information database server 30, an AR content download server 40 as a content providing device, a billing system host 50, and a WebAP server 60 as an operation screen providing device. ing.
  • the WebATM system 1 is an ATM system in which the ATM 10 is made into a thin client with the WebAP server 60 as the center.
  • the basis of the WebATM system 1 includes an ATM 10, a WebAP server 60, and a billing system host 50.
  • the transaction application (content of the transaction operation screen) provided by the ATM 10 is stored in the WebAP server 60.
  • the content stored in the WebATM system 1 includes a page (operation screen) with an AR marker.
  • transaction information is provided from the account host 50 to the ATM 10 via the WebAP server 60.
  • the AR content is stored in the AR content download server 40 and provided to the smartphone terminal 20 by communication.
  • the content data to be overlaid on the AR marker is stored in the AR content download server 40.
  • the AR content download server 40 is connected to a customer information database server 30 that manages customer information.
  • AR content content to be superimposed on (attached to) an AR marker
  • the AR content download server 40 it may be stored offline via a medium or the like, not via the network.
  • the smart phone terminal 20 can superimpose and display the image of AR content using the AR marker on the customer operation screen of the ATM 10 as a mark.
  • the ATM 10 includes a control unit 11 that controls the entire apparatus, a customer operation screen 12 as an operation screen presentation unit configured using a touch panel display, a passbook unit 13 that performs processing of the inserted passbook (for example, passbook entry, etc.), It has a card unit 14 for processing the inserted card (for example, reading data) and a cash processing unit 15 for depositing and withdrawing cash. Further, it is assumed that a telephone 80 capable of making a call with a call center operator is also arranged in the vicinity of the ATM 10.
  • the control unit 11 can be constructed by installing the transaction program of the embodiment in a computer including a CPU, a memory, and the like.
  • the control unit 11 includes at least a main control program 111 for controlling each component in the apparatus and a web browser 112.
  • the Web browser 112 accesses the WebAP server 60 by communication, acquires Web content related to the transaction operation screen, displays the operation screen on the customer operation screen 12, and performs processing for providing the customer. That is, the ATM 10 is configured to operate as a thin client including only the Web browser 112 as an application.
  • the WebAP server 60 is connected to the Web server process 61 serving as an operation screen data providing unit that provides a web page (operation screen related to transaction processing) to the ATM 10 and the accounting host 50, and information processing (transaction) associated with the transaction processing. And a content storage unit 63 for storing Web content (operation screen related to transaction processing) and AR content data.
  • the content storage unit 63 stores ATM display content 64, which is a Web page to be supplied to the ATM 10, and AR content data 65 to be supplied to the smartphone terminal 20 via the AR content download server 40.
  • AR content data 65 data of AR content (content such as image data and text data) corresponding to each tag data obtained by decoding an AR marker (encoded image including contents obtained by encoding tag data) is stored. It shall be included.
  • the customer information database server 30 includes a customer information database storage unit 32 for managing and storing customer data, and a database for providing data of the customer information database storage unit 32 to the AR content download server 40 as a database client. It has a server process 31.
  • the customer information database storage unit 32 stores data for managing information on customers who use the ATM 10 and the smartphone terminal 20.
  • the information stored in the customer information database storage unit 32 is assumed to have contents as shown in FIG.
  • the customer information database storage unit 32 stores information including a customer name for each customer and a customer ID for identifying each customer's smartphone terminal 20 (customer ID used for application login). It shall be.
  • the smartphone terminal 20 includes a control unit 21, a touch panel display 22, a camera 23, and a communication unit 24 as a network interface that performs wireless communication.
  • the control unit 21 performs various data processing and control of each device.
  • the control unit 21 is configured by installing various control programs in a computer including a CPU, a memory, and the like. In this embodiment, it is assumed that an AR application 211 for processing at least AR content is installed in a computer constituting the control unit 21.
  • the AR application 211 serving as a content holding unit and an image processing unit displays an image captured by the camera 23 (hereinafter referred to as “camera captured image”) on the touch panel display 22 and analyzes the captured image to detect an AR marker. Check if there is any.
  • the AR application 211 detects an AR marker, the AR application 211 acquires AR content corresponding to the AR marker via the AR content download server 40, and an image based on the acquired AR content (hereinafter referred to as “AR content image”). ) And a camera-captured image superimposed image (hereinafter referred to as “composite image”) is displayed on the touch panel display 22.
  • various AR technology applications can be applied to the AR marker detection processing, AR content (AR content image) acquisition processing, and composition processing performed by the AR application 211.
  • the AR application 211 may download and cache the necessary AR content data from the AR content download server 40 in advance, or acquire it whenever necessary (each time the AR marker is detected). It may be.
  • a touch panel display 22 is disposed on one surface of the plate-shaped smartphone terminal 20 (see FIG. 6A), and a camera 23 is disposed on the other surface (rear surface) (see FIG. 6B). Thereby, the customer can view the composite image on the touch panel display 22 while imaging the portion including the AR marker with the camera 23 (while holding the smartphone terminal 20).
  • the AR content download server 40 has an application server process 41 that provides AR content to the smartphone terminal 20 that operates as a client.
  • the AR content download server 40 (application server process 41) accepts the login from the smartphone terminal 20 (login using the customer ID managed by the customer information database server 30), accepts the authentication, and accepts the smartphone terminal 20 that accepts the connection. to manage. Then, the application server process 41 performs processing for acquiring and providing the AR content corresponding to the request (tag data) from the logged-in smartphone terminal 20 from the WebAP server 60.
  • the application server process 41 performs processing to acquire tag data obtained by decoding the AR marker, request the Web AP server 60 to acquire AR content corresponding to the acquired tag data, and return the AR content to the smartphone terminal 20.
  • the AR content download server 40 may download and cache all the AR content (AR content data 65 stored in the content storage unit 63) from the WebAP server 60 in advance. You may make it download every time (every request
  • the master data of the AR content is stored in the WebAP server 60.
  • the storage position of the master data of the AR content is not limited, and is stored in the AR content download server 40. Alternatively, it may be stored only in each smartphone terminal 20 (stored together with the AR application 211).
  • the AR application 211 is launched on the smartphone terminal 20 by the customer (S101), and a login request is made to the AR content download server 40 (S102).
  • the AR content download server 40 performs authentication by a process of collating with the customer data of the customer information database server 30 based on the login request from the smartphone terminal 20, and here, it is assumed that the authentication is successful (S103). .
  • the authentication method in the AR content download server 40 is not limited. In the AR content download server 40, if there is no security problem when accepting login, the authentication process may be omitted. Further, the AR content download server 40 may accept a request for AR content from the smartphone terminal 20 without performing login processing.
  • transaction processing starts at the ATM 10 in accordance with the operation of the customer (the customer who owns the smartphone terminal 20) (S104).
  • the login process steps S101 to S103) by the smartphone terminal 20 may be after the transaction process in the ATM 10 is started.
  • the operation screen displayed on the customer operation screen 12 is changed, and the operation screen including the AR marker is displayed (S105).
  • the customer operation screen 12 is imaged by the smartphone terminal 20 (camera 23) by the customer's operation, and the AR marker is detected by the smartphone terminal 20 (AR application 211) (S106).
  • the smartphone terminal 20 analyzes the image of the AR marker, extracts tag data, attaches the tag data, and sends a data request for AR content to the AR content download server 40. Transmit (S107).
  • the AR content download server 40 Upon receiving the AR content data request, the AR content download server 40 acquires the AR content corresponding to the tag data from the WebAP server 60 (S108) and transmits it to the smartphone terminal 20 (S109).
  • the smartphone terminal 20 (AR application 211) starts a process of displaying the image of the AR content and the image obtained by combining the camera captured image on the customer operation screen 12 (S110).
  • FIG. 9 shows an operation screen displayed on the customer operation screen 12 when accepting the input of the password at the ATM 10.
  • FIG. 10 is an explanatory diagram showing an image of the AR content displayed on the touch panel display 22 of the smartphone terminal 20 when accepting the input of the password at the ATM 10.
  • the smartphone terminal 2 displays a composite image obtained by combining the AR content image and the camera-captured image, but FIG. 10 shows only the AR content image extracted for the sake of simplicity.
  • FIG. 11 illustrates a composite image displayed on the touch panel display 22 of the smartphone terminal 20 when accepting the input of the password at the ATM 10. That is, FIG. 11 illustrates a state in which the camera captured image obtained by capturing the operation screen illustrated in FIG. 9 and the composite image obtained by combining the AR content image illustrated in FIG.
  • the PIN code input operation screen (number input screen) displayed on the ATM 10 includes 10 objects corresponding to 10 numbers from 0 to 9 (operable). Buttons B100 to B109, and fields F101 to F104 for displaying the number of input digits are arranged.
  • buttons B100 to B109 images that function as AR markers are displayed on the buttons B100 to B109, respectively.
  • the AR marker images attached to the buttons B100 to B109 appear to have symbols A to J in the form of a 7-segment display as viewed from the customer's eyes. It has a visible configuration.
  • the customer refers to the AR content displayed on the touch panel display 22 of the smartphone terminal 20 in order to input “1” as the first character of the personal identification number.
  • the customer recognizes that the button corresponding to “1” displayed on the touch panel display 22 of the smartphone terminal 20 is the “A” button on the operation screen of the ATM 10 (customer operation screen 12), and “A”. Press the button.
  • the ATM 10 determines that the number “1” corresponding to the “A” button has been input, and displays an AR marker image in which tag data similar to the “A” button is encoded in F101.
  • the customer inputs the reference number by pressing the button including the AR marker displayed on the customer operation screen 12 of the ATM 10 while referring to the AR content displayed on the touch panel display 22 of the smartphone terminal 20. To go.
  • the customer cannot recognize numbers entered in each field on the operation screen of the ATM 10 (customer operation screen 12), but displays the AR content on the smartphone terminal 20 (touch panel display 22), and displays in each field.
  • the corresponding numbers can be grasped.
  • the AR content displayed on the touch panel display 22 is, for example, as illustrated in FIG. Become.
  • the composite image displayed on the touch panel display 22 is as shown in FIG.
  • buttons B100 to B109 on the ATM 10 side are displayed at positions overlapping the buttons B100 to B109 on the ATM 10 side.
  • the touch panel display 22 displays fields F201 to F204 for displaying the input numbers (numbers) at positions overlapping the fields F101 to F104 on the ATM 10 side.
  • . 9 shows a state in which only a two-digit password is entered, so only numbers of two digits are displayed in FIGS. 10 and 11 as well.
  • buttons B100 to B109 displayed on the ATM 10 which button corresponds to which number may be random, but the image displayed on each button corresponds to the number corresponding to the button.
  • the button B101 to which the image A is attached in the 7-segment display format is a button that can input the number “1”, so that the image attached to the button B101 corresponds to “1”. It is necessary to use tag data of AR content to be used as an AR marker.
  • the smartphone terminal 20 (AR application 211) can acquire AR content (image data of each button) corresponding to the captured AR marker and display it on the touch panel display 22.
  • the smartphone terminal 20 displays the virtual image of the personal identification number superimposed on the AR marker, thereby allowing the customer to press the AR marker (AR tag) as a button.
  • the smartphone terminal 20 (AR application 211) first displays the AR content as illustrated in FIG. 11, the smartphone terminal 20 (AR application 211) freezes the displayed composite image for a predetermined time or until the screen is touched. You may make it be the state which carried out. This eliminates the need for the customer to continue to be ready to input the password while holding the smartphone terminal 20 over the ATM 10, thus increasing customer convenience.
  • A-3-1 On the customer operation screen 12 of the ATM 10, when accepting the password input (numerical input), the operation buttons on the ATM 10 side are displayed with only the AR marker, and correspond to each operation button. The numbers are displayed as AR content on the smartphone terminal 20 side. In addition, on the customer operation screen 12 of the ATM 10, only the AR marker (image with “*” symbol added as a dummy) is displayed for the input number (number), and the input number is displayed on the smartphone terminal 20 side. Display as content. Thereby, the possibility that the password entered in the ATM 10 is peeped by others other than the customer is suppressed.
  • alphabetic symbols are used as an example of the AR marker to be displayed.
  • shape of the AR marker is not limited to this, and for example, an irregular figure or pattern is associated with the AR marker.
  • the relationship with the numbers can be made more difficult, and the possibility of being peeped by a third party other than the customer can be suppressed.
  • the ATM display screen is provided at a low position so that various people can operate it, there is a possibility of peeping from behind, so the ATM 10 and the smartphone terminal 20 are linked to provide input support. That is convenient for customers.
  • the same AR content is distributed to all customers.
  • the AR marker of the same tag data is displayed in the ATM 10.
  • the AR content selected from a plurality of patterns according to the customer (customer type) is displayed on the smartphone terminal 20.
  • a plurality of AR content data 65 is stored, and the AR content download server 40 selects and selects the AR content data 65 corresponding to the customer (customer type).
  • the AR content (AR content corresponding to the acquired tag data) included in the AR content data 65 is read and distributed to the smartphone terminal 20.
  • the WebAP server 60A stores two AR content data 65-1 and 65-2.
  • the AR content data 65-1 includes AR content for sighted persons (healthy persons)
  • the AR content data 65-2 includes AR content for hearing-impaired persons.
  • the configuration in which the AR content download server 40 determines the customer type is not limited.
  • the AR content download server 40 can set the smart phone terminal 20 (AR When accepting a login from the application 211), data that can identify the type of the customer (whether they are sighted or hearing impaired) may be acquired from the AR application 211. Thereby, the AR content download server 40 can select an acquisition destination (AR content data 65-1 or AR content data 65-2) when acquiring the AR content according to the type of customer.
  • information for managing the type of each customer is also stored in the customer information database server 30, and the AR content download server 40 is based on the ID (customer ID) used when accepting login from the smartphone terminal 20.
  • the information (customer type information of the customer ID) of the customer information database server 30 may be acquired.
  • FIGS. 13 to 15 are explanatory diagrams showing an example in which transaction support (operation support) is performed using AR contents when the customer confirms information related to the transaction at the ATM 10.
  • a message indicating that a fee is charged for executing a transaction for the customer and a confirmation button B201 for accepting confirmation from the customer are arranged.
  • the user can transition to the next operation screen by pressing the confirmation button.
  • a button B202 (a button displaying “consultation counter not using voice”) for displaying guidance for the hearing impaired is also arranged.
  • an AR marker image G201 in which tag data of AR content for adding (enlarged display) information related to the operation screen is arranged.
  • FIGS. 14 and 15 show a composite image displayed on the touch panel display 22 when the operation screen of FIG. 13 (screen on which the AR marker image G201 is displayed) is captured by the camera 23 of the smartphone terminal 20. .
  • FIG. 14 shows a composite image displayed on the smartphone terminal 20 when the customer type is a sighted person (healthy person).
  • FIG. 15 shows a composite image displayed on the smartphone terminal 20 when the customer type is a hearing impaired person.
  • the smartphone terminal 20 displays an AR content image “The current time fee is as follows.
  • An enlarged image G302 is arranged.
  • the smartphone terminal 20 prompts the user to press the button B202 as an AR content image.
  • the AR content for transaction support is displayed (enlarged display) on the smartphone terminal 20 without using voice for the hearing impaired person.
  • the sighted person is configured to display (enlarged display) AR content on the smartphone terminal 20 for transaction support (operation support) using sound.
  • the display contents of the customer operation screen of the screen in ATM must be concise and clear. This is because the display content needs to shorten the operation time if the erroneous recognition of the operation content is reduced.
  • due to a lack of information there are many patterns that cause a shortage of information in response to a sudden specification change or a complicated display content confirmation operation. Inquiries to call centers due to lack of information can cause pressure on banking operations. Therefore, in the WebATM system 1A of the second embodiment, it is possible to expand the information provided to the customer while minimizing the influence on the ATM 10 (customer operation screen 12) by adding information by AR content.
  • FIG. 2 In the second embodiment, different AR contents are displayed on the smartphone terminal 20 in accordance with the customer (customer type). Specifically, in the second embodiment, AR content adapted to characteristics of a sighted person (a healthy person) and a hearing impaired person is displayed from the smartphone terminal 20. Thereby, in the WebATM system 1A, addition of information tailored to the customer (display of AR content) is realized without changing the content of the operation screen displayed on the customer operation screen 12 of the ATM 10. Further, as described above, in the WebATM system 1A, only the AR content is replaced without changing the content of the operation screen displayed on the ATM 10 (customer operation screen 12), so the configuration of the operation screen of the ATM 10 ( (ATM application) can be reduced.
  • FIG. 16 is a block diagram showing the overall configuration of the WebATM system 1B of the third embodiment.
  • a call center terminal 70 installed in a call center (not shown) is added as a system component. Further, the customer can receive a transaction (operation) support by speaking with the operator of the call center terminal 70 using the telephone 80 installed in the vicinity of the ATM 10.
  • the contents of the AR marker (tag data) on the operation screen currently displayed on the ATM 10 can be changed according to the operator's operation on the call center terminal 70. That is, when the operator operates the call center terminal 70 and induces a transaction (operation) to a customer using voice / video / text, the object described (the button on the operation screen) is used by using the AR content. Or message).
  • the call center terminal 70 is configured to be able to display the same screen as that currently distributed from the WebAP server 60B to the ATM 10.
  • the WebAP server 60B can change the AR marker on the operation screen distributed to the ATM 10 in accordance with a control command (for example, a control command using a communication message) from the call center terminal 70. To do.
  • a control command for example, a control command using a communication message
  • Various web application configurations can be applied.
  • FIGS. 17A and 17B and FIGS. 18A and 18B an example of adding information (enlarged display) to the operation screen being displayed using the AR content in the ATM 10 will be described with reference to FIGS. 17A and 17B and FIGS. 18A and 18B.
  • FIG. 17A shows an example of an operation screen displayed on the customer operation screen 12 of the ATM 10.
  • a message indicating that a fee is charged for dealing with a customer and a confirmation button B501 for accepting confirmation from the customer are arranged.
  • the customer can transition to the next operation screen by pressing the confirmation button B501.
  • a button B502 (a button displaying “consultation counter not using voice”) for displaying guidance for the hearing impaired is also arranged.
  • a field F501 for displaying an AR marker image is arranged on the operation screen of the ATM 10 shown in FIG. 17A.
  • an image “1” in the form of a 7-segment display is arranged in the field F501 as an AR marker.
  • FIG. 17B shows a composite image displayed on the touch panel display 22 when the operation screen of FIG. 17A (screen on which the AR marker in the field F501 is displayed) is captured by the camera 23 of the smartphone terminal 20.
  • FIG. 17B as an AR content image corresponding to the AR marker image displayed in the field F501 on the smartphone terminal 20 (touch panel display 22), an arrow indicating a message in the operation screen on the ATM 10 side, An image G601 with a message “Please see” is displayed.
  • 18A shows an example in which the AR marker displayed in the field F501 is replaced on the operation screen in FIG. 17A (an example in which the image is replaced with an image “2” in the 7-segment display format).
  • FIG. 18B as an AR content image corresponding to the AR marker image displayed in the field F501 on the smartphone terminal 20 (touch panel display 22), an arrow indicating the confirmation button B501 in the operation screen on the ATM 10 side, An image G602 with a message “please see here” is displayed.
  • the operator of the call center terminal 70 performs an operation (operation control for the WebAP server 60) for replacing the AR marker image displayed in the field F501, thereby replacing the AR marker image displayed in the field F501. It is possible. Accordingly, when the operator of the call center terminal 70 wants to explain the message displayed on the operation screens of FIGS. 17A and 18A, the operator of the call center terminal 70 transmits an instruction to display the AR marker “1” in the field F 501 to the WebAP server 60. Thus, it is necessary to operate the call center terminal 70. In addition, when the operator of the call center terminal 70 guides the customer to press the confirmation button B501 displayed on the operation screens of FIGS. 17A and 18A, the operator instructs the field F501 to display the AR marker “2”.
  • the WebAP server 60B Upon receiving the instruction from the call center terminal 70, the WebAP server 60B temporarily creates a target screen after changing the AR marker, and transmits a screen data download request (reload request) to the ATM 10 to be changed. To do. And ATM10 which received the instruction
  • an interface for accepting an AR marker replacement instruction displayed on the operation screen on the ATM 10 side is not limited.
  • the call center terminal 70 may accept a predetermined operation on a keyboard (not shown) or by pressing a button on an operation screen (not shown).
  • the AR marker displayed on the customer operation screen 12 of the ATM 10 can be replaced in accordance with the control of the call center terminal 70.
  • the WebATM system 1B it is possible to perform display indicating an object explained by the call center operator using the AR content, regardless of the operation environment of the customer.
  • the display contents of the ATM 10 can be changed in a timely manner, and the “AR marker” itself can be used variably.
  • the “AR marker” itself can be used variably. This is because it is possible to relax the following requirements due to the operating environment of the customer.
  • As a first requirement when the display content is changed on the smartphone terminal 20, downloading is necessary, so the customer needs to be in a place where the smartphone terminal 20 can communicate (a place where wireless communication is established). That is.
  • AR content is downloaded and switched on the smartphone terminal 20 side, in order to receive the switching completion on the call center side (call center terminal 70 side), the smartphone terminal 20 side to the call center (call center terminal 70) Communication processing occurs.
  • information communication from a general terminal such as the call center terminal 70
  • a terminal having a high security risk such as ATM 10.
  • the customer information database server 30 and the AR content download server 40 are arranged, but when the AR content is held (cached) in advance on the smartphone terminal 20 side.
  • the customer information database server 30 may be arranged and the AR content download server 40 may be omitted.
  • the ATM 10 has been described as a configuration that functions as a thin client.
  • the content of the operation screen is provided inside, and the accounting system does not pass through the WebAP server 60. It may be configured to connect directly to the host 50.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
PCT/JP2014/078664 2014-03-20 2014-10-28 取引システム及び取引装置 Ceased WO2015141051A1 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014058453A JP6191519B2 (ja) 2014-03-20 2014-03-20 取引システム及び取引装置
JP2014-058453 2014-03-20

Publications (1)

Publication Number Publication Date
WO2015141051A1 true WO2015141051A1 (ja) 2015-09-24

Family

ID=54144048

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/078664 Ceased WO2015141051A1 (ja) 2014-03-20 2014-10-28 取引システム及び取引装置

Country Status (2)

Country Link
JP (1) JP6191519B2 (https=)
WO (1) WO2015141051A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114528061A (zh) * 2022-02-18 2022-05-24 中国工商银行股份有限公司 一种基于ar的设备使用方法、设备及智能终端系统

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017130101A (ja) * 2016-01-21 2017-07-27 富士通株式会社 入力支援方法、入力支援装置および入力支援プログラム
WO2018154877A1 (ja) * 2017-02-24 2018-08-30 富士フイルム株式会社 付加情報表示装置、方法およびプログラム
JP7306716B2 (ja) * 2020-11-18 2023-07-11 株式会社Kort Valuta 取引管理方法、取引管理システム及びプログラム
WO2023276091A1 (ja) * 2021-06-30 2023-01-05 日本電信電話株式会社 表示制御システム、表示制御方法、および、表示制御プログラム
WO2023276092A1 (ja) * 2021-06-30 2023-01-05 日本電信電話株式会社 表示制御システム、表示制御方法、および、表示制御プログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005250950A (ja) * 2004-03-05 2005-09-15 Nippon Telegr & Teleph Corp <Ntt> マーカ提示用携帯端末および拡張現実感システムならびにその動作方法
JP2012174208A (ja) * 2011-02-24 2012-09-10 Sony Corp 情報処理装置、情報処理方法、プログラム及び端末装置
JP2013110514A (ja) * 2011-11-18 2013-06-06 Konica Minolta Business Technologies Inc 操作入力システム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005250950A (ja) * 2004-03-05 2005-09-15 Nippon Telegr & Teleph Corp <Ntt> マーカ提示用携帯端末および拡張現実感システムならびにその動作方法
JP2012174208A (ja) * 2011-02-24 2012-09-10 Sony Corp 情報処理装置、情報処理方法、プログラム及び端末装置
JP2013110514A (ja) * 2011-11-18 2013-06-06 Konica Minolta Business Technologies Inc 操作入力システム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114528061A (zh) * 2022-02-18 2022-05-24 中国工商银行股份有限公司 一种基于ar的设备使用方法、设备及智能终端系统

Also Published As

Publication number Publication date
JP6191519B2 (ja) 2017-09-06
JP2015184762A (ja) 2015-10-22

Similar Documents

Publication Publication Date Title
AU2018202908B2 (en) Controlling Access Based on Display Orientation
US10121136B2 (en) Display orientation based user interface presentation
JP6191519B2 (ja) 取引システム及び取引装置
DK2996015T3 (en) PROCEDURE TO USE IMPROVED REALITY AS HMI VIEW
US9129274B1 (en) Controlling access based on display orientation
CA2959338C (en) Augmented reality card activation
US20170324726A1 (en) Digital authentication using augmented reality
US11610203B2 (en) Value transfer via facial recognition
CN109859410A (zh) 一种智慧终端柜员机及其应用
CN103282929A (zh) 移动电话atm处理方法和系统
US20140115492A1 (en) System and method for transposing an external user interface on a mobile device
JP6300113B2 (ja) 情報表示システム及び情報表示端末
KR100981189B1 (ko) 창구업무자동화시스템
JP2015184762A5 (https=)
JP2020021458A (ja) 情報処理装置、情報処理方法および情報処理システム
JP2008197674A (ja) 支援情報提供方法、支援情報提供プログラム及び情報提供管理システム
JP2020027500A (ja) モバイル端末およびコンピュータプログラム
JP4150651B2 (ja) 支援情報提供方法、支援情報提供プログラム及び情報提供管理システム
US20200012855A1 (en) Operation assistance apparatus, operation assistance method, and computer readable recording medium
CN110634247B (zh) 密码验证装置及电子设备
JP2020017063A (ja) 入出金装置
JP6705290B2 (ja) マルチペイメントカード発行システム，端末装置およびコンピュータプログラム
JP6191406B2 (ja) 情報処理装置、及びプログラム
JP2009122865A (ja) カード情報書込みシステム
KR20170064730A (ko) Vr 기기를 활용한 가상 고객 서비스 방법 및 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14886572

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14886572

Country of ref document: EP

Kind code of ref document: A1