WO2021231281A1 - Dispositifs et systèmes d'entrée sans contact d'informations - Google Patents

Dispositifs et systèmes d'entrée sans contact d'informations Download PDF

Info

Publication number
WO2021231281A1
WO2021231281A1 PCT/US2021/031545 US2021031545W WO2021231281A1 WO 2021231281 A1 WO2021231281 A1 WO 2021231281A1 US 2021031545 W US2021031545 W US 2021031545W WO 2021231281 A1 WO2021231281 A1 WO 2021231281A1
Authority
WO
WIPO (PCT)
Prior art keywords
touchscreen
pos
user
sensing plane
pos system
Prior art date
Application number
PCT/US2021/031545
Other languages
English (en)
Inventor
Kenneth Czapla
Original Assignee
Central Technology, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Central Technology, Inc. filed Critical Central Technology, Inc.
Publication of WO2021231281A1 publication Critical patent/WO2021231281A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
    • G06F1/1607—Arrangements to support accessories mechanically attached to the display housing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
    • G06F1/1643—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being associated to a digitizer, e.g. laptops that can be used as penpads
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen

Definitions

  • the present disclosure relates generally to information input devices and, more particularly, to devices and systems allowing for the touchless input of information.
  • POS systems have become increasingly common at many retail locations, grocery stores, fast food restaurants, gas stations, libraries, and similar settings.
  • the use of such devices has several advantages such as allowing for more checkouts in a given amount of floor space, having to staff fewer workers at checkouts for a given number of customers, and preventing over- or understaffmg of checkout locations as customer volume fluctuates during the day.
  • Most self-service POS systems include one or more touchscreens allowing a customer to input information such as payment options, account and/or credentialing information, selection of items to purchase, information about items to purchased, and the like.
  • Such systems in retail settings also generally include one or more scanning devices for collecting information concerning the items being purchased.
  • Many full-service restaurants use similar systems which allow servers to input orders which are transmitted to kitchen staff as well as to complete sales transactions using a customer’s credit or debit card, for instance.
  • a method includes positioning a sensing plane defined by a touchless input device at an air gap distance from a display in a POS system.
  • the method further includes connecting the touchless input device to the POS system, and disabling a touchscreen of the display.
  • the method further includes displaying a graphical user interface on the display, and outputting a user interaction signal associated with one of a plurality of functional graphics of the graphical user interface from the touchless input device.
  • the method further includes causing the POS system to perform a predetermined function responsive to the user interaction signal.
  • a method of operating a touchless input system includes displaying a graphical user interface on a touchscreen in a point of sale (POS) system, and producing, on the graphical user interface, an indicator image associated with an object penetrating a sensing plane of a touchless input device positioned at an air gap distance from the touchscreen.
  • the method further includes outputting a user interaction signal associated with a functional part of the graphical user interface from the touchless input device, and causing the POS system to perform a predetermined function responsive to the user interaction signal.
  • a method of retrofitting a self-serve kiosk in a point of sale (POS) system for touchless operation includes positioning a sensing plane defined by a touchless input device at an air gap distance from a display in a POS system having a touchscreen display configured to display a graphical user interface. The method further includes electrically connecting the touchless input device to a computer of the self-serve kiosk.
  • POS point of sale
  • the method still further includes storing control software for the touchless input device on the computer, and configuring the computer by way of the control software to: produce, on the graphical user interface, an indicator image for an object penetrating the sensing plane, output a user interaction signal from the touchless input device to the POS system, and cause the POS system to perform a predetermined function responsive to the user interaction signal.
  • a touchless input system for a POS system includes a touchscreen having one or more functional graphics which cause a POS system to perform a predetermined function when selected, a touchless input device defining a sensing plane disposed at a distance from the touchscreen, and a computer.
  • the computer is configured to produce, on the graphical user interface, an indicator image for an object penetrating the sensing plane, and to receive a user interaction signal from the touchless input device associated with a selected one of the functional graphics.
  • the computer is further configured to cause the POS system to perform a predetermined function responsive to the user interaction signal.
  • a kit for retrofitting a POS system having a touchscreen display includes an IR frame overlay, at least one mounting bracket adapted for mounting the IR frame overlay at a distance from the touchscreen display of a POS system, an interface cable for operably connecting the IR frame overlay to the POS system, and a software package which can be run on the POS system and allows the POS system to receive input from the IR frame overlay and to generate an indicator image on the visual display.
  • Fig. l is a diagrammatic side view of a system for the touchless input of information, according to one embodiment
  • FIG. 2 is a diagrammatic side view of a system for the touchless input of information, according to one embodiment
  • FIG. 3 is a diagrammatic side view of a system for the touchless input of information, according to one embodiment
  • Fig. 4 is a diagrammatic side view of the system for the touchless input of information shown in Fig. 3;
  • FIG. 5 is a diagrammatic side view of a system for the touchless input of information mounted to a display screen, according to one embodiment
  • Fig. 6 is a diagrammatic view of a touchless input device, according to one embodiment
  • FIG. 7 is a perspective view of a touchless input device mounted to a POS display, according to one embodiment
  • FIG. 8 is a diagrammatic view of a system for the touchless input of information, according to another embodiment.
  • Fig. 9 is a diagrammatic view of a kit for retrofitting a touchless input device to an existing display screen, according to one embodiment
  • Fig. 10 is a diagrammatic side view of a system for the touchless input of information, according to one embodiment
  • FIG. 11 is a diagrammatic side view of a system for the touchless input of information, according to one embodiment
  • Fig. 12 is a schematic diagram of a system for the touchless input of information, according to one embodiment
  • Fig. 13 is a flowchart of logic flow and methodology in a system for the touchless input of information, according to one embodiment.
  • Fig. 14a is a diagrammatic front view of a touchless input device and display screen, according to still another embodiment
  • Fig. 14b a diagrammatic side view of the touchless input device and display screen of Fig. 14a;
  • Fig. 15 is a diagrammatic view of a touchless input assembly, according to one embodiment
  • Fig. 16 is a diagrammatic view of a touchless input assembly as in Fig. 15 shown in the process of installation to a POS system;
  • FIG. 17 is another view of a touchless input assembly installed in a POS system, according to one embodiment
  • FIG. 18 is yet another view showing a portion of the touchless input assembly of Figs. 15-17;
  • Fig. 19 is a side diagrammatic view of portions of a POS system, according to one embodiment;
  • Fig. 20 is a diagrammatic view of a touchscreen monitor configured according to one embodiment;
  • Fig. 21 is a functional block diagram of a POS system, according to one embodiment
  • Fig. 22 is a diagrammatic view of a touchless input assembly, according to one embodiment.
  • Fig. 23 is a diagrammatic view of a touchless input assembly, according to one embodiment.
  • System 10 includes a touchless input device of any suitable type such as a rectangular infra-red (IR) frame overlay 18 (hereinafter referred to at times as an “IR frame” or an “IR overlay”) disposed at a distance from a touchscreen 12 input device.
  • Touchscreen 12 is operatively connected to a control system such as a computer in a point of sale (POS) system.
  • POS point of sale
  • Touchscreen 12 includes a screen surface 14 capable of displaying a variety of images such as functional icons, or functional graphics, in a graphical user interface (GUI).
  • GUI graphical user interface
  • a “functional graphic” refers to a graphic that when selected by a user by touching at the location of the graphic or touchlessly selecting that graphic causes a POS system to perform a predetermined function, as further discussed herein.
  • a part of a graphical user interface that is not itself a graphic as such could also be functional.
  • a non-functional graphic would be a graphic displayed on touchscreen 12 at a location where no action/function is taken responsive to touch or attempted touchless interaction.
  • Predetermined functions performed by a POS system as contemplated herein may, for example, select a desired good or service for purchase, look up an item, login, logout, enter a numeral, “advance” the screen display or “go back,” confirm a payment or select a payment type, enter a payment value, check out a book, select to print a receipt, call an attendant, and many others).
  • Screen surface 14 may itself be formed by or include a touch-sensitive layer, such as a capacitive layer, or multiple resistive layers, of known design as further described herein.
  • a “touchscreen” includes hardware over and above that of a non-touchscreen computer display. The present disclosure is not limited to any particular touchscreen hardware technology, nor to any particular touchless input device technology.
  • IR overlay 18 is capable of detecting and tracking both the horizontal (X-axis) position and vertical (Y-axis) position of an object such as a user’s finger or a stylus when inserted within the area or central opening defined by IR overlay 18, in particular when the object penetrates a sensing plane defined by IR overlay 18.
  • the IR overlay 18 is disposed at a distance from the surface of touchscreen 12 thereby creating an air gap 16 between screen surface 14 and the sensing plane defined by IR overlay 18.
  • the exact size of air gap 16 may vary from system to system, but preferably is large enough that a user may insert an object within IR overlay 18 to penetrate the sensing plane without touching and thereby risking contamination of either screen surface 14 or the inserted object.
  • the air gap may be relatively smaller. In other applications, such as where customers are exclusively employees who have been trained on system 10 the air gap may be relatively larger. In a practical implementation the air gap distance is from 0.5 inches to 1 inch, more particularly from 0.7 inches to 0.8 inches and still more particularly about 0.75 inches. It has been discovered that at approximately 0.75 inches users are generally unlikely to touch the display and parallax, further discussed herein, is relatively manageable. In other instances, the air gap distance may be about 0.75 inches or greater such as from two to four inches.
  • IR overlay 18 As IR overlay 18 is disposed at a distance from screen surface 14 the phenomenon of parallax may be an issue, and as further discussed herein is the displacement or difference in the apparent relative positions of objects or targets when viewed along different lines of sight.
  • a user As seen in Fig. 1, a user’s viewing position 20 having a line of sight 22 to a particular icon 28 displayed on touchscreen 12 may have a perceived location 24 relative to IR overlay 18 which is displaced from its actual location 26.
  • the magnitude of the displacement can vary according to factors such as the viewing angle as well as the distance between the IR frame and the touchscreen surface.
  • the perceived icon location 24 is displaced vertically (along the Y- axis) above its actual location 26.
  • a touchless input system 30 having an IR frame overlay 38 disposed at a distance 36 from a touchscreen 32 having a screen surface 34 is disposed at an angle from a user’s viewing position 40.
  • the declined angle of the screen 32 and frame 38 relative to the viewer 40 results in a line of sight 42 which displaces the perceived image 44 at a distance below (lower) along the Y-axis with respect to IR frame 38 relative to the actual position 46 of an icon 48.
  • displacements along the X- axis are also possible when an icon is viewed from the left or right of its actual position.
  • System 50 includes an infra-red (IR) frame overlay 58 disposed at a distance from a touchscreen 52 input device.
  • Touchscreen 52 is operatively connected to a control system such as a computer running POS software.
  • Touchscreen 52 includes a screen surface 54 capable of displaying a variety of images such as icons, in a graphical user interface indicated generally at 53, for a POS system and detecting the selection of an icon by a user who touches the screen surface 54 at a desired icon 68 which then may trigger a predetermined action.
  • IR overlay 58 is capable of detecting and tracking both the horizontal (X-axis) position and vertical (Y-axis) position of an object such as a user’s finger when it is inserted within the area encompassed by the IR overlay 58 and penetrates the sensing plane.
  • IR overlay 58 is disposed at a distance from the surface of touchscreen 52 thereby creating an air gap 56.
  • the system 50 produces a visual indicator image 72 (“indicator 72”) which is displayed on screen surface 54 where the user’s finger is actually pointing.
  • Indicator 72 is two-dimensional but is shown three-dimensionally for illustrative purposes. Producing indicator 72 enables compensating for parallax, as a user may otherwise assume they are pointing at a location on screen surface 54 different from the location at which they are actually pointing.
  • Indicator 72 may be a variety of icons or images such as an arrow, a circle, a finger, or any other image or icon, collectively referred to as a “pointer,” capable of indicating to a user a particular area or location on the screen.
  • Indicator 72 may be translucent or opaque, of any color, and may incorporate motion, blinking, or other animation or characteristics as desired.
  • an indicator may create shading or a halo effect around the icon or area being pointed at.
  • indicator image 72 is displayed at a location in an X-Y coordinate system that is aligned with a location of penetration of the sensing plane by object/fmger 70 in the X-Y coordinate system.
  • a selection of the icon may be made by the user.
  • the selection action might be if a user holds an object still, for instance within a motion tolerance of a few pixels, over a particular location for a predetermined time duration (e.g., 1 second or less), if a user makes a particular gesture within the IR frame area (e.g., turning the finger in a tight loop), or if the user issues an audible command (if the POS system includes a microphone).
  • the system may optionally include a confirmation step where a “confirm” icon is brought up on the touchscreen once a select action is detected by the system.
  • a selection action as discussed herein can be understood as the physical action taken by a user, holding an object still, moving an object in a certain way, penetrating and exiting the sensing plane, or something else.
  • the selection action can further be understood to be analogous to performing a mouse click (mouse-down + mouse-up) as further discussed herein.
  • a user interaction input or signal as discussed herein can be understood as the electrical action(s) taken by a touchless input device in response to a selection action or parts thereof.
  • Outputting a user interaction signal could include outputting raw X-Y coordinate data from an IR overlay to a computer in a POS system in some instances.
  • the POS system can be understood to perform a predetermined function based on a selection action and based on a user interaction signal.
  • the POS system detects that an icon is selected and is caused to perform a predetermined function based on a time duration an object has penetrated the sensing plane.
  • the computer in the POS system may track time that an object is held still at any given X-Y location, such as by starting a counter once a time duration of a few milliseconds is detected at the given X-Y location.
  • the selection action is based on penetration of the sensing plane with the object and exiting of the object from the sensing plane, analogous to the penetration of the sensing plane with the object being a mouse-down portion of a mouse click and removal of the object from the sensing plane being a mouse-up portion of a mouse click.
  • a user interaction signal could be produced when the object penetrates the sensing plane, exits the sensing plane, or moves in X-Y directions in the sensing plane.
  • the selection action is recognized based on both actions of penetrating and exiting the sensing plane, much like the user is pushing a button without actually touching the button. The performance of the predetermined function is thus triggered when the user withdraws the object from the sensing plane.
  • a user-perceptible alert such as an audible sound or a display of a graphic, text, screen flash, etc. may be produced to alert or instruct the user to remove the object from the sensing plane after a predetermined time duration has elapsed, since so long as the user maintains the object in the sensing plane a selection action cannot be recognized, analogous to the user holding a mouse button down but not having released it.
  • Fig. 5 shows a touchless input system 80 according to one embodiment.
  • a touchless input device 86 is mounted to a touchscreen 82 of an existing POS system.
  • Touchless input device 86 includes an IR frame overlay 88 and one or more mounting brackets 90 for mounting input device 86 to touchscreen 82 at a distance to define an air gap 92 between IR overlay 88 and touchscreen 82.
  • IR overlay 88 and mounting bracket 90 may be separate components or they may be formed as a unitary body.
  • Bracket 90 may be mountable to touchscreen 82 using screws, bolts, clips, or other fasteners or using adhesives, epoxy, or the like.
  • IR overlay 88 may be oversized in at least one of height or width, and typically both, relative to touchscreen 82.
  • IR overlay 88 allows the physical structure of IR overlay 88 to be outside of the area with which a user is likely to interact, minimizing touch risk to IR overlay 88 itself.
  • the central opening defined by IR overlay 88 is oversized to touchscreen 82 in at least one of a vertical aspect or a horizontal aspect.
  • Bracket 90 and other brackets contemplated herein, could be L-shaped, for instance, in the manner of an angle iron and having a flat mounting surface oriented generally parallel to the touchscreen itself for attachment to the touchscreen or parts of the touchscreen such as a housing.
  • a bracket could include a pad or a peg that extends linearly from an IR overlay and having a first end or side attached to the IR overlay, and an opposite end free for attachment to the touchscreen or a touchscreen housing, for instance. While brackets are shown positioned along left and right sides of an IR overlay in the attached drawings, in other instances brackets could be located at each of the corners of the IR overlay, upon top and bottom edges, or elsewhere.
  • a pad or wall could be continuous, or nearly continuous, around a periphery of the IR overlay, and extend between the IR overlay and the touchscreen.
  • Brackets for mounting an IR overlay as discussed herein can be sized and shaped such that upon installation a desired spacing distance between the IR overlay and the touchscreen is obtained, providing a desired air gap distance between the sensing plane of the IR overlay and touchscreen.
  • the mounting brackets could be adjustable to vary the spacing distance, such as by way of slots in the bracket receiving fasteners that can be loosened to enable sliding, or tightened to set a position of the bracket relative to the IR overlay.
  • the IR overlay 94 includes an outer frame 96.
  • Outer frame 96 may be shaped as desired, but will be generally shaped as a corresponding touchscreen, typically rectangular or square.
  • Frame 96 may be sized as desired, but typically will be slightly larger than a corresponding touchscreen. That is, the frame will typically extend beyond the area of a touchscreen in both the vertical and horizontal dimensions.
  • IR overlay 94 additionally includes two light producing arrays 98 (such as light emitting diodes (LED), one disposed along a horizontal portion of frame 96 and one disposed along a vertical portion of frame 96, as well as two light detecting arrays 100 also disposed along one horizontal portion of frame 96 and one vertical portion of frame 96.
  • Frame overlay 94 can detect when an object such as a stylus or finger has entered the area (sensing plane) of frame 96 by an interruption of light arriving at a light detecting array from a light producing array. The exact location of the object within the frame 96 is determined by where along the horizontal (X-axis) and vertical (Y-axis) the interruptions are detected.
  • Another example of an IR overlay 102 is shown in Fig.
  • IR overlay 102 includes a frame portion 104 and two bracket portions 106. Bracket portions 106 are mounted to a touchscreen 108 of a POS system 109.
  • POS system 109 is shown in the context of a self check kiosk having a base 111 and a stand 113 supporting touchscreen 108 at a location vertically above base 111.
  • a touchless input system 110 includes a display screen 114 mounted inside a cabinet 112. Images from display screen 114 are reflected off of a reflective surface 116 such as a mirror or a prism through an IR frame opening 118 such that a user may view images displayed on display screen 114 through IR frame opening 188. Selections may be made by the user 120 via an IR frame overlay 118 similar to those systems previously described. Touchless input system 110 in this particular example has the advantage of positioning display screen 114 far out of reach so that the possibility of accidental contact of the screen by a user is essentially impossible.
  • a retrofitting kit 122 includes an IR overlay 124 having one or more mounting brackets 126 adapted for mounting IR overlay 124 at a distance from a touchscreen display, an interface cable 128, a software package 130, and optionally mounting bracket adapters 132.
  • the size of IR overlay 124 as well as the location, type, and number of mounting brackets 126 and/or bracket adapters 132 may vary according to the particular touchscreen and/or POS system the kit 122 is intended for retrofitting.
  • the type of interface cable may include a universal serial bus (USB) style cable, a micro-USB, an ethernet cable, a firewire, eSATA, MIDI, or other suitable interface cable.
  • IR overlay may include appropriate hardware and firmware for wireless interfacing with a POS system such as Bluetooth®, wi-fi, infra-red, radio frequency, or other suitable wireless communication protocols.
  • the software package includes software which can be run on the POS system and allows the POS system to receive inputs from IR frame overlay 124 for interfacing and delivering information from IR frame overlay 124 to the POS system.
  • the software package may be delivered via a physical medium such as a compact disc, DVD, flash drive, secure digital (SD) card, or via a downloadable package delivered digitally over the internet. It should be appreciated that the software package can configure a computer on a POS system to perform any or all of the functions of a touchless input system as described herein in connection with any of the various contemplated embodiments.
  • a physical medium such as a compact disc, DVD, flash drive, secure digital (SD) card
  • a touchless information input system 140 suitable for use with a physical keypad 142 is shown in Fig. 10.
  • keypad 142 includes physical keys 144 each having an individual light source 146.
  • An IR frame overlay 150 is disposed at a distance from keypad 142 creating an air gap 148.
  • system 140 causes the light 146 of the individual key 144 which is being pointed at to light up. If this is the desired key then the user can perform a suitable select action as described herein and the POS system then performs the specific function which would have been generated by physically depressing that key.
  • FIG. 11 Another touchless information input system 160 suitable for use with a physical keypad 162 is shown in Fig. 11.
  • keypad 162 includes physical keys 164.
  • An IR frame overlay 168 is disposed at a distance from keypad 162 creating an air gap 166.
  • the system detects the location of the object. The system then causes a light 172 to be projected from one or more light sources 170 located on the IR frame 168 onto the key 164 being pointed at by the user.
  • Fig. 12 shows a schematic diagram of one example of a touchless information input system 174.
  • a POS system or device 180 such as a computer in a self-check or other kiosk is operationally connected to a touchless interface 176 such as one of the IR frame overlays previously described as well as to a display device 178.
  • POS system 180 is typically capable of running software for operating the POS system, running software for operating the touchless interface device, accepting input from the touchless interface device, optionally accepting input from the display device, outputting information to the display device, and optionally outputting commands to other devices such as printers, servers, handheld electronic devices of employees, or still others.
  • FIG. 13 shows a flowchart of example logic and methodology flow of how a touchless information input system 182 might operate.
  • an object is detected 184 within the area enclosed by an IR overlay where the object penetrates the sensing plane.
  • the system calculates the pointer (indicator image) location 186 based on the X and Y coordinates of the object within the area encompassed by the IR overlay.
  • the pointer is then displayed 188 on the POS touchscreen.
  • the system then waits for a user interaction signal (and/or queries if an indicated location is a desired selection), for instance, waiting a time duration, or detecting penetration of the sensing plane with an object and removal of the object from the sensing plane, detecting a confirmation gesture, a user voice input, or still another. If no selection is detected then the system may loop back to detect an object within the IR overlay again. If a selection is confirmed then the selection is made 192 and the POS performs the function the selection would have caused had the screen actually been touched at that location. Depending upon what type of selection action the computer is configured to recognize, a user-perceptible alert can be generated to prompt a user to withdraw the object from the sensing plane.
  • Figs. 14a-14b show a diagrammatic view of a touchless input system 200 according to another embodiment.
  • a touchless display device 204 such as an IR overlay as previously described is disposed at a distance from a visual display 202 such as a touchscreen.
  • the distance forms an air gap 210 between touchless display device 204 and visual display 202.
  • the size of air gap 210 may vary depending on a particular application. In some examples the air gap is relatively smaller such as one inch. In other examples, the air gap is relatively larger such as two to four inches so as to allow for objects to penetrate the sensing plane defined by touchless display device 204 to a greater distance without contacting visual display 202.
  • touchless display device 204 is larger than the area of visual display 202. As is shown in Fig. 14a, touchless display device 204 is larger in both the vertical 206 dimension as well as the horizontal 208 dimension. The exact size of the vertical and horizontal overages may vary depending on the application, but typically will range from one to four inches in each direction. Making touchless display device 204 larger in area than visual display 202 allows for a larger usable viewing angle for users and limits risk of a user actually contacting device 204.
  • a touchless input assembly 317 including a touchless input device, for example an IR frame overlay, 318 attached to a bezel bracket 319.
  • Assembly 317 is structured to slide over an existing touch monitor, or conventional monitor, and includes sidewalls 321 formed by bezel bracket 319.
  • Sidewalls 321 may depend downwardly, into the page in Fig. 15 approximately, from a main body section 323 that forms three sides of a rectangle.
  • a bottom side 331 or edge of the rectangle is an open side to enable slipping bezel bracket 319 over an existing monitor.
  • bezel bracket 319 may be formed of a plurality of separate bracket pieces, such as elongate metal frame pieces having walls oriented at about 90 degrees to one another, two of which may be equipped with slots 327 that can receive fasteners 328 for securement, or other protrusions, at a range of locations. Slots and fasteners, or another adjustment mechanism, can enable bezel bracket 319 to be adjusted in width and secured in a desired state upon a display of an existing POS system 325.
  • a deformable member 320 which can include an elastically deformable shock cord or bungee cord, can conform to various shapes of hardware in POS system 325, such as a touchscreen monitor.
  • Fig. 16 illustrates assembly 317 as it might appear in the process of being fitted over an existing touchscreen monitor of POS system 325.
  • Standoff connector mounts 329 position IR frame 318 at a distance relative to bezel bracket 319 that provides a desired air gap.
  • Bezel bracket 319 may form a central opening 333 that is generally in register with the touchscreen display of POS system 325.
  • IR frame 318 may be structured similarly to other IR frames disclosed herein and equipped with a USB cable or another electrical communication connection cord 335 that plugs into an open port in POS system 325.
  • Deformable member 320 can be detached in some instances to be routed around, through, over, under, or behind other apparatus of POS system 325.
  • Alternative deformable members could be provided that are plastically deformable, or have variable, adjustable configurations, to provide a secure attachment to hardware in POS system 325.
  • bezel bracket 319 may be structured generally complementarily to a touchscreen monitor in POS system 325 and adjusted by way of sliding individual frame elements to different widths as desired. It should be appreciated that rather than standoff connector mounts 329, a different connecting structure, for example, a continuous peripheral wall, or threaded rotatable fasteners threadedly engaged with one or both of bezel bracket 319 or IR frame 318, clamps, or any other suitable structure could attach IR frame 318 to bezel bracket 319 at the desired air gap distance, which air gap distance may be adjustable.
  • Protective non-metallic pads 337 may be attached to bezel bracket 319 as shown in Fig. 18.
  • FIG. 19 there is shown an original/exi sting touchscreen monitor 470 including a touchscreen 430.
  • an IR touchless add on frame device (not shown) has been fitted to monitor 470 and defines a sensing plane 420 located at a distance 410 in front of an original sensing/touch plane 460 formed by a display panel 440 and touchscreen 430.
  • Touchscreen 430 defines an original touch sensing plane 460.
  • Sensing plane 420 when broken, takes over the role of the original touchscreen 430, with the associated IR frame sending raw touch event data to a running application when a finger or other object breaks plane 420. Consistent with other embodiments discussed herein, this configuration eliminates the need to physically touch the original touchscreen 430.
  • users may physically touch the original screen by continuing to plane 460.
  • various devices such as self-serve kiosks, including ATMs, retail checkout stations, and others
  • providing an add-on IR touchless input device is not interpreted or otherwise detected by the user.
  • users may physically touch the original screen, potentially repeatedly touching the original display through an entire session, creating risk of spreading or contracting pathogens.
  • the original touch panel could be one of many known touch technologies, such as 5-wire resistive, surface capacitive, projected capacitive, SAW (surface acoustic wave), and infrared.
  • Methods of stimulus could include, for example, an audible alert, a full-screen momentary flash, a pop-up window message DO NOT TOUCH, or still another user-perceptible stimulus. Both an audible alert and a visual alert could be used at the same time.
  • FIG. 20 there is depicted an original touchscreen monitor 400 reconfigured using the touchscreen monitor configuration utility, such that most, or all, of the touch display area is disabled or inactivated, providing an inactive zone 480.
  • a block 401 shown in the inactive zone represents a touch controller (a computer) resident on original touchscreen monitor 400 and configured to output raw touch data to other parts of the POS system. Inactive or disabled means that touching the touchscreen will not trigger the operating system in the POS system to take any responsive action, although raw touch data will still be transmitted. In other words, once inactivated the native driver software for the touchscreen will not communicate touch data received from the touch controller to the operating system.
  • the touchscreen may be inactivated by opening the touchscreen driver software, on-site using an input device such as a keyboard plugged into the POS system, or remotely, and switching a setting from active to inactive.
  • an input device such as a keyboard plugged into the POS system
  • remotely and switching a setting from active to inactive.
  • raw touch data will be sent to a host computer resident in the POS system, but no mouse-down, mouse- up, enter key, or other touch event will trigger an action in the operating system such as a logical click or pointer movement.
  • the present strategy is contemplated to prevent duplicated button entry from occurring, which might happen if a finger or object is pointed toward a selected graphical button, such as where a user breaks plane 450 and continues to plane 460.
  • a user's finger initially breaks plane 450 and selects the numeral 5 button in a graphical keypad displayed for a user to enter a personal identification number or the like. The user's finger might then proceed further and physically touch the number 5 button on touchscreen 430. Absent the methodology and strategy disclosed herein, the host computer in the POS system could interpret the user having pressed the numeral 5 button twice, and thus produce an error such as a user login failure.
  • an original touchscreen is inactivated according to the present disclosure and no longer sending touch events, the original touchscreen can still be turned on and continue to transmit raw touch data.
  • the raw touch data can be thought of as an electrical signal produced by the original touchscreen irrespective of whether the touchscreen driver is set to active or inactive (disabled).
  • the raw touch data can consist of X-Y coordinates, as an example, sent to a USB driver 540 by way of a USB bus 530. Also shown in Fig.
  • USB driver software 550 and operating system software 570, together with USB bus 530 and USB driver 540 being resident on a computer processor 560 such as a microprocessor or a microcontroller and/or an associated computer readable memory.
  • Processor 560 may be a native processor in a POS system.
  • Touchless application software 600 which may be an example software package that is downloaded to the POS system as discussed herein, is shown at 600, and stored on a computer processor 560 and/or an associated computer readable memory.
  • Software 600 includes a USB traffic monitor module 580 configured to monitor a touch device based on VID/PID (vendor identification/product identification) hardware IDs that is then forwarded to a TCP port listener which flags an event to a touchless processor module 590.
  • VID/PID vendor identification/product identification
  • Software 600 may run in the same buffer as operating system software 570.
  • Touchless processor module 590 may run in a Windows or Linux or other operating system.
  • raw serial communications for touchscreens could be captured using a serial interface.
  • raw touch data can be captured using a HID (human interface device) application programming interface (API), or potentially a custom software driver to communicate directly to the touchscreen.
  • HID human interface device
  • API application programming interface
  • Software 600 can set an event flag, for instance, indicating that the original touch panel was touched unnecessarily.
  • a recorded audio file is played, for instance using a speaker 610, to inform the user they no longer need to or should not touch the touchscreen.
  • speakers 610 can be integral to the original touch monitor in the POS system or mounted elsewhere in the kiosk, for example.
  • a third-party self-serve application 620 can be provided to communicate directly to an API of software 600.
  • This feature could enable third-party self-serve applications to forward the user's current selected language mode using an API string (language call) in order to provide a recorded audio file, such as a .wav file, in a user's preferred language if the touchscreen is touched.
  • a user might start a session at the kiosk and “press” the Spanish language button.
  • Third-party software 620 would send a string to the touchless application software 600 so that in the event the user touched the touchscreen they would receive a voice audio message or text message in their preferred language.
  • Any of the example embodiments contemplated herein can include positioning a sensing plane defined by a touchless input device at an air gap distance from a display in a POS system.
  • the touchless input device including an IR frame overlay for example, is then electrically connected to the POS system.
  • Personnel operating the POS system, including a technician or information technology professional installing the touchless input device can then disable an original touchscreen in the POS system.
  • Disabling a touchscreen of a display is a routine operation in known touchscreen systems as discussed herein, and can be performed by way of a textual user interface or a graphical user interface displayed on the touchscreen itself, or potentially a connected computer, and with a user switching a preexisting setting in the touchscreen driver from ON to OFF.
  • a graphical user interface will be displayed on the display screen of the POS system.
  • the touchless input device can output a user interaction signal to the POS system.
  • the user interaction signal can include a location or a motion of the user's finger, object, et cetera, according to X-Y coordinates defined by the touchless input device.
  • Operating the POS system can further include associating the user interaction signal with one of a plurality of functional graphics of the graphical user interface that is displayed.
  • the functional graphics could include numeral buttons, or any of an essentially endless variety of icons, images, zones, words, or other functional graphics.
  • a plurality of functional graphics means more than one graphical element, each having a different predetermined function when activated such as by a mouse click.
  • Operating the POS system can further include causing the POS system to perform a predetermined function, such as execute a user account login, display a popup graphic, display a visual or audio alert, or take any other predetermined action perceptible or not perceptible to a user, responsive to the user interaction signal.
  • the predetermined action is based on the association of the user interaction signal with the one of a plurality of functional graphics of the graphical user interface.
  • the predetermined action may be dependent upon which graphical button the user touchlessly activates.
  • the touchscreen may be disabled in the sense that touch data is not forwarded to and acted upon by the operating system of the POS system, the touchscreen is still turned on and will output raw touch data or a touch signal from the disabled touchscreen indicative of a user touching the disabled touchscreen.
  • a user-perceptible alert such as a visual alert or an audio signal, may be produced based on the touch signal.
  • the user-perceptible alert may be a screen flash, a text message, a popup graphic, an audio alert, or still another.
  • POS system 710 there is shown a POS system 710 according to one embodiment and including a kiosk 712 having a base 714 and a touchscreen display 716 supported upon base 714.
  • POS system is shown as it might appear having been retrofitted for touchless entry of information in a system that, prior to retrofitting, employed a touchscreen display 716.
  • POS system is shown as it might appear where a bezel bracket 718 is being mounted to touchscreen display 716.
  • Bezel bracket 718 can be formed by three legs 719 attached so as to form three sides of a square or rectangular shape, with an open side shown at 732.
  • Bezel bracket 718 further incudes sidewalls 722 formed upon opposed ones of legs 719 enabling bezel bracket 718 to fit over touchscreen display 716 to position an attached face frame 720 equipped for touchless information input in a manner similar or identical to that of preceding embodiments. Face frame 720 will thus be positioned at an air gap distance from a touch sensitive screen surface of touchscreen display 716, again consistent with other embodiments described herein.
  • Face frame 720 includes an inner perimeter 730 that will include emitters and detectors defining a sensing plane that is broken by a user’s finger or other object. Face frame 720 includes a first mounting flange 724 on a first side of face frame 720 and a second mounting flange (not numbered) on a second side of face frame 720. Each mounting flange 724 is attached to one of legs 719, such as by way of attachment screws 728. In other embodiments mounting flashes may be positioned upon bezel bracket 718 in addition to or instead of mounting flanges upon face frame 720. Shock cord mounting screws 726 are used to attach with a shock cord as described in connection with other embodiments.
  • POS system 810 is shown in the process of being fitted with a face frame 820. Face frame 820 will be configured similarly to other embodiments but is attached to a kiosk 812 having a touchscreen display 816 in a different manner.
  • POS system 810 includes a top bracket 822 attached to face frame 820, and a bottom bracket 826 attached to face frame 820. Rather than a bezel bracket mounting configuration as discussed in connection with the embodiment of Fig.
  • leg portions 819 of face frame 720 may form a complete rectangular shape, as opposed to the open-sided rectangular shape in other embodiments. Peripheral edges 828 of face frame 820 may be spaced from touchscreen display 716 when POS system 810 is fully assembled for service.
  • setting up a touchless information input system can also include configuring an existing computer in the POS system to operate with the add-on touchless input device.
  • Configuring the computer can include downloading a software package as described herein, for example delivering it digitally, such that the computer is configured by way of control software newly stored thereon.
  • the computer may be configured by way of the control software to operate the POS system much the same as before, but receiving information inputted touchlessly instead of responsive to actually touching a touchscreen.
  • the computer may be configured in particular by way of the control software to produce, on the graphical user interface, an indicator image for an object penetrating the sensing plane, as described herein, to receive a user interaction signal from the touchless input device to the POS system, and cause the POS system to perform one or more predetermined functions responsive to the user interaction signal.
  • the computer may also be configured by way of the control software to disable the touchscreen, although disabling the touchscreen could also be performed manually, and to produce a user-perceptible alert based on a user touching the touchscreen.
  • One strategy to greatly reduce the transmission of pathogens between people is to eliminate the need of physically touching buttons of a graphical user interface on a touchscreen when using a self-service kiosk. This is accomplished by the methodologies discussed herein of introducing an IR frame overlay, mounted a distance in front of the original touchscreen of a kiosk's monitor, creating air-gap space between the original touchscreen surface and the IR frame. The IR touch frame overlay then takes over the role of detecting finger pointing and positioning. This method affords a patron to simply "break the plane" by penetrating the IR frame with a finger, or a pointer object at the desired graphical button without the need to physically touch any surface.
  • the disclosed systems compensate for this issue by generating a visual indicator when the IR frame is penetrated by an object at the location on the display where the system detects the object to be pointing.
  • the visual indicator may be an image similar to a mouse pointer, or it may be an indicator light generated by the visual display or even projected by the IR frame itself.
  • a confirmation such as holding the indicator at the location for a predetermined period of time causes the system to generate an event such as a mouse click to confirm the selection and the POS system performs the triggered operation.
  • the disclosed systems may be retrofitted to existing POS or other touchpad driven systems such as those found in hotels, airports, grocery stores, retail outlets, gas stations, restaurants, and anywhere else such systems are used.
  • the disclosed systems may also be built into new POS or other systems allowing for the use of cheaper visual displays which lack touchscreen functionality.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention concerne des dispositifs et des systèmes pour entrer des informations au moyen de systèmes de point de vente (POS) à écran tactile sans avoir à toucher physiquement l'écran. Une superposition de trames IR détecte quand un doigt d'un utilisateur ou un autre objet rompt le plan de la trame et affiche une image sur l'écran pour indiquer quelle partie de l'écran tactile est actuellement choisie. Un signal est transmis au dispositif POS qui effectue ensuite l'action associée à la partie de l'écran tactile choisie par l'utilisateur comme si l'écran a été touché à cet emplacement. Dans un aspect associé, le fonctionnement d'un système POS comprend la désactivation d'un écran tactile d'un dispositif d'affichage, et l'association d'un signal d'interaction d'utilisateur à partir d'un dispositif d'entrée sans contact avec un graphe d'une pluralité de graphes fonctionnels d'une interface utilisateur graphique affichée sur le dispositif d'affichage. Le système POS est amené à effectuer une fonction prédéterminée en réponse à l'entrée de l'utilisateur.
PCT/US2021/031545 2020-05-10 2021-05-10 Dispositifs et systèmes d'entrée sans contact d'informations WO2021231281A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202063022532P 2020-05-10 2020-05-10
US63/022,532 2020-05-10
US202063055984P 2020-07-24 2020-07-24
US63/055,984 2020-07-24

Publications (1)

Publication Number Publication Date
WO2021231281A1 true WO2021231281A1 (fr) 2021-11-18

Family

ID=78524835

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2021/031545 WO2021231281A1 (fr) 2020-05-10 2021-05-10 Dispositifs et systèmes d'entrée sans contact d'informations

Country Status (1)

Country Link
WO (1) WO2021231281A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022233540A1 (fr) * 2021-05-04 2022-11-10 Imprimerie Nationale Kit de detection pour borne interactive

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040011932A1 (en) * 2002-06-07 2004-01-22 Simon Duff Stand for flat panel display
US7928964B2 (en) * 2005-04-22 2011-04-19 Microsoft Corporation Touch input data handling
US20110090147A1 (en) * 2009-10-20 2011-04-21 Qualstar Corporation Touchless pointing device
WO2016102948A1 (fr) * 2014-12-24 2016-06-30 University Of Hertfordshire Higher Education Corporation Interaction cohérente sans contact avec des images 3d stéréoscopiques
US20190212849A1 (en) * 2018-01-09 2019-07-11 GM Global Technology Operations LLC Method and apparatus that detect driver input to touch sensitive display

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040011932A1 (en) * 2002-06-07 2004-01-22 Simon Duff Stand for flat panel display
US7928964B2 (en) * 2005-04-22 2011-04-19 Microsoft Corporation Touch input data handling
US20110090147A1 (en) * 2009-10-20 2011-04-21 Qualstar Corporation Touchless pointing device
WO2016102948A1 (fr) * 2014-12-24 2016-06-30 University Of Hertfordshire Higher Education Corporation Interaction cohérente sans contact avec des images 3d stéréoscopiques
US20190212849A1 (en) * 2018-01-09 2019-07-11 GM Global Technology Operations LLC Method and apparatus that detect driver input to touch sensitive display

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022233540A1 (fr) * 2021-05-04 2022-11-10 Imprimerie Nationale Kit de detection pour borne interactive

Similar Documents

Publication Publication Date Title
US6864882B2 (en) Protected touch panel display system
US9946506B2 (en) Dual screen point-of-sale system
US7741957B2 (en) Method for break reminder and display device using the same
CA2838280C (fr) Surface interactive avec detection de proximite d'utilisateur
US20170249912A1 (en) Method and apparatus for controlling information display areas in a mirror display
US20020075243A1 (en) Touch panel display system
US20150242038A1 (en) Filter module to direct audio feedback to a plurality of touch monitors
US20030206275A1 (en) Merchandise display case and system
EP3866389B1 (fr) Distributeur de combustible transparent
US20120268398A1 (en) Display input apparatus
CN101464754A (zh) 任何平面四边无附加设备实现多点触控的定位方法和装置
WO2021231281A1 (fr) Dispositifs et systèmes d'entrée sans contact d'informations
WO2013081672A1 (fr) Dispositif d'entrée tactile multipoint
WO2014116580A1 (fr) Système de point de vente à kiosques de présentation transparents
US8589232B2 (en) Advertising method and system with use of multi-screened computer monitor units
KR102407318B1 (ko) 프로젝터 스마트테이블
US11270559B2 (en) Scanner with projected human interface
US20140040024A1 (en) Establishment based advertising method and system
KR20130115585A (ko) 투명 디스플레이 패널을 포함하는 디지털 컨텐츠 제공겸용 멀티 자판기
JP2006011765A (ja) 自動取引装置
US20060066580A1 (en) External hanging touch screen
TWI430170B (zh) 電子看板
US20150248273A1 (en) Providing audio feedback for touch events

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21803117

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21803117

Country of ref document: EP

Kind code of ref document: A1