WO2012139203A1 - Commandes physiques à rétroaction tactile pour dispositifs tactiles captifs - Google Patents

Commandes physiques à rétroaction tactile pour dispositifs tactiles captifs Download PDF

Info

Publication number
WO2012139203A1
WO2012139203A1 PCT/CA2012/000348 CA2012000348W WO2012139203A1 WO 2012139203 A1 WO2012139203 A1 WO 2012139203A1 CA 2012000348 W CA2012000348 W CA 2012000348W WO 2012139203 A1 WO2012139203 A1 WO 2012139203A1
Authority
WO
WIPO (PCT)
Prior art keywords
pad
conducting
pads
touch screen
capacitive touch
Prior art date
Application number
PCT/CA2012/000348
Other languages
English (en)
Inventor
Justin Martin HENRY
Original Assignee
Joysticky Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Joysticky Inc. filed Critical Joysticky Inc.
Publication of WO2012139203A1 publication Critical patent/WO2012139203A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • A63F13/2145—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
    • A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
    • A63F13/98—Accessories, i.e. detachable arrangements optional for the use of the video game device, e.g. grip supports of game controllers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/039—Accessories therefor, e.g. mouse pads
    • G06F3/0393—Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A63F13/533—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game for prompting the player, e.g. by displaying a game menu
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
    • A63F13/92—Video game devices specially adapted to be hand-held while playing
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1037—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1068—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad

Definitions

  • the specification relates generally to user input enhancements for capacitive touch devices and more specifically to augmenting capacitive touch screen devices with buttons, direction pads, joysticks and other input means that provide tactile feedback while at the same time simulating contact by an electrical activation apparatus on the capacitive touch device.
  • Portable touch screen devices such as personal digital assistants (PDAs) have traditionally used resistive touch screen technology to sense the location of input presses on the screen by the user. While finger input is possible with resistive touch screen technology, input accuracy is generally better when the user uses a stylus or their fingernail to indicate touch location.
  • PDAs personal digital assistants
  • touch screen devices such as portable music players, mobile phones and tablet computers have changed to predominantly use capacitive touch screen technology as the primary input means.
  • capacitive touch screen technology over resistive touch screen technology for portable devices such as these is that a finger can be used for input, rather than a stylus, and finger input to the touch screen can be very accurate.
  • touch screen input offers advantages to both the manufacturer of the device and the user of the device.
  • One advantage of a touch screen user interface to a manufacturer is that they can design an extremely flexible user interface that is not dependent on physical user input layouts, such as button and joystick locations. This means that the user interface can change from time to time to adapt to the needs of the application. It also means that the user interface can be changed even after the user has used the device for some time, for example through a software update.
  • Advantages of a touch screen user interface include the device being small, portable and flexible, as a wide range of applications with different input layouts can be supported by the one device.
  • a major disadvantage is the lack of tactile feedback.
  • non-touch screen products such as cameras, calculators, game controllers, and remote controls
  • users become used to tactile feedback from buttons, joysticks, and other input means.
  • the lack of tactile feedback on touch screen devices is not only disconcerting to the user, but it also reduces usability of the touch screen device for at least the following reasons:
  • buttons Use a hidden, physical button (or buttons) underneath the touch screen display, or at the perimeter of the touch screen, or use a haptic transducer.
  • the purpose of the hidden buttons or haptic transducer is to provide vibration on the surface of the touch screen that has a familiar button click sensation when the touch screen is pressed.
  • ⁇ Provide a sleeve or case for the touch screen device, or provide a separate device that has physical buttons, and that communicates electrically or wirelessly with the device.
  • US Patent Application 2010/0081505 shows how a touch screen device can be inserted into a case that has physical buttons, and how such buttons can communicate with applications on the touch screen device through the electrical connector.
  • touch screen devices with wireless communication such as WiFi or Bluetooth can be made to communicate with wireless controllers that have buttons, D-Pads and joysticks.
  • Such methods of providing devices with buttons that communicate with the touch screen device are suboptimal because they create numerous disadvantages, such as increasing the size of the touch screen device, limiting the general use of the touch screen device, increasing the cost of goods, providing additional devices for the user to carry, and requiring software changes to the existing applications to take advantage of the button devices.
  • ⁇ Provide a sleeve or case for the touch screen device, or a separate device, that has a joystick or touch pad, in a similar manner to that discussed above.
  • These methods of providing devices that communicate with the touch screen device are suboptimal because they create numerous disadvantages, such as increasing the size of the touch screen device, limiting the general use of the touch screen device, increasing the cost of goods, providing additional devices for the user to carry, and requiring software changes to the existing applications to take advantage of the joystick or touch pad devices.
  • the present specification generally provides finger-simulating pads that are placed on the capacitive touch screen, traces that conduct electrical signals, and physical controls such as buttons, D-Pads and joysticks that provide tactile feedback to the user.
  • the finger-simulating pads are placed over the appropriated virtual controls on the touch screen, such as over virtual buttons, virtual D- Pads and virtual joysticks. Then, whenever an interaction occurs with the physical controls, an electrical connection is made between a user and the finger-simulating pads via the electrical traces, thereby simulating interaction with the virtual controls.
  • the application running on the touch screen device believes the virtual controls are being used, while in actuality, the user is interacting with the physical controls which have familiar tactile feedback.
  • the present specification further provides physical input means with tactile feedback for a user of a capacitive touch screen device.
  • the present specification further provides physical controls that are in an ergonomic location relative to the virtual controls on the touch screen device. [0030] The present specification further provides physical controls that are not directly on the virtual controls on the touch screen so that the user's fingers, and the physical controls, do not obscure information on the touch screen display device.
  • the present specification further provides physical controls that do not interfere with or limit the general use of the touch screen device.
  • the present specification further provides physical controls that do not prevent the user from using the virtual controls, or any other input on the touch screen device.
  • the present specification further provides physical controls that do not require any changes to the software, applications or operating system running on the touch screen device.
  • the present specification further provides physical controls that can operate on, and be compatible, with a wide range of existing capacitive touch screen devices.
  • the present specification further provides physical controls that can be easily removed if the user so desires, and do not produce any damage to the touch screen device.
  • the present specification further provides a different version of the physical controls that are not easily removed from the touch screen device.
  • the present specification further provides physical controls that are durable.
  • the present specification further provides physical controls for a touch screen device that are inexpensive to manufacture.
  • the present specification further provides physical controls for a capacitive touch device that does not contain a screen.
  • An aspect of the specification an apparatus for actuating a portion of a capacitive touch sensor, comprising: a conducting pad for placement on a portion of the capacitive touch sensor; and a connector for electrically connecting the conducting pad to an electrical activation apparatus, wherein when the electrical activation apparatus is in contact with the connector, a change in capacitance is detected at the capacitive touch sensor.
  • the conducting pad can be substantially transparent.
  • the conducting pad can comprise at least one of Indium tin oxide (ITO), at least one conductive plastic, at least one conductive polymer, carbon fibers, carbon powder, graphene, carbon nanotubes, micro-thin wire mesh, nanowires embedded in a polymer matrix, PEDOT, PEDOT:PSS, CleviosTM, OrgaconTM, antimony tin oxide (ATO), silver/indium sputtered films, hydrogel, a transparent gold layer, vacuum deposited material, hybrid conductive coatings, and metal foil.
  • ITO Indium tin oxide
  • PEDOT PEDOT:PSS
  • CleviosTM OrgaconTM
  • ATO antimony tin oxide
  • silver/indium sputtered films hydrogel, a transparent gold layer, vacuum deposited material, hybrid conductive coatings, and metal foil.
  • the connector can comprise a switch comprising an open position wherein the electrical activation apparatus is electrically isolated from the conducting pad, and a closed position wherein the electrical activation apparatus is electrically connected to the conducting pad.
  • the apparatus can further comprise an actuator for opening and closing the switch via the electrical activation apparatus.
  • the actuator can be conductive such that when the actuator placed in the closed position by the electrical activation apparatus, the actuator further electrically connects the electrical activation apparatus to the switch.
  • the apparatus can further comprise an insulating substrate for supporting the conducting pad and the connector. At least a portion of the insulating substrate can be substantially transparent.
  • the insulating substrate can be attachable to the capacitive touch sensor via at least one of static cling, suction, magnetism and an adhesive.
  • An area of the conducting pad can be similar to a given area of the capacitive touch sensor corresponding to a virtual button depicted on a display device beneath the capacitive touch sensor.
  • the apparatus can further comprise at least one switch for electrically connecting the connector to the electrical activation apparatus, and the at least one switch comprising an open position wherein the electrical activation apparatus is electrically isolated from the conducting pad, and a closed position wherein the electrical activation apparatus is electrically connected to the conducting pad.
  • the at least one switch can be enabled for location at one or more of: a housing of the capacitive touch sensor; a bezel of the capacitive touch sensor; a frame of the capacitive touch senor; adjacent the capacitive touch sensor; on a side of the housing; and, on the back of the housing.
  • the apparatus can further comprise at least one actuator for opening and closing the at least one switch, the actuator located over the switch.
  • the electrical activation apparatus can comprise one or more of a body part, a finger, a conducting stylus, a conducting apparatus, a housing of the capacitive touch sensor, a metal portion of the housing, a frame, a bezel, a ground plane and an ambient ground.
  • the apparatus can further comprise an intermediate tactile device connected to the conducting pad via the connector, the intermediate tactile device for use by the electrical activation apparatus to activate the conducting pad.
  • the intermediate tactile device can comprise one or more of a switch, a joystick, a direction pad (D-pad), a button, a trackball and a trackpad.
  • a connection between the intermediate tactile device and one or more of the conducting pad and the connector can be at least one of: conductive, resistive and capacitive.
  • Activation of the intermediate tactile device can connect the conducting pad to one or more of a housing of the capacitive touch sensor, a metal portion of the housing, a frame, a bezel, a ground plane and an ambient ground.
  • the conducting pad can be one or more of a size and shape that does not otherwise interfere with operation of the capacitive touch sensor in a normal use mode.
  • the conducting pad can be located on the capacitive touch sensor at a location for activating a given portion of the capacitive touch sensor, taking into account contact of the connector with the capacitive touch sensor.
  • the apparatus can further comprise a plurality of conducting pads, the plurality of conducting pads including the conducting pad, and a plurality of connectors in a one-to- one relationship with the plurality of the conducting pads, the plurality of connectors including the connector, wherein when the electrical activation apparatus is in contact with one or more of the plurality of connectors, a change in capacitance is detected at the capacitive touch sensor corresponding to a location corresponding to one or more of the plurality of conducting pads.
  • the plurality of conducting pads can be interdigitated. More than one of the plurality of conducting pads can be simultaneously activated by the electrical activation apparatus via a respective corresponding subset of the plurality of connectors, thereby simulating a movement at the capacitive touch apparatus.
  • a further aspect of the specification provides an apparatus for actuating a portion of a capacitive touch sensor on a display device surrounded by a housing, comprising: a substantially transparent substrate attachable to the capacitive touch sensor and the housing; a first array of conducting pads on the substrate for placement on a portion of the capacitive touch sensor; at least one conducting connector for placement on a portion of the housing; a plurality of electrically connecting traces for electrically connecting each of the connecting conducting pads to at least one conducting connector; at least one module comprising: at least one conductive contact pad; and at least one module contact for electrically contacting the at least conductive contact pad to the at least one conducting connector, such that when the at least one conductive contact pad is touched by an electrically activating apparatus, a change in capacitance is detected at the capacitive touch sensor underneath a portion of the first array corresponding to the subset.
  • the at least one conducting connector for placement on a portion of the housing can comprise a variable resistor, wherein each of the plurality of electrically connecting traces are connected to the variable resistor in a geometric pattern corresponding to the first array of conducting pads.
  • the at least one conducting connector for placement on a portion of the housing can comprise a second array of connecting conducting pads for placement on a portion of the housing, the second array of conducting pads in a one-to-one relationship with the first array of conducting pads, the plurality of connecting conducting pads arranged in a second grid corresponding to the first grid.
  • the plurality of electrically connecting traces electrically can connect each of the connecting conducting pads to a corresponding one of the conducting pads.
  • the at least one module can be enabled for placement over the second array.
  • the apparatus can further comprise at least one adapter enabled for insertion between the at least one module and the second array for making an electrical connection between the at least one module contact and a subset of the second array of connecting contact pads.
  • a further aspect of the specification provides an apparatus for holding a touch screen device comprising: a recessed portion for holding the touch screen device; and a substantially flat portion for locating accessories for the touch screen device, the substantially flat portion being substantially flush with the touch screen device when the touch screen device is held in the recessed portion.
  • Yet another aspect of the specification provides an apparatus for actuating a portion of a capacitive touch sensor, comprising: a pad for placement on a portion of the capacitive touch sensor, the pad comprising a given conductivity; and a connector for capacitively coupling the pad to electronics associated with the capacitive touch sensor, wherein when the electronics are capacitively coupled with the connector, a change in capacitance is detected at the capacitive touch sensor, the given conductivity for enabling the change in capacitance.
  • FIG. 1A depicts a capacitive touch sensor, according to the prior art.
  • Fig. IB depicts a signal measured by the capacitive touch sensor of Fig. 1A, according to the prior art.
  • Fig. 2A depicts a finger-simulating device for simulating finger touch, according to non-limiting implementations.
  • Fig. 2B depicts a signal measured by a capacitive touch sensor when the device of Fig. 2A is activated, according to non-limiting implementations.
  • Fig. 3 depicts a finger-simulating device for simulating finger touch with tactile feedback, according to non-limiting implementations.
  • Fig. 4 depicts a finger-simulating device for simulating finger touch with tactile feedback, according to non-limiting implementations.
  • Fig. 5 depicts a finger-simulating device for simulating finger touch with tactile feedback, according to non-limiting implementations.
  • Fig. 6 depicts a finger-simulating device for simulating finger touch with tactile feedback, according to non-limiting implementations.
  • Fig. 7A depicts a finger being used with a capacitive touch sensor with finger- simulating material there between, according to non-limiting implementations.
  • Fig. 7B depicts a signal measured by a capacitive touch sensor in the usage scenario depicted in Fig. 7A, according to non-limiting implementations.
  • Fig. 8A depicts an example button assembly structure, according to non-limiting implementations.
  • Fig. 8B depicts an exploded view of the example button assembly structure of Fig. 8A, according to non-limiting implementations.
  • Fig. 9A depicts an example D-Pad assembly structure, according to non-limiting implementations.
  • Fig. 9B depicts an exploded view of the example D-Pad assembly structure of Fig. 9A, according to non-limiting implementations.
  • Fig. 10A depicts an example joystick assembly structure, according to non- limiting implementations.
  • Fig. 10B depicts an exploded view of the example joystick assembly structure of Fig. 10A, according to non-limiting implementations.
  • Figs. 1 1 A, 1 IB, 1 1C, and 1 1D depict examples of joystick assembly structures, according to non-limiting implementations.
  • Fig. 12A depicts an example D-Pad pad layout, according to non-limiting implementations.
  • Fig. 12B depicts measured performance data of the example D-Pad pad layout of Fig. 12A, according to non-limiting implementations.
  • Fig. 13A depicts an example joystick pad layout, according to non-limiting implementations.
  • Fig. 13B depicts measured performance data of the example joystick pad layout of Fig. 13 A, according to non-limiting implementations.
  • Fig. 14 depicts graphics and touch zones of a touch screen device, according to the prior art.
  • Fig. 15 depicts example assemblies positioned on the touch screen device of Fig. 14, according to non-limiting implementations.
  • Fig. 16 depicts a positioning application running on a touch screen device, according to non-limiting implementations.
  • Fig. 17 depicts a plurality of touch screen accessories positioned on a touch screen device, according to non-limiting implementations.
  • Fig. 18A depicts an example three-button assembly in a first location on a touch screen device, according to non-limiting implementations.
  • Fig. 18B depicts the example three-button assembly of Fig. 18B in a second location on the touch screen device, according to non-limiting implementations.
  • Fig. 19A depicts modules and adapters on a touch screen device, according to non-limiting implementations.
  • Fig. 19B depicts a system of modules and adapters, according to non-limiting implementations.
  • Fig. 20 depicts apparatus for adapting to different virtual D-Pad, joystick, button, etc. layouts, according to non-limiting implementations.
  • Fig. 21 depicts example assemblies positioned on a touch screen device, according to non-limiting implementations.
  • Fig. 22 depicts an isometric view of example assemblies positioned on a touch screen device, according to non-limiting implementations.
  • Fig. 23 depicts an example accessory, according to non-limiting implementations.
  • Fig. 24 depicts an example slide out accessory, according to non-limiting implementations.
  • Figs. 25A and 25B depict an example case accessory, according to non-limiting implementations.
  • Fig. 26 depicts an assembly for use in combination with a touch screen device, for remote activation thereof according non-limiting implementations.
  • FIG. 1A depicts capacitive touch sensors according to the prior art.
  • capacitive touch sensors such as projected capacitance, self-capacitance and mutual capacitance sensors.
  • a capacitive touch sensor 1 1 has a grid of x and y conductive electrodes 12 separated by an insulating layer (not shown), a cover 14, signal generating and processing electronics (not shown), and housingl6.
  • the conductive electrodes 12 are made of a transparent material such as indium tin oxide (ITO), and the cover 14 is generally transparent glass or plastic.
  • ITO indium tin oxide
  • the capacitance of at least one of the x and y sensors at the location being touched exhibits a change of capacitance with respect to ambient ground.
  • the coordinates of the touch location on the touch sensor can be determined.
  • an electric field (not shown) is formed between the drive lines and the sense lines of the grid of conductive electrodes 12. Some of the electric field lines can extend above the drive and sense lines, and even above a cover 14. When a conductive object such as a finger 10 approaches or touches the cover 14, the object interacts with some of the electric field lines extending above the cover 14. Such interaction with the electric field lines changes the capacitance associated with drive and sense lines near that location, which changes the current flow from the drive line to the sense line, and which in turn changes the voltage value (or charge coupling) detected at the sense line.
  • Graph 1 G depicted in Figure IB shows the signal (or capacitance) as measured by the capacitive touch sensor 1 1 in the x direction along the line 1J-1K.
  • the capacitive touch sensor 1 1 is generally connected to electronics, analog and digital signal processors, and processing units running firmware, software, etc. (not shown). All these stages implement signal processing algorithms to condition the information coming from the capacitive touch sensor 1 1 , and calculate higher level information such as finger touch locations (x-y position of the finger), pressure, gestures, etc. Any suitable algorithm can determine the finger location to be xl based on calculations of the signal such as the thresholded peak or centroid.
  • Figure 2A depicts a finger-simulating device, according to non-limiting implementations.
  • the capacitive touch sensor 21 can be "tricked” into thinking a finger, or any other suitable electrical activation apparatus, is touching at a particular location (i.e. simulated touch) by interfering, blocking or interrupting the electric field lines (i.e. providing local capacitance) in a way that approximates the way a finger would.
  • any suitable electrical activation apparatus can be used in place of a finger, including but not limited to any other suitable body part of a user, a conducting stylus, a conducting apparatus and the like.
  • a suitable finger-simulating material 25 can be placed in close proximity to the cover 24, and can be electrically connected with the use of a conductor 23 to the hand 28, finger 20, or some other convenient part of the user.
  • Graph 2G in Figure 2B shows the signal as measured by the capacitive touch sensor 21 in the x direction along the imaginary line 2J-2K. The measured signal in Graph 2G in the simulated touch situation is similar to the signal measured in Graph 1 G in Figure 1 B for the actual touch situation.
  • a non-limiting example of finger-simulating material 25 comprises a thin disc of metal foil.
  • Another non-limiting example of finger-simulating material 25 comprises a disc of thin, transparent polyester film sputtered with a suitable conductive material, including but not limited to silver/indium. Additional details and examples will be given below.
  • a non-limiting example of a conductor 23 comprises a thin wire, however additional details and examples will be given below.
  • the finger-simulating material 25 approximates the shape of the end of a finger when it touches the cover 24, many signal processing algorithms determine that the signal provided by the finger simulating material 25 in electrical connection with the user is a finger touch, though simulated. In both the simulated and actual finger touch scenarios, the user's body acts as a virtual ground, or as a return electrical path (i.e. coupling) to the capacitive touch sensor's signal generating and processing electronics (not shown).
  • the finger simulating material 25 When the user is disconnected from the conductor 23, the finger simulating material 25 is no longer connected to the virtual ground, or is not coupled back to the electronics, and the finger simulating material 25 then does not affect the electric field lines in the way a finger would, and the measured signal intensity or capacitance is affected. Based on the type of capacitive touch sensor technology, the detected signal can be reduced, or even eliminated, such that signal processing algorithms determine that the (simulated) finger touch has ended, even though the finger-simulating material 25 remains in place.
  • the conductor 23 is relatively thin and short. For example, if the conductor 23 is too long, it can act as an antenna, thereby coupling unwanted signals to the finger-simulating material 23. Or if conductor 23 is too long and wide, it can have sufficient area to act as a virtual ground or coupler to the capacitive touch sensor's signal generating and processing electronics (especially when in close proximity to the capacitive touch sensor's housing 26 where the electronics are housed). This causes the capacitive touch sensor to detect a simulated finger press even when the user is not in contact with the conductor 23.
  • hysteresis i.e. having a lower and an upper threshold value.
  • a long or wide conductor 23 may not initially cause the detection of a false simulated finger press because its coupling to the touch sensor's signal generating and processing electronics may result in a measured signal below the hysteresis upper threshold value.
  • the signal processing algorithms determine that the simulated finger is still touching the cover 24 because the long/wide conductor's coupling results in a measured signal above the hysteresis lower threshold value.
  • the layout of conductor 23 is further arranged so as to not interfere with the touch sensor.
  • the touch sensor might measure the effect of the conductor 23 as being part of the area of the finger-simulating material 25, and the signal processing algorithms might determine the touch to be in a different location, or the shape to not match that of a finger, and reject the touch.
  • the conductor 23 can be connected to multiple finger-simulating material locations.
  • the conductor 23 can take a plurality of routes from the user to the finger-simulating material 23.
  • the conductor 23 can be connected to one or more locations on the finger-simulating material 23, for example when the finger- simulating material 23 has a high resistance.
  • the conductor 23 can have a higher resistance, such as that of a resistor or semi-conductor.
  • the conductor 23 can have signal processing capabilities in-line, and/or be connected to signal processing components. For example, its thickness could neck down in a location to form a resistor, or it could have a layout in a location to form an inductor.
  • local doping of the conductor 23 could produce other signal processing capabilities, such as that of a diode.
  • the finger-simulating material 25 need not be continuous.
  • it could have no material in the center of a disc, i.e. appear as a donut and/or annulus in plan view.
  • different designs of the finger-simulating material 25, conductor 23 and other components in the system can be different or changed depending on the type of capacitive touch sensor. For example, the user could be instructed to use a smaller area of fmger-simulating material 25 (such as by tearing off a tab) if they are using the assembly with a particular touch screen device.
  • a pad is appreciated to be “activated” when a touch screen device determines that a finger touch is present in the vicinity of the pad (i.e. a finger touch is correctly simulated), and “deactivated” when a touch screen device determines that no finger touch is present (i.e. a finger touch is no longer simulated).
  • pad 25 is appreciated to be “activated” when conductor 23 contacts hand 28 or finger 20, and “deactivated” when trace 23 is floating.
  • finger-simulating material 25 and conductor 23 together comprise an apparatus for actuating a portion of a capacitive touch sensor.
  • Such an apparatus generally comprises: a conducting pad for placement on a portion of the capacitive touch sensor; and a connector for electrically connecting the conducting pad to an electrical activation apparatus, wherein when the electrical activation apparatus is in contact with the connector, a change in capacitance is detected at the capacitive touch sensor.
  • Figure 3 depicts another example of how a user, or any other suitable electrical activation apparatus, can be connected to the finger-simulating material 35, in use with a capacitive touch sensor 31 , according to non- limiting implementations.
  • a switch 37 is used instead of the conductor 33 connecting directly to the user.
  • the switch 37 connects to the hand 38 via conductor 32.
  • the switch 37 closes, thereby creating an electrical path between the finger-simulating material 35 and the hand 38 through conductors 33 and 32, and a finger touch is simulated in the vicinity of pad 35.
  • Pad 35 is appreciated to be “activated” when switch 37 is closed and “deactivated” when switch 37 is open.
  • switch 37 and insulated button cap 39 provide tactile feedback to the user that the finger has depressed the switch and activated the function on the touch screen display.
  • the conductor 32 does not need to connect directly to hand 38, only to some part of the user with similar properties.
  • Figure 4 depicts how a button itself can be used to connect the finger-simulating material 45 to the finger 40, when in use with a capacitive touch sensor 41 , according to non-limiting implementations.
  • a conductive button cap 49 is used to activate the switch 47.
  • the switch 47 is connected to the conductive button cap through conductor 42.
  • the switch 47 closes, thereby creating an electrical path between the finger-simulating material 45 and the finger 40 through conductor 43, conductor 42 and conductive button cap 49, and a finger touch is simulated in the vicinity of pad 45.
  • Pad 45 is appreciated to be “activated” when switch 47 is closed and “deactivated” when switch 47 is open.
  • the switch 47 and conductor 42 can be the same mechanism.
  • a non-limiting example is when a metal dome comprises both the switch 47 and conductor 42 and thereby fulfills both functions.
  • the conductive button cap 49 can have higher resistance, such as that of a resistor or semi-conductor.
  • the conductor 43, switch 47, conductor 42 and button cap 49 can be stacked directly on top of the finger-simulating material 45.
  • the conductive button cap 49 can have a thin insulating layer so that there is capacitive contact between the conductive button cap 49 and the finger 40.
  • Figure 5 depicts another example of how the finger-simulating material 55 can be coupled to the touch sensor's signal generating and processing electronics to simulate a finger touch, according to non- limiting implementations.
  • a conductive coupler is placed relatively close to the capacitive touch sensor 51.
  • Suitable coupler materials include, but are not limited to, metal foil, a metal bezel and a metal-coated plastic case. The larger the area of the coupler 58, the further the coupler can be from the capacitive touch sensor 51.
  • the coupler 58 is connected to the switch 57 with conductor 52.
  • Figure 6 depicts another example of how the finger-simulating material 65 can be coupled to the touch sensor's signal generating and processing electronics to simulate a finger touch, according to non- limiting implementations.
  • a portion of housing 66 (or all of housing 66) of capacitive touch sensor 61 is conductive, and provides coupling to the touch sensor's signal generating and processing electronics.
  • Switch 67 is connected to the conductive portion of the housing 66 with conductor 62.
  • the switch 67 closes, thereby creating an electrical path between the finger-simulating material 65 and the conductive portion of the housing 66 via conductor 63 and conductor 62, and a finger touch is simulated in the vicinity of pad 65.
  • Pad 65 is appreciated to be “activated” when switch 67 is closed and “deactivated” when switch 67 is open.
  • Figure 7A depicts how the finger 70 can still be used effectively with the capacitive touch sensor 71 even when the finger- simulating material 75 remains on the cover 74, according to non-limiting implementations.
  • a thin insulator 78 such as a thin piece of plastic, can cover the thin finger-simulating material 75. Then, when the finger 70 is over the finger-simulating material 75, or in a location close to it, the capacitive touch sensor 71 can still determine the finger's approximate location.
  • the finger 70 is slightly above the cover 74 to the left of the finger-simulating material 75, and the conductor 73 is electrically floating.
  • the capacitance signal is now the combination of: the signal due to the finger 70 (similar to that in Graph 1G in Figure IB); and the signal due to the capacitive coupling between the finger 70, finger- simulating material 75 and the capacitive touch sensor 71 (e.g. at location x2).
  • This second signal is much lower than that in the case of Figure 2B (shown in Graph 2G) because there is no electrical contact between the user and the finger-simulating material 75. Therefore the capacitive touch sensor 71 determines the finger to be at location x3 which is close to the actual position (i.e. the position that would be measured if the finger-simulating material 75 and conductor 73 were not present).
  • the advantage of this construction example is that the finger-simulating material 75 can remain on the capacitive touch sensor 71 permanently or semipermanently under an insulator 78, and not interfere with the regular use of the capacitive touch sensor 71 with the finger 70.
  • the finger-simulating material 75 dimensions should not be much larger than that of a finger tip or else the signal due to the finger simulating material 75 will dominate the measured signal curve (i.e. the signal at location x2 due to the capacitive coupling between the finger 70, finger-simulating material 75 and the capacitive touch sensor 71).
  • Figure 8A and Figure 8B depict an assembled and exploded view of an example of the structure of a button assembly 8S to perform the functions described above, according to non-limiting implementations.
  • Pad 82 performs the function of the finger-simulating material described above.
  • the pad 82 can be manufactured by printing a thin layer of conductive, semi-conductive or resistive material on a substrate 81.
  • Other techniques to produce the desired shape and thickness of pad 82 can be used, including but not limited to vapor depositing or sputtering the pad material onto the top surface of substrate 81 , and the like. Any suitable masking and etching steps can be used to achieve the desired location, shape and thickness of pad 82.
  • the pad 82 can be manufactured separately and applied or adhered to substrate 81. [00136] In some implementations, if the button assembly 8S is to be applied to a capacitive touch screen device, the pad 82 can be visually transparent so as not to obscure information on the display screen.
  • substrate 81 can be flexible, transparent and thin. For example, when the substrate 81 is applied to a capacitive touch sensor (not shown), the user can still operate the capacitive touch sensor with their finger directly over or touching the substrate. Some example constructions and parameters will be discussed below.
  • Pad 82 can comprise any suitable material including, but not limited to:
  • ITO Indium tin oxide
  • Conductive polymers such as PEDOT and PEDOT:PSS (including brand names such as CleviosTM and OrgaconTM)
  • Trace 83 performs the function of a conductor described above (for example, conductor 43 in Figure 4).
  • the trace 83 can be manufactured by printing a thin layer of conductive, semi-conductive or resistive material on the substrate 81 , while ensuring that there is electrical contact between the trace 83 material and pad 82 material.
  • Other techniques to produce the desired shape and thickness of trace 83 can be used, such as vapor depositing or sputtering the trace material onto the top surface of substrate 81.
  • Various masking and etching steps can be used to achieve the desired location, shape and thickness of trace 83.
  • pad 82 and trace 83 can comprise the same material, and can be manufactured at the same time with the same masking and etching steps.
  • trace 83 can overlap pad 82 to obtain good electrical contact.
  • the trace could traverse to the opposite side of pad 82, for example.
  • trace 83 could form some shape on pad 82, such as a ring at the perimeter of pad 82, a star shape, an S shape, or any other suitable shape.
  • trace 83 can branch before reaching pad 82, and can contact pad 82 in multiple locations.
  • trace 83 is not a straight line.
  • trace 83 can be visually transparent so as not to obscure information on the display screen.
  • the trace 83 material be compatible with substrate 81 when it is flexible, transparent and thin.
  • Examples materials that are suitable for manufacturing trace 83 are the same as those listed above for pad 82, with the following additions including, but not limited to:
  • not all of the trace 83 need be of the same material.
  • that portion of the trace 83 can be made of other materials that are not necessarily transparent or thin such as:
  • other elements can be built into the trace 83, such as resistive elements, by altering the geometry and/or material of a portion of the trace 83. For example, if a portion of trace 83 is made very thin it will behave as a resistor. In another example, a portion of the trace 83 could be made from carbon ink.
  • Contact pad 84 performs part of the function of a switch described above (for example, switch 47 in Figure 4).
  • the contact pad 84 can be manufactured using any suitable technique, including but not limited to printing a thin layer of conductive, semi- conductive or resistive material on the substrate 81 , while ensuring that there is electrical contact between the contact pad 84 material and trace 83 material. Any other suitable technique to produce the desired shape and thickness of contact pad 84 can be used, including but not limited to vapor depositing or sputtering the contact pad 84 material onto the top surface of substrate 81. Any suitable masking and etching steps can be used to achieve the desired location, shape and thickness of contact pad 84.
  • contact pad 84 can be made of a material that can maintain conductivity even after a large number of contacts by the metal dome 86, including, but not limited to:
  • contact pad 84 can be an extension of trace 83.
  • the contact pad can be made at the same time from the silver ink.
  • pad 82, trace 83 and contact pad 84 can be made of layers of different materials.
  • contact pad 84 it can be made of two layers, such as one material that adheres well to substrate 81 and a second material that covers the first material that supports a long lifetime of button presses.
  • substrate 81 can be visually transparent so as not to obscure information on the display screen.
  • substrate 81 material can be flexible and thin.
  • Substrate 81 can comprise any suitable material including, but not limited to: [00175] - PET plastic
  • substrate 81 can be made from several different materials.
  • a thin, flexible, transparent section under pad 82 can be adhered to a stiffer, non-transparent section under contact pad 84.
  • the stiffer section under contact pad 84 can be made from a flex circuit or thin printed circuit board (PCB).
  • substrate 81 can have various adhesives applied to the lower surface so that it can adhere to a surface such as a capacitive touch sensor (not shown).
  • the material of substrate 81 can be chosen so that it adheres to a capacitive touch sensor, for example, via static cling, suction, or magnetism.
  • substrate 81 and mask 85 can have printing that is visible, for example to a user. This printing may be useful to enable a user to position the pad 82 in the desired location on a capacitive touch sensor (not shown).
  • substrate 81 can have an irregular border shape. For example, when the border of substrate 81 follows the contour around pad 82, a visual cue is provided to the user on how to position the substrate (and therefore pad 82) in the desired location on a capacitive touch sensor (not shown).
  • substrate 81 can comprise an air channel 81a to allow air to escape when metal dome 86 is depressed.
  • mask 85 can comprise the air channel 81 a.
  • Mask 85 can be applied using any suitable technique, including but not limited to printed or deposition onto substrate 81.
  • Mask 85 as provided in implementations described herein has two functions: to cover the exposed section of substrate 81 so as to cover pad 82 and trace 83 to prevent them from being touched by the user; and to prevent the metal dome 86 from contacting the trace 83 or contact pad 84 until the metal dome is depressed.
  • the metal dome 86 performs part of the functionality of a switch described above (for example, switch 47 in Figure 4). For example, when metal dome 86 is depressed (e.g. when button cap 88 is depressed by a finger), metal dome 86 makes electrical contact with contact pad 84 though opening 85a. Metal dome 86 also acts as a spring and to provide tactile feedback to the user that the button cap 88 has been pressed.
  • Fastener 87 keeps the metal dome 86 in place.
  • Fastener 87 can have any suitable shape. In one example, when mask 85 does not cover the exposed portion of substrate 81 , fastener 87 can be made large and perform that function instead of mask 85.
  • Button cap 88 and post 88a perform the function of a conductive button cap (for example, conductive button cap 49 in Figure 4).
  • Button cap 88 and post 88a are generally conductive and can be made from suitable material and/or combination of materials, including but not limited to conductive materials such as metal, semiconductive material such as conductive rubber, and insulating materials coated with conductive materials.
  • conductive materials such as metal, semiconductive material such as conductive rubber, and insulating materials coated with conductive materials.
  • Retainer 89 can be generally attached to mask 85, for example with adhesive. Furthermore, retainer 89 captures the flange 88b thereby keeping button cap 88 in place.
  • substrate 81 can have a tab extension (not shown) that does not have adhesive on its underside. The tab allows the user to lift and remove the button assembly 8S.
  • a rubber button or membrane switch can perform the function of a spring and contact (instead of a metal dome 86) and button cap (instead of button cap 88).
  • FIG. 9A and Figure 9B depict an assembled and exploded view of an example of the structure of a D-Pad assembly 9S, according to non-limiting implementations.
  • a D-Pad is a direction pad that is a common input to many applications such as games and applications with menu navigation.
  • the D- Pad can be pressed in one of four directions and therefore the D-Pad actually performs the function of four buttons.
  • Some D-Pads support eight directions.
  • the display screen In touch screen applications, the display screen generally displays a virtual D-Pad that indicates the four locations that the user should touch.
  • buttons with four associated pads 92U, 92D, 92L, 92R the methods described above to construct a single button can be used to construct four buttons with four associated pads 92U, 92D, 92L, 92R, the main difference being that instead of four button caps there is a single button cap 98.
  • the button cap 98 of a D-Pad can be designed in many shapes and sizes. Traditionally a D-Pad button cap is symmetric in the x-y directions, however in some applications it is more oval shaped. It often has a cross shape on the top surface to allow the user to feel the four directions; however other shapes are common, such as a flat disk or four individual buttons.
  • the traces then make their way to the top surface of circuit board 95 by vias (not shown) to make electrical contact with appropriate contact pads, such as contact pad 94D;
  • metal dome 96D four metal domes, such as metal dome 96D, and a fastener 97 are used to perform the same functions as described in the construction of a single button assembly above with reference to Figure 8 for example;
  • button cap 98 had four posts, such as post 98D, which align with the four metal domes;
  • the materials used in this example can be similar to those described above in the construction of a single button. Therefore, when assembly 9S is used in conjunction with a touch screen device (not shown), when the button cap 98 is depressed in one of the four directions by the finger 90, electrical contact is made from finger 90 to the corresponding pad 92U, 92D, 92L, or 92R, thereby simulating a finger press in the appropriate location on the touch screen device, as described above.
  • a four-direction switch can be used, including but not limited to a microswitch, that can be soldered (for example) to circuit board 95 to make contact with traces such as 93D routed by vias to the top side of circuit board 95.
  • directional microswitches support four directions while other implementations support eight directions. In the case of eight directions, four additional pads and corresponding traces can be added in the appropriate cardinal locations on substrate 91.
  • the button cap 98 could also have a center button (not shown). This could be used in applications that require a "select" or "fire” button in the center.
  • a fifth center metal dome can be added (or a microswitch for example) with a center activation pad.
  • a fifth pad and associated trace can be added to the D-Pad assembly 9S.
  • the fifth pad (not shown) could be in the center of the other pads, or in a different location on the substrate 91.
  • the fifth button need not be a separate button. In one example, pressing the whole button cap 98 could depress the center button of a directional microswitch.
  • the button cap 98 can be insulating.
  • the circuit board 95 has a large ground "fill", which performs the function of a coupler 58 shown in Figure 5.
  • a metal dome such as 96D is depressed by a post such as 98D, the metal dome 96D makes contact between the contact pad such as 94D and the large ground "fill” and the associated pad such as 92D is "activated”.
  • FIG. 10A and Figure 10B depict an assembled and exploded view of an example of the structure of a joystick assembly 10S, according to non-limiting implementations.
  • a joystick is a direction device that is a common input to many applications such as games and applications that require so called “analog input", i.e. more than just the four directions of a D-Pad.
  • the joystick conveys to the application both direction and how far from center it is activated.
  • the display screen In touch screen applications, the display screen generally displays a virtual joystick that indicates the region in which the user should touch.
  • the methods described above to construct a single button can be used to construct multiple pads 102 connected to contact pads 104 with traces 103. However, unlike in the case of a single button, multiple contact pads 104 can be contacted at the same time with post 108a on button cap 108.
  • the traces then make their way to the top surface of circuit board 105 by vias (not shown) to make electrical contact with corresponding contact pads 104;
  • the button cap 108 has a flange 108b that is larger in diameter than the top opening in retainer 109, but smaller in diameter than the inner walls of retainer 109; this allows button cap 108 with its flange 108b to slide some distance in all directions in the plane of the circuit board 105;
  • the retainer 109 is bonded to circuit board 105 and substrate 101 ; there is some space between the under surface of the top of the retainer 109 and the top surface of the flange 108b which allows the button cap 108 to slide in all directions in the plane of the circuit board 105;
  • button cap 108 has post 108a which makes electrical contact with contact pads 104; it is appreciated that the lower surface of post 108a, and the contact pads 104 are generally constructed from suitable materials that allow for the post 108a and button cap 108 to slide without degrading their surfaces; and
  • the materials used in this non-limiting implementation can be the same as those used in the construction of a single button described above; therefore when the button cap 108 is touched by the finger 100, electrical contact is made from finger 100 to the corresponding pad or pads 102.
  • the post 108a is sized relative to the size of contact pads 104 so that it contacts one, two or three of contact pads 104 at once, depending on its location.
  • the following usage example demonstrates how the joystick assembly 10S works in conjunction with a touch screen device (not shown):
  • the application that provides the virtual joystick at the display device determines the simulated touch location to be at the centroid of the pads at the perimeter (i.e. 8 simulated touch locations), or at the centroid of pairs of pads at the perimeter (i.e. additional 8 simulated touch locations), or at the centroid of pads or pairs of pads at the perimeter with the center pad (i.e. additional 16 simulated touch locations), or at the centroid of the center pad (i.e. 1 simulated touch location).
  • the application that provides the virtual joystick at the display device determines that the simulated finger slides between these 33 locations, since at any time at least one pad is "activated”; and, when adjacent pads are “activated”, together they simulate one larger finger touch.
  • 32 non-center locations (related to the cardinal points) is a very good approximation of a true "analog" joystick.
  • Many games, for example, can only display an on-screen character as either walking or running in 8 directions, i.e. 16 joystick locations.
  • a spring mechanism can be built into the assembly to perform this function.
  • a spring assembly can include, but not is limited to:
  • - flange 108b comprising a flexible material, such as rubber and the like, and affixed to the retainer 109 at its perimeter;
  • - retainer 109 comprising a flexible material, such as rubber and the like, affixed to the flange 108b at its perimeter
  • applications can comprise a self centering algorithm for the virtual joystick, i.e. when the user touches the capacitive touch sensor, the application notes that location as the center of the virtual joystick. Therefore, if the joystick assembly 10S is used with this type of application, center pad 102C need not be located with the center of the virtual joystick graphic shown on the touch screen display device. Rather, when the user touches the button cap 108 (which has been centered mechanically), the application notes the location of the center pad 102C as the center of the virtual joystick.
  • a button cap that contacts the retainer where the contact pads are on the retainer 109.
  • an assembly such as a D-Pad or joystick assembly described above can be constructed that has multi functions.
  • a joystick module can be constructed that can act as a joystick when moved left/right/up/down, and also provides a "select” or "fire” function when pressed with greater force.
  • a micro switch (not shown) can be situated underneath circuit board 105. When the button cap 108 is pressed with sufficient force, circuit board 105 will press on the micro switch and close the switch.
  • auxiliary pad (not shown) in a location on substrate 101 in a different location to the joystick pads 102 by the use of appropriate traces.
  • the auxiliary pad can therefore be used to simulate a finger press in a location that corresponds to the desired function on the capacitive touch device, such as "select” or "fire” for example.
  • the shape and layout of the contact pads 104 do not have to be the same as the shape and layout of the pads 102.
  • the layout, shape and spacing of the contact pads 104 and pads 102 can be optimized independently to achieve the desired joystick behaviour.
  • a layout of contact pads can be designed so that the joystick has to be moved outwards one distance (delta dl , not shown) to result in the application determining that the virtual joystick has moved from the center to halfway out to the perimeter, and the joystick has to be moved less distance outwards (delta d2, not shown) to result in the application determining that the virtual joystick has moved from halfway out to the outside of the perimeter.
  • the distance movement of the physical joystick is exponential while the distance movement of the virtual joystick is linear.
  • Figures 1 1A, 1 IB, 1 1C and 1 1D depicts a top view of four respective examples of layouts of pads for a joystick assembly, according to non-limiting implementations.
  • Example A shown in Figure 1 1A is a top view of the pad layout already shown at assembly 10S in isometric view in Figure 10, where pads 102, traces 103, substrate 101, button cap 108 and retainer 109 are as described in reference to Figure 10.
  • Example B shown in Figure 1 IB is a top view of a pad layout which is similar to example A, but where the perimeter of the pads 1 12b are interdigitated with each other. It is appreciated that interdigitation is a non-limiting perimeter design that results in adjacent pads 1 12b "merging" with each other. "Merge” in this case means that when two or more adjacent pads are “activated” they appear as one larger “activated” pad from the capacitive touch sensor electrodes' point of view.
  • Another technique for "merging" pads is to make their borders relatively close (compared to the capacitive touch sensor's sensing resolution), and have adjacent borders of similar radius-of-curvature where they meet, for example as illustrated in Figure 1 1 A.
  • two adjacent square pads, each 1 cm in area, and spaced less than 1mm apart will generally be determined to be a single "activated” rectangular region by most capacitive touch sensors currently on the market when the pads are “activated” simultaneously.
  • two adjacent circular pads, each 1 cm in area, and spaced less than 1mm apart will often be determined to be two "activated” regions when the pads are "activated” simultaneously.
  • capacitive touch sensors currently on the market apply a wide range of proprietary algorithms to the measured capacitive signal intensity (such as signal thresholding, region growing and border radius- of-curvature calculation) in order to distinguish between single and multiple finger touches.
  • An iterative design approach can be used to experimentally determine the maximum pad spacing, and pad border design, required to have two or more "activated” pads "merge” into one when used with a particular capacitive touch sensor.
  • One purpose of "merging" adjacent pads is to allow larger spaces between pads (so traces can run between them, for example), while still allowing the touch sensor device to determine adjacent "activated” pads to be one larger “activated” pad, i.e. to simulate a single finger touch though the pads are separated by some distance. Without “merging” perimeters, if the spaces between pads are too large, the touch screen device's algorithms might determine that two or more fingers are touching the touch screen when two or more adjacent pads are activated (for example when the post 108a touches two or more contact pads 104 in Figure 10).
  • Example C shown in Figure 1 1C is a top view of a pad layout with a grid and/or array of pads 1 12c.
  • the grid is along the x and y axis and the pads 1 12c are square, but other layouts are within the scope of present implementations including, but not limited to:
  • example C the virtual joystick position can be determined in a greater number of locations than that in example A. As discussed earlier, example A provides for 33 simulated slide locations. Example C, however, allows for 7 positions per row, with 7 row positions, for a total of 49 simulated slide locations (i.e. combinations of 1 , 2 or 4 adjacent pads "activated").
  • the "activated" pad area changes as the button cap is moved, i.e. sometimes one, two, three or four adjacent pads are “activated”.
  • Current capacitive touch sensors are not affected by the changing activated area as long as the activated area does not become so large as to be rejected as a palm press or multiple finger presses, for example.
  • Current capacitive touch sensors simply determine that the location and contact area of the finger touch has changed.
  • capacitive touch sensor technology changes, a change in the apparent finger touch area may affect the operation.
  • Other pad shapes and layouts can be made that keep the "activated" simulated touch area relatively consistent with the area of a finger press as the button cap moves, and are within the scope of present implementations.
  • Example D is a top view of a pad layout which is similar to example C, however the pads 1 12d are smaller than a minimum pad size to be detected as a finger touch by the capacitive touch sensor (traces not shown).
  • the area of one pad, pad 1 1 1 for example, can be designated as one unit area. If for a particular capacitive touch sensor the minimum area required to simulate a finger touch might be four unit areas, for example.
  • the design of the post (not shown) under joystick button cap 1 18, and the layout of the contact pads (not shown) can be such that groupings of four to nine adjacent pads within the grid of pad 1 12d are always "activated" at one time.
  • the advantage of the pad layout in Example D over the pad layout in Example C is that the "activated" area remains relatively consistent with the area of a finger press as the button cap 1 18 is moved. [00247] Note that as the number of pads and the number of traces increase, a multi-layered fabrication technique can be used to allow various pads and traces to be on different layers, separated by insulating layers.
  • Figure 12A and Figure 13A depict schematics of two different successful prototypes of the present invention that were constructed to study various design parameters, with focus on the following design parameters:
  • the first prototype, shown in Figure 12A, was constructed to provide the functionality of a D-Pad, and thus has a pad layout similar to that shown in Figure 9A.
  • the second prototype, shown in Figure 13 A, was constructed to provide the functionality of a joystick, and thus has a pad layout similar to that shown in Figure 10A.
  • the substrates 121 and 131 were made from transparent polyester film, approximately 0.008" thick.
  • the underside of the substrate was slightly sticky so that it could be adhered to the touch screen 128 and touch screen frame 129 of touch screen device 120.
  • the top surfaces of the substrates 121 and 131 were sputter coated with a thin transparent layer of silver/indium so that the surface sheet resistance was approximately 27 ohms per square.
  • a transparent polyester film approximately 0.002" thick, was placed over the substrate over the pads, traces and cross hatching to act as a pacification layer (so a finger could be used with the touch screen 120 even with the assembly in place on the touch screen 128).
  • Figure 12A and Graph 12G in Figure 12B which comprises an x-y plot of touch locations as measured by the touch screen device 120 in use with the prototype of Figure 12 A.
  • An iterative design process was used to determine the shape and location of each of the four pads 122L, 122R, 122U, 122D and corresponding traces, such as trace 123D, in order to simulate touches as close as possible to the center of four corresponding virtual D-Pad zones 125L, 125R, 125U, 125D.
  • the four dots in Graph 12G show the measured simulated touch locations (i.e.
  • top 122U and bottom 122D pads were offset to the right of their respective touch zones to compensate for the length of their respective traces that traversed the touch screen 128, i.e. the traces contributed somewhat to the calculation of their simulated touch location centroids by the touch screen device 120.
  • the right pad 122R was offset more significantly to the right of its respective touch zone to compensate for the more significant length of its trace that traversed the touch screen 128, i.e. a more significant contribution by its long trace to the calculation of the simulated touch location centroid.
  • the right pad 122R was offset down from its touch zone to compensate for the contribution of the length of its trace above the center of its touch zone.
  • the right pad 122R was larger than the other three pads to compensate for the contribution of the longer length of its trace that traversed the touch screen 1 10, both in terms of the trace's contribution to the centroid calculation, and the trace's effect on the capacitive sensing electronics and processing algorithms (i.e. somewhat akin to an effect on signal to noise ratio) of the touch screen device 120.
  • the thickness of the substrate and pacification layers can be chosen to accommodate different capacitive touch sensor sensitivities and technology.
  • Figure 13A and Graph 13G in Figure 13B which comprises an x-y plot of touch locations as measured by the touch screen device 120 in use with the prototype of Figure 13 A.
  • An iterative design process was used to determine the shape and location of each of the pads 132 and traces (not shown) in order to simulate finger touches and movements, centered as close as possible to the center of the virtual joystick zone 136.
  • the twenty five dots in Graph 13G show the measured simulated touch locations (i.e.
  • Graph 13G shows that the measured simulated touch locations were close to the desired locations, i.e. the major and minor cardinal points on the virtual joystick zone perimeter 136p, and major cardinal locations half way out to the perimeter 136h. For clarity, the half way out measured minor cardinal locations are not shown (i.e. when three pads, two outer plus center, such as 132T, 132TR and 132C, were "activated” simultaneously), however their measured locations were in the appropriate, expected locations.
  • - pad 132C was "deactivated” by removing the hand held metal probe contact from contact pad 134C; due to the aforementioned delays the touch screen device 120 measured that the simulated finger was slid from x-y location L2 to location L3 [00273] - pad 132TR was "activated” and the measured simulated finger was slid from L3 to L4
  • pads such as pads 132
  • the placement, shape and size of a pad can depends on a number of factors including, but not limited to:
  • each of the contact pads 134C, 134T, 134TR, etc. can act as a variable resistor as contact between a joystick and each contact pad 134C, 134T, 134TR, etc. occurs; for example, each contact pad 134C, 134T, 134TR, etc. can comprise a conductive coating, including, but not limited to, carbon ink.
  • the amount of contact and hence the resistance there between will change, causing each corresponding pad 132C, 132T, 132TR, etc. to be activated gradually.
  • contact pads 134C, 134T, 134TR, etc. could be replaced with one resistive contact pad, with traces from pads 132C, 132T, 132TR, etc., attached thereto at locations generally corresponding to contact pads 134C, 134T, 134TR, etc.
  • Each pad 132C, 132T, 132TR, etc. could be activated as a joystick contact moved to each location where each pad 132C, 132T, 132TR, etc. is connected, similar to contacting each contact pad 134C, 134T, 134TR, etc., as described above.
  • the trace and pad design can be determined and/or tested experimentally.
  • the general principle is that as the trace length and/or width across the touch screen increases, the pad can be increased in size and/or offset from the touch zone so that the touch screen device determines the touch location within the appropriate touch zone.
  • the determined touch location is related to the centroid of the pad and the portion of the trace that traverses the touch screen.
  • Figure 14 depicts a touch screen device 140 according to the prior art, to describe useful terms.
  • a touch screen device 140 with a bezel 147, touch screen frame 149 and a touch screen 148 is shown running an application that the user wishes to interact with.
  • Applications generally display virtual button graphics such as 142 to indicate where a user should touch, and what the application's action will be when that virtual button is touched.
  • virtual button graphics including, but not limited to:
  • buttons such as 142;
  • Applications generally define touch zones such as 145 that are associated with virtual button graphics such as 142. If the touch screen device 140 reports a touch within a touch zone to the application, the application will generally perform the function associated with the virtual button graphic such as 142 that is associated with that touch zone, such as 145.
  • a virtual D-Pad graphic such as 141 generally has four or eight touch zones associated with it.
  • a virtual joystick graphic (not shown) generally has one larger touch zone, but the location of the finger touch within that zone is used to determine how the user wishes to direct the virtual joystick. [00296] Some virtual joysticks reposition their center depending on where the user first touches.
  • touch zones for the user to interact with, but they do not have any associated virtual button graphic.
  • An example of this is a game application where the user can touch any portion of the touch screen 148 to fire a weapon (as long as no other touch zone such as 145 is associated with the touch location).
  • Another example of this is an application where the user can drag their finger on any portion of the touch screen 148 to act as a virtual track pad.
  • a touch zone such as 145
  • the virtual button graphic such as 142
  • Figure 15 depicts various assemblies positioned on a touch screen device 150, according to non-limiting implementations. Not shown (for clarity) are the virtual button graphics and virtual D-Pad graphic. The various touch zones, such as 155b, are shown as dotted outlines.
  • a three-button assembly 151 can be designed that provides three button caps, such as 152, for the user to actuate three touch zones, such as 155b. Note that the pads of the three-button assembly, such as 153b, do not need to line up perfectly with the three associated virtual graphics (shown in Figure 14). As long as the touch screen device 150 determines the touch location to be within a touch zone, such as 155b, the associated action will be performed.
  • a D-pad assembly 157 can be designed that provides a D-Pad button cap 159 for the user to actuate four D-Pad touch zones, such as 155d. Note that the pads of the D-pad assembly, such as 153d, do not need to line up perfectly with the four associated virtual graphics (e.g. as shown in Figure 14). As long as the touch screen device 150 determines the touch locations to be within the touch zones, such as 155d, the associated action (direction) will be performed.
  • the touch zones such as 155b
  • the pads such as 153b
  • Any suitable technique can be used to assist the user in positioning the assemblies including, but not limited to: [00303] - Print positioning markers on the substrate such as 154 and provide instructions to the user on how to align the positioning markers with virtual button graphics that the application displays;
  • a printed positioning marker is not in the center of a pad such as 153b, but can be printed in a location that accounts for the centroid calculation of the pad such as 153b and trace such as 156b that runs across the touch screen 158.
  • a printed positioning marker can be positioned to compensate for parallax that occurs when the display screen is a distance below the touch screen 158 where parallax occurs.
  • Figure 16 depicts non-limiting implementations of a positioning application that can be run on the touch screen device 160, an example three-button assembly 161 and an example D-pad assembly 167.
  • the positioning application can be use to assist the user in choosing and positioning assemblies such as 161 and 167 by providing any suitable aid including, but not limited to:
  • the positioning application can ask the user which application they wish to use the assembly with.
  • the positioning application can automatically launch the desired application after the positioning steps.
  • the positioning application can have information specific to a wide range of applications that the user might wish to use the assembly with;
  • the positioning application can update its information periodically or in real time via a connection to the internet (for example) by the touch screen device
  • the position application can ask the user for a list of applications that they wish to use with the assembly and provide a "best fit" location for the assembly so that it can be used with all of those applications without the user have to reposition each time.
  • the positioning application can ask the user for a list of applications they wish to use and then indicate to the user which assembly they should select that best matches the list of chosen applications.
  • the positioning application can provide wide range of instruction and alignment aids, for example text, static graphics, dynamic graphics, audio/video, screen captures, etc.
  • the positioning application can also provide a "test mode" so that the user can confirm correct placement of the assembly by (for example) pressing the D- Pad or buttons and confirming that the correct functions highlight in the positioning application.
  • the positioning application can save preferences (for example of assembly layouts) that the user may wish to load at a future date.
  • the positioning application can save and/or transfer preferences such as positioning information to other applications.
  • the other applications can modify their touch zone locations to match what the user and the positioning application desire the touch zones to be.
  • the positioning application can provide instructions to the user on how to use the customization features of another application to position the touch zones in appropriate locations for an assembly to work with that application.
  • the positioning application can provide instructions to the user on how to use the customization features of another application to choose the control types to match the assemblies that the user wishes to use. For example, in many applications the user can choose whether to use a virtual joystick or tilt to control the application, and in this example, the user can be instructed on how to change to the virtual joystick mode.
  • the positioning application can communicate via an application programming interface (API) to make the various selections discussed above automatically so that the user does not have to navigate menus.
  • API application programming interface
  • Some accessories can be programmed via the positioning application. For example, if the accessory 245 in Figure 24 is programmable (described below), the adapter functions 243 could be programmed by the positioning application.
  • the positioning application can determine the correct settings and instruct the user on how to change them.
  • the positioning application can allow the user to press an assembly button, such as 162, and then touch the touch screen 168 to indicate the mapping that the user desires.
  • the positioning application can instruct the user on how to run another application, make a screen capture and return to the positioning application for more instruction.
  • the positioning application can use a screen capture of another application to assist the user in choosing and positioning various assemblies.
  • the positioning application can upload a screen capture and various information gathered from the user to another device, such as a computer or an online database.
  • a database of application screen captures (in original or edited/annotated form), layouts, positioning tips, etc. can be built from user input data.
  • Figure 17 depicts a positioning application that can be run on the touch screen device 170, according to non-limiting implementations.
  • a composite image is rendered at the display screen to assist a user in positioning six different touch screen accessories, 171 , 172, 173a, 173b, 174, 175.
  • Many applications do not show all virtual button graphics at all times.
  • the temporary virtual button graphic 176 may only visible when the application is in a certain mode, for example, when the user has achieved a bonus.
  • the weapon virtual buttons might only display when the game character has the appropriate weapon in its possession. Therefore it would be very difficult for the user to position all six accessories at the start of the game.
  • this problem can be solved by taking multiple screen captures during the use of the application and merge them into one composite positioning aid image.
  • the positioning application discussed above can then render the composite image at the display screen 178.
  • the assembly substrate boundary shape and pad locations can be designed to minimize the number of assemblies employed to use the most number of applications.
  • the assembly boundary shape can be designed to allow the assemblies to not interfere with other functions and buttons of the touch screen device 170.
  • some of the assemblies can be entirely on the touch screen 178.
  • a "layout saver" substrate (not shown) can be provided that can cover at least a portion of the touch screen 178, and/or the entire touch screen 178, and touch screen frame 179.
  • the "layout saver” substrate can first be applied to the touch screen 178 and touch screen frame 179, and then the assemblies can be applied to the "layout saver” substrate. In this example, whenever the "layout saver" substrate is removed and later re-applied, the layout of assemblies is preserved.
  • assemblies such as a right index finger button assembly 175, can be located on the edge or rear of the touch screen device 170, for example on a housing of the touch screen device 170 including, but not limited to, a frame, a bezel, adjacent touch screen 178, adjacent display screen 168, on side of the touch screen device 170 and a back of the touch screen device 170.
  • the substrate for the button assembly 175 is enabled to wrap around the touch screen device 170.
  • a mechanical coupling enables electrical contact to be made on the top surface of the touch screen device on the substrate of the button assembly 175.
  • Figures 18A and 18B depicts a three-button assembly 181 in a first location on touch screen device 180 in Figure 18A, and a second location on touch screen device 180 in Figure 18B.
  • the three-button assembly 181 uses a layout of pads, such as 183, and traces, such as 186, to achieve compatibility with a wide range of virtual button layouts, according to non-limiting implementations.
  • the bottom row of pads 183 are all associated with the bottom button cap 182 (association meaning that they are all connected to the same trace 186), the middle row of pads are all associated with the middle button cap, and the top row of pads are all associated with the top button cap.
  • Figure 18A versus Figure 18B
  • compatibility with "diagonal” vs. "triangular" layouts of virtual buttons can be achieved easily.
  • buttons such as 182 are not associated with pads such as 183 in rows.
  • Other association layouts can be made by adjusting the trace configurations.
  • other assemblies can be constructed with this technique, such as a two-button or four-button assembly.
  • Figures 19A and 19B depicts a system of modules and adapters, according to non-limiting implementations, that enable a substrate to be applied on the touch screen device 190, without repositioning the substrate each time a different application is run.
  • Figure 19B depicts the system of modules and adapters.
  • pads depicted in black are on top of pads depicted in white.
  • an appropriate module and adapter can be selected and applied to a substrate such as 191L or 191R.
  • the connecting pads 194R on circuit board 193R are connected to the pads 195R on the substrate 191R in a one-to-one fashion with traces (not shown).
  • buttons on 3-button Module Ml are associated with the three virtual buttons in a triangular layout.
  • Example Two Consider another non-limiting example that is the similar to Example One, but with the following differences:
  • buttons on 3-button Module Ml are associated with the three virtual buttons in a linear layout.
  • the D-Pad Module's M2 four directions are associated with the four outside center pairs of pads 197U1 and 197U2, 197D1 and 197D2, 197L1 and 197L2, 197R1 and 197R2, at the four cardinal points.
  • the Joystick Module M3 is associated with, and centered on all sixteen of the pads of the left substrate 191 L.
  • a suitable adapter can be placed on the circuit board (193L or 193R) (combined with circuit board) and then a suitable module can be attached to the combination.
  • the adapter and module can comprise a single assembly.
  • the module and substrate can comprise a single assembly with a slot for the insertion of an adapter.
  • the 4-button module M4 can be permanently affixed to the right hand substrate 191R to make a 4-button assembly (not shown). Then, when the user wishes to use a particular application, the appropriate adapter is selected and slid it into a slot in the 4-button assembly (not shown).
  • the joystick module M3 can be permanently affixed to the left hand substrate 191L to make a joystick assembly (not shown). Then, when the user wishes to use a particular application, the appropriate adapter is selected and it is slid into a slot in the joystick assembly (not shown).
  • the left and right substrates (191L, 191R) can be made symmetrical so that by rotating a substrate 180 degrees it can be used on the left or right side of touch screen 198.
  • the left and right substrates (191L, 191R) can be manufactured as one, larger substrate that covers the any portion of the touch screen, including the entire touch screen.
  • trackball module M7 can be used with the right or left substrate (191L, 191R).
  • the associated trackball can be made of an insulating material with conducting rods, stripes, strips, etc.
  • the adapter plate can reverse the direction by connecting left to right and up to down between the top and bottom contacts. In this example, when the trackball is rotated to the right, the contact point below moves to the left, but this is reversed by the adapter plate before the signal is conducted, for example, to the pads on the substrate 191L.
  • the virtual control is a track pad
  • the desire is to simply have the track pad off the touch screen 198
  • the user can simply touch the connecting pads 194L or 194R directly without the need for an adapter or module.
  • a user can be provided with a blank adapter and/or module to cover and protect the circuit boards (193L, 193R) when no functional module is being used.
  • circuit board had been used for convenience; however it is not to be considered unduly limiting.
  • any suitable means and/or apparatus for providing connecting pads (194L, 194R) can be used, including but limited to pin connectors.
  • the connecting pads (194L, 194R) and adapters does not need to have a grid array design.
  • a linear pin connector and linear adapter could be used instead.
  • the adapters need not be static in design. For example, they could have switches or sliders built in so the user does not need to remove and replace them, but simply reconfigure them.
  • Figure 20 depicts a method for adapting to different virtual D-Pad, joystick, button, etc. layouts, according to non- limiting implementations, that enable a substrate to be applied on the touch screen device 200, without requiring the substrate be repositioned each time a different application with a different virtual layout is run.
  • a mapping adapter can be adjusted so that the appropriate pad/pads are activated when a D-Pad, joystick, button, etc. is used.
  • a 2-button assembly 201b is applied to the touch screen device 200.
  • the assembly 201b has a substrate 204b, two buttons (203b, 203c), two adapters (202b, 202c), an array of pads (numbered bl through bl6), and traces (not shown).
  • the traces (not shown) run from each pad (bl through bl6) to adapter 202b, and from each pad (bl through bl6) to adapter 202c.
  • a single trace (not shown) runs from adapter 202b to the contact pad (not shown) for button 203b.
  • a single trace (not shown) runs from adapter 202c to the contact pad (not shown) for button 203c.
  • the adapter 202b can be rotated so that a conductor (not shown) under adapter 202b links the trace from button 203b to one or more of the traces to pads bl through bl6.
  • adapter 202c There is a similar construction under adapter 202c.
  • an application run on the touch screen device 200 that has two virtual buttons on the right side of the touch screen 208, one between pads bl3 and bl4, and one under pad bl, for example.
  • the adapter 202b can be rotated so that pad b7 is "activated" when button 203b is pressed.
  • the adapter 202c can be rotated so that both pads bl 3 and bl4 are "activated” when button 203c is pressed.
  • other adapter designs can be constructed, such as slider switches, DIP switches, etc.
  • each adapter can map its corresponding button to the pads bl through bl6 in different ways.
  • the mapping can cycle connection to pads in a horizontal sequence.
  • two pads in the horizontal direction for example, pads b6 and b7
  • the mapping can cycle connection to pads in a vertical sequence.
  • a joystick assembly 201 a is applied to the touch screen device 200.
  • the assembly 201a has a substrate 204a, joystick button cap 203a, adapter 202a, an array of pads (numbered al through a20), and traces (not shown).
  • the traces run from each pad (al through a20) to the adapter 202a.
  • Nine traces run from adapter 202a to the nine contact pads (not shown) under joystick button cap 203a arranged in an appropriate layout (such as discussed above in reference to Figure 10).
  • the adapter 202a can be rotated so that the nine contact pads are connected to nine appropriate pads between al and a20.
  • adapter 202a When adapter 202a is in one position (position 2 for example), the appropriate nine pads centered on pad al4 can be connected to the nine contact pads under joystick button cap 203a. When the adapter 202a is in another (position 9 for example), the appropriate nine pads centered on pad a7 can be connected to the nine contact pads under joystick button cap 203a.
  • Figure 21 depicts examples of assemblies that can be attached to a touch screen device 210 (with features such as a touch screen 218, touch screen frame 219 and bezel 217, for example) by a manufacturer or system integrator, according to non-limiting implementations.
  • manufacturers or system integrators wish to create a custom product, but at the same time they wish to take advantage of the low cost of a commercially available touch screen device 210.
  • Their product often requires physical controls with tactile feedback for the user.
  • products that can be created by combining a touch screen device 210 with tactile assemblies including, but not limited to:
  • many assemblies can be constructed using the techniques discussed above, such as a short button assembly 213, and they can be placed on touch zones such as 215 associated with virtual button graphics such as 212.
  • a mechanical slide assembly 21 1 can be constructed with a button cap 21 1a, rails 21 1b, contact pads (not shown) under the rails 21 lb connected by traces (not shown) to pads 21 1 c on the underside of substrate 21 Id.
  • substrate 21 Id can be permanently attached to the touch screen 218 (with glue or any suitable adhesive for example).
  • a knob assembly 214 can be constructed using the techniques discussed above on substrate 214a. For example, opposite sides of the underside of a conductive knob button cap 214b can make contact with contact pads (not shown) and be connected by traces (not shown) to pads (not shown) in a circular arrangement on substrate 214a. Therefore when the user touches the conductive knob button cap 214b of the knob assembly 214, the touch device 210 will determine that two fingers are touching the touch screen 218. Then, as the user rotates the button cap 214b of the knob assembly 214, it will appear to the touch screen device 210 that the fingers are rotating about the center point.
  • This rotation gesture is a common touch gesture understood by many touch screen devices 210 and can easily be used to represent changes in some value, such as volume (in the case of a car entertainment system for example), or image rotation angle (in the case of a photo frame for example).
  • buttons where the finger will be over the touch screen 218 when the button is activated such as the slide assembly 21 1, knob assembly 214, D- Pad assembly 216 or "vertical stack" button assembly 213a
  • the button cap should be made sufficiently high, or the substrate should be sufficiently thick, or other design measures should be taken so that when the button is pressed and then released the touch screen 218 does not detect the presence of the finger which is still over the touch screen 218. This is because capacitive touch screen devices 218 often use hysteresis to screen out false presses, but lock onto a press when one is detected.
  • Figure 22 depicts various assemblies that can be attached to a touch screen device 220 (with features such as a touch screen 228, touch screen frame 229 and bezel 227, for example), according to non-limiting implementations.
  • the underside of the D-Pad assembly 224 substrate and 3-button assembly 221 substrate comprise a reusable, light-tack adhesive that enables the assemblies to be securely stuck to the touch screen 228 and touch screen frame 229.
  • the adhesive can be of a type that does not leave residue when the assembly is removed, and it can be used over and over again.
  • the user can be provided with a cleaning cloth or other cleaning techniques to minimize the dirt and dust that can be trapped between the assembly and the touch screen 228 or touch screen frame 229.
  • any suitable method of storing the assemblies when not attached to the touch screen device 220 are within the scope of present implementations including, but not limited to:
  • Figure 23 depicts an accessory 235 for using assemblies as described above in combination with the touch screen device 230, according non-limiting implementations.
  • Accessory 235 is enabled to receive touch screen device 230 in a recessed portion and further comprise a flat surface to which assemblies 234, 231 and the like can be attached, the flat surface being flush with the touch screen 238 so that the touch screen portion of assemblies such as 234 and 231 can reside on touch screen 238.
  • the accessory 235 has multiple functions and benefits:
  • touch screen devices 230 do not have sufficient real estate on the touch screen frame 239 to position various types of assemblies (due to the size of the touch screen frame 239 or due to buttons and controls on the touch screen frame 239).
  • the accessory 235 increases the real estate by providing a larger flat surface.
  • the accessory 235 allows various types of assemblies to be positioned in more ergonomic locations.
  • the joystick assembly 234 and four-button assembly 231 are positioned economically for use by thumbs while the user plays games on a "smart phone" touch screen device 230.
  • the accessory 235 provides a more ergonomic shape for the user to hold the touch screen device 230 while using various applications.
  • the accessory 235 can have two grip areas on its lower surface that mimic the shape of traditional game controllers. These grip areas fit in the palm of each hand, provide a location for the fingers to grip and thereby allow the user's thumbs to be more mobile to operate the various assemblies.
  • the lower surface of accessory 235 can be made of materials that provide friction for the hands and fingers, such as rubber or rubber paint.
  • the accessory 235 provides more options for the user to place button assemblies in various orientations to allow the pads to align well with application touch zones (not shown).
  • the accessory 235 can allow for the touch screen device 230 to be placed in the horizontal or vertical orientation to suite the application.
  • the accessory 235 can be designed to be used with different touch screen devices 235 by providing different "spacers" and other adapters (not shown) to bring the touch screen 238 into the same plane as the flat surface of the accessory 235.
  • the accessory 235 can be designed to fit (and immobilize) different touch screen devices 230 by incorporating flexible clips, retainers, elastic, tape, Velcro, etc. in its design.
  • the touch screen 238 is recessed compared with the touch screen frame 239, or sometimes the bezel 237 is slightly raised compared with the touch screen 238 or touch screen frame 239. If there are plane (“height") differences or “steps" between the flat surface of the accessory 235 and the touch screen 238, the substrate of the button assembly can adapt. This can be accomplished in a number of ways including, but not limited to:
  • the substrate can be sufficiently flexible to bend over the step
  • the substrate can have ridges or steps formed into it at manufacturing time
  • the substrate can be made in multiple pieces at various "heights", or connected by flexible cables;
  • the accessory 235 can have auxiliary functions including, but not limited to:
  • a section of the accessory 235 can open and the user can store assemblies in the opening;
  • the accessory 235 can be semi-permanently attached to the touch screen device 230 and can act as a protective case;
  • the accessory 235 can have multiple parts that the user can reconfigure;
  • the accessory 235 can act as a stand.
  • Accessory 245 is enabled to releasably receive touch screen device 240 with an attachment portion (not shown) and further comprises a slide out portion with built-in assemblies such as a D-Pad 241, buttons 242, joysticks 244, "shoulder” buttons Rl (246) and LI (not shown), and the like.
  • the attachment portion can be attached to the touch screen device 240 with any appropriate attachment means, such as via clips, retainers, adhesive, tape, Velcro, etc.
  • the built-in assemblies have similar construction to those described above.
  • the accessory can also house adapter functions, such as 243 that have similar construction to those described above.
  • the substrate 247 can be applied to the touch screen 248, and can also cover the touch screen frame 249 (thereby also acting as a screen protector).
  • the substrate contains any suitable combination pads and traces similar to those as described above.
  • the traces from the pads make their way to the D-Pad, joysticks, buttons, etc. via a flexible cable 247a that wraps under the touch screen device 240, and optionally through the adapter functions 243.
  • the flexible cable 247a allows the sliding portion of accessory 245 to slide under the touch screen device 240 when it is not in use.
  • accessory 245 can comprise buttons (not shown) to activate a switch in a remote location to reduce trace length.
  • the adapter functions 243 can be performed electrically, such as with the use of a switching electronic circuit (not shown) housed in accessory 245.
  • the electronic circuit can be powered from various sources including, but not limited to:
  • the electronic circuit can be programmed and/or controlled by the touch screen device 240 in any suitable manner including, but not limited to:
  • accessory 245 can be incorporated into accessory 245, including but not limited to status LEDs.
  • Figures 25A and 25B depict an accessory 255 for use in combination with the touch screen device 250, according non- limiting implementations.
  • Figure 25 A shows the application of the substrate 251 only.
  • Figure 25B shows the application of the accessory 255 over substrate 251 and touch screen device 250.
  • accessory 255 attaches to touch screen device 250 in any suitable manner and further comprises a portion with built-in assemblies such as a D- Pad 252, buttons 253, joysticks 254, shoulder buttons Rl (256) and LI (not shown), and the like.
  • the accessory 255 can be attached to the touch screen device 250 in a manner similar to a protective case with any appropriate means, such as via clips, slide on retainers, etc.
  • the substrate 251 can be applied to the touch screen 258, and can also cover the touch screen frame 259 (thereby also acting as a screen protector).
  • the substrate contains pads, such as 251 p and traces (not shown) as described above. In this non-limiting example, the traces from the pads make their way to the circuit boards such as 251a, which contain the connecting pads 251b.
  • adapter modules similar to those described in reference to Figure 19 can be used.
  • touch screen devices such as 250 have buttons such as 250a that could be obstructed by accessory 255.
  • buttons such as 255a can be incorporated into accessory 255 that activate the touch screen buttons such as 250a when pressed.
  • the accessory button 255a can be conductive, and can relay finger touch to the touch screen button 250a via traces and pads as described herein.
  • assembly 265 for use in combination with the touch screen device 260, according non-limiting implementations.
  • assembly 265 comprises a communication and electronic switching module 263, a substrate 261 , pads such as 262 and traces (not shown).
  • the traces connect the pads such as 262 to the module 263.
  • the module 263 receives signals from the remote device 266, it can cause the electronic switching circuitry to close and connect a pad (or pads) to a coupler or directly to the touch screen device housing as described in reference to Figure 5 and Figure 6, thereby simulating a finger press at the desired location on the capacitive touch screen 268.
  • the communication and electronic switching are separate modules.
  • the communication between the communication module 263 and remote device 266 is wireless, while in other implementations the communication is wired.
  • the communication can be unidirectional or bidirectional.
  • the remote device 266 can have assemblies such as a D-Pad, buttons, joysticks, and the like. In other implementations the remote device 266 can have other input sources such as temperature sensors, door/window contact sensors, production line test generators, or any other input source, in which case the information from the input source can be transferred to the touch screen device 260 (running appropriate applications with appropriate virtual inputs) via simulated finger touches.
  • the touch screen device 260 running appropriate applications with appropriate virtual inputs
  • Persons skilled in the art will appreciate that there are yet more alternative implementations and modifications possible for implementing the embodiments, and that the above implementations and examples are only illustrations of one or more embodiments. The scope, therefore, is only to be limited by the claims appended hereto.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention porte sur un appareil pour actionner une partie d'un capteur tactile capacitif. L'appareil comprend : un plot conducteur destiné à être placé sur une partie du capteur tactile capacitif, et un connecteur pour connecter électriquement le plot conducteur à un appareil d'activation électrique, l'appareil d'activation électrique étant en contact avec le connecteur, un changement de la capacité étant détecté au niveau du capteur tactile capacitif.
PCT/CA2012/000348 2011-04-12 2012-04-11 Commandes physiques à rétroaction tactile pour dispositifs tactiles captifs WO2012139203A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161474389P 2011-04-12 2011-04-12
US61/474,389 2011-04-12

Publications (1)

Publication Number Publication Date
WO2012139203A1 true WO2012139203A1 (fr) 2012-10-18

Family

ID=47008737

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2012/000348 WO2012139203A1 (fr) 2011-04-12 2012-04-11 Commandes physiques à rétroaction tactile pour dispositifs tactiles captifs

Country Status (1)

Country Link
WO (1) WO2012139203A1 (fr)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014137851A2 (fr) 2013-03-08 2014-09-12 Petersen Darren C Appareil d'actionneur mécanique pour une surface tactile d'un dispositif électronique
GB2517418A (en) * 2013-08-19 2015-02-25 Arm Ip Ltd Capacitive touch sensor within wrist worn device
US9164595B2 (en) 2013-03-08 2015-10-20 Darren C. PETERSEN Mechanical actuator apparatus for a touchscreen
CN105204753A (zh) * 2014-06-12 2015-12-30 联想(北京)有限公司 一种信息处理方法及交互类附件
JP2016015129A (ja) * 2014-06-13 2016-01-28 学校法人明治大学 入力装置、入力システム、情報処理装置及びヘッドマウントディスプレイ
CN105446460A (zh) * 2014-06-13 2016-03-30 联想(北京)有限公司 一种信息处理方法、交互类附件及电子设备
GB2535492A (en) * 2015-02-18 2016-08-24 Stevens Andrew PEGG-OXH-1 A stand alone electronic device that clips onto capacitive touch screen devices such as tablets, mini tablets, and mobile telephones, and simulates
JP2016160358A (ja) * 2015-03-02 2016-09-05 フジコピアン株式会社 静電容量式センサー感知状態維持用の導電性粘着シートおよび前記導電性粘着シートを用いた静電容量式センサーの感知状態を維持する方法
JP2016160357A (ja) * 2015-03-02 2016-09-05 フジコピアン株式会社 静電容量式センサー感知状態維持用の導電性粘着シートおよび前記導電性粘着シートを用いた静電容量式センサーの感知状態を維持する方法
CN106462278A (zh) * 2014-05-15 2017-02-22 松下知识产权经营株式会社 操作旋钮及利用该操作旋钮的显示装置
WO2017045744A1 (fr) * 2015-09-17 2017-03-23 Continental Automotive France Systeme de molette adaptable sur telephone intelligent ou tablette electronique
CN106657516A (zh) * 2016-12-09 2017-05-10 深圳市泽昕通讯有限公司 基于电磁干扰环境下触摸屏干扰复现与规避的方法及系统
CN108073333A (zh) * 2018-01-31 2018-05-25 北京小米移动软件有限公司 触控模组、终端和电子设备
TWI631496B (zh) * 2016-07-22 2018-08-01 華碩電腦股份有限公司 電子裝置及觸控板
CN108810216A (zh) * 2018-06-01 2018-11-13 常州信息职业技术学院 佩戴式通讯设备
US10310677B2 (en) 2015-03-31 2019-06-04 Andrew Stevens Electronic finger touch simulator for capacitive touch screen devices
EP3537266A1 (fr) * 2018-03-05 2019-09-11 Advanced Silicon SA Bouton transparent pour écran tactile capacitif
WO2019208323A1 (fr) * 2018-04-23 2019-10-31 Nakajima Jinya Dispositif d'actionnement à distance pour terminal mobile
WO2020245307A1 (fr) * 2019-06-04 2020-12-10 Flavians Bv Appareil de recouvrement d'écran tactile
WO2020244742A1 (fr) * 2019-06-04 2020-12-10 Flavians Bv Appareil de recouvrement d'écran tactile
GB2576462B (en) * 2017-05-12 2022-03-23 Animae Tech Limited Method and device for interacting with touch sensitive surface

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100081505A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Accessory for playing games with a portable electronic device
KR101015337B1 (ko) * 2010-07-05 2011-02-16 정영훈 터치스크린용 조향 어답터

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100081505A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Accessory for playing games with a portable electronic device
KR101015337B1 (ko) * 2010-07-05 2011-02-16 정영훈 터치스크린용 조향 어답터

Cited By (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014137851A2 (fr) 2013-03-08 2014-09-12 Petersen Darren C Appareil d'actionneur mécanique pour une surface tactile d'un dispositif électronique
US9158390B2 (en) 2013-03-08 2015-10-13 Darren C. PETERSEN Mechanical actuator apparatus for a touch sensing surface of an electronic device
US9164595B2 (en) 2013-03-08 2015-10-20 Darren C. PETERSEN Mechanical actuator apparatus for a touchscreen
GB2517418A (en) * 2013-08-19 2015-02-25 Arm Ip Ltd Capacitive touch sensor within wrist worn device
GB2517418B (en) * 2013-08-19 2018-04-11 Arm Ip Ltd Capacitive touch sensor within wrist worn device
US9588624B2 (en) 2013-08-19 2017-03-07 Arm Ip Limited Capacitive touch sensor within wrist worn device
EP3144783A1 (fr) * 2014-05-15 2017-03-22 Panasonic Intellectual Property Management Co., Ltd. Bouton de commande et dispositif d'affichage muni de ce bouton
US10318078B2 (en) 2014-05-15 2019-06-11 Panasonic Intellectual Property Management Co., Ltd. Operation knob and display device in which same is used
CN106462278A (zh) * 2014-05-15 2017-02-22 松下知识产权经营株式会社 操作旋钮及利用该操作旋钮的显示装置
EP3144783A4 (fr) * 2014-05-15 2017-08-02 Panasonic Intellectual Property Management Co., Ltd. Bouton de commande et dispositif d'affichage muni de ce bouton
JPWO2015174092A1 (ja) * 2014-05-15 2017-04-20 パナソニックＩｐマネジメント株式会社 操作つまみおよびそれを利用した表示装置
CN105204753A (zh) * 2014-06-12 2015-12-30 联想(北京)有限公司 一种信息处理方法及交互类附件
CN105446460A (zh) * 2014-06-13 2016-03-30 联想(北京)有限公司 一种信息处理方法、交互类附件及电子设备
JP2016015129A (ja) * 2014-06-13 2016-01-28 学校法人明治大学 入力装置、入力システム、情報処理装置及びヘッドマウントディスプレイ
GB2535492A (en) * 2015-02-18 2016-08-24 Stevens Andrew PEGG-OXH-1 A stand alone electronic device that clips onto capacitive touch screen devices such as tablets, mini tablets, and mobile telephones, and simulates
GB2535492B (en) * 2015-02-18 2018-09-12 Stevens Andrew Electronic devices for simulating human finger contact against capacitive touch screens
JP2016160357A (ja) * 2015-03-02 2016-09-05 フジコピアン株式会社 静電容量式センサー感知状態維持用の導電性粘着シートおよび前記導電性粘着シートを用いた静電容量式センサーの感知状態を維持する方法
JP2016160358A (ja) * 2015-03-02 2016-09-05 フジコピアン株式会社 静電容量式センサー感知状態維持用の導電性粘着シートおよび前記導電性粘着シートを用いた静電容量式センサーの感知状態を維持する方法
US10310677B2 (en) 2015-03-31 2019-06-04 Andrew Stevens Electronic finger touch simulator for capacitive touch screen devices
US10429960B2 (en) 2015-09-17 2019-10-01 Continental Automotive France Adaptable control-knob system on a smartphone or electronic tablet
CN108093650B (zh) * 2015-09-17 2021-04-27 法国大陆汽车公司 可适配于智能电话或电子平板上的旋钮系统
WO2017045744A1 (fr) * 2015-09-17 2017-03-23 Continental Automotive France Systeme de molette adaptable sur telephone intelligent ou tablette electronique
FR3041494A1 (fr) * 2015-09-17 2017-03-24 Continental Automotive France Systeme de molette adaptable sur telephone intelligent ou tablette electronique
CN108093650A (zh) * 2015-09-17 2018-05-29 法国大陆汽车公司 可适配于智能电话或电子平板上的旋钮系统
TWI631496B (zh) * 2016-07-22 2018-08-01 華碩電腦股份有限公司 電子裝置及觸控板
CN106657516A (zh) * 2016-12-09 2017-05-10 深圳市泽昕通讯有限公司 基于电磁干扰环境下触摸屏干扰复现与规避的方法及系统
CN106657516B (zh) * 2016-12-09 2020-11-24 深圳市泽昕通讯有限公司 基于电磁干扰环境下触摸屏干扰复现与规避的方法及系统
US11301066B2 (en) 2017-05-12 2022-04-12 Animae Technologies Limited Method and a device for interacting with a touch sensitive surface
GB2576462B (en) * 2017-05-12 2022-03-23 Animae Tech Limited Method and device for interacting with touch sensitive surface
CN108073333A (zh) * 2018-01-31 2018-05-25 北京小米移动软件有限公司 触控模组、终端和电子设备
EP3537266A1 (fr) * 2018-03-05 2019-09-11 Advanced Silicon SA Bouton transparent pour écran tactile capacitif
WO2019208323A1 (fr) * 2018-04-23 2019-10-31 Nakajima Jinya Dispositif d'actionnement à distance pour terminal mobile
CN108810216B (zh) * 2018-06-01 2020-06-05 常州信息职业技术学院 佩戴式通讯设备
CN108810216A (zh) * 2018-06-01 2018-11-13 常州信息职业技术学院 佩戴式通讯设备
WO2020244742A1 (fr) * 2019-06-04 2020-12-10 Flavians Bv Appareil de recouvrement d'écran tactile
WO2020245307A1 (fr) * 2019-06-04 2020-12-10 Flavians Bv Appareil de recouvrement d'écran tactile
BE1029474B1 (nl) * 2019-06-04 2023-01-16 Flavians Touchscreen overlay-apparaten

Similar Documents

Publication Publication Date Title
WO2012139203A1 (fr) Commandes physiques à rétroaction tactile pour dispositifs tactiles captifs
US11093001B1 (en) Virtual reality viewer and input mechanism
US20210252388A1 (en) Controller with sensor-rich controls
US8330061B2 (en) Compact input device
US8994666B2 (en) Tactile touch-sensing interface system
AU2008100566A4 (en) Method and apparatus for implementing multiple push buttons in a user input device
CA2904015C (fr) Appareil d'actionneur mecanique pour un ecran tactile
US20120169597A1 (en) Physical joystick for electronic tablet devices
US20110199325A1 (en) Touch Screen Multi-Control Emulator
AU2007313960B2 (en) Sensor configurations in a user input device
US9158390B2 (en) Mechanical actuator apparatus for a touch sensing surface of an electronic device
US20080088597A1 (en) Sensor configurations in a user input device
US20100236843A1 (en) Data input device
MX2011010298A (es) Deteccion de tacto en una superficie curveada.
WO2010039383A2 (fr) Pavé tactile mobile avec une fonctionnalité supplémentaire
US11099692B2 (en) Sensor device and method
US20150338982A1 (en) System, device and method for emulating user interaction with a touch screen device
US9298324B1 (en) Capacitive touch with tactile feedback
US10804897B2 (en) Touch-sensitive keypad control device
KR20180018739A (ko) 상호 작용을 위해 회전 가능하게 장착된 베젤을 구비하는 전자 장치 및 그 전자 장치의 작동 방법
WO2013162830A1 (fr) Systèmes et procédés pour un dispositif d'éclairage enroulable
US20180101262A1 (en) Multi-phase touch-sensing electronic device
JP3195752U (ja) タッチパネル用吸盤型スイッチ

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12771946

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC

122 Ep: pct application non-entry in european phase

Ref document number: 12771946

Country of ref document: EP

Kind code of ref document: A1