US20120034978A1 - High-Dimensional Touchpad Game Controller with Multiple Usage and Networking Modalities - Google Patents

High-Dimensional Touchpad Game Controller with Multiple Usage and Networking Modalities Download PDF

Info

Publication number
US20120034978A1
US20120034978A1 US13/198,691 US201113198691A US2012034978A1 US 20120034978 A1 US20120034978 A1 US 20120034978A1 US 201113198691 A US201113198691 A US 201113198691A US 2012034978 A1 US2012034978 A1 US 2012034978A1
Authority
US
United States
Prior art keywords
game
hdtp
controller
network
algorithm
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13/198,691
Other versions
US9950256B2 (en
Inventor
Seung E. Lim
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NRI R&D Patent Licensing LLC
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US13/198,691 priority Critical patent/US9950256B2/en
Publication of US20120034978A1 publication Critical patent/US20120034978A1/en
Assigned to LUDWIG, LESTER F. reassignment LUDWIG, LESTER F. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LIM, SEUNG E.
Assigned to NRI R&D PATENT LICENSING, LLC reassignment NRI R&D PATENT LICENSING, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LUDWIG, LESTER F
Assigned to PBLM ADVT LLC reassignment PBLM ADVT LLC SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: NRI R&D PATENT LICENSING, LLC
Priority to US15/926,727 priority patent/US20180207526A1/en
Application granted granted Critical
Publication of US9950256B2 publication Critical patent/US9950256B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/23Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
    • A63F13/235Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/33Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
    • A63F13/335Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/90Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
    • A63F13/92Video game devices specially adapted to be hand-held while playing
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/90Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
    • A63F13/95Storage media specially adapted for storing game information, e.g. video game cartridges
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1025Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection
    • A63F2300/1031Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection using a wireless connection, e.g. Bluetooth, infrared connections
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1068Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/20Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
    • A63F2300/204Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform the platform being a handheld device
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/20Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
    • A63F2300/206Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards
    • A63F2300/208Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards for storing personal settings or data of the player
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A63F2300/403Connection between platform and handheld device
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A63F2300/407Data transfer via internet

Definitions

  • portable devices are becoming very popular, users still rely on devices that are not portable for a variety of reasons—for example most inexpensive portable devices have limited capacity of processor or storage. Devices with lack of mobility can be compensated for by additional features or additional types of devices that provide access to associated systems or networks.
  • WiFi and other types of networking has become available in most urban areas, and there are broad ranges of devices that enable the users to easily connect among devices within homes via various types of networking.
  • electronic games for social networks and massively multiplayer online (MMO) games are a rapidly growing trend in gaming industry.
  • MMO massively multiplayer online
  • digital distribution and downloadable content are also becoming a trend in gaming industry. Accordingly, staying connected to the internet or other network has become increasingly essential in gaming.
  • HDTP touch-pad and touch-screen technologies as taught in U.S. Pat. No. 6,570,078, pending U.S. patent application Ser. No. 12/418,605, pending U.S. patent application Ser. No. 11/761,978, and many other related pending U.S. patent applications provide a wide range of touch-based user interface capabilities—including 3D and 6D interactions, advanced multi-touch, rich information flux, rich metaphors, multi-dimensional extensions to hyperlinks (for example as taught in pending U.S. patent application Ser. No. 13/026,248), and tactile grammars—many of which are very well suited for interactive control of gaming systems. Additionally, HDTP touch-pad and touch-screen technologies can be readily implemented in small, handheld devices.
  • HDTP touch-screen technologies can be implemented using multiplexed OLED displays or transparent OLED overlays atop LCD displays so that capacitive sensing overlays and associated RF electronics are not required.
  • the capture and tracking software for gestures and parameters can be implemented in part or entirely in GPU processors, display driver software, and other computational elements within a device.
  • the present invention provides for the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies.
  • the present invention additionally pertains to various embodiments of advanced game controllers that include an HDTP touch-pad or touch-screen.
  • inventive systems and methods of the invention comprise the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies.
  • a game controller comprises touch-based sensor that is used as a sensor for a HDTP user interface.
  • a game controller comprises capacitive touch sensor that is used as a sensor for a HDTP user interface.
  • a game controller comprises an OLED display that is used as a touch-based user interface.
  • a game controller comprises an OLED display that is used as a sensor for a HDTP user interface.
  • a game controller comprises video camera that is used as a sensor for a HDTP user interface.
  • a game controller comprises video camera that is used as a sensor for gesture sensing.
  • a game controller comprises an HDTP user interface and a joystick.
  • a game controller comprises support for a multiple-dimensional hypermedia object.
  • a game controller comprises support for a multiple-dimensional hyperlink.
  • the invention comprises a High Dimensional Touch Parameter (HDTP) touch capability that can selectively function, as desired by the user, as one or more of a game controller that connects to a game console via network connections, an independent portable/mobile game device with limited but sufficient capacity of processor/memory, a controller for a game console connected remotely through the internet and or a storage device/media player that can store gaming history, personal information, or media files.
  • the device comprises at least one processor for executing at least one algorithm, the algorithm including at least a game, at least one touch sensor providing real-time tactile information to at least one algorithm, the algorithm implementing at least on HDTP function, and at least one networking element configured to network the device to at least the internet.
  • HDTP High Dimensional Touch Parameter
  • the invention comprises a device that can selectively function, as desired by the user, as one or more of:
  • the invention comprises a device that can selectively function, as desired by the user, as one or more of:
  • the invention comprises a device that can selectively function, as desired by the user, as one or more of:
  • the invention comprises a device that can selectively function, as desired by the user, as one or more of:
  • FIGS. 1 a and 1 b illustrate physical configuration of the embodiment of the invention which comprises of a screen on the center of the front and touch sensor regions on left and right end of the device both on the front and the back.
  • FIGS. 2 a and 2 b illustrate physical configuration of the embodiment of the invention which comprises of a touch-screen on the front and touch sensor regions on left and right end of the device both on the front and the back.
  • FIG. 3 a illustrates physical configuration of the embodiment of the invention which includes a joystick (or a directional stick) on the bottom center of the front.
  • FIG. 3 b illustrates physical configuration of the embodiment of the invention which includes two joysticks (or directional sticks) on the bottom center of the front.
  • FIG. 4 a - 4 c illustrates physical configuration of the embodiment of the invention where the touch sensor region on the front is partitioned into multiple parts.
  • FIGS. 5 a and 5 b illustrates physical configuration of the embodiment of the invention where there are touch sensor regions along the edge of the device.
  • FIG. 6 a depicts an exemplary controller (or portable gaming console) as a standalone device.
  • FIG. 6 b depicts an exemplary controller (or portable gaming console) connected to the network or computing environment.
  • FIG. 6 c depicts an exemplary controller connected with wire to the console, which is connected to the TV or display.
  • FIG. 6 d depicts an exemplary controller connected wirelessly the console, which is connected to the TV or display.
  • Such wireless connection includes infrared, Bluetooth, WiFi, etc.
  • FIG. 6 e depicts an exemplary controller wired to the console (connected to the TV or display) which is connected to the network or computing environment.
  • FIG. 6 f depicts an exemplary controller connected wirelessly the console (connected to the TV or display) which is connected to the network or computing environment.
  • FIGS. 7 a and 7 b describe the possible embodiments of the architecture of the invention.
  • FIG. 8 a illustrates an exemplary arrangement wherein a game controller is connected to the server via network for the purpose of having the server handle computations, data or database, or combinations of them.
  • FIG. 8 b illustrates an exemplary arrangement wherein multiple game controllers are connected to one server through network.
  • FIG. 8 c illustrates an exemplary arrangement wherein a controller can control the server through the network or the computing environment.
  • FIG. 8 d illustrates an exemplary arrangement wherein multiple controllers can control the server through the network or the computing environment.
  • FIG. 9 a illustrates an exemplary arrangement wherein two game controllers are connected through network.
  • FIG. 9 b illustrates how three game controllers are connected to one another through network.
  • FIG. 9 c illustrates an exemplary arrangement wherein a controller can control another controller that is connected to the same network or the computing environment.
  • FIG. 9 d illustrates an exemplary arrangement wherein one controller can control another controller connected on the same network or the computing environment.
  • FIG. 10 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the left.
  • FIG. 10 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
  • FIG. 10 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the right.
  • FIG. 11 a illustrates an exemplary view from the simulated aircraft when the aircraft is slanted upward.
  • FIG. 11 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
  • FIG. 11 c illustrates an exemplary view from the simulated aircraft when the aircraft is slanted downward.
  • FIG. 12 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated clockwise.
  • FIG. 12 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
  • FIG. 12 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated counterclockwise.
  • WiFi and other types of networking has become available in most urban areas, and there are broad ranges of devices that enable the users to easily connect among devices within homes via various types of networking.
  • electronic games for social networks and massively multiplayer online (MMO) games are a rapidly growing trend in gaming industry.
  • MMO massively multiplayer online
  • digital distribution and downloadable content are also becoming a trend in gaming industry. Accordingly, staying connected to the internet or other network has become increasingly essential in gaming.
  • HDTP High Dimensional Touch Parameter
  • HDTP High Dimensional Touch Parameter
  • touch-pad and touch-screen technologies as taught in U.S. Pat. No. 6,570,078, pending U.S. patent application Ser. No. 12/418,605, pending U.S. patent application Ser. No. 11/761,978, and many other related pending U.S. patent applications provide a wide range of touch-based user interface capabilities. These include vast ranges of control by combinations of additional parameters derived from touch by the human hand, including a number of natural 3D capabilities, for example:
  • HDTP touch-pad and touch-screen technologies can be readily implemented in small, handheld devices in various ways.
  • medium and high resolutions HDTP touch-screen technologies can be implemented using multiplexed OLED displays or transparent OLED overlays atop LCD displays so that capacitive sensing overlays and associated RF electronics are not required.
  • the capture and tracking software for gestures and parameters can be implemented in part or entirely in GPU processors, display driver software, and other computational elements within a device.
  • video cameras can also be used to implement HDTP capabilities and extensions of them.
  • the present invention provides for the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies.
  • the present invention additionally pertains to various embodiments of advanced game controllers that include an HDTP touch-pad or touch-screen.
  • buttons and directional pad/stick are eliminated by the HDTP. Controls that previously require complicated sequence of arrow keys and buttons can easily be implemented by combination of parameters. Users can navigate through the setup menus and control options in a game with the HDTP.
  • a joystick or a directional control stick which is a main feature of most game controllers, can be replaced with having the HDTP along the edge of the controller: if a user wants to move an object to a desired direction, the user can place one or more finger(s) in the corresponding side of the touch-pad, or a touch-pad can be placed on the top surface of the joystick.
  • the invention can comprise (or be comprised within) a device comprising of any combination of two or more of the following:
  • the aforementioned touch-pad or touch-screen can be an HDTP touch-pad or touch-screen.
  • a number of exemplary configurations incorporating one or more touch-pads or touch-screens, ordinary, gesture-based, and/or HDTP are now presented.
  • FIG. 1 a - 5 b illustrate physical exemplary embodiment of the invention.
  • FIGS. 1 a and 1 b illustrate physical configuration of the embodiment of the invention which comprises of a screen on the center of the front and touch sensor regions on left and right end of the device both on the front and the back.
  • FIGS. 2 a and 2 b illustrate physical configuration of the embodiment of the invention which comprises of a touch-screen on the front and touch sensor regions on left and right end of the device both on the front and the back.
  • FIG. 3 a illustrates physical configuration of the embodiment of the invention which includes a joystick (or a directional stick) on the bottom center of the front.
  • FIG. 3 b illustrates physical configuration of the embodiment of the invention which includes two joysticks (or directional sticks) on the bottom center of the front.
  • FIG. 4 a - 4 c illustrates physical configuration of the embodiment of the invention where a touch sensor region is implemented on the front of the device is partitioned into multiple parts.
  • FIGS. 5 a and 5 b illustrates physical configuration of the embodiment of the invention where there is at least one touch sensor region along the edge of the device.
  • Various embodiments of the invention can support a number of operating modalities and networking arrangements with the internet, game consoles, games servers, etc.
  • FIG. 6 a - 6 f illustrate exemplary usage modality and/or networking embodiments provided for by the invention.
  • FIG. 6 a represents the controller (or portable gaming console) as a standalone device.
  • FIG. 6 b represents the controller (or portable gaming console) connected to the network or computing environment.
  • the controller is connected with wire to the console, which is connected to the TV or display.
  • the controller is connected wirelessly the console, which is connected to the TV or display.
  • Such wireless connection includes infrared, Bluetooth, LAN, WAN, WAP, etc.
  • the controller is wired to the console (connected to the TV or display) which is connected to the network or computing environment.
  • FIG. 6 f the controller is connected wirelessly the console (connected to the TV or display) which is connected to the network or computing environment.
  • FIGS. 7 a and 7 b describe the possible embodiments of the internal architecture of the invention.
  • FIG. 7 a depicts an exemplary embodiment comprising one or more network interface(s), memory, CPU, GPU, and DSP.
  • FIG. 7 b illustrates a different an exemplary embodiment.
  • the need for memory and CPU is eliminated by having a GPGPU (General Purpose GPU).
  • General purpose computing, as well as graphic rendering, is delegated to GPGPU.
  • the exemplary depicted audio features can be included or omitted as can be advantageous.
  • FIG. 8 a illustrates an exemplary arrangement wherein a game controller is connected to the server via network for the purpose of having the server handle computations, data or database, or combinations of them.
  • FIG. 8 b illustrates an exemplary arrangement wherein multiple game controllers are connected to one server through network. All the controllers are connected only through the server; no direct access among one controller to another is available. This is referred to as “star” topology or social network.
  • FIG. 8 c illustrates an exemplary arrangement wherein a controller can control the server through the network or the computing environment.
  • FIG. 8 d illustrates an exemplary arrangement wherein multiple controllers can control the server through the network or the computing environment.
  • FIG. 9 a illustrates an exemplary arrangement wherein two game controllers are connected through network.
  • FIG. 9 b illustrates an exemplary arrangement wherein three game controllers are connected to one another through network. This connection represents a “Full Mesh” top-every controller is connected to every other controller.
  • FIG. 9 c illustrates an exemplary arrangement wherein a controller can control another controller that is connected to the same network or the computing environment.
  • FIG. 9 d illustrates an exemplary arrangement wherein one controller can control another controller connected on the same network or the computing environment.
  • rotating a finger can be used to adjust the direction, and more or less pressure to adjust the intensity of throwing/hitting.
  • Other variations are clear to one skilled in the art and are provided for by the invention.
  • FIG. 10 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the left
  • FIG. 10 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the right.
  • FIG. 10 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
  • FIG. 11 a illustrates an exemplary view from the simulated aircraft when the aircraft is slanted upward
  • FIG. 11 c illustrates an exemplary view from the simulated aircraft when the aircraft is slanted downward.
  • FIG. 11 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
  • FIG. 12 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated clockwise
  • FIG. 12 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated counterclockwise.
  • FIG. 12 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
  • Combinations of more HDTP parameters can implement, emulate, or simulate more complex control actions.
  • the simulated aircraft can be slanted downward while rotated to the left by a finger rotated counterclockwise while being tilted downward.
  • Other variations are clear to one skilled in the art and are provided for by the invention.
  • touch sensor regions both on front and back side of the controller can be advantageous.
  • the touch sensor regions on the front can be used for navigating the aircraft, and the touch sensor regions on the back can be used for navigating through submenus for selecting targets, weapons, etc.
  • the touch sensor regions on the front can be used for actual movement of the aircraft, and the touch sensor regions on the back can be used for manipulating the viewpoint.
  • Other variations are clear to one skilled in the art and are provided for by the invention.
  • the orientation of a 3D object can be manipulated with a finger placed on the touch sensor on the left end of the controller, and the position of a 3D object can be manipulated with a finger placed on the touch sensor on the right end of the controller.
  • Other variations are clear to one skilled in the art and are provided for by the invention.
  • one region of the HDTP can control the arm motions while another region of the HDTP can control the leg motions.
  • Variations on the users' touch can simulate complex punches or kicks. Also, making selections in menus or switching between different modes can be done easily with rolling, pitching, or rotating fingers. Other variations are clear to one skilled in the art and are provided for by the invention. Further, a contiguous touch sensor region can be partitioned into multiple parts, as described in pending U.S. patent application U.S. Ser. No. 12/418,605.
  • different parts of the HDTP can control different instruments: for example, left hand can play the drums, and right hand can play the guitar.
  • left hand can play the drums
  • right hand can play the guitar.
  • Other variations are clear to one skilled in the art and are provided for by the invention.
  • the controller can be composed of a plurality of distinct portions or modules—for example left, center, and right modules—and one or more such portions or modules can be replaced with a module that is longer, shaped differently, or has other variations or differences—for example as may be particularly suited to a particular mode or action of play.
  • a module that is longer to replicate frets on a guitar can be used to provide experience that is similar to playing an actual guitar.
  • Other variations are clear to one skilled in the art and are provided for by the invention.
  • Combinations of parameters can also improve the user experience in construction and management simulation games by providing easier way of making selections in menus or switching between different modes.
  • users can control the object in the game, while the camera detects the user behavior which can be another input for the game.
  • the invention uses HDTP functions to implement multi-dimensional extensions to hypermedia objects including hyperlinks and rollovers (for example as taught in pending U.S. patent application Ser. No. 13/026,248).
  • the invention comprises a device that can selectively function, as desired by the user, as one or more of:
  • the invention comprises a device that can selectively function, as desired by the user, as one or more of:
  • the invention comprises a device that can selectively function, as desired by the user, as one or more of:
  • the invention comprises a device that can selectively function, as desired by the user, as one or more of:

Abstract

A device comprising a High Dimensional Touch Parameter (HDTP) touch capability that can selectively function, as desired by the user, as one or more of a game controller that connects to a game console via network connections, an independent portable/mobile game device with limited but sufficient capacity of processor/memory, a controller for a game console connected remotely through the internet and or a storage device/media player that can store gaming history, personal information, or media files. In an embodiment the device comprises at least one processor for executing at least one algorithm, the algorithm including at least a game, at least one touch sensor providing real-time tactile information to at least one algorithm, the algorithm implementing at least on HDTP function, and at least one networking element configured to network the device to at least the internet.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • Pursuant to 35 U.S.C. §119(e), this application claims benefit of priority from Provisional U.S. Patent application Ser. No. 61/371,153, received at the U.S. Patent Office on Aug. 5, 2010, the contents of which are incorporated by reference.
  • COPYRIGHT & TRADEMARK NOTICES
  • A portion of the disclosure of this patent document may contain material, which is subject to copyright protection. Certain marks referenced herein may be common law or registered trademarks of the applicant, the assignee or third parties affiliated or unaffiliated with the applicant or the assignee. Use of these marks is for providing an enabling disclosure by way of example and shall not be construed to exclusively limit the scope of the disclosed subject matter to material associated with such marks.
  • BACKGROUND OF THE INVENTION
  • Although portable devices are becoming very popular, users still rely on devices that are not portable for a variety of reasons—for example most inexpensive portable devices have limited capacity of processor or storage. Devices with lack of mobility can be compensated for by additional features or additional types of devices that provide access to associated systems or networks. An important example of these, and subject of the present invention, is game consoles.
  • WiFi and other types of networking has become available in most urban areas, and there are broad ranges of devices that enable the users to easily connect among devices within homes via various types of networking. Additionally, electronic games for social networks and massively multiplayer online (MMO) games are a rapidly growing trend in gaming industry. Further, digital distribution and downloadable content are also becoming a trend in gaming industry. Accordingly, staying connected to the internet or other network has become increasingly essential in gaming.
  • Further, it is noted that during the last decade video games have become more interactive. Older games utilized button-pressing sequences to simulate more complicated inputs and motions (such as gestures). Because of the fact that such button-pressing sequences are often very complicated, some games have limited audience of users. As gaming consoles devised and include user-operated controls that are easier to use, such game consoles have increasingly attracted users that are not experienced gamers. For example, Nintendo's Wii has variety of games the whole family can play, and the targeted age of users are definitely of wider range compared to some years ago.
  • The popularity of the Apple™ iPhone™ and subsequent smartphones, PDAs, and other handheld mobile devices with touch interfaces has lead to interest and demand for games that use touch-based and touch-gesture user interfaces. To date the touch capabilities have been somewhat limited. Some newer game controllers and portable game consoles comprise touch-screens, but these typically only offer the X-Y position tracking capabilities of traditional mice or simple flinger-flick gestures.
  • The High Dimensional Touch Parameter (“HDTP”) touch-pad and touch-screen technologies as taught in U.S. Pat. No. 6,570,078, pending U.S. patent application Ser. No. 12/418,605, pending U.S. patent application Ser. No. 11/761,978, and many other related pending U.S. patent applications provide a wide range of touch-based user interface capabilities—including 3D and 6D interactions, advanced multi-touch, rich information flux, rich metaphors, multi-dimensional extensions to hyperlinks (for example as taught in pending U.S. patent application Ser. No. 13/026,248), and tactile grammars—many of which are very well suited for interactive control of gaming systems. Additionally, HDTP touch-pad and touch-screen technologies can be readily implemented in small, handheld devices. Further as to this, as taught in pending U.S. patent applications Ser. Nos. 12/418,605 and 61/506,634, medium and high resolutions HDTP touch-screen technologies can be implemented using multiplexed OLED displays or transparent OLED overlays atop LCD displays so that capacitive sensing overlays and associated RF electronics are not required. In such embodiments, the capture and tracking software for gestures and parameters can be implemented in part or entirely in GPU processors, display driver software, and other computational elements within a device.
  • Two previous pending U.S. Patent Applications by the present inventor—U.S. patent applications Ser. Nos. 12/502,230 and 12/511,930—share a specification that teaches aspects of game-based applications of HDTP technologies, for example as implemented on a computer (or as implemented on a hand-held device; see FIG. 1 f therein).
  • The present invention provides for the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies. The present invention additionally pertains to various embodiments of advanced game controllers that include an HDTP touch-pad or touch-screen.
  • SUMMARY OF THE INVENTION
  • Features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
  • In an embodiment, inventive systems and methods of the invention comprise the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies.
  • In another aspect of the invention, a game controller comprises touch-based sensor that is used as a sensor for a HDTP user interface.
  • In another aspect of the invention, a game controller comprises capacitive touch sensor that is used as a sensor for a HDTP user interface.
  • In an aspect of the invention, a game controller comprises an OLED display that is used as a touch-based user interface.
  • In another aspect of the invention, a game controller comprises an OLED display that is used as a sensor for a HDTP user interface.
  • In another aspect of the invention, a game controller comprises video camera that is used as a sensor for a HDTP user interface.
  • In another aspect of the invention, a game controller comprises video camera that is used as a sensor for gesture sensing.
  • In another aspect of the invention, a game controller comprises an HDTP user interface and a joystick.
  • In another aspect of the invention, a game controller comprises support for a multiple-dimensional hypermedia object.
  • In another aspect of the invention, a game controller comprises support for a multiple-dimensional hyperlink.
  • In an embodiment, the invention comprises a High Dimensional Touch Parameter (HDTP) touch capability that can selectively function, as desired by the user, as one or more of a game controller that connects to a game console via network connections, an independent portable/mobile game device with limited but sufficient capacity of processor/memory, a controller for a game console connected remotely through the internet and or a storage device/media player that can store gaming history, personal information, or media files. In an embodiment the device comprises at least one processor for executing at least one algorithm, the algorithm including at least a game, at least one touch sensor providing real-time tactile information to at least one algorithm, the algorithm implementing at least on HDTP function, and at least one networking element configured to network the device to at least the internet.
  • In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
      • a game controller device that connects to a game console via wireless connections;
      • a game controller device that connects to a game console via wired connections;
      • an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
      • a controller for a game console connected remotely through the internet;
      • a storage device/media player that can store gaming history, personal information, or media files.
  • In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
      • a game controller device that connects to a game console via wireless connections;
      • a game controller device that connects to a game console via wired connections;
      • an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
      • a controller for a game console connected remotely through the internet.
  • In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
      • a game controller device that connects to a game console via wireless connections;
      • a game controller device that connects to a game console via wired connections;
      • an independent portable/mobile game device with limited but sufficient capacity of processor/memory.
  • In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
      • an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
      • a storage device/media player that can store gaming history, personal information, or media files.
  • These and other embodiments will also become readily apparent to those skilled in the art from the following detailed description of the embodiments having reference to the attached figures, the invention not being limited to any particular embodiment disclosed.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and other aspects, features and advantages of the present invention will become more apparent upon consideration of the following description of preferred embodiments taken in conjunction with the accompanying drawing figures.
  • FIGS. 1 a and 1 b illustrate physical configuration of the embodiment of the invention which comprises of a screen on the center of the front and touch sensor regions on left and right end of the device both on the front and the back.
  • FIGS. 2 a and 2 b illustrate physical configuration of the embodiment of the invention which comprises of a touch-screen on the front and touch sensor regions on left and right end of the device both on the front and the back.
  • FIG. 3 a illustrates physical configuration of the embodiment of the invention which includes a joystick (or a directional stick) on the bottom center of the front.
  • FIG. 3 b illustrates physical configuration of the embodiment of the invention which includes two joysticks (or directional sticks) on the bottom center of the front.
  • FIG. 4 a-4 c illustrates physical configuration of the embodiment of the invention where the touch sensor region on the front is partitioned into multiple parts.
  • FIGS. 5 a and 5 b illustrates physical configuration of the embodiment of the invention where there are touch sensor regions along the edge of the device.
  • FIG. 6 a depicts an exemplary controller (or portable gaming console) as a standalone device.
  • FIG. 6 b depicts an exemplary controller (or portable gaming console) connected to the network or computing environment.
  • FIG. 6 c depicts an exemplary controller connected with wire to the console, which is connected to the TV or display.
  • FIG. 6 d depicts an exemplary controller connected wirelessly the console, which is connected to the TV or display. Such wireless connection includes infrared, Bluetooth, WiFi, etc.
  • FIG. 6 e depicts an exemplary controller wired to the console (connected to the TV or display) which is connected to the network or computing environment.
  • FIG. 6 f depicts an exemplary controller connected wirelessly the console (connected to the TV or display) which is connected to the network or computing environment.
  • FIGS. 7 a and 7 b describe the possible embodiments of the architecture of the invention.
  • FIG. 8 a illustrates an exemplary arrangement wherein a game controller is connected to the server via network for the purpose of having the server handle computations, data or database, or combinations of them.
  • FIG. 8 b illustrates an exemplary arrangement wherein multiple game controllers are connected to one server through network.
  • FIG. 8 c illustrates an exemplary arrangement wherein a controller can control the server through the network or the computing environment.
  • FIG. 8 d illustrates an exemplary arrangement wherein multiple controllers can control the server through the network or the computing environment.
  • FIG. 9 a illustrates an exemplary arrangement wherein two game controllers are connected through network.
  • FIG. 9 b illustrates how three game controllers are connected to one another through network.
  • FIG. 9 c illustrates an exemplary arrangement wherein a controller can control another controller that is connected to the same network or the computing environment.
  • FIG. 9 d illustrates an exemplary arrangement wherein one controller can control another controller connected on the same network or the computing environment.
  • FIG. 10 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the left. FIG. 10 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position. FIG. 10 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the right.
  • FIG. 11 a illustrates an exemplary view from the simulated aircraft when the aircraft is slanted upward. FIG. 11 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position. FIG. 11 c illustrates an exemplary view from the simulated aircraft when the aircraft is slanted downward.
  • FIG. 12 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated clockwise. FIG. 12 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position. FIG. 12 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated counterclockwise.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • In the following, numerous specific details are set forth to provide a thorough description of various embodiments. Certain embodiments may be practiced without these specific details or with some variations in detail. In some instances, certain features are described in less detail so as not to obscure other aspects. The level of detail associated with each of the elements or features should not be construed to qualify the novelty or importance of one feature over the others.
  • In the following description, reference is made to the accompanying drawing figures which form a part hereof, and which show by way of illustration specific embodiments of the invention. It is to be understood by those of ordinary skill in this technological field that other embodiments may be utilized, and structural, electrical, as well as procedural changes may be made without departing from the scope of the present invention.
  • Mobile and Non-Mobile Devices
  • Although portable devices are becoming very popular, users still rely on devices that are not portable for a variety of reasons—for example most inexpensive portable devices have limited capacity of processor or storage. Devices with lack of mobility can be compensated for by additional features or additional types of devices that provide access to associated systems or networks. An important example of these, and the subject of the present invention, are game consoles.
  • Networking of Game Controllers
  • WiFi and other types of networking has become available in most urban areas, and there are broad ranges of devices that enable the users to easily connect among devices within homes via various types of networking. Additionally, electronic games for social networks and massively multiplayer online (MMO) games are a rapidly growing trend in gaming industry. Further, digital distribution and downloadable content are also becoming a trend in gaming industry. Accordingly, staying connected to the internet or other network has become increasingly essential in gaming.
  • User Interface Evolution in Game Controllers
  • Further, it is noted that during the last decade video games have become more interactive. Older games utilized button-pressing sequences to simulate more complicated inputs and motions (such as gestures). Because of the fact that such button-pressing sequences are often very complicated, some games have limited audience of users. As gaming consoles devised and include user-operated controls that are easier to use, such game consoles have increasingly attracted users that are not experienced gamers. For example, Nintendo's Wii has variety of games the whole family can play, and the targeted age of users are definitely of wider range compared to some years ago.
  • Touch-Based User Interfaces in Game Controllers
  • The popularity of the Apple™ iPhone™ and subsequent smartphones, PDAs, and other handheld mobile devices with touch interfaces has lead to interest and demand for games that use touch-based and touch-gesture user interfaces. To date the touch capabilities have been somewhat limited. Some newer game controllers and portable game consoles comprise touch-screens, but these typically only offer the X-Y position tracking capabilities of traditional mice or simple flinger-flick gestures.
  • High Dimensional Touch Parameter (“HDTP”) Touch-Pad and Touch-Screen Technologies and its Use in Game Controllers
  • The High Dimensional Touch Parameter (“HDTP”) touch-pad and touch-screen technologies as taught in U.S. Pat. No. 6,570,078, pending U.S. patent application Ser. No. 12/418,605, pending U.S. patent application Ser. No. 11/761,978, and many other related pending U.S. patent applications provide a wide range of touch-based user interface capabilities. These include vast ranges of control by combinations of additional parameters derived from touch by the human hand, including a number of natural 3D capabilities, for example:
      • 3D and 6D interactions;
      • advanced multi-touch;
      • use both hands (for example, when the invention is oriented horizontally) or one hand (when oriented vertically);
      • rich information flux;
      • rich frameworks for a wide variety of metaphors;
      • multi-dimensional extensions to hypermedia objects including hyperlinks and rollovers (for example as taught in pending U.S. patent application Ser. No. 13/026,248);
      • tactile grammars.
  • Additionally, HDTP touch-pad and touch-screen technologies can be readily implemented in small, handheld devices in various ways. As taught in pending U.S. patent applications Ser. Nos. 12/418,605 and 61/506,634, medium and high resolutions HDTP touch-screen technologies can be implemented using multiplexed OLED displays or transparent OLED overlays atop LCD displays so that capacitive sensing overlays and associated RF electronics are not required. In such embodiments, the capture and tracking software for gestures and parameters can be implemented in part or entirely in GPU processors, display driver software, and other computational elements within a device. Also as taught in U.S. Pat. No. 6,570,078 and pending U.S. patent application Ser. No. 12/418,605, video cameras can also be used to implement HDTP capabilities and extensions of them.
  • Use of HDTP Touch-Pad and Touch-Screen Technologies in Game Controllers
  • The vast ranges of control by combinations of additional parameters derived from touch by the human hand, including its extensive natural 3D capabilities, metaphors, grammars, and advanced hyperlinks are very well suited for interactive control of gaming systems.
  • Two previous pending U.S. Patent Applications by the present inventor—U.S. patent applications Ser. Nos. 12/502,230 and 12/511,930—share a specification that teaches aspects of game-based applications of HDTP technologies, for example as implemented on a computer (or as implemented on a hand-held device; see FIG. 1 f therein).
  • The present invention provides for the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies. The present invention additionally pertains to various embodiments of advanced game controllers that include an HDTP touch-pad or touch-screen.
  • Use of HDTP 3D Capabilities
  • As newer games heavily rely on interactive 3D features more and more, these additional parameters provided by the HDTP can be more useful as they can produce controls using natural metaphors. The need for multiple buttons and directional pad/stick is eliminated by the HDTP. Controls that previously require complicated sequence of arrow keys and buttons can easily be implemented by combination of parameters. Users can navigate through the setup menus and control options in a game with the HDTP. A joystick or a directional control stick, which is a main feature of most game controllers, can be replaced with having the HDTP along the edge of the controller: if a user wants to move an object to a desired direction, the user can place one or more finger(s) in the corresponding side of the touch-pad, or a touch-pad can be placed on the top surface of the joystick.
  • HDTP Sensors
  • In an embodiment, the invention can comprise (or be comprised within) a device comprising of any combination of two or more of the following:
      • A screen that also functions as a touch-pad or touch-screen (for example as taught in pending U.S. patent applications Ser. Nos. 12/418,605 and 61/506,634, using capacitive, pressure, or LED/OLD sensing technologies);
      • One or more touch sensor(s) provided in a region along the edge all around or at least in areas where both index fingers and both thumbs can sit comfortably for simultaneous input;
      • One or more touch sensor(s) provided in a region on both left and right end;
      • One or more touch sensor(s) provided in a region on the back of either/both left and right end;
      • One or more low-profile directional pad(s)/stick(s) configured in the center of the bottom and/or the center of the top edge;
      • One or more built-in camera(s) for implementing HDTP functions, gesture recognition, and/or machine vision functions.
  • In an embodiment, the aforementioned touch-pad or touch-screen can be an HDTP touch-pad or touch-screen. A number of exemplary configurations incorporating one or more touch-pads or touch-screens, ordinary, gesture-based, and/or HDTP are now presented.
  • FIG. 1 a-5 b illustrate physical exemplary embodiment of the invention.
  • FIGS. 1 a and 1 b illustrate physical configuration of the embodiment of the invention which comprises of a screen on the center of the front and touch sensor regions on left and right end of the device both on the front and the back.
  • FIGS. 2 a and 2 b illustrate physical configuration of the embodiment of the invention which comprises of a touch-screen on the front and touch sensor regions on left and right end of the device both on the front and the back.
  • The invention provides for the HDTP to be supplemented with additional controllers. For example, FIG. 3 a illustrates physical configuration of the embodiment of the invention which includes a joystick (or a directional stick) on the bottom center of the front. Similarly, FIG. 3 b illustrates physical configuration of the embodiment of the invention which includes two joysticks (or directional sticks) on the bottom center of the front.
  • FIG. 4 a-4 c illustrates physical configuration of the embodiment of the invention where a touch sensor region is implemented on the front of the device is partitioned into multiple parts.
  • FIGS. 5 a and 5 b illustrates physical configuration of the embodiment of the invention where there is at least one touch sensor region along the edge of the device.
  • Networking
  • Various embodiments of the invention can support a number of operating modalities and networking arrangements with the internet, game consoles, games servers, etc.
  • FIG. 6 a-6 f illustrate exemplary usage modality and/or networking embodiments provided for by the invention.
  • FIG. 6 a represents the controller (or portable gaming console) as a standalone device. FIG. 6 b represents the controller (or portable gaming console) connected to the network or computing environment. In FIG. 6 c, the controller is connected with wire to the console, which is connected to the TV or display. In FIG. 6 d, the controller is connected wirelessly the console, which is connected to the TV or display. Such wireless connection includes infrared, Bluetooth, LAN, WAN, WAP, etc. In FIG. 6 e, the controller is wired to the console (connected to the TV or display) which is connected to the network or computing environment. In FIG. 6 f, the controller is connected wirelessly the console (connected to the TV or display) which is connected to the network or computing environment.
  • FIGS. 7 a and 7 b describe the possible embodiments of the internal architecture of the invention. FIG. 7 a depicts an exemplary embodiment comprising one or more network interface(s), memory, CPU, GPU, and DSP. FIG. 7 b illustrates a different an exemplary embodiment. The need for memory and CPU is eliminated by having a GPGPU (General Purpose GPU). General purpose computing, as well as graphic rendering, is delegated to GPGPU. In the above, the exemplary depicted audio features (speaker, microphone) can be included or omitted as can be advantageous.
  • FIG. 8 a illustrates an exemplary arrangement wherein a game controller is connected to the server via network for the purpose of having the server handle computations, data or database, or combinations of them. FIG. 8 b illustrates an exemplary arrangement wherein multiple game controllers are connected to one server through network. All the controllers are connected only through the server; no direct access among one controller to another is available. This is referred to as “star” topology or social network. FIG. 8 c illustrates an exemplary arrangement wherein a controller can control the server through the network or the computing environment. FIG. 8 d illustrates an exemplary arrangement wherein multiple controllers can control the server through the network or the computing environment.
  • FIG. 9 a illustrates an exemplary arrangement wherein two game controllers are connected through network. FIG. 9 b illustrates an exemplary arrangement wherein three game controllers are connected to one another through network. This connection represents a “Full Mesh” top-every controller is connected to every other controller.
  • FIG. 9 c illustrates an exemplary arrangement wherein a controller can control another controller that is connected to the same network or the computing environment. FIG. 9 d illustrates an exemplary arrangement wherein one controller can control another controller connected on the same network or the computing environment.
  • Exemplary HDTP Usage Scenarios
  • Exemplary HDTP parameters (or combinations of parameters) usage scenarios are now considered.
  • In sporting games where a graphically rendered object is thrown or hit, rotating a finger can be used to adjust the direction, and more or less pressure to adjust the intensity of throwing/hitting. Other variations are clear to one skilled in the art and are provided for by the invention.
  • As taught in pending U.S. patent applications U.S. Ser. No. 12/502,230 and U.S. Ser. No. 12/511,930, in a flight simulator game, the user can control the direction of the movement by rolling, pitching, or rotating the finger, these sensed by HDTP touch-screen or touch sensor technology. For example, a user can control horizontal orientation of the aircraft by rolling the finger; roll the finger to the left to have the aircraft roll counter-clockwise and roll the finger to the right to have the aircraft roll clockwise. FIG. 10 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the left, and FIG. 10 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the right. FIG. 10 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position. FIG. 11 a illustrates an exemplary view from the simulated aircraft when the aircraft is slanted upward, and FIG. 11 c illustrates an exemplary view from the simulated aircraft when the aircraft is slanted downward. FIG. 11 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position. FIG. 12 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated clockwise, and FIG. 12 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated counterclockwise. FIG. 12 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
  • Combinations of more HDTP parameters can implement, emulate, or simulate more complex control actions. For example, the simulated aircraft can be slanted downward while rotated to the left by a finger rotated counterclockwise while being tilted downward. Other variations are clear to one skilled in the art and are provided for by the invention.
  • Similar controls can be available in vehicle simulation games. Rolling, pitching, and rotating fingers can control steering, braking, and accelerating the vehicles. Other variations are clear to one skilled in the art and are provided for by the invention.
  • In games where two different major categories of control is required, i.e. combat flight simulations games where the users simulate both flying and combat situations, having touch sensor regions both on front and back side of the controller can be advantageous. As an example, the touch sensor regions on the front can be used for navigating the aircraft, and the touch sensor regions on the back can be used for navigating through submenus for selecting targets, weapons, etc. In another embodiment, the touch sensor regions on the front can be used for actual movement of the aircraft, and the touch sensor regions on the back can be used for manipulating the viewpoint. Other variations are clear to one skilled in the art and are provided for by the invention.
  • In a 3D puzzle game, the orientation of a 3D object can be manipulated with a finger placed on the touch sensor on the left end of the controller, and the position of a 3D object can be manipulated with a finger placed on the touch sensor on the right end of the controller. Other variations are clear to one skilled in the art and are provided for by the invention.
  • In a competitive fighting video game, one region of the HDTP can control the arm motions while another region of the HDTP can control the leg motions. Variations on the users' touch can simulate complex punches or kicks. Also, making selections in menus or switching between different modes can be done easily with rolling, pitching, or rotating fingers. Other variations are clear to one skilled in the art and are provided for by the invention. Further, a contiguous touch sensor region can be partitioned into multiple parts, as described in pending U.S. patent application U.S. Ser. No. 12/418,605.
  • In a music game or application, different parts of the HDTP can control different instruments: for example, left hand can play the drums, and right hand can play the guitar. Other variations are clear to one skilled in the art and are provided for by the invention.
  • In another embodiment, the controller can be composed of a plurality of distinct portions or modules—for example left, center, and right modules—and one or more such portions or modules can be replaced with a module that is longer, shaped differently, or has other variations or differences—for example as may be particularly suited to a particular mode or action of play. Just as the replica guitar used in RockBand™, a module that is longer to replicate frets on a guitar can be used to provide experience that is similar to playing an actual guitar. Other variations are clear to one skilled in the art and are provided for by the invention.
  • Combinations of parameters can also improve the user experience in construction and management simulation games by providing easier way of making selections in menus or switching between different modes.
  • With a built-in camera for gesture recognition or machine vision, users can control the object in the game, while the camera detects the user behavior which can be another input for the game.
  • In an embodiment, the invention uses HDTP functions to implement multi-dimensional extensions to hypermedia objects including hyperlinks and rollovers (for example as taught in pending U.S. patent application Ser. No. 13/026,248).
  • Additional Exemplary Aspects and Applications of the Invention
  • Additional exemplary aspects and applications of the present invention provide for embodiments to be configured as one or more of the following:
      • a standalone device, a portable game/media player limited but moderate capacity of processor and memory;
      • a portable game/media player connected to the network;
      • a game controller connected to the main console with wired connections, which can be connected to the network;
      • a game controller connected to the main console with wireless connections, which can be connected to the network;
      • a game controller directly connected to the network where a main console is connected to;
      • a game controller directed connected to the network for cloud computing network service.
  • In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
      • a game controller device that connects to a game console via wireless connections;
      • a game controller device that connects to a game console via wired connections;
      • an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
      • a controller for a game console connected remotely through the internet;
      • a storage device/media player that can store gaming history, personal information, or media files.
  • In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
      • a game controller device that connects to a game console via wireless connections;
      • a game controller device that connects to a game console via wired connections;
      • an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
      • a controller for a game console connected remotely through the internet.
  • In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
      • a game controller device that connects to a game console via wireless connections;
      • a game controller device that connects to a game console via wired connections;
      • an independent portable/mobile game device with limited but sufficient capacity of processor/memory.
  • In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
      • an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
      • a storage device/media player that can store gaming history, personal information, or media files.
  • The terms “certain embodiments”, “an embodiment”, “embodiment”, “embodiments”, “the embodiment”, “the embodiments”, “one or more embodiments”, “some embodiments”, and “one embodiment” mean one or more (but not all) embodiments unless expressly specified otherwise. The terms “including”, “comprising”, “having” and variations thereof mean “including but not limited to”, unless expressly specified otherwise. The enumerated listing of items does not imply that any or all of the items are mutually exclusive, unless expressly specified otherwise. The terms “a”, “an” and “the” mean “one or more”, unless expressly specified otherwise.
  • While the invention has been described in detail with reference to disclosed embodiments, various modifications within the scope of the invention will be apparent to those of ordinary skill in this technological field. It is to be appreciated that features described with respect to one embodiment typically can be applied to other embodiments.
  • The invention can be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
  • Although exemplary embodiments have been provided in detail, various changes, substitutions and alternations could be made thereto without departing from spirit and scope of the disclosed subject matter as defined by the appended claims. Variations described for the embodiments may be realized in any combination desirable for each particular application. Thus particular limitations and embodiment enhancements described herein, which may have particular advantages to a particular application, need not be used for all applications. Also, not all limitations need be implemented in methods, systems, and apparatuses including one or more concepts described with relation to the provided embodiments. Therefore, the invention properly is to be construed with reference to the claims.

Claims (20)

1. A multiple-function device for use as at least a game controller, the device comprising:
at least one processor for executing at least one algorithm, the algorithm including at least a game;
at least one touch sensor providing real-time tactile information to at least one algorithm, the algorithm implementing at least one HDTP function, and
at least one networking element configured to network the device to at least a game console,
wherein the device can selectively function, as desired by the user, as one or more of: a game controller that connects to a game console via network connections; an independent portable/mobile game device with limited but sufficient capacity of processor/memory; a controller for a game console connected remotely through the internet; a storage device/media player that can store gaming history, personal information, or media files.
2. The device of claim 1 wherein the at least one touch sensor comprises a capacitive sensor.
3. The device of claim 1 wherein the at least one touch sensor comprises a OLED array.
4. The device of claim 1 wherein the at least one HDTP function includes measurement of a roll angle.
5. The device of claim 1 wherein the at least one HDTP function includes measurement of a pitch angle.
6. The device of claim 1 wherein the at least one HDTP function includes measurement of a yaw angle.
7. The device of claim 1 wherein the at least one HDTP function includes a multidimensional hypermedia object.
8. The device of claim 1 wherein the at least one HDTP function includes a multidimensional hyperlink.
9. The device of claim 1 wherein the networking element is further configured to network with a WiFi network.
10. The device of claim 1 wherein the device is further configured to network with the internet.
11. A multiple-function device for use as at least a game controller, the device comprising:
at least one processor for executing at least one algorithm, the algorithm including at least a game;
at least one touch sensor providing real-time tactile information to at least one algorithm, the algorithm implementing at least on HDTP function, and
at least one networking element configured to network the device to at least the internet
wherein the device can selectively function, as desired by the user, as one or more of: a game controller that connects to a game console via network connections; an independent portable/mobile game device with limited but sufficient capacity of processor/memory; a controller for a game console connected remotely through the internet; a storage device/media player that can store gaming history, personal information, or media files.
12. The device of claim 11 wherein the at least one touch sensor comprises a capacitive sensor.
13. The device of claim 11 wherein the at least one touch sensor comprises a OLED array.
14. The device of claim 11 wherein the at least one HDTP function includes measurement of a roll angle.
15. The device of claim 1 wherein the at least one HDTP function includes measurement of a pitch angle.
16. The device of claim 11 wherein the at least one HDTP function includes measurement of a yaw angle.
17. The device of claim 11 wherein the at least one HDTP function includes a multidimensional hypermedia object.
18. The device of claim 11 wherein the at least one HDTP function includes a multidimensional hyperlink.
19. The device of claim 11 wherein the networking element is further configured to network with a WiFi network.
20. The device of claim 11 wherein the device is further configured to network with a game console.
US13/198,691 2010-08-05 2011-08-04 High-dimensional touchpad game controller with multiple usage and networking modalities Expired - Fee Related US9950256B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/198,691 US9950256B2 (en) 2010-08-05 2011-08-04 High-dimensional touchpad game controller with multiple usage and networking modalities
US15/926,727 US20180207526A1 (en) 2010-08-05 2018-03-20 High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US37115310P 2010-08-05 2010-08-05
US13/198,691 US9950256B2 (en) 2010-08-05 2011-08-04 High-dimensional touchpad game controller with multiple usage and networking modalities

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/926,727 Continuation US20180207526A1 (en) 2010-08-05 2018-03-20 High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities

Publications (2)

Publication Number Publication Date
US20120034978A1 true US20120034978A1 (en) 2012-02-09
US9950256B2 US9950256B2 (en) 2018-04-24

Family

ID=45556532

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/198,691 Expired - Fee Related US9950256B2 (en) 2010-08-05 2011-08-04 High-dimensional touchpad game controller with multiple usage and networking modalities
US15/926,727 Abandoned US20180207526A1 (en) 2010-08-05 2018-03-20 High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities

Family Applications After (1)

Application Number Title Priority Date Filing Date
US15/926,727 Abandoned US20180207526A1 (en) 2010-08-05 2018-03-20 High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities

Country Status (1)

Country Link
US (2) US9950256B2 (en)

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120274596A1 (en) * 2011-07-11 2012-11-01 Ludwig Lester F Use of organic light emitting diode (oled) displays as a high-resolution optical tactile sensor for high dimensional touchpad (hdtp) user interfaces
US8477111B2 (en) 2008-07-12 2013-07-02 Lester F. Ludwig Advanced touch control of interactive immersive imaging applications via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8509542B2 (en) 2009-03-14 2013-08-13 Lester F. Ludwig High-performance closed-form single-scan calculation of oblong-shape rotation angles from binary images of arbitrary size and location using running sums
US8604364B2 (en) 2008-08-15 2013-12-10 Lester F. Ludwig Sensors, algorithms and applications for a high dimensional touchpad
US8702513B2 (en) 2008-07-12 2014-04-22 Lester F. Ludwig Control of the operating system on a computing device via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8717303B2 (en) 1998-05-15 2014-05-06 Lester F. Ludwig Sensor array touchscreen recognizing finger flick gesture and other touch gestures
US20140139443A1 (en) * 2012-11-19 2014-05-22 Htc Corporation Touch Sensing Method and Portable Electronic Apparatus
CN103823584A (en) * 2012-11-19 2014-05-28 宏达国际电子股份有限公司 Touch sensing method and portable electronic device
US8754862B2 (en) 2010-07-11 2014-06-17 Lester F. Ludwig Sequential classification recognition of gesture primitives and window-based parameter smoothing for high dimensional touchpad (HDTP) user interfaces
US8797288B2 (en) 2011-03-07 2014-08-05 Lester F. Ludwig Human user interfaces utilizing interruption of the execution of a first recognized gesture with the execution of a recognized second gesture
US8826114B2 (en) 2009-09-02 2014-09-02 Lester F. Ludwig Surface-curve graphical intersection tools and primitives for data visualization, tabular data, and advanced spreadsheets
US20150105152A1 (en) * 2013-10-11 2015-04-16 Valve Corporation Game controller systems and methods
US9019237B2 (en) 2008-04-06 2015-04-28 Lester F. Ludwig Multitouch parameter and gesture user interface employing an LED-array tactile sensor that can also operate as a display
US9052772B2 (en) 2011-08-10 2015-06-09 Lester F. Ludwig Heuristics for 3D and 6D touch gesture touch parameter calculations for high-dimensional touch parameter (HDTP) user interfaces
US9605881B2 (en) 2011-02-16 2017-03-28 Lester F. Ludwig Hierarchical multiple-level control of adaptive cooling and energy harvesting arrangements for information technology
US9626023B2 (en) 2010-07-09 2017-04-18 Lester F. Ludwig LED/OLED array approach to integrated display, lensless-camera, and touch-screen user interface devices and associated processors
US9632344B2 (en) 2010-07-09 2017-04-25 Lester F. Ludwig Use of LED or OLED array to implement integrated combinations of touch screen tactile, touch gesture sensor, color image display, hand-image gesture sensor, document scanner, secure optical data exchange, and fingerprint processing capabilities
US9782673B2 (en) * 2013-01-31 2017-10-10 Gree, Inc. Terminal display control method, terminal display system and server apparatus
US9823781B2 (en) 2011-12-06 2017-11-21 Nri R&D Patent Licensing, Llc Heterogeneous tactile sensing via multiple sensor types
US9830042B2 (en) 2010-02-12 2017-11-28 Nri R&D Patent Licensing, Llc Enhanced roll-over, button, menu, slider, and hyperlink environments for high dimensional touchpad (HTPD), other advanced touch user interfaces, and advanced mice
US20180011529A1 (en) * 2012-05-23 2018-01-11 Kabushiki Kaisha Square Enix (Also Trading As Squa Re Enix Co., Ltd.) Information processing apparatus, method for information processing, and game apparatus
US9904463B2 (en) * 2014-09-23 2018-02-27 Sulake Corporation Oy Method and apparatus for controlling user character for playing game within virtual environment
US9950256B2 (en) 2010-08-05 2018-04-24 Nri R&D Patent Licensing, Llc High-dimensional touchpad game controller with multiple usage and networking modalities
JP2018152042A (en) * 2017-03-13 2018-09-27 ウィキパッド,インコーポレーテッド Game controller with flexible bridge supporting touch screen
US10146427B2 (en) 2010-03-01 2018-12-04 Nri R&D Patent Licensing, Llc Curve-fitting approach to high definition touch pad (HDTP) parameter extraction
US10258876B2 (en) 2014-11-18 2019-04-16 Razer (Asia-Pacific) Pte. Ltd. Gaming controller for mobile device and method of operating a gaming controller
US10430066B2 (en) 2011-12-06 2019-10-01 Nri R&D Patent Licensing, Llc Gesteme (gesture primitive) recognition for advanced touch user interfaces
US11045723B1 (en) 2014-11-18 2021-06-29 Razer (Asia-Pacific) Pte. Ltd. Gaming controller for mobile device and method of operating a gaming controller
US11202960B2 (en) * 2017-01-25 2021-12-21 Kieran S. Lyden Game controller
US20230152761A1 (en) * 2020-04-15 2023-05-18 Rakuten Mobile, Inc. Autonomous network, controller and method
US11752432B2 (en) * 2017-09-15 2023-09-12 Sega Corporation Information processing device and method of causing computer to perform game program
US20230302356A1 (en) * 2013-03-15 2023-09-28 Steelseries Aps Gaming device with independent gesture-sensitive areas

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10391400B1 (en) 2016-10-11 2019-08-27 Valve Corporation Electronic controller with hand retainer and finger motion sensing
US10691233B2 (en) 2016-10-11 2020-06-23 Valve Corporation Sensor fusion algorithms for a handheld controller that includes a force sensing resistor (FSR)
US11185763B2 (en) 2016-10-11 2021-11-30 Valve Corporation Holding and releasing virtual objects
US10307669B2 (en) 2016-10-11 2019-06-04 Valve Corporation Electronic controller with finger sensing and an adjustable hand retainer
US11625898B2 (en) 2016-10-11 2023-04-11 Valve Corporation Holding and releasing virtual objects
US10888773B2 (en) 2016-10-11 2021-01-12 Valve Corporation Force sensing resistor (FSR) with polyimide substrate, systems, and methods thereof
USD908798S1 (en) 2018-05-18 2021-01-26 Valve Corporation Game controller
US10905946B2 (en) 2019-02-28 2021-02-02 Valve Corporation Continuous controller calibration
US11000759B2 (en) 2019-03-29 2021-05-11 Valve Corporation Game controller operable in bluetooth low energy (BLE) mode
US11033809B2 (en) 2019-05-07 2021-06-15 Valve Corporation Using finger presence to activate a motion control feature for a handheld controller
US11042247B2 (en) 2019-06-14 2021-06-22 Valve Corporation Cluster-based sensor assignment
US11458386B2 (en) * 2020-02-14 2022-10-04 Valve Corporation Controller with adjustable features
US11511186B2 (en) 2020-02-14 2022-11-29 Valve Corporation Controller with sensor-rich controls
US11638868B2 (en) 2020-02-14 2023-05-02 Valve Corporation Controller having display with selectable icons
US11504610B2 (en) 2020-02-14 2022-11-22 Valve Corporation Dynamically enabling or disabling controls of a controller
US11504615B1 (en) 2021-05-18 2022-11-22 Valve Corporation Electronic controller with linear hand strap adjuster
GB2615318A (en) * 2022-02-02 2023-08-09 Sony Interactive Entertainment Inc Method, device, and system of input for a videogame console

Citations (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6005545A (en) * 1995-01-17 1999-12-21 Sega Enterprise, Ltd. Image processing method and electronic device
US6225975B1 (en) * 1997-03-18 2001-05-01 Alps Electric Co., Ltd. Control device for game machine
US20040021681A1 (en) * 2002-07-30 2004-02-05 Liao Chin-Hua Arthur Dual-touch-screen mobile computer
US6921336B1 (en) * 2001-05-10 2005-07-26 Robert M. Best Linked electronic game systems
US20060084504A1 (en) * 2004-04-30 2006-04-20 Chan Andy K Wireless communication systems
US20060252530A1 (en) * 2003-01-08 2006-11-09 Igt Mobile device for providing filtered casino information based on real time data
US20070229477A1 (en) * 1998-05-15 2007-10-04 Ludwig Lester F High parameter-count touchpad controller
US20080012828A1 (en) * 2005-05-09 2008-01-17 Sandio Technology Corp. Multi-dimensional input device
US7371163B1 (en) * 2001-05-10 2008-05-13 Best Robert M 3D portable game system
US20090213081A1 (en) * 2007-01-10 2009-08-27 Case Jr Charlie W Portable Electronic Device Touchpad Input Controller
US7611409B2 (en) * 2001-09-20 2009-11-03 Igt Method and apparatus for registering a mobile device with a gaming machine
US20100041480A1 (en) * 2008-08-12 2010-02-18 Sony Corporation Universal game console controller
US20100087241A1 (en) * 2008-10-02 2010-04-08 Igt Gaming System with Mobile User Input Device
US20100231612A1 (en) * 2009-03-16 2010-09-16 Imran Chaudhri Smart Keyboard Management for a Multifunction Device with a Touch Screen Display
US20100279769A1 (en) * 2009-04-13 2010-11-04 Chira Kidakam Game controller with display screen
US20100279773A1 (en) * 2007-11-15 2010-11-04 Ergowerx Llc Motorized Game Controller
US20110086706A1 (en) * 2009-10-14 2011-04-14 Sony Computer Entertainment America Playing Browser Based Games with Alternative Controls and Interfaces
US20120011438A1 (en) * 2010-07-12 2012-01-12 Lg Electronics Inc. Mobile terminal and controlling method thereof
US20120108323A1 (en) * 2005-09-07 2012-05-03 Bally Gaming, Inc. System gaming
US8414373B2 (en) * 2006-05-19 2013-04-09 Wms Gaming Inc. Wagering game machine with wireless peripherals
US8502790B2 (en) * 2010-03-30 2013-08-06 Robert Osann, Jr. Touchpad with reverse-mounted buttons
US8500558B2 (en) * 2005-08-19 2013-08-06 Nintendo Of America Inc. Enhanced method and apparatus for selecting and rendering performance data
US8665218B2 (en) * 2010-02-11 2014-03-04 Asustek Computer Inc. Portable device
US8698764B1 (en) * 2010-06-30 2014-04-15 Amazon Technologies, Inc. Dorsal touch input
US8795083B2 (en) * 2005-05-06 2014-08-05 Nintendo Co., Ltd. Communication game system, game apparatus, server, storage medium storing a program, and game control method
US9019237B2 (en) * 2008-04-06 2015-04-28 Lester F. Ludwig Multitouch parameter and gesture user interface employing an LED-array tactile sensor that can also operate as a display

Family Cites Families (147)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1947020A (en) 1931-05-29 1934-02-13 Ranger Richard Howland Electrical music system
US3493669A (en) 1965-12-03 1970-02-03 Baldwin Co D H Output systems for electric guitars and the like
US3591699A (en) 1968-03-28 1971-07-06 Royce L Cutler Music voicing circuit deriving an input from a conventional musical instrument and providing voiced musical tones utilizing the fundamental tones from the conventional musical instrument
US3612741A (en) 1969-12-04 1971-10-12 Fred C Marshall Electronic musical instrument employing mechanical resonators with regenerative effects
US3651242A (en) 1970-06-15 1972-03-21 Columbia Broadcasting Syst Inc Octave jumper for musical instruments
US4365533A (en) 1971-06-01 1982-12-28 Melville Clark, Jr. Musical instrument
US3742133A (en) 1971-09-15 1973-06-26 Seaboard Sys Inc Monitoring system
US3730046A (en) 1972-02-14 1973-05-01 L Spence Orally operated electronic musical instrument
US3805091A (en) 1972-06-15 1974-04-16 Arp Instr Frequency sensitive circuit employing variable transconductance circuit
US3813473A (en) 1972-10-27 1974-05-28 Investments Ltd Electric guitar system
US3962945A (en) 1973-06-22 1976-06-15 Wade E. Creager Foot actuated electronic organ
US3878748A (en) 1974-03-21 1975-04-22 Larry A Spence Oral cavity controlled electronic musical instrument
JPS513736Y1 (en) 1974-04-30 1976-02-03
GB1548285A (en) 1975-07-14 1979-07-11 Heet G S String instrument vipration initiator and sustainer
DE2535344C2 (en) 1975-08-07 1985-10-03 CMB Colonia Management- und Beratungsgesellschaft mbH & Co KG, 5000 Köln Device for the electronic generation of sound signals
US4080867A (en) 1975-09-22 1978-03-28 Srinkarn Ratanangsu Electronic display system for musical instruments
US4122742A (en) 1976-08-03 1978-10-31 Deutsch Research Laboratories, Ltd. Transient voice generator
US4117413A (en) 1977-06-21 1978-09-26 Norlin Music, Inc. Amplifier with multifilter
US4182213A (en) 1978-05-03 1980-01-08 Iodice Robert M Coil less magnetic pickup for stringed instrument
US4274321A (en) 1979-07-30 1981-06-23 Jerome Swartz Harmony authorization detector synthesizer
US4318327A (en) 1980-07-10 1982-03-09 Toups Daniel J Digital chord display for stringed musical instruments
JPS5871797U (en) 1981-11-10 1983-05-16 ヤマハ株式会社 electronic musical instruments
JPS62267610A (en) 1986-05-16 1987-11-20 Fuji Electric Co Ltd Detecting system for rotational angle of object pattern
US4794838A (en) 1986-07-17 1989-01-03 Corrigau Iii James F Constantly changing polyphonic pitch controller
US4852444A (en) 1986-12-04 1989-08-01 Hoover Alan A Electro-mechanical transducer which couples positive acoustic feedback into an electric amplified guitar body for the purpose of sustaining played notes
US5146833A (en) 1987-04-30 1992-09-15 Lui Philip Y F Computerized music data system and input/out devices using related rhythm coding
US4797608A (en) 1987-08-13 1989-01-10 Digital Equipment Corporation D.C. power monitor
US5159140A (en) 1987-09-11 1992-10-27 Yamaha Corporation Acoustic control apparatus for controlling musical tones based upon visual images
DE3732519A1 (en) 1987-09-26 1989-04-06 Olympia Aeg ARRANGEMENT FOR ENTERING AND PROCESSING CHARACTERS AND / OR GRAPHIC PATTERNS
CA1298997C (en) 1988-05-11 1992-04-21 Asaf Gurner Optical instrument for producing musical tones or images by movement of a player's body
US5233123A (en) 1988-05-27 1993-08-03 Rose Floyd D Musical instruments equipped with sustainers
US4991488A (en) 1988-08-12 1991-02-12 Fala Joseph M Acoustic detection of note bending in stringed M.I.D.I. compatible musical instruments
US5033352A (en) 1989-01-19 1991-07-23 Yamaha Corporation Electronic musical instrument with frequency modulation
GB2232251A (en) 1989-05-08 1990-12-05 Philips Electronic Associated Touch sensor array systems
US5237647A (en) 1989-09-15 1993-08-17 Massachusetts Institute Of Technology Computer aided drawing in three dimensions
US5070399A (en) 1990-02-01 1991-12-03 Alain Martel Light color and intensity modulation system
US5262585A (en) 1990-10-31 1993-11-16 Lenny Greene Electronic cymbal system
US5471008A (en) 1990-11-19 1995-11-28 Kabushiki Kaisha Kawai Gakki Seisakusho MIDI control apparatus
CH682355A5 (en) 1991-02-28 1993-08-31 Matthias Grob Da Veiga
US5341133A (en) 1991-05-09 1994-08-23 The Rowland Institute For Science, Inc. Keyboard having touch sensor keys for conveying information electronically
JP3233659B2 (en) 1991-08-14 2001-11-26 株式会社フェルナンデス Electric stringed musical instrument with string vibration sustaining device
US5442168A (en) 1991-10-15 1995-08-15 Interactive Light, Inc. Dynamically-activated optical instrument for producing control signals having a self-calibration means
US5475214A (en) 1991-10-15 1995-12-12 Interactive Light, Inc. Musical sound effects controller having a radiated emission space
JPH0769767B2 (en) 1991-10-16 1995-07-31 インターナショナル・ビジネス・マシーンズ・コーポレイション Touch overlay for detecting finger touch or stylus position, and detection system
CA2081246A1 (en) 1991-10-24 1993-04-25 Kenji Tumura Electric stringed instrument having a device for sustaining the vibration of a string and an electromagnetic driver for the device
US5335557A (en) 1991-11-26 1994-08-09 Taizo Yasutake Touch sensitive input control device
JPH0627963A (en) 1992-01-14 1994-02-04 Fuerunandesu:Kk Electronic stringed instrument
US5281754A (en) 1992-04-13 1994-01-25 International Business Machines Corporation Melody composer and arranger
EP0574213B1 (en) 1992-06-08 1999-03-24 Synaptics, Inc. Object position detector
US5880411A (en) 1992-06-08 1999-03-09 Synaptics, Incorporated Object position detector with edge motion feature and gesture recognition
US5889236A (en) 1992-06-08 1999-03-30 Synaptics Incorporated Pressure sensitive scrollbar feature
US5440072A (en) 1992-09-25 1995-08-08 Willis; Raymon A. System for rejuvenating vintage organs and pianos
US5459282A (en) 1992-09-25 1995-10-17 Willis; Raymon A. System for rejuvenating vintage organs and pianos
US5357048A (en) 1992-10-08 1994-10-18 Sgroi John J MIDI sound designer with randomizer function
EP0593386A3 (en) 1992-10-16 1996-07-31 Ibm Method and apparatus for accessing touch screen desktop objects via fingerprint recognition
US5563632A (en) 1993-04-30 1996-10-08 Microtouch Systems, Inc. Method of and apparatus for the elimination of the effects of internal interference in force measurement systems, including touch - input computer and related displays employing touch force location measurement techniques
US5592752A (en) 1993-05-13 1997-01-14 Industrial Technology Research Institute Process and an apparatus for producing teas
US5665927A (en) 1993-06-30 1997-09-09 Casio Computer Co., Ltd. Method and apparatus for inputting musical data without requiring selection of a displayed icon
US5675100A (en) 1993-11-03 1997-10-07 Hewlett; Walter B. Method for encoding music printing information in a MIDI message
US5592572A (en) 1993-11-05 1997-01-07 The United States Of America As Represented By The Department Of Health And Human Services Automated portrait/landscape mode detection on a binary image
US5841428A (en) 1993-11-05 1998-11-24 Intertactile Technologies Corporation Rotary circuit control devices with changeable graphics
US5748763A (en) 1993-11-18 1998-05-05 Digimarc Corporation Image steganography system featuring perceptually adaptive and globally scalable signal embedding
US5565641A (en) 1994-03-28 1996-10-15 Gruenbaum; Leon Relativistic electronic musical instrument
US5668338A (en) 1994-11-02 1997-09-16 Advanced Micro Devices, Inc. Wavetable audio synthesizer with low frequency oscillators for tremolo and vibrato effects
US5659466A (en) 1994-11-02 1997-08-19 Advanced Micro Devices, Inc. Monolithic PC audio circuit with enhanced digital wavetable audio synthesizer
US6047073A (en) 1994-11-02 2000-04-04 Advanced Micro Devices, Inc. Digital wavetable audio synthesizer with delay-based effects processing
JP3129380B2 (en) 1994-12-07 2001-01-29 ヤマハ株式会社 Electronic musical instrument keyboard device
US5932827A (en) 1995-01-09 1999-08-03 Osborne; Gary T. Sustainer for a musical instrument
US5591945A (en) 1995-04-19 1997-01-07 Elo Touchsystems, Inc. Acoustic touch position sensor using higher order horizontally polarized shear wave propagation
US5659145A (en) 1995-04-27 1997-08-19 Weil; Robert P. Foot operated audio signal controller with lighted visual reference
JP3552366B2 (en) 1995-06-09 2004-08-11 ヤマハ株式会社 Music control device
US5801340A (en) 1995-06-29 1998-09-01 Invotronics Manufacturing Proximity sensor
JPH0944150A (en) 1995-08-01 1997-02-14 Kawai Musical Instr Mfg Co Ltd Electronic keyboard musical instrument
US5719561A (en) 1995-10-25 1998-02-17 Gilbert R. Gonzales Tactile communication device and method
US6107997A (en) 1996-06-27 2000-08-22 Ure; Michael J. Touch-sensitive keyboard/mouse and computing device using the same
US5786540A (en) 1996-03-05 1998-07-28 Westlund; Robert L. Controller apparatus for music sequencer
US6215910B1 (en) 1996-03-28 2001-04-10 Microsoft Corporation Table-based compression with embedded coding
US5748184A (en) 1996-05-28 1998-05-05 International Business Machines Corporation Virtual pointing device for touchscreens
JP3666129B2 (en) 1996-07-11 2005-06-29 ヤマハ株式会社 Force control device of the operator
US5763806A (en) 1996-07-15 1998-06-09 Willis; Raymon A. Method and apparatus for midifying vintage organs and pianos
US5850051A (en) 1996-08-15 1998-12-15 Yamaha Corporation Method and apparatus for creating an automatic accompaniment pattern on the basis of analytic parameters
US6728775B1 (en) 1997-03-17 2004-04-27 Microsoft Corporation Multiple multicasting of multimedia streams
GB9708464D0 (en) 1997-04-25 1997-06-18 Raychem Ltd Converter for resistive touchscreens
US5827989A (en) 1997-06-23 1998-10-27 Microsoft Corporation System and method for representing a musical event and for converting the musical event into a series of discrete events
US5852251A (en) 1997-06-25 1998-12-22 Industrial Technology Research Institute Method and apparatus for real-time dynamic midi control
US6335770B1 (en) 1997-07-22 2002-01-01 Lg. Philips Lcd Co., Ltd. In-plane switching mode LCD with specific arrangement of common bus line, data electrode, and common electrode
US6037937A (en) 1997-12-04 2000-03-14 Nortel Networks Corporation Navigation tool for graphical user interface
US6310610B1 (en) 1997-12-04 2001-10-30 Nortel Networks Limited Intelligent touch display
JP3419290B2 (en) 1997-12-27 2003-06-23 ヤマハ株式会社 Tone / image generator and storage medium
US6408087B1 (en) 1998-01-13 2002-06-18 Stmicroelectronics, Inc. Capacitive semiconductor user input device
US6392636B1 (en) 1998-01-22 2002-05-21 Stmicroelectronics, Inc. Touchpad providing screen cursor/pointer movement control
EP1717684A3 (en) 1998-01-26 2008-01-23 Fingerworks, Inc. Method and apparatus for integrating manual input
JPH11296166A (en) 1998-04-09 1999-10-29 Yamaha Corp Note display method, medium recording note display program, beat display method and medium recording beat display program
US6400836B2 (en) 1998-05-15 2002-06-04 International Business Machines Corporation Combined fingerprint acquisition and control device
US6288317B1 (en) 1998-05-29 2001-09-11 Raymon A. Willis Real time transmission of keyboard musical performance
US6140565A (en) 1998-06-08 2000-10-31 Yamaha Corporation Method of visualizing music system by combination of scenery picture and player icons
US6100461A (en) 1998-06-10 2000-08-08 Advanced Micro Devices, Inc. Wavetable cache using simplified looping
US5969283A (en) 1998-06-17 1999-10-19 Looney Productions, Llc Music organizer and entertainment center
US6051769A (en) 1998-11-25 2000-04-18 Brown, Jr.; Donival Computerized reading display
US6793619B1 (en) 1999-06-09 2004-09-21 Yaacov Blumental Computer-implemented method and system for giving a user an impression of tactile feedback
US7030860B1 (en) 1999-10-08 2006-04-18 Synaptics Incorporated Flexible transparent touch sensing system for electronic devices
EP1156610A3 (en) 2000-05-19 2005-01-26 Martin Lotze Method and system for automatic selection of musical compositions and/or sound recordings
US6703552B2 (en) 2001-07-19 2004-03-09 Lippold Haken Continuous music keyboard
DE10146996A1 (en) 2001-09-25 2003-04-30 Gerd Reime Circuit with an opto-electronic display content
KR100540399B1 (en) 2003-05-23 2006-01-10 주식회사 옵투스 Multi-campaign assignment apparatus considering overlapping recommendation problem
US7961909B2 (en) 2006-03-08 2011-06-14 Electronic Scripting Products, Inc. Computer interface employing a manipulated object with absolute pose detection component and a display
US7620915B2 (en) 2004-02-13 2009-11-17 Ludwig Lester F Electronic document editing employing multiple cursors
FR2869723A1 (en) 2004-04-29 2005-11-04 Thomson Licensing Sa NON-CONTACT TRANSITION ELEMENT BETWEEN A WAVEGUIDE AND A MOCRORUBAN LINE
US7598949B2 (en) 2004-10-22 2009-10-06 New York University Multi-touch sensing light emitting diode display and method for using the same
KR20070033532A (en) 2005-09-21 2007-03-27 삼성전자주식회사 Touch sensible display device and driving apparatus therefor and method of processing sensing signals
US7864160B2 (en) 2005-10-05 2011-01-04 3M Innovative Properties Company Interleaved electrodes for touch sensing
US7969418B2 (en) 2006-11-30 2011-06-28 Cherif Atia Algreatly 3-D computer input device and method
US8139045B2 (en) 2006-12-15 2012-03-20 Lg Display Co., Ltd. Display device having multi-touch recognizing function and driving method thereof
US8125455B2 (en) 2007-01-03 2012-02-28 Apple Inc. Full scale calibration measurement for multi-touch surfaces
US7639234B2 (en) 2007-01-04 2009-12-29 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Capacitive sensing and absolute position mapping in displacement type pointing devices
US8144129B2 (en) 2007-01-05 2012-03-27 Apple Inc. Flexible touch sensing circuits
US8115753B2 (en) 2007-04-11 2012-02-14 Next Holdings Limited Touch screen system with hover and click input methods
US9317110B2 (en) 2007-05-29 2016-04-19 Cfph, Llc Game with hand motion control
US7835999B2 (en) 2007-06-27 2010-11-16 Microsoft Corporation Recognizing input gestures using a multi-touch input device, calculated graphs, and a neural network with link weights
US20090124348A1 (en) 2007-11-09 2009-05-14 Yoseloff Mark L Electronic dice control in gaming
JP2009140368A (en) 2007-12-07 2009-06-25 Sony Corp Input device, display device, input method, display method, and program
US9170649B2 (en) 2007-12-28 2015-10-27 Nokia Technologies Oy Audio and tactile feedback based on visual environment
US9870629B2 (en) 2008-06-20 2018-01-16 New Bis Safe Luxco S.À R.L Methods, apparatus and systems for data visualization and related applications
US8345014B2 (en) 2008-07-12 2013-01-01 Lester F. Ludwig Control of the operating system on a computing device via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8169414B2 (en) 2008-07-12 2012-05-01 Lim Seung E Control of electronic games via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8604364B2 (en) 2008-08-15 2013-12-10 Lester F. Ludwig Sensors, algorithms and applications for a high dimensional touchpad
US20100079385A1 (en) 2008-09-29 2010-04-01 Smart Technologies Ulc Method for calibrating an interactive input system and interactive input system executing the calibration method
US9104311B2 (en) 2008-10-09 2015-08-11 Lenovo (Singapore) Pte. Ltd. Slate computer with tactile home keys
JP4766101B2 (en) 2008-11-10 2011-09-07 ソニー株式会社 Tactile behavior recognition device, tactile behavior recognition method, information processing device, and computer program
US20100177118A1 (en) 2009-01-09 2010-07-15 Sytnikov Vadim Vasilievich Path creation utility for image editor
US8170346B2 (en) 2009-03-14 2012-05-01 Ludwig Lester F High-performance closed-form single-scan calculation of oblong-shape rotation angles from binary images of arbitrary size using running sums
US8154529B2 (en) 2009-05-14 2012-04-10 Atmel Corporation Two-dimensional touch sensors
US8836648B2 (en) 2009-05-27 2014-09-16 Microsoft Corporation Touch pull-in gesture
US8217912B2 (en) 2009-06-17 2012-07-10 Broadcom Corporation Graphical authentication for a portable device and methods for use therewith
US20100328032A1 (en) 2009-06-24 2010-12-30 Broadcom Corporation Security for computing unit with femtocell ap functionality
US8179376B2 (en) 2009-08-27 2012-05-15 Research In Motion Limited Touch-sensitive display with capacitive and resistive touch sensors and method of control
US20110285648A1 (en) 2010-01-22 2011-11-24 Lester Ludwig Use of fingerprint scanning sensor data to detect finger roll and pitch angles
US20110202934A1 (en) 2010-02-12 2011-08-18 Ludwig Lester F Window manger input focus control for high dimensional touchpad (htpd), advanced mice, and other multidimensional user interfaces
US20120056846A1 (en) 2010-03-01 2012-03-08 Lester F. Ludwig Touch-based user interfaces employing artificial neural networks for hdtp parameter and symbol derivation
US8686960B2 (en) 2010-04-23 2014-04-01 Lester F. Ludwig Piecewise-linear and piecewise-affine transformations for high dimensional touchpad (HDTP) output decoupling and corrections
US8754862B2 (en) 2010-07-11 2014-06-17 Lester F. Ludwig Sequential classification recognition of gesture primitives and window-based parameter smoothing for high dimensional touchpad (HDTP) user interfaces
US9950256B2 (en) 2010-08-05 2018-04-24 Nri R&D Patent Licensing, Llc High-dimensional touchpad game controller with multiple usage and networking modalities
US20120192119A1 (en) 2011-01-24 2012-07-26 Lester F. Ludwig Usb hid device abstraction for hdtp user interfaces
US9442652B2 (en) 2011-03-07 2016-09-13 Lester F. Ludwig General user interface gesture lexicon and grammar frameworks for multi-touch, high dimensional touch pad (HDTP), free-space camera, and other user interfaces
US20120280927A1 (en) 2011-05-04 2012-11-08 Ludwig Lester F Simple touch interface and hdtp grammars for rapid operation of physical computer aided design (cad) systems
US20130009896A1 (en) 2011-07-09 2013-01-10 Lester F. Ludwig 3d finger posture detection and gesture recognition on touch surfaces
US9052772B2 (en) 2011-08-10 2015-06-09 Lester F. Ludwig Heuristics for 3D and 6D touch gesture touch parameter calculations for high-dimensional touch parameter (HDTP) user interfaces

Patent Citations (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6005545A (en) * 1995-01-17 1999-12-21 Sega Enterprise, Ltd. Image processing method and electronic device
US6225975B1 (en) * 1997-03-18 2001-05-01 Alps Electric Co., Ltd. Control device for game machine
US20070229477A1 (en) * 1998-05-15 2007-10-04 Ludwig Lester F High parameter-count touchpad controller
US6921336B1 (en) * 2001-05-10 2005-07-26 Robert M. Best Linked electronic game systems
US7371163B1 (en) * 2001-05-10 2008-05-13 Best Robert M 3D portable game system
US7611409B2 (en) * 2001-09-20 2009-11-03 Igt Method and apparatus for registering a mobile device with a gaming machine
US20040021681A1 (en) * 2002-07-30 2004-02-05 Liao Chin-Hua Arthur Dual-touch-screen mobile computer
US20060252530A1 (en) * 2003-01-08 2006-11-09 Igt Mobile device for providing filtered casino information based on real time data
US20060084504A1 (en) * 2004-04-30 2006-04-20 Chan Andy K Wireless communication systems
US8795083B2 (en) * 2005-05-06 2014-08-05 Nintendo Co., Ltd. Communication game system, game apparatus, server, storage medium storing a program, and game control method
US20080012828A1 (en) * 2005-05-09 2008-01-17 Sandio Technology Corp. Multi-dimensional input device
US8500558B2 (en) * 2005-08-19 2013-08-06 Nintendo Of America Inc. Enhanced method and apparatus for selecting and rendering performance data
US20120108323A1 (en) * 2005-09-07 2012-05-03 Bally Gaming, Inc. System gaming
US8414373B2 (en) * 2006-05-19 2013-04-09 Wms Gaming Inc. Wagering game machine with wireless peripherals
US20090213081A1 (en) * 2007-01-10 2009-08-27 Case Jr Charlie W Portable Electronic Device Touchpad Input Controller
US20100279773A1 (en) * 2007-11-15 2010-11-04 Ergowerx Llc Motorized Game Controller
US9019237B2 (en) * 2008-04-06 2015-04-28 Lester F. Ludwig Multitouch parameter and gesture user interface employing an LED-array tactile sensor that can also operate as a display
US20100041480A1 (en) * 2008-08-12 2010-02-18 Sony Corporation Universal game console controller
US20100087241A1 (en) * 2008-10-02 2010-04-08 Igt Gaming System with Mobile User Input Device
US20100231612A1 (en) * 2009-03-16 2010-09-16 Imran Chaudhri Smart Keyboard Management for a Multifunction Device with a Touch Screen Display
US20100279769A1 (en) * 2009-04-13 2010-11-04 Chira Kidakam Game controller with display screen
US20110086706A1 (en) * 2009-10-14 2011-04-14 Sony Computer Entertainment America Playing Browser Based Games with Alternative Controls and Interfaces
US8665218B2 (en) * 2010-02-11 2014-03-04 Asustek Computer Inc. Portable device
US8502790B2 (en) * 2010-03-30 2013-08-06 Robert Osann, Jr. Touchpad with reverse-mounted buttons
US8698764B1 (en) * 2010-06-30 2014-04-15 Amazon Technologies, Inc. Dorsal touch input
US20120011438A1 (en) * 2010-07-12 2012-01-12 Lg Electronics Inc. Mobile terminal and controlling method thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Nintendo DS. Wikipedia.org. Online. 2010-05-28. Accessed via the Internet. Accessed 2016-03-21. <URL: http://wayback.archive.org/web/20100528090358/http://en.wikipedia.org/wiki/Nintendo_DS> *

Cited By (59)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8866785B2 (en) 1998-05-15 2014-10-21 Lester F. Ludwig Sensor array touchscreen recognizing finger flick gesture
US8717303B2 (en) 1998-05-15 2014-05-06 Lester F. Ludwig Sensor array touchscreen recognizing finger flick gesture and other touch gestures
US8743076B1 (en) 1998-05-15 2014-06-03 Lester F. Ludwig Sensor array touchscreen recognizing finger flick gesture from spatial pressure distribution profiles
US8743068B2 (en) 1998-05-15 2014-06-03 Lester F. Ludwig Touch screen method for recognizing a finger-flick touch gesture
US8878807B2 (en) 1998-05-15 2014-11-04 Lester F. Ludwig Gesture-based user interface employing video camera
US8878810B2 (en) 1998-05-15 2014-11-04 Lester F. Ludwig Touch screen supporting continuous grammar touch gestures
US9304677B2 (en) 1998-05-15 2016-04-05 Advanced Touchscreen And Gestures Technologies, Llc Touch screen apparatus for recognizing a touch gesture
US9019237B2 (en) 2008-04-06 2015-04-28 Lester F. Ludwig Multitouch parameter and gesture user interface employing an LED-array tactile sensor that can also operate as a display
US8643622B2 (en) 2008-07-12 2014-02-04 Lester F. Ludwig Advanced touch control of graphics design application via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8477111B2 (en) 2008-07-12 2013-07-02 Lester F. Ludwig Advanced touch control of interactive immersive imaging applications via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8894489B2 (en) 2008-07-12 2014-11-25 Lester F. Ludwig Touch user interface supporting global and context-specific touch gestures that are responsive to at least one finger angle
US8638312B2 (en) 2008-07-12 2014-01-28 Lester F. Ludwig Advanced touch control of a file browser via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8702513B2 (en) 2008-07-12 2014-04-22 Lester F. Ludwig Control of the operating system on a computing device via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8542209B2 (en) 2008-07-12 2013-09-24 Lester F. Ludwig Advanced touch control of interactive map viewing via finger angle using a high dimensional touchpad (HDTP) touch user interface
US8604364B2 (en) 2008-08-15 2013-12-10 Lester F. Ludwig Sensors, algorithms and applications for a high dimensional touchpad
US8509542B2 (en) 2009-03-14 2013-08-13 Lester F. Ludwig High-performance closed-form single-scan calculation of oblong-shape rotation angles from binary images of arbitrary size and location using running sums
US8639037B2 (en) 2009-03-14 2014-01-28 Lester F. Ludwig High-performance closed-form single-scan calculation of oblong-shape rotation angles from image data of arbitrary size and location using running sums
US8826114B2 (en) 2009-09-02 2014-09-02 Lester F. Ludwig Surface-curve graphical intersection tools and primitives for data visualization, tabular data, and advanced spreadsheets
US8826113B2 (en) 2009-09-02 2014-09-02 Lester F. Ludwig Surface-surface graphical intersection tools and primitives for data visualization, tabular data, and advanced spreadsheets
US9665554B2 (en) 2009-09-02 2017-05-30 Lester F. Ludwig Value-driven visualization primitives for tabular data of spreadsheets
US9830042B2 (en) 2010-02-12 2017-11-28 Nri R&D Patent Licensing, Llc Enhanced roll-over, button, menu, slider, and hyperlink environments for high dimensional touchpad (HTPD), other advanced touch user interfaces, and advanced mice
US10146427B2 (en) 2010-03-01 2018-12-04 Nri R&D Patent Licensing, Llc Curve-fitting approach to high definition touch pad (HDTP) parameter extraction
US9626023B2 (en) 2010-07-09 2017-04-18 Lester F. Ludwig LED/OLED array approach to integrated display, lensless-camera, and touch-screen user interface devices and associated processors
US9632344B2 (en) 2010-07-09 2017-04-25 Lester F. Ludwig Use of LED or OLED array to implement integrated combinations of touch screen tactile, touch gesture sensor, color image display, hand-image gesture sensor, document scanner, secure optical data exchange, and fingerprint processing capabilities
US8754862B2 (en) 2010-07-11 2014-06-17 Lester F. Ludwig Sequential classification recognition of gesture primitives and window-based parameter smoothing for high dimensional touchpad (HDTP) user interfaces
US9950256B2 (en) 2010-08-05 2018-04-24 Nri R&D Patent Licensing, Llc High-dimensional touchpad game controller with multiple usage and networking modalities
US9605881B2 (en) 2011-02-16 2017-03-28 Lester F. Ludwig Hierarchical multiple-level control of adaptive cooling and energy harvesting arrangements for information technology
US9442652B2 (en) 2011-03-07 2016-09-13 Lester F. Ludwig General user interface gesture lexicon and grammar frameworks for multi-touch, high dimensional touch pad (HDTP), free-space camera, and other user interfaces
US8797288B2 (en) 2011-03-07 2014-08-05 Lester F. Ludwig Human user interfaces utilizing interruption of the execution of a first recognized gesture with the execution of a recognized second gesture
US10073532B2 (en) 2011-03-07 2018-09-11 Nri R&D Patent Licensing, Llc General spatial-gesture grammar user interface for touchscreens, high dimensional touch pad (HDTP), free-space camera, and other user interfaces
US20120274596A1 (en) * 2011-07-11 2012-11-01 Ludwig Lester F Use of organic light emitting diode (oled) displays as a high-resolution optical tactile sensor for high dimensional touchpad (hdtp) user interfaces
US9052772B2 (en) 2011-08-10 2015-06-09 Lester F. Ludwig Heuristics for 3D and 6D touch gesture touch parameter calculations for high-dimensional touch parameter (HDTP) user interfaces
US10042479B2 (en) 2011-12-06 2018-08-07 Nri R&D Patent Licensing, Llc Heterogeneous tactile sensing via multiple sensor types using spatial information processing
US10430066B2 (en) 2011-12-06 2019-10-01 Nri R&D Patent Licensing, Llc Gesteme (gesture primitive) recognition for advanced touch user interfaces
US10429997B2 (en) 2011-12-06 2019-10-01 Nri R&D Patent Licensing, Llc Heterogeneous tactile sensing via multiple sensor types using spatial information processing acting on initial image processed data from each sensor
US9823781B2 (en) 2011-12-06 2017-11-21 Nri R&D Patent Licensing, Llc Heterogeneous tactile sensing via multiple sensor types
US20180011529A1 (en) * 2012-05-23 2018-01-11 Kabushiki Kaisha Square Enix (Also Trading As Squa Re Enix Co., Ltd.) Information processing apparatus, method for information processing, and game apparatus
US11119564B2 (en) * 2012-05-23 2021-09-14 Kabushiki Kaisha Square Enix Information processing apparatus, method for information processing, and game apparatus for performing different operations based on a movement of inputs
US20190339765A1 (en) * 2012-05-23 2019-11-07 Kabushiki Kaisha Square Enix (Also Trading As Square Enix Co., Ltd.) Information processing apparatus, method for information processing, and game apparatus for performing different operations based on a movement of inputs
US10831258B2 (en) * 2012-05-23 2020-11-10 Kabushiki Kaisha Square Enix Information processing apparatus, method for information processing, and game apparatus for performing different operations based on a movement of inputs
CN103823584A (en) * 2012-11-19 2014-05-28 宏达国际电子股份有限公司 Touch sensing method and portable electronic device
US20140139443A1 (en) * 2012-11-19 2014-05-22 Htc Corporation Touch Sensing Method and Portable Electronic Apparatus
US9201529B2 (en) * 2012-11-19 2015-12-01 Htc Corporation Touch sensing method and portable electronic apparatus
US10850194B2 (en) 2013-01-31 2020-12-01 Gree, Inc. Terminal display control method, terminal display system and server apparatus
US9782673B2 (en) * 2013-01-31 2017-10-10 Gree, Inc. Terminal display control method, terminal display system and server apparatus
US20230302356A1 (en) * 2013-03-15 2023-09-28 Steelseries Aps Gaming device with independent gesture-sensitive areas
US10328344B2 (en) * 2013-10-11 2019-06-25 Valve Corporation Game controller systems and methods
US20190299094A1 (en) * 2013-10-11 2019-10-03 Valve Corporation Game controller systems and methods
US11052310B2 (en) 2013-10-11 2021-07-06 Valve Corporation Game controller systems and methods
US20150105152A1 (en) * 2013-10-11 2015-04-16 Valve Corporation Game controller systems and methods
US9904463B2 (en) * 2014-09-23 2018-02-27 Sulake Corporation Oy Method and apparatus for controlling user character for playing game within virtual environment
US10716998B2 (en) 2014-11-18 2020-07-21 Razer (Asia-Pacific) Pte. Ltd. Gaming controller for mobile device and method of operating a gaming controller
US10258876B2 (en) 2014-11-18 2019-04-16 Razer (Asia-Pacific) Pte. Ltd. Gaming controller for mobile device and method of operating a gaming controller
US11045723B1 (en) 2014-11-18 2021-06-29 Razer (Asia-Pacific) Pte. Ltd. Gaming controller for mobile device and method of operating a gaming controller
US11607608B2 (en) 2014-11-18 2023-03-21 Razer (Asia-Pacific) Pte. Ltd. Gaming controller for mobile device and method of operating a gaming controller
US11202960B2 (en) * 2017-01-25 2021-12-21 Kieran S. Lyden Game controller
JP2018152042A (en) * 2017-03-13 2018-09-27 ウィキパッド,インコーポレーテッド Game controller with flexible bridge supporting touch screen
US11752432B2 (en) * 2017-09-15 2023-09-12 Sega Corporation Information processing device and method of causing computer to perform game program
US20230152761A1 (en) * 2020-04-15 2023-05-18 Rakuten Mobile, Inc. Autonomous network, controller and method

Also Published As

Publication number Publication date
US9950256B2 (en) 2018-04-24
US20180207526A1 (en) 2018-07-26

Similar Documents

Publication Publication Date Title
US20180207526A1 (en) High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities
US9354839B2 (en) Storage medium storing object movement controlling program and information processing apparatus
CN104205034A (en) Creation of three-dimensional graphics using gestures
US20120274585A1 (en) Systems and methods of multi-touch interaction with virtual objects
CN110665220B (en) Game Controller
KR20140029158A (en) System and method for facilitating interaction with a virtual space via a touch sensitive surface
KR20140006642A (en) Method for processing user gesture input in online game
JP2007130312A (en) Game program and game apparatus
Baldauf et al. Investigating on-screen gamepad designs for smartphone-controlled video games
US9072968B2 (en) Game device, game control method, and game control program for controlling game on the basis of a position input received via touch panel
US9751019B2 (en) Input methods and devices for music-based video games
Teather et al. Comparing order of control for tilt and touch games
JP2007325709A (en) Game device, program and information recording medium
US20080300033A1 (en) Storage medium storing puzzle game program, puzzle game apparatus, and puzzle game controlling method
Teather et al. Tilt-Touch synergy: Input control for “dual-analog” style mobile games
Zheng et al. BlockTower: A Multi-player Cross-Platform Competitive Social Game
JP2019117634A (en) Display control program, display control method, and display control system
JP6919050B1 (en) Game system, program and information processing method
JP6980748B2 (en) Display control program, display control method, and display control system
JP7221685B2 (en) Information processing device, game processing method and program
WO2023002907A1 (en) Information processing system, program, and information processing method
Shafana et al. Investigating the role of gesture modalities and screen size in an AR 3D game
Toktaş et al. Evaluation of crosshair-aided gyroscope gamepad controller
JP4724758B2 (en) Input processing program and input processing apparatus
Afshari et al. Magnetic interaction with devices: A pilot study on mobile gaming

Legal Events

Date Code Title Description
AS Assignment

Owner name: LUDWIG, LESTER F., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LIM, SEUNG E.;REEL/FRAME:031122/0261

Effective date: 20130716

AS Assignment

Owner name: NRI R&D PATENT LICENSING, LLC, TEXAS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LUDWIG, LESTER F;REEL/FRAME:042745/0063

Effective date: 20170608

AS Assignment

Owner name: PBLM ADVT LLC, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNOR:NRI R&D PATENT LICENSING, LLC;REEL/FRAME:044036/0254

Effective date: 20170907

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20220424