US20180207526A1 - High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities - Google Patents
High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities Download PDFInfo
- Publication number
- US20180207526A1 US20180207526A1 US15/926,727 US201815926727A US2018207526A1 US 20180207526 A1 US20180207526 A1 US 20180207526A1 US 201815926727 A US201815926727 A US 201815926727A US 2018207526 A1 US2018207526 A1 US 2018207526A1
- Authority
- US
- United States
- Prior art keywords
- hdtp
- game
- touch
- touch surface
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/33—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
- A63F13/335—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/23—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
- A63F13/235—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
- A63F13/92—Video game devices specially adapted to be hand-held while playing
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
- A63F13/95—Storage media specially adapted for storing game information, e.g. video game cartridges
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1025—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection
- A63F2300/1031—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals details of the interface with the game device, e.g. USB version detection using a wireless connection, e.g. Bluetooth, infrared connections
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1068—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted to detect the point of contact of the player on a surface, e.g. floor mat, touch pad
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/204—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform the platform being a handheld device
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/206—Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards
- A63F2300/208—Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards for storing personal settings or data of the player
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
- A63F2300/403—Connection between platform and handheld device
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
- A63F2300/407—Data transfer via internet
Definitions
- portable devices are becoming very popular, users still rely on devices that are not portable for a variety of reasons—for example most inexpensive portable devices have limited capacity of processor or storage. Devices with lack of mobility can be compensated for by additional features or additional types of devices that provide access to associated systems or networks.
- WiFi and other types of networking has become available in most urban areas, and there are broad ranges of devices that enable the users to easily connect among devices within homes via various types of networking.
- electronic games for social networks and massively multiplayer online (MMO) games are a rapidly growing trend in gaming industry.
- MMO massively multiplayer online
- digital distribution and downloadable content are also becoming a trend in gaming industry. Accordingly, staying connected to the internet or other network has become increasingly essential in gaming.
- HDTP touch-pad and touch-screen technologies as taught in U.S. Pat. No. 6,570,078, pending U.S. patent application Ser. No. 12/418,605, pending U.S. patent application Ser. No. 11/761,978, and many other related pending U.S. patent applications provide a wide range of touch-based user interface capabilities—including 3D and 6D interactions, advanced multi-touch, rich information flux, rich metaphors, multi-dimensional extensions to hyperlinks (for example as taught in pending U.S. patent application Ser. No. 13/026,248), and tactile grammars—many of which are very well suited for interactive control of gaming systems. Additionally, HDTP touch-pad and touch-screen technologies can be readily implemented in small, handheld devices.
- HDTP touch-screen technologies can be implemented using multiplexed OLED displays or transparent OLED overlays atop LCD displays so that capacitive sensing overlays and associated RF electronics are not required.
- the capture and tracking software for gestures and parameters can be implemented in part or entirely in GPU processors, display driver software, and other computational elements within a device.
- the present invention provides for the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies.
- the present invention additionally pertains to various embodiments of advanced game controllers that include an HDTP touch-pad or touch-screen.
- inventive systems and methods of the invention comprise the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies.
- a game controller comprises touch-based sensor that is used as a sensor for a HDTP user interface.
- a game controller comprises capacitive touch sensor that is used as a sensor for a HDTP user interface.
- a game controller comprises an OLED display that is used as a touch-based user interface.
- a game controller comprises an OLED display that is used as a sensor for a HDTP user interface.
- a game controller comprises video camera that is used as a sensor for a HDTP user interface.
- a game controller comprises video camera that is used as a sensor for gesture sensing.
- a game controller comprises an HDTP user interface and a joystick.
- a game controller comprises support for a multiple-dimensional hypermedia object.
- a game controller comprises support for a multiple-dimensional hyperlink.
- the invention comprises a High Dimensional Touch Parameter (HDTP) touch capability that can selectively function, as desired by the user, as one or more of a game controller that connects to a game console via network connections, an independent portable/mobile game device with limited but sufficient capacity of processor/memory, a controller for a game console connected remotely through the internet and or a storage device/media player that can store gaming history, personal information, or media files.
- the device comprises at least one processor for executing at least one algorithm, the algorithm including at least a game, at least one touch sensor providing real-time tactile information to at least one algorithm, the algorithm implementing at least on HDTP function, and at least one networking element configured to network the device to at least the internet.
- HDTP High Dimensional Touch Parameter
- the invention comprises a device that can selectively function, as desired by the user, as one or more of:
- the invention comprises a device that can selectively function, as desired by the user, as one or more of:
- the invention comprises a device that can selectively function, as desired by the user, as one or more of:
- the invention comprises a device that can selectively function, as desired by the user, as one or more of:
- FIGS. 1 a and 1 b illustrate physical configuration of the embodiment of the invention which comprises of a screen on the center of the front and touch sensor regions on left and right end of the device both on the front and the back.
- FIGS. 2 a and 2 b illustrate physical configuration of the embodiment of the invention which comprises of a touch-screen on the front and touch sensor regions on left and right end of the device both on the front and the back.
- FIG. 3 a illustrates physical configuration of the embodiment of the invention which includes a joystick (or a directional stick) on the bottom center of the front.
- FIG. 3 b illustrates physical configuration of the embodiment of the invention which includes two joysticks (or directional sticks) on the bottom center of the front.
- FIG. 4 a -4 c illustrates physical configuration of the embodiment of the invention where the touch sensor region on the front is partitioned into multiple parts.
- FIGS. 5 a and 5 b illustrates physical configuration of the embodiment of the invention where there are touch sensor regions along the edge of the device.
- FIG. 6 a depicts an exemplary controller (or portable gaming console) as a standalone device.
- FIG. 6 b depicts an exemplary controller (or portable gaming console) connected to the network or computing environment.
- FIG. 6 c depicts an exemplary controller connected with wire to the console, which is connected to the TV or display.
- FIG. 6 d depicts an exemplary controller connected wirelessly the console, which is connected to the TV or display.
- Such wireless connection includes infrared, Bluetooth, WiFi, etc.
- FIG. 6 e depicts an exemplary controller wired to the console (connected to the TV or display) which is connected to the network or computing environment.
- FIG. 6 f depicts an exemplary controller connected wirelessly the console (connected to the TV or display) which is connected to the network or computing environment.
- FIGS. 7 a and 7 b describe the possible embodiments of the architecture of the invention.
- FIG. 8 a illustrates an exemplary arrangement wherein a game controller is connected to the server via network for the purpose of having the server handle computations, data or database, or combinations of them.
- FIG. 8 b illustrates an exemplary arrangement wherein multiple game controllers are connected to one server through network.
- FIG. 8 c illustrates an exemplary arrangement wherein a controller can control the server through the network or the computing environment.
- FIG. 8 d illustrates an exemplary arrangement wherein multiple controllers can control the server through the network or the computing environment.
- FIG. 9 a illustrates an exemplary arrangement wherein two game controllers are connected through network.
- FIG. 9 b illustrates how three game controllers are connected to one another through network.
- FIG. 9 c illustrates an exemplary arrangement wherein a controller can control another controller that is connected to the same network or the computing environment.
- FIG. 9 d illustrates an exemplary arrangement wherein one controller can control another controller connected on the same network or the computing environment.
- FIG. 10 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the left.
- FIG. 10 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
- FIG. 10 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the right.
- FIG. 11 a illustrates an exemplary view from the simulated aircraft when the aircraft is slanted upward.
- FIG. 11 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
- FIG. 11 c illustrates an exemplary view from the simulated aircraft when the aircraft is slanted downward.
- FIG. 12 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated clockwise.
- FIG. 12 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
- FIG. 12 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated counterclockwise.
- WiFi and other types of networking has become available in most urban areas, and there are broad ranges of devices that enable the users to easily connect among devices within homes via various types of networking.
- electronic games for social networks and massively multiplayer online (MMO) games are a rapidly growing trend in gaming industry.
- MMO massively multiplayer online
- digital distribution and downloadable content are also becoming a trend in gaming industry. Accordingly, staying connected to the internet or other network has become increasingly essential in gaming.
- HDTP High Dimensional Touch Parameter
- HDTP High Dimensional Touch Parameter
- touch-pad and touch-screen technologies as taught in U.S. Pat. No. 6,570,078, pending U.S. patent application Ser. No. 12/418,605, pending U.S. patent application Ser. No. 11/761,978, and many other related pending U.S. patent applications provide a wide range of touch-based user interface capabilities. These include vast ranges of control by combinations of additional parameters derived from touch by the human hand, including a number of natural 3D capabilities, for example:
- HDTP touch-pad and touch-screen technologies can be readily implemented in small, handheld devices in various ways.
- medium and high resolutions HDTP touch-screen technologies can be implemented using multiplexed OLED displays or transparent OLED overlays atop LCD displays so that capacitive sensing overlays and associated RF electronics are not required.
- the capture and tracking software for gestures and parameters can be implemented in part or entirely in GPU processors, display driver software, and other computational elements within a device.
- video cameras can also be used to implement HDTP capabilities and extensions of them.
- the present invention provides for the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies.
- the present invention additionally pertains to various embodiments of advanced game controllers that include an HDTP touch-pad or touch-screen.
- buttons and directional pad/stick are eliminated by the HDTP. Controls that previously require complicated sequence of arrow keys and buttons can easily be implemented by combination of parameters. Users can navigate through the setup menus and control options in a game with the HDTP.
- a joystick or a directional control stick which is a main feature of most game controllers, can be replaced with having the HDTP along the edge of the controller: if a user wants to move an object to a desired direction, the user can place one or more finger(s) in the corresponding side of the touch-pad, or a touch-pad can be placed on the top surface of the joystick.
- the invention can comprise (or be comprised within) a device comprising of any combination of two or more of the following:
- the aforementioned touch-pad or touch-screen can be an HDTP touch-pad or touch-screen.
- a number of exemplary configurations incorporating one or more touch-pads or touch-screens, ordinary, gesture-based, and/or HDTP are now presented.
- FIG. 1 a -5 b illustrate physical exemplary embodiment of the invention.
- FIGS. 1 a and 1 b illustrate physical configuration of the embodiment of the invention which comprises of a screen on the center of the front and touch sensor regions on left and right end of the device both on the front and the back.
- FIGS. 2 a and 2 b illustrate physical configuration of the embodiment of the invention which comprises of a touch-screen on the front and touch sensor regions on left and right end of the device both on the front and the back.
- FIG. 3 a illustrates physical configuration of the embodiment of the invention which includes a joystick (or a directional stick) on the bottom center of the front.
- FIG. 3 b illustrates physical configuration of the embodiment of the invention which includes two joysticks (or directional sticks) on the bottom center of the front.
- FIG. 4 a -4 c illustrates physical configuration of the embodiment of the invention where a touch sensor region is implemented on the front of the device is partitioned into multiple parts.
- FIGS. 5 a and 5 b illustrates physical configuration of the embodiment of the invention where there is at least one touch sensor region along the edge of the device.
- Various embodiments of the invention can support a number of operating modalities and networking arrangements with the internet, game consoles, games servers, etc.
- FIG. 6 a -6 f illustrate exemplary usage modality and/or networking embodiments provided for by the invention.
- FIG. 6 a represents the controller (or portable gaming console) as a standalone device.
- FIG. 6 b represents the controller (or portable gaming console) connected to the network or computing environment.
- the controller is connected with wire to the console, which is connected to the TV or display.
- the controller is connected wirelessly the console, which is connected to the TV or display.
- Such wireless connection includes infrared, Bluetooth, LAN, WAN, WAP, etc.
- the controller is wired to the console (connected to the TV or display) which is connected to the network or computing environment.
- FIG. 6 f the controller is connected wirelessly the console (connected to the TV or display) which is connected to the network or computing environment.
- FIGS. 7 a and 7 b describe the possible embodiments of the internal architecture of the invention.
- FIG. 7 a depicts an exemplary embodiment comprising one or more network interface(s), memory, CPU, GPU, and DSP.
- FIG. 7 b illustrates a different an exemplary embodiment.
- the need for memory and CPU is eliminated by having a GPGPU (General Purpose GPU).
- General purpose computing, as well as graphic rendering, is delegated to GPGPU.
- the exemplary depicted audio features can be included or omitted as can be advantageous.
- FIG. 8 a illustrates an exemplary arrangement wherein a game controller is connected to the server via network for the purpose of having the server handle computations, data or database, or combinations of them.
- FIG. 8 b illustrates an exemplary arrangement wherein multiple game controllers are connected to one server through network. All the controllers are connected only through the server; no direct access among one controller to another is available. This is referred to as “star” topology or social network.
- FIG. 8 c illustrates an exemplary arrangement wherein a controller can control the server through the network or the computing environment.
- FIG. 8 d illustrates an exemplary arrangement wherein multiple controllers can control the server through the network or the computing environment.
- FIG. 9 a illustrates an exemplary arrangement wherein two game controllers are connected through network.
- FIG. 9 b illustrates an exemplary arrangement wherein three game controllers are connected to one another through network. This connection represents a “Full Mesh” top—every controller is connected to every other controller.
- FIG. 9 c illustrates an exemplary arrangement wherein a controller can control another controller that is connected to the same network or the computing environment.
- FIG. 9 d illustrates an exemplary arrangement wherein one controller can control another controller connected on the same network or the computing environment.
- rotating a finger can be used to adjust the direction, and more or less pressure to adjust the intensity of throwing/hitting.
- Other variations are clear to one skilled in the art and are provided for by the invention.
- FIG. 10 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the left
- FIG. 10 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the right.
- FIG. 10 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
- FIG. 11 a illustrates an exemplary view from the simulated aircraft when the aircraft is slanted upward
- FIG. 11 c illustrates an exemplary view from the simulated aircraft when the aircraft is slanted downward.
- FIG. 11 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
- FIG. 12 a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated clockwise
- FIG. 12 c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated counterclockwise.
- FIG. 12 b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.
- Combinations of more HDTP parameters can implement, emulate, or simulate more complex control actions.
- the simulated aircraft can be slanted downward while rotated to the left by a finger rotated counterclockwise while being tilted downward.
- Other variations are clear to one skilled in the art and are provided for by the invention.
- touch sensor regions both on front and back side of the controller can be advantageous.
- the touch sensor regions on the front can be used for navigating the aircraft, and the touch sensor regions on the back can be used for navigating through submenus for selecting targets, weapons, etc.
- the touch sensor regions on the front can be used for actual movement of the aircraft, and the touch sensor regions on the back can be used for manipulating the viewpoint.
- Other variations are clear to one skilled in the art and are provided for by the invention.
- the orientation of a 3D object can be manipulated with a finger placed on the touch sensor on the left end of the controller, and the position of a 3D object can be manipulated with a finger placed on the touch sensor on the right end of the controller.
- Other variations are clear to one skilled in the art and are provided for by the invention.
- one region of the HDTP can control the arm motions while another region of the HDTP can control the leg motions.
- Variations on the users' touch can simulate complex punches or kicks. Also, making selections in menus or switching between different modes can be done easily with rolling, pitching, or rotating fingers. Other variations are clear to one skilled in the art and are provided for by the invention. Further, a contiguous touch sensor region can be partitioned into multiple parts, as described in pending U.S. patent application Ser. No. 12/418,605.
- different parts of the HDTP can control different instruments: for example, left hand can play the drums, and right hand can play the guitar.
- left hand can play the drums
- right hand can play the guitar.
- Other variations are clear to one skilled in the art and are provided for by the invention.
- the controller can be composed of a plurality of distinct portions or modules - for example left, center, and right modules—and one or more such portions or modules can be replaced with a module that is longer, shaped differently, or has other variations or differences—for example as may be particularly suited to a particular mode or action of play.
- a module that is longer to replicate frets on a guitar can be used to provide experience that is similar to playing an actual guitar.
- Other variations are clear to one skilled in the art and are provided for by the invention.
- Combinations of parameters can also improve the user experience in construction and management simulation games by providing easier way of making selections in menus or switching between different modes.
- users can control the object in the game, while the camera detects the user behavior which can be another input for the game.
- the invention uses HDTP functions to implement multi-dimensional extensions to hypermedia objects including hyperlinks and rollovers (for example as taught in pending U.S. patent application Ser. No. 13/026,248).
- the invention comprises a device that can selectively function, as desired by the user, as one or more of:
- the invention comprises a device that can selectively function, as desired by the user, as one or more of:
- the invention comprises a device that can selectively function, as desired by the user, as one or more of:
- the invention comprises a device that can selectively function, as desired by the user, as one or more of:
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A device comprising a High Dimensional Touch Parameter (HDTP) touch capability that can selectively function, as desired by the user, as one or more of a game controller that connects to a game console via network connections, an independent portable/mobile game device with limited but sufficient capacity of processor/memory, a controller for a game console connected remotely through the internet and or a storage device/media player that can store gaming history, personal information, or media files. In an embodiment the device comprises at least one processor for executing at least one algorithm, the algorithm including at least a game, at least one touch sensor providing real-time tactile information to at least one algorithm, the algorithm implementing at least on HDTP function, and at least one networking element configured to network the device to at least the internet.
Description
- Pursuant to 35 U.S.C. § 119(e), this application is a continuation application of U.S. patent application Ser. No. 13/198,691 filed Aug. 4, 2011, which claims benefit of priority from Provisional U.S. patent application Ser. No. 61/371,153, received at the U.S. Patent Office on Aug. 5, 2010, the contents of which are incorporated by reference.
- A portion of the disclosure of this patent document may contain material, which is subject to copyright protection. Certain marks referenced herein may be common law or registered trademarks of the applicant, the assignee or third parties affiliated or unaffiliated with the applicant or the assignee. Use of these marks is for providing an enabling disclosure by way of example and shall not be construed to exclusively limit the scope of the disclosed subject matter to material associated with such marks.
- Although portable devices are becoming very popular, users still rely on devices that are not portable for a variety of reasons—for example most inexpensive portable devices have limited capacity of processor or storage. Devices with lack of mobility can be compensated for by additional features or additional types of devices that provide access to associated systems or networks. An important example of these, and subject of the present invention, is game consoles.
- WiFi and other types of networking has become available in most urban areas, and there are broad ranges of devices that enable the users to easily connect among devices within homes via various types of networking. Additionally, electronic games for social networks and massively multiplayer online (MMO) games are a rapidly growing trend in gaming industry. Further, digital distribution and downloadable content are also becoming a trend in gaming industry. Accordingly, staying connected to the internet or other network has become increasingly essential in gaming.
- Further, it is noted that during the last decade video games have become more interactive. Older games utilized button-pressing sequences to simulate more complicated inputs and motions (such as gestures). Because of the fact that such button-pressing sequences are often very complicated, some games have limited audience of users. As gaming consoles devised and include user-operated controls that are easier to use, such game consoles have increasingly attracted users that are not experienced gamers. For example, Nintendo's Wii has variety of games the whole family can play, and the targeted age of users are definitely of wider range compared to some years ago.
- The popularity of the Apple™ iPhone™ and subsequent smartphones, PDAs, and other handheld mobile devices with touch interfaces has lead to interest and demand for games that use touch-based and touch-gesture user interfaces. To date the touch capabilities have been somewhat limited. Some newer game controllers and portable game consoles comprise touch-screens, but these typically only offer the X-Y position tracking capabilities of traditional mice or simple flinger-flick gestures.
- The High Dimensional Touch Parameter (“HDTP”) touch-pad and touch-screen technologies as taught in U.S. Pat. No. 6,570,078, pending U.S. patent application Ser. No. 12/418,605, pending U.S. patent application Ser. No. 11/761,978, and many other related pending U.S. patent applications provide a wide range of touch-based user interface capabilities—including 3D and 6D interactions, advanced multi-touch, rich information flux, rich metaphors, multi-dimensional extensions to hyperlinks (for example as taught in pending U.S. patent application Ser. No. 13/026,248), and tactile grammars—many of which are very well suited for interactive control of gaming systems. Additionally, HDTP touch-pad and touch-screen technologies can be readily implemented in small, handheld devices. Further as to this, as taught in pending U.S. patent application Ser. Nos. 12/418,605 and 61/506,634, medium and high resolutions HDTP touch-screen technologies can be implemented using multiplexed OLED displays or transparent OLED overlays atop LCD displays so that capacitive sensing overlays and associated RF electronics are not required. In such embodiments, the capture and tracking software for gestures and parameters can be implemented in part or entirely in GPU processors, display driver software, and other computational elements within a device.
- Two previous pending U.S. patent applications by the present inventor—U.S. patent application Ser. Nos. 12/502,230 and 12/511,930—share a specification that teaches aspects of game-based applications of HDTP technologies, for example as implemented on a computer (or as implemented on a hand-held device; see
FIG. 1f therein). - The present invention provides for the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies. The present invention additionally pertains to various embodiments of advanced game controllers that include an HDTP touch-pad or touch-screen.
- Features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
- In an embodiment, inventive systems and methods of the invention comprise the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies.
- In another aspect of the invention, a game controller comprises touch-based sensor that is used as a sensor for a HDTP user interface.
- In another aspect of the invention, a game controller comprises capacitive touch sensor that is used as a sensor for a HDTP user interface.
- In an aspect of the invention, a game controller comprises an OLED display that is used as a touch-based user interface.
- In another aspect of the invention, a game controller comprises an OLED display that is used as a sensor for a HDTP user interface.
- In another aspect of the invention, a game controller comprises video camera that is used as a sensor for a HDTP user interface.
- In another aspect of the invention, a game controller comprises video camera that is used as a sensor for gesture sensing.
- In another aspect of the invention, a game controller comprises an HDTP user interface and a joystick.
- In another aspect of the invention, a game controller comprises support for a multiple-dimensional hypermedia object.
- In another aspect of the invention, a game controller comprises support for a multiple-dimensional hyperlink.
- In an embodiment, the invention comprises a High Dimensional Touch Parameter (HDTP) touch capability that can selectively function, as desired by the user, as one or more of a game controller that connects to a game console via network connections, an independent portable/mobile game device with limited but sufficient capacity of processor/memory, a controller for a game console connected remotely through the internet and or a storage device/media player that can store gaming history, personal information, or media files. In an embodiment the device comprises at least one processor for executing at least one algorithm, the algorithm including at least a game, at least one touch sensor providing real-time tactile information to at least one algorithm, the algorithm implementing at least on HDTP function, and at least one networking element configured to network the device to at least the internet.
- In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
-
- a game controller device that connects to a game console via wireless connections;
- a game controller device that connects to a game console via wired connections;
- an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
- a controller for a game console connected remotely through the internet;
- a storage device/media player that can store gaming history, personal information, or media files.
- In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
-
- a game controller device that connects to a game console via wireless connections;
- a game controller device that connects to a game console via wired connections;
- an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
- a controller for a game console connected remotely through the internet.
- In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
-
- a game controller device that connects to a game console via wireless connections;
- a game controller device that connects to a game console via wired connections;
- an independent portable/mobile game device with limited but sufficient capacity of processor/memory.
- In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
-
- an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
- a storage device/media player that can store gaming history, personal information, or media files.
- These and other embodiments will also become readily apparent to those skilled in the art from the following detailed description of the embodiments having reference to the attached figures, the invention not being limited to any particular embodiment disclosed.
- The above and other aspects, features and advantages of the present invention will become more apparent upon consideration of the following description of preferred embodiments taken in conjunction with the accompanying drawing figures.
-
FIGS. 1a and 1b illustrate physical configuration of the embodiment of the invention which comprises of a screen on the center of the front and touch sensor regions on left and right end of the device both on the front and the back. -
FIGS. 2a and 2b illustrate physical configuration of the embodiment of the invention which comprises of a touch-screen on the front and touch sensor regions on left and right end of the device both on the front and the back. -
FIG. 3a illustrates physical configuration of the embodiment of the invention which includes a joystick (or a directional stick) on the bottom center of the front. -
FIG. 3b illustrates physical configuration of the embodiment of the invention which includes two joysticks (or directional sticks) on the bottom center of the front. -
FIG. 4a-4c illustrates physical configuration of the embodiment of the invention where the touch sensor region on the front is partitioned into multiple parts. -
FIGS. 5a and 5b illustrates physical configuration of the embodiment of the invention where there are touch sensor regions along the edge of the device. -
FIG. 6a depicts an exemplary controller (or portable gaming console) as a standalone device. -
FIG. 6b depicts an exemplary controller (or portable gaming console) connected to the network or computing environment. -
FIG. 6c depicts an exemplary controller connected with wire to the console, which is connected to the TV or display. -
FIG. 6d depicts an exemplary controller connected wirelessly the console, which is connected to the TV or display. Such wireless connection includes infrared, Bluetooth, WiFi, etc. -
FIG. 6e depicts an exemplary controller wired to the console (connected to the TV or display) which is connected to the network or computing environment. -
FIG. 6f depicts an exemplary controller connected wirelessly the console (connected to the TV or display) which is connected to the network or computing environment. -
FIGS. 7a and 7b describe the possible embodiments of the architecture of the invention. -
FIG. 8a illustrates an exemplary arrangement wherein a game controller is connected to the server via network for the purpose of having the server handle computations, data or database, or combinations of them. -
FIG. 8b illustrates an exemplary arrangement wherein multiple game controllers are connected to one server through network. -
FIG. 8c illustrates an exemplary arrangement wherein a controller can control the server through the network or the computing environment. -
FIG. 8d illustrates an exemplary arrangement wherein multiple controllers can control the server through the network or the computing environment. -
FIG. 9a illustrates an exemplary arrangement wherein two game controllers are connected through network. -
FIG. 9b illustrates how three game controllers are connected to one another through network. -
FIG. 9c illustrates an exemplary arrangement wherein a controller can control another controller that is connected to the same network or the computing environment. -
FIG. 9d illustrates an exemplary arrangement wherein one controller can control another controller connected on the same network or the computing environment. -
FIG. 10a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the left.FIG. 10b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.FIG. 10c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the right. -
FIG. 11a illustrates an exemplary view from the simulated aircraft when the aircraft is slanted upward.FIG. 11b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.FIG. 11c illustrates an exemplary view from the simulated aircraft when the aircraft is slanted downward. -
FIG. 12a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated clockwise.FIG. 12b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.FIG. 12c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated counterclockwise. - In the following, numerous specific details are set forth to provide a thorough description of various embodiments. Certain embodiments may be practiced without these specific details or with some variations in detail. In some instances, certain features are described in less detail so as not to obscure other aspects. The level of detail associated with each of the elements or features should not be construed to qualify the novelty or importance of one feature over the others.
- In the following description, reference is made to the accompanying drawing figures which form a part hereof, and which show by way of illustration specific embodiments of the invention. It is to be understood by those of ordinary skill in this technological field that other embodiments may be utilized, and structural, electrical, as well as procedural changes may be made without departing from the scope of the present invention.
- Although portable devices are becoming very popular, users still rely on devices that are not portable for a variety of reasons—for example most inexpensive portable devices have limited capacity of processor or storage. Devices with lack of mobility can be compensated for by additional features or additional types of devices that provide access to associated systems or networks. An important example of these, and the subject of the present invention, are game consoles.
- WiFi and other types of networking has become available in most urban areas, and there are broad ranges of devices that enable the users to easily connect among devices within homes via various types of networking. Additionally, electronic games for social networks and massively multiplayer online (MMO) games are a rapidly growing trend in gaming industry. Further, digital distribution and downloadable content are also becoming a trend in gaming industry. Accordingly, staying connected to the internet or other network has become increasingly essential in gaming.
- Further, it is noted that during the last decade video games have become more interactive. Older games utilized button-pressing sequences to simulate more complicated inputs and motions (such as gestures). Because of the fact that such button-pressing sequences are often very complicated, some games have limited audience of users. As gaming consoles devised and include user-operated controls that are easier to use, such game consoles have increasingly attracted users that are not experienced gamers. For example, Nintendo's Wii has variety of games the whole family can play, and the targeted age of users are definitely of wider range compared to some years ago.
- The popularity of the Apple™ iPhone™ and subsequent smartphones, PDAs, and other handheld mobile devices with touch interfaces has lead to interest and demand for games that use touch-based and touch-gesture user interfaces. To date the touch capabilities have been somewhat limited. Some newer game controllers and portable game consoles comprise touch-screens, but these typically only offer the X-Y position tracking capabilities of traditional mice or simple flinger-flick gestures.
- The High Dimensional Touch Parameter (“HDTP”) touch-pad and touch-screen technologies as taught in U.S. Pat. No. 6,570,078, pending U.S. patent application Ser. No. 12/418,605, pending U.S. patent application Ser. No. 11/761,978, and many other related pending U.S. patent applications provide a wide range of touch-based user interface capabilities. These include vast ranges of control by combinations of additional parameters derived from touch by the human hand, including a number of natural 3D capabilities, for example:
-
- 3D and 6D interactions;
- advanced multi-touch;
- use both hands (for example, when the invention is oriented horizontally) or one hand (when oriented vertically);
- rich information flux;
- rich frameworks for a wide variety of metaphors;
- multi-dimensional extensions to hypermedia objects including hyperlinks and rollovers (for example as taught in pending U.S. patent application Ser. No. 13/026,248);
- tactile grammars.
- Additionally, HDTP touch-pad and touch-screen technologies can be readily implemented in small, handheld devices in various ways. As taught in pending U.S. patent Application Ser. Nos. 12/418,605 and 61/506,634, medium and high resolutions HDTP touch-screen technologies can be implemented using multiplexed OLED displays or transparent OLED overlays atop LCD displays so that capacitive sensing overlays and associated RF electronics are not required. In such embodiments, the capture and tracking software for gestures and parameters can be implemented in part or entirely in GPU processors, display driver software, and other computational elements within a device. Also as taught in U.S. Pat. No. 6,570,078 and pending U.S. patent application Ser. No. 12/418,605, video cameras can also be used to implement HDTP capabilities and extensions of them.
- The vast ranges of control by combinations of additional parameters derived from touch by the human hand, including its extensive natural 3D capabilities, metaphors, grammars, and advanced hyperlinks are very well suited for interactive control of gaming systems.
- Two previous pending U.S. patent applications by the present inventor—U.S. patent application Ser. Nos. 12/502,230 and 12/511,930—share a specification that teaches aspects of game-based applications of HDTP technologies, for example as implemented on a computer (or as implemented on a hand-held device; see
FIG. 1f therein). - The present invention provides for the incorporation of selected HDTP features as advantageous for additional embodiments, product, or applications of a game controller, device acting as a game controller, or other related technologies. The present invention additionally pertains to various embodiments of advanced game controllers that include an HDTP touch-pad or touch-screen.
- As newer games heavily rely on interactive 3D features more and more, these additional parameters provided by the HDTP can be more useful as they can produce controls using natural metaphors. The need for multiple buttons and directional pad/stick is eliminated by the HDTP. Controls that previously require complicated sequence of arrow keys and buttons can easily be implemented by combination of parameters. Users can navigate through the setup menus and control options in a game with the HDTP. A joystick or a directional control stick, which is a main feature of most game controllers, can be replaced with having the HDTP along the edge of the controller: if a user wants to move an object to a desired direction, the user can place one or more finger(s) in the corresponding side of the touch-pad, or a touch-pad can be placed on the top surface of the joystick.
- In an embodiment, the invention can comprise (or be comprised within) a device comprising of any combination of two or more of the following:
-
- A screen that also functions as a touch-pad or touch-screen (for example as taught in pending U.S. patent application Ser. Nos. 12/418,605 and 61/506,634, using capacitive, pressure, or LED/OLD sensing technologies);
- One or more touch sensor(s) provided in a region along the edge all around or at least in areas where both index fingers and both thumbs can sit comfortably for simultaneous input;
- One or more touch sensor(s) provided in a region on both left and right end;
- One or more touch sensor(s) provided in a region on the back of either/both left and right end;
- One or more low-profile directional pad(s)/stick(s) configured in the center of the bottom and/or the center of the top edge;
- One or more built-in camera(s) for implementing HDTP functions, gesture recognition, and/or machine vision functions.
- In an embodiment, the aforementioned touch-pad or touch-screen can be an HDTP touch-pad or touch-screen. A number of exemplary configurations incorporating one or more touch-pads or touch-screens, ordinary, gesture-based, and/or HDTP are now presented.
-
FIG. 1a-5b illustrate physical exemplary embodiment of the invention. -
FIGS. 1a and 1b illustrate physical configuration of the embodiment of the invention which comprises of a screen on the center of the front and touch sensor regions on left and right end of the device both on the front and the back. -
FIGS. 2a and 2b illustrate physical configuration of the embodiment of the invention which comprises of a touch-screen on the front and touch sensor regions on left and right end of the device both on the front and the back. - The invention provides for the HDTP to be supplemented with additional controllers. For example,
FIG. 3a illustrates physical configuration of the embodiment of the invention which includes a joystick (or a directional stick) on the bottom center of the front. Similarly,FIG. 3b illustrates physical configuration of the embodiment of the invention which includes two joysticks (or directional sticks) on the bottom center of the front. -
FIG. 4a-4c illustrates physical configuration of the embodiment of the invention where a touch sensor region is implemented on the front of the device is partitioned into multiple parts. -
FIGS. 5a and 5b illustrates physical configuration of the embodiment of the invention where there is at least one touch sensor region along the edge of the device. - Various embodiments of the invention can support a number of operating modalities and networking arrangements with the internet, game consoles, games servers, etc.
-
FIG. 6a-6f illustrate exemplary usage modality and/or networking embodiments provided for by the invention. -
FIG. 6a represents the controller (or portable gaming console) as a standalone device.FIG. 6b represents the controller (or portable gaming console) connected to the network or computing environment. InFIG. 6c , the controller is connected with wire to the console, which is connected to the TV or display. InFIG. 6d , the controller is connected wirelessly the console, which is connected to the TV or display. Such wireless connection includes infrared, Bluetooth, LAN, WAN, WAP, etc. InFIG. 6e , the controller is wired to the console (connected to the TV or display) which is connected to the network or computing environment. InFIG. 6f , the controller is connected wirelessly the console (connected to the TV or display) which is connected to the network or computing environment. -
FIGS. 7a and 7b describe the possible embodiments of the internal architecture of the invention.FIG. 7a depicts an exemplary embodiment comprising one or more network interface(s), memory, CPU, GPU, and DSP.FIG. 7b illustrates a different an exemplary embodiment. The need for memory and CPU is eliminated by having a GPGPU (General Purpose GPU). General purpose computing, as well as graphic rendering, is delegated to GPGPU. In the above, the exemplary depicted audio features (speaker, microphone) can be included or omitted as can be advantageous. -
FIG. 8a illustrates an exemplary arrangement wherein a game controller is connected to the server via network for the purpose of having the server handle computations, data or database, or combinations of them.FIG. 8b illustrates an exemplary arrangement wherein multiple game controllers are connected to one server through network. All the controllers are connected only through the server; no direct access among one controller to another is available. This is referred to as “star” topology or social network.FIG. 8c illustrates an exemplary arrangement wherein a controller can control the server through the network or the computing environment.FIG. 8d illustrates an exemplary arrangement wherein multiple controllers can control the server through the network or the computing environment. -
FIG. 9a illustrates an exemplary arrangement wherein two game controllers are connected through network.FIG. 9b illustrates an exemplary arrangement wherein three game controllers are connected to one another through network. This connection represents a “Full Mesh” top—every controller is connected to every other controller. -
FIG. 9c illustrates an exemplary arrangement wherein a controller can control another controller that is connected to the same network or the computing environment.FIG. 9d illustrates an exemplary arrangement wherein one controller can control another controller connected on the same network or the computing environment. - Exemplary HDTP parameters (or combinations of parameters) usage scenarios are now considered.
- In sporting games where a graphically rendered object is thrown or hit, rotating a finger can be used to adjust the direction, and more or less pressure to adjust the intensity of throwing/hitting. Other variations are clear to one skilled in the art and are provided for by the invention.
- As taught in pending U.S. patent application Ser. No. 12/502,230 and U.S. Ser. No. 12/511,930, in a flight simulator game, the user can control the direction of the movement by rolling, pitching, or rotating the finger, these sensed by HDTP touch-screen or touch sensor technology. For example, a user can control horizontal orientation of the aircraft by rolling the finger; roll the finger to the left to have the aircraft roll counter-clockwise and roll the finger to the right to have the aircraft roll clockwise.
FIG. 10a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the left, andFIG. 10c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated to the right.FIG. 10b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.FIG. 11a illustrates an exemplary view from the simulated aircraft when the aircraft is slanted upward, andFIG. 11c illustrates an exemplary view from the simulated aircraft when the aircraft is slanted downward.FIG. 11b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position.FIG. 12a illustrates an exemplary view from the simulated aircraft when the aircraft is rotated clockwise, andFIG. 12c illustrates an exemplary view from the simulated aircraft when the aircraft is rotated counterclockwise.FIG. 12b illustrates an exemplary view from the simulated aircraft when the aircraft is in neutral position. - Combinations of more HDTP parameters can implement, emulate, or simulate more complex control actions. For example, the simulated aircraft can be slanted downward while rotated to the left by a finger rotated counterclockwise while being tilted downward. Other variations are clear to one skilled in the art and are provided for by the invention.
- Similar controls can be available in vehicle simulation games. Rolling, pitching, and rotating fingers can control steering, braking, and accelerating the vehicles. Other variations are clear to one skilled in the art and are provided for by the invention.
- In games where two different major categories of control is required, i.e. combat flight simulations games where the users simulate both flying and combat situations, having touch sensor regions both on front and back side of the controller can be advantageous. As an example, the touch sensor regions on the front can be used for navigating the aircraft, and the touch sensor regions on the back can be used for navigating through submenus for selecting targets, weapons, etc. In another embodiment, the touch sensor regions on the front can be used for actual movement of the aircraft, and the touch sensor regions on the back can be used for manipulating the viewpoint. Other variations are clear to one skilled in the art and are provided for by the invention.
- In a 3D puzzle game, the orientation of a 3D object can be manipulated with a finger placed on the touch sensor on the left end of the controller, and the position of a 3D object can be manipulated with a finger placed on the touch sensor on the right end of the controller. Other variations are clear to one skilled in the art and are provided for by the invention.
- In a competitive fighting video game, one region of the HDTP can control the arm motions while another region of the HDTP can control the leg motions. Variations on the users' touch can simulate complex punches or kicks. Also, making selections in menus or switching between different modes can be done easily with rolling, pitching, or rotating fingers. Other variations are clear to one skilled in the art and are provided for by the invention. Further, a contiguous touch sensor region can be partitioned into multiple parts, as described in pending U.S. patent application Ser. No. 12/418,605.
- In a music game or application, different parts of the HDTP can control different instruments: for example, left hand can play the drums, and right hand can play the guitar. Other variations are clear to one skilled in the art and are provided for by the invention.
- In another embodiment, the controller can be composed of a plurality of distinct portions or modules - for example left, center, and right modules—and one or more such portions or modules can be replaced with a module that is longer, shaped differently, or has other variations or differences—for example as may be particularly suited to a particular mode or action of play. Just as the replica guitar used in RockBand™, a module that is longer to replicate frets on a guitar can be used to provide experience that is similar to playing an actual guitar. Other variations are clear to one skilled in the art and are provided for by the invention.
- Combinations of parameters can also improve the user experience in construction and management simulation games by providing easier way of making selections in menus or switching between different modes.
- With a built-in camera for gesture recognition or machine vision, users can control the object in the game, while the camera detects the user behavior which can be another input for the game.
- In an embodiment, the invention uses HDTP functions to implement multi-dimensional extensions to hypermedia objects including hyperlinks and rollovers (for example as taught in pending U.S. patent application Ser. No. 13/026,248).
- Additional exemplary aspects and applications of the present invention provide for embodiments to be configured as one or more of the following:
-
- a standalone device, a portable game/media player limited but moderate capacity of processor and memory;
- a portable game/media player connected to the network;
- a game controller connected to the main console with wired connections, which can be connected to the network;
- a game controller connected to the main console with wireless connections, which can be connected to the network;
- a game controller directly connected to the network where a main console is connected to;
- a game controller directed connected to the network for cloud computing network service.
- In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
-
- a game controller device that connects to a game console via wireless connections;
- a game controller device that connects to a game console via wired connections;
- an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
- a controller for a game console connected remotely through the internet;
- a storage device/media player that can store gaming history, personal information, or media files.
- In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
-
- a game controller device that connects to a game console via wireless connections;
- a game controller device that connects to a game console via wired connections;
- an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
- a controller for a game console connected remotely through the internet.
- In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
-
- a game controller device that connects to a game console via wireless connections;
- a game controller device that connects to a game console via wired connections;
- an independent portable/mobile game device with limited but sufficient capacity of processor/memory.
- In an embodiment the invention comprises a device that can selectively function, as desired by the user, as one or more of:
-
- an independent portable/mobile game device with limited but sufficient capacity of processor/memory;
- a storage device/media player that can store gaming history, personal information, or media files.
- The terms “certain embodiments”, “an embodiment”, “embodiment”, “embodiments”, “the embodiment”, “the embodiments”, “one or more embodiments”, “some embodiments”, and “one embodiment” mean one or more (but not all) embodiments unless expressly specified otherwise. The terms “including”, “comprising”, “having” and variations thereof mean “including but not limited to”, unless expressly specified otherwise. The enumerated listing of items does not imply that any or all of the items are mutually exclusive, unless expressly specified otherwise. The terms “a”, “an” and “the” mean “one or more”, unless expressly specified otherwise.
- While the invention has been described in detail with reference to disclosed embodiments, various modifications within the scope of the invention will be apparent to those of ordinary skill in this technological field. It is to be appreciated that features described with respect to one embodiment typically can be applied to other embodiments.
- The invention can be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
- Although exemplary embodiments have been provided in detail, various changes, substitutions and alternations could be made thereto without departing from spirit and scope of the disclosed subject matter as defined by the appended claims. Variations described for the embodiments may be realized in any combination desirable for each particular application. Thus particular limitations and embodiment enhancements described herein, which may have particular advantages to a particular application, need not be used for all applications. Also, not all limitations need be implemented in methods, systems, and apparatuses including one or more concepts described with relation to the provided embodiments. Therefore, the invention properly is to be construed with reference to the claims.
Claims (23)
1. A game controller device comprising:
a processor for executing an algorithm for controlling a game being executed by a game console;
a High Dimensional Touch Parameter (HDTP) touch surface, the HDTP touch surface for receiving user touch input and generating real-time tactile information, wherein the real-time tactile information is arranged to be processed to generate HDTP control signals to control the game, and wherein the HDTP touch surface comprises a touch-screen, the resulting system arranged to provide at least a game controller function; and
at least one networking element configured to enable the device to communicate with the game console controlled by at least the game controller function of the multiple-function device,
wherein the multiple-function device directs the HDTP control signals to at least a game console, and
wherein at least 3-dimensional (3D) control signals responsive to 3D aspects of touch measured by the HDTP touch surface are provided to control at least one 3D aspect of a visual response produced by the game.
2. The device of claim 1 wherein the HDTP touch surface comprises a capacitive sensor.
3. The device of claim 1 wherein the HDTP touch surface comprises an OLED array.
4. The device of claim 1 wherein the HDTP touch surface enables measurement of a roll angle.
5. The device of claim 1 wherein the HDTP touch surface enables measurement of a pitch angle.
6. The device of claim 1 wherein the HDTP touch surface enables measurement of a yaw angle.
7. The device of claim 1 wherein the HDTP touch surface enables measurement of a pitch angle.
8. The device of claim 1 wherein the HDTP touch surface provides a control signal responsive to pressure applied to the touchscreen that is arranged to control an electronic game.
9. The device of claim 1 wherein the networking element is further configured to provide an interface to a WiFi network.
10. The device of claim 1 wherein the networking element is further configured to network the device with the internet.
11. A game controller device comprising:
a processor for executing an algorithm for controlling a game;
a High Dimensional Touch Parameter (HDTP) touch surface for receiving user touch input and generating real-time tactile information, wherein the real-time tactile information is arranged to be processed to generate HDTP control signals to control the game and wherein the HDTP touch surface comprises a touch-screen, the resulting system arranged to provide at least a game controller function; and
at least one networking element configured to network the device to at least two game consoles,
wherein the multiple-function device directs the HDTP control signals to at least the at least two game consoles, and
wherein at least 3-dimensional (3D) control signals responsive to 3D aspects of touch measured by the HDTP touch surface are provided to control at least one 3D aspect of a visual response produced by the game.
12. The device of claim 11 wherein the HDTP touch surface comprises a capacitive sensor.
13. The device of claim 11 wherein the HDTP touch surface comprises an OLED array.
14. The device of claim 11 wherein the HDTP touch surface enables measurement of a roll angle.
15. The device of claim 11 wherein the HDTP touch surface enables measurement of a yaw angle.
16. The device of claim 11 wherein the networking element is further configured to provide an interface to a WiFi network.
17. The device of claim 11 wherein the device is further configured to network with the Internet.
18. The device of claim 11 wherein the HDTP touch surface provides a control signal responsive to pressure applied to the touchscreen that is arranged to control an electronic game.
19. A touchscreen-controlled device for at least controlling games, the device comprising:
at least one processor for executing at least one algorithm; and
at least one touchscreen arrangement for measuring tactile information including touch location and touch pressure,
wherein the touchscreen arrangement is configured to provide real-time tactile information including touch location and touch pressure to the algorithm,
wherein the algorithm at least performing pressure measurement processing functions and for creating control signals responsive to at least the pressure applied to the touchscreen, and
wherein the algorithm is at least configured to control an electronic game.
20. The device of claim 19 , wherein the device further comprising an audio speaker that can be used by the electronic game.
21. The device of claim 20 , wherein the device audio speaker can be used by other functions of the device that are not electronic games.
22. The device of claim 19 , wherein the device further comprising an audio microphone.
23. The device of claim 19 , wherein the device is configured to interface to a wireless network.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/926,727 US20180207526A1 (en) | 2010-08-05 | 2018-03-20 | High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US37115310P | 2010-08-05 | 2010-08-05 | |
US13/198,691 US9950256B2 (en) | 2010-08-05 | 2011-08-04 | High-dimensional touchpad game controller with multiple usage and networking modalities |
US15/926,727 US20180207526A1 (en) | 2010-08-05 | 2018-03-20 | High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/198,691 Continuation US9950256B2 (en) | 2010-08-05 | 2011-08-04 | High-dimensional touchpad game controller with multiple usage and networking modalities |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180207526A1 true US20180207526A1 (en) | 2018-07-26 |
Family
ID=45556532
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/198,691 Expired - Fee Related US9950256B2 (en) | 2010-08-05 | 2011-08-04 | High-dimensional touchpad game controller with multiple usage and networking modalities |
US15/926,727 Abandoned US20180207526A1 (en) | 2010-08-05 | 2018-03-20 | High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/198,691 Expired - Fee Related US9950256B2 (en) | 2010-08-05 | 2011-08-04 | High-dimensional touchpad game controller with multiple usage and networking modalities |
Country Status (1)
Country | Link |
---|---|
US (2) | US9950256B2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2615318A (en) * | 2022-02-02 | 2023-08-09 | Sony Interactive Entertainment Inc | Method, device, and system of input for a videogame console |
Families Citing this family (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6610917B2 (en) | 1998-05-15 | 2003-08-26 | Lester F. Ludwig | Activity indication, external source, and processing loop provisions for driven vibrating-element environments |
US9019237B2 (en) | 2008-04-06 | 2015-04-28 | Lester F. Ludwig | Multitouch parameter and gesture user interface employing an LED-array tactile sensor that can also operate as a display |
US8345014B2 (en) | 2008-07-12 | 2013-01-01 | Lester F. Ludwig | Control of the operating system on a computing device via finger angle using a high dimensional touchpad (HDTP) touch user interface |
US8169414B2 (en) | 2008-07-12 | 2012-05-01 | Lim Seung E | Control of electronic games via finger angle using a high dimensional touchpad (HDTP) touch user interface |
US8604364B2 (en) | 2008-08-15 | 2013-12-10 | Lester F. Ludwig | Sensors, algorithms and applications for a high dimensional touchpad |
US8170346B2 (en) | 2009-03-14 | 2012-05-01 | Ludwig Lester F | High-performance closed-form single-scan calculation of oblong-shape rotation angles from binary images of arbitrary size using running sums |
US20110066933A1 (en) | 2009-09-02 | 2011-03-17 | Ludwig Lester F | Value-driven visualization primitives for spreadsheets, tabular data, and advanced spreadsheet visualization |
US20110202934A1 (en) | 2010-02-12 | 2011-08-18 | Ludwig Lester F | Window manger input focus control for high dimensional touchpad (htpd), advanced mice, and other multidimensional user interfaces |
US10146427B2 (en) | 2010-03-01 | 2018-12-04 | Nri R&D Patent Licensing, Llc | Curve-fitting approach to high definition touch pad (HDTP) parameter extraction |
US9632344B2 (en) | 2010-07-09 | 2017-04-25 | Lester F. Ludwig | Use of LED or OLED array to implement integrated combinations of touch screen tactile, touch gesture sensor, color image display, hand-image gesture sensor, document scanner, secure optical data exchange, and fingerprint processing capabilities |
US9626023B2 (en) | 2010-07-09 | 2017-04-18 | Lester F. Ludwig | LED/OLED array approach to integrated display, lensless-camera, and touch-screen user interface devices and associated processors |
US8754862B2 (en) | 2010-07-11 | 2014-06-17 | Lester F. Ludwig | Sequential classification recognition of gesture primitives and window-based parameter smoothing for high dimensional touchpad (HDTP) user interfaces |
US9950256B2 (en) | 2010-08-05 | 2018-04-24 | Nri R&D Patent Licensing, Llc | High-dimensional touchpad game controller with multiple usage and networking modalities |
US20120204577A1 (en) | 2011-02-16 | 2012-08-16 | Ludwig Lester F | Flexible modular hierarchical adaptively controlled electronic-system cooling and energy harvesting for IC chip packaging, printed circuit boards, subsystems, cages, racks, IT rooms, and data centers using quantum and classical thermoelectric materials |
US9442652B2 (en) | 2011-03-07 | 2016-09-13 | Lester F. Ludwig | General user interface gesture lexicon and grammar frameworks for multi-touch, high dimensional touch pad (HDTP), free-space camera, and other user interfaces |
US20120274596A1 (en) * | 2011-07-11 | 2012-11-01 | Ludwig Lester F | Use of organic light emitting diode (oled) displays as a high-resolution optical tactile sensor for high dimensional touchpad (hdtp) user interfaces |
US9052772B2 (en) | 2011-08-10 | 2015-06-09 | Lester F. Ludwig | Heuristics for 3D and 6D touch gesture touch parameter calculations for high-dimensional touch parameter (HDTP) user interfaces |
US9823781B2 (en) | 2011-12-06 | 2017-11-21 | Nri R&D Patent Licensing, Llc | Heterogeneous tactile sensing via multiple sensor types |
US10430066B2 (en) | 2011-12-06 | 2019-10-01 | Nri R&D Patent Licensing, Llc | Gesteme (gesture primitive) recognition for advanced touch user interfaces |
JP5377709B2 (en) * | 2012-05-23 | 2013-12-25 | 株式会社スクウェア・エニックス | Information processing apparatus, information processing method, and game apparatus |
US9201529B2 (en) * | 2012-11-19 | 2015-12-01 | Htc Corporation | Touch sensing method and portable electronic apparatus |
CN103823584B (en) * | 2012-11-19 | 2017-06-27 | 宏达国际电子股份有限公司 | Sensing method of touch control and portable electronic devices |
JP2014147511A (en) * | 2013-01-31 | 2014-08-21 | Gree Inc | Program, display system, and server device |
US9687730B2 (en) * | 2013-03-15 | 2017-06-27 | Steelseries Aps | Gaming device with independent gesture-sensitive areas |
US10328344B2 (en) | 2013-10-11 | 2019-06-25 | Valve Corporation | Game controller systems and methods |
US9904463B2 (en) * | 2014-09-23 | 2018-02-27 | Sulake Corporation Oy | Method and apparatus for controlling user character for playing game within virtual environment |
US10258876B2 (en) | 2014-11-18 | 2019-04-16 | Razer (Asia-Pacific) Pte. Ltd. | Gaming controller for mobile device and method of operating a gaming controller |
US11045723B1 (en) | 2014-11-18 | 2021-06-29 | Razer (Asia-Pacific) Pte. Ltd. | Gaming controller for mobile device and method of operating a gaming controller |
US11625898B2 (en) | 2016-10-11 | 2023-04-11 | Valve Corporation | Holding and releasing virtual objects |
US10307669B2 (en) | 2016-10-11 | 2019-06-04 | Valve Corporation | Electronic controller with finger sensing and an adjustable hand retainer |
US10888773B2 (en) | 2016-10-11 | 2021-01-12 | Valve Corporation | Force sensing resistor (FSR) with polyimide substrate, systems, and methods thereof |
US10691233B2 (en) | 2016-10-11 | 2020-06-23 | Valve Corporation | Sensor fusion algorithms for a handheld controller that includes a force sensing resistor (FSR) |
US10391400B1 (en) | 2016-10-11 | 2019-08-27 | Valve Corporation | Electronic controller with hand retainer and finger motion sensing |
US10987573B2 (en) | 2016-10-11 | 2021-04-27 | Valve Corporation | Virtual reality hand gesture generation |
US11185763B2 (en) | 2016-10-11 | 2021-11-30 | Valve Corporation | Holding and releasing virtual objects |
US10507385B2 (en) * | 2017-01-25 | 2019-12-17 | Kieran S. Lyden | Game controller |
CA2975036A1 (en) * | 2017-03-13 | 2018-09-13 | Wikipad, Inc. | Game controller with flexible bridge supporting touch screen |
JP6418299B1 (en) * | 2017-09-15 | 2018-11-07 | 株式会社セガゲームス | Information processing apparatus and program |
USD908798S1 (en) | 2018-05-18 | 2021-01-26 | Valve Corporation | Game controller |
US10905946B2 (en) | 2019-02-28 | 2021-02-02 | Valve Corporation | Continuous controller calibration |
US11000759B2 (en) | 2019-03-29 | 2021-05-11 | Valve Corporation | Game controller operable in bluetooth low energy (BLE) mode |
US11033809B2 (en) | 2019-05-07 | 2021-06-15 | Valve Corporation | Using finger presence to activate a motion control feature for a handheld controller |
US11042247B2 (en) | 2019-06-14 | 2021-06-22 | Valve Corporation | Cluster-based sensor assignment |
US11638868B2 (en) | 2020-02-14 | 2023-05-02 | Valve Corporation | Controller having display with selectable icons |
US11458386B2 (en) * | 2020-02-14 | 2022-10-04 | Valve Corporation | Controller with adjustable features |
US11504610B2 (en) | 2020-02-14 | 2022-11-22 | Valve Corporation | Dynamically enabling or disabling controls of a controller |
US11511186B2 (en) | 2020-02-14 | 2022-11-29 | Valve Corporation | Controller with sensor-rich controls |
WO2021210329A1 (en) * | 2020-04-15 | 2021-10-21 | Rakuten Mobile, Inc. | Autonomous network, controller and method |
US11504615B1 (en) | 2021-05-18 | 2022-11-22 | Valve Corporation | Electronic controller with linear hand strap adjuster |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040021681A1 (en) * | 2002-07-30 | 2004-02-05 | Liao Chin-Hua Arthur | Dual-touch-screen mobile computer |
US20060084504A1 (en) * | 2004-04-30 | 2006-04-20 | Chan Andy K | Wireless communication systems |
US20070229477A1 (en) * | 1998-05-15 | 2007-10-04 | Ludwig Lester F | High parameter-count touchpad controller |
US20080012828A1 (en) * | 2005-05-09 | 2008-01-17 | Sandio Technology Corp. | Multi-dimensional input device |
US20100013860A1 (en) * | 2006-03-08 | 2010-01-21 | Electronic Scripting Products, Inc. | Computer interface employing a manipulated object with absolute pose detection component and a display |
US20100041480A1 (en) * | 2008-08-12 | 2010-02-18 | Sony Corporation | Universal game console controller |
US20100279773A1 (en) * | 2007-11-15 | 2010-11-04 | Ergowerx Llc | Motorized Game Controller |
US8414373B2 (en) * | 2006-05-19 | 2013-04-09 | Wms Gaming Inc. | Wagering game machine with wireless peripherals |
Family Cites Families (165)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US1947020A (en) | 1931-05-29 | 1934-02-13 | Ranger Richard Howland | Electrical music system |
US3493669A (en) | 1965-12-03 | 1970-02-03 | Baldwin Co D H | Output systems for electric guitars and the like |
US3591699A (en) | 1968-03-28 | 1971-07-06 | Royce L Cutler | Music voicing circuit deriving an input from a conventional musical instrument and providing voiced musical tones utilizing the fundamental tones from the conventional musical instrument |
US3612741A (en) | 1969-12-04 | 1971-10-12 | Fred C Marshall | Electronic musical instrument employing mechanical resonators with regenerative effects |
US3651242A (en) | 1970-06-15 | 1972-03-21 | Columbia Broadcasting Syst Inc | Octave jumper for musical instruments |
US4365533A (en) | 1971-06-01 | 1982-12-28 | Melville Clark, Jr. | Musical instrument |
US3742133A (en) | 1971-09-15 | 1973-06-26 | Seaboard Sys Inc | Monitoring system |
US3730046A (en) | 1972-02-14 | 1973-05-01 | L Spence | Orally operated electronic musical instrument |
US3805091A (en) | 1972-06-15 | 1974-04-16 | Arp Instr | Frequency sensitive circuit employing variable transconductance circuit |
US3813473A (en) | 1972-10-27 | 1974-05-28 | Investments Ltd | Electric guitar system |
US3962945A (en) | 1973-06-22 | 1976-06-15 | Wade E. Creager | Foot actuated electronic organ |
US3878748A (en) | 1974-03-21 | 1975-04-22 | Larry A Spence | Oral cavity controlled electronic musical instrument |
JPS513736Y1 (en) | 1974-04-30 | 1976-02-03 | ||
GB1548285A (en) | 1975-07-14 | 1979-07-11 | Heet G S | String instrument vipration initiator and sustainer |
DE2535344C2 (en) | 1975-08-07 | 1985-10-03 | CMB Colonia Management- und Beratungsgesellschaft mbH & Co KG, 5000 Köln | Device for the electronic generation of sound signals |
US4080867A (en) | 1975-09-22 | 1978-03-28 | Srinkarn Ratanangsu | Electronic display system for musical instruments |
US4122742A (en) | 1976-08-03 | 1978-10-31 | Deutsch Research Laboratories, Ltd. | Transient voice generator |
US4117413A (en) | 1977-06-21 | 1978-09-26 | Norlin Music, Inc. | Amplifier with multifilter |
US4182213A (en) | 1978-05-03 | 1980-01-08 | Iodice Robert M | Coil less magnetic pickup for stringed instrument |
US4274321A (en) | 1979-07-30 | 1981-06-23 | Jerome Swartz | Harmony authorization detector synthesizer |
US4318327A (en) | 1980-07-10 | 1982-03-09 | Toups Daniel J | Digital chord display for stringed musical instruments |
JPS5871797U (en) | 1981-11-10 | 1983-05-16 | ヤマハ株式会社 | electronic musical instruments |
JPS62267610A (en) | 1986-05-16 | 1987-11-20 | Fuji Electric Co Ltd | Detecting system for rotational angle of object pattern |
US4794838A (en) | 1986-07-17 | 1989-01-03 | Corrigau Iii James F | Constantly changing polyphonic pitch controller |
US4852444A (en) | 1986-12-04 | 1989-08-01 | Hoover Alan A | Electro-mechanical transducer which couples positive acoustic feedback into an electric amplified guitar body for the purpose of sustaining played notes |
US5146833A (en) | 1987-04-30 | 1992-09-15 | Lui Philip Y F | Computerized music data system and input/out devices using related rhythm coding |
US4797608A (en) | 1987-08-13 | 1989-01-10 | Digital Equipment Corporation | D.C. power monitor |
US5159140A (en) | 1987-09-11 | 1992-10-27 | Yamaha Corporation | Acoustic control apparatus for controlling musical tones based upon visual images |
DE3732519A1 (en) | 1987-09-26 | 1989-04-06 | Olympia Aeg | ARRANGEMENT FOR ENTERING AND PROCESSING CHARACTERS AND / OR GRAPHIC PATTERNS |
CA1298997C (en) | 1988-05-11 | 1992-04-21 | Asaf Gurner | Optical instrument for producing musical tones or images by movement of a player's body |
US5233123A (en) | 1988-05-27 | 1993-08-03 | Rose Floyd D | Musical instruments equipped with sustainers |
US4991488A (en) | 1988-08-12 | 1991-02-12 | Fala Joseph M | Acoustic detection of note bending in stringed M.I.D.I. compatible musical instruments |
US5033352A (en) | 1989-01-19 | 1991-07-23 | Yamaha Corporation | Electronic musical instrument with frequency modulation |
GB2232251A (en) | 1989-05-08 | 1990-12-05 | Philips Electronic Associated | Touch sensor array systems |
US5237647A (en) | 1989-09-15 | 1993-08-17 | Massachusetts Institute Of Technology | Computer aided drawing in three dimensions |
US5070399A (en) | 1990-02-01 | 1991-12-03 | Alain Martel | Light color and intensity modulation system |
US5262585A (en) | 1990-10-31 | 1993-11-16 | Lenny Greene | Electronic cymbal system |
US5471008A (en) | 1990-11-19 | 1995-11-28 | Kabushiki Kaisha Kawai Gakki Seisakusho | MIDI control apparatus |
CH682355A5 (en) | 1991-02-28 | 1993-08-31 | Matthias Grob Da Veiga | |
US5341133A (en) | 1991-05-09 | 1994-08-23 | The Rowland Institute For Science, Inc. | Keyboard having touch sensor keys for conveying information electronically |
JP3233659B2 (en) | 1991-08-14 | 2001-11-26 | 株式会社フェルナンデス | Electric stringed musical instrument with string vibration sustaining device |
US5475214A (en) | 1991-10-15 | 1995-12-12 | Interactive Light, Inc. | Musical sound effects controller having a radiated emission space |
US5442168A (en) | 1991-10-15 | 1995-08-15 | Interactive Light, Inc. | Dynamically-activated optical instrument for producing control signals having a self-calibration means |
JPH0769767B2 (en) | 1991-10-16 | 1995-07-31 | インターナショナル・ビジネス・マシーンズ・コーポレイション | Touch overlay for detecting finger touch or stylus position, and detection system |
EP0539232A3 (en) | 1991-10-24 | 1994-05-18 | Fernandes Co Ltd | An electric stringed instrument having a device for sustaining the vibration of a string and an electromagnetic driver for the device |
US5335557A (en) | 1991-11-26 | 1994-08-09 | Taizo Yasutake | Touch sensitive input control device |
JPH0627963A (en) | 1992-01-14 | 1994-02-04 | Fuerunandesu:Kk | Electronic stringed instrument |
US5281754A (en) | 1992-04-13 | 1994-01-25 | International Business Machines Corporation | Melody composer and arranger |
US5880411A (en) | 1992-06-08 | 1999-03-09 | Synaptics, Incorporated | Object position detector with edge motion feature and gesture recognition |
EP0574213B1 (en) | 1992-06-08 | 1999-03-24 | Synaptics, Inc. | Object position detector |
US5889236A (en) | 1992-06-08 | 1999-03-30 | Synaptics Incorporated | Pressure sensitive scrollbar feature |
US5440072A (en) | 1992-09-25 | 1995-08-08 | Willis; Raymon A. | System for rejuvenating vintage organs and pianos |
US5459282A (en) | 1992-09-25 | 1995-10-17 | Willis; Raymon A. | System for rejuvenating vintage organs and pianos |
US5357048A (en) | 1992-10-08 | 1994-10-18 | Sgroi John J | MIDI sound designer with randomizer function |
EP0593386A3 (en) | 1992-10-16 | 1996-07-31 | Ibm | Method and apparatus for accessing touch screen desktop objects via fingerprint recognition |
US5563632A (en) | 1993-04-30 | 1996-10-08 | Microtouch Systems, Inc. | Method of and apparatus for the elimination of the effects of internal interference in force measurement systems, including touch - input computer and related displays employing touch force location measurement techniques |
US5592752A (en) | 1993-05-13 | 1997-01-14 | Industrial Technology Research Institute | Process and an apparatus for producing teas |
US5665927A (en) | 1993-06-30 | 1997-09-09 | Casio Computer Co., Ltd. | Method and apparatus for inputting musical data without requiring selection of a displayed icon |
US5675100A (en) | 1993-11-03 | 1997-10-07 | Hewlett; Walter B. | Method for encoding music printing information in a MIDI message |
US5841428A (en) | 1993-11-05 | 1998-11-24 | Intertactile Technologies Corporation | Rotary circuit control devices with changeable graphics |
US5592572A (en) | 1993-11-05 | 1997-01-07 | The United States Of America As Represented By The Department Of Health And Human Services | Automated portrait/landscape mode detection on a binary image |
US5748763A (en) | 1993-11-18 | 1998-05-05 | Digimarc Corporation | Image steganography system featuring perceptually adaptive and globally scalable signal embedding |
US5565641A (en) | 1994-03-28 | 1996-10-15 | Gruenbaum; Leon | Relativistic electronic musical instrument |
US5668338A (en) | 1994-11-02 | 1997-09-16 | Advanced Micro Devices, Inc. | Wavetable audio synthesizer with low frequency oscillators for tremolo and vibrato effects |
US5659466A (en) | 1994-11-02 | 1997-08-19 | Advanced Micro Devices, Inc. | Monolithic PC audio circuit with enhanced digital wavetable audio synthesizer |
US6047073A (en) | 1994-11-02 | 2000-04-04 | Advanced Micro Devices, Inc. | Digital wavetable audio synthesizer with delay-based effects processing |
JP3129380B2 (en) | 1994-12-07 | 2001-01-29 | ヤマハ株式会社 | Electronic musical instrument keyboard device |
US5932827A (en) | 1995-01-09 | 1999-08-03 | Osborne; Gary T. | Sustainer for a musical instrument |
CN1545056A (en) * | 1995-01-17 | 2004-11-10 | 世嘉企业股份有限公司 | Image processing method and electronic device |
US5591945A (en) | 1995-04-19 | 1997-01-07 | Elo Touchsystems, Inc. | Acoustic touch position sensor using higher order horizontally polarized shear wave propagation |
US5659145A (en) | 1995-04-27 | 1997-08-19 | Weil; Robert P. | Foot operated audio signal controller with lighted visual reference |
JP3552366B2 (en) | 1995-06-09 | 2004-08-11 | ヤマハ株式会社 | Music control device |
US5801340A (en) | 1995-06-29 | 1998-09-01 | Invotronics Manufacturing | Proximity sensor |
JPH0944150A (en) | 1995-08-01 | 1997-02-14 | Kawai Musical Instr Mfg Co Ltd | Electronic keyboard musical instrument |
US5719561A (en) | 1995-10-25 | 1998-02-17 | Gilbert R. Gonzales | Tactile communication device and method |
US6107997A (en) | 1996-06-27 | 2000-08-22 | Ure; Michael J. | Touch-sensitive keyboard/mouse and computing device using the same |
US5786540A (en) | 1996-03-05 | 1998-07-28 | Westlund; Robert L. | Controller apparatus for music sequencer |
US6215910B1 (en) | 1996-03-28 | 2001-04-10 | Microsoft Corporation | Table-based compression with embedded coding |
US5748184A (en) | 1996-05-28 | 1998-05-05 | International Business Machines Corporation | Virtual pointing device for touchscreens |
JP3666129B2 (en) | 1996-07-11 | 2005-06-29 | ヤマハ株式会社 | Force control device of the operator |
US5763806A (en) | 1996-07-15 | 1998-06-09 | Willis; Raymon A. | Method and apparatus for midifying vintage organs and pianos |
US5850051A (en) | 1996-08-15 | 1998-12-15 | Yamaha Corporation | Method and apparatus for creating an automatic accompaniment pattern on the basis of analytic parameters |
US6728775B1 (en) | 1997-03-17 | 2004-04-27 | Microsoft Corporation | Multiple multicasting of multimedia streams |
JPH10258181A (en) * | 1997-03-18 | 1998-09-29 | Alps Electric Co Ltd | Operation device for game machine |
GB9708464D0 (en) | 1997-04-25 | 1997-06-18 | Raychem Ltd | Converter for resistive touchscreens |
US5827989A (en) | 1997-06-23 | 1998-10-27 | Microsoft Corporation | System and method for representing a musical event and for converting the musical event into a series of discrete events |
US5852251A (en) | 1997-06-25 | 1998-12-22 | Industrial Technology Research Institute | Method and apparatus for real-time dynamic midi control |
US20010055074A1 (en) | 1997-07-22 | 2001-12-27 | Hiroshi Komatsu | In-plane switching mode lcd with specific arrangement of common bus line, data electrode, and common electrode |
US6310610B1 (en) | 1997-12-04 | 2001-10-30 | Nortel Networks Limited | Intelligent touch display |
US6037937A (en) | 1997-12-04 | 2000-03-14 | Nortel Networks Corporation | Navigation tool for graphical user interface |
JP3419290B2 (en) | 1997-12-27 | 2003-06-23 | ヤマハ株式会社 | Tone / image generator and storage medium |
US6408087B1 (en) | 1998-01-13 | 2002-06-18 | Stmicroelectronics, Inc. | Capacitive semiconductor user input device |
US6392636B1 (en) | 1998-01-22 | 2002-05-21 | Stmicroelectronics, Inc. | Touchpad providing screen cursor/pointer movement control |
EP1058924B1 (en) | 1998-01-26 | 2012-06-13 | Apple Inc. | Method and apparatus for integrating manual input |
JPH11296166A (en) | 1998-04-09 | 1999-10-29 | Yamaha Corp | Note display method, medium recording note display program, beat display method and medium recording beat display program |
US6400836B2 (en) | 1998-05-15 | 2002-06-04 | International Business Machines Corporation | Combined fingerprint acquisition and control device |
US6288317B1 (en) | 1998-05-29 | 2001-09-11 | Raymon A. Willis | Real time transmission of keyboard musical performance |
US6140565A (en) | 1998-06-08 | 2000-10-31 | Yamaha Corporation | Method of visualizing music system by combination of scenery picture and player icons |
US6100461A (en) | 1998-06-10 | 2000-08-08 | Advanced Micro Devices, Inc. | Wavetable cache using simplified looping |
US5969283A (en) | 1998-06-17 | 1999-10-19 | Looney Productions, Llc | Music organizer and entertainment center |
US6051769A (en) | 1998-11-25 | 2000-04-18 | Brown, Jr.; Donival | Computerized reading display |
US6793619B1 (en) | 1999-06-09 | 2004-09-21 | Yaacov Blumental | Computer-implemented method and system for giving a user an impression of tactile feedback |
US7030860B1 (en) | 1999-10-08 | 2006-04-18 | Synaptics Incorporated | Flexible transparent touch sensing system for electronic devices |
EP1156610A3 (en) | 2000-05-19 | 2005-01-26 | Martin Lotze | Method and system for automatic selection of musical compositions and/or sound recordings |
US7371163B1 (en) * | 2001-05-10 | 2008-05-13 | Best Robert M | 3D portable game system |
US6966837B1 (en) * | 2001-05-10 | 2005-11-22 | Best Robert M | Linked portable and video game systems |
US6703552B2 (en) | 2001-07-19 | 2004-03-09 | Lippold Haken | Continuous music keyboard |
US7611409B2 (en) * | 2001-09-20 | 2009-11-03 | Igt | Method and apparatus for registering a mobile device with a gaming machine |
DE10146996A1 (en) | 2001-09-25 | 2003-04-30 | Gerd Reime | Circuit with an opto-electronic display content |
US20060252530A1 (en) * | 2003-01-08 | 2006-11-09 | Igt | Mobile device for providing filtered casino information based on real time data |
KR100540399B1 (en) | 2003-05-23 | 2006-01-10 | 주식회사 옵투스 | Multi-campaign assignment apparatus considering overlapping recommendation problem |
US7620915B2 (en) | 2004-02-13 | 2009-11-17 | Ludwig Lester F | Electronic document editing employing multiple cursors |
FR2869723A1 (en) | 2004-04-29 | 2005-11-04 | Thomson Licensing Sa | NON-CONTACT TRANSITION ELEMENT BETWEEN A WAVEGUIDE AND A MOCRORUBAN LINE |
US7598949B2 (en) | 2004-10-22 | 2009-10-06 | New York University | Multi-touch sensing light emitting diode display and method for using the same |
JP4781743B2 (en) * | 2005-05-06 | 2011-09-28 | 任天堂株式会社 | Communication game system |
US8696464B2 (en) * | 2005-08-19 | 2014-04-15 | Nintendo Co., Ltd. | Enhanced method and apparatus for selecting and rendering performance data |
US8678901B1 (en) * | 2005-09-07 | 2014-03-25 | Bally Gaming | System gaming |
KR20070033532A (en) | 2005-09-21 | 2007-03-27 | 삼성전자주식회사 | Touch sensible display device and driving apparatus therefor and method of processing sensing signals |
US7864160B2 (en) | 2005-10-05 | 2011-01-04 | 3M Innovative Properties Company | Interleaved electrodes for touch sensing |
US7969418B2 (en) | 2006-11-30 | 2011-06-28 | Cherif Atia Algreatly | 3-D computer input device and method |
US8139045B2 (en) | 2006-12-15 | 2012-03-20 | Lg Display Co., Ltd. | Display device having multi-touch recognizing function and driving method thereof |
US8125455B2 (en) | 2007-01-03 | 2012-02-28 | Apple Inc. | Full scale calibration measurement for multi-touch surfaces |
US7639234B2 (en) | 2007-01-04 | 2009-12-29 | Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. | Capacitive sensing and absolute position mapping in displacement type pointing devices |
US8144129B2 (en) | 2007-01-05 | 2012-03-27 | Apple Inc. | Flexible touch sensing circuits |
US20090213081A1 (en) * | 2007-01-10 | 2009-08-27 | Case Jr Charlie W | Portable Electronic Device Touchpad Input Controller |
US8115753B2 (en) | 2007-04-11 | 2012-02-14 | Next Holdings Limited | Touch screen system with hover and click input methods |
US9317110B2 (en) | 2007-05-29 | 2016-04-19 | Cfph, Llc | Game with hand motion control |
US7835999B2 (en) | 2007-06-27 | 2010-11-16 | Microsoft Corporation | Recognizing input gestures using a multi-touch input device, calculated graphs, and a neural network with link weights |
US20090124348A1 (en) | 2007-11-09 | 2009-05-14 | Yoseloff Mark L | Electronic dice control in gaming |
JP2009140368A (en) | 2007-12-07 | 2009-06-25 | Sony Corp | Input device, display device, input method, display method, and program |
US9170649B2 (en) | 2007-12-28 | 2015-10-27 | Nokia Technologies Oy | Audio and tactile feedback based on visual environment |
US9019237B2 (en) | 2008-04-06 | 2015-04-28 | Lester F. Ludwig | Multitouch parameter and gesture user interface employing an LED-array tactile sensor that can also operate as a display |
US9870629B2 (en) | 2008-06-20 | 2018-01-16 | New Bis Safe Luxco S.À R.L | Methods, apparatus and systems for data visualization and related applications |
US8345014B2 (en) | 2008-07-12 | 2013-01-01 | Lester F. Ludwig | Control of the operating system on a computing device via finger angle using a high dimensional touchpad (HDTP) touch user interface |
US8169414B2 (en) | 2008-07-12 | 2012-05-01 | Lim Seung E | Control of electronic games via finger angle using a high dimensional touchpad (HDTP) touch user interface |
US8604364B2 (en) | 2008-08-15 | 2013-12-10 | Lester F. Ludwig | Sensors, algorithms and applications for a high dimensional touchpad |
US20100079385A1 (en) | 2008-09-29 | 2010-04-01 | Smart Technologies Ulc | Method for calibrating an interactive input system and interactive input system executing the calibration method |
US8529345B2 (en) * | 2008-10-02 | 2013-09-10 | Igt | Gaming system including a gaming table with mobile user input devices |
US9104311B2 (en) | 2008-10-09 | 2015-08-11 | Lenovo (Singapore) Pte. Ltd. | Slate computer with tactile home keys |
JP4766101B2 (en) | 2008-11-10 | 2011-09-07 | ソニー株式会社 | Tactile behavior recognition device, tactile behavior recognition method, information processing device, and computer program |
WO2010081040A1 (en) | 2009-01-09 | 2010-07-15 | Skinit, Inc. | Path creation utility for image editor |
US8170346B2 (en) | 2009-03-14 | 2012-05-01 | Ludwig Lester F | High-performance closed-form single-scan calculation of oblong-shape rotation angles from binary images of arbitrary size using running sums |
US8274536B2 (en) * | 2009-03-16 | 2012-09-25 | Apple Inc. | Smart keyboard management for a multifunction device with a touch screen display |
US20100279769A1 (en) * | 2009-04-13 | 2010-11-04 | Chira Kidakam | Game controller with display screen |
US8154529B2 (en) | 2009-05-14 | 2012-04-10 | Atmel Corporation | Two-dimensional touch sensors |
US8836648B2 (en) | 2009-05-27 | 2014-09-16 | Microsoft Corporation | Touch pull-in gesture |
US8217912B2 (en) | 2009-06-17 | 2012-07-10 | Broadcom Corporation | Graphical authentication for a portable device and methods for use therewith |
US20100328032A1 (en) | 2009-06-24 | 2010-12-30 | Broadcom Corporation | Security for computing unit with femtocell ap functionality |
US8179376B2 (en) | 2009-08-27 | 2012-05-15 | Research In Motion Limited | Touch-sensitive display with capacitive and resistive touch sensors and method of control |
US8313377B2 (en) * | 2009-10-14 | 2012-11-20 | Sony Computer Entertainment America Llc | Playing browser based games with alternative controls and interfaces |
US20110285648A1 (en) | 2010-01-22 | 2011-11-24 | Lester Ludwig | Use of fingerprint scanning sensor data to detect finger roll and pitch angles |
TWI401591B (en) * | 2010-02-11 | 2013-07-11 | Asustek Comp Inc | Portable electronic device |
US20110202934A1 (en) | 2010-02-12 | 2011-08-18 | Ludwig Lester F | Window manger input focus control for high dimensional touchpad (htpd), advanced mice, and other multidimensional user interfaces |
US20120056846A1 (en) | 2010-03-01 | 2012-03-08 | Lester F. Ludwig | Touch-based user interfaces employing artificial neural networks for hdtp parameter and symbol derivation |
US8502790B2 (en) * | 2010-03-30 | 2013-08-06 | Robert Osann, Jr. | Touchpad with reverse-mounted buttons |
US8686960B2 (en) | 2010-04-23 | 2014-04-01 | Lester F. Ludwig | Piecewise-linear and piecewise-affine transformations for high dimensional touchpad (HDTP) output decoupling and corrections |
US8698764B1 (en) * | 2010-06-30 | 2014-04-15 | Amazon Technologies, Inc. | Dorsal touch input |
US8754862B2 (en) | 2010-07-11 | 2014-06-17 | Lester F. Ludwig | Sequential classification recognition of gesture primitives and window-based parameter smoothing for high dimensional touchpad (HDTP) user interfaces |
KR101667586B1 (en) * | 2010-07-12 | 2016-10-19 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
US9950256B2 (en) | 2010-08-05 | 2018-04-24 | Nri R&D Patent Licensing, Llc | High-dimensional touchpad game controller with multiple usage and networking modalities |
US20120192119A1 (en) | 2011-01-24 | 2012-07-26 | Lester F. Ludwig | Usb hid device abstraction for hdtp user interfaces |
US9442652B2 (en) | 2011-03-07 | 2016-09-13 | Lester F. Ludwig | General user interface gesture lexicon and grammar frameworks for multi-touch, high dimensional touch pad (HDTP), free-space camera, and other user interfaces |
US20120280927A1 (en) | 2011-05-04 | 2012-11-08 | Ludwig Lester F | Simple touch interface and hdtp grammars for rapid operation of physical computer aided design (cad) systems |
US20130009896A1 (en) | 2011-07-09 | 2013-01-10 | Lester F. Ludwig | 3d finger posture detection and gesture recognition on touch surfaces |
US9052772B2 (en) | 2011-08-10 | 2015-06-09 | Lester F. Ludwig | Heuristics for 3D and 6D touch gesture touch parameter calculations for high-dimensional touch parameter (HDTP) user interfaces |
-
2011
- 2011-08-04 US US13/198,691 patent/US9950256B2/en not_active Expired - Fee Related
-
2018
- 2018-03-20 US US15/926,727 patent/US20180207526A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070229477A1 (en) * | 1998-05-15 | 2007-10-04 | Ludwig Lester F | High parameter-count touchpad controller |
US20040021681A1 (en) * | 2002-07-30 | 2004-02-05 | Liao Chin-Hua Arthur | Dual-touch-screen mobile computer |
US20060084504A1 (en) * | 2004-04-30 | 2006-04-20 | Chan Andy K | Wireless communication systems |
US20080012828A1 (en) * | 2005-05-09 | 2008-01-17 | Sandio Technology Corp. | Multi-dimensional input device |
US20100013860A1 (en) * | 2006-03-08 | 2010-01-21 | Electronic Scripting Products, Inc. | Computer interface employing a manipulated object with absolute pose detection component and a display |
US8414373B2 (en) * | 2006-05-19 | 2013-04-09 | Wms Gaming Inc. | Wagering game machine with wireless peripherals |
US20100279773A1 (en) * | 2007-11-15 | 2010-11-04 | Ergowerx Llc | Motorized Game Controller |
US20100041480A1 (en) * | 2008-08-12 | 2010-02-18 | Sony Corporation | Universal game console controller |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2615318A (en) * | 2022-02-02 | 2023-08-09 | Sony Interactive Entertainment Inc | Method, device, and system of input for a videogame console |
Also Published As
Publication number | Publication date |
---|---|
US20120034978A1 (en) | 2012-02-09 |
US9950256B2 (en) | 2018-04-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20180207526A1 (en) | High-dimensional touch parameter (hdtp) game controllers with multiple usage and networking modalities | |
US9354839B2 (en) | Storage medium storing object movement controlling program and information processing apparatus | |
US8405656B2 (en) | Method and system for three dimensional interaction of a subject | |
US9700787B2 (en) | System and method for facilitating interaction with a virtual space via a touch sensitive surface | |
CN104205034A (en) | Creation of three-dimensional graphics using gestures | |
JP6438198B2 (en) | Program and game device | |
US20070111803A1 (en) | Storage medium having game program stored thereon and game apparatus | |
KR20140006642A (en) | Method for processing user gesture input in online game | |
CN115427122A (en) | Virtual console game controller | |
CN110665220A (en) | Game controller | |
JP6519075B2 (en) | INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING PROGRAM, INFORMATION PROCESSING SYSTEM, AND INFORMATION PROCESSING METHOD | |
US9072968B2 (en) | Game device, game control method, and game control program for controlling game on the basis of a position input received via touch panel | |
US9751019B2 (en) | Input methods and devices for music-based video games | |
JP5081399B2 (en) | GAME DEVICE, PROGRAM, AND INFORMATION RECORDING MEDIUM | |
US20080300033A1 (en) | Storage medium storing puzzle game program, puzzle game apparatus, and puzzle game controlling method | |
Teather et al. | Tilt-Touch synergy: Input control for “dual-analog” style mobile games | |
JP2015008987A (en) | Program and game device | |
Zheng et al. | BlockTower: A Multi-player Cross-Platform Competitive Social Game | |
JP6919050B1 (en) | Game system, program and information processing method | |
WO2023002907A1 (en) | Information processing system, program, and information processing method | |
JP6980748B2 (en) | Display control program, display control method, and display control system | |
JP5354820B2 (en) | Input processing program and input processing apparatus | |
JP7368957B2 (en) | Programs and information processing equipment | |
JP4724758B2 (en) | Input processing program and input processing apparatus | |
Shafana et al. | Investigating the role of gesture modalities and screen size in an AR 3D game |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |