CN102159290A - Touch sensing gaming peripheral for musical game - Google Patents

Touch sensing gaming peripheral for musical game Download PDF

Info

Publication number
CN102159290A
CN102159290A CN2009801360660A CN200980136066A CN102159290A CN 102159290 A CN102159290 A CN 102159290A CN 2009801360660 A CN2009801360660 A CN 2009801360660A CN 200980136066 A CN200980136066 A CN 200980136066A CN 102159290 A CN102159290 A CN 102159290A
Authority
CN
China
Prior art keywords
player
haptic effect
actuator
peripheral hardware
main body
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2009801360660A
Other languages
Chinese (zh)
Other versions
CN102159290B (en
Inventor
丹尼·A·格兰特
罗伯特·拉克鲁瓦
埃林·拉姆齐
亨德里克·巴特尔
珍妮弗·扬森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Immersion Corp
Original Assignee
Immersion Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Immersion Corp filed Critical Immersion Corp
Publication of CN102159290A publication Critical patent/CN102159290A/en
Application granted granted Critical
Publication of CN102159290B publication Critical patent/CN102159290B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • A63F13/28Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
    • A63F13/285Generating tactile feedback signals via the game input device, e.g. force feedback
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/21Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • A63F13/2145Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20Input arrangements for video game devices
    • A63F13/24Constructional details thereof, e.g. game controllers with detachable joystick handles
    • A63F13/245Constructional details thereof, e.g. game controllers with detachable joystick handles specially adapted to a particular type of game, e.g. steering wheels
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80Special adaptations for executing a specific game genre or game mode
    • A63F13/814Musical performances, e.g. by evaluating the player's ability to follow a notation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/32Constructional details
    • G10H1/34Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
    • G10H1/342Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments for guitar-like instruments with or without strings and with a neck on which switches or string-fret contacts are used to detect the notes being played
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1037Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1062Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted to a type of game, e.g. steering wheel
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8047Music games
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/155Musical effects
    • G10H2210/195Modulation effects, i.e. smooth non-discontinuous variations over a time interval, e.g. within a note, melody or musical transition, of any sound parameter, e.g. amplitude, pitch, spectral response, playback speed
    • G10H2210/221Glissando, i.e. pitch smoothly sliding from one note to another, e.g. gliss, glide, slide, bend, smear, sweep
    • G10H2210/225Portamento, i.e. smooth continuously variable pitch-bend, without emphasis of each chromatic pitch during the pitch change, which only stops at the end of the pitch shift, as obtained, e.g. by a MIDI pitch wheel or trombone
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/135Musical aspects of games or videogames; Musical instrument-shaped game input interfaces
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/135Musical aspects of games or videogames; Musical instrument-shaped game input interfaces
    • G10H2220/145Multiplayer musical games, e.g. karaoke-like multiplayer videogames
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/265Key design details; Special characteristics of individual keys of a keyboard; Key-like musical input devices, e.g. finger sensors, pedals, potentiometers, selectors
    • G10H2220/305Key design details; Special characteristics of individual keys of a keyboard; Key-like musical input devices, e.g. finger sensors, pedals, potentiometers, selectors using a light beam to detect key, pedal or note actuation
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/395Acceleration sensing or accelerometer use, e.g. 3D movement computation by integration of accelerometer data, angle sensing with respect to the vertical, i.e. gravity sensing.
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2230/00General physical, ergonomic or hardware implementation of electrophonic musical tools or instruments, e.g. shape or architecture
    • G10H2230/045Special instrument [spint], i.e. mimicking the ergonomy, shape, sound or other characteristic of a specific acoustic musical instrument category
    • G10H2230/075Spint stringed, i.e. mimicking stringed instrument features, electrophonic aspects of acoustic stringed musical instruments without keyboard; MIDI-like control therefor
    • G10H2230/135Spint guitar, i.e. guitar-like instruments in which the sound is not generated by vibrating strings, e.g. guitar-shaped game interfaces
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/315Sound category-dependent sound synthesis processes [Gensound] for musical use; Sound category-specific synthesis-controlling parameters or control means therefor
    • G10H2250/441Gensound string, i.e. generating the sound of a string instrument, controlling specific features of said sound
    • G10H2250/445Bowed string instrument sound generation, controlling specific features of said sound, e.g. use of fret or bow control parameters for violin effects synthesis
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2250/00Aspects of algorithms or signal processing methods without intrinsic musical character, yet specifically adapted for or used in electrophonic musical processing
    • G10H2250/315Sound category-dependent sound synthesis processes [Gensound] for musical use; Sound category-specific synthesis-controlling parameters or control means therefor
    • G10H2250/461Gensound wind instruments, i.e. generating or synthesising the sound of a wind instrument, controlling specific features of said sound

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

A touch sensing gaming peripheral that simulates a musical instrument includes a body, a first sensing element and a first actuator. A processor, located within the body of the gaming peripheral, communicates with a host computer running a software program corresponding to a musical game. The first sensing element, disposed within the body and coupled to the processor, senses an input from the user. The sensed input is communicated to the host processor. The first actuator, disposed within the body and coupled to the processor, outputs a touch effect in response to receiving an activating signal based on an event that occurs in the software program. In some implementations, the first sensed element is disposed proximate to the first actuator so that the user senses the touch effect in response to the input provided by users.

Description

A kind of tactilely-perceptible recreation peripheral hardware that is used for music game
Related application
The application requires based on U.S. Provisional Patent Application sequence number NO.61/087,917 senior interest, this application was submitted on August 11st, 2008, the inventor is Danny A.Grant, RobertLaCroix, Erin Ramsay and Hendrik Bartel, title are " Haptic Enabled Guitar " (" tactilely-perceptible guitars "), and its full content is contained in this.
Technical field
Disclosure of the present invention relates generally to a kind of tactilely-perceptible recreation peripheral hardware that is used for music game.
Background technology
Guitar Hero and RockBand are the music electronic recreation famous with the controller of its musical instrument shape, this controller is used by the player, thereby the performance of analog music is by (for example: colored note button on the sound column on the guitar (fret), the wind instrument or the like) is presented on the screen corresponding to the different buttons on the controller.These recreation support the individual to play, and also support two or more players' cooperation and competitive mode.Several household electronic gaming platforms (for example Playstation of Sony, the Wii of Nintendo, the Xbox of Microsoft or the like) and hand-held and moving game system have been issued in these recreation altogether.
For example, when playing games as the recreation peripheral hardware, on screen, demonstrate the guitar neck of extension vertically, and along with song is carried out, the colour-coded of symbol note is by the numbers along with music moves down along screen with guitar.The color of note and position and those different sound column buttons couplings on the guitar controller.In case the mobile note on the screen arrives colour-coded, the player must play the note that illustrates by the rocking bar of pressing on correct sound column button (promptly selecting the finger position on the sound column plate) and the operation guitar of manipulating the strings (strum bar) (promptly impacting or play " virtual string ") for score.Success or failure will cause that the counter on the screen changes, and demonstrate this player and how play (indicating by the redness on the counter, yellow and green portion).Just in case counter drops on below the red part, song will stop automatically, and the player is hissed stage by spectators.Successful note impacts will increase player's score, and impacts by impacting a lot of continuous successful note, and the player can increase its score multiplying power.
Song choose the luminous note that specific paragraph will have the star profile, thereby all notes that successfully impact in this string will be full of a private counter.By using trill rocking bar (whammy bar) during the lasting note in these paragraphs, also can be full of this private counter.In case private counter is filled half at least, the player can activate some recreation and strengthen (gaming enhancement) by pressing select button or immediately guitar being lifted to a vertical position.When the recreation enhancing was activated, the score multiplier doubled, and strengthened up to recreation to exhaust.When recreation strengthens when being activated, counter also increases more significantly, makes that the player is easier counter is remained on high level.
The note that shows on the screen can be the combination of two to four notes of monophonic note or formation and sound.Monophonic note and and sound can continue, as along with the indication of the multi-color cord of note mark, whether this depends on to exist in the song of playing and continues and sound or chord.During continuing note, the player can use the trill rocking bar on the guitar to change the pitch or the tone of note.In addition, only but needn't stir the rocking bar of manipulating the strings by the fingering that changes on the sound column button, these recreation support " beating string " (hammer-ons) with " drawing string " (pull-offs) or the virtual enforcement of other guitar playing techniques, these playing techniques are used for successfully playing out the note of quick series.Be applicable to that also finger tapping and other multiplex touch controls interact.
For some electronic game platform, the Wii of Nintendo for example combines the remote controller of Wii in the recreation peripheral hardware that the player plays.Equally, this recreation peripheral hardware has the potential of tactile feedback, because the Wii remote controller has the ability of output haptic effect.Yet, because the different aspect of Wii remote controller, for example action performance, the haptic effect that the Wii remote controller outputs on the recreation peripheral hardware may be limited.
What need is the tactilely-perceptible recreation peripheral hardware that uses with music game, and it offers player's haptic effect, and this haptic effect provides happy and experience true to nature to the player when the player plays music game.
Summary of the invention
In some embodiments of the present invention, the recreation peripheral hardware comprises the main body of analog instruments.Be positioned at the processor of main body and the main-machine communication of runs software program.The recreation peripheral hardware comprises first actuator of a part that is arranged in main body.Based on event in the software program, first actuator response receives the activation signal of from processor and exports haptic effect.In some embodiments, first actuator is arranged in the part of main body, and this part contacts recreation peripheral hardware or relevant with the interactional position of recreation peripheral hardware with the player.In some embodiments, haptic effect based on relate to the player contact the recreation peripheral hardware or with recreation peripheral hardware interactional incident.
In some embodiments, recreation peripheral hardware simulation guitar, this guitar comprises main body and comprises the neck that extends from main body.Be positioned at the processor of main body and the main-machine communication of runs software program.This guitar comprises first actuator that is arranged in neck.Based on event in the software program, first actuator response receives activation signal and exports haptic effect.In some embodiments, haptic effect based on relate to the player contact the guitar neck or with the interactional incident of guitar neck.
In some embodiments, at least one input element in the main body of first sensor sensing recreation peripheral hardware, and send first transducing signal to the main frame of runs software program.Haptic effect exports the main body of recreation peripheral hardware to by first actuator, wherein based on event in the software program, and first activation signal that first actuator response receives from main frame.In some embodiments, first actuator is arranged in the part of main body, and this part contacts recreation peripheral hardware or relevant with the interactional position of recreation peripheral hardware with the player.In some embodiments, first actuator is arranged in the part of approaching described at least one input element of main body.In some embodiments, the player contacts input element to haptic effect or the incident of interact with input element (or lack respectively (lack)) based on relating to.
In some embodiments, the guitar that the simulation of recreation peripheral hardware has main body, this guitar also comprises the neck that extends from main body, the selection of at least one input element in the first sensor sensing guitar neck, and send first transducing signal to the main frame of runs software program.Haptic effect exports neck to by first actuator, wherein based on event in the software program, and first excitation signal that first actuator response receives from main frame.In some embodiments, first actuator is arranged in the neck of guitar.In some embodiments, first actuator is positioned at the position near described at least one input element.In some embodiments, the player contacts input element to haptic effect or the incident of interact with input element (or lacking respectively) based on relating to.
In different embodiments of the present invention, actuator is positioned at main body or the otherwise position that contacts the recreation peripheral hardware near the player.In different embodiments of the present invention, actuator is positioned at the interactional position of main body or other aspects with the recreation peripheral hardware near the player.In different embodiments of the present invention, actuator is positioned at the position near input element, provides input by the recreation peripheral hardware to recreation this position player.
In some embodiments, recreation peripheral hardware simulation guitar, first actuator are configured to export haptic effect to the palm of the hand side of neck or to the sound column side of neck.In some embodiments, neck comprises at least one input element, for example can press button, touch pad or touch-screen.In some embodiments, at least one sensing element coupling (couple) is in input element, thus echo probe to input element selected by first picking of player, sensing element is exported first transducing signal to main frame.In some embodiments, guitar comprises second actuator that is positioned at main body, wherein the corresponding event that takes place in the software program in response of second actuator and when receiving second excitation signal, second actuator is exported corresponding haptic effect to main body.
In some embodiments, sensing element is configured to, detected after the player selected input element at sensing element, respond the finger that this sensing element detects the proficiency that the player moves along the direction of input element, and change first transducing signal, the update software program correspondingly of first transducing signal through changing wherein.In some embodiments, first actuator is configured to, and detects the finger that moves along the direction of input element based on sensing element, responds corresponding excitation signal and changes haptic effect.In some embodiments, guitar further comprises the light-emitting device that is coupled in input element, and wherein light-emitting device is configured to when the luminous signal that receives from main frame luminous.
In some embodiments, guitar comprises the one or more rocking bars of manipulating the strings that are arranged in main body, and the rocking bar of wherein manipulating the strings is configured to, the rocking bar of manipulating the strings that response is moved by second hand of player, and export second transducing signal to main frame.In some embodiments, second actuator is coupled in the rocking bar of manipulating the strings, wherein based on event in the software program, second actuator when the excitation signal that receives from main frame to the rocking bar output haptic effect of manipulating the strings.In the embodiment of a plurality of rocking bars of manipulating the strings, each rocking bar of manipulating the strings all can be by player's independent operation.In some embodiments, guitar comprises trill rocking bar that is coupled in main body and the 3rd sensing element that is coupled in the trill rocking bar, and wherein the 3rd sensing element is configured to, and when the player operates the trill rocking bar, exports the 3rd transducing signal to main frame.In some embodiments, when second actuator receives second excitation signal at the operated trill rocking bar of response, export corresponding haptic effect to main body.In some embodiments, guitar comprises the 3rd actuator that is coupled in the trill rocking bar, and wherein the 3rd actuator is configured to, when the corresponding excitation signal that receives from main frame, to trill rocking bar output haptic effect.
In some embodiments of the present invention, recreation peripheral hardware simulation stringed musical instrument.In some embodiments of the present invention, stringed musical instrument can include but not limited to acoustic guitar, electric guitar, bass guitar, violin, mandolin, violoncello, bass, Banjo or other stringed musical instruments.
In some embodiments of the present invention, recreation peripheral hardware simulative tube musical instrument.In some embodiments of the present invention, wind instrument can include but not limited to clarinet, saxophone, oboe, flute or other wind instruments.
In some embodiments of the present invention, recreation peripheral hardware analog brass device.In some embodiments of the present invention, brass instrument can include but not limited to loudspeaker, trombone, large size, baritone musical instrument or other brass instruments.
In some embodiments of the present invention, recreation peripheral hardware simulating keyboard musical instrument.In some embodiments of the present invention, keyboard instrument can include but not limited to piano, organ, electric keyboard instrument, synthesizer, accordion or other keyboard instruments.
In some embodiments of the present invention, recreation peripheral hardware simulation percussion instrument.In some embodiments of the present invention, the recreation peripheral hardware is simulated a plurality of percussion instruments.In some embodiments of the present invention, percussion instrument can include but not limited to snare drum, bass drum, forte cymbals, one or more small drum, step on cymbals and/or other percussion instruments.
Description of drawings
Comprise this specification into and constitute the accompanying drawing of a specification part, show the example of one or more embodiments of the present invention, accompanying drawing is used from explanation one and explains principle of the present invention and each side.
In the accompanying drawings:
Fig. 1 illustrates the stereogram of the recreation peripheral hardware of each embodiment according to the present invention, for example guitar.
Fig. 2 illustrates the block diagram of the tactilely-perceptible recreation peripheral hardware of each embodiment according to the present invention.
Fig. 3 illustrates the front view of the tactilely-perceptible recreation peripheral hardware of each embodiment according to the present invention.
Fig. 4 illustrates the side view according to the neck of the guitar with sound column button of traditional recreation peripheral hardware.
Fig. 5 illustrates the side view of the neck of the guitar with sound column button of different embodiments according to the present invention.
Fig. 6 A and 6B illustrate the side view of the neck of the guitar with sound column button of different embodiments according to the present invention.
Fig. 7 illustrates the front view according to the rocking bar of manipulating the strings of traditional recreation peripheral hardware.
Fig. 8 illustrates the front view of the rocking bar of manipulating the strings of the guitar of different embodiments according to the present invention.
Fig. 9 A and 9B illustrate the rocking bar of manipulating the strings of the guitar of the different embodiments according to the present invention.
The specific embodiment
Though is different instances and the embodiment that background has been described the tactilely-perceptible recreation peripheral hardware that uses with music game at this with the tactilely-perceptible guitar, the invention is not restricted to this.Below explanation only is exemplary, and does not limit the present invention in any way.Other recreation peripheral hardware and and embodiment will enlighten those skilled in the art easily with disclosure interests.The detailed reference of the different embodiments of the present invention shown in accompanying drawing will be provided now.In whole accompanying drawings and the following description, will use identical reference number to represent same or analogous project.
For clear, not that all conventional features of embodiment described here all are shown and described.Certainly, be understood that, in the exploitation of any this actual embodiment, must make the exclusive decision of numerous enforcement, thereby realize developer's specific purpose, for example meet the relevant constraint relevant of application with commerce, and should be understood that these specific purposes for different embodiments and different developer with difference.In addition, should be understood that this development effort may be complicated and expend time in, but be customary engineering duty for those of ordinary skills with disclosure interests.
According to the disclosure, those of ordinary skills will understand, also can use device with less versatility, for example hardwire device, field programmable gate array (FPGA), application-specific integrated circuit (ASIC) or the like, and can not depart from the scope and spirit of inventive concept disclosed herein.Wherein, the method that comprises series of processing steps is implemented by computer or machine, and these treatment steps can be used as a series of machine readable instructions storages, they can be stored on the tangible medium, for example the program storage of Computer Memory Unit (for example ROM (read-only storage), PROM (programmable read only memory), EEPROM (EEPROM), flash memory, USB flash disk or the like), magnetic recording medium (for example CD-ROM, DVD-ROM, paper card, paper tape or the like) and other types.
Fig. 1 illustrates the stereogram of the recreation peripheral hardware of each embodiment according to the present invention.More specifically, as shown in the figure, this recreation peripheral hardware simulation guitar, and will describe each embodiment of the present invention as background now is for purpose clearly, and not in order to limit.As shown in Figure 1, guitar 100 comprises main body 102, and this main body has front surface 104 and rear surface 106.In addition, guitar 100 comprises neck 108, has sound column plate 110 on the neck, and the sound column plate has end 110A that intersects with main body 102 and the opposed end 110B that attaches to head 112.In the recreation, interactional two main region are between player and the guitar 100: 1) near five of head 112 input sensing elements 114, and 2) the rocking bar 116 of manipulating the strings on the front surface 104 of main body 102.Except interactional zone, the different piece of player's health can contact guitar 100, include but not limited to: the contacting of the contacting of player's hand and neck 108, player's hip or leg and rear surface 106, player's arm contacts with the part of front surface 104, or other contacts.In different embodiments, sound column plate 110 can comprise other input sensing element 118 at the octave sound column place near main body 102.In addition, guitar 100 can comprise trill rocking bar 120 and one or more action button 122 on front surface 104.Though the structure at the guitar shown in this is similar to
Figure BDA0000050385550000081
Guitar, but should notice that the guitar of any other pattern all can be considered as the tactilely-perceptible guitar.
The guitar that Fig. 2 illustrates with each embodiment according to the present invention is the block diagram of the tactilely-perceptible recreation peripheral hardware of background.Guitar 100 comprises and connects the transceiver port 124 (Fig. 1) of guitar 100 to electronic game platform 99 (below be also referred to as " main frame ").In some embodiments, transceiver port 124 connects guitar 100 and main frame 99 by electric wire.In some embodiments, transceiver port 124 wirelessly connects guitar 100 and main frame 99.Main frame 99 can be connected in the display 98 of the graphics environment that shows electronic game.Perhaps play music from electronic game with display 98 one or with loudspeaker 97 sense of hearings of displays separated ground.In some embodiments, loudspeaker 97 is integral parts of sense of touch guitar 100.
In some embodiments, as shown in Figure 2, comprise one or more local processors 126 in the guitar 100, these local processors are connected in one or more input sensing elements, under the background of guitar, these input sensing elements are depicted as sound column button sensing element 126, manipulate the strings rocking bar sensing element 130 and/or trill rocking bar sensing element 132.Should understand that other sensing elements can be used for other musical instruments.Particularly, local processor 126 is configured to receive and handle the information signal from sensing element 128,130,132, and these information signals of communicating by letter with main frame 99.In addition, local processor 126 is connected in one or more actuators, under the background of guitar, these actuators are depicted as neck or sound column plate actuator 134, the rocker actuator of manipulating the strings 136, trill rocker actuator 138 and/or main body actuator, can comprise in these actuators any one or a plurality of.Based on higher management or crossfire instruction from main frame 99, local processor 126 provides haptic effect signal to different actuators 134,136,138,140.In some embodiments, voltage swing and duration are flowed (stream) to guitar, thereby provide information by main frame to actuator.
In the operation, main frame 99 can provide high level instructions to local processor 126, the type (for example vibrate, rock (jolt), stop (detent), blow (pop) or the like) of the haptic effect by one or more selected actuators 134,136,138,140 outputs for example, thus local processor 126 indication actuators 134,136,138,140 are about the special feature (for example size, frequency, duration or the like) of haptic effect that will output.
Local processor 126 can be included in the guitar 100, and usually can not be easily removes from the shell (for example Xbox, Playstation3 or the like) of guitar 100.In some embodiments, local processor 126 is arranged in special-purpose electronic game controller (for example Wii remote controller), and it is included in the guitar 100 removedly.In these embodiments, local processor 126 is arranged in the electronic game controller, and reception is communicated by letter from the information signal of sensing element 128,130,132 and with main frame 99.In some embodiments, the local processor 126 in the electronic game controller can provide the instruction and controlled actuator 134,136,138,140 in any one or a plurality of.The processor in the electronic game controller of special use, guitar 100 also can comprise special-purpose local processor, thereby sends Processing tasks, communication and instruction between a plurality of processors efficiently, to realize higher speed, bandwidth and flexibility.
Fig. 3 illustrates the tactilely-perceptible guitar of each embodiment according to the present invention.In Fig. 3, guitar 100 comprises the one or more actuators 134 that are coupled in input sensing element 114.In some embodiments, can use an actuator to more than one or even all sound column button output haptic effect.Though it should be noted that not shown sound column button (opposite with Fig. 1) near main body among Fig. 3, this sound column button and corresponding actuator also are considered.As mentioned above, the rocker actuator 136 of manipulating the strings is coupled in the rocking bar 116 of manipulating the strings.In some embodiments, actuator 138 can be used for exporting haptic effect to trill rocking bar 120.In some embodiments, one or more actuators 140 also can be positioned at along the neck 110 of guitar 100 and/or the diverse location of main body 102.Particularly, neck 110 can comprise actuator 134, thereby the haptic effect of output is directly being felt (playing at the right hand under the situation of guitar) on player's left hand.Should note, though in Fig. 3, do not illustrate especially, but actuator 134 is positioned under the input sensing element 114 and/or 118, thereby when pushing sensing element 114,118, the haptic effect of output is directly being felt (under the situation of right hand performance guitar) on player's left hand.These actuators are optionally exported haptic effect, thus for the player provides sensation true to nature, promptly guitar be exist and during playing, feel true to nature.
In some embodiments, one or more actuator 140 is activated as target, makes 100 some (for example part or all of main body, neck) output of whole guitar haptic effect.The position of actuator is exemplary among Fig. 3, and the actuator of any number all can be applicable to any desired location of guitar.In some embodiments of the present invention, actuator can be placed on and contact the position of guitar near the player on the guitar 100.
In some embodiments, can be used for triggering at this part place of guitar from the input of a part of guitar or near the actuator of this part.In some embodiments of the present invention, can be used for triggering the actuator at other part places of guitar from the input of a part of guitar.In some embodiments of the present invention, with from the input of guitar independently game events can be used for triggering the actuator at guitar different piece place.Should understand that different inputs and/or game events can be used for triggering different actuators.By limiting examples, can trigger the next actuator 134 of guitar 100 from the input of the rocking bar sensing element 130 of manipulating the strings.
Consider dissimilar actuators, include but not limited to off-axis rotary inertia (ERM) actuator, linear resonance actuator (LRA), piezo-activator, voice coil actuator, electroactive polymer (EAP) actuator, marmem or the like.
Fig. 4 illustrates the side view of the neck of traditional electronic game guitar controller.Go out as shown in Figure 4, shown neck 200 comprises five input sensing elements, these input sensing elements by sound column 204 separate can be by sound column button 202 forms, and from the top surface 206 outstanding distance D of neck.In any embodiment of being discussed herein, consider that guitar can be configured to not have any sound column 204.Estimated distance D is approximately 1.5 millimeters (1/16 inches).Sound column button 202 is upwards pushed away by spring 208, thereby the player overcomes power upwards by applying power and button 202 is pushed distance D downwards on the top surface of button 202.When specific button 202 is pushed downwards, switch (not shown) record, and indication main frame 99 players have played out a note.
Yet the structure of the sound column button 202 of traditional guitar controller causes several shortcomings.In these shortcomings one is that finger must move the abundant distance of growing and writes down and play a note.This has hindered the speed of carrying out, because long distance D does not allow player's finger to move soon as it can move.In addition, after the recreation of playing q.s, long displacement can cause the player to feel fatigue or injure.In addition, the conventional construction of button may be made very big noise and provide soft (spongy) to confirm when button is pressed.This can divert one's attention from game experiencing, because the button sound during pressing is with respect to the volume of music very remarkable (Fig. 2) of loudspeaker 97 outputs.
Fig. 5 illustrates the side view of the guitar neck of different embodiments according to the present invention.As shown in Figure 5, neck 300 utilizes the sensing element 302 that is arranged in neck 300 to overcome one or more shortcomings of traditional guitar controller.In some embodiments, sensing element 302 is capacitive sensing elements 302 and can be suspended in the neck 300.This sensing element can be configured to comprise as shown in the figure by sound column 306 separated five capacitive character sensing buttons 304.In some embodiments, the capacitive character sensing button that can use five independences and separate.Each sensing button 304 carries out color coding respectively by the color scheme scheme in the existing electronic game guitar controller.In some embodiments, the input sensing element is configured to wherein have LED or other light emitting sources, thereby or when the player presses the sound column button, perhaps being prompted to press the sound column button when pounding out correct note as the player, the sound column button is lighted.
When player's finger applies predetermined power on sound column button 304, the variation of capacitive character sensing button 304 sense capacitance.Though the button 304 that illustrates flushes with the top surface 308 of neck 300, button 304 also can be raised or recessed a little with respect to the top surface 308 of neck 300.In some embodiments, button 304 is programmed, thereby when button is applied the pressure of threshold amount, writes down them and be pressed.This allows button 304 to be pushed by the player downwards, has not played a note in fact and do not write down the player.In other words, the player can exert pressure on button 304 (rather than in fact sensor does not read input), thereby alleviates the pressure on player's wrist and the articulations digitorum manus.In some embodiments, can use the sensing element with sensing button, these sensing buttons adopt the resistive touch technology operation opposite with the capacitance touch technology.
Fig. 6 A and 6B illustrate the side view of the sound column button of the different embodiments according to the present invention.As shown in Figure 6A and 6B, the guitar utilization is arranged in the optics input sensing element 402 of neck 400, thereby the sensing player is to the selection of input sensing element (with the form of sound column button) 404 in recreation.In some embodiments, each sound column button 404 all comprises optical sensor 402, thereby guitar comprises five optical sensors being separated by sound column 410 (perhaps ten, if comprise other input sensing element 118 near main body).In some embodiments, an optical sensor is arranged in neck 400, and is configured to comprise five optical sensing parts that are divided into independent button and separated by sound column 410.In some embodiments, optical pickocff 402 comprises emitter/receiver element 406, this element emits light into the basal surface 408 of sound column button 404, and whether confirming button is pressed by the light quantity of emitter/receiver 406 emissions and reception subsequently thereby the emitter/receiver element is by continuous measurement.
In some embodiments, the top surface of sound column button 404 is configured to have some flexibilities, thereby when player's finger 96 applied the power of scheduled volume on the top surface of sound column button 404, this top surface can move in downward direction.When the player applies force to sound column button 404, the variation in the light that is received in the certain Measuring Time of emitter/receiver 406 sensings.In case the threshold that emitter/receiver 406 senses in the light changes, optical sensor 402 just sends the transducing signal that indication sound column button 404 has been pressed to processor 126.Threshold changes can be arranged to like this: sound column button 404 can slightly be pushed downwards and not write down the player and played a note by the player.This allow the player exert pressure on the button 404 (rather than sensor in fact do not trigger note select) thus alleviate pressure on player's wrist and the articulations digitorum manus.In limiting examples, this threshold changes can be arranged to press sound column button 404 above 400 microns with respect to the player.The advantage of optical sensor 402 is, player's his or her finger of can having a rest on sound column button 404, and trigger button 404 unexpectedly not.In addition, optical sensor 402 allows players (for example to play powerful chord) along the sound column button 404 his or her finger that slides as real guitar, and needn't raise his or her finger, reorientates finger and press (as existing game console guitar) then.
In some embodiments, comprise 4,5,6 or 12 ridge or slit on the sound column plate, wherein each ridge or slit are represented part or all string that lays along the sound column plate.Ridge or slit will play the effect of string, thereby when the player pushes or be placed on his or her finger on the string, sensor will sense.Processor can receive the information about sound column chord number (for example the 4th sound column, three strings), and output represents the signal of sound column position, and this signal can be play by loudspeaker.To export haptic effect, thereby offer player's experience true to nature, promptly he has supressed string.This can be used for the training tool as guitarist beginner.
The tactilely-perceptible guitar can have the input sensing element of touch element form, for example touch-screen or touch pad.In some embodiments, touch element can be along the part of sound column plate or along its whole length, thereby one or more sound column comprises touch element, and this touch element sensing player's finger contacts with touch element.In some embodiments, touch element is a touch-screen, and it shows one or more string, thereby the touch element on the contiguous sound column makes the multiple row string can be positioned at a plurality of positions along the sound column plate.In some embodiments, the player pressed during touch-screen can be lighted and sing that root string and/or button.This also is feasible for many strings and a plurality of sound columns that intersect, as when playing powerful chord or glissando guitar.Sound column plate touch element can be used for training the player how to use the tactilely-perceptible guitar.The touch cognition technology that it should be noted that any other type all can be used for the sensing player and presses the input sensing element.Each embodiment of the present invention can comprise the use of one or more charge coupled devices (CCD) or pressure sensor, with the finger position on sensing and the monitoring sound column plate.In some embodiments, during the recreation, except virtual string, touch-screen also can show chart.In one example, when the player had hit continuous note bar or hit high score, touch-screen can show cheerful and light-hearted flash of light arrow or the star that moves along neck.
In some embodiments, when player's finger by on the input sensing element when increasing other real guitar effect, can use above-mentioned any input sensing element to measure the change in location of finger in a period of time.For example, the sensing element finger of measuring the player up and/or down motion on perpendicular to the direction of the rocking bar of manipulating the strings.This element can send then and indicate the player just at the transducing signal of the virtual string of stretch bending (and thereby regulate note).Therefore correspondingly, main frame can be adjusted note and/or and the accent of sound.In some embodiments, when sensing element was measured player's the selection of finger, sensing element can provide the transducing signal of representing trill and rock the sound column button apace.Correspondingly, therefore main frame will adjust the accent of note apace.In some embodiments, stretch bending and/or trill feature can be similar to the player and operate the effect that the trill rocking bar produces.
In some embodiments, guitar comprises the one or more actuators 128 that are arranged in neck, and actuator is coupled in processor in neck.To actuator be discussed with reference to figure 5, but it should be noted that actuator can use with above-mentioned any input sensing element.Actuator 128 is configured to when being activated by processor 126 the output haptic effect to sensing button 304, thus at player's finger player's when specific sound column button contacts doigte to haptic effect.Though it should be noted that to illustrate and described an actuator, can use more than one actuator.Opposite with the parts that separate, can consider that actuator and sensing element are parts of one.
Now with reference to Fig. 5 the operation of input sensing element is discussed, but it should be noted that in other sensing elements that this operation also can be applicable to this place discuss any one or whole.Between game play session, the player by on one or more input sensing elements 304, impacts a note thereby combine with electronic game with his or her finger, and then sensing element 302 selections of detection player on 304 buttons.In case detect selection, sensing element 302 just sends or launches transducing signal to processor 126, and the player presses this specific sensing element 304 for certain with indication.Processor 126 can send represent transducing signal information to main frame 99, thereby main frame 99 relatively from the information that illustrates on the reception information of guitar and the display screen 98, thereby determine whether coupling.If coupling, then corresponding note in the song or chord can be heard by loudspeaker 97.In some embodiments, main frame 99 can send higher management and instruct to processor 126, with output haptic effect on button 304 and with the type (for example vibrate, rock or the like) of haptic effect of output.Processor 126 receives this instruction and activates actuator 128, to export selected haptic effect to this specific button 304.The player feels this haptic effect and be apprised of and selected correct note and/or button 304.Based on the corresponding sound of hearing in the song of playing, main frame and/or local processor can be indicated will be by the type of the haptic effect of actuator output.For example, can indicate actuator output to rock, the string that its representative is being played to the sound column button and/or the rocking bar of manipulating the strings.In another example, when the long lasting note of one of correct performance, can indicate actuator to export a short arc and/or low amount is vibrated to the sound column button.Similarly, when correct performance chord, can indicate actuator to export a short arc and/or low amount is vibrated to two or more sound column buttons.In some embodiments, controller can be configured to can cause haptic effect with the triggering of absonant note of music or chord, perhaps ear-piercing and/or offending haptic effect.
In some embodiments of the present invention, different haptic effects can be sent to different sound column buttons.In some embodiments of the present invention, different haptic effects can be sent to identical sound column button in the different time.In some embodiments of the present invention, according to the note type in the song of playing (for example whole note, minim, 1/4th notes or the like), different haptic effects can be sent to identical sound column button.In some embodiments of the present invention, according to separately (for example staccato, Legato, beat string, draw string or the like) between the note in the song of playing, different haptic effects can be sent to identical sound column button.In some embodiments of the present invention, according to guitar or the more generally type and the sensation of stringed musical instrument, different haptic effects can be sent to a plurality of sound column buttons.
As mentioned above, the rocking bar 116 of manipulating the strings can be used as the input element of sense of touch guitar, because electronic game usually requires the player to imitate playing or playing of virtual string and selected button 114 by moving the rocking bar of manipulating the strings pivotally up and/or down.As shown in Figure 7, the structure of the rocking bar of manipulating the strings on the tradition guitar controller is such, its by default value by elastic force push center C, and move to terminal position E pivotally around axle A, thereby have only when the rocking bar of manipulating the strings arrives the position E of its end of travel, the switch that is coupled in the rocking bar of manipulating the strings just sends activation signal to processor.Its unfavorable and unrealistic part is that real guitar technology may require very fast playing and/or playing, thereby forces limited and the string that plucks the strings of a guitar accurately.Just send activation signal by the rocking bar of only manipulating the strings when the rocking bar of manipulating the strings arrives its terminal position E, this can not provide truly feels to the player when the player impacts virtual string, or even whether impacts the truly feels of virtual string.
Yet in some embodiments of the present invention, actuator 136 exportable haptic effects are to the rocking bar 116 of manipulating the strings, to transmit the sensation of string.May be favourable during this bass guitar in the player operates video games, wherein the string than conventional guitar is heavier usually for the string of bass guitar.In some embodiments, the kinaesthesia haptic effect rocking bar 116 that can be applicable to manipulate the strings, so that perceive virtual string " weight " or " gently ", thereby thereby requiring the player to apply different power to the rocking bar 116 of manipulating the strings hits a note.This can finish by actuator 136 being coupled in manipulate the strings rocking bar 116 and change the resistance that is applied to actuator 136.In some embodiments, can consider the inertial haptic effect, trigger the vibration that produces by actuator 136 so that impact the rocking bar 116 of manipulating the strings.Similar effect can be applied to the sound column button, thereby simulation is being played different strings or play different strings on identical guitar on the different guitars.Especially, according to the size of string, the exportable different resistance of actuator comes musical notes to the sound column button thereby require the player to apply different power.
Fig. 8 illustrates the side view of the rocking bar of manipulating the strings of different embodiments according to the present invention.As shown in Figure 8, cross the center along either direction when mobile pivotally when the rocking bar 500 of manipulating the strings of guitar, the rocking bar 500 of manipulating the strings sends activation signals.In some embodiments, when moving along either direction, the rocking bar 500 of manipulating the strings crosses centre position C one angle θ and when arriving centre position I, the rocking bar of manipulating the strings writes down virtual string and impacted.The rocking bar of considering to manipulate the strings is movable to the extreme position E of stroke as shown in Figure 7, yet when center C is crossed in the position of center-pole 502, the rocking bar sensor 130 transmission activation signals of manipulating the strings.This is impacting, is playing or playing the experience more true to nature that virtual string is provided to the player when manipulating the strings rocking bar 500.
As shown in Figure 8, actuator 136 is coupled in the rocking bar 500 of manipulating the strings, thus actuator 136 output haptic effects to the rocking bar 500 of manipulating the strings, the player feels described haptic effect then, thereby indicates a note or chord by continuous playing or playing.Actuator 136 can be programmed, thereby when the player used the rocking bar of manipulating the strings only to hit a note, rocking bar output was rocked by manipulating the strings.In some embodiments, actuator 136 can be programmed, thus when the player plays chord, the output intensive stop in a series of intervals on the rocking bar 500 of manipulating the strings, wherein each stop representative impacts each root in the many strings.In some embodiments, the rocker actuator of manipulating the strings 136 and one or more sound column button actuator 134 (Fig. 2) can be activated simultaneously, thereby simulate the sound of one or more string when playing a note or chord.For example, when the player plays in electronic game when continuing note, can rock or pulse, can vibrate by 134 outputs of sound column button actuator simultaneously by rocker actuator 136 outputs of manipulating the strings.In addition, as mentioned above, the actuator in the neck is activated, with the haptic effect of feeling on the output player left hand (playing at the right hand under the situation of guitar), simultaneously by the output of the actuator on the rocking bar 500 of manipulating the strings haptic effect.In some embodiments, the one or more actuators in the main body are activated, and with the haptic effect that the output player feels, export haptic effect by the actuator on the rocking bar 500 of manipulating the strings simultaneously.In some embodiments of the present invention, can implement trill rocking bar 120 about the rocking bar 500 similar modes of manipulating the strings with above-mentioned.
This can offer the sense of touch indication of player with one or more virtual string.In addition, the player adjusts the physical motion of hand by utilizing tactile data, can optimization the speed and the accuracy of his or she recreation.In addition, actuator 136 can improve player's experience in conjunction with (center-based) based on the center haptic effect that the rocking bar structure provided of manipulating the strings, and manipulates the strings rocking bar 500 picture really or have a sensation true to nature because will feel.
In some embodiments, the rocking bar of the manipulating the strings element (as touch pad or touch-screen) that can be touched replaces, and wherein sensing should finger when player's finger contact touch element for touch element.The exportable corresponding transducing signal of touch element is as by the above-mentioned signal that rocking bar produced of manipulating the strings.In some embodiments, touch element shows one or more virtual string, thereby the player can select in the shown string arbitrary or all by moving his or her finger along touch-screen on shown string.Touch element can comprise one or more actuators of coupling with it, and described actuator offers independently haptic effect of player, to simulate the sensation of playing on the string of virtual demonstration.In some embodiments, touch element can be programmable, with the desired number that shows virtual string (for example 4,5,6 or 12).
In some embodiments, guitar can utilize real string rather than the touch element or the rocking bar of manipulating the strings, and wherein the player plays or impact described string.The power sensor can be coupled in this string, thereby the power sensor can be determined the player and when impacts string.In some embodiments, the player impacts power big or small monitored of string, and then the power of being monitored is emitted to platform with the influence recreation.
In some embodiments, guitar comprises a plurality of rocking bars of manipulating the strings (Fig. 9 A and 9B), and wherein each rocking bar of manipulating the strings is represented of will play or followed different virtual strings more in recreation.As shown in Fig. 9 A, a plurality of rocking bars 600,602,604,606 of laterally manipulating the strings separate and next-door neighbour mutually at interval, thereby look like independent string and play the effect of independent string.As shown in Fig. 9 B, guitar has total rocking bar 700 of manipulating the strings, and this rocking bar of manipulating the strings has a plurality of rocking bar sections 702,704,706,708 of manipulating the strings, and wherein each rocking bar section of manipulating the strings can be moved individually by player's independent finger, plays with the imitation finger.Consider that above-mentioned one or more rocker actuator of manipulating the strings can use with a plurality of rocking bars of manipulating the strings.In some embodiments, guitar comprises a plurality of rocking bars of laterally manipulating the strings shown in Fig. 9 A, and one or more rocking bar of laterally manipulating the strings has a plurality of rocking bar sections of manipulating the strings as shown in Fig. 9 B.
In some embodiments, the exportable haptic effect of tactilely-perceptible guitar is to the trill rocking bar, thereby provides happy experience for the player.As mentioned among Fig. 2, guitar comprises actuator 138, the trill rocking bar that this actuator response is just being operated by the player and export haptic effect on trill rocking bar 120.Especially, but be coupled in the distance that the trill rocking bar sensing element 132 sensing trill rocking bars 120 of trill rocking bar 120 are pushed or spurred by the player, thereby actuator 138 can respond the motion of institute's sensing and output resistance or vibration force.In some embodiments, the motion of the trill rocking bar of institute's sensing can be used to the haptic effect output in other places on the adjusting device (for example the sound column button or the entire body of guitar).When performance length continues note, this feature will be noticeable especially, thereby operation trill rocking bar will be adjusted the haptic effect of feeling on neck and/or the main body.In some embodiments, when impacting the rocking bar of manipulating the strings and continue note, can adjust the trill rocking bar, thereby produce sinusoidal or other adjusted haptic effects, and note intensity continues constant (opposite with the note hangover or the diminuendo that are continuing) to play.
Except the tactilely-perceptible guitar, the software of electronic game can provide additional advantage, for the player provides happier experience.In some embodiments, electronic game can be indicated local processor 126, makes actuator export main body, sound column button and/or the rocking bar of manipulating the strings that is vibrated to guitar for the first time, thus the sensation ardent, true to nature of the guitar that realization is being played.This haptic effect can begin with short arc, and along with the player continues to obtain the recreation timing and increase its amplitude in the effort of simulating " smoothness " experience of playing guitar.In some embodiments, when player's timing stops,, can export discordant haptic effect by arbitrary or all actuators as the indication of giving the player.In some embodiments, actuator is positioned at the back side of main body and before plays the hand zone, and the actuator and the rocking bar of manipulating the strings can be activated to produce above-mentioned sensation.In some embodiments, haptic effect by different actuator outputs can change, this depend on the player in electronic game selected guitar type (for example for " hollow body " guitar, vibration in the main body is bigger, on the contrary, for " solid body " guitar, the vibration in the main body is trickleer).
In some embodiments, guitar can be configured to, and when the player successfully impacted note in recreation, the sense of touch that provides button to press or play incident was confirmed.In other words, can export haptic effect, thereby when the player successfully presses the correct button consistent with shown button on the screen on the guitar, provide button to press or play the affirmation of rocking bar incident by actuator.
In some embodiments, guitar can be configured to export one or more haptic effects, thereby the indication player successfully presses the correct note of predetermined number.For example, in recreation, when the player successfully presses the continuously correct note of predetermined number, the notion of " note bar " is arranged.Exportable one or more haptic effects of guitar from one or more actuators, thus when the player has finished a note bar milestone, reward the player.Also can produce a kind of haptic effect, increase in size along with the player impacts continuous this haptic effect of correct note, wherein the size of this increase is felt on the main body of controller and/or neck.Player one misses a note, and this effect is just reset, and the player knows that he has finished his effect bar.In some embodiments, guitar can be configured to, and when the player presses one or more incorrect button, exports other haptic effect.
As mentioned above, during playing, electronic game can have the player and utilize and beat the string and the ability of drawing string on the guitar.The tactilely-perceptible guitar can be carried out the haptic effect that uses uniqueness when beating string or drawing the string behavior the player, and wherein actuator is being carried out the player on the button of the behavior and exported haptic effect.
A game concepts is point-blank encounter recreation or " competitive mode ", and wherein two players vie each other, successfully to hit maximum number of notes in preset time.A feature in the competitive mode is that during competing, a player starts the project of diverting one's attention that the another one player is divert one's attention.Therefore for example, in competitive mode, the project of diverting one's attention after the startup causes that another one player's screen catches fire, and stops the player to see note in one given period, and thereby suppresses them and successfully hit the ability of note in the period at this section.The project of diverting one's attention can be used for the tactilely-perceptible guitar, wherein the project of diverting one's attention of Qi Donging causes recipient's guitar uncontrollably to vibrate or exports following haptic effect: cause irregular beat or with screen on shown nonsynchronous the beaing of note, perhaps fully lose tactile feedback capability temporarily.
In some embodiments, the distinct signal that accelerometer can send the guitar position on the plate of guitar is to main frame, main frame and then will upgrade incarnation guitar on the screen, thereby coupling player's guitar position.For example, the accelerometer of guitar can sense the back that the player is placed on guitar between his both legs or is placed on him, thereby main frame will indicate electronic game that the shown incarnation that is placed on guitar between his both legs or is placed on his back is shown.
As mentioned above, be each embodiment that background has been described tactilely-perceptible recreation peripheral hardware with guitar 100.Yet, should understand that above-mentioned each embodiment can be suitable for simulating the musical instrument of other types.By example, the description of sound column button 114,118 and its related sensor 128 and actuator 134 can be suitable for the button of different wind instruments and/or the button of different brass flap valve and/or keyboard instrument.Can use other sensor to measure and be applied to different wind instruments or brass air stream and its time by the player.Same by example, the sensor 130 that the rocking bar 116 of manipulating the strings is related with it and the description of actuator 134 can be suitable for other and " play " stringed musical instrument (for example mandolin, Banjo, Hawaiian guitar or the like).Further pass through example, this description can easily extend to the stringed musical instrument (for example violin, violoncello or the like) that requires to use bow, in this case, may expect to use first the recreation peripheral hardware simulate stringed musical instrument and use second the recreation peripheral hardware simulate bow.Still further by example, by musical instrument itself and/or by being used to play the sound mallet or the clave of these musical instruments, this description can extend to the different percussion instrument of simulation.
Though illustrated and described each embodiment and application, for those skilled in the art obviously, under the prerequisite that does not depart from inventive concept disclosed herein, be feasible than above-mentioned more change with disclosure interests.For example, though the above recreation peripheral hardware of having described analog instruments in electronic game and/or music game also can consider to use each embodiment of the present invention to instruct new player how to use musical instrument as training tool.Therefore, within the spirit of claims, do not limit the present invention.

Claims (33)

1. tactilely-perceptible recreation peripheral hardware comprises:
Main body, its analog instruments;
First input element, it is arranged in the described main body, receives the input from the player;
Processor, it is arranged in the described main body, and the main-machine communication of wherein said processor and runs software program, wherein said processor are coupled in described first input element, and the input communication that will be received from described player is to described main frame; And
First actuator, it is arranged in the described main body and is coupled in described processor, wherein based on event in the described software program, the activation signal that described first actuator response receives and export haptic effect to described main body.
2. recreation peripheral hardware according to claim 1, wherein, described first actuator and described first input element are arranged in the described main body close to each other, wherein in the software program event in response to the input that is received from described player, thereby when being received from described player's input, by the haptic effect of described first actuator output by described player's perception.
3. recreation peripheral hardware according to claim 1, wherein, the simulation of the main body of described recreation peripheral hardware comprises the guitar of guitar body and neck.
4. recreation peripheral hardware according to claim 3, wherein, described input element is arranged in the described neck.
5. recreation peripheral hardware according to claim 1 further comprises:
Sensing element, it is coupled in described first input element, wherein, responds the detection that described first input element is selected by described player, and described sensing element is exported first transducing signal to described main frame.
6. recreation peripheral hardware according to claim 1 further comprises:
Second actuator, it is arranged in described main body, wherein, the corresponding event that in response to described software program, takes place and when receiving second activation signal, described second actuator is exported corresponding haptic effect to described main body.
7. recreation peripheral hardware according to claim 1, wherein, described first input element is to press button.
8. recreation peripheral hardware according to claim 1, wherein, described first input element is touch pad or touch-screen.
9. recreation peripheral hardware according to claim 8, wherein, described touch-screen is configured to by its Displaying graphical objects.
10. recreation peripheral hardware according to claim 5, wherein, described sensing element is configured to, detected after the player selected described input element at described sensing element, in response to detecting the finger that the direction of described player along described first input element moves, and change described first transducing signal, wherein first transducing signal through changing correspondingly upgrades described software program.
11. recreation peripheral hardware according to claim 10 wherein, detects the finger that moves along the direction of described first input element based on described sensing element, the corresponding excitation signal of described first actuator response and change described haptic effect.
12. recreation peripheral hardware according to claim 5 further comprises the light-emitting device that is coupled in described first input element, wherein said light-emitting device is configured to when the luminous signal that receives from described main frame luminous.
13. recreation peripheral hardware according to claim 3, wherein, described first input element comprises the rocking bar of manipulating the strings, and wherein, described first actuator is exported described haptic effect to the described rocking bar of manipulating the strings, thereby moving in response to described player when manipulating the strings rocking bar, described player perceives described haptic effect.
14. recreation peripheral hardware according to claim 3, wherein, described first input element comprises the sound column key, and wherein, described first actuator output is near the haptic effect of described sound column key, thereby when selecting the sound column key in response to described player, described player perceives described haptic effect.
15. recreation peripheral hardware according to claim 3, wherein, described first input element comprises the sound column key, and wherein, described first actuator is exported described haptic effect to described sound column key, thereby when selecting the sound column key in response to described player, described player perceives described haptic effect.
16. recreation peripheral hardware according to claim 3, wherein, described first input element comprises the trill rocking bar, and wherein, described first actuator is exported described haptic effect to the main body near described trill rocking bar, thereby when selecting the trill rocking bar in response to described player, described player perceives described haptic effect.
17. recreation peripheral hardware according to claim 3, wherein, described first input element comprises the trill rocking bar, and wherein said first actuator is exported described haptic effect to described trill rocking bar, thereby when selecting the trill rocking bar in response to described player, described player perceives described haptic effect.
18. recreation peripheral hardware according to claim 1, wherein, described main body simulation brass instrument, wherein said first input element comprises flap valve, and wherein said first actuator is exported described haptic effect to described flap valve, thereby when selecting flap valve in response to described player, described player perceives described haptic effect.
19. recreation peripheral hardware according to claim 1, wherein, described main body simulation wind instrument, wherein said first input element comprises button, and wherein said first actuator is exported described haptic effect to described button, thereby in response to described player's selection key the time, described player perceives described haptic effect.
20. recreation peripheral hardware according to claim 1, wherein, described main body simulation stringed musical instrument, wherein said first input element comprises the sound column key, and wherein said first actuator is exported described haptic effect to described sound column key, thereby when selecting the sound column key in response to described player, described player perceives described haptic effect.
21. recreation peripheral hardware according to claim 1, wherein, described main body simulation stringed musical instrument, wherein said first input element comprises string, and wherein said first actuator is exported described haptic effect to described string, thereby when selecting described string in response to described player, described player perceives described haptic effect.
22. the method for an operate game peripheral hardware, described recreation peripheral hardware has the main body of analog instruments, and described method comprises:
Selection by the first sensing element sensing, first input element also sends the main frame of first transducing signal to runs software program, described first input element is arranged in the main body of described recreation peripheral hardware, described software program is corresponding to music game, and described first transducing signal representative is from the extremely input of described music game of described player; And
In response to first activation signal that receives from described main frame, by the main body of first actuator output haptic effect to described recreation peripheral hardware, described first activation signal is corresponding to the incident in the described music game.
23. method according to claim 22, wherein, described first actuator and described first input element closely are arranged in the described main body mutually, event response in the wherein said music game is in the input from described player, thereby when being received from described player's input, by the described haptic effect of described first actuator output by described player's perception.
24. method according to claim 23 further comprises:
Selection by the second sensing element sensing, second input element also sends second transducing signal to described main frame, described second input element is arranged in the main body of described recreation peripheral hardware, second input of described second transducing signal representative from described player to described music game; And
In response to second activation signal that receives from described main frame, export the main body of second haptic effect by second actuator to described recreation peripheral hardware, described second activation signal is corresponding to second incident in the described music game.
25. method according to claim 23 wherein, in response to first activation signal that receives from described main frame, comprises that by first actuator output haptic effect to the main body of described recreation peripheral hardware the described haptic effect of output is to described first input element.
26. method according to claim 23, wherein, in response to second activation signal that receives from described main frame, export second haptic effect to the main body of described recreation peripheral hardware by second actuator and comprise that described second haptic effect of output is to described second input element.
27. method according to claim 23 further comprises:
In response to second activation signal that receives from described main frame, export the main body of second haptic effect by second actuator to described recreation peripheral hardware, described second activation signal is corresponding to second incident in the described music game.
28. method according to claim 22, wherein, described musical instrument is corresponding to wind instrument, brass instrument, stringed musical instrument or percussion instrument.
29. method according to claim 22, wherein, described musical instrument is corresponding to guitar.
30. method according to claim 24, wherein, described musical instrument is corresponding to guitar, and wherein said first input element comprises the sound column key, and wherein second input element comprises the key of manipulating the strings.
31. recreation peripheral hardware according to claim 1, wherein, described main body simulation keyboard instrument, wherein said first input element comprises button, and wherein said first actuator is exported described haptic effect to described button, thereby when described player selects described button, the described haptic effect of described player's perception.
32. recreation peripheral hardware according to claim 1, wherein, described haptic effect responds from described player's input and changes in time.
33. recreation peripheral hardware according to claim 32, wherein, described haptic effect responds from described player's successful input to be increased on amplitude in time.
CN200980136066.0A 2008-08-11 2009-08-10 Touch sensing gaming peripheral for musical game Expired - Fee Related CN102159290B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US8791708P 2008-08-11 2008-08-11
US61/087,917 2008-08-11
PCT/US2009/053289 WO2010019508A1 (en) 2008-08-11 2009-08-10 A haptic enabled gaming peripheral for a musical game

Publications (2)

Publication Number Publication Date
CN102159290A true CN102159290A (en) 2011-08-17
CN102159290B CN102159290B (en) 2015-03-25

Family

ID=41078161

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200980136066.0A Expired - Fee Related CN102159290B (en) 2008-08-11 2009-08-10 Touch sensing gaming peripheral for musical game

Country Status (6)

Country Link
US (1) US20100033426A1 (en)
EP (1) EP2321019B1 (en)
JP (1) JP5499030B2 (en)
KR (1) KR101287892B1 (en)
CN (1) CN102159290B (en)
WO (1) WO2010019508A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103520918A (en) * 2012-07-04 2014-01-22 雅马哈株式会社 Music game device and music game method
CN104793737A (en) * 2014-01-16 2015-07-22 意美森公司 Systems and methods for content authoring
CN109154857A (en) * 2016-05-17 2019-01-04 Ck高新材料有限公司 Acoustic signal is converted into the method for haptic signal and utilizes the haptic device of its method
CN111462716A (en) * 2019-01-18 2020-07-28 和莱乐器有限责任公司 Accordion

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8749495B2 (en) * 2008-09-24 2014-06-10 Immersion Corporation Multiple actuation handheld device
KR101554221B1 (en) * 2009-05-11 2015-09-21 삼성전자주식회사 Method for playing a musical instrument using potable terminal and apparatus thereof
US8369974B2 (en) 2009-06-16 2013-02-05 Kyran Daisy Virtual phonograph
US8093486B2 (en) 2010-05-18 2012-01-10 Red Chip Company, Ltd. Touch screen guitar
US20120240751A1 (en) * 2011-03-23 2012-09-27 Ayako Yonetani Hybrid stringed instrument
US9063570B2 (en) 2012-06-27 2015-06-23 Immersion Corporation Haptic feedback control system
US8896524B2 (en) 2012-08-24 2014-11-25 Immersion Corporation Context-dependent haptic confirmation system
DE102013003245A1 (en) * 2013-02-27 2014-08-28 Patrik Zajonc A method and apparatus for teaching the controlling of a remote-controlled modeling device, such as an aircraft
US8975501B2 (en) * 2013-03-14 2015-03-10 FretLabs LLC Handheld musical practice device
US9751019B2 (en) * 2013-12-18 2017-09-05 Activision Publishing, Inc. Input methods and devices for music-based video games
USD723098S1 (en) 2014-03-14 2015-02-24 FretLabs LLC Handheld musical practice device
WO2015160728A1 (en) * 2014-04-14 2015-10-22 Brown University System for electronically generating music
JP5962726B2 (en) * 2014-09-16 2016-08-03 株式会社Cygames GAME DEVICE AND PROGRAM
US9483956B2 (en) * 2015-01-23 2016-11-01 Ann R. Winget Stringed musical instrument performance feedback system and method
CN107185230A (en) * 2016-03-15 2017-09-22 施政 A kind of multiplayer's networking game system
US9908042B2 (en) * 2016-04-25 2018-03-06 Performance Designed Products Llc Guitar shaped video game controller
US9908043B2 (en) * 2016-04-25 2018-03-06 Performance Designed Products Llc Guitar shaped video game controller
US9914050B2 (en) * 2016-04-25 2018-03-13 Performance Designed Products Llc Guitar shaped video game controller
JP6327537B2 (en) * 2016-10-14 2018-05-23 株式会社コナミデジタルエンタテインメント Game machine operating device and game machine equipped with the same
IL259059A (en) * 2018-04-30 2018-06-28 Arcana Instr Ltd A musical instrument with a joystick with variable tension and variable travel distance and a method of use thereof
JP2023183887A (en) * 2022-06-17 2023-12-28 カシオ計算機株式会社 Input interface, electronic musical instrument, light emission control method, and program
US12023576B1 (en) 2023-10-03 2024-07-02 Performance Designed Products Llc Video game controller

Family Cites Families (102)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4334280A (en) * 1980-06-09 1982-06-08 Texas Instruments Incorporated System and method for providing an audible sound and a tactile feedback in an electronic data processing system
US4355348A (en) * 1980-07-30 1982-10-19 Williams Theodore R Audio signal responsive optical display
US4935728A (en) * 1985-01-02 1990-06-19 Altra Corporation Computer control
US5195179A (en) * 1986-01-29 1993-03-16 Hitachi, Ltd. Coordinate input apparatus
US4768412A (en) * 1986-05-09 1988-09-06 Sanderson Stephen N Low profile keyboard device and system for recording and scoring music
JPH03292524A (en) * 1990-04-11 1991-12-24 Oki Electric Ind Co Ltd Cursor shift system
US5264836A (en) * 1991-01-15 1993-11-23 Apple Computer, Inc. Three dimensional cursor
US5524187A (en) * 1991-03-25 1996-06-04 The Trustees Of Columbia University Worlds-within-worlds nested display and interaction system and method
US5388992A (en) * 1991-06-19 1995-02-14 Audiological Engineering Corporation Method and apparatus for tactile transduction of acoustic signals from television receivers
US5471571A (en) * 1991-12-27 1995-11-28 Xerox Corporation Method and apparatus for setting a graphical object's position and orientation with viscous dragging
US5757358A (en) * 1992-03-31 1998-05-26 The United States Of America As Represented By The Secretary Of The Navy Method and apparatus for enhancing computer-user selection of computer-displayed objects through dynamic selection area and constant visual feedback
US6131097A (en) * 1992-12-02 2000-10-10 Immersion Corporation Haptic authoring
US6433771B1 (en) * 1992-12-02 2002-08-13 Cybernet Haptic Systems Corporation Haptic device attribute control
US5526480A (en) * 1992-12-28 1996-06-11 International Business Machines Corporation Time domain scroll bar for multimedia presentations in a data processing system
US5550562A (en) * 1993-01-12 1996-08-27 Fujitsu Limited Data processing device that enables mouse-operated application programs to be operated from an operation pad, and an operation pad for use with the same
US5374942A (en) * 1993-02-05 1994-12-20 Gilligan; Federico G. Mouse and method for concurrent cursor position and scrolling control
US5524195A (en) * 1993-05-24 1996-06-04 Sun Microsystems, Inc. Graphical user interface for interactive television with an animated agent
US5347306A (en) * 1993-12-17 1994-09-13 Mitsubishi Electric Research Laboratories, Inc. Animated electronic meeting place
US5461711A (en) * 1993-12-22 1995-10-24 Interval Research Corporation Method and system for spatial accessing of time-based information
US5438529A (en) * 1994-01-26 1995-08-01 Immersion Human Interface Corporation Percussion input device for personal computer systems
CA2140164A1 (en) * 1994-01-27 1995-07-28 Kenneth R. Robertson System and method for computer cursor control
US5564004A (en) * 1994-04-13 1996-10-08 International Business Machines Corporation Method and system for facilitating the selection of icons
US5565887A (en) * 1994-06-29 1996-10-15 Microsoft Corporation Method and apparatus for moving a cursor on a computer screen
US5835693A (en) * 1994-07-22 1998-11-10 Lynch; James D. Interactive system for simulation and display of multi-body systems in three dimensions
ATE189539T1 (en) * 1994-08-18 2000-02-15 Interval Research Corp INPUT DEVICE FOR VIDEO WITH TACTILE FEEDBACK DEPENDING ON THE CONTENT OF THE VIDEO
US5684722A (en) * 1994-09-21 1997-11-04 Thorner; Craig Apparatus and method for generating a control signal for a tactile sensation generator
US5570111A (en) * 1994-10-03 1996-10-29 International Business Machines Corporation Graphical user interface cursor positioning device having a negative inertia transfer function
EP0713172B1 (en) * 1994-11-15 2002-02-06 Microsoft Corporation Slide out interface bar
US5565888A (en) * 1995-02-17 1996-10-15 International Business Machines Corporation Method and apparatus for improving visibility and selectability of icons
JP3348265B2 (en) * 1995-03-27 2002-11-20 富士通株式会社 Overhead transfer control method
EP0747807B1 (en) * 1995-04-11 2002-03-06 Dragon Systems Inc. Moving an element shown on a computer display
JP3562049B2 (en) * 1995-07-21 2004-09-08 セイコーエプソン株式会社 Video display method and apparatus
US5628686A (en) * 1995-07-31 1997-05-13 Microsoft Corporation Apparatus and method for bidirectional data communication in a game port
US5977977A (en) * 1995-08-04 1999-11-02 Microsoft Corporation Method and system for multi-pass rendering
US5805165A (en) * 1995-08-31 1998-09-08 Microsoft Corporation Method of selecting a displayed control item
US5808601A (en) * 1995-09-12 1998-09-15 International Business Machines Corporation Interactive object selection pointer method and apparatus
US5959613A (en) * 1995-12-01 1999-09-28 Immersion Corporation Method and apparatus for shaping force signals for a force feedback device
AU734018B2 (en) * 1995-10-09 2001-05-31 Nintendo Co., Ltd. Three-dimension image processing system
US5990875A (en) * 1995-10-16 1999-11-23 Packard Bell Nec Double pen up event
US5896125A (en) * 1995-11-06 1999-04-20 Niedzwiecki; Richard H. Configurable keyboard to personal computer video game controller adapter
US5710574A (en) * 1995-11-14 1998-01-20 International Business Machines Corporation Method and system for positioning a graphical pointer within a widget of a data processing system graphical user interface
US5877748A (en) * 1995-11-20 1999-03-02 Redlich; Sanford I. Computer control input interface system
US6169540B1 (en) * 1995-12-01 2001-01-02 Immersion Corporation Method and apparatus for designing force sensations in force feedback applications
US6147674A (en) * 1995-12-01 2000-11-14 Immersion Corporation Method and apparatus for designing force sensations in force feedback computer applications
US6028593A (en) * 1995-12-01 2000-02-22 Immersion Corporation Method and apparatus for providing simulated physical interactions within computer generated environments
US5956484A (en) * 1995-12-13 1999-09-21 Immersion Corporation Method and apparatus for providing force feedback over a computer network
US6078308A (en) * 1995-12-13 2000-06-20 Immersion Corporation Graphical click surfaces for force feedback applications to provide user selection using cursor interaction with a trigger position within a boundary of a graphical object
US6750877B2 (en) * 1995-12-13 2004-06-15 Immersion Corporation Controlling haptic feedback for enhancing navigation in a graphical environment
CA2247364C (en) * 1996-03-08 2002-05-14 Motorola, Inc. Method and recognizer for recognizing a sampled sound signal in noise
US5737144A (en) * 1996-06-05 1998-04-07 Quantum Corporation Switched boost voltage generator for actuator retract in disk drive
US5802353A (en) * 1996-06-12 1998-09-01 General Electric Company Haptic computer modeling system
US5791992A (en) * 1996-07-31 1998-08-11 International Business Machines Corporation Video game system with internet cartridge
US5896139A (en) * 1996-08-01 1999-04-20 Platinum Technology Ip, Inc. System and method for optimizing a scene graph for optimizing rendering performance
US6084587A (en) * 1996-08-02 2000-07-04 Sensable Technologies, Inc. Method and apparatus for generating and interfacing with a haptic virtual reality environment
US5877750A (en) * 1996-09-17 1999-03-02 International Business Machines Corporation Method and apparatus for in-place line width selection for graphics applications
JPH10111958A (en) * 1996-10-04 1998-04-28 Olympus Optical Co Ltd Simulation system using computer graphics and model representing method of simulation system
US5889506A (en) * 1996-10-25 1999-03-30 Matsushita Electric Industrial Co., Ltd. Video user's environment
GB9622556D0 (en) * 1996-10-30 1997-01-08 Philips Electronics Nv Cursor control with user feedback mechanism
US5884029A (en) * 1996-11-14 1999-03-16 International Business Machines Corporation User interaction with intelligent virtual objects, avatars, which interact with other avatars controlled by different users
US5973670A (en) * 1996-12-31 1999-10-26 International Business Machines Corporation Tactile feedback controller for computer cursor control device
US6111562A (en) * 1997-01-06 2000-08-29 Intel Corporation System for generating an audible cue indicating the status of a display object
US5841710A (en) * 1997-02-14 1998-11-24 Micron Electronics, Inc. Dynamic address remapping decoder
US6285351B1 (en) * 1997-04-25 2001-09-04 Immersion Corporation Designing force sensations for computer applications including sounds
US6292170B1 (en) * 1997-04-25 2001-09-18 Immersion Corporation Designing compound force sensations for computer applications
US6215495B1 (en) * 1997-05-30 2001-04-10 Silicon Graphics, Inc. Platform independent application program interface for interactive 3D scene management
US6071194A (en) * 1997-06-19 2000-06-06 Act Labs Ltd Reconfigurable video game controller
US6292174B1 (en) * 1997-08-23 2001-09-18 Immersion Corporation Enhanced cursor control using limited-workspace force feedback devices
KR100263167B1 (en) * 1997-11-21 2000-08-01 윤종용 Resolution changing apparatus for liquid crystal display monitor
US6210168B1 (en) * 1998-03-16 2001-04-03 Medsim Ltd. Doppler ultrasound simulator
US6266053B1 (en) * 1998-04-03 2001-07-24 Synapix, Inc. Time inheritance scene graph for representation of media content
US6421048B1 (en) * 1998-07-17 2002-07-16 Sensable Technologies, Inc. Systems and methods for interacting with virtual objects in a haptic virtual reality environment
US6373463B1 (en) * 1998-10-14 2002-04-16 Honeywell International Inc. Cursor control system with tactile feedback
US6282455B1 (en) * 1998-10-19 2001-08-28 Rockwell Technologies, Llc Walk-through human/machine interface for industrial control
US6292776B1 (en) * 1999-03-12 2001-09-18 Lucent Technologies Inc. Hierarchial subband linear predictive cepstral features for HMM-based speech recognition
US7263073B2 (en) * 1999-03-18 2007-08-28 Statsignal Ipc, Llc Systems and methods for enabling a mobile user to notify an automated monitoring system of an emergency situation
JP4003342B2 (en) * 1999-04-05 2007-11-07 株式会社バンダイナムコゲームス GAME DEVICE AND COMPUTER-READABLE RECORDING MEDIUM
US7061486B2 (en) * 1999-09-24 2006-06-13 Sun Microsystems, Inc. Using messaging to manage scene-based rendering
US6819922B1 (en) * 2000-08-14 2004-11-16 Hewlett-Packard Development Company, L.P. Personal digital assistant vehicle interface and method
US6727916B1 (en) * 2000-12-21 2004-04-27 Sprint Spectrum, L.P. Method and system for assisting a user to engage in a microbrowser-based interactive chat session
US6885876B2 (en) * 2001-03-12 2005-04-26 Nokia Mobile Phones Ltd. Mobile phone featuring audio-modulated vibrotactile module
US7283954B2 (en) * 2001-04-13 2007-10-16 Dolby Laboratories Licensing Corporation Comparing audio using characterizations based on auditory events
US6963762B2 (en) * 2001-05-23 2005-11-08 Nokia Corporation Mobile phone using tactile icons
US7623114B2 (en) * 2001-10-09 2009-11-24 Immersion Corporation Haptic feedback sensations based on audio output from computer devices
US6703550B2 (en) * 2001-10-10 2004-03-09 Immersion Corporation Sound data output and manipulation using haptic feedback
US6940497B2 (en) * 2001-10-16 2005-09-06 Hewlett-Packard Development Company, L.P. Portable electronic reading apparatus
US7127271B1 (en) * 2001-10-18 2006-10-24 Iwao Fujisaki Communication device
US7171191B2 (en) * 2002-04-08 2007-01-30 Gateway Inc. User dynamically definable centralized notification between portable devices
JP4052029B2 (en) * 2002-06-17 2008-02-27 ヤマハ株式会社 Musical sound generator, plucked instrument, performance system, musical sound generation control method and musical sound generation control program
US7496631B2 (en) * 2002-08-27 2009-02-24 Aol Llc Delivery of an electronic communication using a lifespan
GB2418475B (en) 2003-06-09 2007-10-24 Immersion Corp Interactive gaming systems with haptic feedback
US7421088B2 (en) * 2003-08-28 2008-09-02 Motorola, Inc. Multifunction transducer
US7112737B2 (en) * 2003-12-31 2006-09-26 Immersion Corporation System and method for providing a haptic effect to a musical instrument
US7555151B2 (en) * 2004-09-02 2009-06-30 Siemens Medical Solutions Usa, Inc. System and method for tracking anatomical structures in three dimensional images
US7273979B2 (en) * 2004-12-15 2007-09-25 Edward Lee Christensen Wearable sensor matrix system for machine control
JP4557899B2 (en) * 2006-02-03 2010-10-06 任天堂株式会社 Sound processing program and sound processing apparatus
JP2009531153A (en) * 2006-03-29 2009-09-03 ハーモニックス・ミュージック・システムズ・インコーポレイテッド Game controller that simulates a guitar
US8003872B2 (en) * 2006-03-29 2011-08-23 Harmonix Music Systems, Inc. Facilitating interaction with a music-based video game
US7754961B1 (en) * 2006-04-12 2010-07-13 Activision Publishing, Inc. Strum input for a video game controller
US7320643B1 (en) 2006-12-04 2008-01-22 Harmonix Music Systems, Inc. Game controller simulating a musical instrument
US7714220B2 (en) * 2007-09-12 2010-05-11 Sony Computer Entertainment America Inc. Method and apparatus for self-instruction
US8017857B2 (en) * 2008-01-24 2011-09-13 745 Llc Methods and apparatus for stringed controllers and/or instruments
US8827806B2 (en) * 2008-05-20 2014-09-09 Activision Publishing, Inc. Music video game and guitar-like game controller

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103520918A (en) * 2012-07-04 2014-01-22 雅马哈株式会社 Music game device and music game method
CN104793737A (en) * 2014-01-16 2015-07-22 意美森公司 Systems and methods for content authoring
US10437341B2 (en) 2014-01-16 2019-10-08 Immersion Corporation Systems and methods for user generated content authoring
CN109154857A (en) * 2016-05-17 2019-01-04 Ck高新材料有限公司 Acoustic signal is converted into the method for haptic signal and utilizes the haptic device of its method
CN109154857B (en) * 2016-05-17 2021-11-02 Ck高新材料有限公司 Method for converting acoustic signal into haptic signal and haptic device using the same
CN111462716A (en) * 2019-01-18 2020-07-28 和莱乐器有限责任公司 Accordion
CN111462716B (en) * 2019-01-18 2023-05-16 和莱乐器有限责任公司 Accordion

Also Published As

Publication number Publication date
WO2010019508A1 (en) 2010-02-18
WO2010019508A9 (en) 2010-06-24
EP2321019B1 (en) 2019-04-10
KR20110050667A (en) 2011-05-16
CN102159290B (en) 2015-03-25
JP5499030B2 (en) 2014-05-21
EP2321019A1 (en) 2011-05-18
KR101287892B1 (en) 2013-07-22
JP2011530391A (en) 2011-12-22
US20100033426A1 (en) 2010-02-11

Similar Documents

Publication Publication Date Title
CN102159290B (en) Touch sensing gaming peripheral for musical game
US8246461B2 (en) Methods and apparatus for stringed controllers and/or instruments
US8858330B2 (en) Music video game with virtual drums
US8608566B2 (en) Music video game with guitar controller having auxiliary palm input
US8827806B2 (en) Music video game and guitar-like game controller
US8317614B2 (en) System and method for playing a music video game with a drum system game controller
US8961309B2 (en) System and method for using a touchscreen as an interface for music-based gameplay
US8454418B2 (en) Methods and apparatus for stringed controllers and instruments
US8469812B2 (en) Fret and method of manufacturing frets for stringed controllers and instruments
US20110086704A1 (en) Music game system and method of providing same
US10002598B2 (en) Selective pitch emulator for electrical stringed instruments
WO2008019089A2 (en) Musical instrument
KR101380159B1 (en) instrument playing system
GB2433155A (en) String and button assembly for electronic musical instrument

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C53 Correction of patent for invention or patent application
CB02 Change of applicant information

Address after: American California

Applicant after: IMMERSION CORPORATION

Address before: American California

Applicant before: Immersion Corp.

C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150325

Termination date: 20200810

CF01 Termination of patent right due to non-payment of annual fee