CN107667334A - Haptic device and the method for controlling haptic device - Google Patents
Haptic device and the method for controlling haptic device Download PDFInfo
- Publication number
- CN107667334A CN107667334A CN201580080682.4A CN201580080682A CN107667334A CN 107667334 A CN107667334 A CN 107667334A CN 201580080682 A CN201580080682 A CN 201580080682A CN 107667334 A CN107667334 A CN 107667334A
- Authority
- CN
- China
- Prior art keywords
- audio input
- phase
- haptic device
- peak amplitude
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
- A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/215—Input arrangements for video game devices characterised by their sensors, purposes or types comprising means for detecting acoustic signals, e.g. using a microphone
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
- A63F13/424—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/70—Game security or game management aspects
- A63F13/79—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/013—Force feedback applied to a game
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/015—Force feedback applied to a joystick
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
- H04L67/306—User profiles
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Business, Economics & Management (AREA)
- Computer Security & Cryptography (AREA)
- General Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
According to various embodiments, it is possible to provide a kind of haptic device.The haptic device may include：Input circuit, it is configured as receiving audio input；Phase determination circuit, it is configured to determine that the phase of the audio input；Peak amplitude determines circuit, and it is configured to determine that the peak amplitude of the audio input；And haptic controller, it is configured as the phase based on the audio input and the peak amplitude based on the audio input to control at least one actuator.
Description
Technical field
Various embodiments relate generally to haptic device and the method for controlling haptic device.
Background technology
Conventional tactile in games system and game console carries out the scheme scope of haptic device, tactile feel because used in
Effect and the fidelity of feel/feedback and have limitation.Improved accordingly, it may be desirable to carry out scheme to tactile.
The content of the invention
According to various embodiments, it is possible to provide a kind of haptic device.The haptic device may include：Input circuit, it is configured
To receive audio input；Phase determination circuit, it is configured to determine that the phase of audio input；Peak amplitude determines circuit, its
It is configured to determine that the peak amplitude of audio input；And haptic controller, its be configured as phase based on audio input and
At least one actuator is controlled based on the peak amplitude of audio input.
According to various embodiments, it is possible to provide a kind of method for controlling haptic device.This method may include：It is defeated to receive audio
Enter；Determine the phase of audio input；Determine the peak amplitude of audio input；And phase based on audio input and based on audio
The peak amplitude of input controls at least one actuator.
Brief description of the drawings
In the various figures, in whole different views, same reference numerals are often referred to same parts.Each figure, which is not necessarily to scale, to be painted
System, on the contrary, emphasis is usually to pay close attention to the illustration to the principle of the invention.Various features or the size of component can be any for definition
Ground extends or reduction.In the following description, various embodiments of the present invention describe with reference to following figure.
Figure 1A shows the haptic device according to various embodiments；
Figure 1B shows the haptic device according to various embodiments；
Fig. 1 C flow for displaying figures, the method for illustrating the control haptic device according to various embodiments；
Fig. 2 shows the diagram of the tactile audio stimulation according to various embodiments；And
Fig. 3 shows the diagram of the double-channel tactile flow chart according to various embodiments.
Embodiment
It is described in detail below to refer to by means of diagram to show the accompanying drawing of the specific detail of the achievable present invention and embodiment.
These embodiments are described in detail enough to allow those skilled in the art to realize the present invention.Using other embodiment, and
Structure and logical changes can be carried out without departing from scope of the invention.Various embodiments are not necessarily mutually exclusive, such as some embodiments
It can be combined with one or more other embodiments to form new embodiment.
Herein, the haptic device as described in this manual may include internal memory, and the internal memory is for example in tactile
In the processing implemented in device.Can be volatile ram for the internal memory in embodiment, such as DRAM (Dynamic Random
Access Memory；DRAM) or Nonvolatile memory, such as PROM (Programmable Read Only
Memory；Programmable read only memory), EPROM (Erasable PROM；Erasable PROM), EEPROM (Electrically
Erasable PROM；Electrical Erasable PROM), or flash memory, such as floating dam internal memory, charge traps internal memory, MRAM
(Magnetoresistive Random Access Memory；MRAM internal memory) or PCRAM (Phase
Change Random Access Memory；Phase-change random access internal memory).
In embodiment, " circuit " (being hereinafter also referred to as " block ") can be regarded as any kind of logic and carry out in fact
Body, it can be to perform the software being stored in internal memory, firmware or its any combination of special circuit or processing that the logic, which carries out entity,
Device.Therefore, in embodiment, " circuit " can be hardwire logic or PLD, such as programmable processor,
Such as microprocessor is (for example, CISC (Complex Instruction Set Computer；CISC) handle
Device or Reduced Instruction Set Computer (Reduced Instruction Set Computer；RISC) processor)." circuit " also may be used
To perform the processor of software, the software is, for example, any kind of computer program, such as uses virtual machine code (such as example
Such as Java) computer program.The implementation scheme of any other species of each function that will be described in greater detail below is also
It can be regarded as " circuit " according to alternate embodiment.
In the description, term "comprising" is interpreted as with the wide in range implication similar to word " comprising ", and will be understood that
Entirety or step or the group of entirety or step are specified to mean to include one, but is not excluded for any other entirety or step or any
The group of entirety or step.This definition is also applied to the version of word " including (comprising) ".
Reference to any prior art in this specification is not construed as recognizing or implied in any form cited
Prior art form the part of Australia (or any other country) common knowledge.
For make the present invention it can be readily appreciated that and obtain actual effect, will by citing and it is unrestricted in a manner of and with reference to each figure come
Specific embodiment is described.
The various embodiments of device are provided, and the various embodiments of method are provided.It will be understood that the fundamental property of device is also fitted
For method, and vice versa.Therefore, for brevity, the repeated description of such property can be omitted.
It will be understood that any device as described herein is also applicable to any property of specific device description herein.Will reason
Solution, any method as described herein is also applicable to any property of ad hoc approach description herein.Further, it will be appreciated that for
For any device or method as described herein, described all parts or step may not must be incorporated into device or method,
And it can only include (but not all) part or step.
Word " coupling " (or " connection ") herein can be regarded as electric coupling or be interpreted as mechanical coupling, such as be attached,
Or fixed or attachment, or contact condition is only existed in without any fixation, and will be understood that, it is possible to provide directly couple or INDIRECT COUPLING
Both (in other words, couple and be not directly contacted with).
The tactile of low degree is relatively unknown technology, but is in fact a part for our daily lifes.Intelligence electricity
Words can make mobile phone vibration use tactile anti-in a manner of call user's attention to message and/or incoming call by using same core motor
Feedback.Another example using tactile be in control panel games system, and especially in game controller.Game console
Using same core motor and other type haptic devices, game control is vibrated in material time point during progress of playing will pass through
Device makes game experiencing more on the spot in person and feature true to nature.Many chances be present to come by especially in games system and player
The mode for carrying out unique application in peripheral device used to tactile develops and broken up consumer products on a large scale to improve, greatly.
Wherein tactile is in CE (customer electronics；Client's electronics) reach in market certain penetration degree with
And reach the field of generally receiving/degree of understanding in gaming, and especially used in control panel games system and player
Hand held controller in.These controllers can have single tactile actuator, and the single tactile actuator is in set rate or frequency
" rumble is sent under rate, the intensity of predetermined extent " or one section of duration of vibrating controller.User can not further control
Or customization tactile sensation.Shortage for the standard of the tactile of any degree is lasting challenge, because this kind lacks in part
Innovation is lagged in degree.The conventional implementation scheme provided is virtually all " single " channel design, and this shows in framework layer
Level (architectural level) and hardware developers and game/software I SV (Independent Software
Vendor；Stand alone software supplier) between upper lack exploitation.If simple direct solution, OEM can be established
(Original Equipment Manufacturer；Original device manufacturer) can benefit and optionally in the industry establish or
Promote a set of standard.
Conventional tactile in games system and game console carries out scope, tactile feel of the scheme because of haptic device used
Effect and the fidelity of feel/feedback and have limitation.The implementation scheme is " single " channel design and allows to protect without true
Tactile sensation/the feedback for the limited range really spent.Some existing conducts in " solid " field of haptics, but controlling organization is still
Intrusive mood, it mean that these controlling organizations are needed under system/controller HW and/or SW level and potentially in game source code
In basic framework change.These limitations develop to improvement tactile and further shortage and elder generation that the technology causes to adopt
Enter the hysteresis of exploitation.Professional standard and/or management body (governing body) shortage further prove the shortage adopted and
Advanced exploitation it is slow.
According to various embodiments, it is possible to provide simpler, minimally invasive formula solution overcomes pointed limitation
In it is some or most of.
According to various embodiments, it is possible to provide secondary high frequency rate audio and digital control layer for tactile.
Figure 1A shows the haptic device 100 according to various embodiments.Haptic device 100 may include input circuit 102, input
Circuit 102 is configured as receiving audio input.Haptic device 100 can further comprise Phase determination circuit 104, and phase determines electricity
Road 104 is configured to determine that the phase of audio input.Haptic device 100 can further comprise that peak amplitude determines circuit 106, peak
Value amplitude determines that circuit 106 is configured to determine that the peak amplitude of audio input.Haptic device 100 can further comprise tactile control
Device 108 processed, haptic controller 108 are configured as phase based on audio input and controlled based on the peak amplitude of audio input
At least one actuator.As represented by line 110, input circuit 102, Phase determination circuit 104, peak amplitude determine circuit
106 and haptic controller 108 can be coupled to each other, electric coupling and/or machinery coupling of the coupling such as using line or cable.
In other words, audio signal can be received according to the haptic device of various embodiments and can be based on audio signal phase and
At least one actuator is controlled based on the peak amplitude of audio signal.
According to various embodiments, haptic controller 108 can be configured to the phase based on audio input and be based on
The peak amplitude of audio input positions the channel corresponding to audio input in time.
According to various embodiments, haptic controller 108 can be configured to the phase based on audio input and be based on
The peak amplitude of audio input positions the channel corresponding to audio input in phase.
According to various embodiments, haptic controller 108 can be configured to the phase based on audio input and be based on
The peak amplitude of audio input, in the letter with positioning in the relation of the audio stream corresponding to audio input corresponding to audio input
Road.
According to various embodiments, Phase determination circuit 104 and peak amplitude can be determined that circuit 106 is provided in software layer
In.
According to various embodiments, Phase determination circuit 104 and peak amplitude can be determined that circuit 106 is provided in API
(application programming interface；Application Programming Interface) in key-course.
According to various embodiments, what haptic controller 108 can be configured to independently of audio input through determination
Phase and at least one other actuator is controlled through the peak amplitude of determination independently of audio input.
Figure 1B shows the haptic device 112 according to various embodiments.Haptic device 112 can be similar to the dress of tactile shown in Figure 1A
Putting 100 ground includes being configured as the input circuit 102 for receiving audio input.Haptic device 112 can be similar to tactile shown in Figure 1A
The ground of device 100 further comprises the Phase determination circuit 104 for the phase for being configured to determine that audio input.Haptic device 112 can
The peak amplitude for the peak amplitude for further comprising being configured to determine that audio input similar to the ground of haptic device 100 shown in Figure 1A
Determine circuit 106.Haptic device 112 can be similar to the ground of haptic device 100 shown in Figure 1A and further comprise being configured as being based on sound
The phase of frequency input and the haptic controller 108 of at least one actuator is controlled based on the peak amplitude of audio input.Tactile
Device 112 can further comprise high-frequency coding circuit 114, as will be hereinafter described in greater detail.Haptic device 112 can enter
One step includes lock control circuit 116, as will be hereinafter described in greater detail.Haptic device 112 can further comprise at least one
Individual actuator 118.As represented by line 120, input circuit 102, Phase determination circuit 104, peak amplitude determine circuit 106,
Haptic controller 108, high-frequency coding circuit 114, lock control circuit 116 and at least one actuator 118 can be coupled to each other, should
Coupling is such as using the electric coupling and/or machinery coupling of line or cable.
According to various embodiments, lock control circuit 116 can be configured as activating high-frequency coding circuit 114.
According to various embodiments, haptic controller 108 can be configured to the secondary tactile source specified based on user
Trigger to control at least one actuator 118.
According to various embodiments, the triggering of secondary tactile source that user specifies can be based on maintaining in the service based on cloud
One or more user profiles (user profile) simultaneously can be associated with application-specific and/or game.
According to various embodiments, user profile can be stored in cloud.
According to various embodiments, haptic device 112 may be provided in game console input unit.
According to various embodiments, game console input unit may include or can be control stick (joystick) and game hand
At least one of handle (gamepad).
Fig. 1 C flow for displaying Figure 122, it illustrates a kind of method for controlling haptic device.In step 124, audio can be received
Input.In step 126, it may be determined that the phase of audio input.In step 128, it may be determined that the peak amplitude of audio input.
In step 130, phase that can be based on audio input and at least one actuator is controlled based on the peak amplitude of audio input.
According to various embodiments, this method can further comprise：Phase based on audio input and based on audio input
Peak amplitude positions the channel corresponding to audio input in time.
According to various embodiments, this method can further comprise：Phase based on audio input and based on audio input
Peak amplitude positions the channel corresponding to audio input in phase.
According to various embodiments, this method can further comprise：Phase based on audio input and based on audio input
Peak amplitude, in the channel with positioning in the relation of the audio stream corresponding to audio input corresponding to audio input.
According to various embodiments, it can be provided in software layer and phase is determined and peak amplitude is determined.
According to various embodiments, it can be provided in API key-courses and phase is determined and peak amplitude is determined.
According to various embodiments, this method can further comprise：Independently of the phase through determination and independence of audio input
At least one other actuator is controlled in the peak amplitude through determination of audio input.
According to various embodiments, this method can further comprise：High-frequency encodes.
According to various embodiments, this method can further comprise：Activate high-frequency coding.
According to various embodiments, this method can further comprise：Triggered based on the secondary tactile source that user specifies to control
Make at least one actuator.
According to various embodiments, the secondary tactile source triggering that user specifies can be based on user profile.
According to various embodiments, user profile can be stored in cloud.
According to various embodiments, haptic device may be provided in game console input unit.
According to various embodiments, game console input unit may include or can be in control stick and game paddle at least
It is a kind of.
According to various embodiments, haptic device may include at least one actuator.
According to various embodiments, it is possible to provide computer-readable medium, the computer-readable medium may include to instruct, when passing through
During these instructions of computing device, processor is set to carry out a kind of method for controlling haptic device, this method is for example above-described
Method.
According to various embodiments, it is possible to provide minimally invasive formula Tactile control layer, the minimally invasive formula Tactile control layer allow
The haptic effect of relative broad range, more accurately and definitely, to (API (is applied via programmable software interface under system OS levels
Programming interface)/driver) on " secondary " channel with component enable " double-channel " tactile of discrete control.The solution party
Case may include tactile enable hardware and/or peripheral controller device in system, and these peripheral controller devices combine with API,
The API can the operation under OS (operating system) level, to be handled in real time by OS in stereo audio stream and high-frequency pulse will to be set
Or digital encoding signal intercepts the stereo audio stream when being applied in the audio signal, haptic controller can pay attention to this and set
Determine high-frequency pulse or digital encoding signal and trigger one or more haptic devices to respond in a predefined manner.Can be by this
Path is considered as the second channel of Tactile control.Normal audio channel also can trigger haptic response, but may have limitation；Especially
Ground, " level (level) " that the normal audio channel only can be based on audio signal and/or by providing in the range of tonepulse
" frequency " triggers haptic response.For example, extremely low frequency can bombard and meanwhile explosion time interrupt, and the frequency of the type sound
Scope can be in the range of upper or higher frequency.
Fig. 2 shows the diagram 200 of the tactile audio stimulation according to various embodiments, such as with time (such as trunnion axis
Shown in 202) display amplitude (being showed on vertical axis 204) modular system stereo audio signal 206.
In single channel tactile implementation scheme, the amplitude of the various frequency ranges of system audio and duration can trigger
Haptic controller is to drive haptic device to be responded.In some cases, this may need filter network to one or more
Individual target audio frequency range (low, high or low paramount) is detected, one or more target audio frequency ranges be used for
Predetermined way drives one or more haptic devices, (that is, intensity and duration are in check most typically parameter).
Fig. 3 show according to the tool of various embodiments have three layers control double-channel tactile flow chart diagram 300.
Fig. 3 shows the general survey of the double-channel haptic data stream according to various embodiments.It there may be the control of some lower levels
Mechanism, as will be described hereinafter.Path #1 (from system stereo audio system 302 to haptic controller 304) can be wherein
The path that haptic controller 304 is triggered by system or gaming audio.Haptic controller 304 can then activate first device 306 (can
Referred to as device #1), first device 306 may correspond to the first channel 312.In path, #2 is (from D/A (digital/analog；Number
Word/simulation)-A/D (analog/digital；Analog/digital) to haptic controller 304, wherein D/A-A/D turns converter 320
Parallel operation 320 (also referred to as D/A-A/D blocks) may be provided as allowing digital audio and video signals or analog signal to data signal
Conversion is transferred in haptic controller, and should be noted that this block optionally can be configured as simply by program design mode
" passing through ") in, phase discriminator (also referred to as Phase determination circuit, and may be provided in processing block 316) can inspection system source sound
Frequency simultaneously can determine the phase of system audio signal in real time.The peak amplitude detecting part of processing block 316 (can be described as peak amplitude
Determine circuit) viewed in real time can be carried out to the peak amplitude of system audio.If the second channel of Tactile control signal is used for triggering
Different from be applied on the #1 of path those respond lower level tactiles respond, then these two data points can then be used for when
Between, both phases and/or (can wherein be referred to according to " positioning " of various embodiments with positioning in the relation of system/gaming audio stream
In time Tactile control signal is activated and worked relative to target audio stream) second channel of Tactile control signal.If with
Family will select not game replaying audio, then second channel, path #2 can be used for stimulating to carry out to a certain degree based on other triggerings
Tactile sensation, this other triggering stimulates that is, game metadata and/or from system level events, is especially converted into game phase
The game thump or sequence of pass action (that is, gun recharge ammunition, weapon conversion etc.)." lock control " block 324 can be used
To activate high-frequency encoded block in the following manner：Using the amended audio conveyed via path #2, and/or by user
The digital triggering specified ((can the configuration file based on cloud storage from the secondary tactile source that user specifies triggering 326 via path #3
322) paramount frequency encoded block 318) reach haptic controller 304.High-frequency encoded block 318 can be used to high-frequency signal
It is applied in target audio stream, the target audio stream will allow embedded haptic events triggering to be detected by haptic controller.Should
Pay attention to, this block can be controlled with program design mode by " control of the lock of channel 2/3 " block 324.If exclusively with channel #3,
Then " high-frequency coding " and/or D/A-A/D blocks may be set to " passing through pattern ".If using digital triggering, high frequency does not occur
Rate encoded block 318.It will be understood that Fig. 3 part being included in dotted line frame 328 may be provided in software/API key-courses.Touch
Feel that controller 304 can be for example based on controlling the second device 308 and the corresponding to second channel 314 via path #2 input
Three devices 310.Each in first device 306, second device 308 and 3rd device 310 can be tactile actuator, the tactile
Actuator is, for example, same core motor, the device based on piezoelectric type or the converter based on audio.First device 306, second device
308 and 3rd device 310 in each can from by path #1 or path #2 driving.
According to various embodiments, it is possible to provide double-channel Tactile control layer.According to various embodiments, device and method can provide
Device that one mechanism, wherein tactile sensation are delivered in embedded controller scope by the mechanism is delivered to and is exclusively used in/connects
To the enable device of secondary channels.Single channel tactile solution is static state and immutable.According to various embodiments
Second (true independent) channel combined with fixed channel in the case of, playing carries out experience and can significantly improve and by user
Further improve so that the game, which is experienced, more makes one on the spot in person.
According to various embodiments, these device and methods can be flexibility, and allow user optionally by using
Secondary channels adjust the tactile experience of the user.These device and methods allow users with second channel dynamically to divide again
With trigger source, these trigger sources are configured and customize based on application and/or using model.
According to the device and method of various embodiments be related to the tactile for game device, haptic controller, three-dimensional tactile,
Tactile control layer, double-deck tactile and/or double-channel tactile.
According to various embodiments, it is possible to provide secondary high frequency rate audio and digital control layer for tactile.According to various realities
The double-channel Tactile control layer design for applying example can provide for the second high-frequency channel of tactile manipulation, the second high-frequency channel
Strengthen the function of the tactile movement on game console.
According to various embodiments, it is possible to provide minimally invasive formula Tactile control layer, the minimally invasive formula Tactile control layer allow
The haptic effect of relative broad range, more accurately and definitely, to (API/ drives via programmable software interface under system OS levels
Device) on secondary channels with the component enable double-channel tactile of discrete control.Various embodiments may include that the tactile in system causes
Can hardware and/or peripheral controller device, these peripheral controller devices combined with API, the API can under OS levels operation with
Stereo audio stream intercepts the stereo audio stream when being handled in real time by OS.The high-frequency pulse or digital encryption control signal of setting can
It is applied in the audio signal.Haptic controller can pay attention to these signals to trigger haptic device to be rung in a predefined manner
Should.This path can be considered as to the second channel of Tactile control.
Normal audio channel also can trigger haptic response, but may have limitation.Especially, the normal audio channel is only
" level " that can be based on audio signal and/or trigger haptic response based on " frequency " in the range of tonepulse is provided.For example,
Extremely low frequency can bombard and meanwhile explosion time interrupt, and the frequency range of the type sound will be in upper or higher frequency model
In enclosing.
According to various embodiments, first path can be wherein haptic controller by the path of system/gaming audio triggering.
In second path, phase discriminator inspection system source audio and can in real time determine the phase of system audio signal.Handle the peak of block
Be worth amplitude detecting part can viewed in real time system audio peak amplitude.If the second channel of Tactile control signal is used for triggering not
The lower level tactile for being same as putting on the response of first path is responded, then these two data points then can be used in time, phase
Position both and/or with the relation of system/gaming audio stream in position Tactile control signal second channel.If user will select
Not game replaying audio, then second channel, the second path can be used for stimulating to carry out tactile to a certain degree based on other triggerings
Feel, this other triggering stimulates that is, game metadata and/or from system level events, is especially converted into game relevant action
The game thump or sequence of (that is, gun recharge ammunition, weapon conversion etc.).Lock control block can be used to lower section
Formula activates high-frequency encoded block：It will be used using the amended audio via the second delivery pathways, and/or via the 3rd path
The digital triggering that family is specified reaches haptic controller.If using digital triggering, high-frequency coding may not occur.
Following instance is related to other embodiment.
Example 1 is haptic device, and the haptic device includes：Input circuit, it is configured as receiving audio input；Phase is true
Determine circuit, it is configured to determine that the phase of audio input；Peak amplitude determines circuit, and it is configured to determine that audio input
Peak amplitude；And haptic controller, it is configured as the phase based on audio input and the peak amplitude based on audio input
To control at least one actuator.
In example 2, the theme of example 1 can optionally include：Haptic controller is configured to defeated based on audio
The phase entered and the peak amplitude based on audio input position the channel corresponding to audio input in time.
In example 3, the theme of any one in example 1 to 2 can optionally include：Haptic controller is further configured
The channel for corresponding to audio input is positioned in phase for the phase based on audio input and based on the peak amplitude of audio input.
In example 4, the theme of any one in example 1 to 3 can optionally include：Haptic controller is further configured
For the phase based on audio input and the peak amplitude based on audio input, in the relation with the audio stream corresponding to audio input
Channel of the interior positioning corresponding to audio input.
In example 5, the theme of any one in example 1 to 4 can optionally include：Phase is provided in software layer to determine
Circuit and peak amplitude determine circuit.
In example 6, the theme of any one in example 1 to 5 can optionally include：Phase is provided in API key-courses
Determine that circuit and peak amplitude determine circuit.
In example 7, the theme of any one in example 1 to 6 can optionally include：Haptic controller is further configured
Controlled at least for the phase through determination independently of audio input and independently of the peak amplitude through determination of audio input
One other actuator.
In example 8, the theme of any one in example 1 to 7 can optionally include：High-frequency coding circuit.
In example 9, the theme of example 8 can optionally include：Lock control circuit, it is configured as activating high-frequency coding
Circuit.
In example 10, the theme of any one in example 1 to 9 can optionally include：Haptic controller further by with
The secondary tactile source specified based on user is set to trigger to control at least one actuator.
In example 11, the theme of any one in example 1 to 10 can optionally include：The secondary tactile that user specifies
Source triggering is based on user profile.
In example 12, the theme of example 11 can optionally include：User profile is stored in cloud.
In example 13, the theme of any one in example 1 to 12 can optionally include：Haptic device provides to be controlled in game
In device input unit processed.
In example 14, the theme of example 13 can optionally include：Game console input unit includes control stick and trip
At least one of play handle.
In example 15, the theme of any one in example 1 to 14 can optionally include：At least one actuator.
Example 16 is a kind of method for controlling haptic device, and this method includes：Receive audio input；Determine audio input
Phase；Determine the peak amplitude of audio input；And phase based on audio input and based on the peak amplitude of audio input come
Control at least one actuator.
In example 17, the theme of example 16 can optionally include：Phase based on audio input and based on audio input
Peak amplitude position channel corresponding to audio input in time.
In example 18, the theme of any one in example 16 to 17 can optionally include：Phase based on audio input
And the channel for corresponding to audio input is positioned in phase based on the peak amplitude of audio input.
In example 19, the theme of any one in example 16 to 18 can optionally include：Phase based on audio input
And the peak amplitude based on audio input, corresponding to audio input with positioning in the relation of the audio stream corresponding to audio input
Channel.
In example 20, the theme of any one in example 16 to 19 can optionally include：There is provided in software layer to phase
Position is determined and peak amplitude is determined.
In example 21, the theme of any one in example 16 to 20 can optionally include：The offer pair in API key-courses
Phase is determined and peak amplitude is determined.
In example 22, the theme of any one in example 16 to 21 can optionally include：Independently of the warp of audio input
The phase of determination and independently of audio input the peak amplitude through determination and to control at least one other actuator.
In example 23, the theme of any one in example 16 to 22 can optionally include：High-frequency encodes.
In example 24, the theme of example 23 can optionally include：Activate high-frequency coding.
In example 25, the theme of any one in example 16 to 24 can optionally include：Time specified based on user
Trigger to control at least one actuator in level tactile source.
In example 26, the theme of any one in example 16 to 25 can optionally include：The secondary that user specifies is touched
The triggering of feel source is based on user profile.
In example 27, the theme of example 26 can optionally include：User profile is stored in cloud.
In example 28, the theme of any one in example 16 to 27 can optionally include：Haptic device is provided and played
In controller input unit.
In example 29, the theme of example 28 can optionally include：Game console input unit includes control stick and trip
At least one of play handle.
In example 30, the theme of any one in example 16 to 29 can optionally include：Haptic device includes at least one
Individual actuator.
Although the present invention with reference to specific embodiment it is particularly shown and description, although it will be understood by those skilled in the art that
, can be in these specific embodiments in the case of the spirit and scope of the invention limited without departing from appended claims
Form and details make various changes.Therefore, scope of the invention is specified by appended claims, and falls into claim
Equivalents implication and scope in all changes therefore be intended to be covered.
Claims (30)
1. a kind of haptic device, comprising：
Input circuit, it is configured as receiving audio input；
Phase determination circuit, it is configured to determine that the phase of the audio input；
Peak amplitude determines circuit, is configured to determine that the peak amplitude of the audio input；And
Haptic controller, it is configured as the phase based on the audio input and the peak value based on the audio input
Amplitude controls at least one actuator.
2. haptic device as claimed in claim 1, wherein the haptic controller is configured to be based on the audio
The phase of input and the peak amplitude based on the audio input position corresponding to the audio input in time
Channel.
3. haptic device as claimed in claim 1, wherein the haptic controller is configured to be based on the audio
The phase of input and positioned based on the peak amplitude of the audio input in phase and correspond to the audio input
Channel.
4. haptic device as claimed in claim 1, wherein the haptic controller is configured to be based on the audio
The phase of input and the peak amplitude based on the audio input, with the audio stream corresponding to the audio input
Relation in positioning corresponding to the audio input channel.
5. haptic device as claimed in claim 1, wherein the Phase determination circuit and the peak amplitude determine that circuit carries
For in software layer.
6. haptic device as claimed in claim 1, wherein the Phase determination circuit and the peak amplitude determine that circuit carries
For in API key-courses.
7. haptic device as claimed in claim 1, wherein the haptic controller is configured to independently of the sound
The phase through determination and at least one other to control independently of the peak amplitude through determination of the audio input of frequency input
Actuator.
8. haptic device as claimed in claim 1, is further included：High-frequency coding circuit.
9. haptic device as claimed in claim 8, is further included：Lock control circuit, it is configured as activating the high-frequency
Coding circuit.
10. haptic device as claimed in claim 1, wherein the haptic controller is configured to specify based on user
Secondary tactile source trigger and control at least one actuator.
11. haptic device as claimed in claim 1, wherein the secondary tactile source triggering that the user specifies is based on user configuration
File.
12. haptic device as claimed in claim 11, wherein the user profile is stored in cloud.
13. haptic device as claimed in claim 1, wherein the haptic device is provided in game console input unit.
14. haptic device as claimed in claim 13, wherein the game console input unit includes control stick and game
At least one of handle.
15. haptic device as claimed in claim 1, is further included：At least one actuator.
16. a kind of method for controlling haptic device, this method includes：
Receive audio input；
Determine the phase of the audio input；
Determine the peak amplitude of the audio input；And
The phase based on the audio input and at least one to control based on the peak amplitude of the audio input
Actuator.
17. method as claimed in claim 16, is further included：The phase based on the audio input and based on described
The peak amplitude of audio input positions the channel corresponding to the audio input in time.
18. method as claimed in claim 16, is further included：The phase based on the audio input and based on described
The peak amplitude of audio input positions the channel corresponding to the audio input in phase.
19. method as claimed in claim 16, is further included：The phase based on the audio input and based on described
The peak amplitude of audio input, corresponding to the sound with positioning in the relation of the audio stream corresponding to the audio input
The channel of frequency input.
20. method as claimed in claim 16, the phase is determined and to the peak wherein being provided in software layer
Value amplitude is determined.
21. method as claimed in claim 16, the phase is determined and to described wherein being provided in API key-courses
Peak amplitude is determined.
22. method as claimed in claim 16, is further included：The phase through determination independently of the audio input and solely
The peak amplitude through determination of the audio input is stood on to control at least one other actuator.
23. method as claimed in claim 16, is further included：High-frequency encodes.
24. method as claimed in claim 23, is further included：Activate the high-frequency coding.
25. method as claimed in claim 16, is further included：Triggered based on the secondary tactile source that user specifies to control
At least one actuator.
26. method as claimed in claim 16, wherein the secondary tactile source triggering that the user specifies is based on user configuration
File.
27. method as claimed in claim 26, wherein the user profile is stored in cloud.
28. method as claimed in claim 16, wherein the haptic device is provided in game console input unit.
29. method as claimed in claim 28, wherein the game console input unit includes control stick and game paddle
At least one of.
30. method as claimed in claim 16, wherein the haptic device includes at least one actuator.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/SG2015/050139 WO2016195588A1 (en) | 2015-06-03 | 2015-06-03 | Haptics devices and methods for controlling a haptics device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107667334A true CN107667334A (en) | 2018-02-06 |
| CN107667334B CN107667334B (en) | 2021-07-06 |
Family
ID=57440858
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201580080682.4A Active CN107667334B (en) | 2015-06-03 | 2015-06-03 | Haptic device and method of controlling haptic device |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US10427040B2 (en) |
| EP (1) | EP3304251B1 (en) |
| CN (1) | CN107667334B (en) |
| AU (1) | AU2015397084B2 (en) |
| TW (1) | TWI692710B (en) |
| WO (1) | WO2016195588A1 (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100445930C (en) * | 2001-10-09 | 2008-12-24 | 伊默逊股份有限公司 | Haptic feedback sensations based on audio output from computer devices |
| US20110037546A1 (en) * | 2008-04-25 | 2011-02-17 | Dav | Electromagnetic actuator and corresponding control device with haptic feedback |
| EP2629178A1 (en) * | 2012-02-15 | 2013-08-21 | Immersion Corporation | High definition haptic effects generation using primitives |
| CN103971689A (en) * | 2013-02-04 | 2014-08-06 | 腾讯科技（深圳）有限公司 | Audio identification method and device |
| EP2778901A1 (en) * | 2013-03-15 | 2014-09-17 | Immersion Corporation | Method and haptic device for encoding and decoding haptic information |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003015407A1 (en) * | 2001-08-07 | 2003-02-20 | Polycom, Inc. | System and method for high resolution videoconferencing |
| US8525778B2 (en) * | 2007-03-21 | 2013-09-03 | Northwestern University | Haptic device with controlled traction forces |
| US8117364B2 (en) * | 2007-11-13 | 2012-02-14 | Microsoft Corporation | Enhanced protocol and architecture for low bandwidth force feedback game controller |
| JP5792951B2 (en) * | 2010-12-16 | 2015-10-14 | キヤノン株式会社 | Control device for vibration actuator |
| US8717152B2 (en) * | 2011-02-11 | 2014-05-06 | Immersion Corporation | Sound to haptic effect conversion system using waveform |
| US9489047B2 (en) | 2013-03-01 | 2016-11-08 | Immersion Corporation | Haptic device with linear resonant actuator |
| US9319415B2 (en) * | 2014-04-30 | 2016-04-19 | Intuit Inc. | Method and system for providing reference architecture pattern-based permissions management |
| US10353467B2 (en) * | 2015-03-06 | 2019-07-16 | Apple Inc. | Calibration of haptic devices |
| DK201670720A1 (en) * | 2016-09-06 | 2018-03-26 | Apple Inc | Devices, Methods, and Graphical User Interfaces for Generating Tactile Outputs |
-
2015
- 2015-06-03 CN CN201580080682.4A patent/CN107667334B/en active Active
- 2015-06-03 EP EP15894394.4A patent/EP3304251B1/en active Active
- 2015-06-03 US US15/578,810 patent/US10427040B2/en active Active
- 2015-06-03 WO PCT/SG2015/050139 patent/WO2016195588A1/en active Application Filing
- 2015-06-03 AU AU2015397084A patent/AU2015397084B2/en active Active
-
2016
- 2016-03-23 TW TW105108979A patent/TWI692710B/en active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100445930C (en) * | 2001-10-09 | 2008-12-24 | 伊默逊股份有限公司 | Haptic feedback sensations based on audio output from computer devices |
| US20110037546A1 (en) * | 2008-04-25 | 2011-02-17 | Dav | Electromagnetic actuator and corresponding control device with haptic feedback |
| EP2629178A1 (en) * | 2012-02-15 | 2013-08-21 | Immersion Corporation | High definition haptic effects generation using primitives |
| CN103971689A (en) * | 2013-02-04 | 2014-08-06 | 腾讯科技（深圳）有限公司 | Audio identification method and device |
| EP2778901A1 (en) * | 2013-03-15 | 2014-09-17 | Immersion Corporation | Method and haptic device for encoding and decoding haptic information |
Also Published As
| Publication number | Publication date |
|---|---|
| US10427040B2 (en) | 2019-10-01 |
| EP3304251A4 (en) | 2019-01-16 |
| WO2016195588A1 (en) | 2016-12-08 |
| EP3304251B1 (en) | 2023-10-11 |
| AU2015397084A1 (en) | 2017-12-21 |
| CN107667334B (en) | 2021-07-06 |
| EP3304251A1 (en) | 2018-04-11 |
| AU2015397084B2 (en) | 2021-05-27 |
| TWI692710B (en) | 2020-05-01 |
| TW201643665A (en) | 2016-12-16 |
| US20180154254A1 (en) | 2018-06-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10146311B2 (en) | Haptic devices and methods for providing haptic effects via audio tracks | |
| US20190087006A1 (en) | Devices and methods for modifying haptic effects | |
| US9619029B2 (en) | Haptic trigger control system | |
| EP2921212A1 (en) | Systems and methods for a shared haptic experience | |
| US8686941B2 (en) | Haptic feedback sensations based on audio output from computer devices | |
| CN105653026A (en) | Touch controller | |
| KR20160067766A (en) | Systems and methods for controlling haptic signals | |
| CN108404408A (en) | Information processing method, device, storage medium and electronic equipment | |
| KR20160056750A (en) | Haptic trigger modification system | |
| JP2021528763A (en) | Methods, systems, and programs for mapping inputs to software applications | |
| US20190054373A1 (en) | Method, computing device, and system for generating a mixed haptic track for a mixed haptic effect | |
| JP6801838B2 (en) | Fixing haptic effects for slow motion | |
| CN208756945U (en) | Game console with reconfigurable simulation rocking bar sensitivity modifier button | |
| CN106232194B (en) | Game delivery device, game delivery method, and game delivery program | |
| CN107667334A (en) | Haptic device and the method for controlling haptic device | |
| CN109890474B (en) | Method for simulating a virtual controller device, simulator and computer-readable medium | |
| KR20140127931A (en) | System and Method for implementing character action control skill in touch screen device | |
| CN107735150A (en) | Mixed using in equipment to render haptic effect |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |