CN104321115B - For the input sensitivity strengthened and functional multisensor joystick - Google Patents

For the input sensitivity strengthened and functional multisensor joystick Download PDF

Info

Publication number
CN104321115B
CN104321115B CN201280062818.5A CN201280062818A CN104321115B CN 104321115 B CN104321115 B CN 104321115B CN 201280062818 A CN201280062818 A CN 201280062818A CN 104321115 B CN104321115 B CN 104321115B
Authority
CN
China
Prior art keywords
joystick
sensor
order
controller
electronic equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201280062818.5A
Other languages
Chinese (zh)
Other versions
CN104321115A (en
Inventor
E.J.拉森
R.L.马克斯
A.米克海洛夫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc filed Critical Sony Computer Entertainment Inc
Publication of CN104321115A publication Critical patent/CN104321115A/en
Application granted granted Critical
Publication of CN104321115B publication Critical patent/CN104321115B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/22—Setup operations, e.g. calibration, key configuration or button assignment
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/218—Input arrangements for video game devices characterised by their sensors, purposes or types using pressure sensors, e.g. generating a signal proportional to the pressure applied by the player
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05G—CONTROL DEVICES OR SYSTEMS INSOFAR AS CHARACTERISED BY MECHANICAL FEATURES ONLY
    • G05G9/00—Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously
    • G05G9/02—Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only
    • G05G9/04—Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously
    • G05G9/047—Manually-actuated control mechanisms provided with one single controlling member co-operating with two or more controlled members, e.g. selectively, simultaneously the controlling member being movable in different independent ways, movement in each individual way actuating one controlled member only in which movement in two or more ways can occur simultaneously the controlling member being movable by hand about orthogonal axes, e.g. joysticks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0338—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Position Input By Displaying (AREA)

Abstract

One is incorporated to embedded type sensor in joystick to detect object, the system and method for the existence of such as thumb。There is detection signal to be generated by the sensor added, and when there is detection signal designation joystick not by the impact then property mechanical location wherein of the power outside controller, then automatic calibration logic can remove biasing in real time automatically from joystick。In a further embodiment, the outer surface across joystick arranges multiple embedded type sensors, to provide second position input equipment based on joystick。In such embodiments, it is possible to application sense of touch or proximity transducer technology are to improve the precision of the primary importance information that joystick generates, or the coordinate space that the coordinate space controlling to control with the primary importance information utilizing joystick to provide separates。

Description

For the input sensitivity strengthened and functional multisensor joystick
Technical field
The present invention relates to computer entry device, and relate more particularly to adopt the joystick of multiple input pickup kind。
Background technology
Catch the latest developments of (that is, following the tracks of the motion of system user, to cause corresponding effect on the figure of display) even with performance, the hand-held controller with joystick is maintained as the most popular input equipment of electronic game industry。Figure 1A describe can be commercially available for SonyPlaystation?The SonyDualShock3 of series electronic gaming platform?Hand-held controller 100。Hand-held controller 100 includes two thumb handle 105 highlighted from controller body 101。Each thumb handle 105 provides two dimension input (X, Y) that can be used for causing corresponding effect on the figure of display。Sometimes referred to as simulating handle or be more generally referred to as each thumb handle 105 of joystick " position of " center " position provides position input to calculating platform relative to the machinery in controller body 101 according to projection。During use, the thumb of user is typically placed on the top surface of each thumb handle 105, and the power that thumb applies changes the thumb handle 105 position relative to center。The rotary table of each thumb handle 105 is coupled to the potentiometer of two or more being contained in controller body 101, to provide proportional relative to the angle of center or position to thumb handle 105 electricity continuously to export (thus, term " simulating handle ")。
Although the control more preferably given by the Continuous property of thumb handle 105 has made than digital direction input equipment, the input equipment (particularly 3D being played) that all directionkeys as shown in Figure 1 (cross key) 110 are more popular, but near center location, thumb handle 105 is likely to shortcoming accuracy。The shortcoming of accuracy may not be limited by simulation resolution, but typically it is largely due to the positional information that exported from controller 100 by computer 100 or receive (such as, X, Y) the firmware calculated in platform or software " dead band " forced。
Figure 1B diagram is mapped to the dead band 103 around center (" initial point ") position 111 in the coordinate space of the mechanical range of thumb handle 105。The effect in dead band 103 be in that in dead band from the central position 111 any skew be left in the basket (that is, disposing as zero), with avoid self-controller 100 be not intended to input。Such as, thumb handle 105 can be moved to a little 120, and X, the Y output being associated is left in the basket, because it is in dead band 103。The reason forcing dead band 103 is that thumb handle 105 can be subject to mechanical wear over time, and would develop into " biasing " thus machine center moves, and causes center 111 to drift about。When biasing goes above dead band 103, such as, when center moves in Figure 1B 115, even if when not having actual user to input (such as, when controller 100 is in the free time), the position output carrying out self-controller 100 also will be transfused in graphics rendering engine and (that is, not be left in the basket)。Now, it is possible to promote user to be calibrated routine, Δ y is thereby determined that1With Δ x1, what make positional information with the new machine center around thumb handle 105 maps back to center。
Then, the size in dead band 103 is that alignment routine is likely to be imposed to the function of the frequency of user, and owing to being likely to change from a user to next user from the skew at center, therefore conventional in the prior art is the degree of accuracy about center sacrificing suitable amount, to be of value to the controller robustness of perception。Means and the technology of being improved the sensitivity of thumb handle 105 by the harmful effect with use of minimizing mechanical wear and big dead band are then advantageous for。
Illustrating further in Figure 1A, what remain routine is include one group of control on controller 100, including aided location control, such as cross key 110, are similar to thumb handle 105, and cross key 110 also exports at least in both direction (such as, X, Y) on positional information。Other control includes order button 109, and order button 109 provides the one-touch access calculating any number of function that platform is supported being communicatively coupled to by controller 100。But, the controller 100 of bigger build forced by aided location control and order button, and also requires that the thumb of user activates。Then, the use of cross key 110 and order button 109 needs thumb to move apart one of two thumb handle 105, crosses the distance in the reach area of thumb, to activate cross key 110, and is then returned to be placed in thumb handle 105。This Operations Requirements considerable time and dexterity carry out and are likely to cause human fatigue due to required range of movement。Improve the accessibility of aided location control and order button and the means of accuracy and what technology was then also advantageous that。
Accompanying drawing explanation
In the conclusion part of description, particularly point out and clearly claimed embodiments of the invention。But when combining the accompanying drawing enclosed and reading, with reference to the following detailed description, it is possible to about both organizational form and operational approach, be more fully understood that embodiments of the invention together with the purpose of the present invention, feature and advantage, in the accompanying drawings:
Figure 1A illustrates the isometric view of the hand-held electronic game console of routine；
The figure of the coordinate space of the output of the joystick that Figure 1B diagram is mapped in Fig. 1 diagrammatic conventional hand-held controller；
Fig. 2 A diagram is according to the isometric view of the joystick with embedded type sensor of embodiments of the invention；
Fig. 2 B diagram is according to the isometric view of the joystick with embedded type sensor of embodiments of the invention；
Fig. 2 C diagram is according to the isometric view of the joystick with embedded one-dimensional sensor array of embodiments of the invention；
Fig. 3 A diagram is according to the isometric view of the joystick with embedded one-dimensional sensor array of embodiments of the invention；
Fig. 3 B diagram is according to the isometric view of the joystick with embedded two-dimensional sensor array of embodiments of the invention；
Fig. 3 C diagram is according to the isometric view of the joystick with embedded two-dimensional sensor array of embodiments of the invention；
Fig. 4 A diagram is according to the isometric view of joystick of the embedded type sensor with power for detecting the object from contact joystick of embodiments of the invention；
Fig. 4 B diagram is according to the isometric view of joystick of the embedded type sensor with power for detecting the object from contact joystick of embodiments of the invention；
Fig. 4 C diagram is according to the isometric view of the joystick with embedded type sensor for detecting the object close to joystick of embodiments of the invention；
Fig. 4 D diagram is according to the isometric view of the joystick with embedded type sensor for detecting the object close to joystick of embodiments of the invention；
Fig. 5 A diagram is according to the state diagram of the joystick for having inactive state of embodiments of the invention；
Fig. 5 B be illustrate according to embodiments of the invention according to there is detection signal, the flow chart of automatic mode of calibration joystick；
Fig. 6 be according to embodiments of the invention in order to be controlled the automatically calibration of handle and/or to provide the functional-block diagram of hardware of second position information；
Fig. 7 A is the functional-block diagram in order to determine object and the hardware contacted of joystick according to embodiments of the invention；
Fig. 7 B is the functional-block diagram of the tactile sensing hardware according to embodiments of the invention；
Fig. 8 A is the functional-block diagram of the close hardware in order to determine object and joystick according to embodiments of the invention；
Fig. 8 B is the functional-block diagram close to sensing hardware according to embodiments of the invention；
Fig. 9 A-9C illustrates respectively and detects signal and the plane graph of the first and second positional informationes, side view and timing diagram according to the existence from the joystick incorporating sensor array of embodiments of the invention；
Figure 10 A and 10B diagram is according to the Multi-stage transmission sensor array of the surface mapping stress level across joystick of embodiments of the invention；
Figure 11 illustrates the first and second positional informationes that the basis according to embodiments of the invention receives from the joystick incorporating sensor array, controls the flow chart of the method for Drawing Object；
Figure 12 diagram according to one embodiment of the present of invention can be used for determine the hardware of object location information and user interface；
Figure 13 diagram is according to the additional firmware that can be used for processing instruction of one embodiment of the present of invention。
In order to make diagram clear, in figure, diagrammatic each element is not drawn necessarily to scale。Additionally, when thinking fit, repeat reference numerals in the various figures, to indicate corresponding or similar element。
Detailed description of the invention
Described herein is for improving the sensitivity of hand-held controller joystick and functional method and system。In an embodiment, by at least one additional sensor is incorporated in controller, such as, embed in the surface of joystick, to detect the existence of object, the such as thumb when diagrammatic thumb handle in being similar to Figure 1A, reduces the needs to the dead band around the center of joystick。Generate from described additional sensor and there is detection signal, when exist detection signal designation joystick by the impact of power outside controller and thus during property mechanical location wherein, then automatic calibration logic can remove biasing in real time from joystick。
In a further embodiment, the outer surface across joystick arranges multiple additional sensors, to provide second position input equipment based on joystick。In such embodiments, it is possible to application sense of touch or proximity transducer technology, to improve the precision of the primary importance information that joystick generates, or the coordinate space that the coordinate space controlling to control with the primary importance information utilizing joystick to provide separates。
In order to generate existence detection signal and second position information both or both one of, can in joystick embedded capacitor or other touchpad technology。It is likewise possible to alternatively adopt any photon, sound or thermal sensing technology as proximity transducer, be used for generating both existence detection signal and second position information or both one of。
Although for the thorough understanding providing embodiments of the invention, describing numerous details, but it will be appreciated by those skilled in the art that and can put into practice other embodiments when there is no these details。In other cases, it does not have known technology, hardware component and software algorithm are described in detail, in order to do not make the present invention smudgy。Here algorithm and symbol according to the operation about the data bit in computer storage or binary digital signal represent, give the some parts of described description。
Here algorithm and symbol according to the operation about the data bit in computer storage represent, give the some parts that detailed description provides。Unless it is specifically otherwise indicated, otherwise according to discussed below, obviously it should be appreciated that in whole description, utilize such as " calculating ", " determine ", " estimation ", " storage ", " collection ", " display ", " reception ", " merging ", " generation ", the discussion of " renewal " etc term is mentioned that action and the process of computer system or similar electronic computing device, it is operated and the data that physics (electronics) measures that are expressed as in the RS of computer system is transformed into computer system memory or depositor, or other such information stores, other data of analogously represented one-tenth physical quantity in transmission or display device。
Unless it is specifically otherwise indicated, otherwise according to discussed below, obviously it should be appreciated that in entire disclosure, the discussion utilizing such as " process ", " detection ", " determination " etc term is mentioned that action and/or the process of circuit, computer or similar electronic computing device, it is operated and/or being expressed as physical quantity in depositor and/or memorizer, for instance other data of the analogously represented one-tenth physical quantity that the data of amount of electrons are transformed in memorizer and/or depositor。
Computer program can be stored in computer-readable recording medium, the such as (but not limited to) dish of any kind, including floppy disk, CD (such as, compact disk read only memory (CD-ROM), digital video disc (DVD), Blu-ray disc?Deng) and magneto-optic disk, read only memory (ROM), random access memory (RAM), EPROM, EEPROM, magnetic or optical card, or compatibly store the non-state medium of other kind any of e-command。
Here, term " couples " and " connection ", can be used for the structural relation describing between the parts of the equipment carrying out each operation together with its derivative。It should be understood that these terms are not intended as synonym each other。On the contrary, in certain embodiments, " connection " is used for indicating two or more element physically or electrically to contact directly to each other, and " coupling " is used for indicating two or more element (to there is other intervening elements between them) directly with one another or indirectly and physically or electrically contacts, and/or said two or more element are worked in coordination with or intercommunication mutually (such as, as become cause and effect relation)。
In an embodiment, embedded type sensor is disposed in joystick。Described sensor serve as with will be independent of being couple to the actuator of joystick for joystick free time/basis that makes a distinction between inactive state and active state, the displacement of sensor response joystick (relative to controller) generates primary importance information (X1, Y1)。Such as, there is one or more responsible generation primary importance information (X1, Y1) one or more potentiometric simulation joystick in；Described sensor will provide for detecting the device of the applying of the power to joystick independent of potentiometer。
Advantageously, embedded type sensor can detect the existence level being still not enough to physically shift control handle of necessity。This be not to say that can not when not generating existence detection signal physically shift control handle, but embedded type sensor and support circuit can (described physical contact may generate and be couple to joystick, and is responsible for generating primary importance information (X according to physical contact1, Y1) actuator resolution in displacement) or the physical contact (it will not generate any mechanical displacement in the resolution of actuator) that approaches, generate " there is detection " signal。
In an embodiment, in response to adjoint mechanical displacement joystick to generate primary importance information (X1, Y1) the activity approaching applying of required power and make existence detection signal。Then, contrary with the standing order button (such as, " thumb handle is downward " order actuator) on joystick, embedded type sensor by do not have user beyond in order to generate primary importance information (X1, Y1) the deliberate action of the action required by purpose shift control handle when, generate and there is detection signal。Like this, for a user, embedded type sensor can be fully transparent (that is, functionally invisible)。Embedded type sensor generate existence detection signal be then able to provide for reduce dead band and/or for primary importance information (X1, Y1) relevant basis, consequently, it is possible to infer primary importance information (X with bigger sensitivity1, Y1), and do not require the deliberate action beyond the action required routinely for shift control handle of user。In order to generate the embedded type sensor and circuit that there is detection signal thus can be integrated in any joystick, and do not sacrifice existing functional and sense of touch。Such as, embedded type sensor described herein can be added to thumb handle 105, maintains essentially identical shape, sensation and function simultaneously, provides higher position-sensitivity simultaneously。
In an embodiment, embedded type sensor is disposed in certain part of joystick。Fig. 2 A diagram is according to the isometric view of the joystick 200 when embedded type sensor 225 is disposed in the top surface 207 of joystick of embodiments of the invention。As illustrated, joystick includes the joystick cap 205 on the bar 208 prominent from joystick base 210, and joystick base 210 is limited by controller body 201。Compared with the external diameter of joystick cap 205, joystick bar 208 has less external diameter。Embedded type sensor 225 detection touchs or proximates to the existence of object of joystick cap 205, and joystick will provide for and turn round the joystick base 210 mobile corresponding primary importance information relative to controller body 201。In one embodiment, joystick 200 is the direct replacer of diagrammatic thumb handle 105 in Figure 1A。For such embodiment, each of two thumb handle 105 can be substituted by the joystick 200 at least with single embedded type sensor 225。
The isometric view of the joystick 215 that Fig. 2 B diagram is disposed in the sidewall 209 of joystick cap 205 according to the embedded type sensor 225 of an alternative embodiment of the invention。Fig. 2 C illustrates the isometric view of the joystick 215 that embedded type sensor 225 is disposed in joystick bar 208。Other alternative includes the sensor being arranged in joystick base 210。
In an embodiment, in joystick, arrange multiple embedded type sensors of the operable object touching or proximating to joystick with detection。In any way, the plurality of embedded type sensor can be arranged across outer surface, thus forming the grid network of sensor points。Fig. 3 A diagram is according to the isometric view of the joystick 300 with two dimension (2D) sensor array 325 of embodiments of the invention。Sensor array 325 includes the more than one embedded type sensor 225 of the top surface 207 across joystick 200。Fig. 3 B diagram is according to the isometric view of the joystick 315 of having of embodiments of the invention one-dimensional (1D) sensor array 325。One-dimensional sensor array 325 includes the row's embedded type sensor 225 around the girth surrounding joystick cap sidewall 307。Alternative also includes a peacekeeping two-dimensional array across top surface 207 or sidewall 209 respectively。Fig. 3 C diagram is according to the isometric view of the joystick 320 of the one-dimensional sensor array 325 having in joystick bar 208 of embodiments of the invention。Sensor array 325 includes the more than one sensor 325 around joystick bar 208 arrangement。
Usually, the sensor embedded in joystick can be as known in the art be used to input primary importance information (X when joystick1, Y1) (that is, joystick is active) time, it is possible to independently generate and there is detection any touch sensor of signal or proximity transducer。In the first embodiment, embedded type sensor 225,325 is the touch sensor contacted of detection object and joystick。For thumb handle embodiment, described object is assumed to be the thumb of user, but, depend on the tactile sensor technology adopted, it is possible to sense some passive object。In the exemplary embodiment, touch sensor detection the electric capacity of outer surface of joystick, resistance, applying power, or their change。
Capacitance sensing embodiment realizes previously described any sensor or sensor array configuration (such as, in Fig. 2 A-3C) here, in order to when the thumb contact joystick of user, the change of record electric capacity or electric capacity。The deformation (distortion or other) of certain part of power sensing embodiment detection joystick。In one embodiment, joystick embeds deformeter (such as diagrammatic optional position in Fig. 2 A-3C), so that along with the regional area of joystick records resistance change in response to having to be distorted along the load forces (such as, from thumb) of the first dimension or the component of the displacement of the second dimension driving joystick 400。Such as, in Figure 4 A in diagrammatic joystick 400, on joystick cap 405 can deformation upper surface eyelid covering or pad under arrange foil-type deformeter 425, when load forces F makes paillon foil deformation, generate exist detection signal。Certainly, quasiconductor (pressure drag) meter can also be used as paillon foil strain gauge with same ability。Although load forces F has a component of displacement driving joystick 300 along arbitrary dimension along dimension x or y, but can or by described force component or obtained the deformation detected by the subsidiary component on z-dimension。Such as, deformeter 425 can detect the deformation in the upper surface eyelid covering caused by the threshold pressure on the top surface of joystick cap。Sensing in embodiment in this power, deformeter 425 detects to utilize the friction between object and joystick to come along the pressure (generally, the z-component of load forces F) required for x or y-dimension shift control handle。As another example, deformeter 425 can be disposed in around the girth of joystick cap 405, to detect the load forces component parallel of the deformation in the upper surface eyelid covering caused by the pressure on the sidewall of joystick cap 405, described pressure and x or y-dimension。
Sensing in embodiment in another power, at least one piezoresistance sensor is disposed in the bar of joystick to be passed down to the rotary table of joystick from object contact point and deformation along with driving force。Such as, in figure 4b in diagrammatic joystick, multiple semiconductor strain gages 425 are disposed in bar 408, when one of any power F owing to having some components along x or y-dimension of deformeter 425 is passed to rotary table 410 thus resisting the power of one or more back-moving spring and driving the displacement of joystick 300 along arbitrary dimension and during deformation, generate and there is detection signal。
In an embodiment, embedded type sensor comprises the proximity transducer that detects the object being separated by threshold distance on the surface with joystick。Before applying power is with shift control handle, proximity transducer generates exists detection signal for making joystick be converted to active state。For thumb handle embodiment, it is the thumb of user that the object of detection is assumed, but, depend on adopting close to detection technology, some also can be triggered existence detection signal by animal body。Fig. 4 C diagram has the isometric view of the joystick 420 of exemplary embedded proximity transducer embodiment。Embedded proximity transducer 425 and/or 426 is disposed on joystick cap 405。In diagrammatic example, proximity transducer 425 is to having radiation h ν1Radiation, the photoelectric detector of such as ambient light。When joystick 420 is used in by the displacement input primary importance information of joystick 420, because photoelectric detector becomes being interdicted described radiation and shielded by thumb 400, existence detection signal therefore can be generated。
In an embodiment, depend on, close to sensing, the parts being arranged in controller body。Such as, in figure 4 c, proximity transducer 426 can be to radiation h ν2Sensitive photoelectric detector, described radiation h ν2Can be such as from the LED431 being arranged in controller body 401 narrow emission launched and IR。When thumb 400 moves to correct position with shift control handle 420, become to be interrupted the transmitting from LED431 in response to photoelectric detector 426, generate and there is detection signal。Such arrowband photodetector embodiment is advantageously insensitive for ambient light level, and the then unlikely just existence detection signal (that is, the existence detected from the situation except the joystick use having a mind to) generating the vacation caused by dark surrounds。
As the another kind of diagram of proximity transducer, Fig. 4 D illustrates the isometric view of the joystick 435 of a part for the acoustic transceiver of embedded type sensor 425 formation transmitting sound wave 436 (such as, ultrasound wave)。When thumb 400 is near joystick cap 405, sound 437 is reflected and is embedded into formula proximity transducer 425 and detected。When reflection sound 437 indicate thumb 400 be in the threshold value to joystick 420 close to time, can then generate existence detection signal。Other can be adopted similarly close to detection technology, for instance, it is possible to use projected capacitive touch-sensing or thermal sensing。
Fig. 5 A diagram is according to the state diagram of the joystick of embodiments of the invention。As shown, except " activity " state 510, joystick is also provided with " inertia " state, and both states exist detection signal and distinguish。Instruction joystick is detected signal (such as by the existence being intended for use as position input equipment, logic high or logic low) cause joystick to enter active state 510, during active state 510, primary importance information is mapped to the first coordinate space such as generated by the graphics engine in the exemplary environments of electronic game platform。Instruction joystick is not detected signal (such as by the existence being intended for use as position input equipment, logic low or logic high) cause joystick to enter inactive state 500, during inactive state 500, as a part for automatic real time calibration routine, primary importance information is mapped to the datum mark of the first coordinate space。Utilize each transformation from inactive state to active state, it is contemplated that input be immediately following joystick position after first automatic zero set, it is possible to precision makes the mapping to coordinate space of the primary importance information highly。
Fig. 5 B illustrates according to embodiments of the invention, according to there is detection signal, enables the flow chart of the automatic mode 550 of joystick。From operation 502, receive and there is detection sensor output。If the value instruction that there is detection signal does not have object (thumb), then is not for Drawing Object control, enables joystick (inactive state 500)。Method 550 enters operation 570, carrying out automatic alignment routine, wherein the datum mark in the first coordinate space (such as, zero point, center, initial point etc.) is mapped to Current mechanical position or the angle of controller, output as primary importance changer (such as, potentiometer)。
On the contrary, if there is the existence of value instruction object (thumb) of detection signal, then method 550 enters operation 559, in operation 559, for Drawing Object control, joystick (that is, entering active state 510) is enabled。In the first embodiment, at operation 560, primary importance information (X1, Y1) it is the output generated by primary importance changer (such as, potentiometer), and it is mapped to the coordinate space relevant with the up-to-date reference position determined in operation 570。
In another embodiment, as further described in other place here, when joystick includes embedded type sensor array, when when operating 559 enable joystick, generate second position information (X by the output of embedded type sensor is mapped to the second coordinate space2, Y2)。
Fig. 6 is the functional-block diagram of the calibration automatically being controlled handle in real time according to embodiments of the invention and/or the hardware providing second position information。Controller 601 includes at least one joystick 605, but as be positioned at square frame under joystick 605 illustrate, for controller 601, it is possible to there is more than one joystick 605。Controller 601 also includes the position sensor 615 coupled with joystick 605, and the displacement (angle or other displacement) of 615 joysticks 605 of position sensor is transformed into primary importance information (X1, Y1)。In diagrammatic exemplary embodiment, position sensor 615 also includes X potentiometer 616 and Y potentiometer 617。Controller 601 also includes any number of order button 613, and has the cross key 610 of at least one directionkeys 612。
Joystick 605 includes order button 614, for instance, " thumb handle is downward " orders, and it is by activating relative to the downward shift control handle 605 of the body of controller 601。Joystick 605 also includes at least one embedded type sensor 625, the additional embedded type sensor 627 and 629 in dotted line illustrate, embedded type sensor can be arranged to form embedded type sensor array 620。
The output of embedded type sensor 625 or sensor array 620 is exported to CL Compare Logic 611, at CL Compare Logic 611, sensor output with threshold ratio relatively。When sensor output exceedes threshold value, transmit to state machine 633 and there is detection signal 630, state machine 633, according to the existence detection signal 630 exported from embedded type sensor 625 or sensor array 620, makes the state (active state 500 or inactive state 510) of joystick 605 advance。For the embodiment with embedded type sensor array 620, if arbitrary n embedded type sensor 625,627,629 generates the output of the existence of instruction object, then the output of array is carried out logical "and" to generate existence detection signal 630。
When joystick state is confirmed as inertia, joystick calibration logic 635 carries out automatic calibrating method 550, to update reference position。When joystick state is confirmed as active state, primary importance information (X1, Y1) signal 645 refers to the reference position signal 645 that joystick calibration logic 635 exports, and be transmitted to and calculating the graphics engine 655 performed on platform 650。For the embodiment with embedded type sensor array 620, the output of array 620 is taken as second position information (X2, Y2) signal 651 sends graphics engine 655 to。Then graphics engine 655 exports (multiple) Drawing Object at least controlled by primary importance information to display。
In one embodiment, joystick calibration logic 635 is physically to be arranged in the intrinsic circuit of controller 601, firmware and/or software。For such embodiment, removing in real time of joystick biasing is besieged and invisible for calculating platform 650。For such embodiment, the application program performed on calculating platform 650 can include user and can set to reduce or eliminate the labelling in the joystick dead band forcing at primary importance information signal 645。Alternatively, when calculate platform 650 just perform to be configured to utilize Dead band controller 656 receive there is detection signal 630 or second position information signal 651 (for sensor array embodiments) and depend on whether there is detection signal 630 to adjust the application program in dead band from controller output, can automatically reduce or eliminate joystick dead band。When traditional controller does not provide existence detection signal 630, Dead band controller 656 can force dead band bigger compared with the situation of controller output existence detection signal 630。
In another embodiment, joystick calibration logic 635 is physically to be arranged in the circuit, firmware and/or the software that calculate in platform 650。For such embodiment, can include detecting signal 630 or second position information signal 651 (for sensor array embodiments) in response to receiving to exist and reducing or eliminate the logic in the joystick dead band forcing at primary importance information signal 645 calculating the application program performed on platform 650。
Fig. 7 A is the functional-block diagram according to embodiments of the invention earnest body really with the hardware contacted of joystick 605。Docking sense of touch surveys embodiment, embedded type sensor 625 is touch sensor, and joystick 605 includes when absolute or relative measurement exceed threshold level, or it changes when exceeding threshold level, one or more touch sensor 725,727,729 contacted of record object and joystick 605。Fig. 7 B is the functional-block diagram of the tactile sensing hardware according to embodiments of the invention。In the exemplary embodiment, touch sensor 725 is capacitance sensor 780 or resistance sensor 786。Sensor array embodiment, condenser type or resistive touch sensor 725,727,729 are formed the touch pad being arranged on the surface of joystick 605。Condenser type and resistive touch sensor array can provide any number of sensing points of the typical resolution with the conventional touch pad for mobile computing platform。Sensing in embodiment in power, force transducer 781 can include arbitrary pressure drag or piezoelectric transducer 782, resistance-type or elastoresistance formula sensor 783, capacitance type sensor 784 or inductance type transducer 785。Can each many deformation of these tactile sensing technology commercially available for realizing sensor 725。
Fig. 8 A is the functional-block diagram of the close hardware according to embodiments of the invention earnest body really and joystick 605。For close to sensing embodiment, embedded type sensor 625 is proximity transducer, and joystick 605 include when definitely or relative measurement exceed threshold level, or it changes one or more close proximity transducer 825,827,829 of record object and joystick 605 when exceeding threshold level。For diagrammatic exemplary embodiment further in Fig. 8 B, proximity transducer 825 is arranged on the heat sensor 880 in joystick 605, photoelectric detector and/or emitter 881, acoustics (such as, ultrasound wave) transceiver 882 or projected capacitive and touches (PCT) sensor 883。
Now turn to operation 580 discussed further, in the embodiment adopting embedded type sensor array, except except the primary importance information of joystick, second position information can be determined from joystick, and calculate platform 650 and utilize described second position information。Fig. 9 A-9C illustrates according to embodiments of the invention, from the plane graph of the first and second positional informationes of the joystick 905 incorporating sensor array, side view and timing diagram。In this exemplary embodiment, joystick 905 is realized as thumb handle。At time t0With time t1Between first time interim, any sensor of being arranged on joystick 905 is all not detected by thumb to be existed, and there is detection for low level, and joystick 905 is inactive。As shown in fig. 9b, joystick 905 along with by the orthogonal z-axis of the x-axis of controller ontology definition and y-axis, deviate the amount of θ, φ from real mechanical center position。As shown in Figure 9 C, during the first period, for instance by automatic calibrating method 550, primary importance information X1, Y1It is set to reference position X1(0), Y1, and be absent from second position information (X (0)2, Y2)。
At time t1With time t2Between the second period during, the embedded type sensor (such as, 925 and 927) of array detects that thumb exists, and makes joystick 905 enter active state, X1(1), Y1(1) it is the primary importance information recording the displacement for the joystick 905 making joystick 905 be directed at z-axis and utilize the thumb of user to occur。Additionally during the second period, embedded type sensor 925 and 927 is by the array averaging of any routine, for instance, the barycenter of multiple sensors 925,927 etc. of the existence of identification record thumb, define initial second position information X2(0), Y2(0)。
At time t2With time t3Between the 3rd period during, at X1(2), Y1(2) equal to X1(1), Y1(1), when, joystick 905 is maintained at identical physical location relative to controller body。During this time, there is detection and keep high level, but, the existence of the thumb of user is detected by embedded type sensor 929 and 925 now, and sensor 927 no longer detects existence。As response, second position information is with recording relative to X2(0), Y2(0) X that centroid position changes2(1), Y2(1) change。
At time t3During the 4th period occurred afterwards, owing to utilizing thumb along the x-axis shift control handle 905 of controller, therefore there is detection and keep high level。Primary importance information X1Record and X1And X (2)1(3) change between。The existence of the thumb of user remain by embedded type sensor 929 and 925 detect, thus from the 3rd period second position information X2(2), Y2(2) remain unchanged。
As Fig. 9 A-9C illustrate, utilize into the embedded type sensor of array, joystick 905 may be in response to physical location (such as, the barycenter) change over time of the sensor that is triggered that detection exists, and provides second position information independent of primary importance information。In another embodiment, joystick 905, in response to the change over time being higher than the level that there is detection threshold value, provides second position information independent of primary importance information。Such as, Figure 10 A and 10B diagram is according to the Multi-stage transmission sensor array of the surface mapping pressure across joystick of embodiments of the invention。In Figure 10 A, sensor 1025 and 1027 record exceedes the first stress level of threshold value " there is detection " level, and sensor 1029 records also above threshold value " there is detection " level, but as an example, lower than the second stress level of the first stress level。In fig. 1 ob, the second stress level of sensor 1029 record changes (such as increasing to) to the first stress level。Similarly, the first stress level of sensor 1027 record changes (being such as reduced to) to the second stress level。Like this, although between Figure 10 A and 10B, the overall sensor that detection exists does not change, but centroid position calculates and may be incorporated into the multistage sensing function given by some sense of touch (with close) sensor, to generate second position information (X2, Y2)。In one embodiment, for instance, by by the level the sensed position weighting to each sensor that is triggered in array, determining centroid position。
No matter according to the change of the sensing station that is triggered, be triggered sensor levels or both, the second position information generated all can strengthen the functional of joystick。In thumb handle embodiment, obtain second position information from the motion of thumb (rather than wrist and thumb), without thumb from the big distance of thumb handle displacement。For such embodiment, barycenter mobile possibility over time is only small, less than sensor array dimension (such as, width) 25% or be even less than 10%。Like this, when in response to the power by thumb, thumb handle applied in order to thumb handle in one direction is displaced to another direction change on direction, along with the thumb finger belly of user is in the rolling from side to opposite side or deformation during pitching, second position information can catch relative to the minor alteration on the user thumb finger belly position of thumb handle or pressure distribution。
In other embodiments, the much bigger relative motion between second position information capture the second object and joystick。For such embodiment, barycenter movement in time is likely to bigger, for instance the 25% or more of sensor array dimension (such as, width)。Such as, in a thumb handle embodiment, second position information can be used for providing " hitting " function to joystick, follows the tracks of ball input equipment with virtualization in joystick。Although the functional meeting of true tracking ball in joystick since it is desired that facing to joystick centralizing spring transfer charge power and make joystick displacement thus hindered, but, making the thumb pressure change stiction to affect between the thumb of user and joystick only by user, embedded type sensor array just can be used for the input of second position information。Hitting the motion that can be recorded as thumb across the surface of joystick, this motion can typically occur when origin position at joystick, because during swing movement, the thumb of user will not pin handle in any specific position。
In an embodiment, performing in the application program calculated on platform, the second position information of joystick sensor array column-generation it is mapped to coordinate space。In one embodiment, the coordinate space that primary importance information is mapped to from second position information is mapped to coordinate space is different。In an alternate embodiment, the first and second positional informationes are mapped to identical coordinate space。In any one embodiment, although joystick is in center, second position data are likely to the relative motion between the thumb and the joystick that catch relatively large user, origin position originally catch shifted from the central position to joystick relevant and at joystick by the small relative motion between thumb and joystick before shifting from the central position, user。Like this, when the second position data utilizing software to distinguish the second position data of micro perspective and macroscopic scale, both the first and second embodiments can be realized on single joystick。
Figure 11 illustrates according to embodiments of the invention, according to the first and second positional informationes received from the joystick incorporating sensor array, controls the flow chart of the method 1100 of Drawing Object。In operation 1160 and 1165, as described in other place here, receive the first and second positional informationes from corresponding source。In the first embodiment, at operation 1170, primary importance information (X1, Y1) it is mapped to the first coordinate space。Such as, in 3D game application, in the such as graphics engine of first person shooting game (FPS) application program, primary importance information (X1, Y1) it is mapped to camera coverage space。Control in the camera coverage space as Drawing Object of operation 1180 is thus being at least partially based on primary importance information。In the first embodiment, at operation 1175, second position information (X2, Y2) it is mapped to the second coordinate space。Such as, in the graphics engine of identical 3D game application, second position information (X2, Y2) it is mapped to object space。The control of the aiming as Drawing Object (such as, cross-hair) of the operation 1180 in the cone in camera coverage space is thus being at least partially based on second position information。By this way, second position information can be used for " control cap " ability of the motion based on single thumb。As another example, the order that calculating platform performs to define in order coordinate space can be triggered across hitting of the top of thumb handle, such as, second position data can be mapped to that menu is drop-down, screen changes, apparant change or the configuration of other non-spatial attributes any of Drawing Object that rendered by graphics engine。
In an alternate embodiment, operating the second position data of 1165 receptions and combined in the primary importance data of operation 1160 reception, and be mapped to identical coordinate space in operation 1180。Such as, in the graphics engine of 3D game application, primary importance information (X1, Y1) and second position information (X2, Y2) both is mapped to camera coverage space, but plays not same-action。In one suchembodiment, second position information can carry out " mouse visual angle " with rotary camera visual-field space, and primary importance information is used for revising camera coverage space and runs with simulation。In another embodiment, primary importance information (X1, Y1) and second position information (X2, Y2) both it being mapped to identical coordinate space (such as, camera coverage space), the first and second positional informationes have identical function simultaneously。Such as, second position data can be imported into comb filter, to improve the signal to noise ratio (SNR) of primary importance data, and thus improves the sensitivity of joystick further。As another example, minor alteration according to thumb pressure level and the second position data that generate are mapped to same coordinate space (such as, camera coverage space), to be mapped to the coordinate space with the first scale factor in the displacement relative to joystick utilizing embedded type sensor An arrayed recording, and the displacement relative to the joystick of controller body utilizing potentiometer record be mapped to there is second (less) scale factor coordinate space (such as, camera coverage space) when, non-linear placement input is provided to and calculates in platform。
Figure 12 illustrates further according to one embodiment of the present of invention, can be used for coming hardware and the user interface of adaptive display according to object tracking。Figure 12 schematically illustrates Sony?Playstation?The whole system framework of 3 amusement equipment (a kind of control station being compatible for for realizing object tracking methods described herein)。Platform unit 1400 is provided, and may be connected to each ancillary equipment of platform unit 1400。Platform unit 1400 includes: Cell processor 1428；Rambus?Dynamic random access memory (XDRAM) unit 1426；There is the RealitySimulator(reality simulator of dedicated video random access memory (VRAM) unit 1432) graphic element 1430；With I/O bridger 1434。Platform unit 1400 also comprises for from the dish 1440A BluRay being read out?DISKBD-ROM?CD reader 1440, and dismountable suction-type hard disk drive (HDD) 1436 that I/O bridger 1434 accesses can be passed through。Alternatively, platform unit 1400 also comprises can pass through the memory card reader 1438 that I/O bridger 1434 accesses similarly, is used for reading compact flash, MemoryStick?Storage card etc.。
I/O bridger 1434 is also connected to multiple USB (universal serial bus) (USB) 2.0 port 1424；Gigabit Ethernet port 1422；IEEE802.11b/g wireless network (Wi-Fi) port 1420；With the Bluetooth that can support up to 7 bluetooths connections?Wireless link port 1418。
In operation, I/O bridger 1434 processes all of wireless, USB and Ethernet data, including from the data with joystick described herein one or more game console 1402 functional。Such as, when user plays game, I/O bridger 1434 through Bluetooth link, receives the data from game (motion) controller 1402, and described data is directed to Cell processor 1428, the current state of Cell processor 1428 correspondingly more new game。
Except game console 1402, radio port, USB port and ethernet port also provide for other ancillary equipment and connect, such as: remote controller 1404；Keyboard 1406；Mouse 1408；Portable entertainment device 1410, such as SonyPlaystation?Portable entertainment device；Video image sensors, such as Playstation?Eye video image sensors 1412；Microphone earphone 1414；Microphone array 1415。Then, such ancillary equipment can be wirelessly connected to platform unit 1400 in principle；Such as, portable entertainment device 1410 can communicate through Wi-Fiad-ho connection, and microphone earphone 1414 can communicate through Bluetooth link。
The meaning Playstation3 equipment that arranges of these interfaces also potentially can with other ancillary equipment, and such as digital VTR (DVR), Set Top Box, digital video image sensor, portable electronic device, voice-over-IP telephone machine, mobile phone, printer and scanner are compatible。
Game console 1402 is operable with by Bluetooth link, and platform unit 1400 radio communication, or is connected to USB port, thus also provides for the electric power that the battery to game console 1402 charges。Game console 1402 may also include the recognizing of the spherical part of memorizer, processor, the optical transmitting set of the permanent memory of memory card reader, such as flash memory etc, such as LED or infrared light etc, mike and speaker, digital video image sensor, subregion photodiode, internal clocking, such as object game control station/can recognize that shape。
Except conventional button as known in the art or joystick order, or replace described conventional button or joystick order, be also the input configuration game console 1402 for game described herein。Alternatively, the ancillary equipment that other can be wireless enabled, such as Playstation?Portable set can serve as has the functional controller of joystick described herein。At Playstation?When portable set, it is possible to additional game or control information (such as, control instruction or life number) are provided on the screen of the device。Other can also be used to replace or auxiliary control appliance, such as DDR (not shown), light gun (not shown), steering wheel and pedal (not shown) etc.。
Remote controller 1404 is also operable to by Bluetooth link, with platform unit 1400 radio communication。Remote controller 1404 comprises and is suitable for BluRay?The operation of CD BD-ROM reader 1440, and it is suitable for the control of the navigation of CD content。
Except conventional imprinting in advance and recordable CD, and outside so-called super-audio (SuperAudio) CD, BluRay?CD BD-ROM reader 1440 is also operable to read the CD-ROM with Playstation equipment and PlayStation2 hardware compatibility。Except conventional imprinting in advance and except recordable DVD, reader 1440 is also operable to read and the DVD-ROM of Playstation2 equipment and PlayStation3 hardware compatibility。Reader 1440 is also operable to read and the BD-ROM of Playstation3 hardware compatibility, and the imprinting in advance of routine and recordable Blu-ray Disc。
Platform unit 1400 is operable with by Voice & Video adapter, being supplied to display and audio output device by the Voice & Video that reality simulator graphic element 1430 generates or decodes by Playstation3 equipment。Audio connector 1450 can include the analog-and digital-output of routine, and video-frequency connector 1452 can include component video, S-video, composite video and one or more HDMI (HDMI) output in many aspects。As a result, video frequency output can be the form of such as PAL or NTSC etc, or is 720p, 1080i or 1080p fine definition。
In one embodiment, video image sensors 1412 comprises single charge-coupled image sensor (CCD) and LED indicator。In certain embodiments, imageing sensor 1412 includes the real-time data compression based on software and hardware and encoding device, so that can by suitable form, such as transmit the video data compressed based on MPEG (Motion Picture Experts Group) standard of I picture, in order to decoded by platform unit 1400。Video image sensors LED indicator is arranged in response to the suitably control data from platform unit 1400 luminous, such as to represent disadvantageous lighting condition。Each embodiment of video image sensors 1412 can pass through HDMI, USB, bluetooth or Wi-Fi communication port, is connected to platform unit 1400 in many aspects。Each embodiment of video image sensors can include one or more mike being associated, and also is able to transmit voice data。In the embodiment of video image sensors, CCD can have the resolution being suitable for high definition video seizure。In use, utilize the image that video image sensors catches such as to be incorporated in game, or be construed as game control input。In another embodiment, video image sensors is suitable for the Infrared video image sensor of detection infrared light。
Figure 13 diagram is according to the additional firmware that can be used for processing instruction of one embodiment of the present of invention。Illustrating further in Figure 13, the Cell processor 1428 of Figure 12 has the framework comprising 4 basic elements of character: externally input and export structure, comprises storage control 2160 and dual bus interface controller 2170A, B；Mention being the primary processor of main treatment element 2150；Mention 8 coprocessors for collaborative treatment element (SPE) 2110A-H；With the circular data bus mentioning the above-mentioned each parts of connection for Component Interconnect bus 2180。
Main treatment element (PPE) 2150 is based on the internal operation clock with 3.2GHz, the Power PC core (PPU) 2155 compatible with two-way simultaneous multithreading Power1470。It includes one-level (L1) high-speed cache 2151 of two-stage (L2) high-speed cache 2152 of 512kB and 32kB。PPE2150 can carry out 8 independent position computings in each clock cycle, converts 25.6GFLOP to by 3.2GHz。The Main Function of PPE2150 acts as the controller of the SPE2110A-H processing most amount of calculation。In operation, PPE2150 maintains job queue, for SPE2110A-H schedule job, and monitors their progress。As a result, each SPE2110A-H runs its effect is fetch operation, perform this operation and the kernel Tong Bu with PPE2150。
Each collaborative treatment element (SPE) 2110A-H comprises corresponding synergetic unit (SPU) 2114A-H, with corresponding storage flow controller (MFC) 2140A-H, storage flow controller (MFC) 2140A-H and then comprise corresponding DYNAMIC MEMORY ACCESS controller (DMAC) 2142A-H, corresponding MMU (MMU) 2144A-H and EBI (not shown)。Each SPU2114A-H is the risc processor with local RAM2130A-H。
Component Interconnect bus (EIB) 2180 is the logic circular communication bus in Cell processor 1428, it connects above-mentioned processor elements, i.e. PPE2150, storage control 2160, dual bus interface controller 1570A, B, and 8 SPE2110A-H, 12 participants altogether。Participant by the speed of each clock cycle at least 8 byte, can read while write described bus。As earlier indicated, each SPE2110A-H comprises for dispatching the longer DMAC2142A-H reading or writing sequence。EIB comprises 4 passages, two clockwise, and counter-clockwise direction two。Result is for 12 participants, and the longest progressively data flowing between any two participant is 6 steps in suitable direction。
Storage control 2160 comprises XDRAM interface 2126, by XDRAM interface 2126, storage control and XDRAM mutual connection。Dual bus interface controller 2170A, B comprise system interface 2172A, B。
It should be understood that above description be intended that illustration rather than limitation。Such as, although the flow chart in figure illustrates the particular order of the operation undertaken by certain embodiments of the present invention, it is to be understood that such order is not that required (such as, alternative embodiment can carry out each operation in a different order, combine some operation, some operation overlapping etc.)。Additionally, when reading and understanding above description, many other embodiments are apparent to those skilled in the art。Although describing the present invention with reference to specific exemplary embodiment, it will be appreciated that the present invention is not restricted to the embodiment described, but in the spirit and scope of claims, modifications and changes the present invention can be put into practice。Then, the scope of the present invention should refer to the gamut of the equivalent that appended claims are endowed together with such claim and determines。

Claims (17)

1. an electronic equipment, including:
First circuit, in order to receive primary importance information, described primary importance information is associated relative to the physical displacement of reference position at least the first dimension and the second dimension with joystick；
Second circuit, in order to automatically sense object whether close to or contact joystick, and generate the existence detection signal of correspondence；With
In order to not have the detection signal of object proximity or contact joystick in response to instruction, calibration is for the logic of the reference position of joystick automatically。
2. the electronic equipment described in claim 1, wherein the logic in order to automatically to calibrate reference position makes the mechanical location of joystick relevant to the place-centric point in logical coordinates space。
3. the electronic equipment described in claim 1, also includes:
Joystick；
It is couple to the first sensor of joystick, in order to detect the physical displacement of joystick and to generate corresponding primary importance information；With
Second sensor, in order to detect the existence of the object touching or proximating to joystick and to generate corresponding existence detection signal。
4. the electronic equipment described in claim 3, wherein the second sensor comprises the touch sensor being arranged in joystick, and described touch sensor is in order to detect the power that electric capacity, resistance or the outer surface at joystick apply。
5. the electronic equipment described in claim 4, wherein touch sensor comprises at least one in pressure resistance type, piezoelectric type, resistance-type, condenser type or optical touch sensitive device。
6. the electronic equipment described in claim 5, wherein resistive touch sensor is elastoresistance formula touch sensor。
7. the electronic equipment described in claim 3, wherein the second sensor comprises the proximity transducer arranged in the controller, and described proximity transducer is in order to detect the object in the threshold distance from the surface of joystick。
8. the electronic equipment described in claim 7, wherein proximity transducer also comprises the heat sensor, photoelectric detector or the ultrasonic transmitter-receiver that are arranged in joystick。
9. the electronic equipment described in claim 3, wherein the second sensor also comprises the sensor array with the multiple sensing elements along at least the first dimension, and described sensor array also generates second position information。
10. the electronic equipment described in claim 9, wherein sensor array has the multiple sensing elements along at least the second dimension to form two-dimensional array。
11. the electronic equipment described in claim 10, wherein sensor array is disposed on the top surface of joystick。
12. the electronic equipment described in claim 9, also include:
Having the calculating platform of graphics engine, described graphics engine is in order in response to indicating the object existence near to or in contact with joystick to detect signal, to generate Drawing Object according to primary importance information。
13. a controller for the figure for controlling display, described controller includes:
Body；
From the joystick that body is prominent；
It is couple to the first sensor of joystick, in order to detect handle in the displacement relative to body of at least the first dimension and the second dimension, and the primary importance information that output is corresponding；
Proximity transducer, in order to, before the outer surface of object contact joystick, to detect the object in the threshold distance of the outer surface of joystick, and to export the existence detection signal of correspondence；And
In order in response to the output from proximity transducer, reference position is mapped to the logic of the mechanical location of joystick。
14. the controller described in claim 13, wherein proximity transducer also comprises and is arranged in joystick or the intrinsic projected capacitive sensor of controller, heat sensor, photoelectric detector or ultrasonic transmitter-receiver。
15. the controller described in claim 13, wherein the logic in order to map reference position also comprises in order in response to the object close to joystick being detected, to initiate the logic of the calibration of reference position。
16. a controller for the Drawing Object for controlling display, described controller includes:
Body；
From the joystick that body is prominent；
It is couple to the first sensor of joystick, in order to detect handle in the displacement relative to body of at least the first dimension and the second dimension, and the primary importance information that output is corresponding；
Touch sensor, in order to detect electric capacity, or puts on the power of the outer surface of joystick, and the existence detection signal that output is corresponding；And
In order in response to the output from touch sensor, reference position is mapped to the logic of the mechanical location of joystick。
17. the controller described in claim 16, wherein touch sensor is disposed in joystick, in order to detect the pressure that the surface to joystick applies, and as response, and the existence detection signal that output is corresponding。
CN201280062818.5A 2011-10-20 2012-10-18 For the input sensitivity strengthened and functional multisensor joystick Active CN104321115B (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US13/278,083 2011-10-20
US13/278,083 US8730166B2 (en) 2011-10-20 2011-10-20 Multi-sensored control stick for enhanced input sensitivity and funtionality
US13/278083 2011-10-20
PCT/US2012/060829 WO2013059472A1 (en) 2011-10-20 2012-10-18 Multi-sensored control stick for enhanced input sensitivity and functionality

Publications (2)

Publication Number Publication Date
CN104321115A CN104321115A (en) 2015-01-28
CN104321115B true CN104321115B (en) 2016-06-22

Family

ID=48135537

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201280062818.5A Active CN104321115B (en) 2011-10-20 2012-10-18 For the input sensitivity strengthened and functional multisensor joystick

Country Status (5)

Country Link
US (1) US8730166B2 (en)
EP (2) EP3241594B1 (en)
JP (1) JP5710846B2 (en)
CN (1) CN104321115B (en)
WO (1) WO2013059472A1 (en)

Families Citing this family (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI447678B (en) * 2011-10-24 2014-08-01 Hon Hai Prec Ind Co Ltd Integrated remote controller
FR3008503B1 (en) * 2013-07-10 2015-08-07 Peugeot Citroen Automobiles Sa HUMAN INTERFACE / MACHINE WITH CONTROL MEANS COUPLED WITH MEANS FOR DETECTING THE PRESENCE OF A USER
WO2015063901A1 (en) * 2013-10-30 2015-05-07 株式会社東芝 Electronic device, operation control method, and program
DE102013222203A1 (en) 2013-10-31 2015-04-30 Lemförder Electronic GmbH Device and method for selecting a mode of operation of a transmission of a vehicle and system for setting a mode of operation of a transmission of a vehicle
KR101488367B1 (en) * 2013-12-17 2015-01-30 현대자동차주식회사 Flap type electronic automatic transmission lever
US9904459B2 (en) * 2015-03-23 2018-02-27 Nvidia Corporation Control device integrating touch and displacement controls
US9868058B2 (en) * 2015-06-30 2018-01-16 Microsoft Technology Licensing, Llc Thumbstick with adjustable tension
US11399766B2 (en) 2015-12-18 2022-08-02 Koninklijke Philips N.V. Fetal monitoring system and method
FR3046472B1 (en) * 2016-01-03 2018-07-20 Bigben Interactive Sa METHOD FOR CONTROLLING A SENSOR CURSOR USING A GAME LEVER AND CORRESPONDING GAME LEVER
US10463954B2 (en) * 2016-03-07 2019-11-05 Microsoft Technology Licensing, Llc Mechanical center calibration of control sticks in user input devices
US10108273B2 (en) * 2016-03-07 2018-10-23 Microsoft Technology Licensing, Llc Movement space mapping for control sticks in user input devices
CN106020477A (en) * 2016-05-23 2016-10-12 苏州芯通微电子有限公司 Linear and nonlinear sensing line apparatus
GB2566869A (en) * 2016-06-14 2019-03-27 Ironburg Invent Ltd Games controller
EP3285148A1 (en) 2016-08-19 2018-02-21 Bigben Interactive SA Method for controlling a display element by a game console
CN106310657A (en) * 2016-09-14 2017-01-11 创客数字科技（深圳）有限公司 Gamepad with pressure sensitive touchpad
WO2018058881A1 (en) * 2016-09-30 2018-04-05 深圳市虚拟现实科技有限公司 Method and system for automatic correction of attitude measurement device
WO2018058882A1 (en) * 2016-09-30 2018-04-05 深圳市虚拟现实科技有限公司 Method and system for automatic correction of attitude measurement device
JP6770103B2 (en) * 2016-10-27 2020-10-14 サーク・コーポレーション Finger tracking on input devices with proximity sensing
US10656281B2 (en) 2016-11-10 2020-05-19 Cable Television Laboratories, Inc. Systems and methods for interference detection in shared spectrum channels
US10367577B2 (en) * 2016-11-10 2019-07-30 Cable Television Laboratories, Inc. Systems and methods for beacon detection infrastructures
US11686852B2 (en) 2016-11-10 2023-06-27 Cable Television Laboratories, Inc. Systems and methods for interference detection in shared spectrum channels
KR102284765B1 (en) * 2016-12-30 2021-08-03 서크 코퍼레이션 Trigger movement detection without mechanical switch
JP6912889B2 (en) * 2017-01-12 2021-08-04 任天堂株式会社 Game system and game controller
US20220062756A1 (en) * 2017-01-25 2022-03-03 Kieran S. Lyden Game Controller
US10515255B2 (en) 2017-03-24 2019-12-24 Qualcomm Incorporated Fingerprint sensor with bioimpedance indicator
US10438040B2 (en) * 2017-03-24 2019-10-08 Qualcomm Incorporated Multi-functional ultrasonic fingerprint sensor
US10552658B2 (en) 2017-03-24 2020-02-04 Qualcomm Incorporated Biometric sensor with finger-force navigation
JP6864532B2 (en) * 2017-04-17 2021-04-28 任天堂株式会社 Input device, information processing device and manufacturing method of input device
CN107168554B (en) * 2017-04-26 2020-07-24 歌尔股份有限公司 Trigger key calibration method, device and equipment
GB2563243B (en) * 2017-06-07 2020-11-18 Sony Interactive Entertainment Inc Input method and apparatus
CN109254543B (en) * 2017-07-13 2021-04-06 深圳市道通智能航空技术有限公司 Remote control device and calibration method of potentiometer rocker thereof
EP3444016A1 (en) * 2017-08-17 2019-02-20 Bigben Interactive SA Method for controlling a display element by a game console
US10556174B2 (en) 2017-10-25 2020-02-11 Microsoft Technology Licensing, Llc Calibration bias for control mechanisms in user input devices
US10434405B2 (en) * 2017-10-30 2019-10-08 Microsoft Technology Licensing, Llc Control stick sensitivity adjustment
US10521030B2 (en) * 2018-01-10 2019-12-31 Microsoft Technology Licensing, Llc Transforming a control stick movement space
US20210293643A1 (en) * 2018-07-05 2021-09-23 The Regents Of The University Of Colorado, A Body Corporate Multi-Modal Fingertip Sensor With Proximity, Contact, And Force Localization Capabilities
DE102018215066A1 (en) * 2018-09-05 2020-03-05 Brendel Holding Gmbh & Co. Kg Control panel for remote control, comprising an activation sensor with a variable effective sensor range
US10635188B2 (en) * 2018-09-17 2020-04-28 Facebook Technologies, Llc Magnetic user input assembly of a controller device
US10888776B2 (en) * 2018-11-27 2021-01-12 Valve Corporation Handheld controllers with detachable overlays
US10635202B1 (en) * 2018-12-18 2020-04-28 Valve Corporation Dynamic sensor assignment
US10905946B2 (en) * 2019-02-28 2021-02-02 Valve Corporation Continuous controller calibration
US11033809B2 (en) * 2019-05-07 2021-06-15 Valve Corporation Using finger presence to activate a motion control feature for a handheld controller
FR3095958A1 (en) * 2019-05-14 2020-11-20 Stmicroelectronics (Rousset) Sas Device, for example video game device, equipped with a contactless transponder
CN112752179B (en) * 2019-10-31 2023-08-15 北京钛方科技有限责任公司 Earphone control method, handle module and earphone
CN111151000B (en) * 2019-12-26 2023-08-29 歌尔股份有限公司 Method, device, equipment and storage medium for adjusting operation lever
US11511186B2 (en) * 2020-02-14 2022-11-29 Valve Corporation Controller with sensor-rich controls
CN111665940B (en) * 2020-06-05 2021-05-11 腾讯科技（深圳）有限公司 Cursor control method and device and related equipment
US11385770B1 (en) 2021-04-21 2022-07-12 Qualcomm Incorporated User interfaces for single-handed mobile device control
CN115300898A (en) * 2021-05-05 2022-11-08 宝德科技股份有限公司 Rocker assembly and game handle
CN116670623A (en) * 2021-06-07 2023-08-29 深圳市大疆创新科技有限公司 Remote controller, rod quantity determining method thereof and cradle head system
CN116414225A (en) * 2021-12-30 2023-07-11 宝德科技股份有限公司 Haptic simulation system
GB2615778B (en) * 2022-02-17 2024-09-11 Sn Systems Ltd Analogue stick calibration
WO2024095731A1 (en) * 2022-10-31 2024-05-10 株式会社ソニー・インタラクティブエンタテインメント Operation device, information processing method, and computer program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1645309A (en) * 2004-11-08 2005-07-27 程天宇 Functional module for controlling cursor move ment in electronic apparatus
CN201111002Y (en) * 2007-11-06 2008-09-03 潘振胜 Game handle mouse
CN101455903A (en) * 2008-12-29 2009-06-17 何江 Game handle for FPS game and positioning method thereof
CN201594225U (en) * 2010-02-03 2010-09-29 姜开淦 Joystick with gesture recognition function

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0676931B2 (en) * 1986-01-13 1994-09-28 工業技術院長 Tactile sensor
JPH0757453B2 (en) 1988-08-23 1995-06-21 松下電工株式会社 Electrical component mounting device
US6720949B1 (en) * 1997-08-22 2004-04-13 Timothy R. Pryor Man machine interfaces and applications
JPH11259228A (en) * 1998-02-13 1999-09-24 Primax Electronics Ltd Computer joy stick having two optical sensors generating vector signals
US6204838B1 (en) * 1998-05-21 2001-03-20 Primax Electronics Ltd. Controlling scrolls of a screen image
US7289107B1 (en) * 1999-03-12 2007-10-30 Varatouch Technology, Inc. Auto-calibration of pointing devices used in a computer user interface
JP2001228968A (en) * 2000-02-14 2001-08-24 Calsonic Kansei Corp Method for calculating neutral point of joystick lever device and joystick lever device using the same
US6948398B2 (en) * 2002-07-22 2005-09-27 Deere & Company Joystick with enabling sensors
US7854655B2 (en) * 2002-07-27 2010-12-21 Sony Computer Entertainment America Inc. Obtaining input for controlling execution of a game program
JP2004326713A (en) * 2003-04-23 2004-11-18 Takashi Soma Force sensing joy stick
US7109994B2 (en) * 2003-05-20 2006-09-19 Electronic Arts, Inc. Sequencing input control stick
US7113811B2 (en) * 2003-06-17 2006-09-26 Agere Systems Inc. System and method for conserving battery power in a mobile station
US20050176504A1 (en) * 2004-02-09 2005-08-11 Stanley Mark J. Method and apparatus for providing computer pointing device input to a video game console
US7927216B2 (en) * 2005-09-15 2011-04-19 Nintendo Co., Ltd. Video game system with wireless modular handheld controller
JP2009026001A (en) * 2007-07-18 2009-02-05 Sharp Corp Operation device and electric apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1645309A (en) * 2004-11-08 2005-07-27 程天宇 Functional module for controlling cursor move ment in electronic apparatus
CN201111002Y (en) * 2007-11-06 2008-09-03 潘振胜 Game handle mouse
CN101455903A (en) * 2008-12-29 2009-06-17 何江 Game handle for FPS game and positioning method thereof
CN201594225U (en) * 2010-02-03 2010-09-29 姜开淦 Joystick with gesture recognition function

Also Published As

Publication number Publication date
EP2768589A1 (en) 2014-08-27
EP2768589B1 (en) 2017-05-31
EP2768589A4 (en) 2016-01-06
JP2014535102A (en) 2014-12-25
US20130100021A1 (en) 2013-04-25
WO2013059472A1 (en) 2013-04-25
EP3241594A1 (en) 2017-11-08
EP3241594B1 (en) 2019-02-27
CN104321115A (en) 2015-01-28
US8730166B2 (en) 2014-05-20
JP5710846B2 (en) 2015-04-30

Similar Documents

Publication Publication Date Title
CN104321115B (en) For the input sensitivity strengthened and functional multisensor joystick
US10960298B2 (en) Boolean/float controller and gesture recognition system
JP5575228B2 (en) Base station movement detection and compensation
JP5204224B2 (en) Object detection using video input combined with tilt angle information
KR101308642B1 (en) Determination of controller three-dimensional location using image analysis and ultrasonic communication
TWI331931B (en) Board game system and robotic device
US20140078312A1 (en) Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera
US20060264260A1 (en) Detectable and trackable hand-held controller
JP4895352B2 (en) Object selection program, object selection device, object selection system, and object selection method
KR20180107782A (en) Virtual Reality Helmets and How to Use them
TWI582676B (en) Displaying an object indicator
CN107037938A (en) Mitigate the interference in capacitance sensing
EP3711828B1 (en) Scheme for detecting and tracking user manipulation of a game controller body and for translating movements thereof into inputs and game commands
US20130040737A1 (en) Input device, system and method
TW201142746A (en) Information processing device, information processing method, and program
CN101264384A (en) Disc type game system and robot device
TWI543023B (en) Identification of an object on a touch-sensitive surface
CN208999971U (en) A kind of smart pen with mouse function

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant