US20230111778A1 - Stylus haptic component - Google Patents
Stylus haptic component Download PDFInfo
- Publication number
- US20230111778A1 US20230111778A1 US17/450,268 US202117450268A US2023111778A1 US 20230111778 A1 US20230111778 A1 US 20230111778A1 US 202117450268 A US202117450268 A US 202117450268A US 2023111778 A1 US2023111778 A1 US 2023111778A1
- Authority
- US
- United States
- Prior art keywords
- stylus
- haptic
- display
- gap
- triggering criteria
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
- A63F13/2145—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/26—Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
- A63F13/28—Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
- A63F13/285—Generating tactile feedback signals via the game input device, e.g. force feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1615—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function
- G06F1/1616—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
- G06F1/1618—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position the display being foldable up to the back of the other housing with a single degree of freedom, e.g. by 360° rotation over the axis defined by the rear edge of the base enclosure
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1643—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being associated to a digitizer, e.g. laptops that can be used as penpads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1647—Details related to the display arrangement, including those related to the mounting of the display in the housing including at least an additional display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/04162—Control or interface arrangements specially adapted for digitisers for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/04166—Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
- G06F3/0441—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means using active external devices, e.g. active pens, for receiving changes in electrical potential transmitted by the digitiser, e.g. tablet driving signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04108—Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
Definitions
- a stylus or pen may be used to provide input to the device.
- Some styli provide haptic output to a user in various use cases.
- a stylus may provide vibratory haptic output when haptic triggering criteria are detected, such as an indication that the stylus is contacting a display of a computing device.
- haptic triggering criteria such as an indication that the stylus is contacting a display of a computing device.
- a method comprises detecting one or more haptic triggering criteria, and at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output.
- a width of the gap between the first display and the second display is determined, and a crossing time for a tip of the stylus to cross the gap is calculated using the width of the gap, a stylus velocity, and a stylus direction.
- the method determines that the one or more haptic triggering criteria are not detected.
- the method continues to actuate the haptic feedback component for the crossing time.
- FIG. 1 shows one example of a stylus and dual-display computing device according to examples of the present disclosure.
- FIG. 2 shows the computing device of FIG. 1 folded about a rotation axis according to examples of the present disclosure.
- FIG. 3 shows the computing device of FIG. 1 folded into a back-to-back orientation according to examples of the present disclosure.
- FIG. 4 shows a schematic diagram of components of the stylus of FIG. 1 according to examples of the present disclosure.
- FIG. 5 shows the stylus drawing a line from the first display across a gap to the second display.
- FIG. 6 is a schematic depiction of the two displays of the computing device with the stylus drawing a line toward the gap in the displays.
- FIG. 7 is a schematic depiction of the two displays with the stylus having crossed the gap in the displays.
- FIGS. 8 A- 8 C show a flowchart illustrating a method for actuating a haptic feedback component in a stylus while the stylus crosses a gap between displays of a computing device according to examples of the present disclosure.
- FIG. 9 schematically depicts an example computing system.
- some styli provide haptic output to a user when one or more haptic triggering criteria are detected. These styli may provide haptic output for a variety of purposes, including but not limited to indicating contact with a display, signaling input to an application (e.g., drawing or writing on a touch-sensitive display screen), and simulating a tactile sensation (e.g., resulting from the traversal of a virtual surface such as gravel, or from touching a virtual object).
- an application e.g., drawing or writing on a touch-sensitive display screen
- simulating a tactile sensation e.g., resulting from the traversal of a virtual surface such as gravel, or from touching a virtual object.
- examples relate to styli, computing devices, and methods for continuously actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device.
- the present disclosure determines a width of the gap between the first display and the second display, and uses the width, a stylus velocity, and a stylus direction to calculate a crossing time for a tip of the stylus to cross the gap.
- the gap width determination comprises an estimated gap width that approximates the actual gap width by making use of one or more factors, as described further below.
- the gap width determination comprises a stored gap width, which may be the actual gap width or may approximate the actual gap width.
- a first time after actuating the haptic feedback component in the stylus it is determined that one or more haptic triggering criteria are not detected. At least on condition of determining that the one or more haptic triggering criteria are not detected, the stylus continues to actuate the haptic feedback component for the crossing time during which the stylus crosses the gap.
- these techniques enable the continuous provision of haptic feedback while the stylus travels from the first screen across the gap to the second screen.
- the computing device may take the form of a laptop computing device, tablet computing device, or any other suitable computing device having two or more displays.
- the mobile computing device 104 includes a housing having a first planar substrate 108 A and a second planar substrate 108 B rotatably coupled by a hinge 112 .
- the first planar substrate 108 A includes a first touch screen display 114 A and the second planar substrate 108 B includes a second touch screen display 114 B.
- the first touch screen display 114 A and the second touch screen display 114 B are rotatable about hinge 112 relative to each other.
- the hinge 112 is configured to permit the first touch screen display 114 A and the second touch screen display 114 B to rotate through 360 degrees between angular orientations from a display-to-display orientation ( FIG. 2 ) to a back-to-back orientation ( FIG. 3 ).
- the first touch screen display 114 A and the second touch screen display 114 B are rotatable through a range of degrees less than 360 degrees.
- FIG. 1 also illustrates one example of a stylus 100 according to examples of the present disclosure.
- Stylus 100 includes an elongated body in the form factor of a pen, though the body may assume any suitable form.
- the stylus 100 is operable to provide user input to computing device 104 . Any suitable type of user input may be provided to computing device 104 using stylus 100 .
- stylus 100 may be used to write or draw graphical content on first touch screen display 114 A and second touch screen display 114 B, modify displayed graphical content (e.g., resize, reposition, rotate), erase graphical content, select graphical user interface (GUI) elements, and/or provide gestural input.
- GUI graphical user interface
- the stylus may include a communication subsystem 124 that can transmit energy and/or data from the stylus to the computing device.
- the communication subsystem 124 may include a radio transmitter for wirelessly transmitting data to computing device 104 along a radio link.
- the communication subsystem 124 alternatively or additionally may include a capacitive transmitter for wirelessly transmitting data to computing device 104 along a capacitive link. The capacitive link may be established between the capacitive transmitter and first touch screen display 114 A or second touch screen display 114 B, where each display includes capacitive touch sensors, for example.
- Any suitable data may be transmitted to computing device 104 via the communication subsystem 124 , including but not limited to indications of pressure sensed at the stylus tip 106 , actuation of an input component on the stylus 100 (e.g., depression of one or more buttons), data regarding the position of the stylus relative to the computing device (e.g., one or more coordinates), a power state or battery level of the stylus, and data from one or more motion sensors on-board the stylus (e.g., accelerometer and/or gyroscope data).
- indications of pressure sensed at the stylus tip 106 e.g., depression of one or more buttons
- data regarding the position of the stylus relative to the computing device e.g., one or more coordinates
- a power state or battery level of the stylus e.g., accelerometer and/or gyroscope data
- any suitable mechanism may be used to transmit information from stylus 100 to computing device 104 . Additional examples include optical, resistive, and wired mechanisms.
- styli according to the present disclosure do not include a communication subsystem for transmitting energy and/or data from the stylus to a computing device.
- a stylus in addition to or instead of transmitting data to the computing device, is configured to receive energy and/or data from computing device 104 .
- stylus 100 includes a sensor subsystem 117 that comprises an electrostatic voltage sensor 115 configured to receive electrostatic energy signals from the first touch screen display 114 A and second touch screen display 114 B over an electrostatic channel, such as a frequency changing channel.
- these signals are provided by capacitively-coupled currents from electrodes of the first touch screen display 114 A and second touch screen display 114 B. These signals are amplified and converted to digital signals for use by a processor 116 of the stylus 100 .
- sensor subsystem 117 can include one or more other sensing components and functionalities, such as accelerometer(s), gyroscope(s), inertial measurement unit(s), and force (pressure) sensor(s).
- sensor subsystem 117 includes an accelerometer 122 and a pressure sensor 126 at the tip 106 of stylus 100 , such as a piezoelectric crystal that provides an output voltage in response to the pressure imposed upon it.
- Example hardware including processor 116 , memory 120 and communication subsystem 124 , that may be incorporated by stylus 100 to implement the disclosed approaches, is described further below with reference to FIG. 9 .
- the processor 116 includes a haptic circuit 130 configured to execute a haptic driver 132 that controls activation of the haptic feedback component 134 .
- Stylus 100 further includes one or more batteries 127 configured to provide power to processor to the various components of the stylus.
- stylus 100 is configured to provide haptic feedback to users.
- stylus 100 includes a haptic feedback component 134 configured to apply haptic output to the body of the stylus.
- one or more haptic feedback components may be provided at any suitable location within stylus 100 .
- Haptic feedback component 134 may employ any suitable component(s) to provide haptic feedback as described herein.
- haptic feedback component 134 may include a motor 136 that applies haptic output to the stylus body in the form of vibration induced in the body.
- multiple haptic feedback components are provided at different locations within a stylus.
- the stylus 100 actuates the haptic feedback component 134 to provide haptic output upon detecting one or more haptic triggering criteria.
- the haptic feedback component 134 is actuated when the stylus 100 or computing device 104 determines that the stylus is contacting a surface, such as the first touch screen display 114 A or the second touch screen display 114 B.
- a haptic triggering criterion may comprise a pressure signal generated by the pressure sensor 126 in the stylus 100 , or an electrostatic signal generated by the first touch screen display 114 A or the second touch screen display 114 B, or by the stylus 100 .
- the haptic triggering criteria may comprise a hover indication that indicates the stylus tip 106 is located within a predetermined hovering distance of the first touch screen display 114 A or the second touch screen display 114 B.
- the predetermined hovering distance may be 1 cm, 2 cm, or other suitable distance.
- the haptic feedback component 134 is actuated to produce haptic output.
- a single haptic triggering criterion such as detection of a pressure signal, triggers actuation of the haptic feedback component 134 .
- two or more haptic triggering criteria are required to trigger the haptic feedback component, such as both a pressure signal and an electrostatic signal received by the computing device 104 from the stylus 100 .
- the one or more haptic triggering criteria comprise electrostatic indications generated by the computing device 104 that indicates the stylus 100 is moving relative to the computing device.
- a user may operate the stylus 100 to provide a continuous user input that spans across the first touch screen display 114 A and the second touch screen display 114 B.
- the user presses the stylus tip against the first touch screen display 114 A, draws a straight line over the gap 140 between the first inside edge 121 of the first touch screen display 114 A and the second inside edge 123 of the second touch screen display 114 B, and continues drawing on the second touch screen display.
- the stylus 100 requires detection of a haptic triggering criteria in the form of a pressure signal from the stylus tip 106 indicating contact with a surface.
- a haptic triggering criteria in the form of a pressure signal from the stylus tip 106 indicating contact with a surface.
- the haptic feedback component 134 is actuated to begin vibrating the stylus. This haptic feedback continues as the stylus tip 106 travels across the surface of the first display 114 A.
- the pressure signal from the stylus tip 106 is lost as the stylus traverses the gap.
- the stylus crosses the second inside edge 123 of the second display 114 B and contacts the surface of this display, the pressure signal is detected again, and the stylus tip 106 travels across the surface of the second display.
- haptic feedback when the user continuously moves the stylus from one display across the gap to the other display.
- the stylus tip is in the gap between displays and the one or more haptic triggering criteria (such as pressure) are not detected, in some examples the haptic feedback will be interrupted and then resumed again when the stylus contacts the second display. This can create a disruptive and less than desirable user experience, with the user feeling the interruption in the haptic feedback between the two displays.
- the user in other cases where the user moves the stylus along one display and then lifts the stylus off the display, the user expects haptic feedback to cease, and it is desirable to stop providing haptic feedback in these situations.
- examples of the present disclosure determine a width of the gap between the first display and the second display, and utilize this width along with a stylus velocity and a stylus direction to calculate a crossing time for a tip of the stylus to cross the gap.
- the calculated crossing time comprises an estimated time that is based at least in part on the estimated gap width, a stylus velocity, and a stylus direction.
- the user moves the stylus 100 at a velocity of 10 mm/sec along the first touch sensitive display 114 A from left to right toward the gap 140 .
- the velocity of the stylus 100 is determined by the computing device and is transmitted from the computing device 104 to the stylus 100 via electrostatic signals, radio signals (such as Bluetooth), or any other suitable transmission medium.
- the computing device may utilize x, y coordinates of the changing location of the stylus tip 106 to calculate the velocity.
- coordinates and/or other data (such as electrostatic signals) may be transmitted from the computing device to the stylus 100 , and the stylus may calculate its velocity relative to the first display 114 A.
- the stylus 100 utilizes one or more sensors onboard the stylus (e.g., accelerometer(s), gyroscope(s), inertial measurement units) to determine its velocity relative to the first display 114 A.
- a width 142 of the gap 140 between the first display 114 A and the second display 114 B is utilized to calculate a crossing time for the tip of the stylus to cross the gap.
- determining the width of the gap comprises retrieving a width 142 stored in a memory of the stylus 100 or the computing device 104 .
- the width 142 of gap 140 is stored in the memory of a computing device at manufacturing or at a later time.
- the computing device 104 and/or stylus 100 utilizes the width 142 of the gap 140 to calculate a crossing time for a tip of the stylus to cross the gap.
- the width 142 is dynamically determined (e.g., estimated) by the computing device by examining use of the stylus with the device. For example, the computing device 100 may determine locations of the tip 106 of the stylus 100 relative to the first display 114 A, the gap 140 , and the second display 114 B during use and over time. By tracking and using these locations of the tip 106 in combination with instances of not detecting the one or more haptic triggering criteria, the computing device dynamically determines the width 142 of the gap between the two displays. As noted above, in these examples the gap width determination comprises an estimated gap width that approximates the actual gap width and may not exactly match the actual gap width.
- determining the width of the gap may comprise transmitting the width of the gap from the computing device 104 to the stylus 100 . Additionally, and in one potential advantage of the present disclosure, by examining actual use of the stylus to dynamically determine the gap width as described above, this configuration can provide continuous, uninterrupted haptic feedback to the user while the stylus crosses the gap without requiring or utilizing predetermined gap values stored in memory of the stylus or computing device.
- the direction of movement of the stylus is also used to calculate a crossing time for the tip of the stylus to cross the gap.
- the stylus direction of movement is a default direction 135 retrieved from a memory of the stylus 100 or the computing device 104 .
- cartesian coordinates of the changing location of the stylus tip 106 are calculated by the computing device 104 and utilized to generate a direction vector 150 corresponding to the movement of the tip.
- the direction vector may be transmitted to the stylus 100 and utilized to calculate the crossing time as described further below.
- raw x, y position data of the tip 106 may be transmitted to the stylus 100 .
- the stylus may determine the direction of travel of the tip 106 and utilize this direction to determine the crossing time.
- the direction of travel may be used to determine an angle with respect to the first inside edge 121 and/or second inside edge 123 .
- a default direction 135 comprises a default angle that is stored in a memory of the stylus 100 and/or computing device 104 , and utilized as described below. Additionally, and in one potential advantage of this configuration, in some examples utilizing a default direction can reduce communications between the stylus 100 and computing device 104 and/or reduce computational resources otherwise required to determine the direction of travel.
- the stylus tip 106 moves at a velocity of 10 mm/sec along the first touch sensitive display 114 A from left to right toward the gap 140 in the direction of vector 150 , which is orthogonal to the first inside edge 121 of the first touch screen display 114 A and the second inside edge 123 of the second touch screen display 114 B.
- the width 142 of gap 140 is 5 mm.
- the width 142 may be determined by retrieving a value from a memory of the stylus 100 or computing device, or by dynamically determining the width as described herein.
- the stylus 100 also comprises a crossing time calculator 148 stored in memory 120 .
- the stylus 100 or computing device 104 determines that the tip will enter and cross the gap 140 at a 90-degree angle with respect to the first inside edge 121 and second inside edge 123 . Given this 90-degree angle and the determined gap width of 5.0 mm, it is then determined that the tip 106 will travel 5.0 mm. between the first inside edge 121 and the second inside edge 123 . Alternatively expressed, the tip 106 will travel 5.0 mm as it crosses the gap 140 .
- the stylus tip direction will not be orthogonal to the first inside edge 121 or second inside edge 123 .
- the angle of entry into the gap 140 will result in a travel distance of the tip across the gap 140 that is greater than the gap width 142 , and a correspondingly longer crossing time.
- the stylus 100 or computing device 104 determines, at a first time, that one or more haptic triggering criteria are not detected.
- the haptic triggering criteria comprises a pressure signal from the stylus tip 106 .
- the stylus 100 and/or computing device 104 may measure or sample the pressure signal at a given sampling rate, such as 1 sample every 4 milliseconds or any other suitable sampling rate.
- the stylus 100 coverts the crossing time into the number of pressure signals that will be lost (not received) while the stylus 100 is crossing the gap 140 .
- the crossing time calculator 148 determines that 125 pressure signal samples will be lost (not received) while the stylus tip 106 crosses the gap 140 .
- the stylus 100 advantageously continues to actuate the haptic feedback component for the determined crossing time, which in this example is 0.5 seconds.
- the stylus 100 provides continuous, uninterrupted haptic feedback to the user during the entire user input sequence of drawing a line across the first touch screen display 114 A, over the gap 140 between the first touch screen display and second touch screen display 114 B, and continuing across the second touch screen display.
- the stylus 100 or computing device 104 determines that 125 pressure signal samples will be lost (not received) while the stylus tip 106 crosses the gap 140 . Accordingly and in some examples, when the stylus tip 106 initially crosses the first inside edge 121 and the first pressure signal sample is not detected, the stylus 100 or computing device 104 may begin counting the number of pressure signal samples not received, and continue to actuate the haptic feedback component for a duration that corresponds to 125 pressure signal samples (0.5 seconds).
- the configurations of the present disclosure enable the stylus 100 to provide uninterrupted haptic feedback while the stylus crosses the gap 140 between displays, even though the one or more haptic triggering criteria are not detected.
- the stylus 100 or computing device 104 detects the pressure signal from the stylus tip contacting the second touch screen display.
- the stylus continues to actuate the haptic feedback component and provide haptic output as the stylus tip 106 continues along the surface of the second touch screen display.
- this configuration provides continuous haptic output to the user when the stylus is in an appropriate location for such output (e.g., exiting the gap and contacting the second touch screen display 114 B).
- the user after entering the gap 140 the user does not continue moving the stylus tip 106 to the second inside edge 123 .
- the user may pause the stylus tip 106 within the gap 140 or may lift the stylus 100 away from the computing device 104 .
- the stylus 100 or computing device 104 determines that the pressure signal is not detected.
- the stylus ceases actuating the haptic feedback component at the expiration of the crossing time. Accordingly, and in one potential advantage of this configuration, the user is not provided with haptic feedback in situations where such feedback is not appropriate or expected by the user.
- the user may lift the stylus 100 away from the computing device 104 .
- the stylus 100 on condition of determining that a lift distance of the tip above the first display or the second display exceeds a threshold lift distance, the stylus 100 ceases to actuate the haptic feedback component.
- the stylus or computing device determines that the tip 106 of the stylus 100 is located beyond the threshold lift distance, such as 1 cm., 2 cm. or other suitable distance, from the first touch screen display 114 A or second touch screen display 114 B.
- an electrostatic signal transmitted from the stylus 100 and received at the computing device is utilized to determine that the tip 106 of the stylus 100 is located beyond the threshold lift distance.
- the haptic feedback component may continue to actuate when the estimated lift distance is less than the threshold lift distance.
- environmental noise such as electrostatic interference
- electrostatic signals are transmitted between the stylus 100 and computing device 104 , or vice versa. These signals may be utilized for a variety of purposes, such as determining whether one or more haptic triggering criteria are detected, and transmitting stylus velocity values from the computing device 104 to the stylus 100 , or vice versa.
- electrostatic noise can disrupt the corresponding calculations.
- the computing device 104 or stylus 100 compares a detected environmental noise level to a noise threshold. When the detected noise level exceeds the noise threshold, the duration of the calculated crossing time is adjusted accordingly. For example, in some use cases when the detected noise exceeds the noise threshold, the duration of the calculated crossing time may be increased to account for an expected greater number of lost or degraded electrostatic signals.
- one or more additional parameters may be utilized in calculating a crossing time for a tip 106 of the stylus 100 to cross the gap 140 .
- the two displays may transmit electrostatic signals to the stylus 100 at different frequencies.
- the first display 114 A may transmit a first electrostatic signal at a first frequency
- the second display 114 B may transmit a second electrostatic signal at a second, different frequency.
- the stylus 100 may determine a location of the tip 106 relative to the gap 140 between the first display and the second display.
- the signal strength of the two electrostatic signals is analyzed to determine the location of the tip 106 as it crosses the first inside edge 121 , travels across the gap 140 , and crosses the second inside edge 123 .
- these different electrostatic signals may be utilized in combination with one or more of the stylus velocity, direction, and gap width 142 to calculate the crossing time for the tip 106 to cross the gap, and to correspondingly continue actuating the haptic feedback component for the crossing time.
- using different frequencies for different displays as described above may improve the accuracy of determining at which display (and which side of the gap 140 ) the stylus 100 is located when it nears the gap, thereby correspondingly enabling a haptic feedback user experience that more closely matches user expectations.
- the two displays may transmit electrostatic signals to the stylus 100 at the same frequencies but during different time windows.
- the first display 114 A may transmit a first electrostatic signal during a first set of time windows from the first display
- the second display 114 B may transmit a second electrostatic signal during an alternating second set of different time windows.
- the first display 114 A may transmit a first electrostatic signal in a time window between 1.0-2.0 ms.
- the second display 114 B may transmit a second electrostatic signal in a time window between 2.0-3.0 ms, and so forth.
- the stylus 100 can determine which display transmitted the signal. Using these signals received at different times, the stylus 100 may then determine a location of the tip 106 relative to the gap 140 between the first display and the second display. In some examples, the signal strength of the electrostatic signals is analyzed to determine the location of the tip 106 as it crosses the first inside edge 121 , travels across the gap 140 , and crosses the second inside edge 123 . In some examples, these electrostatic signals may be utilized in combination with one or more of the stylus velocity, direction, and gap width 142 to calculate the crossing time for the tip 106 to cross the gap and to correspondingly continue actuating the haptic feedback component for the crossing time.
- using different time windows for detecting signals from the two different displays as described above may improve the accuracy of determining at which display (and which side of the gap 140 ) the stylus 100 is located when it nears the gap, thereby correspondingly enabling a haptic feedback user experience that more closely matches user expectations.
- method 200 for actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device will now be described.
- method 200 may be implemented and performed at a stylus, such as stylus 100 .
- one or more steps of method 200 may be implemented and performed at a computing device, such as computing device 104 .
- method 200 may include additional and/or alternative steps relative to those illustrated in FIGS. 8 A- 8 C . Further, it is to be understood that the steps of method 200 may be performed in any suitable order. Further still, it is to be understood that one or more steps may be omitted from method 200 without departing from the scope of this disclosure. It will also be appreciated that method 200 also may be performed in other contexts using other suitable components
- the method 200 includes detecting one or more haptic triggering criteria.
- the method 200 includes, wherein the haptic triggering criteria comprise one or more criterion selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication.
- the method 200 includes, at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output.
- the method 200 includes determining a width of the gap between the first display and the second display.
- the method 200 may include retrieving a stored width from a memory of the stylus or the computing device.
- the method 200 may include transmitting the width of the gap from the computing device to the stylus.
- the method 200 may include determining locations of the tip of the stylus during use.
- the method 200 may include determining the width of the gap using at least the locations of the tip during use and instances of not detecting the one or more haptic triggering criteria.
- the method 200 includes, using the width of the gap, a stylus velocity, and a stylus direction, calculating a crossing time for a tip of the stylus to cross the gap.
- the method 200 may include, wherein the stylus direction is a default direction retrieved from a memory of the stylus or the computing device.
- the method 200 includes, at a first time after actuating the haptic feedback component, determining that the one or more haptic triggering criteria are not detected.
- the method 200 includes, at least on condition of determining that the one or more haptic triggering criteria are not detected, continuing to actuate the haptic feedback component for the crossing time.
- the method 200 may include, at the expiration of the crossing time, detecting the one or more haptic triggering criteria.
- the method 200 may include, on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continuing to actuate the haptic feedback component.
- the method 200 may include, at the expiration of the crossing time, determining that the one or more haptic triggering criteria are not detected.
- the method 200 may include, on condition of determining that the one or more haptic triggering criteria are not detected, ceasing to actuate the haptic feedback component at the expiration of the crossing time.
- the method 200 may include, while the tip of the stylus is crossing the gap, on condition of determining that a lift distance of the tip above the first display or the second display exceeds a threshold lift distance, ceasing to actuate the haptic feedback component.
- the method 200 may include, wherein calculating a crossing time further comprises: comparing a detected noise level to a noise threshold.
- the method 200 may include, on condition that the detected noise level exceeds the noise threshold, adjusting the duration of the crossing time.
- the method 200 may include transmitting a first electrostatic signal at a first frequency from the first display.
- the method 200 may include transmitting a second electrostatic signal at a second frequency from the second display.
- the method 200 may include using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display.
- the method 200 may include transmitting a first electrostatic signal during a first set of time windows from the first display.
- the method 200 may include transmitting a second electrostatic signal during a second set of time windows from the second display.
- the method 200 may include using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display.
- the methods and processes described herein may be tied to a computing system of one or more computing devices.
- such methods and processes may be implemented as a computer-application program or service, an application-programming interface (API), a library, and/or other computer-program product.
- API application-programming interface
- FIG. 9 schematically shows a non-limiting embodiment of a computing system 300 that can enact one or more of the methods and processes described above.
- Computing system 300 is shown in simplified form.
- One or more aspects of computing system 300 may be utilized in stylus 100 and in the computing device 104 described herein.
- Computing system 300 may take the form of one or more input devices, personal computers, server computers, tablet computers, home-entertainment computers, network computing devices, gaming devices, mobile computing devices, mobile communication devices (e.g., smart phone), and/or other computing devices, and wearable computing devices such as smart wristwatches and head mounted augmented reality devices.
- Computing system 300 includes a logic processor 302 , volatile memory 304 , and a non-volatile storage device 306 .
- Computing system 300 may optionally include a display subsystem 308 , input subsystem 310 , communication subsystem 312 , and/or other components not shown in FIG. 9 .
- Logic processor 302 includes one or more physical devices configured to execute instructions.
- the logic processor may be configured to execute instructions that are part of one or more applications, programs, routines, libraries, objects, components, data structures, or other logical constructs. Such instructions may be implemented to perform a task, implement a data type, transform the state of one or more components, achieve a technical effect, or otherwise arrive at a desired result.
- the logic processor may include one or more physical processors (hardware) configured to execute software instructions. Additionally or alternatively, the logic processor may include one or more hardware logic circuits or firmware devices configured to execute hardware-implemented logic or firmware instructions. Processors of the logic processor 302 may be single-core or multi-core, and the instructions executed thereon may be configured for sequential, parallel, and/or distributed processing. Individual components of the logic processor optionally may be distributed among two or more separate devices, which may be remotely located and/or configured for coordinated processing. Aspects of the logic processor may be virtualized and executed by remotely accessible, networked computing devices configured in a cloud-computing configuration. In such a case, these virtualized aspects are run on different physical logic processors of various different machines, it will be understood.
- Non-volatile storage device 306 includes one or more physical devices configured to hold instructions executable by the logic processors to implement the methods and processes described herein. When such methods and processes are implemented, the state of non-volatile storage device 306 may be transformed—e.g., to hold different data.
- Non-volatile storage device 306 may include physical devices that are removable and/or built-in.
- Non-volatile storage device 306 may include optical memory (e.g., CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memory (e.g., ROM, EPROM, EEPROM, FLASH memory, etc.), and/or magnetic memory (e.g., hard-disk drive, floppy-disk drive, tape drive, MRAM, etc.), or other mass storage device technology.
- Non-volatile storage device 306 may include nonvolatile, dynamic, static, read/write, read-only, sequential-access, location-addressable, file-addressable, and/or content-addressable devices. It will be appreciated that non-volatile storage device 306 is configured to hold instructions even when power is cut to the non-volatile storage device 306 .
- Volatile memory 304 may include physical devices that include random access memory. Volatile memory 304 is typically utilized by logic processor 302 to temporarily store information during processing of software instructions. It will be appreciated that volatile memory 304 typically does not continue to store instructions when power is cut to the volatile memory 304 .
- logic processor 302 volatile memory 304 , and non-volatile storage device 306 may be integrated together into one or more hardware-logic components.
- hardware-logic components may include field-programmable gate arrays (FPGAs), program- and application-specific integrated circuits (PASIC/ASICs), program- and application-specific standard products (PSSP/ASSPs), system-on-a-chip (SOC), and complex programmable logic devices (CPLDs), for example.
- FPGAs field-programmable gate arrays
- PASIC/ASICs program- and application-specific integrated circuits
- PSSP/ASSPs program- and application-specific standard products
- SOC system-on-a-chip
- CPLDs complex programmable logic devices
- module may be used to describe an aspect of computing system 300 typically implemented in software by a processor to perform a particular function using portions of volatile memory, which function involves transformative processing that specially configures the processor to perform the function.
- a module, program, or engine may be instantiated via logic processor 302 executing instructions held by non-volatile storage device 306 , using portions of volatile memory 304 .
- modules, programs, and/or engines may be instantiated from the same application, service, code block, object, library, routine, API, function, etc.
- the same module, program, and/or engine may be instantiated by different applications, services, code blocks, objects, routines, APIs, functions, etc.
- the terms “module,” “program,” and “engine” may encompass individual or groups of executable files, data files, libraries, drivers, scripts, database records, etc.
- display subsystem 308 may be used to present a visual representation of data held by non-volatile storage device 306 .
- the visual representation may take the form of a graphical user interface (GUI).
- GUI graphical user interface
- the state of display subsystem 308 may likewise be transformed to visually represent changes in the underlying data.
- Display subsystem 308 may include one or more display devices utilizing virtually any type of technology. Such display devices may be combined with logic processor 302 , volatile memory 304 , and/or non-volatile storage device 306 in a shared enclosure, or such display devices may be peripheral display devices.
- input subsystem 310 may comprise or interface with one or more user-input devices such as a stylus, keyboard, mouse, touch screen, or game controller.
- the input subsystem may comprise or interface with selected natural user input (NUI) componentry.
- NUI natural user input
- Such componentry may be integrated or peripheral, and the transduction and/or processing of input actions may be handled on- or off-board.
- Example NUI componentry may include a microphone for speech and/or voice recognition; an infrared, color, stereoscopic, and/or depth camera for machine vision and/or gesture recognition; a head tracker, eye tracker, accelerometer, and/or gyroscope for motion detection and/or intent recognition; as well as electric-field sensing componentry for assessing brain activity; and/or any other suitable sensor.
- communication subsystem 312 may be configured to communicatively couple various computing devices described herein with each other, and with other devices.
- Communication subsystem 312 may include wired and/or wireless communication devices compatible with one or more different communication protocols.
- the communication subsystem may be configured for communication via a wireless telephone network, or a wired or wireless personal-, local-, or wide-area network, such as Bluetooth or an HDMI over Wi-Fi connection.
- the communication subsystem may allow computing system 300 to send and/or receive messages to and/or from other devices via a network such as the Internet.
- One aspect provides a method for actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device, the method comprising: detecting one or more haptic triggering criteria; at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output; determining a width of the gap between the first display and the second display; using the width of the gap, a stylus velocity, and a stylus direction, calculating a crossing time for a tip of the stylus to cross the gap; at a first time after actuating the haptic feedback component, determining that the one or more haptic triggering criteria are not detected; and at least on condition of determining that the one or more haptic triggering criteria are not detected, continuing to actuate the haptic feedback component for the crossing time.
- the method may additionally or alternatively include, at the expiration of the crossing time, detecting the one or more haptic triggering criteria; and on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continuing to actuate the haptic feedback component.
- the method may additionally or alternatively include, at the expiration of the crossing time, determining that the one or more haptic triggering criteria are not detected; and on condition of determining that the one or more haptic triggering criteria are not detected, ceasing to actuate the haptic feedback component at the expiration of the crossing time.
- the method may additionally or alternatively include, wherein determining the width of the gap comprises retrieving a stored width from a memory of the stylus or the computing device.
- the method may additionally or alternatively include, wherein determining the width of the gap comprises transmitting the width of the gap from the computing device to the stylus.
- the method may additionally or alternatively include, wherein determining the width of the gap comprises: determining locations of the tip of the stylus during use; and determining the width of the gap using at least the locations of the tip during use and instances of not detecting the one or more haptic triggering criteria.
- the method may additionally or alternatively include, wherein the stylus direction is a default direction retrieved from a memory of the stylus or the computing device.
- the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication.
- the method may additionally or alternatively include, while the tip of the stylus is crossing the gap, on condition of determining that a lift distance of the tip above the first display or the second display exceeds a threshold lift distance, ceasing to actuate the haptic feedback component.
- the method may additionally or alternatively include, wherein calculating a crossing time further comprises: comparing a detected noise level to a noise threshold; and on condition that the detected noise level exceeds the noise threshold, adjusting the duration of the crossing time.
- the method may additionally or alternatively include, transmitting a first electrostatic signal at a first frequency from the first display; transmitting a second electrostatic signal at a second frequency from the second display; and using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display.
- the method may additionally or alternatively include, transmitting a first electrostatic signal during a first set of time windows from the first display; transmitting a second electrostatic signal during a second set of time windows from the second display; and using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display.
- a stylus for use with a computing device comprising a first display and a second display that are separated by a gap, the stylus comprising: a haptic feedback component within the stylus; a logic processor; and a memory storing instructions executable by the processor to actuate the haptic feedback component while the stylus crosses the gap between the first display and the second display, the instructions executable to: detect one or more haptic triggering criteria; at least on condition of detecting the one or more haptic triggering criteria, actuate the haptic feedback component to produce haptic output; determine a width of the gap between the first display and the second display; using the width of the gap, a stylus velocity, and a stylus direction, calculate a crossing time for a tip of the stylus to cross the gap; at a first time after actuating the haptic feedback component, determine that the one or more haptic triggering criteria are not detected; at least on condition of determining that the one or more haptic triggering criteria are not detected, continue to
- the stylus may additionally or alternatively include, wherein the instructions are executable to, at the expiration of the crossing time: detect the one or more haptic triggering criteria; and on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continue to actuate the haptic feedback component.
- the stylus may additionally or alternatively include, wherein the instructions are executable to determine the width of the gap by retrieving a stored width from a memory of the stylus or the computing device.
- the stylus may additionally or alternatively include, wherein the instructions are executable to determine the width of the gap by receiving the width from the computing device.
- the stylus may additionally or alternatively include, wherein the instructions are executable to: determine locations of the tip of the stylus during use; and determine the width of the gap using at least the locations of the tip during use and instances of not detecting the one or more haptic triggering criteria.
- the stylus may additionally or alternatively include, wherein the stylus direction is a default direction, and the instructions are executable to retrieve the default direction from a memory of the stylus or the computing device.
- the stylus may additionally or alternatively include, wherein the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication.
- Another aspect provides a method for actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device, the method comprising: detecting one or more haptic triggering criteria, wherein the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication; at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output; determining a width of the gap between the first display and the second display; using the width of the gap, a stylus velocity, and a stylus direction, calculating a crossing time for a tip of the stylus to cross the gap; at a first time after actuating the haptic feedback component, determining that the one or more haptic triggering criteria are not detected; at least on condition of determining that the one or more haptic triggering criteria are not detected, continuing to actuate the
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Hardware Design (AREA)
- Mathematical Physics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Examples are disclosed relating to providing haptic feedback in a stylus while the stylus crosses a gap between two displays. In one example, a method comprises detecting one or more haptic triggering criteria, and at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output. A width of the gap between the displays is determined, and a crossing time for a tip of the stylus to cross the gap is calculated using the width of the gap, a stylus velocity, and a stylus direction. At a first time after actuating the haptic feedback component, the method determines that the one or more haptic triggering criteria are not detected. At least on condition of determining that the one or more haptic triggering criteria are not detected, the method continues to actuate the haptic feedback component for the crossing time.
Description
- With many computing devices, a stylus or pen may be used to provide input to the device. Some styli provide haptic output to a user in various use cases. As one example, a stylus may provide vibratory haptic output when haptic triggering criteria are detected, such as an indication that the stylus is contacting a display of a computing device. When the stylus is used with devices that include two displays separated by a gap, avoiding interruptions in haptic output when crossing the gap can prove challenging.
- Examples are disclosed that relate to actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device. In one example, a method comprises detecting one or more haptic triggering criteria, and at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output. A width of the gap between the first display and the second display is determined, and a crossing time for a tip of the stylus to cross the gap is calculated using the width of the gap, a stylus velocity, and a stylus direction. At a first time after actuating the haptic feedback component, the method determines that the one or more haptic triggering criteria are not detected. At least on condition of determining that the one or more haptic triggering criteria are not detected, the method continues to actuate the haptic feedback component for the crossing time.
- This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
-
FIG. 1 shows one example of a stylus and dual-display computing device according to examples of the present disclosure. -
FIG. 2 shows the computing device ofFIG. 1 folded about a rotation axis according to examples of the present disclosure. -
FIG. 3 shows the computing device ofFIG. 1 folded into a back-to-back orientation according to examples of the present disclosure. -
FIG. 4 shows a schematic diagram of components of the stylus ofFIG. 1 according to examples of the present disclosure. -
FIG. 5 shows the stylus drawing a line from the first display across a gap to the second display. -
FIG. 6 is a schematic depiction of the two displays of the computing device with the stylus drawing a line toward the gap in the displays. -
FIG. 7 is a schematic depiction of the two displays with the stylus having crossed the gap in the displays. -
FIGS. 8A-8C show a flowchart illustrating a method for actuating a haptic feedback component in a stylus while the stylus crosses a gap between displays of a computing device according to examples of the present disclosure. -
FIG. 9 schematically depicts an example computing system. - As noted above, some styli provide haptic output to a user when one or more haptic triggering criteria are detected. These styli may provide haptic output for a variety of purposes, including but not limited to indicating contact with a display, signaling input to an application (e.g., drawing or writing on a touch-sensitive display screen), and simulating a tactile sensation (e.g., resulting from the traversal of a virtual surface such as gravel, or from touching a virtual object). When the stylus is used with devices that include two displays separated by a gap, in some use cases it is desirable to provide continuous haptic output as the stylus moves from one display across the gap to the other display. However, avoiding interruptions in haptic output when crossing the gap can prove challenging.
- Accordingly, examples are disclosed that relate to styli, computing devices, and methods for continuously actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device. As described in more detail below, in different examples the present disclosure determines a width of the gap between the first display and the second display, and uses the width, a stylus velocity, and a stylus direction to calculate a crossing time for a tip of the stylus to cross the gap. In some examples, the gap width determination comprises an estimated gap width that approximates the actual gap width by making use of one or more factors, as described further below. In some examples, the gap width determination comprises a stored gap width, which may be the actual gap width or may approximate the actual gap width. At a first time after actuating the haptic feedback component in the stylus, it is determined that one or more haptic triggering criteria are not detected. At least on condition of determining that the one or more haptic triggering criteria are not detected, the stylus continues to actuate the haptic feedback component for the crossing time during which the stylus crosses the gap. Advantageously, these techniques enable the continuous provision of haptic feedback while the stylus travels from the first screen across the gap to the second screen.
- With reference now to
FIGS. 1-3 , one example of a computing device is illustrated in the form of a dual screenmobile computing device 104. In other examples, the computing device may take the form of a laptop computing device, tablet computing device, or any other suitable computing device having two or more displays. In the example ofFIGS. 1-3 , themobile computing device 104 includes a housing having a firstplanar substrate 108A and a secondplanar substrate 108B rotatably coupled by ahinge 112. Thefirst planar substrate 108A includes a firsttouch screen display 114A and the secondplanar substrate 108B includes a secondtouch screen display 114B. - In the example of
FIGS. 1-3 , the firsttouch screen display 114A and the secondtouch screen display 114B are rotatable abouthinge 112 relative to each other. Thehinge 112 is configured to permit the firsttouch screen display 114A and the secondtouch screen display 114B to rotate through 360 degrees between angular orientations from a display-to-display orientation (FIG. 2 ) to a back-to-back orientation (FIG. 3 ). In other examples, the firsttouch screen display 114A and the secondtouch screen display 114B are rotatable through a range of degrees less than 360 degrees. -
FIG. 1 also illustrates one example of astylus 100 according to examples of the present disclosure.Stylus 100 includes an elongated body in the form factor of a pen, though the body may assume any suitable form. Thestylus 100 is operable to provide user input to computingdevice 104. Any suitable type of user input may be provided to computingdevice 104 usingstylus 100. As examples,stylus 100 may be used to write or draw graphical content on firsttouch screen display 114A and secondtouch screen display 114B, modify displayed graphical content (e.g., resize, reposition, rotate), erase graphical content, select graphical user interface (GUI) elements, and/or provide gestural input. - With reference now to
FIG. 4 , in some examples and to enable the provision of user input fromstylus 100 to computingdevice 104, the stylus may include acommunication subsystem 124 that can transmit energy and/or data from the stylus to the computing device. For example, thecommunication subsystem 124 may include a radio transmitter for wirelessly transmitting data to computingdevice 104 along a radio link. As another example, thecommunication subsystem 124 alternatively or additionally may include a capacitive transmitter for wirelessly transmitting data to computingdevice 104 along a capacitive link. The capacitive link may be established between the capacitive transmitter and firsttouch screen display 114A or secondtouch screen display 114B, where each display includes capacitive touch sensors, for example. - Any suitable data may be transmitted to computing
device 104 via thecommunication subsystem 124, including but not limited to indications of pressure sensed at thestylus tip 106, actuation of an input component on the stylus 100 (e.g., depression of one or more buttons), data regarding the position of the stylus relative to the computing device (e.g., one or more coordinates), a power state or battery level of the stylus, and data from one or more motion sensors on-board the stylus (e.g., accelerometer and/or gyroscope data). - It will be understood that any suitable mechanism may be used to transmit information from
stylus 100 to computingdevice 104. Additional examples include optical, resistive, and wired mechanisms. In other examples, styli according to the present disclosure do not include a communication subsystem for transmitting energy and/or data from the stylus to a computing device. - In some examples of the present disclosure, in addition to or instead of transmitting data to the computing device, a stylus is configured to receive energy and/or data from
computing device 104. In the example ofFIG. 4 ,stylus 100 includes asensor subsystem 117 that comprises an electrostatic voltage sensor 115 configured to receive electrostatic energy signals from the firsttouch screen display 114A and secondtouch screen display 114B over an electrostatic channel, such as a frequency changing channel. In some examples, these signals are provided by capacitively-coupled currents from electrodes of the firsttouch screen display 114A and secondtouch screen display 114B. These signals are amplified and converted to digital signals for use by aprocessor 116 of thestylus 100. - In some examples,
sensor subsystem 117 can include one or more other sensing components and functionalities, such as accelerometer(s), gyroscope(s), inertial measurement unit(s), and force (pressure) sensor(s). In the present example,sensor subsystem 117 includes anaccelerometer 122 and apressure sensor 126 at thetip 106 ofstylus 100, such as a piezoelectric crystal that provides an output voltage in response to the pressure imposed upon it. - Example hardware, including
processor 116,memory 120 andcommunication subsystem 124, that may be incorporated bystylus 100 to implement the disclosed approaches, is described further below with reference toFIG. 9 . In some examples, theprocessor 116 includes ahaptic circuit 130 configured to execute ahaptic driver 132 that controls activation of thehaptic feedback component 134.Stylus 100 further includes one ormore batteries 127 configured to provide power to processor to the various components of the stylus. - As noted above,
stylus 100 is configured to provide haptic feedback to users. To this end,stylus 100 includes ahaptic feedback component 134 configured to apply haptic output to the body of the stylus. In different examples, one or more haptic feedback components may be provided at any suitable location withinstylus 100.Haptic feedback component 134 may employ any suitable component(s) to provide haptic feedback as described herein. As one example,haptic feedback component 134 may include amotor 136 that applies haptic output to the stylus body in the form of vibration induced in the body. In some examples, multiple haptic feedback components are provided at different locations within a stylus. - As introduced above, in some examples the
stylus 100 actuates thehaptic feedback component 134 to provide haptic output upon detecting one or more haptic triggering criteria. In one example, thehaptic feedback component 134 is actuated when thestylus 100 orcomputing device 104 determines that the stylus is contacting a surface, such as the firsttouch screen display 114A or the secondtouch screen display 114B. For example, a haptic triggering criterion may comprise a pressure signal generated by thepressure sensor 126 in thestylus 100, or an electrostatic signal generated by the firsttouch screen display 114A or the secondtouch screen display 114B, or by thestylus 100. In other examples, the haptic triggering criteria may comprise a hover indication that indicates thestylus tip 106 is located within a predetermined hovering distance of the firsttouch screen display 114A or the secondtouch screen display 114B. In different examples, the predetermined hovering distance may be 1 cm, 2 cm, or other suitable distance. - At least on condition of detecting the one or more haptic triggering criteria, the
haptic feedback component 134 is actuated to produce haptic output. In some examples, a single haptic triggering criterion, such as detection of a pressure signal, triggers actuation of thehaptic feedback component 134. In other examples, two or more haptic triggering criteria are required to trigger the haptic feedback component, such as both a pressure signal and an electrostatic signal received by thecomputing device 104 from thestylus 100. In some examples, the one or more haptic triggering criteria comprise electrostatic indications generated by thecomputing device 104 that indicates thestylus 100 is moving relative to the computing device. - With reference now to
FIGS. 5 and 6 and as noted above, in some use cases a user may operate thestylus 100 to provide a continuous user input that spans across the firsttouch screen display 114A and the secondtouch screen display 114B. In the example ofFIGS. 5 and 6 , the user presses the stylus tip against the firsttouch screen display 114A, draws a straight line over thegap 140 between the firstinside edge 121 of the firsttouch screen display 114A and the secondinside edge 123 of the secondtouch screen display 114B, and continues drawing on the second touch screen display. - In this example, to trigger the actuation of the haptic output component, the
stylus 100 requires detection of a haptic triggering criteria in the form of a pressure signal from thestylus tip 106 indicating contact with a surface. InFIGS. 5 and 6 , when thestylus tip 106 contacts the first touchsensitive display 114A, thehaptic feedback component 134 is actuated to begin vibrating the stylus. This haptic feedback continues as thestylus tip 106 travels across the surface of thefirst display 114A. When the stylus crosses the firstinside edge 121 of thefirst display 114A and enters thegap 140, the pressure signal from thestylus tip 106 is lost as the stylus traverses the gap. When the stylus crosses the secondinside edge 123 of thesecond display 114B and contacts the surface of this display, the pressure signal is detected again, and thestylus tip 106 travels across the surface of the second display. - As noted above, it is desirable to provide continuous haptic output when the user continuously moves the stylus from one display across the gap to the other display. However, when the stylus tip is in the gap between displays and the one or more haptic triggering criteria (such as pressure) are not detected, in some examples the haptic feedback will be interrupted and then resumed again when the stylus contacts the second display. This can create a disruptive and less than desirable user experience, with the user feeling the interruption in the haptic feedback between the two displays. Additionally, in other cases where the user moves the stylus along one display and then lifts the stylus off the display, the user expects haptic feedback to cease, and it is desirable to stop providing haptic feedback in these situations.
- Accordingly, and to address the above potential drawbacks and provide desirable user experiences across different use cases, and as described in more detail below, examples of the present disclosure determine a width of the gap between the first display and the second display, and utilize this width along with a stylus velocity and a stylus direction to calculate a crossing time for a tip of the stylus to cross the gap. In different examples, the calculated crossing time comprises an estimated time that is based at least in part on the estimated gap width, a stylus velocity, and a stylus direction. When the stylus tip enters the gap, the present disclosure determines that the one or more haptic triggering criteria are not detected. At least on condition of determining that the one or more haptic triggering criteria are not detected, the stylus continues actuating the haptic feedback component for the crossing time while the stylus traverses across the gap.
- With reference again to
FIG. 6 , in one example the user moves thestylus 100 at a velocity of 10 mm/sec along the first touchsensitive display 114A from left to right toward thegap 140. In some examples, the velocity of thestylus 100 is determined by the computing device and is transmitted from thecomputing device 104 to thestylus 100 via electrostatic signals, radio signals (such as Bluetooth), or any other suitable transmission medium. In some examples, the computing device may utilize x, y coordinates of the changing location of thestylus tip 106 to calculate the velocity. In other examples, such coordinates and/or other data (such as electrostatic signals) may be transmitted from the computing device to thestylus 100, and the stylus may calculate its velocity relative to thefirst display 114A. In other examples, thestylus 100 utilizes one or more sensors onboard the stylus (e.g., accelerometer(s), gyroscope(s), inertial measurement units) to determine its velocity relative to thefirst display 114A. - As noted above, and in one potential advantage of the present disclosure, a
width 142 of thegap 140 between thefirst display 114A and thesecond display 114B is utilized to calculate a crossing time for the tip of the stylus to cross the gap. In some examples, determining the width of the gap comprises retrieving awidth 142 stored in a memory of thestylus 100 or thecomputing device 104. In some examples, thewidth 142 ofgap 140 is stored in the memory of a computing device at manufacturing or at a later time. Advantageously, and as described in more detail below, thecomputing device 104 and/orstylus 100 utilizes thewidth 142 of thegap 140 to calculate a crossing time for a tip of the stylus to cross the gap. - In some examples, the
width 142 is dynamically determined (e.g., estimated) by the computing device by examining use of the stylus with the device. For example, thecomputing device 100 may determine locations of thetip 106 of thestylus 100 relative to thefirst display 114A, thegap 140, and thesecond display 114B during use and over time. By tracking and using these locations of thetip 106 in combination with instances of not detecting the one or more haptic triggering criteria, the computing device dynamically determines thewidth 142 of the gap between the two displays. As noted above, in these examples the gap width determination comprises an estimated gap width that approximates the actual gap width and may not exactly match the actual gap width. In these and other examples, determining the width of the gap may comprise transmitting the width of the gap from thecomputing device 104 to thestylus 100. Additionally, and in one potential advantage of the present disclosure, by examining actual use of the stylus to dynamically determine the gap width as described above, this configuration can provide continuous, uninterrupted haptic feedback to the user while the stylus crosses the gap without requiring or utilizing predetermined gap values stored in memory of the stylus or computing device. - As noted above, the direction of movement of the stylus is also used to calculate a crossing time for the tip of the stylus to cross the gap. In some examples, the stylus direction of movement is a
default direction 135 retrieved from a memory of thestylus 100 or thecomputing device 104. In some examples, cartesian coordinates of the changing location of thestylus tip 106 are calculated by thecomputing device 104 and utilized to generate adirection vector 150 corresponding to the movement of the tip. In some examples, the direction vector may be transmitted to thestylus 100 and utilized to calculate the crossing time as described further below. In other examples, raw x, y position data of thetip 106 may be transmitted to thestylus 100. In these examples the stylus may determine the direction of travel of thetip 106 and utilize this direction to determine the crossing time. As described further below, the direction of travel may be used to determine an angle with respect to the firstinside edge 121 and/or secondinside edge 123. In some examples, adefault direction 135 comprises a default angle that is stored in a memory of thestylus 100 and/orcomputing device 104, and utilized as described below. Additionally, and in one potential advantage of this configuration, in some examples utilizing a default direction can reduce communications between thestylus 100 andcomputing device 104 and/or reduce computational resources otherwise required to determine the direction of travel. - In one example use case and with reference again to
FIG. 6 , thestylus tip 106 moves at a velocity of 10 mm/sec along the first touchsensitive display 114A from left to right toward thegap 140 in the direction ofvector 150, which is orthogonal to the firstinside edge 121 of the firsttouch screen display 114A and the secondinside edge 123 of the secondtouch screen display 114B. In this example thewidth 142 ofgap 140 is 5 mm. As noted above, thewidth 142 may be determined by retrieving a value from a memory of thestylus 100 or computing device, or by dynamically determining the width as described herein. In this example, thestylus 100 also comprises acrossing time calculator 148 stored inmemory 120. - As the
stylus tip 106 is moving orthogonal to the firstinside edge 121, thestylus 100 orcomputing device 104 determines that the tip will enter and cross thegap 140 at a 90-degree angle with respect to the firstinside edge 121 and secondinside edge 123. Given this 90-degree angle and the determined gap width of 5.0 mm, it is then determined that thetip 106 will travel 5.0 mm. between the firstinside edge 121 and the secondinside edge 123. Alternatively expressed, thetip 106 will travel 5.0 mm as it crosses thegap 140. - Using the determined velocity of 10 mm/sec, the gap width of 5 mm, and the determined 90-degree angle of entry into the
gap 140, thecrossing time calculator 148 calculates that thetip 106 will travel from the firstinside edge 121 to the second inside edge 123 (e.g., across the gap) in 0.5 seconds (5 mm/10 mm/sec=0.5 seconds). Alternatively expressed, thetip 106 will be located in thegap 140 for 0.5 seconds which corresponds to the crossing time. - It will be appreciated that in other examples, the stylus tip direction will not be orthogonal to the first
inside edge 121 or secondinside edge 123. In these examples, the angle of entry into thegap 140 will result in a travel distance of the tip across thegap 140 that is greater than thegap width 142, and a correspondingly longer crossing time. - In some examples and as noted above, when the
stylus tip 106 enters thegap 140, thestylus 100 orcomputing device 104 determines, at a first time, that one or more haptic triggering criteria are not detected. In one example, the haptic triggering criteria comprises a pressure signal from thestylus tip 106. For example, thestylus 100 and/orcomputing device 104 may measure or sample the pressure signal at a given sampling rate, such as 1 sample every 4 milliseconds or any other suitable sampling rate. In some examples, using the crossing time and the sampling rate, thestylus 100 coverts the crossing time into the number of pressure signals that will be lost (not received) while thestylus 100 is crossing thegap 140. In the present example, where thestylus 100 calculates a crossing time of 0.5 seconds and the pressure signal sampling rate is 1 sample every 4 milliseconds, thecrossing time calculator 148 determines that 125 pressure signal samples will be lost (not received) while thestylus tip 106 crosses thegap 140. - Accordingly, in this example while the
stylus tip 106 is contacting and moving along the surface of the firsttouch screen display 114A, pressure signals from thestylus tip 106 are detected. When thestylus tip 106 crosses the firstinside edge 121, the pressure signal is not detected. As noted above, at this first time after actuating the haptic feedback component, thestylus 100 orcomputing device 104 determines that the pressure signal is not detected. However, because thetip 106 is moving in a direction that crosses thegap 140, and at least on condition of determining that the pressure signal is not detected, thestylus 100 advantageously continues to actuate the haptic feedback component for the determined crossing time, which in this example is 0.5 seconds. Accordingly, and in one potential advantage of the present disclosure, thestylus 100 provides continuous, uninterrupted haptic feedback to the user during the entire user input sequence of drawing a line across the firsttouch screen display 114A, over thegap 140 between the first touch screen display and secondtouch screen display 114B, and continuing across the second touch screen display. - Also in this example and using the pressure sampling rate described above, the
stylus 100 orcomputing device 104 determines that 125 pressure signal samples will be lost (not received) while thestylus tip 106 crosses thegap 140. Accordingly and in some examples, when thestylus tip 106 initially crosses the firstinside edge 121 and the first pressure signal sample is not detected, thestylus 100 orcomputing device 104 may begin counting the number of pressure signal samples not received, and continue to actuate the haptic feedback component for a duration that corresponds to 125 pressure signal samples (0.5 seconds). - Advantageously, in this manner the configurations of the present disclosure enable the
stylus 100 to provide uninterrupted haptic feedback while the stylus crosses thegap 140 between displays, even though the one or more haptic triggering criteria are not detected. - With reference now to
FIG. 7 , at the expiration of the crossing time when thestylus tip 106 reaches the secondinside edge 123 of the secondtouch screen display 114B, thestylus 100 orcomputing device 104 detects the pressure signal from the stylus tip contacting the second touch screen display. Next, and on condition of detecting the pressure signal at the expiration of the crossing time, the stylus continues to actuate the haptic feedback component and provide haptic output as thestylus tip 106 continues along the surface of the second touch screen display. In this example, and in one potential advantage of the present disclosure, by continuing to provide haptic output on condition of detecting the pressure signal at the expiration of the crossing time, this configuration provides continuous haptic output to the user when the stylus is in an appropriate location for such output (e.g., exiting the gap and contacting the secondtouch screen display 114B). - In some use case examples, after entering the
gap 140 the user does not continue moving thestylus tip 106 to the secondinside edge 123. For example, the user may pause thestylus tip 106 within thegap 140 or may lift thestylus 100 away from thecomputing device 104. In these examples, at the expiration of the crossing time thestylus 100 orcomputing device 104 determines that the pressure signal is not detected. Next, and on condition of determining that the pressure signal is not detected at the expiration of the crossing time, the stylus ceases actuating the haptic feedback component at the expiration of the crossing time. Accordingly, and in one potential advantage of this configuration, the user is not provided with haptic feedback in situations where such feedback is not appropriate or expected by the user. - In some use cases and as noted above, while the tip of the stylus is crossing the
gap 140, the user may lift thestylus 100 away from thecomputing device 104. In some examples, on condition of determining that a lift distance of the tip above the first display or the second display exceeds a threshold lift distance, thestylus 100 ceases to actuate the haptic feedback component. In these examples, before the expiration of the crossing time, the stylus or computing device determines that thetip 106 of thestylus 100 is located beyond the threshold lift distance, such as 1 cm., 2 cm. or other suitable distance, from the firsttouch screen display 114A or secondtouch screen display 114B. In some examples, an electrostatic signal transmitted from thestylus 100 and received at the computing device is utilized to determine that thetip 106 of thestylus 100 is located beyond the threshold lift distance. In some example use cases, and in one potential advantage of this configuration, by utilizing a threshold lift distance as described above, when electrostatic or other interference causes slight errors in the determined lift distance of the stylus tip above a display, the haptic feedback component may continue to actuate when the estimated lift distance is less than the threshold lift distance. - In some examples, environmental noise, such as electrostatic interference, can interfere with one or more sensors in the
stylus 100 and/orcomputing device 104. For example and as noted above, in some examples electrostatic signals are transmitted between thestylus 100 andcomputing device 104, or vice versa. These signals may be utilized for a variety of purposes, such as determining whether one or more haptic triggering criteria are detected, and transmitting stylus velocity values from thecomputing device 104 to thestylus 100, or vice versa. In these examples, electrostatic noise can disrupt the corresponding calculations. Accordingly, and in some examples, thecomputing device 104 orstylus 100 compares a detected environmental noise level to a noise threshold. When the detected noise level exceeds the noise threshold, the duration of the calculated crossing time is adjusted accordingly. For example, in some use cases when the detected noise exceeds the noise threshold, the duration of the calculated crossing time may be increased to account for an expected greater number of lost or degraded electrostatic signals. - In some examples, one or more additional parameters may be utilized in calculating a crossing time for a
tip 106 of thestylus 100 to cross thegap 140. For example, to determine a location of thetip 106 of thestylus 100 relative to thegap 140 between the firsttouch screen display 114A and secondtouch screen display 114B, the two displays may transmit electrostatic signals to thestylus 100 at different frequencies. In one example, thefirst display 114A may transmit a first electrostatic signal at a first frequency, and thesecond display 114B may transmit a second electrostatic signal at a second, different frequency. - Using these signals at different frequencies, the
stylus 100 may determine a location of thetip 106 relative to thegap 140 between the first display and the second display. In some examples, the signal strength of the two electrostatic signals is analyzed to determine the location of thetip 106 as it crosses the firstinside edge 121, travels across thegap 140, and crosses the secondinside edge 123. In some examples, these different electrostatic signals may be utilized in combination with one or more of the stylus velocity, direction, andgap width 142 to calculate the crossing time for thetip 106 to cross the gap, and to correspondingly continue actuating the haptic feedback component for the crossing time. Accordingly, and in another potential advantage of the present disclosure, using different frequencies for different displays as described above may improve the accuracy of determining at which display (and which side of the gap 140) thestylus 100 is located when it nears the gap, thereby correspondingly enabling a haptic feedback user experience that more closely matches user expectations. - In other examples, to determine a location of the
tip 106 of thestylus 100 relative to thegap 140 between the firsttouch screen display 114A and secondtouch screen display 114B, the two displays may transmit electrostatic signals to thestylus 100 at the same frequencies but during different time windows. In one example, thefirst display 114A may transmit a first electrostatic signal during a first set of time windows from the first display, and thesecond display 114B may transmit a second electrostatic signal during an alternating second set of different time windows. For example, thefirst display 114A may transmit a first electrostatic signal in a time window between 1.0-2.0 ms. Following this transmission and at 2.0 ms, thesecond display 114B may transmit a second electrostatic signal in a time window between 2.0-3.0 ms, and so forth. - By determining the time window in which an electrostatic signal was received, the
stylus 100 can determine which display transmitted the signal. Using these signals received at different times, thestylus 100 may then determine a location of thetip 106 relative to thegap 140 between the first display and the second display. In some examples, the signal strength of the electrostatic signals is analyzed to determine the location of thetip 106 as it crosses the firstinside edge 121, travels across thegap 140, and crosses the secondinside edge 123. In some examples, these electrostatic signals may be utilized in combination with one or more of the stylus velocity, direction, andgap width 142 to calculate the crossing time for thetip 106 to cross the gap and to correspondingly continue actuating the haptic feedback component for the crossing time. Accordingly, and in one potential advantage of this configuration, using different time windows for detecting signals from the two different displays as described above may improve the accuracy of determining at which display (and which side of the gap 140) thestylus 100 is located when it nears the gap, thereby correspondingly enabling a haptic feedback user experience that more closely matches user expectations. - With reference now to
FIGS. 8A-8C , amethod 200 for actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device will now be described. As described below, in someexamples method 200 may be implemented and performed at a stylus, such asstylus 100. In other examples, one or more steps ofmethod 200 may be implemented and performed at a computing device, such ascomputing device 104. - The following description of
method 200 is provided by way of example and is not meant to be limiting. Therefore, it is to be understood thatmethod 200 may include additional and/or alternative steps relative to those illustrated inFIGS. 8A-8C . Further, it is to be understood that the steps ofmethod 200 may be performed in any suitable order. Further still, it is to be understood that one or more steps may be omitted frommethod 200 without departing from the scope of this disclosure. It will also be appreciated thatmethod 200 also may be performed in other contexts using other suitable components - With reference to
FIG. 8A , at 204 themethod 200 includes detecting one or more haptic triggering criteria. At 208 themethod 200 includes, wherein the haptic triggering criteria comprise one or more criterion selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication. At 212 themethod 200 includes, at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output. At 216 themethod 200 includes determining a width of the gap between the first display and the second display. At 218 themethod 200 may include retrieving a stored width from a memory of the stylus or the computing device. At 220 themethod 200 may include transmitting the width of the gap from the computing device to the stylus. At 222 themethod 200 may include determining locations of the tip of the stylus during use. At 224 themethod 200 may include determining the width of the gap using at least the locations of the tip during use and instances of not detecting the one or more haptic triggering criteria. - At 228 the
method 200 includes, using the width of the gap, a stylus velocity, and a stylus direction, calculating a crossing time for a tip of the stylus to cross the gap. At 232 themethod 200 may include, wherein the stylus direction is a default direction retrieved from a memory of the stylus or the computing device. With reference now toFIG. 8B , at 236 themethod 200 includes, at a first time after actuating the haptic feedback component, determining that the one or more haptic triggering criteria are not detected. At 240 themethod 200 includes, at least on condition of determining that the one or more haptic triggering criteria are not detected, continuing to actuate the haptic feedback component for the crossing time. - At 244 the
method 200 may include, at the expiration of the crossing time, detecting the one or more haptic triggering criteria. At 248 themethod 200 may include, on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continuing to actuate the haptic feedback component. At 250 themethod 200 may include, at the expiration of the crossing time, determining that the one or more haptic triggering criteria are not detected. At 252 themethod 200 may include, on condition of determining that the one or more haptic triggering criteria are not detected, ceasing to actuate the haptic feedback component at the expiration of the crossing time. At 256 themethod 200 may include, while the tip of the stylus is crossing the gap, on condition of determining that a lift distance of the tip above the first display or the second display exceeds a threshold lift distance, ceasing to actuate the haptic feedback component. - With reference now to
FIG. 8C , at 260 themethod 200 may include, wherein calculating a crossing time further comprises: comparing a detected noise level to a noise threshold. At 264 themethod 200 may include, on condition that the detected noise level exceeds the noise threshold, adjusting the duration of the crossing time. At 268 themethod 200 may include transmitting a first electrostatic signal at a first frequency from the first display. At 272 themethod 200 may include transmitting a second electrostatic signal at a second frequency from the second display. At 274 themethod 200 may include using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display. - At 276 the
method 200 may include transmitting a first electrostatic signal during a first set of time windows from the first display. At 278 themethod 200 may include transmitting a second electrostatic signal during a second set of time windows from the second display. At 280 themethod 200 may include using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display. - In some embodiments, the methods and processes described herein may be tied to a computing system of one or more computing devices. In particular, such methods and processes may be implemented as a computer-application program or service, an application-programming interface (API), a library, and/or other computer-program product.
-
FIG. 9 schematically shows a non-limiting embodiment of acomputing system 300 that can enact one or more of the methods and processes described above.Computing system 300 is shown in simplified form. One or more aspects ofcomputing system 300 may be utilized instylus 100 and in thecomputing device 104 described herein.Computing system 300 may take the form of one or more input devices, personal computers, server computers, tablet computers, home-entertainment computers, network computing devices, gaming devices, mobile computing devices, mobile communication devices (e.g., smart phone), and/or other computing devices, and wearable computing devices such as smart wristwatches and head mounted augmented reality devices. -
Computing system 300 includes alogic processor 302,volatile memory 304, and anon-volatile storage device 306.Computing system 300 may optionally include adisplay subsystem 308,input subsystem 310,communication subsystem 312, and/or other components not shown inFIG. 9 . -
Logic processor 302 includes one or more physical devices configured to execute instructions. For example, the logic processor may be configured to execute instructions that are part of one or more applications, programs, routines, libraries, objects, components, data structures, or other logical constructs. Such instructions may be implemented to perform a task, implement a data type, transform the state of one or more components, achieve a technical effect, or otherwise arrive at a desired result. - The logic processor may include one or more physical processors (hardware) configured to execute software instructions. Additionally or alternatively, the logic processor may include one or more hardware logic circuits or firmware devices configured to execute hardware-implemented logic or firmware instructions. Processors of the
logic processor 302 may be single-core or multi-core, and the instructions executed thereon may be configured for sequential, parallel, and/or distributed processing. Individual components of the logic processor optionally may be distributed among two or more separate devices, which may be remotely located and/or configured for coordinated processing. Aspects of the logic processor may be virtualized and executed by remotely accessible, networked computing devices configured in a cloud-computing configuration. In such a case, these virtualized aspects are run on different physical logic processors of various different machines, it will be understood. -
Non-volatile storage device 306 includes one or more physical devices configured to hold instructions executable by the logic processors to implement the methods and processes described herein. When such methods and processes are implemented, the state ofnon-volatile storage device 306 may be transformed—e.g., to hold different data. -
Non-volatile storage device 306 may include physical devices that are removable and/or built-in.Non-volatile storage device 306 may include optical memory (e.g., CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memory (e.g., ROM, EPROM, EEPROM, FLASH memory, etc.), and/or magnetic memory (e.g., hard-disk drive, floppy-disk drive, tape drive, MRAM, etc.), or other mass storage device technology.Non-volatile storage device 306 may include nonvolatile, dynamic, static, read/write, read-only, sequential-access, location-addressable, file-addressable, and/or content-addressable devices. It will be appreciated thatnon-volatile storage device 306 is configured to hold instructions even when power is cut to thenon-volatile storage device 306. -
Volatile memory 304 may include physical devices that include random access memory.Volatile memory 304 is typically utilized bylogic processor 302 to temporarily store information during processing of software instructions. It will be appreciated thatvolatile memory 304 typically does not continue to store instructions when power is cut to thevolatile memory 304. - Aspects of
logic processor 302,volatile memory 304, andnon-volatile storage device 306 may be integrated together into one or more hardware-logic components. Such hardware-logic components may include field-programmable gate arrays (FPGAs), program- and application-specific integrated circuits (PASIC/ASICs), program- and application-specific standard products (PSSP/ASSPs), system-on-a-chip (SOC), and complex programmable logic devices (CPLDs), for example. - The terms “module,” “program,” and “engine” may be used to describe an aspect of
computing system 300 typically implemented in software by a processor to perform a particular function using portions of volatile memory, which function involves transformative processing that specially configures the processor to perform the function. Thus, a module, program, or engine may be instantiated vialogic processor 302 executing instructions held bynon-volatile storage device 306, using portions ofvolatile memory 304. It will be understood that different modules, programs, and/or engines may be instantiated from the same application, service, code block, object, library, routine, API, function, etc. Likewise, the same module, program, and/or engine may be instantiated by different applications, services, code blocks, objects, routines, APIs, functions, etc. The terms “module,” “program,” and “engine” may encompass individual or groups of executable files, data files, libraries, drivers, scripts, database records, etc. - When included,
display subsystem 308 may be used to present a visual representation of data held bynon-volatile storage device 306. The visual representation may take the form of a graphical user interface (GUI). As the herein described methods and processes change the data held by the non-volatile storage device, and thus transform the state of the non-volatile storage device, the state ofdisplay subsystem 308 may likewise be transformed to visually represent changes in the underlying data.Display subsystem 308 may include one or more display devices utilizing virtually any type of technology. Such display devices may be combined withlogic processor 302,volatile memory 304, and/ornon-volatile storage device 306 in a shared enclosure, or such display devices may be peripheral display devices. - When included,
input subsystem 310 may comprise or interface with one or more user-input devices such as a stylus, keyboard, mouse, touch screen, or game controller. In some embodiments, the input subsystem may comprise or interface with selected natural user input (NUI) componentry. Such componentry may be integrated or peripheral, and the transduction and/or processing of input actions may be handled on- or off-board. Example NUI componentry may include a microphone for speech and/or voice recognition; an infrared, color, stereoscopic, and/or depth camera for machine vision and/or gesture recognition; a head tracker, eye tracker, accelerometer, and/or gyroscope for motion detection and/or intent recognition; as well as electric-field sensing componentry for assessing brain activity; and/or any other suitable sensor. - When included,
communication subsystem 312 may be configured to communicatively couple various computing devices described herein with each other, and with other devices.Communication subsystem 312 may include wired and/or wireless communication devices compatible with one or more different communication protocols. As non-limiting examples, the communication subsystem may be configured for communication via a wireless telephone network, or a wired or wireless personal-, local-, or wide-area network, such as Bluetooth or an HDMI over Wi-Fi connection. In some embodiments, the communication subsystem may allowcomputing system 300 to send and/or receive messages to and/or from other devices via a network such as the Internet. - The following paragraphs provide additional support for the claims of the subject application. One aspect provides a method for actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device, the method comprising: detecting one or more haptic triggering criteria; at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output; determining a width of the gap between the first display and the second display; using the width of the gap, a stylus velocity, and a stylus direction, calculating a crossing time for a tip of the stylus to cross the gap; at a first time after actuating the haptic feedback component, determining that the one or more haptic triggering criteria are not detected; and at least on condition of determining that the one or more haptic triggering criteria are not detected, continuing to actuate the haptic feedback component for the crossing time. The method may additionally or alternatively include, at the expiration of the crossing time, detecting the one or more haptic triggering criteria; and on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continuing to actuate the haptic feedback component. The method may additionally or alternatively include, at the expiration of the crossing time, determining that the one or more haptic triggering criteria are not detected; and on condition of determining that the one or more haptic triggering criteria are not detected, ceasing to actuate the haptic feedback component at the expiration of the crossing time. The method may additionally or alternatively include, wherein determining the width of the gap comprises retrieving a stored width from a memory of the stylus or the computing device. The method may additionally or alternatively include, wherein determining the width of the gap comprises transmitting the width of the gap from the computing device to the stylus. The method may additionally or alternatively include, wherein determining the width of the gap comprises: determining locations of the tip of the stylus during use; and determining the width of the gap using at least the locations of the tip during use and instances of not detecting the one or more haptic triggering criteria. The method may additionally or alternatively include, wherein the stylus direction is a default direction retrieved from a memory of the stylus or the computing device. The method may additionally or alternatively include, wherein the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication. The method may additionally or alternatively include, while the tip of the stylus is crossing the gap, on condition of determining that a lift distance of the tip above the first display or the second display exceeds a threshold lift distance, ceasing to actuate the haptic feedback component. The method may additionally or alternatively include, wherein calculating a crossing time further comprises: comparing a detected noise level to a noise threshold; and on condition that the detected noise level exceeds the noise threshold, adjusting the duration of the crossing time. The method may additionally or alternatively include, transmitting a first electrostatic signal at a first frequency from the first display; transmitting a second electrostatic signal at a second frequency from the second display; and using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display. The method may additionally or alternatively include, transmitting a first electrostatic signal during a first set of time windows from the first display; transmitting a second electrostatic signal during a second set of time windows from the second display; and using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display.
- Another aspect provides a stylus for use with a computing device comprising a first display and a second display that are separated by a gap, the stylus comprising: a haptic feedback component within the stylus; a logic processor; and a memory storing instructions executable by the processor to actuate the haptic feedback component while the stylus crosses the gap between the first display and the second display, the instructions executable to: detect one or more haptic triggering criteria; at least on condition of detecting the one or more haptic triggering criteria, actuate the haptic feedback component to produce haptic output; determine a width of the gap between the first display and the second display; using the width of the gap, a stylus velocity, and a stylus direction, calculate a crossing time for a tip of the stylus to cross the gap; at a first time after actuating the haptic feedback component, determine that the one or more haptic triggering criteria are not detected; at least on condition of determining that the one or more haptic triggering criteria are not detected, continue to actuate the haptic feedback component for the crossing time. The stylus may additionally or alternatively include, wherein the instructions are executable to, at the expiration of the crossing time: detect the one or more haptic triggering criteria; and on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continue to actuate the haptic feedback component. The stylus may additionally or alternatively include, wherein the instructions are executable to determine the width of the gap by retrieving a stored width from a memory of the stylus or the computing device. The stylus may additionally or alternatively include, wherein the instructions are executable to determine the width of the gap by receiving the width from the computing device. The stylus may additionally or alternatively include, wherein the instructions are executable to: determine locations of the tip of the stylus during use; and determine the width of the gap using at least the locations of the tip during use and instances of not detecting the one or more haptic triggering criteria. The stylus may additionally or alternatively include, wherein the stylus direction is a default direction, and the instructions are executable to retrieve the default direction from a memory of the stylus or the computing device. The stylus may additionally or alternatively include, wherein the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication.
- Another aspect provides a method for actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device, the method comprising: detecting one or more haptic triggering criteria, wherein the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication; at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output; determining a width of the gap between the first display and the second display; using the width of the gap, a stylus velocity, and a stylus direction, calculating a crossing time for a tip of the stylus to cross the gap; at a first time after actuating the haptic feedback component, determining that the one or more haptic triggering criteria are not detected; at least on condition of determining that the one or more haptic triggering criteria are not detected, continuing to actuate the haptic feedback component for the crossing time; at the expiration of the crossing time, detecting the one or more haptic triggering criteria; and on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continuing to actuate the haptic feedback component.
- It will be understood that the configurations and/or approaches described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are possible. The specific routines or methods described herein may represent one or more of any number of processing strategies. As such, various acts illustrated and/or described may be performed in the sequence illustrated and/or described, in other sequences, in parallel, or omitted. Likewise, the order of the above-described processes may be changed.
- The subject matter of the present disclosure includes all novel and non-obvious combinations and sub-combinations of the various processes, systems and configurations, and other features, functions, acts, and/or properties disclosed herein, as well as any and all equivalents thereof.
Claims (20)
1. A method for actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device, the method comprising:
detecting one or more haptic triggering criteria;
at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output;
determining a width of the gap between the first display and the second display;
using the width of the gap, a stylus velocity, and a stylus direction, calculating a crossing time for a tip of the stylus to cross the gap;
at a first time after actuating the haptic feedback component, determining that the one or more haptic triggering criteria are not detected; and
at least on condition of determining that the one or more haptic triggering criteria are not detected, continuing to actuate the haptic feedback component for the crossing time.
2. The method of claim 1 , further comprising:
at the expiration of the crossing time, detecting the one or more haptic triggering criteria; and
on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continuing to actuate the haptic feedback component.
3. The method of claim 1 , further comprising:
at the expiration of the crossing time, determining that the one or more haptic triggering criteria are not detected; and
on condition of determining that the one or more haptic triggering criteria are not detected, ceasing to actuate the haptic feedback component at the expiration of the crossing time.
4. The method of claim 1 , wherein determining the width of the gap comprises retrieving a stored width from a memory of the stylus or the computing device.
5. The method of claim 1 , wherein determining the width of the gap comprises transmitting the width of the gap from the computing device to the stylus.
6. The method of claim 1 , wherein determining the width of the gap comprises:
determining locations of the tip of the stylus during use; and
determining the width of the gap using at least the locations of the tip during use and instances of not detecting the one or more haptic triggering criteria.
7. The method of claim 1 , wherein the stylus direction is a default direction retrieved from a memory of the stylus or the computing device.
8. The method of claim 1 , wherein the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication.
9. The method of claim 1 , further comprising, while the tip of the stylus is crossing the gap, on condition of determining that a lift distance of the tip above the first display or the second display exceeds a threshold lift distance, ceasing to actuate the haptic feedback component.
10. The method of claim 1 , wherein calculating a crossing time further comprises:
comparing a detected noise level to a noise threshold; and
on condition that the detected noise level exceeds the noise threshold, adjusting the duration of the crossing time.
11. The method of claim 1 , further comprising:
transmitting a first electrostatic signal at a first frequency from the first display;
transmitting a second electrostatic signal at a second frequency from the second display; and
using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display.
12. The method of claim 1 , further comprising:
transmitting a first electrostatic signal during a first set of time windows from the first display;
transmitting a second electrostatic signal during a second set of time windows from the second display; and
using the first electrostatic signal and the second electrostatic signal to determine a location of the tip of the stylus relative to the gap between the first display and the second display.
13. A stylus for use with a computing device comprising a first display and a second display that are separated by a gap, the stylus comprising:
a haptic feedback component within the stylus;
a logic processor; and
a memory storing instructions executable by the processor to actuate the haptic feedback component while the stylus crosses the gap between the first display and the second display, the instructions executable to:
detect one or more haptic triggering criteria;
at least on condition of detecting the one or more haptic triggering criteria, actuate the haptic feedback component to produce haptic output;
determine a width of the gap between the first display and the second display;
using the width of the gap, a stylus velocity, and a stylus direction, calculate a crossing time for a tip of the stylus to cross the gap;
at a first time after actuating the haptic feedback component, determine that the one or more haptic triggering criteria are not detected;
at least on condition of determining that the one or more haptic triggering criteria are not detected, continue to actuate the haptic feedback component for the crossing time.
14. The stylus of claim 13 , wherein the instructions are executable to, at the expiration of the crossing time:
detect the one or more haptic triggering criteria; and
on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continue to actuate the haptic feedback component.
15. The stylus of claim 13 , wherein the instructions are executable to determine the width of the gap by retrieving a stored width from a memory of the stylus or the computing device.
16. The stylus of claim 13 , wherein the instructions are executable to determine the width of the gap by receiving the width from the computing device.
17. The stylus of claim 13 , wherein the instructions are executable to:
determine locations of the tip of the stylus during use; and
determine the width of the gap using at least the locations of the tip during use and instances of not detecting the one or more haptic triggering criteria.
18. The stylus of claim 13 , wherein the stylus direction is a default direction, and the instructions are executable to retrieve the default direction from a memory of the stylus or the computing device.
19. The stylus of claim 13 , wherein the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication.
20. A method for actuating a haptic feedback component in a stylus while the stylus crosses a gap between a first display and a second display of a computing device, the method comprising:
detecting one or more haptic triggering criteria, wherein the haptic triggering criteria comprise one or more criteria selected from a pressure signal, an electrostatic signal from the first display or the second display, and a hover indication;
at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output;
determining a width of the gap between the first display and the second display;
using the width of the gap, a stylus velocity, and a stylus direction, calculating a crossing time for a tip of the stylus to cross the gap;
at a first time after actuating the haptic feedback component, determining that the one or more haptic triggering criteria are not detected;
at least on condition of determining that the one or more haptic triggering criteria are not detected, continuing to actuate the haptic feedback component for the crossing time;
at the expiration of the crossing time, detecting the one or more haptic triggering criteria; and
on condition of detecting the one or more haptic triggering criteria at the expiration of the crossing time, continuing to actuate the haptic feedback component.
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/450,268 US11635817B1 (en) | 2021-10-07 | 2021-10-07 | Stylus haptic component |
CN202280066908.5A CN118056175A (en) | 2021-10-07 | 2022-07-26 | Touch assembly of touch pen |
EP22755003.5A EP4413443A1 (en) | 2021-10-07 | 2022-07-26 | Stylus haptic component |
PCT/US2022/038254 WO2023059385A1 (en) | 2021-10-07 | 2022-07-26 | Stylus haptic component |
US18/299,409 US11954257B2 (en) | 2021-10-07 | 2023-04-12 | Stylus haptic component |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/450,268 US11635817B1 (en) | 2021-10-07 | 2021-10-07 | Stylus haptic component |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/299,409 Continuation US11954257B2 (en) | 2021-10-07 | 2023-04-12 | Stylus haptic component |
Publications (2)
Publication Number | Publication Date |
---|---|
US20230111778A1 true US20230111778A1 (en) | 2023-04-13 |
US11635817B1 US11635817B1 (en) | 2023-04-25 |
Family
ID=82932737
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/450,268 Active US11635817B1 (en) | 2021-10-07 | 2021-10-07 | Stylus haptic component |
US18/299,409 Active US11954257B2 (en) | 2021-10-07 | 2023-04-12 | Stylus haptic component |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/299,409 Active US11954257B2 (en) | 2021-10-07 | 2023-04-12 | Stylus haptic component |
Country Status (4)
Country | Link |
---|---|
US (2) | US11635817B1 (en) |
EP (1) | EP4413443A1 (en) |
CN (1) | CN118056175A (en) |
WO (1) | WO2023059385A1 (en) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130285957A1 (en) * | 2012-04-26 | 2013-10-31 | Samsung Electronics Co., Ltd. | Display device and method using a plurality of display panels |
US20150074564A1 (en) * | 2013-09-10 | 2015-03-12 | Lenovo (Singapore) Pte. Ltd. | Feedback for cursor location in multiple monitor device contexts |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8330733B2 (en) | 2009-01-21 | 2012-12-11 | Microsoft Corporation | Bi-modal multiscreen interactivity |
US20120162091A1 (en) | 2010-12-23 | 2012-06-28 | Lyons Kenton M | System, method, and computer program product for multidisplay dragging |
KR101802522B1 (en) | 2011-02-10 | 2017-11-29 | 삼성전자주식회사 | Apparatus having a plurality of touch screens and screen changing method thereof |
US8842057B2 (en) | 2011-09-27 | 2014-09-23 | Z124 | Detail on triggers: transitional states |
US9524030B2 (en) | 2013-04-26 | 2016-12-20 | Immersion Corporation | Haptic feedback for interactions with foldable-bendable displays |
US10671186B2 (en) | 2016-06-15 | 2020-06-02 | Microsoft Technology Licensing, Llc | Autonomous haptic stylus |
US11416130B2 (en) | 2019-10-01 | 2022-08-16 | Microsoft Technology Licensing, Llc | Moving applications on multi-screen computing device |
-
2021
- 2021-10-07 US US17/450,268 patent/US11635817B1/en active Active
-
2022
- 2022-07-26 WO PCT/US2022/038254 patent/WO2023059385A1/en active Application Filing
- 2022-07-26 CN CN202280066908.5A patent/CN118056175A/en active Pending
- 2022-07-26 EP EP22755003.5A patent/EP4413443A1/en active Pending
-
2023
- 2023-04-12 US US18/299,409 patent/US11954257B2/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130285957A1 (en) * | 2012-04-26 | 2013-10-31 | Samsung Electronics Co., Ltd. | Display device and method using a plurality of display panels |
US20150074564A1 (en) * | 2013-09-10 | 2015-03-12 | Lenovo (Singapore) Pte. Ltd. | Feedback for cursor location in multiple monitor device contexts |
Also Published As
Publication number | Publication date |
---|---|
CN118056175A (en) | 2024-05-17 |
US11954257B2 (en) | 2024-04-09 |
US11635817B1 (en) | 2023-04-25 |
WO2023059385A1 (en) | 2023-04-13 |
EP4413443A1 (en) | 2024-08-14 |
US20230251719A1 (en) | 2023-08-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102253313B1 (en) | Operation method and apparatus using fingerprint identification, and mobile terminal | |
US11543961B2 (en) | Touch screen display with virtual trackpad | |
US9165566B2 (en) | Indefinite speech inputs | |
US10025427B2 (en) | Probabilistic touch sensing | |
JP2014179085A (en) | Method and devices for displaying graphical user interfaces based on user contact | |
US11775084B2 (en) | Stylus haptic component arming and power consumption | |
US20120268373A1 (en) | Method for recognizing user's gesture in electronic device | |
US20240126385A1 (en) | Touch-sensitive input device | |
EP2828725A1 (en) | User input system | |
US9891726B1 (en) | Stylus with touch-sensitive retention clip | |
US20220214725A1 (en) | Posture probabilities for hinged touch display | |
US11789541B2 (en) | Adjusting haptic feedback through touch-sensitive input devices | |
US11954257B2 (en) | Stylus haptic component | |
US11797090B2 (en) | Stylus haptic output | |
EP4315006A1 (en) | Touch screen and trackpad touch detection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DEKEL, SHOHAM;RON, URI;BAR-NESS, ASSAF;SIGNING DATES FROM 20211006 TO 20211007;REEL/FRAME:057735/0582 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |