AU2007100827A4 - Multi-event input system - Google Patents

Multi-event input system Download PDF

Info

Publication number
AU2007100827A4
AU2007100827A4 AU2007100827A AU2007100827A AU2007100827A4 AU 2007100827 A4 AU2007100827 A4 AU 2007100827A4 AU 2007100827 A AU2007100827 A AU 2007100827A AU 2007100827 A AU2007100827 A AU 2007100827A AU 2007100827 A4 AU2007100827 A4 AU 2007100827A4
Authority
AU
Australia
Prior art keywords
touch
surface
finger
contact
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired
Application number
AU2007100827A
Other versions
AU2007100827B4 (en
Inventor
Scott M. Herz
Wayne Carl Westerman
Roberto G. Yepez
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US11/619,595 priority Critical patent/US7777732B2/en
Priority to US11/619,595 priority
Application filed by Apple Inc filed Critical Apple Inc
Publication of AU2007100827A4 publication Critical patent/AU2007100827A4/en
Application granted granted Critical
Publication of AU2007100827B4 publication Critical patent/AU2007100827B4/en
Anticipated expiration legal-status Critical
Application status is Expired legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for entering handwritten data, e.g. gestures, text
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/044Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning

Description

1

O

00

AUSTRALIA

Patents Act 1990 COMPLETE SPECIFICATION FOR AN INNOVATION PATENT Name of Applicant: Actual Inventors: Address for Service: Invention Title: Apple Inc. of 1 Infinite Loop, Cupertino, California, 95014, United States of America Scott M. HERZ Roberto G. YEPEZ Wayne Carl WESTERMAN DAVIES COLLISON CAVE, Patent Attorneys, of 1 Nicholson Street, Melbourne, Victoria 3000, Australia Multi-event input system The following statement is a full description of this invention, including the best method of performing it known to us: P/00/011 Q \OPER\D8W\2007\Augu\30300149 inn doc 27/8/07 NMULTI-EVENT INPUT SYSTEM 00 C BACKGROUND [0001] The present invention relates generally to input systems, methods, and devices, and more particularly, to multi-event input systems, methods, and devices for 00 use in connection with touch-sensitive electronic devices.

[0002] There currently exist various types of input devices for performing operations in a computer system. The operations, for example, may correspond to moving a cursor and making selections on a display screen. The operations may also include paging, scrolling, panning, zooming, etc. The input devices may include, for example, buttons, switches, keyboards, mice, trackballs, pointing sticks, joy sticks, touch surfaces (including touch pads and touch screens, etc.), and other types of input devices.

[0003] Various types of touch screens are described in one or more of the related applications cross-referenced above which are incorporated by reference herein.

Touch screens typically include a touch panel, a controller, and a software driver. A touch panel generally includes a generally clear panel with a touch sensitive surface.

The touch panel is positioned in front of a display screen so that the touch sensitive surface covers the viewable area of the display screen (usually the entire display area).

The touch panel registers touch events and sends corresponding signals to the controller. The controller processes these signals and sends the data to the computer system. The software driver translates the touch events into computer events recognizable by the computer system.

SUMMARY

[0004] It has been discovered that current touch surface systems suffer from various disadvantages. For example, some touch screen systems are generally only

I-

la-929964

O

O

responsive to either a touch or a lack thereof. That is, they are limited to two states ;and do not contemplate a third state. Accordingly, they cannot replicate all of the OO events that other types of input devices can generate. For example, a mouse input device is generally capable of generating more events than a conventional touch screen input system.

OO [0005] Other touch screen systems may be capable of distinguishing between a

O

Otouch event, wherein a finger touches the touch screen, and a proximity event, wherein a finger is in close proximity to the touch screen but does not contact the Otouch screen. Such systems still suffer from a drawback in that they can generate touch events based on unintentional touches. For example, when a user's finger hovers over the touch screen and accidentally bumps into the screen, an unintentional generation of a touch event results.

[0006] In addition, design and development of various electronic devices have been driven by a demand for smaller and smaller form factors. This demand may be linked to a need or desire for ease of portability or mobility. Smaller devices naturally come equipped with smaller display screens. As well, the information presented in a relatively small display screen may be relatively dense. An adult finger, however, can be relatively large and imprecise.

[0007] A need therefore exists for systems, methods, and devices that provide for a touch surface that improves upon the prior art. Various embodiments of the present disclosure improve upon the prior art by providing for more robust touch surfaces that can recognize and distinguish different types of touch inputs. Accordingly, the number of types of input and the number of types of events are advantageously increased. In this manner, additional functionality can be achieved. Moreover, various embodiments of the present disclosure can also provide for increased precision in detecting touches. This can be particularly beneficial when used with devices having relatively small screens. Of course, increased precision can be beneficial when used with screens of any size.

-2la-929964 [00081 Among other things, embodiments of the present disclosure provide multi- Sevent input methods that discriminate between a first contact and a second contact, 00 wherein the first contact is between a touch-surface display and a flesh surface and the second contact is between the touch-surface display and a non-flesh surface. The first contact is used to drive a first event, and the second contact is used to drive a second C event. In some embodiments, the flesh surface may comprise a palmar aspect of a 00 finger. In some embodiments, the non-flesh surface may comprise a fingernail. In some embodiments, the non-flesh surface may comprise an electrically insulative material coupled to a finger.

[0009] In accordance with other embodiments of the present disclosure, methods of using a touch-surface display arrangement are provided. The touch-surface display arrangement is touched with a flesh surface of a finger to drive a first event, and the touch-surface display arrangement is touched with a non-flesh surface of a finger to drive a second event.

10010] In accordance with other embodiments of the present disclosure, computer-implemented methods for processing multiple types of touch inputs are provided. A contact between a touch-surface display and a surface of a finger is received. A determination is made whether the surface comprises a flesh aspect or a non-flesh aspect of a finger. If the surface comprises a flesh aspect, the contact is used to drive a first event. If the surface comprises a non-flesh aspect, the contact is used to drive a second event. The second event can be used to invoke various types of actions, such as a rollover, tooltip, selection of text, and many others.

[0011] In accordance with other embodiments of the present disclosure, touch input systems are provided which include a display device for displaying a graphical user interface and a touch surface operatively coupled to the display device, wherein the touch surface is configured to receive a plurality of types of touch inputs and is capable of distinguishing between a flesh contact and a non-flesh contact. The touch input systems may further include a device driver configured to receive touch input information from the touch screen and determine one or more input states. The touch -3la-929964 input systems may further include a window server configured to receive information Z from the device driver pertaining to the one or more input states and to convert the 0 information into one or more events for dispatch to an application. In some embodiments, the system may optionally comprise an imaging chip operatively coupled to the touch surface. In various embodiments, the input state may comprise 00 any of the following: touching with flesh; not touching with flesh; in-range of a Otracking area; and out-of-range of a tracking area. In various embodiments, the events may comprise any of the following: left mouse button down; left mouse button up; Smouse entered a tracking area; mouse exited the tracking area; mouse moved without N pressing the left mouse button; and mouse dragged while pressing the left mouse button.

[0012] In accordance with other embodiments of the present disclosure, portable electronic devices are provided. The electronic devices include a display device for displaying a graphical user interface and a touch screen positioned in front of the display device and configured to receive a plurality of types of touch inputs and is capable of distinguishing between a flesh contact and a non-flesh contact. The electronic devices may further include a device driver configured to receive touch input information from the touch screen and determine one or more input states. The electronic devices may further include a window server configured to receive information from the device driver pertaining to the one or more input states and to convert the information into one or more events for dispatch to an application. The electronic devices may further include a processor unit operatively coupled to the display device, wherein the application is executable within the processor unit.

Examples of electronic devices include, for example, laptop computers, tablet computers, handheld computers, wrist-worn computers, PDAs (personal data assistants), smart phones, telephones and other communication devices, media players including music players and video players, game consoles, navigation devices, and exercise monitor devices.

[0013] In addition, program storage devices are provided, readable by a programmable control device, comprising instructions stored thereon for causing the -4la-929964 0 programmable control device to perform one or more of the methods disclosed herein.

;As well, computer-readable media having computer-executable instructions for O performing the methods disclosed herein are provided.

BRIEF DESCRIPTION OF THE DRAWINGS 00 10014] The following drawings form part of the present specification and are included to further demonstrate certain aspects of the present invention. The Sinvention may be better understood by reference to one or more of these drawings in Scombination with the detailed description of specific embodiments presented herein.

[0015] FIG. 1A depicts a perspective view of an exemplary display arrangement in accordance with various embodiments of the present disclosure.

[0016] FIG. 1B depicts a perspective view of an exemplary display arrangement in accordance with various embodiments of the present disclosure.

[0017] FIG. IC depicts a perspective view of an exemplary display arrangement in accordance with various embodiments of the present disclosure.

[00181 FIG. 2 depicts a block diagram of an exemplary touch event delivery system architecture in accordance with various embodiments of the present disclosure.

[0019] FIG. 3A depicts a front plan view of an exemplary touch screen display in accordance with various embodiments of the present disclosure.

[00201 FIG. 3B depicts a front plan view of an exemplary touch screen display in accordance with various embodiments of the present disclosure.

[00211 FIG. 3C depicts a front plan view of an exemplary touch screen display in accordance with various embodiments of the present disclosure.

la-929964 00 [0022]1 FIG. 3D depicts a front plan view of an exemplary touch screen display in accordance with various embodiments of the present disclosure.

[0023] FIG. 4A depicts a front plan view of an exemplary touch screen display in accordance with various embodiments of the present disclosure.

S[0024] FIG. 4B depicts a front plan view of an exemplary touch screen display in O accordance with various embodiments of the present disclosure.

[0025] FIG. 4C depicts a front plan view of an exemplary touch screen display in accordance with various embodiments of the present disclosure.

[0026] FIG. 4D depicts a front plan view of an exemplary touch screen display in accordance with various embodiments of the present disclosure.

[0027] FIG. 5A depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0028] FIG. 5B depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0029] FIG. 6A depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0030] FIG. 6B7A depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0031] FIG. 7A depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0032] FIG. 78A depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0033] FIG. 8A depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

-6la-929964 [0034] FIG. 8B depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

00 C1 [0035] FIG. 9A depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0036] FIG. 9B depicts a front plan view of an exemplary handheld electronic Sdevice in accordance with various embodiments of the present disclosure.

[0037] FIG. 9C depicts a front plan view of an exemplary handheld electronic Sdevice in accordance with various embodiments of the present disclosure.

[0038] FIG. 10A depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0039] FIG. 10B depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

[0040] FIG. 10C depicts a front plan view of an exemplary handheld electronic device in accordance with various embodiments of the present disclosure.

DETAILED DESCRIPTION [00411 Reference is now made to FIG. 1A, which depicts a perspective view with a partial cutaway of an exemplary display arrangement 100, in accordance with one embodiment of the present disclosure. In some embodiments, the display arrangement may be integral with an electronic device, while in other embodiments, the display arrangement may be a separate component that is communicatively coupled to an electronic device. The display arrangement 100 includes a display 1 and an optically transparent touch screen 120 positioned in front of the display 110.

The display 110 is configured to display a graphical user interface (GUI). The GUI may include graphical and textual elements representing the information and actions available to the user. The transparent touch screen 120 comprises an input device that -7la-929964 is sensitive to a user's touch, allowing a user to interact with the GUI on the display ;110. By way of example, the touch screen 120 may allow a user to move an input 00 pointer or make selections on the GUI by simply pointing at the GUI on the display 110.

[0042] In general, touch screens 120 recognize a touch event on the surface of the 00 touch screen 120 and thereafter output this information to a host device. The host Sdevice interprets the touch event and thereafter performs an action based on the touch event. In some embodiments, the host device may comprise a computer such as, for Sexample, a desktop computer, laptop computer, tablet computer, handheld computer, or wearable computer (such as on the wrist or arm, etc.). The host device may, however, comprise any of a number of types of devices, including, but not limited to, computers, PDAs, portable media players (such as audio players, video players, multimedia players, and the like), game consoles, smart phones, telephones or other communications devices, point-of-sale terminals, ATMs (automated teller machines), navigation devices, exercise monitors or other personal training devices, or other devices or combination of devices.

[0043] In one embodiment, the touch screen 120 includes a plurality of sensing elements 130. Each sensing element 130 "pixel") in an array of sensing elements a touch surface) generates an output signal indicative of the electric field disturbance (for capacitance sensors), force (for pressure sensors) or optical coupling (for optical sensors) at the sensor element. The ensemble of pixel values represents a "proximity image." As described herein, various embodiments of the disclosure address the ability to detect and discriminate between touch-surface signals (represented as a proximity image).

[0044] In some embodiments, the sensing elements may be based on self capacitance or mutual capacitance. In self capacitance, the "self' capacitance of a single electrode is measured as for example relative to ground. In mutual capacitance, the mutual capacitance between at least first and second electrodes is measured. In either case, each of the sensing elements works independently of the other sensing -8la-929964 00

(NI

[0045] While various embodiments described herein may be provided in the context of mutual capacitance touch-surface devices, variations using other types of touch-surfaces such as force or optical sensing touch-surfaces, etc., will be readily 0 apparent to those skilled in the art. Accordingly, the claims appended hereto are not intended to be limited by the disclosed embodiments, but are to be accorded their widest scope consistent with the principles and features disclosed herein.

c [00461 Unlike conventional touch screens, the touch screen 120 is capable of recognizing multiple types of touch inputs. The touch screen 120 allows for handling of different events depending on what is used to touch the touch screen. In accordance with various embodiments of the present disclosure, the touch screen 120 is capable of distinguishing between a contact made by a flesh surface 140 of a finger and a contact made by a non-flesh surface of the finger, such as a fingernail 150. The fingernail 150 may provide a more precise contact than a fleshy surface such as a fingertip. In other embodiments, the non-flesh surface may comprise an electrically insulative material of a suitable thickness coupled to the finger. For example, as depicted in FIG. IB, the non-flesh surface may comprise a rubber finger cap 160 or sleeve 170 having a suitable thickness. It has been found that a thickness in the range of approximately 0.5 mm to approximately 1 mm is suitable, although other thicknesses may be suitable. As another illustrative example, as depicted in FIG. 1C, the non-flesh surface may comprise an adhesive layer 180 having a suitable thickness.

The adhesive layer 180 may cover at least a portion of the flesh and may have a relatively small area, providing a more precise method of touching a touch surface.

As another example, the non-flesh surface may comprise a partially fingerless glove, a glove that is missing one or some of its fingers or fingertips. In some embodiments, at least one of the glove fingers may have an insulated fingertip area, and at least another of the glove fingers may lack a fingertip portion to allow at least one of the user's fingers to be uncovered. An uncovered finger may be used to drive a -9la-92996 4 pf first event system, one class of events, and a covered finger may be used to drive a second event system, a different class of events.

00 S[0047] Reference is now made to FIG. 2, which depicts an exemplary architecture diagram of a touch event delivery system in accordance with various embodiments of the present disclosure. A first architecture layer may be comprised of an imaging chip 00 200. A device driver 210 receives low-level event data from the imaging chip 200 0and provides an event record to a window server 220. The window server 220 converts the information into an event list which is dispatched to an application 230.

(1 [0048] While certain layers are depicted and described in connection with FIG. 2, it will be appreciated by one of skill in the art that various additional layers may be included and various layers maybe excluded in accordance with various embodiments of the present disclosure. In addition, various layers may be combined or separated into further layers. For example, in some embodiments, the imaging chip 200 may be eliminated, and its functions may be performed by the device driver 210.

[0049] The imaging chip 200 detects approaches, touches, and retreats by flesh surfaces and non-flesh surfaces. The imaging chip layer 200 may perform imaging functions, proximity processing, and thresholding as described further in one or more of the cross-referenced applications listed above and incorporated by reference herein.

In some embodiments, the imaging chip 200 may comprise a multi-touch sensor capable of detecting and distinguishing among various different types of input sources that may contact or be proximal to a touch surface, as described further in one or more of the cross-referenced applications listed above and incorporated by reference herein.

[0050] The device driver 210 receives event data from the imaging chip 200 and provides an event record to the window server 220. For example, data regarding whether an object is touching the touch surface may be provided. Furthermore, data regarding whether an object is in-range or out-of-range of a tracking area may be provided. The data may further include such items as how many fingers are detected, their locations, how hard they are pressing down, and many other items of information. In some embodiments, the device driver 210 comprises firmware. In la-929964 other embodiments, the device driver 210 may comprise hardware or software or a combination.

00 C [0051] In accordance with various embodiments of the present disclosure, various input states may be determined, and an expanded number of states may be achieved when a fleshy aspect and a non-fleshy aspect of a finger are used as distinguishable 00 00 inputs. For example, in addition to a down state (corresponding to, touching with flesh) and an up state (corresponding to, not touching with flesh), an in-range state (corresponding to, hovering while approaching the touch surface) and an Sout-of-range state (corresponding to, hovering while retreating away from the touch surface) may also be provided.

[00521 If tracking an object, a bit indicating whether the object is in-range or outof-range may be set to one (in-range) when the object is approaching a touch surface or hovering over the touch surface; the bit may be cleared (out-of-range) when the object is retreating away from the touch surface. Another bit (referred to as the "touch bit") may be used to indicate whether an object is in contact with the touch surface. In accordance with various embodiments of the present disclosure, ifa fleshy surface touches the touch surface, the touch bit may be set to one; however, ifa nonfleshy surface such as a fingernail touches the touch surface, then the touch bit may not be set, but the in-range bit will be set to one.

[00531 The window server 220 comprises software that receives the event record comprising the input state information from the device driver 210 and converts the received information into an event that the application layer 230 can handle. For example, ifa fleshy aspect of a finger touches the touch surface and is then lifted from the touch surface, the window server 220 may interpret and convert those down and up events to the following event list which can be handled by the application layer 230: object mouse, finger, hand, etc.) in-range; object down; object up; object out-of-range. In accordance with various embodiments of the present disclosure, an in-range event may be inserted before a down event, even if an in-range event was not 1II- Ia-929964

I

detected. In addition, an out-of-range event may be inserted after an up event, even if ;Z an out-of-range event was not detected.

00 r\ [0054] In accordance with various embodiments of the present disclosure, the input state information can be converted into the following types of events: EventLeftMouseDown the left mouse button has been pressed); 00 EventLeftMouseUp the left mouse button has been released); O EventMouseEntered the mouse cursor has entered a tracking area); EventMouseExited the mouse cursor has exited a tracking area); EventMouseMoved the mouse has moved without pressing a mouse button); and EventLeftMouseDragged the mouse has been moved while the left mouse button is pressed). Thus, in accordance with various embodiments of the present disclosure, mouse functionality can be achieved in an electronic device having a touch-surface input system, without the need for an actual mouse.

[0055] Reference is now made to FIGS. 3A 3D and 4A 4D, which depict several front plan views of a touch screen display arrangement 300. In the present example, a portion of a web page is displayed by a display 310. A first surface 320 of a user's finger 330 is used to interact with the touch screen 340. In the example shown in FIGS. 3A 3D, the first surface 320 of the finger 330 generally corresponds to a flesh surface of the finger 330. For example, the first surface 320 may generally correspond to the palmar (fingerprint) aspect of the finger 330.

10056] In FIG. 4A, however, a second surface 350 is used to interact with the touch screen 340. In the example shown in FIGS. 4A 4D, the second surface 350 generally corresponds to a non-flesh surface of the finger 330. For example, the second surface 350 may generally correspond to the dorsal (fingernail) aspect of the finger 330. In other embodiments, the second surface 350 may comprise an insulator material of a suitable thickness coupled to the finger 330. For example, the second surface 350 may comprise a rubber finger cap or sleeve having a suitable thickness.

As another illustrative example, the second surface 350 may comprise an adhesive layer applied to the finger 330. The second surface 350 of the finger 330 generates a -12la-929964

O

O

different kind of contact that can be distinguished from the first surface 320 of the ;finger 330.

00 0, [0057] Referring again to FIG. 3A, the first surface 320 of the finger 330 touches the touch screen 340 at time TI. The touch of the first surface 320 is detected and converted to a mouseDown event. Next, as shown in FIGS. 3B 3C, during time 00 period T2, the finger 330 is dragged leftward across the touch screen 340. The 0 dragging of the finger 330 is converted to a mouseDragged event. As the finger 330 Sis dragged across the touch screen 340, the presentation of the web page scrolls to the Sright. As a result, another portion of the web page is revealed, as illustrated in FIGS.

3B 3D. Finally, at time T3, the finger 330 is lifted away from the touch screen 340, which is detected and converted to a mouseUp event. Thus, as illustrated in this example, a flesh surface of the finger 330 can be used to drive a first event system.

As shown in the foregoing example, the first event system may be used to effect translational movement across a screen.

[0058] Referring now to FIG. 4A, the second surface 350 of the finger 330 touches the touch screen 340 at time T4. The touch of the second surface 350 is detected and is converted to a mouseEntered event. Next, during time period T5, the finger 330 is dragged leftward across the touch screen 340, as shown in FIGS. 4B 4C. The dragging of the finger 330 is converted to a mouseMoved event. As a result, a rollover (also referred to as a mouseover) menu 360 may be displayed, as illustrated in FIG. 4D. At time T6, the finger 330 is lifted away from the touch screen 340, which is detected and converted to a mouseExited event. Thus, the second surface 350 of the finger 330 the fingernail) can be used to drive a second event system.

As shown in the foregoing example, the second event system may comprise hover events, mouseEntered, mouseMoved, and MouseExited.

10059] As another illustrative example, in a maps application, while dragging with the first surface of the finger may be used to pan the map, dragging with the second surface of the finger may be used to make a zoom box, which zooms to show the contents of the box.

-13la-929964

L

[00601 As another illustrative example, the first surface of the finger may be used ;to move a text cursor. Dragging with the second surface of the finger may be used to 00 select text.

[00611 As another illustrative example, the second surface of the finger may be used drive tooltips. A tooltip (sometimes referred to as a screentip) is a GUI element 00 comprising text that provides information about a view. For example, a web browser Stooltip can be displayed when the second surface of the finger is in-range of a tracking area for a hyperlink.

,I [0062] As another illustrative example, tapping an application icon with the first surface of the finger may be used to launch an application, whereas dragging with the second surface of the finger may be used to configure an icon grid, reorder them, etc.

[0063] As yet another illustrative example, tapping with the second surface of the finger may be used to bring up an action menu. For example, tapping with the first surface of the finger on a row entry may be used to display the selected item. Tapping with the second surface of the finger may be used to display another set of actions, such as less frequently invoked actions. For example, as shown in FIG. 5A, tapping with the first surface of the finger on an SMS (short message service) message may be used to display the message, as shown in FIG. 5B. Tapping the message with the second surface of the finger, as shown in FIG. 6A, may be used to display various actions, such as, for example, reply, delete, or forward, etc., as shown in FIG. 6B.

[0064] As still another illustrative example, an on-screen keyboard, or soft keyboard, may be displayed on a touch screen display. Tapping on an on-screen keyboard key with the first surface of the finger may be used to type the lower case version of a letter, whereas tapping on the key with the second surface of the finger may be used to type the upper case version of the letter.

[00651 As yet another illustrative example, in an on-screen keyboard, tapping the shift key with the first surface of the finger may be used to enable caps for a single -14la-929964 letter, whereas tapping the shift key with the second surface of the finger may be used ;as a caps lock. Tapping the shift key again with the second surface of the finger may 00 be used to unlock caps.

[0066] As yet another illustrative example, in an on-screen keyboard, tapping on the delete key with the first surface of the finger may be used to delete the last letter, 00 whereas tapping on the delete key with the second surface of the finger may be used Sto delete the last word.

[00671 As yet another illustrative example, in a calendar application, tapping with ~the first surface of the finger on a "next" button to view the next item may be used to jump ahead by a day, whereas tapping on "next" with the second surface of the finger may be used tojump ahead by another unit, such as a week.

[00681 As yet another illustrative example, in a photo application, dragging with the first surface of the finger may be used to pan around an image, whereas dragging with the second surface of the finger may be used to show a crop UI.

[00691 As yet another illustrative example, in a mail, phone, address book, or other application having contact information, dragging with the first surface of the finger may be used to scroll through a list, as shown in FIGS. 7A 7B, whereas dragging with the second surface of the finger may be used to show a favorite phone number tooltip for each person the finger slides over for quick access, as shown in FIGS. 8A 8B.

[0070] As yet another illustrative example, in contacts, dragging with the second surface of the finger may be used to jump to the next letter in a list of contacts.

Likewise, in a media player application, dragging with the second surface of the finger may be used to jump to the next letter in a list of artists or titles. For example, if on As, as depicted in FIG. 9A, dragging with the second surface of the finger may be used to jump to Bs, as depicted in FIG. 9B, then to Cs, as depicted in FIG. 9C, and so on. Accordingly, advanced or accelerated navigation through a long list can be advantageously achieved.

a-9215la-929964 [0071] As still another illustrative example, in a phone application, tapping the ;delete key with the first surface of the finger can be used to delete one digit, whereas 00 tapping the delete key with the second surface of the finger can be used to delete the rwhole phone number.

[0072] As yet another illustrative example, in a media player application, while 00 playing a movie or song, or other audio or video content, dragging with the second surface of the finger may be used to scrub through the content, move the currently viewed or heard part of it backwards or forwards in order to locate something in it quickly, as depicted in FIGS. 10A [0073] The foregoing examples are provided as illustrative examples of uses in which a first surface of a finger can be used to drive a first event system and a second, distinguishable surface of a finger can be used to drive a second event system. In various embodiments, the first surface may generally correspond to a flesh surface of a finger, while the second surface may generally correspond to a non-flesh surface of a finger (such as a fingernail or finger cap, etc.), or vice versa. The examples provided in the present specification are examples only and are not intended to be exhaustive or limiting. Furthermore, additional gestures may be implemnented in accordance with the principles of the present disclosure. For example, a combination of finger surfaces may be used to implement additional gestures in connection with a multipoint touch screen which is capable of sensing multiple points at the same time.

The combination may comprise, for example, a combination of two or more flesh surfaces, a combination of two or more non-flesh surfaces, or a combination of at least one flesh surface and at least one non-flesh surface, etc.

[00741 Further modifications and alternative embodiments will be apparent to those skilled in the art in view of this disclosure. Accordingly, this description is to be construed as illustrative only and is for the purpose of teaching those skilled in the art the manner of carrying out the invention. It is to be understood that the forms of the invention herein shown and described are to be taken as exemplary embodiments.

Various modifications may be made without departing fromrn the scope of the -16- Ia-929964 P \OPER\DBVW\3O3lOOI 9 aend JOc2.2XOI0O 7 ;invention. For example, equivalent elements or materials may be substitute for those illustrated and described herein, and certain features of the invention may be utilized 00 independently of the use of other features, all as would be apparent to one skilled in the art after having the benefit of this description of the invention. In addition, the terms and 5 "an" are generally used in the present disclosure to mean one or more.

00 [00751 Throughout this specification and the claims which follow, unless the context requires otherwise, the word "comprise", and variations such as "comprises" and "comprising", will be understood to imply the inclusion of a stated integer or step or group N of integers or steps but not the exclusion of any other integer or step or group of integers or steps.

100761 The reference in this specification to any prior publication (or information derived from it), or to any matter which is known, is not, and should not be taken as an acknowledgment or admission or any form of suggestion that that prior publication (or information derived from it) or known matter forms part of the common general knowledge in the field of endeavour to which this specification relates.

-17-

Claims (4)

1- first operation; and O if the object comprises a fingernail, using the contact as a basis to effect a second operation.
2. The method of claim 1, wherein the first operation comprises scrolling and the second operation comprises text selection. -18- la-929964 b'13
3. A touch input system comprising: 00 a display device adapted to display a graphical user interface and operatively coupled to a touch-sensitive surface; a touch-distinguishing unit operatively coupled to the touch-sensitive surface such that the touch-distinguishing unit may distinguish a contact with the touch- 00 sensitive surface that comprises a fingernail from a contact that comprises a flesh aspect; a software module operatively coupled to touch-distinguishing unit so as to receive indications regarding the nature of a contact as comprising a flesh aspect or comprising a fingernail; and the software module also operatively coupled to the display device so as to effect a first operation on the graphical user interface when the contact comprises a fingernail and to effect a second operation on the graphical user interface when the contact comprises a flesh aspect.
4. A electronic device comprising: a display device adapted to provide a graphical user interface; and a touch-sensing module comprising a touch sensitive surface and operatively coupled to the display device so that the touch sensing module provides a first indication when a contact to the touch sensitive display has a fingernail aspect and provides a second indication when a contact to the touch sensitive display has a flesh aspect. The device of claim 4, wherein the first indication is associated with text selection and the second indication is associated with scrolling. -19- Ia-929964
AU2007100827A 2007-01-03 2007-08-28 Multi-event input system Expired AU2007100827B4 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US11/619,595 US7777732B2 (en) 2007-01-03 2007-01-03 Multi-event input system
US11/619,595 2007-01-03

Publications (2)

Publication Number Publication Date
AU2007100827A4 true AU2007100827A4 (en) 2007-09-27
AU2007100827B4 AU2007100827B4 (en) 2010-04-01

Family

ID=38577385

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2007100827A Expired AU2007100827B4 (en) 2007-01-03 2007-08-28 Multi-event input system

Country Status (8)

Country Link
US (1) US7777732B2 (en)
EP (1) EP1942399A1 (en)
CN (1) CN201156246Y (en)
AU (1) AU2007100827B4 (en)
DE (1) DE202007013923U1 (en)
HK (1) HK1105767A2 (en)
TW (1) TWM341257U (en)
WO (1) WO2008083362A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2056215A1 (en) * 2007-10-24 2009-05-06 LG Electronics Inc. Mobile terminal and controlling method thereof

Families Citing this family (120)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8508508B2 (en) 2003-02-14 2013-08-13 Next Holdings Limited Touch screen signal processing with single-point calibration
US8456447B2 (en) 2003-02-14 2013-06-04 Next Holdings Limited Touch screen signal processing
US7629967B2 (en) 2003-02-14 2009-12-08 Next Holdings Limited Touch screen signal processing
US7538759B2 (en) 2004-05-07 2009-05-26 Next Holdings Limited Touch panel display system with illumination and detection provided from a single edge
US8130203B2 (en) 2007-01-03 2012-03-06 Apple Inc. Multi-touch input discrimination
US7777732B2 (en) 2007-01-03 2010-08-17 Apple Inc. Multi-event input system
US7855718B2 (en) 2007-01-03 2010-12-21 Apple Inc. Multi-touch input discrimination
US7924271B2 (en) * 2007-01-05 2011-04-12 Apple Inc. Detecting gestures on multi-event sensitive devices
US20080168402A1 (en) 2007-01-07 2008-07-10 Christopher Blumenberg Application Programming Interfaces for Gesture Operations
EP2135155B1 (en) * 2007-04-11 2013-09-18 Next Holdings, Inc. Touch screen system with hover and click input methods
US8681104B2 (en) * 2007-06-13 2014-03-25 Apple Inc. Pinch-throw and translation gestures
AU2008280953A1 (en) 2007-08-30 2009-03-19 Next Holdings Ltd Optical touchscreen with improved illumination
WO2009029764A1 (en) 2007-08-30 2009-03-05 Next Holdings, Inc. Low profile touch panel systems
US20090082951A1 (en) * 2007-09-26 2009-03-26 Apple Inc. Intelligent Restriction of Device Operations
US8405636B2 (en) 2008-01-07 2013-03-26 Next Holdings Limited Optical position sensing system and optical position sensor assembly
KR101224588B1 (en) * 2008-01-24 2013-01-22 삼성전자주식회사 Method for providing UI to detect a multi-point stroke and multimedia apparatus thereof
US8717305B2 (en) * 2008-03-04 2014-05-06 Apple Inc. Touch event model for web pages
US8645827B2 (en) 2008-03-04 2014-02-04 Apple Inc. Touch event model
US8416196B2 (en) 2008-03-04 2013-04-09 Apple Inc. Touch event model programming interface
TWI373728B (en) * 2008-05-02 2012-10-01 Htc Corp Method and apparatus for browsing item information and recording medium using the same
US8174503B2 (en) 2008-05-17 2012-05-08 David H. Cain Touch-based authentication of a mobile device through user generated pattern creation
US8375336B2 (en) * 2008-05-23 2013-02-12 Microsoft Corporation Panning content utilizing a drag operation
DE102008032451C5 (en) * 2008-07-10 2017-10-19 Rational Ag Display method and cooking apparatus therefor
KR20100069842A (en) * 2008-12-17 2010-06-25 삼성전자주식회사 Electronic apparatus implementing user interface and method thereof
US8957865B2 (en) 2009-01-05 2015-02-17 Apple Inc. Device, method, and graphical user interface for manipulating a user interface object
US8751954B2 (en) * 2009-02-18 2014-06-10 Blackberry Limited System and method for scrolling information in a UI table
US9524094B2 (en) 2009-02-20 2016-12-20 Nokia Technologies Oy Method and apparatus for causing display of a cursor
JP5491043B2 (en) * 2009-02-25 2014-05-14 京セラ株式会社 Biometric authentication function with the data processing device
US9311112B2 (en) 2009-03-16 2016-04-12 Apple Inc. Event recognition
US8566045B2 (en) 2009-03-16 2013-10-22 Apple Inc. Event recognition
US8984431B2 (en) * 2009-03-16 2015-03-17 Apple Inc. Device, method, and graphical user interface for moving a current position in content at a variable scrubbing rate
US8285499B2 (en) 2009-03-16 2012-10-09 Apple Inc. Event recognition
US8224392B2 (en) * 2009-04-29 2012-07-17 Lg Electronics Inc. Mobile terminal capable of recognizing fingernail touch and method of controlling the operation thereof
US8355007B2 (en) 2009-05-11 2013-01-15 Adobe Systems Incorporated Methods for use with multi-touch displays for determining when a touch is processed as a mouse event
JP2011028524A (en) * 2009-07-24 2011-02-10 Toshiba Corp Information processing apparatus, program and pointing method
JP2011028555A (en) * 2009-07-27 2011-02-10 Sony Corp Information processor and information processing method
US8624933B2 (en) 2009-09-25 2014-01-07 Apple Inc. Device, method, and graphical user interface for scrolling a multi-section document
DE102009043719A1 (en) 2009-10-01 2011-04-07 Deutsche Telekom Ag A process for command input on a touch-sensitive surface
US8600698B2 (en) 2009-10-09 2013-12-03 Egalax—Empia Technology Inc. Method and device for analyzing positions
CN102043551B (en) * 2009-10-09 2013-05-08 禾瑞亚科技股份有限公司 Method and device for capacitive position detection
EP2500799A4 (en) 2009-10-09 2014-07-23 Egalax Empia Technology Inc Method and apparatus for converting sensing information
US9864471B2 (en) 2009-10-09 2018-01-09 Egalax_Empia Technology Inc. Method and processor for analyzing two-dimension information
TWI552024B (en) 2009-10-09 2016-10-01 Egalax Empia Technology Inc Method and device for analyzing two dimension sensing information
CN102043553B (en) 2009-10-09 2013-01-02 禾瑞亚科技股份有限公司 Method and device for analyzing position in mutual capacitance detection
CN102043509B (en) * 2009-10-09 2013-11-06 禾瑞亚科技股份有限公司 Method and apparatus for analyzing location
WO2011041947A1 (en) 2009-10-09 2011-04-14 禾瑞亚科技股份有限公司 Method and device of position detection
US8643613B2 (en) * 2009-10-09 2014-02-04 Egalax—Empia Technology Inc. Method and device for dual-differential sensing
KR101699735B1 (en) * 2009-10-26 2017-01-26 엘지전자 주식회사 Mobile terminal capable of receiving nail touch input and operation control method thereof
US20110138284A1 (en) * 2009-12-03 2011-06-09 Microsoft Corporation Three-state touch input system
EP2333651B1 (en) * 2009-12-11 2016-07-20 Dassault Systèmes Method and system for duplicating an object using a touch-sensitive display
CN101882050B (en) 2009-12-31 2011-09-21 联想(北京)有限公司 Display method and terminal
US8531412B1 (en) 2010-01-06 2013-09-10 Sprint Spectrum L.P. Method and system for processing touch input
US8581842B2 (en) * 2010-01-19 2013-11-12 Avaya Inc. Detection of a rolling motion or sliding motion of a body part on a surface
US8878791B2 (en) * 2010-01-19 2014-11-04 Avaya Inc. Event generation based on print portion identification
KR101319264B1 (en) * 2010-01-22 2013-10-18 전자부품연구원 Method for providing UI according to multi touch pressure and electronic device using the same
CN102135828B (en) * 2010-01-26 2012-12-12 禾瑞亚科技股份有限公司 Method and device for signal detection
US9684521B2 (en) 2010-01-26 2017-06-20 Apple Inc. Systems having discrete and continuous gesture recognizers
US9092125B2 (en) * 2010-04-08 2015-07-28 Avaya Inc. Multi-mode touchscreen user interface for a multi-state touchscreen device
US20110304557A1 (en) * 2010-06-09 2011-12-15 Microsoft Corporation Indirect User Interaction with Desktop using Touch-Sensitive Control Surface
US8552999B2 (en) 2010-06-14 2013-10-08 Apple Inc. Control selection approximation
US9626099B2 (en) 2010-08-20 2017-04-18 Avaya Inc. Multi-finger sliding detection using fingerprints to generate different events
KR101726607B1 (en) * 2010-10-19 2017-04-13 삼성전자주식회사 Method and apparatus for controlling screen in mobile terminal
US20120096349A1 (en) * 2010-10-19 2012-04-19 Microsoft Corporation Scrubbing Touch Infotip
DE102010048809A1 (en) 2010-10-20 2012-04-26 Hüttinger Elektronik Gmbh + Co. Kg Power supply system for a plasma application and / or induction heating applications
DE102010048810A1 (en) 2010-10-20 2012-04-26 Hüttinger Elektronik Gmbh + Co. Kg System for the operation of multiple plasma and / or induction heating processes
US20120137403A1 (en) * 2010-12-01 2012-06-07 John Bone Touch Screen Stay-Clean Finger Mitten
US20120256857A1 (en) * 2011-04-05 2012-10-11 Mak Genevieve Elizabeth Electronic device and method of controlling same
US8872773B2 (en) 2011-04-05 2014-10-28 Blackberry Limited Electronic device and method of controlling same
US20120256846A1 (en) * 2011-04-05 2012-10-11 Research In Motion Limited Electronic device and method of controlling same
US9298363B2 (en) 2011-04-11 2016-03-29 Apple Inc. Region activation for touch sensitive surface
US8975903B2 (en) 2011-06-09 2015-03-10 Ford Global Technologies, Llc Proximity switch having learned sensitivity and method therefor
US8928336B2 (en) 2011-06-09 2015-01-06 Ford Global Technologies, Llc Proximity switch having sensitivity control and method therefor
US8199126B1 (en) 2011-07-18 2012-06-12 Google Inc. Use of potential-touch detection to improve responsiveness of devices
US10004286B2 (en) 2011-08-08 2018-06-26 Ford Global Technologies, Llc Glove having conductive ink and method of interacting with proximity sensor
US8971572B1 (en) 2011-08-12 2015-03-03 The Research Foundation For The State University Of New York Hand pointing estimation for human computer interaction
US9143126B2 (en) 2011-09-22 2015-09-22 Ford Global Technologies, Llc Proximity switch having lockout control for controlling movable panel
US8624934B2 (en) * 2011-09-29 2014-01-07 Microsoft Corporation Dynamic display of icons on a small screen
US20130104278A1 (en) * 2011-11-02 2013-05-02 Taylor St. Llc Finger cover for operating capacitive touchscreen devices
US8994228B2 (en) 2011-11-03 2015-03-31 Ford Global Technologies, Llc Proximity switch having wrong touch feedback
US10112556B2 (en) 2011-11-03 2018-10-30 Ford Global Technologies, Llc Proximity switch having wrong touch adaptive learning and method
US8878438B2 (en) 2011-11-04 2014-11-04 Ford Global Technologies, Llc Lamp and proximity switch assembly and method
JP2013117890A (en) * 2011-12-05 2013-06-13 Sony Corp Electronic apparatus and operation method of electronic apparatus
US9116598B1 (en) 2012-01-10 2015-08-25 Koji Yoden User interface for use in computing device with sensitive display
US9037683B1 (en) 2012-03-05 2015-05-19 Koji Yoden Media asset streaming over network to devices
US9197206B2 (en) 2012-04-11 2015-11-24 Ford Global Technologies, Llc Proximity switch having differential contact surface
US8933708B2 (en) 2012-04-11 2015-01-13 Ford Global Technologies, Llc Proximity switch assembly and activation method with exploration mode
US9568527B2 (en) 2012-04-11 2017-02-14 Ford Global Technologies, Llc Proximity switch assembly and activation method having virtual button mode
US9184745B2 (en) 2012-04-11 2015-11-10 Ford Global Technologies, Llc Proximity switch assembly and method of sensing user input based on signal rate of change
US9660644B2 (en) 2012-04-11 2017-05-23 Ford Global Technologies, Llc Proximity switch assembly and activation method
US9831870B2 (en) 2012-04-11 2017-11-28 Ford Global Technologies, Llc Proximity switch assembly and method of tuning same
US9559688B2 (en) 2012-04-11 2017-01-31 Ford Global Technologies, Llc Proximity switch assembly having pliable surface and depression
US9944237B2 (en) 2012-04-11 2018-04-17 Ford Global Technologies, Llc Proximity switch assembly with signal drift rejection and method
US9219472B2 (en) 2012-04-11 2015-12-22 Ford Global Technologies, Llc Proximity switch assembly and activation method using rate monitoring
US9520875B2 (en) 2012-04-11 2016-12-13 Ford Global Technologies, Llc Pliable proximity switch assembly and activation method
US9287864B2 (en) 2012-04-11 2016-03-15 Ford Global Technologies, Llc Proximity switch assembly and calibration method therefor
US9065447B2 (en) 2012-04-11 2015-06-23 Ford Global Technologies, Llc Proximity switch assembly and method having adaptive time delay
US9531379B2 (en) 2012-04-11 2016-12-27 Ford Global Technologies, Llc Proximity switch assembly having groove between adjacent proximity sensors
US9136840B2 (en) 2012-05-17 2015-09-15 Ford Global Technologies, Llc Proximity switch assembly having dynamic tuned threshold
US8981602B2 (en) 2012-05-29 2015-03-17 Ford Global Technologies, Llc Proximity switch assembly having non-switch contact and method
US9337832B2 (en) 2012-06-06 2016-05-10 Ford Global Technologies, Llc Proximity switch and method of adjusting sensitivity therefor
US9641172B2 (en) 2012-06-27 2017-05-02 Ford Global Technologies, Llc Proximity switch assembly having varying size electrode fingers
US9678605B2 (en) 2012-06-28 2017-06-13 Synaptics Incorporated Systems and methods for switching sensing regimes for gloved and ungloved user input
US9024643B2 (en) 2012-06-28 2015-05-05 Synaptics Incorporated Systems and methods for determining types of user input
US8954878B2 (en) 2012-09-04 2015-02-10 Google Inc. Information navigation on electronic devices
CN103677595B (en) * 2012-09-07 2017-05-10 中兴通讯股份有限公司 The method of the touch species more hyperlinks, and a terminal device
US8922340B2 (en) 2012-09-11 2014-12-30 Ford Global Technologies, Llc Proximity switch based door latch release
US8796575B2 (en) 2012-10-31 2014-08-05 Ford Global Technologies, Llc Proximity switch assembly having ground layer
CN103869952B (en) * 2012-12-17 2018-06-26 富泰华工业(深圳)有限公司 Haptic feedback system and method for providing tactile feedback
CN104049933A (en) 2013-03-11 2014-09-17 联想(北京)有限公司 Information processing method and electronic equipment
US9311204B2 (en) 2013-03-13 2016-04-12 Ford Global Technologies, Llc Proximity interface development system having replicator and method
JP2014219841A (en) * 2013-05-08 2014-11-20 住友電工ネットワークス株式会社 Operation input device and operation input program
US9733716B2 (en) 2013-06-09 2017-08-15 Apple Inc. Proxy gesture recognizer
US9189114B2 (en) 2013-07-24 2015-11-17 Synaptics Incorporated Face detection with transcapacitive sensing
DE102014202710A1 (en) 2014-02-14 2015-08-20 Bayerische Motoren Werke Aktiengesellschaft Telephone module for managing conference calls
US10038443B2 (en) 2014-10-20 2018-07-31 Ford Global Technologies, Llc Directional proximity switch assembly
CN104407802B (en) * 2014-11-06 2017-08-25 深圳市华星光电技术有限公司 A method for multi-input and terminal events
KR20160071264A (en) * 2014-12-11 2016-06-21 엘지전자 주식회사 Mobile terminal and control method thereof
US9654103B2 (en) 2015-03-18 2017-05-16 Ford Global Technologies, Llc Proximity switch assembly having haptic feedback and method
US9548733B2 (en) 2015-05-20 2017-01-17 Ford Global Technologies, Llc Proximity sensor assembly having interleaved electrode configuration
US20170177204A1 (en) * 2015-12-18 2017-06-22 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Centering gesture to enhance pinch-to-zoom gesture on touchscreens

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4071691A (en) * 1976-08-24 1978-01-31 Peptek, Inc. Human-machine interface apparatus
EP0432139B1 (en) 1986-07-23 1997-05-28 Wacom Company, Ltd. Position designating device
JPH08292830A (en) 1995-04-24 1996-11-05 Wacom Co Ltd Position indicator
JPH09190268A (en) * 1996-01-11 1997-07-22 Canon Inc Information processor and method for processing information
US6249277B1 (en) * 1998-10-21 2001-06-19 Nicholas G. Varveris Finger-mounted stylus for computer touch screen
US20030067447A1 (en) * 2001-07-09 2003-04-10 Geaghan Bernard O. Touch screen with selective touch sources
US6882340B2 (en) 2001-10-19 2005-04-19 Wacom Co., Ltd. Electronic pen
US6690387B2 (en) 2001-12-28 2004-02-10 Koninklijke Philips Electronics N.V. Touch-screen image scrolling system and method
EP1483656A1 (en) 2002-01-31 2004-12-08 Nokia Corporation Method, system and device for distinguishing pointing means
JP2003344086A (en) * 2002-05-28 2003-12-03 Pioneer Electronic Corp Touch panel device and display input device for car
US7023427B2 (en) * 2002-06-28 2006-04-04 Microsoft Corporation Method and system for detecting multiple touches on a touch-sensitive screen
US7663607B2 (en) 2004-05-06 2010-02-16 Apple Inc. Multipoint touchscreen
US8479122B2 (en) * 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
FR2878344B1 (en) * 2004-11-22 2012-12-21 Sionnest Laurent Guyot Device commands and data input
JP2006345209A (en) * 2005-06-08 2006-12-21 Sony Corp Input device, information processing apparatus, information processing method, and program
US8139028B2 (en) 2006-02-01 2012-03-20 Synaptics Incorporated Proximity sensor and method for indicating extended interface results
US8279180B2 (en) 2006-05-02 2012-10-02 Apple Inc. Multipoint touch surface controller
US20070257891A1 (en) * 2006-05-03 2007-11-08 Esenther Alan W Method and system for emulating a mouse on a multi-touch sensitive surface
US8970502B2 (en) * 2006-05-26 2015-03-03 Touchtable Ab User identification for multi-user touch screens
US8441467B2 (en) * 2006-08-03 2013-05-14 Perceptive Pixel Inc. Multi-touch sensing display through frustrated total internal reflection
US8022941B2 (en) * 2006-10-12 2011-09-20 Disney Enterprises, Inc. Multi-user touch screen
US7777732B2 (en) 2007-01-03 2010-08-17 Apple Inc. Multi-event input system
JP2008197934A (en) * 2007-02-14 2008-08-28 Calsonic Kansei Corp Operator determining method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2056215A1 (en) * 2007-10-24 2009-05-06 LG Electronics Inc. Mobile terminal and controlling method thereof
US8217907B2 (en) 2007-10-24 2012-07-10 Lg Electronics Inc. Mobile terminal and controlling method thereof

Also Published As

Publication number Publication date
CN201156246Y (en) 2008-11-26
TWM341257U (en) 2008-09-21
HK1105767A2 (en) 2008-02-22
US20080158170A1 (en) 2008-07-03
EP1942399A1 (en) 2008-07-09
WO2008083362A1 (en) 2008-07-10
DE202007013923U1 (en) 2007-12-27
AU2007100827B4 (en) 2010-04-01
US7777732B2 (en) 2010-08-17

Similar Documents

Publication Publication Date Title
US10209877B2 (en) Touch screen device, method, and graphical user interface for moving on-screen objects without using a cursor
US9965165B2 (en) Multi-finger gestures
US9310994B2 (en) Use of bezel as an input mechanism
US9274682B2 (en) Off-screen gestures to create on-screen input
US9367205B2 (en) Radial menus with bezel gestures
CN104020850B (en) Using a multipoint sensing device gesture operation
US9836201B2 (en) Zoom-based gesture user interface
US9244544B2 (en) User interface device with touch pad enabling original image to be displayed in reduction within touch-input screen, and input-action processing method and program
US8250494B2 (en) User interface with parallax animation
JP5456529B2 (en) Method and computer system for operating a graphical user interface object
CN102645972B (en) Using the mobile computing device to enhance the interpretation of the input event generated when the computing device interaction
CN102754062B (en) Content display mode and a display having a means for rotating inspired, Method, and Graphical User Interface
US8466934B2 (en) Touchscreen interface
US8972903B2 (en) Using gesture to navigate hierarchically ordered user interface screens
US7889185B2 (en) Method, system, and graphical user interface for activating hyperlinks
JP4869135B2 (en) System to emulate the methods and mouse to emulate a mouse in a multi-touch sensitive screen computer implemented
JP5270537B2 (en) Multi-touch use, gesture and implementation
US8547353B2 (en) Method, system, and graphical user interface for displaying hyperlink information on a web page
CN103946766B (en) Based on light finger gesture user interface
KR101956082B1 (en) Device, method, and graphical user interface for selecting user interface objects
US9513798B2 (en) Indirect multi-touch interaction
EP2263134B1 (en) Communication terminals with superimposed user interface
JP5495553B2 (en) Selective rejection of touch contacts in the edge region of the touch surface
US8159469B2 (en) User interface for initiating activities in an electronic device
US8479122B2 (en) Gestures for touch sensitive input devices

Legal Events

Date Code Title Description
FGI Letters patent sealed or granted (innovation patent)
FF Certified innovation patent
MK22 Patent ceased section 143a(d), or expired - non payment of renewal fee or expiry