US20160224129A1 - Detecting a user input with an input device - Google Patents
Detecting a user input with an input device Download PDFInfo
- Publication number
- US20160224129A1 US20160224129A1 US15/095,537 US201615095537A US2016224129A1 US 20160224129 A1 US20160224129 A1 US 20160224129A1 US 201615095537 A US201615095537 A US 201615095537A US 2016224129 A1 US2016224129 A1 US 2016224129A1
- Authority
- US
- United States
- Prior art keywords
- touch
- mechanical control
- touch sensing
- sensing display
- input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/039—Accessories therefor, e.g. mouse pads
- G06F3/0393—Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0362—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 1D translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/039—Accessories therefor, e.g. mouse pads
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04101—2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04104—Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04106—Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
Definitions
- the invention relates to devices and methods for detecting user input, and more particularly, to an input device comprising a multi-touch sensing display.
- Modern electronic devices often use a plurality of control elements to allow a user to adjust parameters relevant to the operation of the device.
- An example of an input unit that may be used in an electronic device includes a console having a plurality of mechanical control elements.
- Such an input device may be used to control, for example, audio equipment, video equipment, or a central control station including, for example, a power plant, a factory, or a traffic system.
- Control elements employed in these systems include analog input elements.
- Analog input elements have a predefined function. Their function cannot be changed or adjusted once implemented limiting their application in the input unit.
- Control elements that operate using encoders such as for example, rotary encoders, are programmable as to their, function. However, in operation, it may be difficult or even impossible to determine the function that is assigned to the control element at any given time. It is even more difficult if the function and value of an associated parameter is displayed on a separate screen remote from the control element.
- Control elements that use encoders and other complex electromechanical input elements also tend to be relatively expensive and overly complex. Input units that use such electromechanical input elements must typically accommodate a fair amount of space underneath the cover plate of the input device, further adding to their cost and making them difficult to mount. Cost, expense and mounting difficulty present substantial problems for large input consoles that may include up to tens or hundreds of control elements.
- Touchscreens are input devices often implemented in compact electronic devices, such as personal digital assistant (PDA) or more recently mobile phones.
- Touchscreens may use one of several known technologies for detecting a touch or a near-touch to a surface.
- One example includes a resistive touchscreen panel composed of several layers. When the panel is touched, a change in the electrical current through the layers may be detected as a touch event.
- a controller may derive the position of the touch event on the panel based on the change in current, which is different at any given position.
- Other touchscreen technologies include capacitive touchscreen panels based on detecting a distortion of an electromagnetic field, or frustrated total internal reflection (FTIR). Some FTIR touchscreen panels use reflected light paths in which a reflection light path internal to a glass plate provides a sensitive surface.
- FTIR frustrated total internal reflection
- a disturbance to the light path may be detected by pressing an object against the surface.
- These touchscreens can be operated with objects like a finger or a pen.
- Some touchscreen panels may trigger input events upon a near touch.
- a capacitive touchscreen may trigger an input event if an object comes to within a predetermined distance of the touchscreen surface.
- Touchscreens were originally designed to detect a single touch at a time. Touchscreens have since evolved to detect simultaneous multiple touches as separate input events. Such multi-touch screens allow a user to use two or more fingers to simultaneously manipulate two or more objects. Despite their flexibility, multi-touch screens are not well-suited for applications involving setting a larger number of parameters. The screens are generally small in size and operated by one hand. The adjustment of a graphical control element on the touchscreen using for example a finger or a pen may demand substantial motor skills from a user and yet, still be rather imprecise. A graphical control element typically requires a substantial amount of space on the screen limiting the number of such elements displayed at any given time. A plurality of small control elements would be difficult and time-consuming to operate. Adjusting a plurality of parameters with a conventional touchscreen is thus not ergonomic, particularly if such adjustments are to be performed over a prolonged time.
- An input device for detecting user input.
- An example input device includes a multi-touch sensing display configured to detect multiple simultaneous triggers on a surface of the multi-touch sensing display as distinct input events.
- the input device also includes at least one mechanical control element arranged on the surface of the multi-touch sensing display.
- the at least one mechanical control element is configured to generate an input event.
- the input event is detected by the multi-touch sensing display in response to actuation of the at least one mechanical control element.
- a method for detecting user input with an input device is also provided.
- An example method may be implemented using an input device having a multi-touch sensing display adapted to detect multiple simultaneous touches or near touches to a surface of the multi-touch sensing display as distinct input events.
- the input device includes at least one mechanical control element arranged on the surface of the multi-touch sensing display.
- An example method includes generating an input event and detecting the input event by the multi-touch sensing display in response to an actuation of the at least one mechanical control element. A parameter associated with the at least one mechanical control element is then adjusted in accordance with the detected input event.
- FIG. 1 is a schematic diagram of an example of an input device.
- FIG. 2 is a schematic diagram of an example of an input device having a rotary knob as a mechanical control element.
- FIG. 3 is a schematic diagram of an example of an input device having a sliding controller as a mechanical control element.
- FIG. 4 is a schematic diagram of an example of an input device having a push button as a control element.
- FIG. 5 is a schematic diagram of an example of an input device using photosensitive elements for detecting actuation of a control element.
- FIG. 6 is a schematic diagram of an example of an input device using a capacitive element for triggering an input event.
- FIG. 7 is a flowchart illustrating operation of an example method for detecting multiple simultaneous touches or near touches of a multi-touch sensing device.
- FIG. 8 is a schematic diagram of an example of an audio console.
- FIG. 1 is a schematic diagram of an example of an input device 100 .
- the input device 100 includes a multi-touch sensing display 101 and two mechanical control elements illustrated in FIG. 1 as including two rotary knobs 102 and 103 .
- the rotary knobs 102 and 103 in FIG. 1 are fixedly mounted to a surface 104 of the multi-touch sensing display 101 .
- the multi-touch sensing display 101 includes an array of optical sensors or photosensitive elements represented in FIG. 1 as a line 105 .
- the multi-touch sensing display 101 may for example be a thin film transistor (TFT) LCD display.
- TFT LCD display includes integrated photosensitive elements. Such displays are known in the art.
- TFT LCD displays having integrated photosensitive elements include an article titled “Active matrix LCD with integrated optical touchscreen,” www.planar.com/advantages/whitepapers/docs/planar-AMLCD-Optical-Touchscre-en.pdf, which is incorporated by reference.
- Light emitted by the multi-touch sensing display 101 may be absorbed, scattered or reflected by trigger elements 106 and 107 . If one of the control elements 102 or 103 is actuated by turning, the intensity of light reflected onto photosensitive elements located underneath the trigger element 106 or 107 at the previous and the new position of the trigger element changes. The change in intensity generates an input event.
- Such an input event may be detected by the multi-touch sensing display 101 as a change of photocurrent, or a change of the current through the array of photosensitive elements 105 .
- the multi-touch sensing display 101 may be configured to include mechanisms for determining the position where the input event has occurred on its surface as well as for generating a position-dependent signal in response to an input event Such mechanisms may include a processor and other hardware and/or software suitably configured. Referring to FIG. 1 , the multi-touch sensing display 101 may therefore deliver signals corresponding to sensor data that may be used by a processing unit 108 to determine an occurrence and position of an input event. The multi-touch sensing display 101 may also directly deliver the position of a detected input event, such as for example, as two dimensional (for example, x and y) coordinates relative to the surface. The setting of the control element that generates the input event may then be determined by the processing unit 108 .
- the processing unit 108 is connected to provide the multi-touch sensing display 101 with processing resources.
- the processing unit 108 in FIG. 1 provides the display signal to the multi-touch sensing display 101 and reads out the state of the array of photosensitive elements of the multi-touch sensing display 101 .
- a readout of the array of photosensitive elements 105 may be performed at predetermined times. At such times, the processing unit 108 may obtain an image of light intensities detected by the photosensitive elements 105 at their respective positions on the surface 104 of display 101 .
- the processing unit 108 may analyze the image data to determine a position in the data at which a change in intensity occurred.
- the processing unit 108 may be provided with information that includes the type of control element located at a given position, and the function currently assigned to the respective control element.
- the processing unit 108 may determine the setting of the control element and assign a corresponding value to a parameter of the function controlled by the control element. It is to be understood that a particular setting of the control element need not correspond to a particular value of an associated parameter, but that activation of the control element by, for example, rotation through a particular angle may define a corresponding change of the parameter value.
- the actual position of trigger elements 106 and 107 may be detected by the photosensitive elements of the multi-touch sensing display 101 and determined by processing unit 108 .
- the input device 100 may detect simultaneous actuation of the control elements 102 and 103 as separate or distinct input events, which may involve resolving the positions relative to the surface at which the input events occurred.
- the input device 100 may also detect a touch or a near-touch to the surface 104 in areas of the multi-touch sensing display 101 that are not covered by the control elements or provided with the optical sensors.
- the processing unit 108 may also control the multi-touch sensing display 101 to display information, such as for example, the type and the value of the parameter controlled by the control element 102 or 103 .
- FIG. 1 shows an example implementation that uses optical sensors so that the surface 104 is made of a transparent material, such as glass. With a glass surface, the rotary knobs 102 and 103 may be mechanically mounted on the surface 104 using an adhesive, for example.
- the input device 100 in FIG. 1 is coupled to an audio mixing device 109 to allow the user to control parameters for operating the audio mixing device 109 .
- the values of parameters that may be adjusted using the control elements 102 and 103 are provided to the audio mixing device 109 .
- the audio mixing device 109 includes a plurality of audio inputs 110 and outputs 111 for communicating audio signals.
- the audio mixing device 109 processes the audio input signals 110 in accordance with parameters received from processing unit 108 . Audio mixing devices, such as for example, a digital mixer, are known in the art and require no further description.
- the example input device 100 in FIG. 1 has been described as including the multi-touch sensing display 101 having optical sensors 105 , however, other types of touchscreens may be used as well. For example, capacitive or resistive touchscreen panels may also be used. Parameter values may also be provided to any type of device by the processing unit 108 . For example, parameters may be relevant to a control station for a machine, a power plant, or any other electronic device, such as a computer or a station for video processing, or any other device connected to the input device 100 .
- the multi-touch sensing display 101 of input device 100 may display information relating to the function controlled by a control element as well as data and information provided by a device connected to the input device 100 .
- FIG. 2 is a schematic diagram of an example of an input device having a rotary knob 201 as a mechanical control element.
- the rotary knob 201 may be turned in two directions as indicated by arrow 202 .
- the rotary knob 201 includes a movable component 203 and a shaft with a base 204 fixedly mounted to a surface 205 of the multi-touch sensing display 206 .
- the shaft and base 204 are mounted by an adhesive to surface 205 .
- the moveable component 203 rotates on the shaft 205 . This rotation moves the trigger element 207 in a plane substantially parallel to the surface 205 .
- the distance between the trigger element 207 and the surface 205 is determine to permit detection of the position of the trigger element 207 by the multi-touch sensing display 206 .
- the turning of the rotary knob 201 generates subsequent input events at positions lying on a circle around the rotary axis 208 of the rotary knob 201 .
- FIG. 3 is a schematic diagram of an example of an input device using a sliding controller 301 as a mechanical control element.
- the sliding controller 301 includes a movable component 303 that slides linearly in a direction horizontal with respect to a surface 305 of the multi-touch sensing display 306 (along arrow 302 ).
- the moveable component 303 is movable within a support structure 304 that is fixedly mounted to the surface 305 .
- the support structure 304 may be mounted to the surface 305 using a variety of techniques and fixing components including gluing or cementing: engaging elements of the support structure 304 with a recess formed on the surface 305 ; providing one or more holes through the multi-touch sensing display 306 to attach the support structure 305 using bolts, screws, and the like.
- Actuation of the control element by moving the sliding control 301 , results in a movement of a trigger element 307 fixed to the movable component 303 in a horizontal direction relative to the surface 305 .
- the spacing between the trigger element 307 and the surface 305 is again determined to permit detection of the trigger element 307 by the multi-touch sensing display 306 . The spacing will depend on the particular detection mechanism employed.
- the trigger element 307 When using optical sensors or a capacitive touch screen panel, the trigger element 307 may not touch surface 305 . When using a resistive touchscreen panel or a method based on total internal reflection, the trigger element 307 may touch the surface 305 . Actuation of the sliding control 301 results in the generation of input events at positions on the surface 305 along a line. The movement of the sliding controller 301 may be inferred by detecting the positions of the input events. A value of an associated parameter may then be changed accordingly.
- FIG. 4 is a schematic diagram of an example of an input device using a push button 401 as a control element.
- the push button 401 includes a movable component 403 that moves in a direction indicated by arrow 402 , which is substantially perpendicular to a surface 405 of the multi-touch sensing display 406 .
- a trigger element 407 is mounted on the movable component 403 a variable distance to the surface 405 , the distance varied by moving the movable component 403 .
- the movable component 403 of the push button 401 is supported by a supporting structure 404 fixedly mounted to surface 405 .
- the push button 401 is actuated by applying pressure to the movable component 403 .
- the distance between the trigger element 407 and the surface 405 is decreased eventually triggering an input event.
- the distance between the trigger element 407 and the surface 405 depends on the specific multi-touch sensing display 406 , on a first distance to an un-pushed state and a second distance to a pushed state.
- a calibrating procedure may be implemented to adjust the first and second distances.
- the intensity of light detected by optical sensors underneath the surface 405 may increase or decrease in the pushed position, without having the trigger element 407 touch the surface 405 .
- the multi-touch sensing display 406 may still be able to determine the position of the trigger element 407 .
- the distance to the surface 405 is sufficient to allow the trigger element 407 to generate an input event when the push button 401 is actuated.
- FIG. 5 is a schematic diagram of an example of an input device 500 using photosensitive elements for detecting actuation of a control element.
- the input device 500 of FIG. 5 includes a control element implemented as a rotary knob 501 .
- the rotary knob 501 is mounted to a surface 502 of a multi-touch sensing display 503 .
- the multi-touch sensing display 503 includes photosensitive pixels 505 (shown as black squares) and display pixels 506 (shown as white squares).
- the display pixels 506 emit light, as indicated by arrows when displaying an image. The emitted light is reflected by a reflective trigger element 504 mounted to the rotary knob 501 .
- the reflected light is detected by the photosensitive pixels 505 (as indicated by the arrows received by the photosensitive pixels 505 ).
- the position of the reflective trigger element 504 relative to the surface 502 may be detected by the photosensitive pixels 505 and determined by reading out the detected intensity values and analyzing the intensity distribution.
- the remaining surface of the rotary knob 501 facing surface 502 may be non-reflective, or light absorptive, for the light emitted by the multi-touch sensing display 503 .
- the emission of light by the display pixels 506 located in the area of the surface 502 over which the trigger element 504 may be moved may be controlled such that the display pixels 505 emit light with a predetermined intensity, for example, near maximum intensity, so that a high signal may be received from photosensitive pixels 505 , and the position of the trigger element may be precisely determined. It is to be understood that other implementations are also possible, such as providing an absorptive trigger element and a reflective surface of the control element 501 facing the surface 502 of the display 503 .
- FIG. 6 is a schematic diagram of an example of an input device 600 using a capacitive element for triggering an input event.
- the input device 600 includes at least one control element implemented in FIG. 6 as a rotary knob 601 .
- the multi-touch sensing display 603 includes a capacitive touch-screen panel having a capacitance sensitive layer 605 .
- Capacitive multi-touch sensing displays are known to those of ordinary skill in the art and will not be explained in further detail. More details on the operation of a capacitive multipoint touchscreen can be found, for example, the US Patent Publication US 2006/00917991 A1, which is incorporated by reference in its entirety.
- a conventional capacitive touchscreen panel may for example include a capacitive sensing layer of a metal oxide, such as indium tin oxide, which conducts an electrical current across the sensor panel.
- the current is applied by electrodes on each corner of the panel, in one example, with a square wave signal.
- a charge transport occurs, which can be measured as a current at the corners of the panel.
- the position of the touch event may be determined by evaluating the resulting currents at the corners of the panel.
- the touchscreen panel may include a plurality of transparent sensor nodes which may again be formed of a conductive medium such as a metal oxide, spatially separated into electrodes and traces.
- a capacitive trigger element 604 is provided to trigger an input event.
- the trigger element 604 disturbs an electrical field established adjacent to a sensing node of capacitive sensitive layer 605 at a position underneath the trigger element 604 .
- the disturbance may be detected as a change in capacitance at the sensing node.
- the position of the trigger element 604 relative to the surface 602 may then be determined.
- Actuation of the control element 601 results in a change of capacitance of another sensing node, which again generates an input event at a position relative to surface 602 , which can be determined by a capacitive sensing circuit.
- the capacitive trigger element 604 may be grounded, or may be grounded when a user touches the control element 601 .
- the sensing nodes of the capacitive multi-touch sensing panel may also be arranged to achieve a high resolution of the positioning of trigger element 604 . For example, high resolution may be achieved by closely spacing the sensing nodes in proximity to the control element.
- multi-touch sensing display 603 is capable of sensing a simultaneous actuation of the control element 601 and a touch to the surface 602 while also displaying information.
- FIG. 7 is a flowchart illustrating operation of an example method for detecting multiple simultaneous touches or near touches of a multi-touch sensing device.
- the method may be performed using the input device of FIG. 1 or FIG. 5 .
- two control elements are actuated simultaneously. It is to be understood that these elements may be any type of control elements, such as rotary knobs, sliders, rockers, push buttons, and similar devices.
- trigger elements of the control elements are moved relative to the display surface at step 702 .
- Optical sensors located in the display may detect light emitted by the display and reflected by the trigger elements.
- the movement of the trigger element results in a change in the intensity of the light detected by the optical sensors, which is detected in step 703 .
- the locations or positions on the display at which the intensity changes occurred may be determined in step 704 .
- a new setting for each control element is determined in step 705 on the basis of the respective intensity change and its location. For example, it may be determined that a slider was moved a particular distance or that a rotary knob was turned through a particular angle. Alternatively, the absolute setting of the control element may be determined, such as for example, a new position of a slider or of a rotary knob.
- a new value for a parameter associated with the control element is then calculated in step 706 on the basis of the derived new setting for each control element.
- a particular switching function may have been assigned to a push button, and an associated parameter value may be changed from ‘1’ to signify an ‘ON’ position to a ‘0’ to signify an ‘OFF’ position upon actuation.
- the parameter value may also be adjusted according to a determined travel distance or turn angle of a control element, or to the determined absolute new setting of the control element.
- the parameters with their values are then provided to a device connected to the input device in step 707 . It is to be understood that the above method may include additional steps, such as for example a step of detecting a touch to a surface adjacent to a control element and adjusting a parameter on the basis of the detected touch, or changing the function of a control element in accordance with a position of a detected touch.
- Graphical control elements may also be provided and functions of the mechanical control elements changed accordingly.
- FIG. 8 is a schematic diagram of an example of an audio console 800 .
- the audio console 800 in FIG. 8 includes two input devices 801 and 802 .
- the input device 801 of audio console 800 includes a plurality of mechanical control elements implemented as rotary buttons 803 .
- the input devices 801 and 802 are shown in a view from above, as indicated by arrow 205 in FIG. 2 .
- the portions of input devices 801 and 802 that are visible to a user are touch-sensitive and are configured to display information.
- the input device 801 includes areas 804 , 805 and 806 adjacent to rotary knobs 803 .
- the areas 804 , 805 , 806 may be used to display the type of parameter and the parameter value that is currently being adjusted by the respective rotary knob 803 .
- area 804 indicates the adjustment of a numerical value for a particular channel
- area 805 indicates the adjustment of a high frequency equalizer using a needle indicator
- area 806 indicates the adjustment of a bandwidth.
- the input device 802 includes sliding controls 807 and 808 , which may be for example, faders, with graphical indications on a channel to be adjusted and of a present setting provided next to them.
- the input device 802 includes push buttons 809 and 810 with their present setting indicated graphically in an area adjacent to them.
- control elements 807 to 810 are mechanical control elements, it is to be understood that some of these may also be implemented as graphical control elements, which may be actuated by touching the surface of input device 802 at a position where the control element is displayed.
- input devices may also be used in other devices such as control stations of a factory or a power plant.
- multi-touch sensing displays are not limited to those described above.
- Other types of displays may be used, such as for example, infrared touchscreen panels, strain gauge touchscreen panels, surface acoustic wave or diffused laser imaging touchscreen panels, and the like. These panels should be adapted in a manner similar to the examples described above to recognize multiple simultaneous touches.
- one or more processes, sub-processes, or process steps described in connection with FIGS. 1-8 may be performed by hardware and/or software under the control of a processor, such as processing unit 108 in FIG. 1 . If the process is performed by software, the software may reside in software memory (not shown) in a suitable electronic processing component or system such as the processing unit 108 in FIG. 1 .
- the software in software memory may include an ordered listing of executable instructions for implementing logical functions (that is, “logic” that may be implemented either in digital form such as digital circuitry or source code or in analog form such as analog circuitry or an analog source such an analog electrical, sound or video signal), and may selectively be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that may selectively fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions.
- a “computer-readable medium” is any means that may contain, store or communicate the program for use by or in connection with the instruction execution system, apparatus, or device.
- the computer readable medium may selectively be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device. More specific examples, but nonetheless a non-exhaustive list, of computer-readable media would include the following: a portable computer diskette (magnetic), a RAM (electronic), a read-only memory “ROM” (electronic), an erasable programmable read-only memory (EPROM or Flash memory) (electronic) and a portable compact disc read-only memory “CDROM” (optical).
- the computer-readable medium may even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
- Liquid Crystal Display Device Control (AREA)
Abstract
An input device and methods for detecting user input using an input device. An example input device includes a multi-touch sensing display configured to detect multiple simultaneous triggers on a surface of the multi-touch sensing display as distinct input events. The input device also includes at least one mechanical control element arranged on the surface of the multi-touch sensing display. The at least one mechanical control element is configured to generate an input event. The input event is detected by the multi-touch sensing display in response to actuation of the at least one mechanical control element.
Description
- This application is a continuation of U.S. application Ser. No. 12/621,388 filed Nov. 18, 2009, now U.S. Pat. No. ______, which, in turn, claims priority to European Patent application Serial No. 08 020 092.6 filed Nov. 18, 2008, the disclosures of which are hereby incorporated in their entirety by reference herein.
- 1. Field of the Invention
- The invention relates to devices and methods for detecting user input, and more particularly, to an input device comprising a multi-touch sensing display.
- 2. Related Art
- Modern electronic devices often use a plurality of control elements to allow a user to adjust parameters relevant to the operation of the device. An example of an input unit that may be used in an electronic device includes a console having a plurality of mechanical control elements. Such an input device may be used to control, for example, audio equipment, video equipment, or a central control station including, for example, a power plant, a factory, or a traffic system. Control elements employed in these systems include analog input elements.
- Analog input elements have a predefined function. Their function cannot be changed or adjusted once implemented limiting their application in the input unit. Control elements that operate using encoders, such as for example, rotary encoders, are programmable as to their, function. However, in operation, it may be difficult or even impossible to determine the function that is assigned to the control element at any given time. It is even more difficult if the function and value of an associated parameter is displayed on a separate screen remote from the control element. Control elements that use encoders and other complex electromechanical input elements also tend to be relatively expensive and overly complex. Input units that use such electromechanical input elements must typically accommodate a fair amount of space underneath the cover plate of the input device, further adding to their cost and making them difficult to mount. Cost, expense and mounting difficulty present substantial problems for large input consoles that may include up to tens or hundreds of control elements.
- Touchscreens are input devices often implemented in compact electronic devices, such as personal digital assistant (PDA) or more recently mobile phones. Touchscreens may use one of several known technologies for detecting a touch or a near-touch to a surface. One example includes a resistive touchscreen panel composed of several layers. When the panel is touched, a change in the electrical current through the layers may be detected as a touch event. A controller may derive the position of the touch event on the panel based on the change in current, which is different at any given position. Other touchscreen technologies include capacitive touchscreen panels based on detecting a distortion of an electromagnetic field, or frustrated total internal reflection (FTIR). Some FTIR touchscreen panels use reflected light paths in which a reflection light path internal to a glass plate provides a sensitive surface. A disturbance to the light path may be detected by pressing an object against the surface. These touchscreens can be operated with objects like a finger or a pen. Some touchscreen panels may trigger input events upon a near touch. For example, a capacitive touchscreen may trigger an input event if an object comes to within a predetermined distance of the touchscreen surface.
- Touchscreens were originally designed to detect a single touch at a time. Touchscreens have since evolved to detect simultaneous multiple touches as separate input events. Such multi-touch screens allow a user to use two or more fingers to simultaneously manipulate two or more objects. Despite their flexibility, multi-touch screens are not well-suited for applications involving setting a larger number of parameters. The screens are generally small in size and operated by one hand. The adjustment of a graphical control element on the touchscreen using for example a finger or a pen may demand substantial motor skills from a user and yet, still be rather imprecise. A graphical control element typically requires a substantial amount of space on the screen limiting the number of such elements displayed at any given time. A plurality of small control elements would be difficult and time-consuming to operate. Adjusting a plurality of parameters with a conventional touchscreen is thus not ergonomic, particularly if such adjustments are to be performed over a prolonged time.
- Accordingly, there is a need for an ergonomic input device that allows for flexible precise adjustment of parameters and that informs a user of the parameter being adjusted.
- In view of the above, an input device is provided for detecting user input. An example input device includes a multi-touch sensing display configured to detect multiple simultaneous triggers on a surface of the multi-touch sensing display as distinct input events. The input device also includes at least one mechanical control element arranged on the surface of the multi-touch sensing display. The at least one mechanical control element is configured to generate an input event. The input event is detected by the multi-touch sensing display in response to actuation of the at least one mechanical control element.
- A method for detecting user input with an input device is also provided. An example method may be implemented using an input device having a multi-touch sensing display adapted to detect multiple simultaneous touches or near touches to a surface of the multi-touch sensing display as distinct input events. The input device includes at least one mechanical control element arranged on the surface of the multi-touch sensing display. An example method includes generating an input event and detecting the input event by the multi-touch sensing display in response to an actuation of the at least one mechanical control element. A parameter associated with the at least one mechanical control element is then adjusted in accordance with the detected input event.
- Those skilled in the art will appreciate that the features mentioned above and those yet to be explained below can be used not only in the respective combinations indicated, but also in other combinations or in isolation, without leaving the scope of the present invention. The above-described methods may be implemented in a device for processing audio signals, or examples implementations may include steps described with respect to the device for processing audio signals.
- Other devices, apparatus, systems, methods, features and advantages of the invention will be or will become apparent to one with skill in the art upon examination of the following figures and detailed description. It is intended that all such additional systems, methods, features and advantages be included within this description, be within the scope of the invention, and be protected by the accompanying claims.
- Example implementations of the invention are described below with reference to the following figures. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention. In the figures, like reference numerals designate corresponding parts throughout the different views.
-
FIG. 1 is a schematic diagram of an example of an input device. -
FIG. 2 is a schematic diagram of an example of an input device having a rotary knob as a mechanical control element. -
FIG. 3 is a schematic diagram of an example of an input device having a sliding controller as a mechanical control element. -
FIG. 4 is a schematic diagram of an example of an input device having a push button as a control element. -
FIG. 5 is a schematic diagram of an example of an input device using photosensitive elements for detecting actuation of a control element. -
FIG. 6 is a schematic diagram of an example of an input device using a capacitive element for triggering an input event. -
FIG. 7 is a flowchart illustrating operation of an example method for detecting multiple simultaneous touches or near touches of a multi-touch sensing device. -
FIG. 8 is a schematic diagram of an example of an audio console. -
FIG. 1 is a schematic diagram of an example of aninput device 100. Theinput device 100 includes amulti-touch sensing display 101 and two mechanical control elements illustrated inFIG. 1 as including tworotary knobs FIG. 1 are fixedly mounted to asurface 104 of themulti-touch sensing display 101. Below thesurface 104, themulti-touch sensing display 101 includes an array of optical sensors or photosensitive elements represented inFIG. 1 as aline 105. Themulti-touch sensing display 101 may for example be a thin film transistor (TFT) LCD display. The TFT LCD display includes integrated photosensitive elements. Such displays are known in the art. Documents describing TFT LCD displays having integrated photosensitive elements include an article titled “Active matrix LCD with integrated optical touchscreen,” www.planar.com/advantages/whitepapers/docs/planar-AMLCD-Optical-Touchscre-en.pdf, which is incorporated by reference. Light emitted by themulti-touch sensing display 101 may be absorbed, scattered or reflected bytrigger elements control elements trigger element multi-touch sensing display 101 as a change of photocurrent, or a change of the current through the array ofphotosensitive elements 105. - It is to be understood that the
multi-touch sensing display 101 may be configured to include mechanisms for determining the position where the input event has occurred on its surface as well as for generating a position-dependent signal in response to an input event Such mechanisms may include a processor and other hardware and/or software suitably configured. Referring toFIG. 1 , themulti-touch sensing display 101 may therefore deliver signals corresponding to sensor data that may be used by aprocessing unit 108 to determine an occurrence and position of an input event. Themulti-touch sensing display 101 may also directly deliver the position of a detected input event, such as for example, as two dimensional (for example, x and y) coordinates relative to the surface. The setting of the control element that generates the input event may then be determined by theprocessing unit 108. - The
processing unit 108 is connected to provide themulti-touch sensing display 101 with processing resources. Theprocessing unit 108 inFIG. 1 provides the display signal to themulti-touch sensing display 101 and reads out the state of the array of photosensitive elements of themulti-touch sensing display 101. A readout of the array ofphotosensitive elements 105 may be performed at predetermined times. At such times, theprocessing unit 108 may obtain an image of light intensities detected by thephotosensitive elements 105 at their respective positions on thesurface 104 ofdisplay 101. Theprocessing unit 108 may analyze the image data to determine a position in the data at which a change in intensity occurred. Theprocessing unit 108 may be provided with information that includes the type of control element located at a given position, and the function currently assigned to the respective control element. By determining the position of an input event and the position of the trigger element relative to thesurface 104, theprocessing unit 108 may determine the setting of the control element and assign a corresponding value to a parameter of the function controlled by the control element. It is to be understood that a particular setting of the control element need not correspond to a particular value of an associated parameter, but that activation of the control element by, for example, rotation through a particular angle may define a corresponding change of the parameter value. - The actual position of
trigger elements multi-touch sensing display 101 and determined by processingunit 108. Theinput device 100 may detect simultaneous actuation of thecontrol elements input device 100 may also detect a touch or a near-touch to thesurface 104 in areas of themulti-touch sensing display 101 that are not covered by the control elements or provided with the optical sensors. Theprocessing unit 108 may also control themulti-touch sensing display 101 to display information, such as for example, the type and the value of the parameter controlled by thecontrol element respective control element FIG. 1 shows an example implementation that uses optical sensors so that thesurface 104 is made of a transparent material, such as glass. With a glass surface, therotary knobs surface 104 using an adhesive, for example. - The
input device 100 inFIG. 1 is coupled to anaudio mixing device 109 to allow the user to control parameters for operating theaudio mixing device 109. For example, the values of parameters that may be adjusted using thecontrol elements audio mixing device 109. Theaudio mixing device 109 includes a plurality ofaudio inputs 110 andoutputs 111 for communicating audio signals. Theaudio mixing device 109 processes the audio input signals 110 in accordance with parameters received from processingunit 108. Audio mixing devices, such as for example, a digital mixer, are known in the art and require no further description. - The
example input device 100 inFIG. 1 has been described as including themulti-touch sensing display 101 havingoptical sensors 105, however, other types of touchscreens may be used as well. For example, capacitive or resistive touchscreen panels may also be used. Parameter values may also be provided to any type of device by theprocessing unit 108. For example, parameters may be relevant to a control station for a machine, a power plant, or any other electronic device, such as a computer or a station for video processing, or any other device connected to theinput device 100. Themulti-touch sensing display 101 ofinput device 100 may display information relating to the function controlled by a control element as well as data and information provided by a device connected to theinput device 100. -
FIG. 2 is a schematic diagram of an example of an input device having arotary knob 201 as a mechanical control element. Therotary knob 201 may be turned in two directions as indicated byarrow 202. Therotary knob 201 includes amovable component 203 and a shaft with a base 204 fixedly mounted to asurface 205 of themulti-touch sensing display 206. The shaft andbase 204 are mounted by an adhesive to surface 205. Themoveable component 203 rotates on theshaft 205. This rotation moves thetrigger element 207 in a plane substantially parallel to thesurface 205. The distance between thetrigger element 207 and thesurface 205 is determine to permit detection of the position of thetrigger element 207 by themulti-touch sensing display 206. The turning of therotary knob 201 generates subsequent input events at positions lying on a circle around therotary axis 208 of therotary knob 201. -
FIG. 3 is a schematic diagram of an example of an input device using a slidingcontroller 301 as a mechanical control element. The slidingcontroller 301 includes amovable component 303 that slides linearly in a direction horizontal with respect to asurface 305 of the multi-touch sensing display 306 (along arrow 302). Themoveable component 303 is movable within asupport structure 304 that is fixedly mounted to thesurface 305. As described above with reference toFIG. 1 , thesupport structure 304 may be mounted to thesurface 305 using a variety of techniques and fixing components including gluing or cementing: engaging elements of thesupport structure 304 with a recess formed on thesurface 305; providing one or more holes through themulti-touch sensing display 306 to attach thesupport structure 305 using bolts, screws, and the like. Actuation of the control element, by moving the slidingcontrol 301, results in a movement of atrigger element 307 fixed to themovable component 303 in a horizontal direction relative to thesurface 305. The spacing between thetrigger element 307 and thesurface 305 is again determined to permit detection of thetrigger element 307 by themulti-touch sensing display 306. The spacing will depend on the particular detection mechanism employed. When using optical sensors or a capacitive touch screen panel, thetrigger element 307 may not touchsurface 305. When using a resistive touchscreen panel or a method based on total internal reflection, thetrigger element 307 may touch thesurface 305. Actuation of the slidingcontrol 301 results in the generation of input events at positions on thesurface 305 along a line. The movement of the slidingcontroller 301 may be inferred by detecting the positions of the input events. A value of an associated parameter may then be changed accordingly. -
FIG. 4 is a schematic diagram of an example of an input device using apush button 401 as a control element. Thepush button 401 includes amovable component 403 that moves in a direction indicated byarrow 402, which is substantially perpendicular to asurface 405 of themulti-touch sensing display 406. Atrigger element 407 is mounted on the movable component 403 a variable distance to thesurface 405, the distance varied by moving themovable component 403. Themovable component 403 of thepush button 401 is supported by a supportingstructure 404 fixedly mounted tosurface 405. Thepush button 401 is actuated by applying pressure to themovable component 403. The distance between thetrigger element 407 and thesurface 405 is decreased eventually triggering an input event. The distance between thetrigger element 407 and thesurface 405 depends on the specificmulti-touch sensing display 406, on a first distance to an un-pushed state and a second distance to a pushed state. A calibrating procedure may be implemented to adjust the first and second distances. In one example, the intensity of light detected by optical sensors underneath thesurface 405 may increase or decrease in the pushed position, without having thetrigger element 407 touch thesurface 405. In the non-actuated state, themulti-touch sensing display 406 may still be able to determine the position of thetrigger element 407. The distance to thesurface 405 is sufficient to allow thetrigger element 407 to generate an input event when thepush button 401 is actuated. -
FIG. 5 is a schematic diagram of an example of aninput device 500 using photosensitive elements for detecting actuation of a control element. Theinput device 500 ofFIG. 5 includes a control element implemented as arotary knob 501. Therotary knob 501 is mounted to asurface 502 of amulti-touch sensing display 503. Themulti-touch sensing display 503 includes photosensitive pixels 505 (shown as black squares) and display pixels 506 (shown as white squares). Thedisplay pixels 506 emit light, as indicated by arrows when displaying an image. The emitted light is reflected by areflective trigger element 504 mounted to therotary knob 501. The reflected light is detected by the photosensitive pixels 505 (as indicated by the arrows received by the photosensitive pixels 505). The position of thereflective trigger element 504 relative to thesurface 502 may be detected by thephotosensitive pixels 505 and determined by reading out the detected intensity values and analyzing the intensity distribution. As shown inFIG. 5 , the remaining surface of therotary knob 501 facingsurface 502 may be non-reflective, or light absorptive, for the light emitted by themulti-touch sensing display 503. The emission of light by thedisplay pixels 506 located in the area of thesurface 502 over which thetrigger element 504 may be moved may be controlled such that thedisplay pixels 505 emit light with a predetermined intensity, for example, near maximum intensity, so that a high signal may be received fromphotosensitive pixels 505, and the position of the trigger element may be precisely determined. It is to be understood that other implementations are also possible, such as providing an absorptive trigger element and a reflective surface of thecontrol element 501 facing thesurface 502 of thedisplay 503. -
FIG. 6 is a schematic diagram of an example of aninput device 600 using a capacitive element for triggering an input event. Theinput device 600 includes at least one control element implemented inFIG. 6 as arotary knob 601. Themulti-touch sensing display 603 includes a capacitive touch-screen panel having a capacitancesensitive layer 605. Capacitive multi-touch sensing displays are known to those of ordinary skill in the art and will not be explained in further detail. More details on the operation of a capacitive multipoint touchscreen can be found, for example, the US Patent Publication US 2006/00917991 A1, which is incorporated by reference in its entirety. - A conventional capacitive touchscreen panel may for example include a capacitive sensing layer of a metal oxide, such as indium tin oxide, which conducts an electrical current across the sensor panel. The current is applied by electrodes on each corner of the panel, in one example, with a square wave signal. When the panel is touched, a charge transport occurs, which can be measured as a current at the corners of the panel. The position of the touch event may be determined by evaluating the resulting currents at the corners of the panel. To detect multiple simultaneous touches, the touchscreen panel may include a plurality of transparent sensor nodes which may again be formed of a conductive medium such as a metal oxide, spatially separated into electrodes and traces. Different coordinates on the display may then be represented by the different electrodes, and the traces are used to connect the electrodes to a capacitive sensing circuit. A change of a capacitance occurring at a particular electrode may then be recognized, and by using a plurality of electrodes, the positions of simultaneously occurring touches may be resolved. Referring to
FIG. 6 , acapacitive trigger element 604 is provided to trigger an input event. Thetrigger element 604 disturbs an electrical field established adjacent to a sensing node of capacitivesensitive layer 605 at a position underneath thetrigger element 604. The disturbance may be detected as a change in capacitance at the sensing node. The position of thetrigger element 604 relative to thesurface 602 may then be determined. Actuation of thecontrol element 601 results in a change of capacitance of another sensing node, which again generates an input event at a position relative to surface 602, which can be determined by a capacitive sensing circuit. Thecapacitive trigger element 604 may be grounded, or may be grounded when a user touches thecontrol element 601. The sensing nodes of the capacitive multi-touch sensing panel may also be arranged to achieve a high resolution of the positioning oftrigger element 604. For example, high resolution may be achieved by closely spacing the sensing nodes in proximity to the control element. Again,multi-touch sensing display 603 is capable of sensing a simultaneous actuation of thecontrol element 601 and a touch to thesurface 602 while also displaying information. -
FIG. 7 is a flowchart illustrating operation of an example method for detecting multiple simultaneous touches or near touches of a multi-touch sensing device. In an example, the method may be performed using the input device ofFIG. 1 orFIG. 5 . Instep 701, two control elements are actuated simultaneously. It is to be understood that these elements may be any type of control elements, such as rotary knobs, sliders, rockers, push buttons, and similar devices. By actuating the control elements, trigger elements of the control elements are moved relative to the display surface atstep 702. Optical sensors located in the display may detect light emitted by the display and reflected by the trigger elements. The movement of the trigger element results in a change in the intensity of the light detected by the optical sensors, which is detected instep 703. The locations or positions on the display at which the intensity changes occurred may be determined instep 704. A new setting for each control element is determined instep 705 on the basis of the respective intensity change and its location. For example, it may be determined that a slider was moved a particular distance or that a rotary knob was turned through a particular angle. Alternatively, the absolute setting of the control element may be determined, such as for example, a new position of a slider or of a rotary knob. A new value for a parameter associated with the control element is then calculated instep 706 on the basis of the derived new setting for each control element. For example, a particular switching function may have been assigned to a push button, and an associated parameter value may be changed from ‘1’ to signify an ‘ON’ position to a ‘0’ to signify an ‘OFF’ position upon actuation. The parameter value may also be adjusted according to a determined travel distance or turn angle of a control element, or to the determined absolute new setting of the control element. The parameters with their values are then provided to a device connected to the input device instep 707. It is to be understood that the above method may include additional steps, such as for example a step of detecting a touch to a surface adjacent to a control element and adjusting a parameter on the basis of the detected touch, or changing the function of a control element in accordance with a position of a detected touch. Graphical control elements may also be provided and functions of the mechanical control elements changed accordingly. -
FIG. 8 is a schematic diagram of an example of anaudio console 800. Theaudio console 800 inFIG. 8 includes twoinput devices input device 801 ofaudio console 800 includes a plurality of mechanical control elements implemented asrotary buttons 803. Theinput devices arrow 205 inFIG. 2 . - The portions of
input devices input device 801 includesareas rotary knobs 803. Theareas rotary knob 803. In the example shown inFIG. 8 ,area 804 indicates the adjustment of a numerical value for a particular channel,area 805 indicates the adjustment of a high frequency equalizer using a needle indicator, andarea 806 indicates the adjustment of a bandwidth. - The
input device 802 includes slidingcontrols 807 and 808, which may be for example, faders, with graphical indications on a channel to be adjusted and of a present setting provided next to them. Theinput device 802 includespush buttons input device 802 at a position where the control element is displayed. - Those of ordinary skill in the art will understand that different types of mechanical and graphical control elements may be arranged on a touch-sensitive surface of the input device, and that mechanical control elements other than the ones mentioned above may be used. Apart from being used in an
audio console 800, input devices according to example implementations may also be used in other devices such as control stations of a factory or a power plant. - Those of ordinary skill in the art will also understand that the types of multi-touch sensing displays used are not limited to those described above. Other types of displays may be used, such as for example, infrared touchscreen panels, strain gauge touchscreen panels, surface acoustic wave or diffused laser imaging touchscreen panels, and the like. These panels should be adapted in a manner similar to the examples described above to recognize multiple simultaneous touches.
- It will be understood, and is appreciated by persons skilled in the art, that one or more processes, sub-processes, or process steps described in connection with
FIGS. 1-8 may be performed by hardware and/or software under the control of a processor, such asprocessing unit 108 inFIG. 1 . If the process is performed by software, the software may reside in software memory (not shown) in a suitable electronic processing component or system such as theprocessing unit 108 inFIG. 1 . The software in software memory may include an ordered listing of executable instructions for implementing logical functions (that is, “logic” that may be implemented either in digital form such as digital circuitry or source code or in analog form such as analog circuitry or an analog source such an analog electrical, sound or video signal), and may selectively be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that may selectively fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. In the context of this disclosure, a “computer-readable medium” is any means that may contain, store or communicate the program for use by or in connection with the instruction execution system, apparatus, or device. The computer readable medium may selectively be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device. More specific examples, but nonetheless a non-exhaustive list, of computer-readable media would include the following: a portable computer diskette (magnetic), a RAM (electronic), a read-only memory “ROM” (electronic), an erasable programmable read-only memory (EPROM or Flash memory) (electronic) and a portable compact disc read-only memory “CDROM” (optical). Note that the computer-readable medium may even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory. - The foregoing description of example implementations has been presented for purposes of illustration and description. It is not exhaustive and does not limit the claimed inventions to the precise form disclosed. Modifications and variations are possible in light of the above description or may be acquired from practicing the invention. The claims and their equivalents define the scope of the invention.
Claims (18)
1. An input device comprising:
a multi-touch sensing display configured to detect multiple simultaneous triggers on a surface of the multi-touch sensing display as distinct input events;
a plurality of mechanical control elements arranged on the surface of the multi-touch sensing display, a first mechanical control element of the plurality of mechanical control elements is configured to control a function in response to a first user input; and
a touch-sensitive area positioned adjacent to the first mechanical control element and configured to receive a second user input,
wherein the second user input corresponds to a detected touch on the touch-sensitive area, and
wherein the touch-sensitive area is configured to change the function provided by the first mechanical control element based on a position of the detected touch on the touch-sensitive area.
2. The input device of claim 1 wherein the plurality of mechanical control elements includes a plurality of rotary knobs fixedly mounted to the surface of the multi-touch sensing display.
3. The input device of claim 2 wherein each rotary knob comprises a movable component and a shaft.
4. The input device of claim 3 wherein each rotary knob is configured to revolve around the shaft that is attached to a base that is attached to the surface of the multi-touch sensing display.
5. The input device of claim 1 where the multi-touch sensing display is configured to detect multiple simultaneous triggers that include touches, near-touches, or a combination thereof as distinct input events.
6. The input device of claim 1 wherein the touch-sensitive area surrounds the first mechanical control element.
7. A method of detecting a user input with an input device comprising a multi-touch sensing display adapted to detect distinct input events and a plurality of mechanical control elements arranged on a surface of the multi-touch sensing display, the method comprising:
in response to an actuation of a first mechanical control element of the plurality of mechanical control elements related to a first user input, generating an input event to control a function and detecting the input event by the multi-touch sensing display;
adjusting a parameter associated with the first mechanical control element in accordance with the detected input event;
detecting, at a touch sensitive area that is positioned adjacent to the first mechanical control element, a second user input that corresponds to a detected touch on the touch-sensitive area, and
changing the function provided by the first mechanical control element based on a position of the detected touch on the touch-sensitive area.
8. The method of claim 7 wherein the plurality of mechanical control elements includes a plurality of rotary knobs fixedly mounted to the surface of the multi-touch sensing display.
9. The method of claim 8 wherein each rotary knob comprises a movable component and a shaft.
10. The method of claim 9 further comprising revolving each rotary knob around the shaft that is attached to a base that is attached to the surface of the multi-touch sensing display.
11. The method of claim 7 further comprising detecting, via the multi-touch sensing display, multiple simultaneous triggers that include touches, near-touches, or a combination thereof as distinct input events.
12. The method of claim 7 wherein the touch-sensitive area surrounds the first mechanical control element.
13. An audio console comprising:
an input device including a multi-touch sensing display configured to detect multiple simultaneous triggers on a surface of the multi-touch sensing display as distinct input events,
a plurality of mechanical control elements arranged on the surface of the multi-touch sensing display, a first mechanical control element of the plurality of mechanical control elements configured to generate an input event in response to a first user input to control a function, the input event being detected by the multi-touch sensing display in response to actuation of the first mechanical control element; and
a touch-sensitive area positioned adjacent to the first mechanical control element and being configured to receive a second user input,
wherein the second user input corresponds to a detected touch on the touch-sensitive area, and
wherein the touch-sensitive area is configured to change the function controlled by the first mechanical control element based on a position of the detected touch on the touch-sensitive area.
14. The audio console of claim 13 wherein the plurality of mechanical control elements includes a plurality of rotary knobs fixedly mounted to the surface of the multi-touch sensing display.
15. The audio console of claim 14 wherein each rotary knob comprises a movable component and a shaft.
16. The audio console of claim 15 wherein each rotary knob is configured to revolve around the shaft that is attached to a base that is attached to the surface of the multi-touch sensing display.
17. The audio console of claim 13 wherein the multi-touch sensing display is configured to detect multiple simultaneous triggers that include touches, near-touches, or a combination thereof as distinct input events.
18. The audio console of claim 13 wherein the touch-sensitive area surrounds the first mechanical control element.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/095,537 US20160224129A1 (en) | 2008-11-18 | 2016-04-11 | Detecting a user input with an input device |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP08020092A EP2187290A1 (en) | 2008-11-18 | 2008-11-18 | Input device and method of detecting a user input with an input device |
EP08020092.6 | 2008-11-18 | ||
US12/621,388 US9310901B2 (en) | 2008-11-18 | 2009-11-18 | Detecting a user input with an input device |
US15/095,537 US20160224129A1 (en) | 2008-11-18 | 2016-04-11 | Detecting a user input with an input device |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/621,388 Continuation US9310901B2 (en) | 2008-11-18 | 2009-11-18 | Detecting a user input with an input device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160224129A1 true US20160224129A1 (en) | 2016-08-04 |
Family
ID=40352075
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/621,388 Active 2032-10-02 US9310901B2 (en) | 2008-11-18 | 2009-11-18 | Detecting a user input with an input device |
US15/095,537 Abandoned US20160224129A1 (en) | 2008-11-18 | 2016-04-11 | Detecting a user input with an input device |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/621,388 Active 2032-10-02 US9310901B2 (en) | 2008-11-18 | 2009-11-18 | Detecting a user input with an input device |
Country Status (6)
Country | Link |
---|---|
US (2) | US9310901B2 (en) |
EP (2) | EP2187290A1 (en) |
JP (1) | JP5744390B2 (en) |
KR (1) | KR101602282B1 (en) |
CN (1) | CN101825965B (en) |
CA (1) | CA2685168C (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019211368A1 (en) * | 2018-05-02 | 2019-11-07 | Preh Gmbh | Input device comprising actuation part and electromagnetic alternating-field influencing for determining position information |
US20200125184A1 (en) * | 2016-02-17 | 2020-04-23 | Martin Eurlings | Control panels and methods of controlling |
WO2020249285A1 (en) * | 2019-06-12 | 2020-12-17 | Preh Gmbh | Input device with movable handle on a capacitive detection surface and capacitive coupling devices |
Families Citing this family (109)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102782616A (en) * | 2009-10-16 | 2012-11-14 | Rpo有限公司 | Methods for detecting and tracking touch objects |
DE102010018637A1 (en) * | 2010-04-29 | 2011-11-03 | Volkswagen Ag | Operating device for use in motor car, has control device for actuating display area such that operations of touch-sensitive surface area of another display area and/or control element are visualized in portion of former display area |
DE102010033514A1 (en) * | 2010-08-05 | 2012-02-09 | Gm Global Technology Operations Llc (N.D.Ges.D. Staates Delaware) | Operating element for operation by a user and control module |
US9483167B2 (en) | 2010-09-29 | 2016-11-01 | Adobe Systems Incorporated | User interface for a touch enabled device |
US9229636B2 (en) | 2010-10-22 | 2016-01-05 | Adobe Systems Incorporated | Drawing support tool |
JP5653180B2 (en) * | 2010-11-09 | 2015-01-14 | アルパイン株式会社 | Operation knob and input system |
US9201185B2 (en) | 2011-02-04 | 2015-12-01 | Microsoft Technology Licensing, Llc | Directional backlighting for display panels |
US8842120B2 (en) | 2011-03-02 | 2014-09-23 | Adobe Systems Incorporated | Physics rules based animation engine |
DE102011006733A1 (en) * | 2011-04-04 | 2012-10-04 | SALZBRENNER STAGETEC AUDIO VIDEO MEDIENSYSTEME GmbH | Operating device, particularly for sound technical systems for digital mixing console, has touch screen and transparent cover arranged in front of touch screen corresponding to viewing side of touch screen |
WO2012149225A2 (en) * | 2011-04-26 | 2012-11-01 | The Regents Of The University Of California | Systems and devices for recording and reproducing senses |
US20120299838A1 (en) * | 2011-05-25 | 2012-11-29 | Numia Medical Technology, Llc | User Touch Screen Interface Device |
US10031641B2 (en) | 2011-09-27 | 2018-07-24 | Adobe Systems Incorporated | Ordering of objects displayed by a computing device |
JP5886003B2 (en) * | 2011-11-11 | 2016-03-16 | 株式会社Tbsテレビ | Light control console and operation device |
US20130145268A1 (en) * | 2011-12-02 | 2013-06-06 | Adobe Systems Incorporated | Frame control |
ITTO20120031A1 (en) * | 2012-01-17 | 2013-07-18 | Finder Spa | PROGRAMMABLE THERMOSTAT WITH PRESSURE SENSITIVE CONTROL INTERFACE |
US9354748B2 (en) | 2012-02-13 | 2016-05-31 | Microsoft Technology Licensing, Llc | Optical stylus interaction |
US9360893B2 (en) | 2012-03-02 | 2016-06-07 | Microsoft Technology Licensing, Llc | Input device writing surface |
US8873227B2 (en) | 2012-03-02 | 2014-10-28 | Microsoft Corporation | Flexible hinge support layer |
US9134807B2 (en) | 2012-03-02 | 2015-09-15 | Microsoft Technology Licensing, Llc | Pressure sensitive key normalization |
USRE48963E1 (en) | 2012-03-02 | 2022-03-08 | Microsoft Technology Licensing, Llc | Connection device for computing devices |
US8935774B2 (en) | 2012-03-02 | 2015-01-13 | Microsoft Corporation | Accessory device authentication |
US9075566B2 (en) | 2012-03-02 | 2015-07-07 | Microsoft Technoogy Licensing, LLC | Flexible hinge spine |
US9870066B2 (en) | 2012-03-02 | 2018-01-16 | Microsoft Technology Licensing, Llc | Method of manufacturing an input device |
US9064654B2 (en) | 2012-03-02 | 2015-06-23 | Microsoft Technology Licensing, Llc | Method of manufacturing an input device |
US9426905B2 (en) | 2012-03-02 | 2016-08-23 | Microsoft Technology Licensing, Llc | Connection device for computing devices |
US11042244B2 (en) * | 2012-04-24 | 2021-06-22 | Sony Corporation | Terminal device and touch input method |
WO2013169849A2 (en) | 2012-05-09 | 2013-11-14 | Industries Llc Yknots | Device, method, and graphical user interface for displaying user interface objects corresponding to an application |
WO2013169843A1 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for manipulating framed graphical objects |
WO2013169865A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input |
WO2013169875A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for displaying content associated with a corresponding affordance |
DE112013002381T5 (en) | 2012-05-09 | 2015-02-26 | Apple Inc. | Apparatus, method and graphical user interface for moving and dropping a user interface object |
AU2013259606B2 (en) | 2012-05-09 | 2016-06-02 | Apple Inc. | Device, method, and graphical user interface for displaying additional information in response to a user contact |
CN109062488B (en) | 2012-05-09 | 2022-05-27 | 苹果公司 | Apparatus, method and graphical user interface for selecting user interface objects |
WO2013169845A1 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for scrolling nested regions |
CN108241465B (en) | 2012-05-09 | 2021-03-09 | 苹果公司 | Method and apparatus for providing haptic feedback for operations performed in a user interface |
AU2013259630B2 (en) | 2012-05-09 | 2016-07-07 | Apple Inc. | Device, method, and graphical user interface for transitioning between display states in response to gesture |
JP6182207B2 (en) | 2012-05-09 | 2017-08-16 | アップル インコーポレイテッド | Device, method, and graphical user interface for providing feedback for changing an activation state of a user interface object |
WO2013169842A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for selecting object within a group of objects |
WO2013169851A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for facilitating user interaction with controls in a user interface |
US20130300590A1 (en) | 2012-05-14 | 2013-11-14 | Paul Henry Dietz | Audio Feedback |
US8947353B2 (en) | 2012-06-12 | 2015-02-03 | Microsoft Corporation | Photosensor array gesture detection |
US9459160B2 (en) | 2012-06-13 | 2016-10-04 | Microsoft Technology Licensing, Llc | Input device sensor configuration |
US9684382B2 (en) | 2012-06-13 | 2017-06-20 | Microsoft Technology Licensing, Llc | Input device configuration having capacitive and pressure sensors |
US9073123B2 (en) | 2012-06-13 | 2015-07-07 | Microsoft Technology Licensing, Llc | Housing vents |
US9256089B2 (en) | 2012-06-15 | 2016-02-09 | Microsoft Technology Licensing, Llc | Object-detecting backlight unit |
US8964379B2 (en) | 2012-08-20 | 2015-02-24 | Microsoft Corporation | Switchable magnetic lock |
US8654030B1 (en) | 2012-10-16 | 2014-02-18 | Microsoft Corporation | Antenna placement |
WO2014059618A1 (en) | 2012-10-17 | 2014-04-24 | Microsoft Corporation | Graphic formation via material ablation |
WO2014059625A1 (en) | 2012-10-17 | 2014-04-24 | Microsoft Corporation | Metal alloy injection molding overflows |
EP2908970B1 (en) | 2012-10-17 | 2018-01-03 | Microsoft Technology Licensing, LLC | Metal alloy injection molding protrusions |
US8952892B2 (en) | 2012-11-01 | 2015-02-10 | Microsoft Corporation | Input location correction tables for input panels |
KR102001332B1 (en) | 2012-12-29 | 2019-07-17 | 애플 인크. | Device, method, and graphical user interface for determining whether to scroll or select contents |
WO2014105275A1 (en) | 2012-12-29 | 2014-07-03 | Yknots Industries Llc | Device, method, and graphical user interface for forgoing generation of tactile output for a multi-contact gesture |
EP2939097B1 (en) | 2012-12-29 | 2018-12-26 | Apple Inc. | Device, method, and graphical user interface for navigating user interface hierarchies |
WO2014105277A2 (en) | 2012-12-29 | 2014-07-03 | Yknots Industries Llc | Device, method, and graphical user interface for moving a cursor according to a change in an appearance of a control icon with simulated three-dimensional characteristics |
KR101958582B1 (en) | 2012-12-29 | 2019-07-04 | 애플 인크. | Device, method, and graphical user interface for transitioning between touch input to display output relationships |
WO2014105279A1 (en) | 2012-12-29 | 2014-07-03 | Yknots Industries Llc | Device, method, and graphical user interface for switching between user interfaces |
US10578499B2 (en) | 2013-02-17 | 2020-03-03 | Microsoft Technology Licensing, Llc | Piezo-actuated virtual buttons for touch surfaces |
EP2830039B1 (en) * | 2013-07-24 | 2018-10-03 | Native Instruments GmbH | Method, arrangement, computer program and computer-readable storage means for controlling at least one parameter or at least one object using capacity sensing input elements |
US9665206B1 (en) | 2013-09-18 | 2017-05-30 | Apple Inc. | Dynamic user interface adaptable to multiple input tools |
CN104461601B (en) * | 2013-09-25 | 2017-11-28 | 联想(北京)有限公司 | A kind of parameter value adjustment method and electronic equipment |
KR20150072719A (en) * | 2013-12-20 | 2015-06-30 | 삼성전자주식회사 | Display apparatus and control method thereof |
US9448631B2 (en) | 2013-12-31 | 2016-09-20 | Microsoft Technology Licensing, Llc | Input device haptics and pressure sensing |
US9759854B2 (en) | 2014-02-17 | 2017-09-12 | Microsoft Technology Licensing, Llc | Input device outer layer and backlighting |
US10120420B2 (en) | 2014-03-21 | 2018-11-06 | Microsoft Technology Licensing, Llc | Lockable display and techniques enabling use of lockable displays |
WO2015174092A1 (en) * | 2014-05-15 | 2015-11-19 | パナソニックIpマネジメント株式会社 | Operation knob and display device in which same is used |
US10324733B2 (en) | 2014-07-30 | 2019-06-18 | Microsoft Technology Licensing, Llc | Shutdown notifications |
CN115756154A (en) * | 2014-09-02 | 2023-03-07 | 苹果公司 | Semantic framework for variable haptic output |
US9424048B2 (en) | 2014-09-15 | 2016-08-23 | Microsoft Technology Licensing, Llc | Inductive peripheral retention device |
US9519349B2 (en) * | 2014-10-30 | 2016-12-13 | Industrial Smoke & Mirrors, Inc. | Touch screen interface device |
US10128838B2 (en) * | 2014-12-31 | 2018-11-13 | Kostal Of America | Reflective switch input surface |
JP6398098B2 (en) * | 2015-01-20 | 2018-10-03 | カルソニックカンセイ株式会社 | Vehicle information input device |
US9645732B2 (en) | 2015-03-08 | 2017-05-09 | Apple Inc. | Devices, methods, and graphical user interfaces for displaying and using menus |
US10095396B2 (en) | 2015-03-08 | 2018-10-09 | Apple Inc. | Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object |
US10048757B2 (en) | 2015-03-08 | 2018-08-14 | Apple Inc. | Devices and methods for controlling media presentation |
US9785305B2 (en) | 2015-03-19 | 2017-10-10 | Apple Inc. | Touch input cursor manipulation |
US20170045981A1 (en) | 2015-08-10 | 2017-02-16 | Apple Inc. | Devices and Methods for Processing Touch Inputs Based on Their Intensities |
JP6481156B2 (en) * | 2015-04-22 | 2019-03-13 | カルソニックカンセイ株式会社 | Input display device |
EP3287875B1 (en) * | 2015-04-23 | 2019-11-13 | Alps Alpine Co., Ltd. | Input assistance device and input system |
US10222889B2 (en) | 2015-06-03 | 2019-03-05 | Microsoft Technology Licensing, Llc | Force inputs and cursor control |
US10416799B2 (en) | 2015-06-03 | 2019-09-17 | Microsoft Technology Licensing, Llc | Force sensing and inadvertent input control of an input device |
US9674426B2 (en) | 2015-06-07 | 2017-06-06 | Apple Inc. | Devices and methods for capturing and interacting with enhanced digital images |
US9860451B2 (en) | 2015-06-07 | 2018-01-02 | Apple Inc. | Devices and methods for capturing and interacting with enhanced digital images |
FR3041494B1 (en) * | 2015-09-17 | 2020-02-07 | Continental Automotive France | WHEEL SYSTEM ADAPTABLE TO SMART TELEPHONE OR ELECTRONIC TABLET |
US10061385B2 (en) | 2016-01-22 | 2018-08-28 | Microsoft Technology Licensing, Llc | Haptic feedback for a touch input device |
JP6649127B2 (en) * | 2016-03-04 | 2020-02-19 | アルプスアルパイン株式会社 | Operation device |
FR3049514B1 (en) * | 2016-04-01 | 2019-05-31 | Dav | INTERFACE FOR MOTOR VEHICLE |
DK179823B1 (en) | 2016-06-12 | 2019-07-12 | Apple Inc. | Devices, methods, and graphical user interfaces for providing haptic feedback |
DK201670737A1 (en) | 2016-06-12 | 2018-01-22 | Apple Inc | Devices, Methods, and Graphical User Interfaces for Providing Haptic Feedback |
DK201670720A1 (en) | 2016-09-06 | 2018-03-26 | Apple Inc | Devices, Methods, and Graphical User Interfaces for Generating Tactile Outputs |
FR3056475B1 (en) * | 2016-09-28 | 2018-11-30 | Dav | INTERFACE FOR MOTOR VEHICLE |
FR3056468B1 (en) * | 2016-09-28 | 2021-12-17 | Dav | AUTOMOTIVE VEHICLE INTERFACE |
FR3056467B1 (en) * | 2016-09-28 | 2021-12-17 | Dav | AUTOMOTIVE VEHICLE INTERFACE |
FR3057684A1 (en) * | 2016-10-14 | 2018-04-20 | Orange | MANIPULABLE OBJECT AND SUPPORT OF MANIPULABLE OBJECTS |
FR3064086A1 (en) * | 2017-03-14 | 2018-09-21 | Orange | PRESSURE BUTTON FOR TOUCH SURFACE, PHYSICAL INTERFACE AND PROTECTION |
GB201707478D0 (en) | 2017-05-10 | 2017-06-21 | Zytronic Displays Ltd | Display arrangement |
DK201770372A1 (en) | 2017-05-16 | 2019-01-08 | Apple Inc. | Tactile feedback for locked device user interfaces |
EP3537271A1 (en) * | 2018-03-05 | 2019-09-11 | Advanced Silicon SA | Transparent button for capacitive touch screen |
US11016575B2 (en) * | 2018-03-30 | 2021-05-25 | Lenovo (Singapore) Pte. Ltd. | Input tool |
CN108826598A (en) * | 2018-05-04 | 2018-11-16 | 北京车和家信息技术有限公司 | Air conditioning control method, device and vehicle |
DE102018120575A1 (en) | 2018-07-12 | 2020-01-16 | Preh Gmbh | Input device with a movable handle on a capacitive detection surface and capacitive coupling devices |
WO2020011416A1 (en) * | 2018-07-12 | 2020-01-16 | Preh Gmbh | Input device with movable handle on a capacitive detection surface and capacitive coupling devices |
WO2020079729A1 (en) * | 2018-10-15 | 2020-04-23 | 三菱電機株式会社 | Touch panel input device, touch panel input method, and program |
CN109683656A (en) * | 2019-01-08 | 2019-04-26 | 业成科技(成都)有限公司 | Touch-control knob assembly |
JP6610813B1 (en) * | 2019-02-04 | 2019-11-27 | Smk株式会社 | Auxiliary input device for capacitive touch panel |
EP3758212A1 (en) * | 2019-06-28 | 2020-12-30 | ABB Schweiz AG | Converter |
WO2021130956A1 (en) * | 2019-12-26 | 2021-07-01 | 三菱電機株式会社 | Tactile sensation presentation panel, tactile sensation presentation touch panel, and tactile sensation presentation touch display |
WO2021130971A1 (en) * | 2019-12-26 | 2021-07-01 | 三菱電機株式会社 | Tactile presentation panel and tactile presentation knob |
CN112735335B (en) * | 2020-11-30 | 2022-04-29 | 武汉天马微电子有限公司 | Organic light-emitting display panel, display device and driving method |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4655552A (en) * | 1984-03-17 | 1987-04-07 | Citizen Watch Co., Ltd. | Flat panel display device having on-screen data input function |
US4951036A (en) * | 1988-08-04 | 1990-08-21 | The Grass Valley Group, Inc. | Touchpad jogger |
GB9108226D0 (en) * | 1991-04-17 | 1991-06-05 | Philips Electronic Associated | Optical touch input device |
US5805146A (en) | 1993-11-05 | 1998-09-08 | Intertactile Technologies Corporation | Integrated display screen and slidable control for electrical circuits |
US7663607B2 (en) | 2004-05-06 | 2010-02-16 | Apple Inc. | Multipoint touchscreen |
US6326956B1 (en) * | 1998-08-24 | 2001-12-04 | Intertactile Technologies Corporation | Circuit control devices utilizing electronic display screen light |
US8199114B1 (en) * | 2000-09-26 | 2012-06-12 | Denny Jaeger | Touch sensor control devices |
US20030048257A1 (en) * | 2001-09-06 | 2003-03-13 | Nokia Mobile Phones Ltd. | Telephone set having a touch pad device |
US7006080B2 (en) * | 2002-02-19 | 2006-02-28 | Palm, Inc. | Display system |
KR100983524B1 (en) * | 2003-12-01 | 2010-09-24 | 삼성전자주식회사 | Light sensing panel, apparatus for sensing a light having the same, and driving method thereof |
US8681132B2 (en) * | 2004-03-18 | 2014-03-25 | Koninklijke Philips N.V. | Scanning display apparatus |
US20060007179A1 (en) * | 2004-07-08 | 2006-01-12 | Pekka Pihlaja | Multi-functional touch actuation in electronic devices |
US20080129707A1 (en) * | 2004-07-27 | 2008-06-05 | Pryor Timothy R | Method and apparatus employing multi-functional controls and displays |
JP2006079589A (en) * | 2004-08-05 | 2006-03-23 | Sanyo Electric Co Ltd | Touch panel |
US7158054B2 (en) * | 2004-09-21 | 2007-01-02 | Nokia Corporation | General purpose input board for a touch actuation |
US7598949B2 (en) * | 2004-10-22 | 2009-10-06 | New York University | Multi-touch sensing light emitting diode display and method for using the same |
JP4186229B2 (en) * | 2005-03-17 | 2008-11-26 | ヤマハ株式会社 | Acoustic adjustment console |
TWI253846B (en) * | 2005-03-28 | 2006-04-21 | Ind Tech Res Inst | Photo-sensing display unit |
JP4645822B2 (en) * | 2005-04-19 | 2011-03-09 | ソニー株式会社 | Image display device and object detection method |
JP4338140B2 (en) * | 2005-05-12 | 2009-10-07 | 株式会社 日立ディスプレイズ | Touch panel integrated display device |
US20060256090A1 (en) * | 2005-05-12 | 2006-11-16 | Apple Computer, Inc. | Mechanical overlay |
WO2007089049A1 (en) * | 2006-01-31 | 2007-08-09 | Samyoung Technologies Co., Ltd. | Keyboard for notebook computer using one body style keypad |
JP2007310628A (en) * | 2006-05-18 | 2007-11-29 | Hitachi Displays Ltd | Image display |
DE202007014957U1 (en) * | 2007-01-05 | 2007-12-27 | Apple Inc., Cupertino | Multimedia touch screen communication device responsive to gestures for controlling, manipulating and editing media files |
US8462133B2 (en) * | 2008-09-29 | 2013-06-11 | Apple Inc. | Clickable and tactile buttons for a touch surface |
-
2008
- 2008-11-18 EP EP08020092A patent/EP2187290A1/en not_active Ceased
- 2008-11-18 EP EP20140194724 patent/EP2863289A1/en not_active Ceased
-
2009
- 2009-11-09 CA CA2685168A patent/CA2685168C/en not_active Expired - Fee Related
- 2009-11-16 JP JP2009261244A patent/JP5744390B2/en not_active Expired - Fee Related
- 2009-11-18 US US12/621,388 patent/US9310901B2/en active Active
- 2009-11-18 KR KR1020090111331A patent/KR101602282B1/en active IP Right Grant
- 2009-11-18 CN CN200910258450.XA patent/CN101825965B/en not_active Expired - Fee Related
-
2016
- 2016-04-11 US US15/095,537 patent/US20160224129A1/en not_active Abandoned
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200125184A1 (en) * | 2016-02-17 | 2020-04-23 | Martin Eurlings | Control panels and methods of controlling |
US10928928B2 (en) * | 2016-02-17 | 2021-02-23 | Arranged Bv | Control panels and methods of controlling |
WO2019211368A1 (en) * | 2018-05-02 | 2019-11-07 | Preh Gmbh | Input device comprising actuation part and electromagnetic alternating-field influencing for determining position information |
WO2020249285A1 (en) * | 2019-06-12 | 2020-12-17 | Preh Gmbh | Input device with movable handle on a capacitive detection surface and capacitive coupling devices |
CN114026518A (en) * | 2019-06-12 | 2022-02-08 | 普瑞有限公司 | Input device with movable handle on capacitance detection surface and capacitance coupling device |
US11816276B2 (en) | 2019-06-12 | 2023-11-14 | Preh Gmbh | Input device with movable handle on capacitive detection surface and capacitive coupling devices |
Also Published As
Publication number | Publication date |
---|---|
JP2010123123A (en) | 2010-06-03 |
US20100214257A1 (en) | 2010-08-26 |
KR101602282B1 (en) | 2016-03-21 |
CA2685168C (en) | 2014-09-16 |
CN101825965B (en) | 2015-08-26 |
CN101825965A (en) | 2010-09-08 |
EP2863289A1 (en) | 2015-04-22 |
CA2685168A1 (en) | 2010-05-18 |
KR20100056396A (en) | 2010-05-27 |
US9310901B2 (en) | 2016-04-12 |
JP5744390B2 (en) | 2015-07-08 |
EP2187290A1 (en) | 2010-05-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20160224129A1 (en) | Detecting a user input with an input device | |
US8217914B2 (en) | Information display apparatus with proximity detection performance and information display method using the same | |
US9703435B2 (en) | Touchpad combined with a display and having proximity and touch sensing capabilities to enable different functions or interfaces to be displayed | |
JP5008156B2 (en) | Multi-contact sensor device and method | |
US20040012572A1 (en) | Display and touch screen method and apparatus | |
US10198123B2 (en) | Mitigating noise in capacitive sensor | |
US20090153494A1 (en) | Touch display for an appliance | |
US11392214B2 (en) | Touch control system and method | |
CN101533326A (en) | Method for calibrating coordinates of resistance touch screen | |
JP2002140165A (en) | Electronic interface panel and electronic equipment | |
US10698554B2 (en) | Positioning components that provide resistance on sense lines of a touch sensor | |
US20080158187A1 (en) | Touch control input system for use in electronic apparatuses and signal generation method thereof | |
KR101927795B1 (en) | Touch input device for sensing a position and a pressure magnitude of touch | |
US11681375B1 (en) | Non-uniform pressure actuation threshold value | |
JP2023025681A (en) | Ar/vr navigation with authentication using integrated scroll wheel and fingerprint sensor user input apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |