EP2455843A2 - System and method for improving touch screen display use under vibration and turbulence - Google Patents

System and method for improving touch screen display use under vibration and turbulence Download PDF

Info

Publication number
EP2455843A2
EP2455843A2 EP11188736A EP11188736A EP2455843A2 EP 2455843 A2 EP2455843 A2 EP 2455843A2 EP 11188736 A EP11188736 A EP 11188736A EP 11188736 A EP11188736 A EP 11188736A EP 2455843 A2 EP2455843 A2 EP 2455843A2
Authority
EP
European Patent Office
Prior art keywords
touch screen
input
bezel
turbulence
accordance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP11188736A
Other languages
German (de)
French (fr)
Other versions
EP2455843B1 (en
EP2455843A3 (en
Inventor
Aaron James Gannon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GE Aviation Systems LLC
Original Assignee
GE Aviation Systems LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GE Aviation Systems LLC filed Critical GE Aviation Systems LLC
Publication of EP2455843A2 publication Critical patent/EP2455843A2/en
Publication of EP2455843A3 publication Critical patent/EP2455843A3/en
Application granted granted Critical
Publication of EP2455843B1 publication Critical patent/EP2455843B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/10Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of two-dimensional [2D] relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547Touch pads, in which fingers can move on a surface
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/143Touch sensitive instrument input devices
    • B60K2360/1438Touch screens
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K2360/00Indexing scheme associated with groups B60K35/00 or B60K37/00 relating to details of instruments or dashboards
    • B60K2360/60Structural details of dashboards or instruments
    • B60K2360/68Features of instruments
    • B60K2360/693Cover plate features
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/20Output arrangements, i.e. from vehicle to user, associated with vehicle functions or specially adapted therefor

Definitions

  • the field of the invention relates generally to input devices, and more specifically, to a method and systems for improving touch screen display use during vibration and turbulence conditions.
  • a system for improving touch screen display use during vibration and turbulence conditions includes a sensor configured to transmit a first input signal relative to a measured parameter of the vehicle, a touch screen input and display system configured to transmit a second input signal relative to a manual input by a user.
  • the touch screen input and display system includes a planar input and viewing surface having a plurality of edges and a bezel at least partially surrounding the surface proximate at least some of the plurality of edges.
  • the bezel includes a surface configured to engage one or more digits of one or more hands of a user and is formed of an elastomeric material.
  • the system also includes an input unit configured to receive the transmitted first and second input signals.
  • a method of improving touch screen display use during vibration and turbulence conditions includes landing at least one digit of at least one hand of a user on a bezel at least partially surrounding a touch screen input and display device and engaging a touch activated area of the touch screen input and display device with at least one other digit of the at least one hand.
  • the method further includes determining an amount of motion influence of the at least one hand is due to at least one of vibration, shock, and turbulence associated with at least one of the touch screen input and display device and the hand and adjusting the touch-activated area using the determined amount of motion influence.
  • a touch screen input and display system includes a touch screen including a planar input and viewing surface having a plurality of edges and a bezel at least partially surrounding the surface proximate at least some of the plurality of edges, the bezel including a surface configured to engage one or more digits or one or more hands of a user, the surface formed of an elastomeric material.
  • an ergonomic physical stabilization edge is formed in the bezel of a touch screen display such that one or both hands can be stabilized while using the touch screen.
  • a relatively thin touchpad is formed in the stabilization edge of the bezel to determine number of fingers being used for stabilization, movement due to turbulence, and a range of appropriate GUI and cursor control actions based on hand position.
  • FIG. 1 is a schematic block diagram of a vehicle control system 100 in accordance with an exemplary embodiment of the present invention.
  • vehicle control system 100 includes a sensor 102 configured to transmit a first input signal relative to a measured parameter of the vehicle and a touch screen input and display system 104 configured to transmit a second input signal relative to a manual input by a user.
  • Touch screen input and display system 104 includes a planar input and viewing surface 106 having a plurality of edges 108 and a bezel 110 at least partially surrounding planar input and viewing surface 106 proximate at least some of edges 108.
  • Bezel 110 includes a surface 112 configured to engage one or more digits 114 of one or more hands 116 of a user.
  • Vehicle control system 100 also includes an input unit 118 configured to receive the transmitted first and second input signals for use by a processor 119 for further processing and/or transmission to other processes.
  • Planar input and viewing surface 106 comprises a touch activated area 120 configured to receive a manual input from a digit 114, for example, a finger or thumb of the user.
  • FIG. 2 is a cross-sectional view of bezel 110 taken along lines 2-2 (shown in FIG. 1 ) in accordance with an exemplary embodiment of the present invention.
  • bezel 110 comprises a trough 202 configured to engage one or more digits 114 of one or more hands 116 of the user.
  • bezel 110 comprises a protrusion 204 configured to engage one or more digits 114, for example, fingers and/or thumb of one or more hands 116 of the user.
  • bezel 110 is designed for finger and thumb stabilization, intended movement, and comfort during operations using planar input and viewing surface 106.
  • Bezel 110 provides trough 202 or protrusion 204 as fingerrails along left, right, and top edges 108 primarily, and further a thumbrail along the bottom edge 108 to permit a pinch grip while scrolling left and right.
  • Bezel 110 permits finger protrusion aft from planar input and viewing surface 106, and may use a curved background surface behind planar input and viewing surface 106 to conform to first link of digits 114 to permit finger protrusion via limited opening behind the planar input and viewing surface 106 to permit heavy turbulence lockdown stabilization.
  • Bezel 110 provides several options for surface 112 including a soft thermoplastic elastomer for damping turbulence and increasing comfort.
  • Surface 112 may also include a textured portion to increase friction, adjacent to a smooth nylon portion used to permit smooth sliding coupled with on-screen interaction.
  • the textured portion may be formed in distal trough 202 while the smooth surface is formed on a proximal side planar surface 208.
  • bezel 110 comprises a sensor 206 configured to detect at least one of vibration, shock, and turbulence.
  • Sensor 206 may be formed integrally with bezel 110, for example, but not limited to, embedded on or within surface 112 proximate trough 202 or protrusion 204. In an alternate embodiment, sensor 206 may be positioned in another location.
  • Sensor 206 is configured to generate an output relative to a motion component between touch screen input and display system 104 and the user resulting from the at least one of vibration, shock, and turbulence.
  • Sensor 206 is configured to determine a number and placement of the one or more digits 114 using at least one of capacitance, proximity, acceleration, force, and a combination thereof.
  • Touch activated area 120 is configured to be at least one of relocated and resized on planar input and viewing surface 106 based on an input from sensor 206, which is configured to determine a motion influence due to at least one of vibration, shock, and turbulence.
  • Planar input and viewing surface 106 may alternatively be sized for use by a range of human anthropometric dimensions, allowing two stabilized hands to permit touching thumbs proximate a center of planar input and viewing surface 106. Different line replaceable bezel widths may be used for different hand and finger sizes.
  • bezel 110 is an active user-interface incorporating a thin, bezel-integrated touchpad 210 extending around an outside edge 212 of bezel 110.
  • Touchpad 210 may be used to identify an intended graphical focus area on planar input and viewing surface 106, to control vertical and/or horizontal scroll bars, for increasing or decreasing quantitative or graphical displays, for panning, zooming, or rotating the screen, for determining finger positions for GUI behavior, and for determining turbulence input and damping its effects as the pilot interacts with the screen.
  • System 100 determines a position of hand 116 and a number of digits 114 that are being used to interact with touch screen input and display system 104 and, in one embodiment, further determines an unintended digit anchor point movement based on a measured turbulence via, for example, but not limited to, rapid up/down movement of a digit anchor point, and adjusts the sensed finger or thumb input on touch screen input and display system 104 in direction opposite to the unintended anchor point movement. System 100 thus determines and corrects unintended digit touch point movement based on measured turbulence and movement of the digit touch point.
  • processor refers to central processing units, microprocessors, microcontrollers, reduced instruction set circuits (RISC), application specific integrated circuits (ASIC), logic circuits, and any other circuit or processor capable of executing the functions described herein.
  • RISC reduced instruction set circuits
  • ASIC application specific integrated circuits
  • the terms "software” and “firmware” are interchangeable, and include any computer program stored in memory for execution by processor 119, including RAM memory, ROM memory, EPROM memory, EEPROM memory, and nonvolatile RAM (NVRAM) memory.
  • RAM memory random access memory
  • ROM memory read-only memory
  • EPROM memory erasable programmable read-only memory
  • EEPROM memory electrically erasable programmable read-only memory
  • NVRAM nonvolatile RAM
  • the above-described embodiments of the disclosure may be implemented using computer programming or engineering techniques including computer software, firmware, hardware or any combination or subset thereof, wherein the technical effect is reducing unintentional hand and finger movement when using a touch screen in vibration and turbulence conditions.
  • Any such resulting program, having computer-readable code means may be embodied or provided within one or more computer-readable media, thereby making a computer program product, i.e., an article of manufacture, according to the discussed embodiments of the disclosure.
  • the computer-readable media may be, for example, but is not limited to, a fixed (hard) drive, diskette, optical disk, magnetic tape, semiconductor memory such as read-only memory (ROM), and/or any transmitting/receiving medium such as the Internet or other communication network or link.
  • the article of manufacture containing the computer code may be made and/or used by executing the code directly from one medium, by copying the code from one medium to another medium, or by transmitting the code over a network.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A vehicle control system (100) includes a sensor (102,206) configured to transmit a first input signal relative to a measured parameter of the vehicle, a touch screen input and display system (104) configured to transmit a second input signal relative to a manual input by a user, the touch screen input and display system including a planar input and viewing surface having a plurality of edges (108) and a bezel (110) at least partially surrounding the surface proximate at least some of the plurality of edges, the bezel including a surface (112) configured to engage one or more digits of one or more hands of a user, the surface formed of an elastomeric material, and an input unit (118) configured to receive the transmitted first and second input signals.

Description

    BACKGROUND OF THE INVENTION
  • The field of the invention relates generally to input devices, and more specifically, to a method and systems for improving touch screen display use during vibration and turbulence conditions.
  • At least some known touch screens with single- and multi-touch capability have enjoyed great success in consumer products, lending intuitive gesture-based control to functions like scrolling, panning, and zooming. However, their use in vehicles, such as on a flight deck of an aircraft is hampered by vibration and turbulence, which makes precise, accurate, and rapid finger and hand movements extremely difficult. Moreover, most aircraft displays must be anchored to the flight deck, transmitting vibration and turbulence directly to the display without any damping. Current generation cursor control devices have incorporated a turbulence hump for resting a wrist on the user during turbulence in an attempt to stabilize the user's hand. However, these current generation displays are not designed for hand stabilization appropriate for use in multi-touch operations.
  • BRIEF DESCRIPTION OF THE INVENTION
  • In one embodiment, a system for improving touch screen display use during vibration and turbulence conditions includes a sensor configured to transmit a first input signal relative to a measured parameter of the vehicle, a touch screen input and display system configured to transmit a second input signal relative to a manual input by a user. The touch screen input and display system includes a planar input and viewing surface having a plurality of edges and a bezel at least partially surrounding the surface proximate at least some of the plurality of edges. The bezel includes a surface configured to engage one or more digits of one or more hands of a user and is formed of an elastomeric material. The system also includes an input unit configured to receive the transmitted first and second input signals.
  • In another embodiment, a method of improving touch screen display use during vibration and turbulence conditions includes landing at least one digit of at least one hand of a user on a bezel at least partially surrounding a touch screen input and display device and engaging a touch activated area of the touch screen input and display device with at least one other digit of the at least one hand. The method further includes determining an amount of motion influence of the at least one hand is due to at least one of vibration, shock, and turbulence associated with at least one of the touch screen input and display device and the hand and adjusting the touch-activated area using the determined amount of motion influence.
  • In yet another embodiment, a touch screen input and display system includes a touch screen including a planar input and viewing surface having a plurality of edges and a bezel at least partially surrounding the surface proximate at least some of the plurality of edges, the bezel including a surface configured to engage one or more digits or one or more hands of a user, the surface formed of an elastomeric material.
  • BRIEF DESCRIPTION OF THE DRAWINGS
    • FIGS. 1 and 2 show exemplary embodiments of the method and system described herein.
    • FIG. 1 is a schematic block diagram of a vehicle control system in accordance with an exemplary embodiment of the present invention; and
    • FIG. 2 is a cross-sectional view of the bezel shown in FIG. 1 taken along the lines 2-2 also shown in FIG. 1 in accordance with an exemplary embodiment of the present invention.
    DETAILED DESCRIPTION OF THE INVENTION
  • The following detailed description illustrates embodiments of the invention by way of example and not by way of limitation. It is contemplated that the invention has general application to improving touch screen display use during vibration and turbulence conditions in industrial, commercial, and residential applications.
  • As used herein, an element or step recited in the singular and proceeded with the word "a" or "an" should be understood as not excluding plural elements or steps, unless such exclusion is explicitly recited. Furthermore, references to "one embodiment" of the present invention are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.
  • In an embodiment of the present invention an ergonomic physical stabilization edge is formed in the bezel of a touch screen display such that one or both hands can be stabilized while using the touch screen.
  • In another embodiment, a relatively thin touchpad is formed in the stabilization edge of the bezel to determine number of fingers being used for stabilization, movement due to turbulence, and a range of appropriate GUI and cursor control actions based on hand position.
  • FIG. 1 is a schematic block diagram of a vehicle control system 100 in accordance with an exemplary embodiment of the present invention. In the exemplary embodiment, vehicle control system 100 includes a sensor 102 configured to transmit a first input signal relative to a measured parameter of the vehicle and a touch screen input and display system 104 configured to transmit a second input signal relative to a manual input by a user. Touch screen input and display system 104 includes a planar input and viewing surface 106 having a plurality of edges 108 and a bezel 110 at least partially surrounding planar input and viewing surface 106 proximate at least some of edges 108. Bezel 110 includes a surface 112 configured to engage one or more digits 114 of one or more hands 116 of a user. In the exemplary embodiment, surface 112 is formed of an elastomeric material, for example, but not limited to, neoprene and synthetic rubber. Vehicle control system 100 also includes an input unit 118 configured to receive the transmitted first and second input signals for use by a processor 119 for further processing and/or transmission to other processes.
  • Planar input and viewing surface 106 comprises a touch activated area 120 configured to receive a manual input from a digit 114, for example, a finger or thumb of the user. FIG. 2 is a cross-sectional view of bezel 110 taken along lines 2-2 (shown in FIG. 1) in accordance with an exemplary embodiment of the present invention. In the exemplary embodiment, bezel 110 comprises a trough 202 configured to engage one or more digits 114 of one or more hands 116 of the user. In another embodiment, bezel 110 comprises a protrusion 204 configured to engage one or more digits 114, for example, fingers and/or thumb of one or more hands 116 of the user.
  • In a physical embodiment, bezel 110 is designed for finger and thumb stabilization, intended movement, and comfort during operations using planar input and viewing surface 106. Bezel 110 provides trough 202 or protrusion 204 as fingerrails along left, right, and top edges 108 primarily, and further a thumbrail along the bottom edge 108 to permit a pinch grip while scrolling left and right. Bezel 110 permits finger protrusion aft from planar input and viewing surface 106, and may use a curved background surface behind planar input and viewing surface 106 to conform to first link of digits 114 to permit finger protrusion via limited opening behind the planar input and viewing surface 106 to permit heavy turbulence lockdown stabilization. Bezel 110 provides several options for surface 112 including a soft thermoplastic elastomer for damping turbulence and increasing comfort. Surface 112 may also include a textured portion to increase friction, adjacent to a smooth nylon portion used to permit smooth sliding coupled with on-screen interaction. The textured portion may be formed in distal trough 202 while the smooth surface is formed on a proximal side planar surface 208.
  • In various embodiments, bezel 110 comprises a sensor 206 configured to detect at least one of vibration, shock, and turbulence. Sensor 206 may be formed integrally with bezel 110, for example, but not limited to, embedded on or within surface 112 proximate trough 202 or protrusion 204. In an alternate embodiment, sensor 206 may be positioned in another location. Sensor 206 is configured to generate an output relative to a motion component between touch screen input and display system 104 and the user resulting from the at least one of vibration, shock, and turbulence. Sensor 206 is configured to determine a number and placement of the one or more digits 114 using at least one of capacitance, proximity, acceleration, force, and a combination thereof.
  • Touch activated area 120 is configured to be at least one of relocated and resized on planar input and viewing surface 106 based on an input from sensor 206, which is configured to determine a motion influence due to at least one of vibration, shock, and turbulence.
  • Planar input and viewing surface 106 may alternatively be sized for use by a range of human anthropometric dimensions, allowing two stabilized hands to permit touching thumbs proximate a center of planar input and viewing surface 106. Different line replaceable bezel widths may be used for different hand and finger sizes.
  • In an interactive embodiment, bezel 110 is an active user-interface incorporating a thin, bezel-integrated touchpad 210 extending around an outside edge 212 of bezel 110. Touchpad 210 may be used to identify an intended graphical focus area on planar input and viewing surface 106, to control vertical and/or horizontal scroll bars, for increasing or decreasing quantitative or graphical displays, for panning, zooming, or rotating the screen, for determining finger positions for GUI behavior, and for determining turbulence input and damping its effects as the pilot interacts with the screen.
  • System 100 determines a position of hand 116 and a number of digits 114 that are being used to interact with touch screen input and display system 104 and, in one embodiment, further determines an unintended digit anchor point movement based on a measured turbulence via, for example, but not limited to, rapid up/down movement of a digit anchor point, and adjusts the sensed finger or thumb input on touch screen input and display system 104 in direction opposite to the unintended anchor point movement. System 100 thus determines and corrects unintended digit touch point movement based on measured turbulence and movement of the digit touch point.
  • The term processor, as used herein, refers to central processing units, microprocessors, microcontrollers, reduced instruction set circuits (RISC), application specific integrated circuits (ASIC), logic circuits, and any other circuit or processor capable of executing the functions described herein.
  • As used herein, the terms "software" and "firmware" are interchangeable, and include any computer program stored in memory for execution by processor 119, including RAM memory, ROM memory, EPROM memory, EEPROM memory, and nonvolatile RAM (NVRAM) memory. The above memory types are exemplary only, and are thus not limiting as to the types of memory usable for storage of a computer program.
  • As will be appreciated based on the foregoing specification, the above-described embodiments of the disclosure may be implemented using computer programming or engineering techniques including computer software, firmware, hardware or any combination or subset thereof, wherein the technical effect is reducing unintentional hand and finger movement when using a touch screen in vibration and turbulence conditions. Any such resulting program, having computer-readable code means, may be embodied or provided within one or more computer-readable media, thereby making a computer program product, i.e., an article of manufacture, according to the discussed embodiments of the disclosure. The computer-readable media may be, for example, but is not limited to, a fixed (hard) drive, diskette, optical disk, magnetic tape, semiconductor memory such as read-only memory (ROM), and/or any transmitting/receiving medium such as the Internet or other communication network or link. The article of manufacture containing the computer code may be made and/or used by executing the code directly from one medium, by copying the code from one medium to another medium, or by transmitting the code over a network.
  • The above-described embodiments of a method and system of improving touch screen display use under vibration and turbulence provides a cost-effective and reliable means of bringing intuitive aspects of multi-touch touch screens to flight deck applications in a method that is usable by a pilot operating under vibration or turbulence. As a result, the methods and systems described herein facilitate operating vehicles, such as, aircraft in a cost-effective and reliable manner.
  • This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims.
  • Various aspects and embodiments of the invention are indicated in the following clauses:
    1. 1. A vehicle control system comprising:
      • a sensor configured to transmit a first input signal relative to a measured parameter of the vehicle;
      • a touch screen input and display system configured to transmit a second input signal relative to a manual input by a user, said touch screen input and display system comprising a planar input and viewing surface having a plurality of edges and a bezel at least partially surrounding said surface proximate at least some of said plurality of edges, said bezel comprising a surface configured to engage one or more digits of one or more hands of a user, said surface formed of an elastomeric material; and
      • an input unit configured to receive the transmitted first and second input signals.
    2. 2. A system in accordance with Clause 1, wherein said bezel comprises at least one of vibration, shock, and turbulence sensor configured to generate an output relative to a motion component between said touch screen and a user resulting from the at least one of vibration, shock, and turbulence.
    3. 3. A system in accordance with Clause 1, wherein said sensor is configured to determine a number and placement of the one or more digits using at least one of capacitance, proximity, acceleration, force, and a combination thereof.
    4. 4. A system in accordance with Clause 1, wherein said touch screen comprises a touch activated area configured to receive a manual input from a digit, said touch screen area configured to be at least one of relocated and resized on said touch screen based on an input from a sensor configured to use at least one of capacitance, proximity, acceleration, force, and a combination thereof to determine a motion influence due to at least one of vibration, shock, and turbulence.
    5. 5. A system in accordance with any of the preceding clauses, wherein said bezel comprises at least one of a trough and a protrusion configured to engage one or more digits of one or more hands of a user.
    6. 6. A method of improving touch screen display use during vibration and turbulence conditions comprising:
      • landing at least one digit of at least one hand of a user on a bezel at least partially surrounding a touch screen input and display device;
      • engaging a touch activated area of the touch screen input and display device with at least one other digit of the at least one hand;
      • determining an amount of motion influence of the at least one hand is due to at least one of vibration, shock, and turbulence associated with at least one of the touch screen input and display device and the hand; and
      • adjusting the touch-activated area using the determined amount of motion influence.
    7. 7. A method in accordance with Clause 6, wherein landing at least one digit of at least one hand of a user on a bezel comprises landing at least one digit of at least one hand of a user in a trough formed in a surface of the bezel and sized to receive the at least one digit.
    8. 8. A method in accordance with Clause 7, wherein landing at least one digit of at least one hand of a user on a bezel comprises landing at least one digit of at least one hand of a user on a surface of protrusion extending from the trough, the protrusion formed of an elastomeric material.
    9. 9. A method in accordance with either one of Clauses 6 or 7, wherein landing at least one digit of at least one hand of a user on a bezel comprises landing at least one digit of at least one hand of a user on a resilient surface of the bezel.
    10. 10. A method in accordance with Clause 6, wherein landing at least one digit of at least one hand of a user on a bezel comprises landing at least one digit of at least one hand of a user on the bezel formed of elastomeric material.
    11. 11. A method in accordance with any one of Clauses 6 to 10, wherein determining an amount of motion influence comprises measuring an amount of movement of the at least one digit with respect to the bezel.
    12. 12. A method in accordance with Clause 11, wherein determining an amount of motion influence comprises measuring an amount of movement of the at least one digit with respect to the bezel using at least one of a capacitance parameter and a proximity parameter.
    13. 13. A method in accordance with either of Clause 11 or 12, wherein determining an amount of motion influence comprises measuring an amount of movement of the at least one digit with respect to the bezel using at least one of an acceleration parameter and a force parameter.
    14. 14. A method in accordance with any one of Clauses 6 to 13, wherein engaging a touch activated area comprises touching the touch activated area using a thumb of the hand.
    15. 15. A method in accordance with any one of Clauses 6 to 14, wherein adjusting the touch-activated area comprises at least one of relocating the touch-activated area and enlarging the touch-activated area to facilitate said engaging during the at least one of vibration, shock, and turbulence based on the determined amount of motion influence.
    16. 16. A touch screen input and display system comprising:
      • a touch screen comprising a planar input and viewing surface having a plurality of edges; and
      • a bezel at least partially surrounding said surface proximate at least some of said plurality of edges, said bezel comprising a surface configured to engage one or more digits of one or more hands of a user, said surface formed of an elastomeric material.
    17. 17. A system in accordance with Clause 16, wherein said bezel comprises at least one of vibration, shock, and turbulence sensor configured to generate an output relative to a motion component between said touch screen and a user resulting from the at least one of vibration, shock, and turbulence.
    18. 18. A system in accordance with Clause 16, wherein said sensor is configured to determine a number and placement of the one or more digits using at least one of capacitance, proximity, acceleration, force, and a combination thereof.
    19. 19. A system in accordance with Clause 16, wherein said touch screen comprises a touch activated area configured to receive a manual input from a digit, said touch screen area configured to be at least one of relocated and resized on said touch screen based on an input from a sensor configured to use at least one of capacitance, proximity, acceleration, force, and a combination thereof to determine a motion influence due to at least one of vibration, shock, and turbulence.
    20. 20. A system in accordance with any one of the preceding Clauses, wherein said bezel comprises at least one of a trough and a protrusion configured to engage one or more digits of one or more hands of a user.

Claims (14)

  1. A vehicle control system (100) comprising:
    a sensor (102) configured to transmit a first input signal relative to a measured parameter of the vehicle;
    a touch screen input and display system (104) configured to transmit a second input signal relative to a manual input by a user, said touch screen input and display system comprising a planar input and viewing surface (106) having a plurality of edges (108) and a bezel (110) at least partially surrounding said surface proximate at least some of said plurality of edges, said bezel comprising a surface (112) configured to engage one or more digits of one or more hands of a user, said surface formed of an elastomeric material; and
    an input unit (118) configured to receive the transmitted first and second input signals.
  2. A system (100) in accordance with Claim 1, wherein said bezel (110) comprises a second sensor (206) configured to detect at least one of vibration, shock, and turbulence and further configured to generate an output relative to a motion component between said touch screen input and display system (104) and a user resulting from the at least one of vibration, shock, and turbulence.
  3. A system (100) in accordance with Claim 2, wherein said second sensor (206) is configured to determine a number and placement of the one or more digits using at least one of capacitance, proximity, acceleration, force, and a combination thereof.
  4. A system (100) in accordance with Claim 1, wherein said touch screen comprises a touch activated area (120) configured to receive a manual input from a digit (114), said touch screen area configured to be at least one of relocated and resized on said touch screen input and display system (104) based on an input from a second sensor (206) configured to use at least one of capacitance, proximity, acceleration, force, and a combination thereof to determine a motion influence due to at least one of vibration, shock, and turbulence.
  5. A system (100) in accordance with any one of the preceding Claims, wherein said bezel (110) comprises at least one of a trough (202) and a protrusion (204) configured to engage one or more digits (114) of one or more hands of a user.
  6. A touch screen input and display system (104) comprising:
    a touch screen comprising a planar input and viewing surface (106) having a plurality of edges (108); and
    a bezel (110) at least partially surrounding said surface proximate at least some of said plurality of edges, said bezel comprising a surface configured to engage one or more digits (114) of one or more hands of a user, said surface formed of an elastomeric material.
  7. A system (104) in accordance with Claim 6, wherein said bezel (110) comprises a sensor (206) configured to detect at least one of vibration, shock, and turbulence sensor and further configured to generate an output relative to a motion component between said touch screen and a user resulting from the at least one of vibration, shock, and turbulence.
  8. A system (104) in accordance with Claim 6, wherein said touch screen comprises a touch activated area (120) configured to receive a manual input from a digit, said touch screen area configured to be at least one of relocated and resized on said touch screen based on an input from a sensor (206) configured to use at least one of capacitance, proximity, acceleration, force, and a combination thereof to determine a motion influence due to at least one of vibration, shock, and turbulence.
  9. A system (100) in accordance with any one of Claims 6 to 8, wherein said bezel (110) comprises at least one of a trough (202) and a protrusion (204) configured to engage one or more digits (114) of one or more hands of a user.
  10. A method of improving touch screen display use during vibration and turbulence conditions comprising:
    landing at least one digit (114) of at least one hand (116) of a user on a bezel (110) at least partially surrounding a touch screen input and display device(104);
    engaging a touch activated area (120) of the touch screen input and display device with at least one other digit (114) of the at least one hand;
    determining an amount of motion influence of the at least one hand is due to at least one of vibration, shock, and turbulence associated with at least one of the touch screen input and display device and the hand; and
    adjusting the touch-activated area using the determined amount of motion influence.
  11. A method in accordance with Claim 10, wherein determining an amount of motion influence comprises measuring an amount of movement of the at least one digit with respect to the bezel.
  12. A method in accordance with Claim 11, wherein determining an amount of motion influence comprises measuring an amount of movement of the at least one digit with respect to the bezel using at least one of a capacitance parameter and a proximity parameter.
  13. A method in accordance with either of Claim 11 or 12, wherein determining an amount of motion influence comprises measuring an amount of movement of the at least one digit with respect to the bezel using at least one of an acceleration parameter and a force parameter.
  14. A method in accordance with any one of Claims 10 to 13, wherein adjusting the touch-activated area comprises at least one of relocating the touch-activated area and enlarging the touch-activated area to facilitate said engaging during the at least one of vibration, shock, and turbulence based on the determined amount of motion influence.
EP11188736.0A 2010-11-23 2011-11-11 System and method for improving touch screen display use under vibration and turbulence Active EP2455843B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US12/952,846 US9870093B2 (en) 2010-11-23 2010-11-23 System and method for improving touch screen display use under vibration and turbulence

Publications (3)

Publication Number Publication Date
EP2455843A2 true EP2455843A2 (en) 2012-05-23
EP2455843A3 EP2455843A3 (en) 2016-10-19
EP2455843B1 EP2455843B1 (en) 2022-01-19

Family

ID=45044369

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11188736.0A Active EP2455843B1 (en) 2010-11-23 2011-11-11 System and method for improving touch screen display use under vibration and turbulence

Country Status (5)

Country Link
US (1) US9870093B2 (en)
EP (1) EP2455843B1 (en)
JP (1) JP6030829B2 (en)
BR (1) BRPI1105232A2 (en)
CA (1) CA2757793C (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014089202A1 (en) * 2012-12-04 2014-06-12 L3 Communications Corporation Touch sensor controller responsive to environmental operating conditions
WO2015136348A1 (en) * 2014-03-11 2015-09-17 Toyota Jidosha Kabushiki Kaisha Operating device for vehicle
WO2016102296A3 (en) * 2014-12-22 2016-08-18 Volkswagen Ag Finger-operated control bar, and use of said control bar
GB2551520A (en) * 2016-06-20 2017-12-27 Ge Aviat Systems Ltd Correction of vibration-induced error for touch screen display in an aircraft
EP3557371A1 (en) * 2018-04-18 2019-10-23 GE Aviation Systems Limited Touch screen display with stabilizing feature
GB2577480A (en) * 2018-09-11 2020-04-01 Ge Aviat Systems Ltd Touch screen display assembly and method of operating vehicle having same
EP3237249B1 (en) * 2014-12-22 2020-04-22 Volkswagen Aktiengesellschaft Transportation means, user interface and method for overlapping the display of display contents over two display devices

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130033433A1 (en) * 2011-08-02 2013-02-07 Honeywell International Inc. Touch screen having adaptive input requirements
US9785291B2 (en) 2012-10-11 2017-10-10 Google Inc. Bezel sensitive touch screen system
US8825234B2 (en) * 2012-10-15 2014-09-02 The Boeing Company Turbulence mitigation for touch screen systems
WO2014194192A1 (en) 2013-05-30 2014-12-04 David Andrews Multi-dimensional trackpad
US10180723B2 (en) * 2013-10-08 2019-01-15 Joyson Safety Systems Acquisition Llc Force sensor with haptic feedback
US9229529B2 (en) * 2013-12-19 2016-01-05 Sony Corporation Apparatus and control method based on motion
KR102176575B1 (en) 2013-12-30 2020-11-09 삼성전자주식회사 Electronic device and method for sensing inputs
US20150242039A1 (en) * 2014-02-25 2015-08-27 Sony Corporation Compensation of distorted digital ink strokes caused by motion of the mobile device receiving the digital ink strokes
US9348446B1 (en) * 2014-06-25 2016-05-24 Rockwell Collins, Inc. Bezel for vehicular touchscreen displays
US10466826B2 (en) 2014-10-08 2019-11-05 Joyson Safety Systems Acquisition Llc Systems and methods for illuminating a track pad system
JP2016115011A (en) 2014-12-11 2016-06-23 トヨタ自動車株式会社 Touch operation detection device
US10025406B2 (en) * 2015-09-14 2018-07-17 The Boeing Company Touch screen bezel design for use in aviation operations
USD822030S1 (en) * 2016-06-29 2018-07-03 Rockwell Collins, Inc. Display bezel
US10705731B2 (en) * 2017-08-17 2020-07-07 The Boeing Company Device operational control systems and methods
FR3083628B1 (en) 2018-07-05 2020-06-12 Thales VISUALIZATION DEVICE WITH TOUCH SCREEN COMPRISING A FINGER HOLDER
US20210188383A1 (en) * 2019-12-20 2021-06-24 Polaris Industries Inc. Snowmobile control system
CN115176216B (en) 2019-12-30 2025-10-31 乔伊森安全系统收购有限责任公司 System and method for intelligent waveform interrupt
US11533813B1 (en) * 2021-07-21 2022-12-20 Rockwell Collins, Inc. Touchscreen display panel gripping mechanism and bezel
US12026340B1 (en) 2023-04-20 2024-07-02 Rockwell Collins, Inc. System including touchscreen display computing device having adjustable sensitivity and method therefor
JP7816298B2 (en) * 2023-06-23 2026-02-18 トヨタ自動車株式会社 Vehicle input device
JP2025003208A (en) * 2023-06-23 2025-01-09 トヨタ自動車株式会社 Vehicle display device
US12493382B2 (en) * 2023-10-27 2025-12-09 Honeywell International Inc. Systems, apparatuses, methods, and computer program products for motion stabilized touch control
US12615439B2 (en) * 2024-05-08 2026-04-28 Stoneridge Electronics Ab Camera monitoring system including HMI-based panning features

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6512513B2 (en) 1919-04-01 2003-01-28 Wacom Co., Ltd. Pointer for use in digitizer systems
JPH01187626A (en) 1988-01-21 1989-07-27 Canon Inc Electronic equipment
US20060284839A1 (en) * 1999-12-15 2006-12-21 Automotive Technologies International, Inc. Vehicular Steering Wheel with Input Device
JPH10240420A (en) 1997-02-27 1998-09-11 Toshiba Corp Portable information devices using pen input
KR100595926B1 (en) * 1998-01-26 2006-07-05 웨인 웨스터만 Method and apparatus for integrating manual input
US6639577B2 (en) 1998-03-04 2003-10-28 Gemstar-Tv Guide International, Inc. Portable information display device with ergonomic bezel
US6104969A (en) 1998-12-30 2000-08-15 Honeywell International Inc. Methods and apparatus for operating an input device in a turbulent environment
US6317114B1 (en) 1999-01-29 2001-11-13 International Business Machines Corporation Method and apparatus for image stabilization in display device
JP2000305477A (en) 1999-04-20 2000-11-02 Nec Shizuoka Ltd Mounting structure of panel
JP3818046B2 (en) 2000-10-31 2006-09-06 株式会社デンソー Portable information equipment
JP2002175155A (en) 2000-12-08 2002-06-21 Olympus Optical Co Ltd Portable terminal
US7030861B1 (en) 2001-02-10 2006-04-18 Wayne Carl Westerman System and method for packing multi-touch gestures onto a hand
JP2003233059A (en) 2002-02-13 2003-08-22 Mitsubishi Electric Corp Touch panel display
US6900795B1 (en) 2002-02-27 2005-05-31 Knight, Iii Jack Unitary molded lens filter for touch screen interface
US7656393B2 (en) * 2005-03-04 2010-02-02 Apple Inc. Electronic device having display and surrounding touch sensitive bezel for user interface and control
US7224345B2 (en) * 2003-10-30 2007-05-29 Pepper Computer, Inc. Pad computer
US7460111B2 (en) 2005-03-02 2008-12-02 Microsoft Corporation Computer input device
JP2006244154A (en) 2005-03-03 2006-09-14 Denso Corp Display input device and display device
CN101137276B (en) 2006-09-01 2011-12-14 鸿富锦精密工业(深圳)有限公司 Portable protection box
US7843427B2 (en) 2006-09-06 2010-11-30 Apple Inc. Methods for determining a cursor position from a finger contact with a touch screen display
JP2008195142A (en) 2007-02-09 2008-08-28 Aisin Aw Co Ltd Operation supporting device and method for on-vehicle equipment
JP4966764B2 (en) 2007-06-27 2012-07-04 パイオニア株式会社 Touch panel display device and touch panel control method
KR100950234B1 (en) * 2007-07-06 2010-03-29 한국표준과학연구원 Implementation method of mouse algorithm using pressure sensor
US8692767B2 (en) 2007-07-13 2014-04-08 Synaptics Incorporated Input device and method for virtual trackball operation
US8154523B2 (en) * 2007-12-13 2012-04-10 Eastman Kodak Company Electronic device, display and touch-sensitive user interface
US7933123B2 (en) 2008-04-11 2011-04-26 Apple Inc. Portable electronic device with two-piece housing
US20090273583A1 (en) * 2008-05-05 2009-11-05 Sony Ericsson Mobile Communications Ab Contact sensitive display
DE112009003647B4 (en) 2008-12-04 2015-08-20 Mitsubishi Electric Corp. Vehicle-mounted information device
JP2010157060A (en) 2008-12-26 2010-07-15 Sony Corp Display device
US8957865B2 (en) 2009-01-05 2015-02-17 Apple Inc. Device, method, and graphical user interface for manipulating a user interface object
CN102150115B (en) 2009-02-06 2014-06-11 松下电器产业株式会社 image display device
JP2010191892A (en) 2009-02-20 2010-09-02 Sony Corp Information processing apparatus, display control method, and program
FR2952466B1 (en) * 2009-11-10 2012-08-17 Airbus Operations Sas METHOD FOR ADAPTING DISPLAY PARAMETERS OF A DISPLAY DEVICE, IN PARTICULAR ON BOARD IN AN AIRCRAFT
US8209630B2 (en) * 2010-01-26 2012-06-26 Apple Inc. Device, method, and graphical user interface for resizing user interface content
US8456445B2 (en) * 2010-04-30 2013-06-04 Honeywell International Inc. Touch screen and method for adjusting screen objects
US20120105335A1 (en) * 2010-11-03 2012-05-03 Honeywell International Inc. Touch screen display assembly

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9442587B2 (en) 2012-12-04 2016-09-13 L-3 Communications Corporation Touch sensor controller responsive to environmental operating conditions
WO2014089202A1 (en) * 2012-12-04 2014-06-12 L3 Communications Corporation Touch sensor controller responsive to environmental operating conditions
WO2015136348A1 (en) * 2014-03-11 2015-09-17 Toyota Jidosha Kabushiki Kaisha Operating device for vehicle
EP3237249B1 (en) * 2014-12-22 2020-04-22 Volkswagen Aktiengesellschaft Transportation means, user interface and method for overlapping the display of display contents over two display devices
US20180267637A1 (en) * 2014-12-22 2018-09-20 Volkswagen Ag Finger-operated control bar, and use of the finger-operated control bar
WO2016102296A3 (en) * 2014-12-22 2016-08-18 Volkswagen Ag Finger-operated control bar, and use of said control bar
GB2551520A (en) * 2016-06-20 2017-12-27 Ge Aviat Systems Ltd Correction of vibration-induced error for touch screen display in an aircraft
GB2551520B (en) * 2016-06-20 2018-11-21 Ge Aviat Systems Ltd Correction of vibration-induced error for touch screen display in an aircraft
US10996793B2 (en) 2016-06-20 2021-05-04 Ge Aviation Systems Limited Correction of vibration-induced error for touch screen display in an aircraft
EP3557371A1 (en) * 2018-04-18 2019-10-23 GE Aviation Systems Limited Touch screen display with stabilizing feature
GB2577480A (en) * 2018-09-11 2020-04-01 Ge Aviat Systems Ltd Touch screen display assembly and method of operating vehicle having same
US10838554B2 (en) 2018-09-11 2020-11-17 Ge Aviation Systems Limited Touch screen display assembly and method of operating vehicle having same
GB2577480B (en) * 2018-09-11 2022-09-07 Ge Aviat Systems Ltd Touch screen display assembly and method of operating vehicle having same

Also Published As

Publication number Publication date
BRPI1105232A2 (en) 2017-11-21
US20120127115A1 (en) 2012-05-24
JP2012113711A (en) 2012-06-14
CA2757793C (en) 2018-05-15
EP2455843B1 (en) 2022-01-19
EP2455843A3 (en) 2016-10-19
CN102609125A (en) 2012-07-25
JP6030829B2 (en) 2016-11-24
CA2757793A1 (en) 2012-05-23
US9870093B2 (en) 2018-01-16

Similar Documents

Publication Publication Date Title
CA2757793C (en) System and method for improving touch screen display use under vibration and turbulence
CN102866797B (en) Touch-screen and method for providing stable touch
TWI514234B (en) Method and apparatus for gesture recognition
US20110187651A1 (en) Touch screen having adaptive input parameter
WO2007103631A3 (en) Electronic device having display and surrounding touch sensitive bezel for user interface and control
US9019217B2 (en) Touch input location correction device, input device, touch input location correction method, and program and integrated circuit used for touch input location correction apparatus
US20100053099A1 (en) Method for reducing latency when using multi-touch gesture on touchpad
KR20140138361A (en) Loop-shaped Tactile Multi-Touch Input Device, Gestures And The Methods
US20150253952A1 (en) Vehicle operation apparatus
US20100271301A1 (en) Input processing device
JP2012079279A (en) Information processing apparatus, information processing method and program
EP2343632A1 (en) Touch panel device operating as if in the equivalent mode even when detected region is smaller than display region of display device
CN110888546B (en) Touch screen display assembly and method of operating a vehicle having a touch screen display assembly
EP2780785A1 (en) Method and apparatus for performing a zooming action
US20200356226A1 (en) Electronic apparatus and display method for touch proximity detection
KR101558284B1 (en) Touch sensing device utilizing assist device and method for operating the same
US10481645B2 (en) Secondary gesture input mechanism for touchscreen devices
KR101899916B1 (en) Method for controlling a display device at the edge of an information element to be displayed
EP4383053A1 (en) Input display device
KR20190040868A (en) Touch-screen system with easy operation of one hand and providing method thereof
CN102609125B (en) For improving the system and method that the touch-screen display under vibration and turbulent flow uses
WO2024232150A1 (en) Non-contact input device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/041 20060101AFI20160913BHEP

Ipc: B60K 37/06 20060101ALI20160913BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170419

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20190318

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20210817

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011072417

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1464176

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220215

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20220119

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1464176

Country of ref document: AT

Kind code of ref document: T

Effective date: 20220119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220519

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220419

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220419

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220420

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220519

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602011072417

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

26N No opposition filed

Effective date: 20221020

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230414

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20221130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221130

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20221130

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20111111

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20220119

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20251022

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20251023

Year of fee payment: 15

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20251022

Year of fee payment: 15