WO2005015376A1 - User interface with display - Google Patents

User interface with display Download PDF

Info

Publication number
WO2005015376A1
WO2005015376A1 PCT/IB2004/051306 IB2004051306W WO2005015376A1 WO 2005015376 A1 WO2005015376 A1 WO 2005015376A1 IB 2004051306 W IB2004051306 W IB 2004051306W WO 2005015376 A1 WO2005015376 A1 WO 2005015376A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
user interface
elements
subconstruction
user
Prior art date
Application number
PCT/IB2004/051306
Other languages
French (fr)
Inventor
Jürgen TE VRUGT
Original Assignee
Philips Intellectual Property & Standards Gmbh
Koninklijke Philips Electronics N. V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Philips Intellectual Property & Standards Gmbh, Koninklijke Philips Electronics N. V. filed Critical Philips Intellectual Property & Standards Gmbh
Publication of WO2005015376A1 publication Critical patent/WO2005015376A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0238Programmable keyboards
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04809Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H2215/00Tactile feedback
    • H01H2215/05Tactile feedback electromechanical
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H2217/00Facilitation of operation; Human engineering
    • H01H2217/014Facilitation of operation; Human engineering handicapped
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H2231/00Applications
    • H01H2231/016Control panel; Graphic display; Programme control

Definitions

  • the invention relates to a user interface with a display, in particular a touch display, and also to a technical device or system equipped with said interface.
  • User interfaces with touch displays are being used more and more frequently in both the public and private sectors.
  • Such a touch display combines the functions of an input medium and an output medium.
  • On the touch display as in the case of other conventional displays, information is output optically and graphically. If the surface of such a touch display is touched, the position where it was touched is evaluated and the screen cursor is accordingly moved or a command is carried out.
  • touch display are used for example in tablet PCs, which can already take the position of a full PC, and in PDAs (Personal Digital Assistants), which are used for mobile uses for example for scheduling and navigation.
  • PDAs Personal Digital Assistants
  • touch displays are used for example at cash machines, ticket machines or information points.
  • Touch displays conventionally have a continuous display surface. The surfaces are in this case usually coated and made of hardened material. Use in daylight is thus facilitated and the display is protected from scratches.
  • One disadvantage of known touch displays is that a user, once he has been prompted to touch a certain area of the display in order to carry out an action, does not detect, as in conventional input devices (e.g. keyboard), whether the touching of the display has been recognized by the user interface. This makes the user uncertain and makes use of the input medium more difficult.
  • a transparent, application- specific key field that is adapted to the device may be provided above the display.
  • the at least partially flexible and/or partially movable subconstruction that interacts with the display may have various functions and be designed in various ways.
  • the display which acts as an optical output surface of the user interface may be designed in various ways .
  • the display may for example be a display without a touch function, wherein the subconstruction arranged below the display is then designed to carry out switching functions and at the same time provides the user with detectable feedback.
  • the display may be a touch display, wherein the subconstruction is then designed for example only to provide the user with detectable feedback.
  • the subconstruction may also be used to raise or lower individual display areas, e.g. for a specific "key operation" or function area operation, so that they can be detected more easily by the user.
  • the display may be divided completely independently of the subconstruction. That is to say the size and position for a switching function area on the display may be newly individually defined completely freely and in an extremely variable manner at any point in time and at the same time accordingly displayed to the user on the display.
  • a conventional input device e.g. keyboard
  • the subconstruction arranged below the display has a switching function in order to trigger command signals.
  • the subconstruction may for example consist of a large number of movable, preferably mechanical, elements which act as switches.
  • the switches are moved out of an initial position by the display being partially pressed down perpendicular to the display surface.
  • selected elements may be blocked, with the remaining elements still having a switching function.
  • selected elements are brought into a raised position and function from this position as pressure switches and possibly additionally as a navigation aid. If, moreover, the remaining elements are blocked, inadvertent operation thereof is prevented.
  • the elements in a raised position have the advantage that they can be more easily found by the user and used blind. Such an input medium can therefore be used in applications for blind people.
  • a number of elements can be combined with one another to form a large switching function area by corresponding symbols being displayed on the display, as a result of which they function jointly as one switch, and this for example increases the certainty with which the user hits it.
  • the elements preferably act as mechanical switches, for example as vertically acting rams, which has the advantage that they can be implemented relatively easily in technical terms.
  • Other embodiments, such as magnetic switches for example, are nevertheless likewise conceivable, especially as the magnetic forces offer detectable pressure resistance for the user.
  • a switching function is performed by the display itself in that the display is designed as a touch display which triggers the corresponding command signals when it is touched.
  • the subconstruction below the display need not necessarily have a switching function, although an additional switching function is not ruled out and in special applications may even be advantageous.
  • the subconstruction arranged below the display in any case provides the user with detectable feedback when the touch display is pressed down upon contact.
  • the subconstruction may consist of a large number of movable elements. These are preferably mechanical elements and act as switches which provide the user with detectable feedback.
  • the elements may in turn be blocked when they are inactive for example, or be brought into a raised position in order for example to make active display fields detectable by touch. In one development, the elements in a raised position may additionally be blocked so that although active display fields can be detected by touch, no detectable feedback is provided upon operation.
  • the display may be used as a pure touch display when all the elements are blocked in their initial position.
  • the display may consist both of solid and of flexible material. Displays made of solid material are divided into sections which are independent of one another, whereas displays made of flexible material are preferably designed as one surface.
  • the particular advantage of a display that is divided into sections is that the display sections are detectable to the user not only on account of being shown in the display but also on account of the physical division, which serves for better orientation and operability.
  • the advantage of continuous displays is that they are more resistant to dirt and other external influences since the dirt cannot pass so easily between the display and the subconstruction arranged therebelow. Depending on the application, each of the abovementioned displays may thus be more advantageous.
  • the subconstruction arranged below the display may also be designed as a pressure-sensitive layer that performs a switching function.
  • This layer may for example have electronic sensors.
  • the subconstructions may also comprise a combination of such a pressure-sensitive layer and individual movable elements - with or without their own switching function.
  • the display is preferably designed as a continuous display.
  • Fig. 1 shows a display made of solid material which is divided into sections, with mechanical elements located below the display.
  • Fig. 2 shows a cross section through the display of Fig. 1, with one mechanical element pressed down.
  • Fig. 3 shows a cross section through the display of Fig. 1, with one mechanical element in a raised position.
  • Fig. 4 shows a display made of continuous flexible material, with mechanical elements located below the display.
  • Fig. 5 shows a cross section through the display of Fig. 4, with one mechanical element pressed down.
  • Fig. 6 shows a cross section through the display of Fig. 4, with one mechanical element in a raised position.
  • Fig. 7 shows a display with a pressure-sensitive layer located below the display.
  • Fig. 8 shows a display with a pressure-sensitive layer lying below it as in Fig. 7 and mechanical elements arranged below the latter, with one of the elements shown in the pressed-down state.
  • Fig. 9 shows a display as in Fig. 8, but with the mechanical element being shown in the raised position.
  • Fig. 1 shows a display 1 according to a first example of embodiment of the invention, said display being made of solid material which is divided into sections 2 that are independent of one another.
  • the sections 2 can be partially displaced pe ⁇ endicular to the display surface.
  • Below the display 1 there is a subconstruction consisting of mechanical elements 3, which subconstruction interacts with the display when the display 1 is displaced in sections.
  • the sections 2 preferably have the same size and shape, but division into different shapes and sizes is not ruled out.
  • the mechanical elements 3 have a switching function and in the specific example of embodiment are designed as switching rams. An element is switched when a user exerts an operating pressure on the corresponding section 2 of the display 1 which lies above the element. The element 3 is automatically displaced back into the initial position following activation, e.g.
  • a conventional input device e.g. an in particular freely operable keyboard
  • a display can be simulated and combined with a display. That is to say the user receives detectable feedback when a section 2 is operated.
  • Such an arrangement can be used for example at a customer terminal of a bank, where a different display image is generated depending on whether the user wishes to withdraw money, make transfers or carry out some other banking business.
  • the inputting of for example the pu ⁇ ose in the case of a transfer, which may consist of a long combination of characters, may be made particularly simple and convenient by the simulation of a conventional keyboard.
  • Fig. 2 shows a cross section through Fig.
  • Fig. 3 shows a cross section through Fig. 1 according to a further refinement of the first example of embodiment.
  • the mechanical elements 3, which in this case too also have a switching function, can be activated automatically by selected elements, which are required for example for a specific application, being brought into a raised position in order as a result to raise the display section 2 lying above them.
  • one section 2 can be seen in the raised position, which can then be pressed down by a user.
  • This refinement is particularly suitable for user interfaces suitable for the blind, since a blind person can orient himself to the raised elements 3 on the display 1 without any problem.
  • Such an arrangement may additionally be equipped with the function that, when a section 2 is pressed down, an acoustic or optical signal is sent out depending on the position of the element.
  • an element 3, which is to be operated once at most according to one application is no longer displaced back into the raised position following the first activation but rather is blocked in the initial position.
  • the elements 3 may be blocked individually in their initial position.
  • FIG. 4 shows a second example of embodiment of the invention, which differs from the previous example in that the display 4 is made of flexible material in a continuous manner.
  • the mechanical elements 3, which have a switching function it may be possible for the mechanical elements 3, which have a switching function, to be activated differently. That is to say the elements 3 can in the simplest variant be pressed down out of their initial position as a switch (Figs. 4 and 5). According to another variant, selected elements can be pressed down out of a raised position as a switch (Fig.
  • Figs. 5 and 6 in each case show a cross section of Fig. 4. Since a continuous display 4 is less susceptible to soiling and other external influences, use of the second example of embodiment in industry is conceivable. Such a user interface is suitable in particular for devices and as operating elements for machines which are used under extreme environmental conditions, in particular where there is a high level of moisture or wetness with a high occurrence of dust such as in a sawmill, etc. If the display areas to be used for a respective application protrude considerably by automatic raising of the elements 3, the display 4 may also be used for example when the user is wearing safety gloves.
  • the display is an E Ink display.
  • E Ink materials are materials which can be optically changed by an electric field.
  • One example of embodiment of this is materials which have films with microcapsules in which freely movable or rotatable particles are dispersed.
  • These particles have two halves which are of different color and at the same time have different electrical properties, for example on one side bear a positive electrical charge and on the other side bear a negative electrical charge.
  • the particles align accordingly in an electric field.
  • a large number of colored particles are dispersed in the manner of a powder in individual microcapsules.
  • two different types of powder particles will be used which have different colors and different electrical charges.
  • one type of particle moves in the field direction and the other type moves counter to the field direction. With both methods, it is possible for differently colored or black or white areas and thus any desired information to be displayed on the surface of the material.
  • the particles remain in their preset alignment or position until a new field is applied.
  • the materials are also referred to as so-called "electronic paper” or “e-paper” and are currently used for example to produce electronic price tickets on supermarket shelves.
  • This type of display can be produced in a cost-effective manner and has a relatively low energy consumption, particularly in uses where the information displayed on the display is not continuously changed.
  • the variant is therefore very particularly suitable for producing a keyboard-like user interface which is sealed with respect to the outside and has variable function area operation, which is displayed directly in the respective function area. Since the material can be produced as a flexible display film, it is particularly suitable for the second example of embodiment (Figs. 4 to 6).
  • the subconstruction, which interacts with the display 4 does not itself have a switching function. Rather, the display is a touch display.
  • the switching function device is located above the actual display layer, for example in the form of a sensor field.
  • the key operation is displayed on the touch display and upon use of a specific section the touch display triggers the respective signal.
  • the subconstruction below the touch display may be formed by mechanical elements which can be pressed down order to provide detectable feedback or which can be raised and pressed down in order to considerably stand out for the user, and which can possibly be blocked individually in order to make it clear to the user that the display area is inactive. When all the elements 3 are blocked in their initial position, the display is even a pure touch display.
  • Such a display may be used for example in a PDA (Personal Digital Assistant) which supports character recognition.
  • PDA Personal Digital Assistant
  • the elements 3 can be moved from their initial position or can be moved from a raised position.
  • only selected areas of the touch display are raised and blocked by automatic activation of the elements below the respective areas.
  • the raised areas of the display then function as a pure touch display without detectable feedback. Operation of such a touch display is, however, clearer and considerably simplified in comparison to conventional touch displays.
  • Fig. 7 shows a fourth example of embodiment.
  • a pressure-sensitive layer 5 that performs a switching function is provided as subconstruction directly below a display 4 made of flexible material.
  • This layer 5 interacts with the display when the display 4 is displaced.
  • the layer 5 registers in particular the precise location of the operating pressure exerted on the display by the user, and forwards the location coordinates in order to carry out the respective action.
  • the layer 5 is preferably elastic, so that the relevant area of the display 4 automatically moves back into its initial position.
  • the subconstruction (3, 5) below the pressure-sensitive layer 5 has additional mechanical elements 3 which interact with the layer 5 and the display 4. These elements 3 in this case have no switching function and can be activated differently as in the previous examples of embodiments.
  • the elements 3 can thus either be operated from their initial position (Fig. 8) or be moved into a raised position and operated from there (Fig. 9) or else blocked in the raised position and/or in the initial position. Since such arrangements are easy to clean and disinfect, use of such displays for example in the medical sector is conceivable.
  • the user interface described with reference to the above examples of embodiments may be used in any devices. It may in particular also be used in a system comprising a number of system components in order to control the system components via the same user interface, for example in a so-called home network. The user can then jointly control for example the television, the video recorder, the stereo system, the lights and other subconstructions via a single user interface according to the invention.
  • the user interfaces shown in the figures and in the description are merely examples of embodiments which can be varied widely by the person skilled in the art without departing from the scope of the invention.
  • the precise structures of the subconstruction can be modified in many details.
  • the switching function elements may also be designed as magnetic elements. These elements also do not necessarily have to be displaced exactly pe ⁇ endicular to the display surface when an operating pressure is exerted by a user, but rather may also additionally be displaced laterally for example.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

A description is given of a user interface with a display (1, 4), in particular a touch display, which can be partially displaced perpendicular to the display surface. Below the display (1, 4) there is arranged a subconstruction (3, 5) which interacts with the display (1, 4) when the display (1, 4) is displaced. By means of the subconstruction (3, 5), the user receives detectable feedback about the operating process and/or the subconstruction (3, 5) serves to raise and/or block individual display areas.

Description

User interface with display
The invention relates to a user interface with a display, in particular a touch display, and also to a technical device or system equipped with said interface. User interfaces with touch displays are being used more and more frequently in both the public and private sectors. Such a touch display combines the functions of an input medium and an output medium. On the touch display, as in the case of other conventional displays, information is output optically and graphically. If the surface of such a touch display is touched, the position where it was touched is evaluated and the screen cursor is accordingly moved or a command is carried out. In the private sector, such displays are used for example in tablet PCs, which can already take the position of a full PC, and in PDAs (Personal Digital Assistants), which are used for mobile uses for example for scheduling and navigation. In the public sector, such touch displays are used for example at cash machines, ticket machines or information points. Touch displays conventionally have a continuous display surface. The surfaces are in this case usually coated and made of hardened material. Use in daylight is thus facilitated and the display is protected from scratches. One disadvantage of known touch displays is that a user, once he has been prompted to touch a certain area of the display in order to carry out an action, does not detect, as in conventional input devices (e.g. keyboard), whether the touching of the display has been recognized by the user interface. This makes the user uncertain and makes use of the input medium more difficult. In order that the user receives detectable feedback, a transparent, application- specific key field that is adapted to the device may be provided above the display. In this case, use of the keyboard would in each case be displayed dynamically on the display section lying therebelow, and the user command would be transmitted by means of the keys to the touch display. Such a design would, however, be quite invariable on account of the key field that is adapted to the device. Furthermore, transmission problems could arise on account of dirt between the keyboard and the display. Moreover, a transparent keyboard fitted above a display reduces the brightness of the display. It is therefore an object of the invention to provide a variable user interface with a display, said user interface being convenient to operate. This object is achieved by a user interface with a display, which can be partially displaced perpendicular to the display surface, and a subconstruction which is arranged below the display and interacts with the display when the display is partially displaced. The at least partially flexible and/or partially movable subconstruction that interacts with the display may have various functions and be designed in various ways. Likewise, the display which acts as an optical output surface of the user interface may be designed in various ways . The display may for example be a display without a touch function, wherein the subconstruction arranged below the display is then designed to carry out switching functions and at the same time provides the user with detectable feedback. On the other hand, the display may be a touch display, wherein the subconstruction is then designed for example only to provide the user with detectable feedback. In both cases, the subconstruction may also be used to raise or lower individual display areas, e.g. for a specific "key operation" or function area operation, so that they can be detected more easily by the user. Since the subconstruction is arranged below the display, in each of the abovementioned variants the display may be divided completely independently of the subconstruction. That is to say the size and position for a switching function area on the display may be newly individually defined completely freely and in an extremely variable manner at any point in time and at the same time accordingly displayed to the user on the display. A conventional input device (e.g. keyboard) is simulated by the possible detectable feedback, and this makes operation more convenient. By raising and or blocking individual display areas by means of the subconstruction, operation of the interface is made easier. According to a first aspect of the invention, the subconstruction arranged below the display has a switching function in order to trigger command signals. The subconstruction may for example consist of a large number of movable, preferably mechanical, elements which act as switches. The switches are moved out of an initial position by the display being partially pressed down perpendicular to the display surface. In one development selected elements may be blocked, with the remaining elements still having a switching function. In another development selected elements are brought into a raised position and function from this position as pressure switches and possibly additionally as a navigation aid. If, moreover, the remaining elements are blocked, inadvertent operation thereof is prevented. The elements in a raised position have the advantage that they can be more easily found by the user and used blind. Such an input medium can therefore be used in applications for blind people. Depending on the division of the display, a number of elements can be combined with one another to form a large switching function area by corresponding symbols being displayed on the display, as a result of which they function jointly as one switch, and this for example increases the certainty with which the user hits it. The elements preferably act as mechanical switches, for example as vertically acting rams, which has the advantage that they can be implemented relatively easily in technical terms. Other embodiments, such as magnetic switches for example, are nevertheless likewise conceivable, especially as the magnetic forces offer detectable pressure resistance for the user. According to a second aspect of the invention, a switching function is performed by the display itself in that the display is designed as a touch display which triggers the corresponding command signals when it is touched. In this case, the subconstruction below the display need not necessarily have a switching function, although an additional switching function is not ruled out and in special applications may even be advantageous. The subconstruction arranged below the display in any case provides the user with detectable feedback when the touch display is pressed down upon contact. In this case, too, the subconstruction may consist of a large number of movable elements. These are preferably mechanical elements and act as switches which provide the user with detectable feedback. The elements may in turn be blocked when they are inactive for example, or be brought into a raised position in order for example to make active display fields detectable by touch. In one development, the elements in a raised position may additionally be blocked so that although active display fields can be detected by touch, no detectable feedback is provided upon operation. In particular, the display may be used as a pure touch display when all the elements are blocked in their initial position. The display may consist both of solid and of flexible material. Displays made of solid material are divided into sections which are independent of one another, whereas displays made of flexible material are preferably designed as one surface. The particular advantage of a display that is divided into sections is that the display sections are detectable to the user not only on account of being shown in the display but also on account of the physical division, which serves for better orientation and operability. The advantage of continuous displays is that they are more resistant to dirt and other external influences since the dirt cannot pass so easily between the display and the subconstruction arranged therebelow. Depending on the application, each of the abovementioned displays may thus be more advantageous. The subconstruction arranged below the display may also be designed as a pressure-sensitive layer that performs a switching function. This layer may for example have electronic sensors. Likewise, the subconstructions may also comprise a combination of such a pressure-sensitive layer and individual movable elements - with or without their own switching function. When using such a pressure-sensitive layer for the subconstruction, the display is preferably designed as a continuous display.
The invention will be further described with reference to examples of embodiments shown in the drawings to which, however, the invention is not restricted. Identical components bear the same references in the figures. Fig. 1 shows a display made of solid material which is divided into sections, with mechanical elements located below the display. Fig. 2 shows a cross section through the display of Fig. 1, with one mechanical element pressed down. Fig. 3 shows a cross section through the display of Fig. 1, with one mechanical element in a raised position. Fig. 4 shows a display made of continuous flexible material, with mechanical elements located below the display. Fig. 5 shows a cross section through the display of Fig. 4, with one mechanical element pressed down. Fig. 6 shows a cross section through the display of Fig. 4, with one mechanical element in a raised position. Fig. 7 shows a display with a pressure-sensitive layer located below the display. Fig. 8 shows a display with a pressure-sensitive layer lying below it as in Fig. 7 and mechanical elements arranged below the latter, with one of the elements shown in the pressed-down state. Fig. 9 shows a display as in Fig. 8, but with the mechanical element being shown in the raised position.
Fig. 1 shows a display 1 according to a first example of embodiment of the invention, said display being made of solid material which is divided into sections 2 that are independent of one another. The sections 2 can be partially displaced peφendicular to the display surface. Below the display 1 there is a subconstruction consisting of mechanical elements 3, which subconstruction interacts with the display when the display 1 is displaced in sections. The sections 2 preferably have the same size and shape, but division into different shapes and sizes is not ruled out. The mechanical elements 3 have a switching function and in the specific example of embodiment are designed as switching rams. An element is switched when a user exerts an operating pressure on the corresponding section 2 of the display 1 which lies above the element. The element 3 is automatically displaced back into the initial position following activation, e.g. by a bias spring or an automatic system. With the display according to this first embodiment, a conventional input device (e.g. an in particular freely operable keyboard) can be simulated and combined with a display. That is to say the user receives detectable feedback when a section 2 is operated. Such an arrangement can be used for example at a customer terminal of a bank, where a different display image is generated depending on whether the user wishes to withdraw money, make transfers or carry out some other banking business. The inputting of for example the puφose in the case of a transfer, which may consist of a long combination of characters, may be made particularly simple and convenient by the simulation of a conventional keyboard. Fig. 2 shows a cross section through Fig. 1, wherein one section of the display 1 is shown in the activated, that is to say pressed-down, state. When it is activated by a user, the mechanical element 3, which has a switching function, triggers a signal for a specific action. When the element is pressed down, or at the latest when the element is displaced back into its initial state following activation, the user receives detectable feedback. Fig. 3 shows a cross section through Fig. 1 according to a further refinement of the first example of embodiment. The mechanical elements 3, which in this case too also have a switching function, can be activated automatically by selected elements, which are required for example for a specific application, being brought into a raised position in order as a result to raise the display section 2 lying above them. In Fig. 3, one section 2 can be seen in the raised position, which can then be pressed down by a user. This refinement is particularly suitable for user interfaces suitable for the blind, since a blind person can orient himself to the raised elements 3 on the display 1 without any problem. Such an arrangement may additionally be equipped with the function that, when a section 2 is pressed down, an acoustic or optical signal is sent out depending on the position of the element. One development provides that an element 3, which is to be operated once at most according to one application, is no longer displaced back into the raised position following the first activation but rather is blocked in the initial position. In a further refinement of the first example of embodiment, the elements 3 may be blocked individually in their initial position. Operation is thus further simplified for the user since upon operating an invalid section 2 - that is to say in this case a blocked section 2 - he receives as feedback the fact that the position of the section 2 has remained unchanged and consequently no action has been triggered. Fig. 4 shows a second example of embodiment of the invention, which differs from the previous example in that the display 4 is made of flexible material in a continuous manner. In this example of embodiment, too, it may be possible for the mechanical elements 3, which have a switching function, to be activated differently. That is to say the elements 3 can in the simplest variant be pressed down out of their initial position as a switch (Figs. 4 and 5). According to another variant, selected elements can be pressed down out of a raised position as a switch (Fig. 6), wherein in both variants certain switches can be blocked in their initial position in order that they cannot be operated. In this respect, Figs. 5 and 6 in each case show a cross section of Fig. 4. Since a continuous display 4 is less susceptible to soiling and other external influences, use of the second example of embodiment in industry is conceivable. Such a user interface is suitable in particular for devices and as operating elements for machines which are used under extreme environmental conditions, in particular where there is a high level of moisture or wetness with a high occurrence of dust such as in a sawmill, etc. If the display areas to be used for a respective application protrude considerably by automatic raising of the elements 3, the display 4 may also be used for example when the user is wearing safety gloves. The remaining keys may then be blocked in their initial position in order to prevent inadvertent operation thereof. In order to simplify operation, whole "operating fields", that is to say in each case a group of elements 3 which appear to the user as a single "key" by the display being configured accordingly, may be raised in order that the operating precision of the user is increased. In one preferred embodiment of the first and also the second example of embodiment, the display is an E Ink display. Such E Ink materials are materials which can be optically changed by an electric field. One example of embodiment of this is materials which have films with microcapsules in which freely movable or rotatable particles are dispersed. These particles have two halves which are of different color and at the same time have different electrical properties, for example on one side bear a positive electrical charge and on the other side bear a negative electrical charge. The particles align accordingly in an electric field. In another example of embodiment, a large number of colored particles are dispersed in the manner of a powder in individual microcapsules. In this case, two different types of powder particles will be used which have different colors and different electrical charges. In an electric field, one type of particle moves in the field direction and the other type moves counter to the field direction. With both methods, it is possible for differently colored or black or white areas and thus any desired information to be displayed on the surface of the material. The particles remain in their preset alignment or position until a new field is applied. The materials are also referred to as so-called "electronic paper" or "e-paper" and are currently used for example to produce electronic price tickets on supermarket shelves. This type of display can be produced in a cost-effective manner and has a relatively low energy consumption, particularly in uses where the information displayed on the display is not continuously changed. The variant is therefore very particularly suitable for producing a keyboard-like user interface which is sealed with respect to the outside and has variable function area operation, which is displayed directly in the respective function area. Since the material can be produced as a flexible display film, it is particularly suitable for the second example of embodiment (Figs. 4 to 6). In a third example of embodiment of the invention, the subconstruction, which interacts with the display 4, does not itself have a switching function. Rather, the display is a touch display. In touch displays, the switching function device is located above the actual display layer, for example in the form of a sensor field. The key operation is displayed on the touch display and upon use of a specific section the touch display triggers the respective signal. As has already been mentioned with reference to Figs. 1 to 3 and Figs. 4 to 6 regarding the first and second examples of embodiments, the subconstruction below the touch display may be formed by mechanical elements which can be pressed down order to provide detectable feedback or which can be raised and pressed down in order to considerably stand out for the user, and which can possibly be blocked individually in order to make it clear to the user that the display area is inactive. When all the elements 3 are blocked in their initial position, the display is even a pure touch display. Such a display may be used for example in a PDA (Personal Digital Assistant) which supports character recognition. The user is then not disturbed by the movement of the elements 3 when inputting handwriting via the touch display using suitable means. In other applications, the elements 3 can be moved from their initial position or can be moved from a raised position. In a further embodiment of the third example of embodiment, as shown in Figs. 3 and 6, only selected areas of the touch display are raised and blocked by automatic activation of the elements below the respective areas. The raised areas of the display then function as a pure touch display without detectable feedback. Operation of such a touch display is, however, clearer and considerably simplified in comparison to conventional touch displays. Fig. 7 shows a fourth example of embodiment. A pressure-sensitive layer 5 that performs a switching function is provided as subconstruction directly below a display 4 made of flexible material. This layer 5 interacts with the display when the display 4 is displaced. The layer 5 registers in particular the precise location of the operating pressure exerted on the display by the user, and forwards the location coordinates in order to carry out the respective action. Moreover, the layer 5 is preferably elastic, so that the relevant area of the display 4 automatically moves back into its initial position. In one refinement of this fourth example of embodiment, the subconstruction (3, 5) below the pressure-sensitive layer 5 has additional mechanical elements 3 which interact with the layer 5 and the display 4. These elements 3 in this case have no switching function and can be activated differently as in the previous examples of embodiments. The elements 3 can thus either be operated from their initial position (Fig. 8) or be moved into a raised position and operated from there (Fig. 9) or else blocked in the raised position and/or in the initial position. Since such arrangements are easy to clean and disinfect, use of such displays for example in the medical sector is conceivable. The user interface described with reference to the above examples of embodiments may be used in any devices. It may in particular also be used in a system comprising a number of system components in order to control the system components via the same user interface, for example in a so-called home network. The user can then jointly control for example the television, the video recorder, the stereo system, the lights and other subconstructions via a single user interface according to the invention. It should finally be pointed out once again that the user interfaces shown in the figures and in the description are merely examples of embodiments which can be varied widely by the person skilled in the art without departing from the scope of the invention. For instance, the precise structures of the subconstruction can be modified in many details. By way of example, unlike in the examples of embodiments shown, the switching function elements may also be designed as magnetic elements. These elements also do not necessarily have to be displaced exactly peφendicular to the display surface when an operating pressure is exerted by a user, but rather may also additionally be displaced laterally for example. Moreover, for the sake of completeness it should be pointed out that the use of the indefinite article "a" or "an" does not mean that the relevant features cannot be present a number of times, and that the use of the term "comprise" does not rule out the existence of other elements or steps.

Claims

CLAIMS:
1. A user interface with a display (1, 4), which can be partially displaced peφendicular to the display surface, and a subconstruction (3, 5) which is arranged below the display (1, 4) and interacts with the display when the display (1, 4) is partially displaced.
2. A user interface as claimed in claim 1, characterized in that the display (1, 4) is divided into sections (2) which can be displaced in a mechanically independent manner.
3. A user interface as claimed in claim 1, characterized in that the display (1, 4) is made entirely of flexible material.
4. A user interface as claimed in any of claims 1 to 3, characterized in that the display (1, 4) is formed at least partially of an E-Ink material.
5. A user interface as claimed in any of claims 1 to 4, characterized in that the display (1, 4) is displaced by means of the subconstruction (3, 5).
6. A user interface as claimed in claim 5, characterized in that the display (1, 4) provides a user with tangible mechanical feedback when the display (1, 4) is partially displaced by the user peφendicular to the display surface, by the display surface being pressed by the subconstruction (3, 5) against the operating pressure exerted by the user.
7. A user interface as claimed in any of claims 1 to 6, characterized in that the subconstruction (3, 5) comprises individual movable elements (3) which interact with the display (1, 4).
8. A user interface as claimed in claim 7, characterized in that the elements (3) can be individually blocked.
9. A user interface as claimed in either of claims 7 and 8, characterized in that the elements (3) can be activated automatically.
10. A user interface as claimed in any of claims 7 to 9, characterized in that the elements (3) are switching function elements.
11. A user interface as claimed in any of claims 1 to 10, characterized in that the display (1, 4) comprises a touch display.
12. A user interface as claimed in any of claims 1 to 11, characterized in that the subconstruction (3, 5) comprises a pressure-sensitive layer (5) which performs a switching function.
13. A technical device, characterized by a user interface as claimed in any of claims 1 to 12.
14. A system comprising at least two system components, characterized by a user interface as claimed in any of claims 1 to 12 for controlling the system components.
PCT/IB2004/051306 2003-08-07 2004-07-28 User interface with display WO2005015376A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP03102460.7 2003-08-07
EP03102460 2003-08-07

Publications (1)

Publication Number Publication Date
WO2005015376A1 true WO2005015376A1 (en) 2005-02-17

Family

ID=34130286

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2004/051306 WO2005015376A1 (en) 2003-08-07 2004-07-28 User interface with display

Country Status (2)

Country Link
TW (1) TW200513973A (en)
WO (1) WO2005015376A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1739526A1 (en) * 2005-07-01 2007-01-03 FESTO AG & Co Electrically operated display and control device.
EP1850359A2 (en) * 2006-04-24 2007-10-31 Volkswagen Aktiengesellschaft Reconfigurable, reshapeable pushbutton and operating panel with such a pushbutton, in particular for application in a vehicle
WO2007135127A2 (en) * 2006-05-24 2007-11-29 Bauhaus-Universität Weimar Portable computer input device featuring tactile feedback
WO2008065195A1 (en) 2006-12-01 2008-06-05 Danmarks Tekniske Universitet A keyboard
EP2012219A1 (en) 2007-06-19 2009-01-07 Research In Motion Limited Touch screen keyboard with tactile feedback, and associated method
EP2042975A1 (en) 2007-09-28 2009-04-01 NTT DoCoMo, Inc. Touch-screen
WO2009117632A1 (en) * 2008-03-21 2009-09-24 Sprint Communications Company L.P. Feedback-providing keypad for touchscreen devices
WO2010069745A1 (en) * 2008-12-15 2010-06-24 Nokia Corporation Apparatus and method for enabling a plurality of functions to be associated to a user input mechanism
CN101606116B (en) * 2006-12-01 2011-08-03 丹麦技术大学 A keyboard
EP1755024A3 (en) * 2005-08-05 2012-09-05 Sony Corporation Information input display apparatus and method
WO2012164207A1 (en) * 2011-05-30 2012-12-06 Commissariat à l'énergie atomique et aux énergies alternatives Display device having a deformable surface and position sensors
US8780060B2 (en) 2010-11-02 2014-07-15 Apple Inc. Methods and systems for providing haptic control
DE102022200966A1 (en) 2022-01-31 2023-08-03 Elektrobit Automotive Gmbh Touch screen having an electro-optical display with haptic feedback

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI643099B (en) * 2018-03-29 2018-12-01 孫仁文 Display module key structure

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2275799A (en) * 1993-03-01 1994-09-07 Mark Jonathan Lewis Keyboards
US5717423A (en) * 1994-12-30 1998-02-10 Merltec Innovative Research Three-dimensional display
EP0854412A1 (en) * 1996-12-24 1998-07-22 Ncr International Inc. Self service terminal
DE19962552A1 (en) * 1999-12-23 2001-07-12 Daimler Chrysler Ag Touch screen e.g. for motor vehicle has surface elements moved by actuator to render them tactile
US20010040558A1 (en) * 2000-05-15 2001-11-15 Roope Takala Device and method for implementing a key
DE10128908A1 (en) * 2001-06-15 2002-12-19 Christoph Doerrer Control panel or operator input field, especially for control of electronic equipment by input of complex and menu-driven commands has a multiplicity of push button elements whose function, size, shape and position can be varied
WO2003019519A1 (en) * 2001-08-24 2003-03-06 Digit Wireless, Llc Changing the visual appearance of input devices
US20030058223A1 (en) * 2001-09-21 2003-03-27 Tracy James L. Adaptable keypad and button mechanism therefor

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2275799A (en) * 1993-03-01 1994-09-07 Mark Jonathan Lewis Keyboards
US5717423A (en) * 1994-12-30 1998-02-10 Merltec Innovative Research Three-dimensional display
EP0854412A1 (en) * 1996-12-24 1998-07-22 Ncr International Inc. Self service terminal
DE19962552A1 (en) * 1999-12-23 2001-07-12 Daimler Chrysler Ag Touch screen e.g. for motor vehicle has surface elements moved by actuator to render them tactile
US20010040558A1 (en) * 2000-05-15 2001-11-15 Roope Takala Device and method for implementing a key
DE10128908A1 (en) * 2001-06-15 2002-12-19 Christoph Doerrer Control panel or operator input field, especially for control of electronic equipment by input of complex and menu-driven commands has a multiplicity of push button elements whose function, size, shape and position can be varied
WO2003019519A1 (en) * 2001-08-24 2003-03-06 Digit Wireless, Llc Changing the visual appearance of input devices
US20030058223A1 (en) * 2001-09-21 2003-03-27 Tracy James L. Adaptable keypad and button mechanism therefor

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1739526A1 (en) * 2005-07-01 2007-01-03 FESTO AG & Co Electrically operated display and control device.
KR101318579B1 (en) * 2005-08-05 2013-10-15 소니 주식회사 Information input display apparatus, information processing method, and recording medium
EP1755024A3 (en) * 2005-08-05 2012-09-05 Sony Corporation Information input display apparatus and method
EP1850359A2 (en) * 2006-04-24 2007-10-31 Volkswagen Aktiengesellschaft Reconfigurable, reshapeable pushbutton and operating panel with such a pushbutton, in particular for application in a vehicle
EP1850359A3 (en) * 2006-04-24 2009-05-13 Volkswagen Aktiengesellschaft Reconfigurable, reshapeable pushbutton and operating panel with such a pushbutton, in particular for application in a vehicle
WO2007135127A2 (en) * 2006-05-24 2007-11-29 Bauhaus-Universität Weimar Portable computer input device featuring tactile feedback
WO2007135127A3 (en) * 2006-05-24 2008-04-17 Univ Weimar Bauhaus Portable computer input device featuring tactile feedback
CN101606116B (en) * 2006-12-01 2011-08-03 丹麦技术大学 A keyboard
WO2008065195A1 (en) 2006-12-01 2008-06-05 Danmarks Tekniske Universitet A keyboard
JP2010511239A (en) * 2006-12-01 2010-04-08 ダンマークス テクニスク ユニバーシテット keyboard
US20100134420A1 (en) * 2006-12-01 2010-06-03 Danmarks Tekniske Universitet A keyboard
EP2012219A1 (en) 2007-06-19 2009-01-07 Research In Motion Limited Touch screen keyboard with tactile feedback, and associated method
EP2042975A1 (en) 2007-09-28 2009-04-01 NTT DoCoMo, Inc. Touch-screen
WO2009117632A1 (en) * 2008-03-21 2009-09-24 Sprint Communications Company L.P. Feedback-providing keypad for touchscreen devices
US8786555B2 (en) 2008-03-21 2014-07-22 Sprint Communications Company L.P. Feedback-providing keypad for touchscreen devices
WO2010069745A1 (en) * 2008-12-15 2010-06-24 Nokia Corporation Apparatus and method for enabling a plurality of functions to be associated to a user input mechanism
US8780060B2 (en) 2010-11-02 2014-07-15 Apple Inc. Methods and systems for providing haptic control
US9977498B2 (en) 2010-11-02 2018-05-22 Apple Inc. Methods and systems for providing haptic control
WO2012164207A1 (en) * 2011-05-30 2012-12-06 Commissariat à l'énergie atomique et aux énergies alternatives Display device having a deformable surface and position sensors
FR2976110A1 (en) * 2011-05-30 2012-12-07 Commissariat Energie Atomique DISPLAY DEVICE WITH DEFORMABLE SURFACE AND POSITION SENSORS
US9285841B2 (en) 2011-05-30 2016-03-15 Commissariat A L'energie Atomique Et Aux Energies Alternatives Display device having a deformable surface and position sensors
DE102022200966A1 (en) 2022-01-31 2023-08-03 Elektrobit Automotive Gmbh Touch screen having an electro-optical display with haptic feedback

Also Published As

Publication number Publication date
TW200513973A (en) 2005-04-16

Similar Documents

Publication Publication Date Title
JP7411007B2 (en) Devices with integrated interface system
EP1459245B1 (en) Display system with tactile guidance
CN101573673B (en) Back-side interface for hand-held devices
JP3906150B2 (en) Touch-sensitive display with tactile feedback
US6262717B1 (en) Kiosk touch pad
KR101234968B1 (en) Touchpad Combined With A Display And Having Proximity And Touch Sensing Capabilities
WO2005015376A1 (en) User interface with display
US20080202824A1 (en) Tilting Touch Control Panel
CN101636710A (en) The adaptable user interface and the mechanism that are used for portable electric appts
US20030016211A1 (en) Kiosk touchpad
US20030128191A1 (en) Dynamically variable user operable input device
US20090042619A1 (en) Electronic Device with Morphing User Interface
AU7870400A (en) A flexible transparent touch sensing system for electronic devices
CN109271055A (en) Electronic equipment hides input area
CN105359065A (en) Multi-function keys providing additional functions and previews of functions
CN101622589A (en) The adaptable user interface and the mechanism that are used for portable electric appts
TW200843366A (en) Multimodal adaptive user interface for a portable electronic device
CN105549755A (en) Key including capacitive sensor
KR101865300B1 (en) Method for controlling behavior of character in touch input device
CN101622590A (en) The adaptable user interface and the mechanism that are used for portable electric appts
CN102713801A (en) Solid state positive force touch sensing
JP2004138416A (en) Pressure-sensitive fingerprint sensor
EP3391185A1 (en) Low-profile pointing stick
CN107066105A (en) Electronic equipment key.backspace with the visual feedback associated with position sensing

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase