WO2003044646A2 - Digital display - Google Patents

Digital display Download PDF

Info

Publication number
WO2003044646A2
WO2003044646A2 PCT/GB2002/005146 GB0205146W WO03044646A2 WO 2003044646 A2 WO2003044646 A2 WO 2003044646A2 GB 0205146 W GB0205146 W GB 0205146W WO 03044646 A2 WO03044646 A2 WO 03044646A2
Authority
WO
WIPO (PCT)
Prior art keywords
input means
graphical representation
electronic apparatus
screen
mechanical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/GB2002/005146
Other languages
English (en)
French (fr)
Other versions
WO2003044646A3 (en
Inventor
Oliver Wallington
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
DESIGNIRIS Ltd
Original Assignee
DESIGNIRIS Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by DESIGNIRIS Ltd filed Critical DESIGNIRIS Ltd
Priority to JP2003546217A priority Critical patent/JP2005509972A/ja
Priority to US10/495,818 priority patent/US20050116941A1/en
Priority to EP02781394A priority patent/EP1444565A2/en
Priority to AU2002349109A priority patent/AU2002349109A1/en
Publication of WO2003044646A2 publication Critical patent/WO2003044646A2/en
Publication of WO2003044646A3 publication Critical patent/WO2003044646A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0362Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of one-dimensional [1D] translations or rotations of an operating part of the device, e.g. scroll wheels, sliders, knobs, rollers or belts
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H19/00Switches operated by an operating part which is rotatable about a longitudinal axis thereof and which is acted upon directly by a solid body external to the switch, e.g. by a hand
    • H01H19/005Electromechanical pulse generators
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01HELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H25/00Switches with compound movement of handle or other operating part
    • H01H25/008Operating part movable both angularly and rectilinearly, the rectilinear movement being perpendicular to the axis of angular movement
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/23Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof
    • H04M1/233Construction or mounting of dials or of equivalent devices; Means for facilitating the use thereof including a pointing device, e.g. roller key, track ball, rocker switch or joystick
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones

Definitions

  • This invention relates to a digital display, and more particularly, to a digital display for providing a human interface in electronic apparatus, such as a mobile telephone, domestic appliance or the like, to display a plurality of items of data for review and/or selection by a user.
  • electronic apparatus including a digital display means for displaying a plurality of data items thereon, the apparatus including mechanical input means for scrolling through, highlighting and/or selecting one or more of said data items, means for producing and displaying a graphical representation of one or more components or elements, said graphical representation being representative of at least a portion of said mechanical input means, or an imaginary portion, element or component thereof, and means for animating said graphical representation in accordance with mechanical operation of said input means so as to at least provide an illusion of connectivity between said input means and said graphical representation.
  • electronic apparatus including a digital display means for displaying a plurality of data items thereon, the apparatus including mechanical input means for scrolling through, highlighting and/or selecting one or more of said data items, at least a portion of said mechanical means being hidden or obscured from view externally of said apparatus, said hidden or obscured portion of said mechanical means, and/or its mechanical operation when in use, being graphically represented and/or displayed on said display means.
  • the underlying concept of the present invention is thus a literal and animated graphical link between a physical interface and the on-screen graphic being controlled thereby.
  • This provides two main benefits over the prior art, namely that it makes menu systems on (particularly) small screen devices more intuitive with more visual feedback, and that it creates a stronger perceived link between external means and on-screen information.
  • the present invention concerns the graphical representation on a display screen of an input means.
  • Some kind of visual representation of the mechanical input means is provided on the screen, which representation is animated to mimic or otherwise represent its mechanical behaviour during operation, giving the impression that the mechanical means and the animated graphic are in fact linked.
  • the mechanical input means are preferably analogue input means, such as one or more rotating wheels (having their axis of rotation movement in line with and/or perpendicular to and/or at any other angle relative to the display screen), one or more sliders (with movement in any direction relative to the screen plane, linear or otherwise), optical, field or other proximity sensing (with such sensing being theoretically possible in any direction relative to the screen plane), tilt or inclination sensing (again in any direction relative to the screen), etc.
  • analogue input means such as one or more rotating wheels (having their axis of rotation movement in line with and/or perpendicular to and/or at any other angle relative to the display screen), one or more sliders (with movement in any direction relative to the screen plane, linear or otherwise), optical, field or other proximity sensing (with such sensing being theoretically possible in any direction relative to the screen plane), tilt or inclination sensing (again in any direction relative to the screen), etc.
  • the input means may sense analogue movement, it may achieve this in
  • the animated screen graphic may be a representation of just the invisible or obscured portion of the input means but it may in addition include a representation of all or part of the visible portion(s) thereof.
  • the graphical representation of the input means need not necessarily be true representation of the input means, but may include or omit features thereof, while still giving the impression of a mechanical/graphical link between the two.
  • the animated screen graphic may include additional graphical elements on or in association with the graphical representation of the input means to give the impression of a link to other virtual elements or components.
  • a single electronic device may include one or more digital display means each including one or more input means and graphical representations thereof.
  • the mechanical input means may be geographically offset from the plane of the display screen such that any visible portion of the input means and its corresponding graphical representation appear to be lined up at the normal angle of operation of the apparatus.
  • the graphical representation of the input means displayed on the screen may include perspective and three-dimensional features so as to improve the realism of the graphical representation at least when viewed from the normal or usual angle of operation of the apparatus. Such perspective or three dimensional features may be exaggerated to enhance the illusion of realism and/or to contribute to the aesthetic appearance of the graphic environment.
  • the graphical representation of the input means as displayed on the screen is beneficially of a similar size and scale to the corresponding portion of the input means, so as to maximise the realism of the representation, a different scale or manner of operation of the input means may be provided according to requirements.
  • the graphical representation might be representative of its operation in the form of an action which is typical of the action or parameter being sensed.
  • an animated element such as a ball or the like may roll around the screen in accordance with the tilting of the apparatus.
  • the location on the screen of the 'virtual' ball is preferably such that it indicates the data item which is currently highlighted for selection or review.
  • the graphical representation of its operation may, for example, comprise a 'virtual' shadow which appears to pass over the screen as a user passes their hand thereover. Again, the location of the shadow on the screen may be indicative of the data item which is currently highlighted for selection or review.
  • the input means may comprise one or more of a plurality of different types.
  • the input means may comprise one or more sliders (linear, curved, complex curve movement, etc), or rotary sensors, for example.
  • Such sliders or rotary sensors may use:
  • strain measuring element changes electrical resistance
  • Light level sensing (light is reflected or varied by movement of slider, this is sensed and converted into either power or resistive electrical quantity).
  • Incremental electrical contacts (a plurality of contacts/electrical switches along movement axis).
  • Magnetic switching magnetic elements on or near sliding portion can be sensed to give position data, reed switches or hall effect sensing).
  • Magnetic hynamo effect moving magnetic in relation to coil to create quantity of electrical power which can be measured.
  • Piezoelectric effect pressure upon piezoelectric crystals creates measurable electrical charge which can be measured) (a few can be used to simulate multiple cam effect described above).
  • Capacitance proximity sensing (measuring position of obj ect by how much generated electric field is leaked through it, can sense proximity and position of human body parts)(also similar is using a leaking static charge).
  • the above can be mixed in many ways and can have more than one axis of sensing, eg as in the case of a joystick.
  • options 1, 2, 4 and 5 above might, in many cases, be considered to be most advantageous (in view of the fact that they do not generally increase the power consumption of the overall apparatus, although option 6 is also considered to be advantageous as it is very durable and offers great accuracy.
  • the apparatus beneficially includes computation means for determining the true position of the input means and equating such positional information to means for altering the graphical representation thereof on the display screen.
  • Such computational means may comprise, for example:
  • An electronic/electrical process can interface input means to display such that the process lies in the behaviour of the components rather than a software element. This process could be digital or analogue.
  • An electronic "processor” can interface input means to display which uses software or "data” to incrementally process the information.
  • This processor can be dedicated to the described function or in addition “process” other calculations required for the operation of the device as a whole.
  • This processor could generate the displayed graphics mathematically or access pre- made graphics in digital formation from a data storage area or device (memory), and of course, a mixture of these processes can be used.
  • Programmable electronics although primarily digital are available now with analogue/digital and digital/analogue signal converters. These often dedicated functions could be used if the sensing means has an analogue electrical output. Some displays too offer effects from an analogue input. Additional (possible) computation/interface means:
  • Analogue or digital electronic elements/components may be used in addition to primary computation means to "clean” or alter data from input means such that it is in a format more readily “understood” by computation means.
  • Typical functions would be “de-bouncing” (getting rid of contact noise) contact based sensing means, analogue to digital converts (to turn analogue data from input means into a digital form for a microprocessor/controller).
  • This element may have its own processes to create electrical signals suitable for the display. This element may also change the voltage or current aspects of the incoming electrical data such that it is at a level suitable for display device.
  • Pressing input means might also activate a back light or make a telephone call etc. This process could also be reversed in the sense that, for example, an incoming call could make graphic shake a little bit or re-activate after a sleep period.
  • the sensing and display means could be designed/electrically connected such that no computation means is required.
  • the sensing and display means could directly drive pixels/shaped elements on a display.
  • Other functions or a computational means could be connected to the interconnection between input means and display to further process the position information, but actually have no effect on the function of the idea.
  • the display means may be any one or more of the following: 1. Liquid crystal display. Uses uniform or shaped areas that generally appear black when electrically activated. Can use mask/filter effects to create illusion of colour. Can have reflective elements so that graphic is observed against a backdrop of reflected light. Can have a back light of some form. could be predominantly or partially transparent. Active areas alter level of this transparency.
  • Plurality of light emitting diodes (any shape). could be in a uniform matrix but not necessarily. Can use a range of colours. Shape of individual LED may contribute part or a whole section of displayed graphic.
  • Vacuum display A sealed transparent chamber which uses electrical reaction with contained gas to create light. Emitters of electrical charge can be shaped such that parts or whole graphics may be displayed.
  • Electro-luminescent segments shaped to form part or whole of portion of graphic. Variety of colours possible. Often used as a back light for LCD screens.
  • any of the above display means could be mixed, and/or filtered, reflected or optically altered in any other way such that the result is still a representation of the mechanical input means.
  • the present invention can be used in any electronic apparatus having a digital display screen, including washing machines, central heating controls, ovens, fridges, and other domestic appliances, electronic toys, game consoles, stereos (home/car/portable), television/stereo remote controls, and similar entertainment based appliances, clocks/watches, mobile/stationary telephones, PDA's, lap tops, etc.
  • the present invention substantially increases the user-friendliness of any electronic apparatus having a digital display screen in the sense that it gives a conceptual and visual correlation between the operation of the user-controlled input means and the data items displayed on the screen.
  • Figure 1 is a schematic front view of a mobile telephone according to an exemplary embodiment of the present invention.
  • Figure 2 is a partial view of the mobile telephone of Figure 1, with a portion of the housing omitted to illustrate the location of the mechanical input means in relation to the graphical representation thereof on the display screen;
  • Figures 3 and 4 are schematic partial views of the mobile telephone of Figure 1, illustrating the possible operation of the input means
  • Figures 5 A and 5B are front and side views of input means suitable for use in apparatus according to an exemplary embodiment of the present invention
  • Figures 6A, 6B, 6C, 6D, 6E and 6F are schematic diagrams to illustrate the operation of position sensing means for use in sensing the position of input means in apparatus according to an exemplary embodiment of the present invention
  • Figures 7A and 7B are graphs illustrating the electrical signal output by the position sensing means of Figures 6 A - 6F, both before and after noise elimination respectively;
  • Figure 8 is a schematic block diagram illustrating the main components of apparatus according to an exemplary embodiment of the present invention.
  • Figures 9, 10 and 11 are schematic diagrams illustrating the operation of apparatus according to an exemplary embodiment of the present invention.
  • Figure 12 is a partial schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 13 is a partial schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 14 is a schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 15 is a partial schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 16 is a partial schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 17 is a partial schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 18 is a partial schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 19 is a partial schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 20 is a partial schematic front view of a mobile telephone .according to another exemplary embodiment of the present invention.
  • Figure 21 is a partial perspective view of a mobile telephone according to an exemplary embodiment of the present invention
  • Figure 22 is a partial perspective view of a mobile telephone according to an exemplary embodiment of the present invention
  • Figure 23 is a block diagram illustrating some of the primary processing elements of apparatus according to an exemplary embodiment of the present invention.
  • Figure 24 is a partial schematic front view of a mobile telephone according to another exemplary embodiment of the present invention.
  • Figure 25 is a schematic front view of input means and display means of apparatus according to another exemplary embodiment of the present invention.
  • Figure 26 is a schematic front view of input means and display means for apparatus according to another exemplary embodiment of the present invention.
  • Figure 27 is a schematic front view of input means and display means for apparatus according to another exemplary embodiment of the present invention.
  • Figure 28 is a schematic front view of input means and display means of apparatus according to another exemplary embodiment of the present invention.
  • Figure 29 is a schematic front view of input means and display means of apparatus according to another exemplary embodiment of the present invention.
  • Figure 30 is a schematic front view of input means and display means of apparatus according to another exemplary embodiment of the present invention.
  • Figure 31 is a schematic front view of input means and display means of apparatus according to another exemplary embodiment of the present invention
  • Figure 32 is a partial schematic front view of input means and display means according to another exemplary embodiment of the present invention
  • Figure 33 is a schematic diagram illustrating how the visual element created by the display may be reflected by optical elements
  • Figure 34 is a schematic front view of input means and display means of apparatus according to another exemplary embodiment of the present invention.
  • Figure 35 is a partial schematic front view of input means and display means according to another exemplary embodiment of the present invention.
  • Figure 36 is a partial schematic front view of input means and display means according to another exemplary embodiment of the present invention.
  • Figure 37 is a partial schematic front view of input means and display means according to another exemplary embodiment of the present invention.
  • Figure 38 is a partial schematic front view of input means and display means according to another exemplary embodiment of the present invention.
  • Figure 39 is a schematic front view of input means and display means according to another exemplary embodiment of the present invention.
  • Figure 40 is a schematic front view of input means and display means according to another exemplary embodiment of the present invention.
  • a mobile telephone 1 comprises an LCD (liquid crystal display) screen 2 for visually displaying data items 2a, status and other relevant information to a user.
  • the display 2 is of a typical 'pixel' type on which text and graphics are represented by a combination of active picture elements or 'pixels'.
  • the visibility (or transparency) of such pixels is controlled by an electrical input which renders each pixel visible or invisible.
  • the mobile telephone 1 includes a keypad 3 to enable a user to input information such as numbers or letters, and some functions of the telephone may also be accessed and/or selected by means of the keypad 3.
  • the mobile telephone 1 further comprises a rotary scroller input means 4 located on the side of the telephone for convenient operation thereof by a user.
  • the input means 4 is mounted in the housing of the telephone 1 such that only a portion 7 thereof is visible and accessible to the user externally of the telephone housing.
  • the rest of the input means 4 is mounted within, and obscured by, the housing of the telephone 1 (see Figure 2).
  • the 'invisible' portion of the input means 4 is located directly behind the display screen 2, with the axis of rotation 6 of the input means 4 being substantially perpendicular to the plane of the screen 2.
  • the input means 4 has an additional direction of motion which is substantially parallel to the plane of the display 2, as illustrated by the arrow 8. Pressure applied to the input means 4 in the direction of arrow 8, causes the input means to move a short distance in the direction of the arrow 8.
  • the input means 4 is preferably sprung such that withdrawal of such pressure therefrom causes it to return to its original position.
  • the input means 4 in this case can be rotated and/or depressed, either independently or simultaneously, by a user's thumb or forefinger, as illustrated in Figure 4 of the drawings.
  • the rotary input means 4 comprises a first disc member 13 and a second, smaller disc member 12, the two discs being mounted substantially concentrically about a common axis of rotation 14.
  • the larger disc member 13 is visible and accessible to the user for interacting with the data items displayed on the screen of the electronic apparatus.
  • the smaller disc member 12 is provided with circumferential ridges 15, which are substantially equidistant and extend along its edge in a direction which is substantially perpendicular to the axis of rotation 14.
  • an elongate flexible strip 16 of electrically conductive material (e.g. metal) is mounted such that an end thereof engages with or rests in a space between two adjacent ridges 15 of the smaller disc member 12, as shown.
  • the strip 16 is deflected in a first 18 or second 19 direction (depending on the direction of rotation of the input means 4), and it clears one of the ridges forming the space within which it was resting, and springs or drops back into the next space, as illustrated by Figure 6B.
  • two electrically conductive elements 20, having contacts 21 are provided on either side of the strip 16, at or adjacent the end opposite that which engages with the smaller disc 12.
  • the elements 20 are mounted such that one of them achieves electrical and physical connectivity with the strip 16 when it is deflected due to rotation of the input means 4, although they are not in contact with the strip when the input means is not in use, i.e. when the strip 16 is resting in one of the spaces between adjacent ridges. It will be appreciated that clockwise rotation of the input means will result in contact between the strip and one of the conducting elements 20, whereas anticlockwise rotation will result in contact between the strip 16 and the other conducting element 20.
  • a third conducting element 26 is provided proximate the end of the strip 16 opposite the end which rests in the spaces between adjacent ridges of the smaller disc member 12.
  • the strip 16 is, in fact, preferably L-shaped, as shown in Figures 6D and 6E, the distal ends of the L- shaped member being fixedly mounted.
  • the input means 4 (and, therefore, the disc 12) is depressed by the user, corresponding pressure is applied to the distal end of the strip 16 which rests in a space between adjacent ridges of the disc 12, thereby forcing the major length portion of the L-shaped strip 16 to be pushed back and the angle between the two limbs of the strip 16 to be reduced, thus deflecting the corner 27 of the L-shaped strip and causing it to come into contact with the third conducting element 26, as shown.
  • the strip 16 is resiliently flexible, such that when the input means 4 is released by the user, the strip 16 springs back into shape and pushes the disc member 12 (and the rest of the input means 4) back to its original position ( Figure 6E).
  • the three conducting element 20, 26 are electrically connected and physically held by solder joints 29, 30 on a printed circuit board 31.
  • the three conducting elements 20, 26 and the flexible metal strip 16 are preferably electrically connected to computation means (not shown).
  • the combination and/or rate of connections made between the strip 16 and the elements 20, 26 received by the computation means enables it to compute (and provide data in electrical form, i.e. switching signals, representative of) the direction of rotation of the input means 4, the speed of rotation, the distance of rotation, pressure on the input means, etc.
  • the input means, flexible strip 16, conducting elements 20, 26 and the computation means will be collectively refe ⁇ ed to hereinafter as an "input device".
  • the electrical switching signals output by the computation means are processed by a filter or the like comprising a mix of passive and active electrical components. It is well known in the art of mechanical switches and the like that capacitive and resistive passive components assist in "cleaning" the signal such that electrical noise 32 and "contact bounce” 33 are reduced.
  • the "clean" signal (as illustrated in figure 7B) is then input to a digital processing device or microcontroller 34 (see Figure 8 of the drawings).
  • the microcontroller 34 processes the signals produced by the input device.
  • the direction and position of the input means 4 during movement thereof by a user is calculated by counting the electrical "pulses” from the input device.
  • the speed of any such movement can be calculated by comparing the rate or frequency of such "pulses” with an internal clock.
  • the values of the above-mentioned parameters can be compared with predetermined criteria or threshold values, and further processes or actions may be activated in the event that the predetermined criteria are matched, exceeded or not exceeded, as required.
  • One such criteria may result in the updating of graphics appearing on the screen of the apparatus in the event that any movement or change of position of the input means 4 is detected.
  • the electrical signal from the input device in this exemplary embodiment of the present invention indicates a change of position of the input means 4 (as opposed to its actual position), and the microcontroller is arranged to calculate the actual position from its memory of the previous position together with the data indicating a change of position. Examples of such processes which may be activated in response to certain criteria being met are:
  • the microcontroller also uses pre-programmed algorithms to generate display data from the position data.
  • the display data includes information that, when transmitted to the display screen, will cause it to create a graphic 35 which visually represents the input means 4 (and/or its operation), as shown in Figure 9 of the drawings.
  • the programmed algorithms re-calculate signals from the input device when a change has occurred in order to create an animated graphic which behaves "mechanically” in a similar fashion to the input means 4 under the control of the user. The process occurs relatively rapidly such that the graphic 35 appears to move at a speed substantially similar to the actual input means 4 with its visible portion and its graphical representation being substantially coordinated, the graphical representation 35 of the input means 4 appearing to rotate by substantially the same angle as the input means 4, as illustrated in Figure 10 of the drawings.
  • the input means 4 is positioned such that a portion 39 thereof is behind the screen.
  • the graphic representing the obscured portion 39 of the input means 4 is aligned such that it appears to actually be the portion 39 of the input means 4 obscured by the screen.
  • the graphic representation of the input means 4 may be visually animatedly linked to other graphics and./or text displayed on the screen.
  • the graphically represented input means may include a pointer or the like for indicating the data item 40 currently selected or highlighted on the screen.
  • Figure 14 of the drawings illustrates a mobile telephone 50 having a display screen 52 and two input means 54, one on each side of the screen 52.
  • Both of the input means 54 comprise rotary discs, a portion 56 of each of which is obscured by the screen 52, and instead graphically and animatedly represented thereon.
  • Either or both of the input means 54 may be used to scroll through, highlight or select one or more data items 58 from a plurality provided on the screen 52.
  • the invention is not intended to be limited with regard to the percentage or size of portion of the input means which is represented on the display screen. This may be dependent on one or more of a number of different factors, including the position of the input means relative to the screen, as illustrated by Figure 12 of the drawings. Further, the invention is not intended to be limited with regard to the nature of the animated representation of the input means provided on the screen. For example, as illustrated in Figure 13 of the drawings, the graphical representation 60 of the input means 54 may suggest a mechanical connection therebetween, even though no such connection exists. .
  • the graphical representation of the input means 54 may, of course, represent linear motion (as opposed to, or in addition to, rotary motion), irrespective of the type of motion actually produced by activation of the input means.
  • the linear motion of the input means 54 may be accurately represented in the screen graphic 60.
  • the input means may be arranged to move in a linear manner around the screen, i.e. around the corners, in which case the animated motion of the graphical representation 60 may also involve such motion, as illustrated in Figure 18 of the drawings.
  • the on-screen graphical representation 60 may be accurately representative of an obscured portion of the input means 54, or it may simply be intended to give the impression of such, i.e.
  • Figures 19 and 20 of the drawings Further examples of the types of graphical representations which may be displayed on the screen are illustrated in Figures 19 and 20 of the drawings.
  • the data items 58 to be displayed may be provided on a graphically represented roller 62 on the screen.
  • the input means 54 is a rotary wheel, rotation of which results in corresponding rotational movement of the roller 62.
  • the obscured portion of the input means 54 is represented on the screen as a steering wheel 64 of a vehicle, the remainder of the scene displayed on the screen being representative of a typical view through a vehicle windscreen.
  • the input means 54 is a rotary wheel or the like, rotation of which results in co ⁇ esponding animated rotational movement of the steering wheel 64 represented on the screen.
  • the input means 54 may be positionally offset from the plane of the screen such that the visible portion of the input means and the graphical representation thereof line up when viewed from an angle at which the apparatus is typically used.
  • the graphical representation of the input means may include perspective and/or three-dimensional aspects such that the graphical representation is a substantially true representation of the input means when viewed from an angle at which the apparatus is typically used.
  • Figure 23 is a schematic block diagram illustrating some of the primary process elements which may be included in apparatus according to an exemplary embodiment of the present invention.
  • the audio 70, keypad 72 and radio 74 process functions are relatively standard elements in current mobile telephones and the like and, as such, will not be discussed in any further detail herein.
  • the sensing means 76 senses the position, direction, speed, etc. of movement of the mechanical input means of the apparatus, and its configuration will be dependent upon the nature of the input means itself.
  • the computation means 78 is used for, among other things, determining the movement of the mechanical input means, running the appropriate algorithms to generate corresponding graphics and transmitting the respective outputs for display on the display screen 80 of the apparatus.
  • the memory 82 and the display driver 84 are again relatively standard elements in current mobile telephones and the like, and as such will not be discussed in any further detail herein.
  • the input means may be styled in a manner not related to its function, but still be visually and/or behaviourally related to the on-screen graphic.
  • the input means 54 and/or its operation may be represented on two or more display screens.
  • the input means 54 may be represented on the display screen by a graphical element or component 90 which is not actually a part of the physical input means, although it is animated on the screen to represent the operation of the input means to give the visual impression that it is in fact part of the input means.
  • the input means 54 may not move with respect to the display screen. Instead, the display screen (and input means) may move relative to a stationary input means. As such, the apparatus may be a ⁇ anged to graphically display an element or component 90 which is not actually a part of the physical input means (whether internal or external), although it appears to be a part of the external "input means" and is animated on the screen to represent the operation of such input means to give the visual impression that it is in fact part of such input means.
  • the display screen 100 may be partially or substantially transparent or translucent (see Figure 28). Such transparency may be inactivated such that information can be displayed on a substantially opaque screen. As a result, the image of the input means viewed on the screen may be a mixture of actual input means with a "virtual" graphic overlaid. Selectively transparent liquid crystal displays are known in the art.
  • portions of the image displayed on the screen may be an inactive graphic, ie. painted on or a mask of some form, which may be an unbroken shape (a) or dots (b), for examples.
  • the graphical representation of the input means may be distorted due to a relatively low screen resolution, as illustrated in Figure 30 of the drawings.
  • the graphical representation may be instructed from a series of specifically designed shapes which can be activated electronically. In a preferred embodiment, there should be enough of such shapes to create a convincing analogue animation.
  • the animated movement represented by the graphical representation of the input means may amplify true movement of the physical input means.
  • movement of the graphical representation could indicate a "force" exerted on the input means, rather than its actual mechanical movement.
  • the visual element created by the display may be distorted, reflected, polarised, magnified or filtered in some way before reaching the user, as illustrated in Figure 33 of the drawings.
  • the input means should be correctly placed in terms of the final viewing angle, but not necessarily in line with the actual means for producing visual information.
  • the graphical representation of the input means may be rendered on a plurality of displays 100, 110, which combine to create a final graphic image. Graphics not related to the input means representation may also be presented on one, some or all of the displays which combine in this manner.
  • the graphical representation of the input means may alter visually to link more closely to other graphics or data on different virtual pages displayed on the screen, ie the default first page may be very simple, the main menu page may have a simple simulated mechanical link to the input means, and again page may have a representation graphic with, for example, steering wheel attributes, or the like.
  • the graphical representation of the input means may disappear partially or entirely if the device as a whole goes into a power off or standby mode, as illustrated by Figure 36 of the drawings. It may also be arranged to partially or entirely disappear, distort etc. to make display space for other displayed information, for example, long SMS texts, WAP pictures, etc.
  • the graphical representation of the input means may distort or move in a dissimilar manner to the input means to create, for example, entertaining animation in certain cases, such as switching the power on and/or off, virtual page transitions, etc. This may also occur at predetermined intervals of time for entertainment purposes and the like.
  • Figure 38 illustrates the case whereby data items are linked to and highlighted according to the position of a pulley-like graphic on the screen, the rotary operation of which appears to follow the corresponding movement of the rotary input means.
  • Figure 39 illustrates an example of the present invention when applied to a wristwatch or the like. Mechanical rotary or linear movement of the watch face results in corresponding movement of the graphical display thereon.
  • Figure 40 illustrates an example of the present invention when applied to a washing machine or similar appliance. As shown mechanical rotary movement of the dial results in a corresponding graphical indication of the selected parameter (such as, in this case) wash temperature.
  • the selected parameter such as, in this case

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • User Interface Of Digital Computer (AREA)
  • Input From Keyboards Or The Like (AREA)
  • Switches With Compound Operations (AREA)
  • Telephone Set Structure (AREA)
  • Mobile Radio Communication Systems (AREA)
PCT/GB2002/005146 2001-11-17 2002-11-15 Digital display Ceased WO2003044646A2 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2003546217A JP2005509972A (ja) 2001-11-17 2002-11-15 デジタル表示装置
US10/495,818 US20050116941A1 (en) 2001-11-17 2002-11-15 Digital display
EP02781394A EP1444565A2 (en) 2001-11-17 2002-11-15 Digital display
AU2002349109A AU2002349109A1 (en) 2001-11-17 2002-11-15 Digital display

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0127597.3 2001-11-17
GB0127597A GB2382292A (en) 2001-11-17 2001-11-17 Digital display with scrolling means

Publications (2)

Publication Number Publication Date
WO2003044646A2 true WO2003044646A2 (en) 2003-05-30
WO2003044646A3 WO2003044646A3 (en) 2003-12-11

Family

ID=9925953

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2002/005146 Ceased WO2003044646A2 (en) 2001-11-17 2002-11-15 Digital display

Country Status (6)

Country Link
US (1) US20050116941A1 (https=)
EP (1) EP1444565A2 (https=)
JP (1) JP2005509972A (https=)
AU (1) AU2002349109A1 (https=)
GB (1) GB2382292A (https=)
WO (1) WO2003044646A2 (https=)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005216284A (ja) * 2003-11-27 2005-08-11 Sony Netservices Gmbh 情報検索装置及び方法
WO2005119419A1 (en) * 2004-06-04 2005-12-15 Research In Motion Limited Scroll wheel with character input
WO2006048710A1 (en) * 2004-11-01 2006-05-11 Nokia Corporation Improved mobile communication terminal and method
EP1501007A3 (en) * 2003-07-23 2006-05-31 Bose Corporation System and method for accepting a user control input
WO2006079893A1 (en) * 2005-01-25 2006-08-03 Nokia Corporation System and method for utilizing idle mode on an electronic device
WO2007012698A1 (en) * 2005-07-27 2007-02-01 Nokia Corporation Method of controlling software functions, electronic device, and computer program product
US7415352B2 (en) 2005-05-20 2008-08-19 Bose Corporation Displaying vehicle information
WO2016060602A1 (en) * 2014-10-14 2016-04-21 Zound Industries International Ab A mobile phone comprising a scroll wheel
CN105804516A (zh) * 2015-08-24 2016-07-27 张帆 新型不可随意摘下的易用型可穿戴设备及方法

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9239673B2 (en) 1998-01-26 2016-01-19 Apple Inc. Gesturing with a multipoint sensing device
US7614008B2 (en) 2004-07-30 2009-11-03 Apple Inc. Operation of a computer with touch screen interface
US8479122B2 (en) 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
US9292111B2 (en) 1998-01-26 2016-03-22 Apple Inc. Gesturing with a multipoint sensing device
US7469381B2 (en) 2007-01-07 2008-12-23 Apple Inc. List scrolling and document translation, scaling, and rotation on a touch-screen display
US20080129552A1 (en) * 2003-10-31 2008-06-05 Iota Wireless Llc Concurrent data entry for a portable device
EP1678654A4 (en) 2003-10-31 2008-07-02 Iota Wireless Llc SIMULTANEOUS DATA ENTRY FOR A PORTABLE DEVICE
GB2413920A (en) * 2004-04-30 2005-11-09 Motorola Inc Mobile station with multi-position sliding actuator for function control
US8381135B2 (en) 2004-07-30 2013-02-19 Apple Inc. Proximity detector in handheld device
WO2006045530A2 (en) * 2004-10-22 2006-05-04 Novo Nordisk A/S An apparatus and a method of providing information to a user
KR100754674B1 (ko) * 2006-03-10 2007-09-03 삼성전자주식회사 휴대 단말의 메뉴 선택 방법 및 장치
KR101258494B1 (ko) * 2006-10-24 2013-04-26 엘지전자 주식회사 스크롤 기능이 구현되는 단말기
JP5101373B2 (ja) * 2007-04-10 2012-12-19 古野電気株式会社 情報表示装置
JP5596914B2 (ja) * 2008-09-16 2014-09-24 富士通株式会社 端末装置、表示制御方法、及び表示機能を備えたプログラム
KR100982999B1 (ko) 2009-04-29 2010-09-17 이상훈 Iptv용 리모콘
JP2011059820A (ja) * 2009-09-07 2011-03-24 Sony Corp 情報処理装置、情報処理方法、およびプログラム
DE102012200129A1 (de) * 2012-01-05 2013-07-11 SONOTEC Dr. zur Horst-Meyer & Münch oHG Mobile Einrichtung zur computergestützten Ein- und Ausgabe von Daten mit einer integrierten Bildschirmausgabeeinheit und Verfahren zur Visualisierung ihrer Bedienung
US11513675B2 (en) * 2012-12-29 2022-11-29 Apple Inc. User interface for manipulating user interface objects
US10691230B2 (en) 2012-12-29 2020-06-23 Apple Inc. Crown input for a wearable electronic device
US10545657B2 (en) 2013-09-03 2020-01-28 Apple Inc. User interface for manipulating user interface objects
US10503388B2 (en) 2013-09-03 2019-12-10 Apple Inc. Crown input for a wearable electronic device
KR20210008944A (ko) 2013-09-03 2021-01-25 애플 인크. 자기 특성을 갖는 사용자 인터페이스 객체를 조작하는 사용자 인터페이스
US12287962B2 (en) 2013-09-03 2025-04-29 Apple Inc. User interface for manipulating user interface objects
US11068128B2 (en) 2013-09-03 2021-07-20 Apple Inc. User interface object manipulations in a user interface
JP2015176462A (ja) * 2014-03-17 2015-10-05 祥司 鱒渕 操作装置
CN110825299B (zh) 2014-06-27 2024-03-29 苹果公司 尺寸减小的用户界面
WO2016036416A1 (en) 2014-09-02 2016-03-10 Apple Inc. Button functionality
US20160062571A1 (en) 2014-09-02 2016-03-03 Apple Inc. Reduced size user interface
CN112130720A (zh) 2014-09-02 2020-12-25 苹果公司 多维对象重排
CN106797493A (zh) 2014-09-02 2017-05-31 苹果公司 音乐用户界面
TWI676127B (zh) 2014-09-02 2019-11-01 美商蘋果公司 關於電子郵件使用者介面之方法、系統、電子器件及電腦可讀儲存媒體
US10365807B2 (en) 2015-03-02 2019-07-30 Apple Inc. Control of system zoom magnification using a rotatable input mechanism
KR20160123879A (ko) * 2015-04-17 2016-10-26 삼성전자주식회사 전자 장치 및 그의 화면 표시 방법
DK201670595A1 (en) 2016-06-11 2018-01-22 Apple Inc Configuring context-specific user interfaces
DE102016220834A1 (de) * 2016-10-24 2018-04-26 Volkswagen Aktiengesellschaft Verfahren und Anordnung zur displayübergreifenden Anzeige und/oder Bedienung in einem Fahrzeug
US10712824B2 (en) 2018-09-11 2020-07-14 Apple Inc. Content-based tactile outputs
US11435830B2 (en) * 2018-09-11 2022-09-06 Apple Inc. Content-based tactile outputs
US10996761B2 (en) 2019-06-01 2021-05-04 Apple Inc. User interfaces for non-visual output of time
US12511021B2 (en) 2020-09-14 2025-12-30 Apple Inc. Device management user interface
US11893212B2 (en) 2021-06-06 2024-02-06 Apple Inc. User interfaces for managing application widgets
US12567415B2 (en) 2023-05-09 2026-03-03 Apple Inc. Providing and controlling immersive three-dimensional environments

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5945985A (en) * 1992-10-27 1999-08-31 Technology International, Inc. Information system for interactive access to geographic information
US5982355A (en) * 1993-11-05 1999-11-09 Jaeger; Denny Multiple purpose controls for electrical systems
JPH0876225A (ja) * 1994-09-02 1996-03-22 Nikon Corp カメラの情報入力表示装置
US5825353A (en) * 1995-04-18 1998-10-20 Will; Craig Alexander Control of miniature personal digital assistant using menu and thumbwheel
JPH09130695A (ja) * 1995-11-02 1997-05-16 Toshiba Corp オンスクリーンディスプレイ装置
NO301040B1 (no) * 1995-12-04 1997-09-01 Ziad Badarneh Tastatur for telefoner og lignende
US5940077A (en) * 1996-03-29 1999-08-17 International Business Machines Corporation Method, memory and apparatus for automatically resizing a window while continuing to display information therein
US6037882A (en) * 1997-09-30 2000-03-14 Levy; David H. Method and apparatus for inputting data to an electronic system
DE19752054A1 (de) * 1997-11-25 1999-05-27 Bayerische Motoren Werke Ag Multifunktionales Bedienteil
US5977975A (en) * 1998-01-13 1999-11-02 Sony Corporation Array of displayed graphic images for enabling selection of a selectable graphic image
EP1028570B1 (en) * 1999-02-11 2004-11-17 Sony International (Europe) GmbH Terminal for wireless telecommunication and method for displaying icons on a display of such a terminal
US6710771B1 (en) * 1999-05-13 2004-03-23 Sony Corporation Information processing method and apparatus and medium
EP1054321A3 (en) * 1999-05-21 2002-06-19 Sony Corporation Information processing method and apparatus
JP2002157078A (ja) * 2000-09-07 2002-05-31 Sony Corp 情報処理装置及び方法、並びに記録媒体
JP2002207561A (ja) * 2001-01-05 2002-07-26 Sony Corp 情報処理装置および方法、並びに記録媒体
US7046213B2 (en) * 2002-06-05 2006-05-16 Ibm Apparatus and method for direct manipulation of electronic information

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1501007A3 (en) * 2003-07-23 2006-05-31 Bose Corporation System and method for accepting a user control input
JP2005216284A (ja) * 2003-11-27 2005-08-11 Sony Netservices Gmbh 情報検索装置及び方法
WO2005119419A1 (en) * 2004-06-04 2005-12-15 Research In Motion Limited Scroll wheel with character input
WO2006048710A1 (en) * 2004-11-01 2006-05-11 Nokia Corporation Improved mobile communication terminal and method
US7362312B2 (en) 2004-11-01 2008-04-22 Nokia Corporation Mobile communication terminal and method
RU2408152C2 (ru) * 2004-11-01 2010-12-27 Нокиа Корпорейшн Устройство мобильной связи и способ ввода выбора объекта для представления на дисплее устройства мобильной связи
WO2006079893A1 (en) * 2005-01-25 2006-08-03 Nokia Corporation System and method for utilizing idle mode on an electronic device
US7415352B2 (en) 2005-05-20 2008-08-19 Bose Corporation Displaying vehicle information
WO2007012698A1 (en) * 2005-07-27 2007-02-01 Nokia Corporation Method of controlling software functions, electronic device, and computer program product
KR100950080B1 (ko) 2005-07-27 2010-03-26 노키아 코포레이션 소프트웨어 기능들을 제어하는 방법, 전자 장치, 그리고컴퓨터 프로그램 제품
WO2016060602A1 (en) * 2014-10-14 2016-04-21 Zound Industries International Ab A mobile phone comprising a scroll wheel
CN105804516A (zh) * 2015-08-24 2016-07-27 张帆 新型不可随意摘下的易用型可穿戴设备及方法

Also Published As

Publication number Publication date
US20050116941A1 (en) 2005-06-02
WO2003044646A3 (en) 2003-12-11
GB2382292A (en) 2003-05-21
GB0127597D0 (en) 2002-01-09
AU2002349109A8 (en) 2003-06-10
EP1444565A2 (en) 2004-08-11
AU2002349109A1 (en) 2003-06-10
JP2005509972A (ja) 2005-04-14

Similar Documents

Publication Publication Date Title
US20050116941A1 (en) Digital display
KR100301234B1 (ko) 대치형 터치패드를 구비한 선택 호출 무선기
US6347997B1 (en) Analog controls housed with electronic displays
JP4065035B2 (ja) 3次元カーソル位置設定装置
US6456778B2 (en) Analog controls housed with electronic displays for video recorders and cameras
KR20020067604A (ko) 영상 제어 시스템
KR102003426B1 (ko) 텍스처 엔진에 대한 시스템 및 방법
US5339096A (en) Flexible, intuitive, operator for computer peripherals
JP4864713B2 (ja) 立体的二次元画像表示装置
JP2005293606A (ja) タッチ入力検知方法及びタッチ入力検知装置
EP3051390B1 (en) Rotational element enabling touch-like gestures
US20070094620A1 (en) Mobile terminal providing graphic user interface and method of providing graphic user interface using the same
US20030128191A1 (en) Dynamically variable user operable input device
CN1304524A (zh) 带有铰接触摸盘的选择性呼叫无线电设备
WO2013112234A1 (en) Methods and apparatus for providing feedback from an electronic device
WO2001043473A1 (en) Hand held data processor unit
JP4502810B2 (ja) センサを操作するための電子機器用の操作要素並びに電子メモリに含まれる機能を選択し、選択された機能をカーソルによって表示するための方法
US20020101402A1 (en) Two-axis ball-based cursor control apparatus with tactile feedback
WO2009156804A1 (en) Simulated reflective display
CN107656692A (zh) 一种全触摸屏智能手表分区域控制的方法
WO2000068930A1 (en) Analog controls housed with electronic displays
JP2008225541A (ja) 入力装置および情報機器
JP2007251893A (ja) リモートコントロール装置
JPH05113852A (ja) 3次元座標入力装置
CN211454560U (zh) 一种新型调节开关

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR IE IT LU MC NL PT SE SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003546217

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2002781394

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2002781394

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 10495818

Country of ref document: US