GB2357684A - Hand-held terminal having a display screen which is controlled by movement of the terminal - Google Patents

Hand-held terminal having a display screen which is controlled by movement of the terminal Download PDF

Info

Publication number
GB2357684A
GB2357684A GB9930119A GB9930119A GB2357684A GB 2357684 A GB2357684 A GB 2357684A GB 9930119 A GB9930119 A GB 9930119A GB 9930119 A GB9930119 A GB 9930119A GB 2357684 A GB2357684 A GB 2357684A
Authority
GB
United Kingdom
Prior art keywords
hand
terminal
mobile terminal
held mobile
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB9930119A
Other versions
GB9930119D0 (en
Inventor
David Martyn Lewis Williams
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Motorola Solutions UK Ltd
Original Assignee
Motorola Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motorola Ltd filed Critical Motorola Ltd
Priority to GB9930119A priority Critical patent/GB2357684A/en
Publication of GB9930119D0 publication Critical patent/GB9930119D0/en
Publication of GB2357684A publication Critical patent/GB2357684A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1626Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163Indexing scheme relating to constructional details of the computer
    • G06F2200/1637Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

A hand-held mobile terminal 10 including a display screen 20 wherein spatial and/or angular movements of the terminal 10 are used to control the display. Control of the display 20 may include: movement of an icon, scrolling, zooming, menu selection. Preferably the movement is detected using a gyroscope. A switch for activating the gyroscope and means for confirming selection of highlighted options may be included. The terminal may be a telephone, with Internet access, or an electronic personal organiser.

Description

2357684 SPATIALLY AWARE HAND-HELD DEVICES The present invention relates
generally to hand-held mobile device displays, and more specifically, but not exclusively, to the control of mobile telephone or radio on-screen display information.
Mobile telephones incorporate a display screen, usually an LCD display screen, for displaying text or graphical information. Recently, mobile telephone users have been able to receive partial internet information (i.e. text only), via the use of the display screen and the Wireless Access Protocol (WAP). Here, HTML information is automatically converted to Wireless Markup Language (WML) and transmitted as text to the mobile telephone.
With the advent of third generation telephones, such as the UMTS (Universal Mobile Telecommunication System), the whole content of web pages and the internet, including images, video etc will be available for accessing through mobile telephones, due to high bit-rates. However, a typical mobile device e.g., electronic personal organiser or cellular telephone, has a display that is in the order of cm across. This restricted size means that only a restricted view of the information can be provided. Consequently, to view an entire web page for example, users must engage in repetitive and time-consuming navigation using cursor keys or 'arrow' buttons. This operation is compounded by the need to focus on the input mechanism, which are often small and difficult to use, rather than on the displayed information. More generally, as more data becomes available it is not clear how current solutions will support larger and more complex information structures even if displays can be made larger.
The invention arose from a desire to include a spatial input device with functioning similar to a computer mouse or graphics tablet, but also one which eschews traditional input mechanisms such as cursor keys and the like.
The advantage of a computer mouse, touchpad or similar input device is that it provides a one-to-one mapping (albeit a scaled mapping) between the physical world of the user and the virtual world of the computer display.
A problem with present mobile telephones, and for that matter personal organisers or CpaIrn' type computers, is that there is a limited amount of space for the addition of further input mechanisms over and above that which is normally included on a mobile telephone. 5 It is therefore desirable to have a hand-held mobile terminal that incorporates a user interface device that takes up no valuable terminal space and one which provides computer mouse-like one to one mapping. In addition to this, it would also be advantageous if the user was able to focus on the display information only, and not be distracted by the physical operation of the input mechanism.
In their article entitled 'The Information Periscope "Isteer"' Junko Misawa and Jurichi Osada propose an LCD panel which can be rotated around a user whereby video information displayed on the panel changes according to the angular position of the panel.
The 'periscope' is designed to be used in public spaces and function as an interactive information kiosk. However, such systems are clearly immobile.
Gyration Incorporated of Saratoga in the United States of America are manufacturers of gestural control devices under the name of Gyropoint Technology. These devices are used as remote controls for television sets, home computers and home entertainment systems. However, the new type of remote controls produced using this technology are to be used in conjunction with existing systems; they do not combine, nor does the literature suggest combining, the MicroGyro 0 100 with hand- held devices such as a mobile telephone.
Summary of the Invention
According to an aspect of the present invention there is provided a handheld mobile terminal including:
a display screen wherein spatial and/or angular movements of the terminal are used to control the display.
Preferably, a gyroscope is included to detect the spatial and/or angular movements of the terminal.
In a preferred embodiment the hand-held mobile terminal is a portable telephone which can 5 communicate with the Internet.
Preferably, the display screen is adapted to display Internet pages or part thereof via the communications link with the world-wide-web.
Information displayed on the screen can preferably be manipulated, controlled or scrolled through by user hand movements detected by the gyroscopic device.
In this way a user can navigate the information highways of the worldwide-web from a mobile telephone but requiring no user input other than movements of the hand.
According to another aspect of the present invention there is provided a method of controlling on-screen information of a hand-held mobile terminal display including the steps of.
detecting spatial movement of the terminal by the use of a gyroscope, translating the spatial movement into control commands and controlling on-screen information via the control commands.
According to another aspect of the present invention there is provided a hand-held device including a display screen and a gyroscope, wherein spatial and/or angular movements of the device are used to control or manipulate on-screen display information, said spatial and/or angular movements are detected by the gyroscope.
An embodiment of the present invention will now be described by way of example only, with reference to the accompanying schematic drawings, in which:
Figure 1 shows operation of a preferred embodiment of the hand-held mobile terminal; Figure 2 shows another embodiment of the hand-held mobile terminal of the present invention.
The mobile terminal 10 includes a display screen 20 on which is displayed information 25. For simplicity only, this information 25 is shown as sections of the alphabet and a sequence of numbers from 1 to 11. However, the information shown on the screen can be of any type: text, graphics or a combination of both etc.
The terminal 10 is in wireless communication with a telecommunications network 50, which in turn is connected to the Internet 60, or other information source, via communications link 65.
Also included on the terminal 10 are input buttons 15 by which a user of the terminal is able to input information such as a desired telephone number.
They may also be used for typing in textual information when connected to the Internet.
2 0 Paging on-screen information up and down, or scrolling left and right and some such other text manipulation, is achieved by movement of the terminal 10.
Any three-dimensional spatial movement (by three-dimensional we include movements that may be in one or two directions only), for example a yaw, roll or pitch, will be detected by the internal gyroscope 35.
The terminal 10 will be adapted to read and process the signals from the gyroscope in any one of the ways known to a skilled reader.
The signals will indicate a predetermined on-screen operation in the same way as a computer interprets the movement of a mouse to move the onscreen pointer about the display screen, and/or to scroll or otherwise move the image relative to the display.
For example, a forward pitch of the terminal 10 may be read as 'scroll down', and the reverse (i.e. a backwards pitch) as 'scroll up'.
Additionally, or alternatively, a hand gesture, such as a shake, may be interpreted as a cancel operation or the like. In this instance there is no direct mapping between the hand movement and the processed instruction.
In this way, the terminal can be adapted to respond to the hand movements of a user and translate these movements into an indication of the required on-screen information manipulation, or in fact to be interpreted as any predetermined function or operation as desired.
In figure 1, the movement 70 is shown as a lateral reciprocating movement, but the reader will be aware that the gyroscopic device 35 detects all possible spatial movements of the terminal, and these can be interpreted as representing various different commands. Here, movement 70 scrolls the displayed information 25 to the right. It could however equally zoom the information in or out to reveal other information or to magnify the display etc. For example, translational movement of the hand held terminal without change in angular disposition, may be associated with a zooming function.
For clarity the mobile terminal 10 is shown with information 25 changing to information 25' after movement 70 of the terminal.
Shown on the side of the terminal 10 is button 40. This button allows the user to activate or deactivate the gyroscopic device 3 5 as desired. Alternatively, a particular gesture (eg a shake) may serve to deactivate positional input to allow for movement of the device to a comparable position before movement continues. This is analogous to lifting and repositioning a mouse.
Referring to Figure 2. The terminal 100 in this embodiment is a hand-held 'palm' type computer. The terminal is shown connected to the Internet 60 via telecommunications line 75, which is, for example, a standard telephone line. Such a connection would generally require the use of a modem, ISDN adaptor or similar, which may be inbuilt into the device, or external.
Included within the display are a 'free-floating' cursor or pointer 98, 99 similar to those utilised in personal computers and which would be controlled in a computer by a computer 10 mouse or other input device.
Movement of the terminal would control the movement of the on-screen cursor. A reserved movement, such as a shake for example, could function in the same way as mouse 'click' and be representative of a user selection. 15 Alternatively, an additional button (or button 40 may be multi-purpose) can be included that could provide a "mouse clicM' fimction. In other embodiments this function is achieved by a hand gesture such as a shake for example.
The figure shows the schematic movement of on screen pointers 98 and 99 by ghosted lines. Pointer 99 is shown indicating a Windows (9 type bar button. Movement of the terminal 100 drags the button up or down in the same manner as achieved by the use of a mouse in a personal computer.
The reader will note that the present invention is not limited to the above examples. It is envisaged that the invention can be utilised by many hand-held devices which include display screens. For example: portable radios, electronic dictionaries, spell-checkers or diaries; cameras; electronic games etc.
The terminal according to the present invention provides the following advantages over current input solutions:
the whole device becomes an invisible input mechanism and therefore the input control does not occupy valuable surface area on the terminal; the user can focus on the information display rather than the input device. 5 the input mechanism's intuitive providing in one-one mapping with movement in an application; repetitive muscular movement is removed; 10 gestures could be used as an input to perform a selection. An example is shaking the device. This provides an alternate to pen-based input with the advantage of dispensing with the pen.

Claims (16)

1. A hand-held mobile terminal including a display screen wherein spatial and/or angular movements of the terTninal are used to control the display. 5
2. A hand-held mobile terminal as claimed in Claim 1, including a gyroscope for detecting the said spatial and/or angular movements.
3. A hand-held mobile terminal as claimed in Claim 1 or 2, wherein the terminal 10 includes a switch for activating or deactivating the gyroscopic device.
4. A hand-held mobile terminal as claimed in Claim 1,2 or 3, wherein the terminal includes an external device for confirming on-screen option choices.
5. A hand-held mobile terminal as claimed in any preceding Claim, wherein control of the display includes any one or more of the following onscreen fimctions: movement of a cursor or pointer icon; scrolling of displayed information up, down, left or right; zoom-in or zoom-out focusing operations; menu option selection.
6. A hand-held mobile terminal as claimed in any preceding Claim, wherein the terminal is a mobile telephone handset.
7. A hand-held mobile terminal as claimed in any Claim 1 to 5, wherein the terminal is an electronic personal organiser. 25
8. A hand-held mobile terminal as claimed in any preceding Claim wherein the terminal is adapted to be connected to the Internet.
9. A hand-held mobile terminal as claimed in any of the preceding claims wherein the 30 movements can be yaw, pitch, roll or translation movements, or gestures.
10. A method of controlling displayed information of a hand-held mobile terminal having a display, the method including the steps of detecting spatial movement of the terminal, translating the spatial movement into control commands and controlling the display via the control commands. 5
11. A method as claimed in Claim 10, wherein a gyroscope is used to detect the movements of the terminal.
12. A method of controlling displayed information of a hand-held mobile terminal, wherein, the yaw, pitch, roll or translation movements, or gestures of the mobile terminal are detected and used for controlling the display.
13. A method as claimed in Claim 12, wherein a gyroscope is used to detect the yaw, pitch, roll, translation movement or gesture of the mobile terminal.
14. A hand-held device including a display screen and a gyroscope, wherein spatial and/or angular movements of the device are used to control or manipulate on-screen display information, said spatial and/or angular movements being detected by the gyroscope.
15. A hand-held mobile device substantially as hereinbefore described, with reference to and as illustrated by, the accompanying drawings.
16. A method of controlling the displayed information of a hand-held mobile terminal, substantially as hereinbefore described, with reference to, and as illustrated by, the accompanying drawings.
GB9930119A 1999-12-21 1999-12-21 Hand-held terminal having a display screen which is controlled by movement of the terminal Withdrawn GB2357684A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB9930119A GB2357684A (en) 1999-12-21 1999-12-21 Hand-held terminal having a display screen which is controlled by movement of the terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB9930119A GB2357684A (en) 1999-12-21 1999-12-21 Hand-held terminal having a display screen which is controlled by movement of the terminal

Publications (2)

Publication Number Publication Date
GB9930119D0 GB9930119D0 (en) 2000-02-09
GB2357684A true GB2357684A (en) 2001-06-27

Family

ID=10866685

Family Applications (1)

Application Number Title Priority Date Filing Date
GB9930119A Withdrawn GB2357684A (en) 1999-12-21 1999-12-21 Hand-held terminal having a display screen which is controlled by movement of the terminal

Country Status (1)

Country Link
GB (1) GB2357684A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2378878A (en) * 2001-06-28 2003-02-19 Ubinetics Ltd Control of display by movement of handheld device
WO2003025510A1 (en) 2001-09-19 2003-03-27 Telefonaktiebolaget L M Ericsson (Publ) Method for navigation and selection at a terminal device
DE10148010A1 (en) * 2001-09-28 2003-04-24 Siemens Ag Method for controlling functions on a mobile telephone or on an audio replay device, uses acoustic signals like voice and a sensor on a user's head and on the mobile telephone
DE10150141A1 (en) * 2001-10-11 2003-04-24 Siemens Ag Device for acquisition and representation of movements, e.g. for use in capture of handwriting or sketches drawn on a plasma type display, and also for use as a conventional mouse type device with single hand operation
WO2003071769A1 (en) * 2002-02-20 2003-08-28 Siemens Aktiengesellschaft Mobile telephone comprising a wraparound display
DE10231570A1 (en) * 2002-07-11 2004-01-29 Mobilegames24 Mobile terminal and processor-readable storage medium
DE10313019A1 (en) * 2003-03-24 2004-10-28 Siemens Ag Single handed operation of a mobile terminal by gesture recognition, whereby movement of the terminal relative to the user is measured and used to control the positioning of input selection means
DE102005024638A1 (en) * 2005-05-30 2006-12-07 Siemens Ag Word/text inputs navigation method, for mobile telephone, involves displacing menu based on requirements of electronic device movement found by image recording device, where relative position of cursor and menu entry is found by device
CN100351760C (en) * 2005-01-12 2007-11-28 宏达国际电子股份有限公司 Hand-held device
WO2008132540A1 (en) * 2007-04-26 2008-11-06 Nokia Corporation Method and mobile terminal with user input based on movement of the terminal detected by a sensor
EP2157770A1 (en) * 2008-08-18 2010-02-24 LG Electronics Inc. Method of controlling a mobile terminal with two display areas
DE102006055252B4 (en) 2006-11-23 2019-03-28 Deutsche Telekom Ag Arrangement and method for multimodal selection of objects in telecommunication applications

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH064208A (en) * 1992-06-19 1994-01-14 Sharp Corp Information processor
US5602566A (en) * 1993-08-24 1997-02-11 Hitachi, Ltd. Small-sized information processor capable of scrolling screen in accordance with tilt, and scrolling method therefor
EP0805389A2 (en) * 1996-04-30 1997-11-05 Sun Microsystems, Inc. Tilt-scrolling on the sunpad
WO1998014863A2 (en) * 1996-10-01 1998-04-09 Philips Electronics N.V. Hand-held image display device
WO1999018485A2 (en) * 1997-10-02 1999-04-15 Koninklijke Philips Electronics N.V. Variable instruction set computer
GB2336749A (en) * 1998-04-24 1999-10-27 Nec Corp Scrolling display of portable display device by shaking
GB2336747A (en) * 1998-04-22 1999-10-27 Nec Corp Hand held communication terminal and method of scrolling display screen of the same.

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH064208A (en) * 1992-06-19 1994-01-14 Sharp Corp Information processor
US5602566A (en) * 1993-08-24 1997-02-11 Hitachi, Ltd. Small-sized information processor capable of scrolling screen in accordance with tilt, and scrolling method therefor
EP0805389A2 (en) * 1996-04-30 1997-11-05 Sun Microsystems, Inc. Tilt-scrolling on the sunpad
WO1998014863A2 (en) * 1996-10-01 1998-04-09 Philips Electronics N.V. Hand-held image display device
WO1999018485A2 (en) * 1997-10-02 1999-04-15 Koninklijke Philips Electronics N.V. Variable instruction set computer
GB2336747A (en) * 1998-04-22 1999-10-27 Nec Corp Hand held communication terminal and method of scrolling display screen of the same.
GB2336749A (en) * 1998-04-24 1999-10-27 Nec Corp Scrolling display of portable display device by shaking

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
PAJ Volume 018, No. 197 (P173) SHARP 14.01.94 & JP060004208 *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2378878B (en) * 2001-06-28 2005-10-05 Ubinetics Ltd A handheld display device
GB2378878A (en) * 2001-06-28 2003-02-19 Ubinetics Ltd Control of display by movement of handheld device
WO2003025510A1 (en) 2001-09-19 2003-03-27 Telefonaktiebolaget L M Ericsson (Publ) Method for navigation and selection at a terminal device
CN103323020B (en) * 2001-09-19 2016-04-13 艾利森电话股份有限公司 Navigation on terminal device and system of selection
CN103323020A (en) * 2001-09-19 2013-09-25 艾利森电话股份有限公司 Method for navigation and selection at a terminal device
DE10148010A1 (en) * 2001-09-28 2003-04-24 Siemens Ag Method for controlling functions on a mobile telephone or on an audio replay device, uses acoustic signals like voice and a sensor on a user's head and on the mobile telephone
DE10150141A1 (en) * 2001-10-11 2003-04-24 Siemens Ag Device for acquisition and representation of movements, e.g. for use in capture of handwriting or sketches drawn on a plasma type display, and also for use as a conventional mouse type device with single hand operation
WO2003071769A1 (en) * 2002-02-20 2003-08-28 Siemens Aktiengesellschaft Mobile telephone comprising a wraparound display
DE10231570A1 (en) * 2002-07-11 2004-01-29 Mobilegames24 Mobile terminal and processor-readable storage medium
DE10313019B4 (en) * 2003-03-24 2005-02-24 Siemens Ag One-hand operation of terminals using gesture recognition
DE10313019A1 (en) * 2003-03-24 2004-10-28 Siemens Ag Single handed operation of a mobile terminal by gesture recognition, whereby movement of the terminal relative to the user is measured and used to control the positioning of input selection means
CN100351760C (en) * 2005-01-12 2007-11-28 宏达国际电子股份有限公司 Hand-held device
DE102005024638A1 (en) * 2005-05-30 2006-12-07 Siemens Ag Word/text inputs navigation method, for mobile telephone, involves displacing menu based on requirements of electronic device movement found by image recording device, where relative position of cursor and menu entry is found by device
DE102006055252B4 (en) 2006-11-23 2019-03-28 Deutsche Telekom Ag Arrangement and method for multimodal selection of objects in telecommunication applications
WO2008132540A1 (en) * 2007-04-26 2008-11-06 Nokia Corporation Method and mobile terminal with user input based on movement of the terminal detected by a sensor
EP2157770A1 (en) * 2008-08-18 2010-02-24 LG Electronics Inc. Method of controlling a mobile terminal with two display areas
US8674934B2 (en) 2008-08-18 2014-03-18 Lg Electronics Inc. Mobile terminal and method of controlling the same

Also Published As

Publication number Publication date
GB9930119D0 (en) 2000-02-09

Similar Documents

Publication Publication Date Title
US20030001863A1 (en) Portable digital devices
US6411275B1 (en) Hand-held display device and a method of displaying screen images
EP0990202B1 (en) Graphical user interface touch screen with an auto zoom feature
JP3630153B2 (en) Information display input device, information display input method, and information processing device
US7336263B2 (en) Method and apparatus for integrating a wide keyboard in a small device
US6037937A (en) Navigation tool for graphical user interface
US7199787B2 (en) Apparatus with touch screen and method for displaying information through external display device connected thereto
JP5174372B2 (en) Function icon display system and method
US20050223342A1 (en) Method of navigating in application views, electronic device, graphical user interface and computer program product
US20060061550A1 (en) Display size emulation system
US20080094367A1 (en) Pressure-Controlled Navigating in a Touch Screen
US20020158908A1 (en) Web browser user interface for low-resolution displays
US6963349B1 (en) Information processing apparatus, control method therefor, and computer-readable memory
KR20070085631A (en) Portable electronic device having user interactive visual interface
US20110090166A1 (en) Method and apparatus for using different graphical display technologies to enable user interactivity
US20090288042A1 (en) Method and system for controlling multiple computers
US20050223341A1 (en) Method of indicating loading status of application views, electronic device and computer program product
JP2005321972A (en) Information processor, processing method for information processor, and processing program for information processor
GB2357684A (en) Hand-held terminal having a display screen which is controlled by movement of the terminal
KR101085239B1 (en) Mobile terminal having double sided input parts, character input method and display change method thereof
EP0895153B1 (en) Data input device and method
KR101920864B1 (en) Method and terminal for displaying of image using touchscreen
KR100413234B1 (en) Method and apparatus for selecting menu using key-pad arrangement type icon in portable set
JP4027937B2 (en) Portable electronic devices
KR100228806B1 (en) Method of displaying screen of portable terminal

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)