WO2004021166A1 - Procede et dispositif de guidage - Google Patents

Procede et dispositif de guidage Download PDF

Info

Publication number
WO2004021166A1
WO2004021166A1 PCT/FI2003/000598 FI0300598W WO2004021166A1 WO 2004021166 A1 WO2004021166 A1 WO 2004021166A1 FI 0300598 W FI0300598 W FI 0300598W WO 2004021166 A1 WO2004021166 A1 WO 2004021166A1
Authority
WO
WIPO (PCT)
Prior art keywords
scrolling
text
display
motion
text lines
Prior art date
Application number
PCT/FI2003/000598
Other languages
English (en)
Inventor
Jukka-Pekka METSÄVAINIO
Manne Hannula
Original Assignee
Myorigo Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Myorigo Oy filed Critical Myorigo Oy
Priority to EP03790973A priority Critical patent/EP1535142A1/fr
Priority to AU2003249135A priority patent/AU2003249135A1/en
Publication of WO2004021166A1 publication Critical patent/WO2004021166A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163—Indexing scheme relating to constructional details of the computer
    • G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer

Definitions

  • the present invention generally relates to the display of electronic equipment such as mobile phones and more particularly to the browsing and reading of a large document on a display screen.
  • scroll bars permitting movements of the text either horizontally or vertically do not have jitter. That is, scroll bars can be used to permit the user to change the portion of the view on the display screen hori- zontally by sliding the horizontal scroll bar and vertically by sliding the vertical scroll bar.
  • a drawback with such methods is that scrolling is always either horizontal or vertical, i.e. no other direction is possible.
  • An objective of the present invention is to provide a guidance method for scrolling the display on a screen of a hand-held device having motion- controlled scrolling and a hand-held device performing the method.
  • the view shown on the display is a portion of larger content comprising text lines that are too long to be displayed entirely on the small display.
  • the guidance method should be adapted to follow accurately the reading direction of the text lines from the beginning of the text lines to the end of the text lines.
  • the reading direction should remain as uniform as possible during the entire reading event, i.e. unwanted effects such as jitter or bouncing of the text lines should not arise during the reading event.
  • a typical situation may be when a user is browsing a large full-size image or a document by scrolling the view shown on a mobile phone's display using motion-control scrolling.
  • the guidance method discovers when the user stops browsing and starts to read text lines. Then the need for guidance is examined. If the result of examination indicates that the user is reading the text lines, the scrolling direction is guided to follow the reading direction of the text lines. The guidance is invisible to the user.
  • the guidance method comprises three main steps: 1) the direction of the text lines shown on the display screen is periodically examined; 2) the movements of the mobile phone are periodically examined and, based on the movements, it is concluded whether the user is reading the text lines; 3) if the result of examination in step 2 indicates that the user is reading the text lines, the scrolling direction is reinforced in the direction of the text line so long as the difference between the current scrolling direction and the text line direction is less than a predetermined threshold value.
  • FIG. 1a-b illustrates a page of the document to be read on a display of a small portable device
  • FIG. 2 is a flowchart illustrating definitions of the direction of text lines on the display
  • FIG. 3 is a flowchart illustrating the method according to the invention
  • FIG. 4 illustrates the inventive idea with the help of a full-size image to be read on a display of a small portable device
  • FIG. 5a-b show an example of the determination of coordinates on the full- size image
  • FIG. 6a-b demonstrate how filtering is carried out.
  • the invention can be applied to a terminal having a small display, at least one sensor such as a magnetic pulse sensor, a acceleration transducer or gyroscope which is mounted in the back of the display, and a character recognition method or, alternatively, some other method for recognizing the direction of the text lines.
  • a sensor such as a magnetic pulse sensor, a acceleration transducer or gyroscope which is mounted in the back of the display
  • a character recognition method or, alternatively, some other method for recognizing the direction of the text lines.
  • FIG. 1a shows a typical situation where a user is browsing a large full-size image 10 on the display of a mobile phone.
  • the full- size image refers to a whole document or page, of which only a part can be displayed on the actual screen of the terminal.
  • the actual display of the mobile phone is illustrated by a dotted square 16 on the document page for visualizing the proportions of the display to the document.
  • the document page has been divided into several columns consisting of text sections 11 - 13 and non-text sections 14 - 15, such as pictures. Lines in the text column 13 are in a different direction than in the other two text columns 11 and 12.
  • FIG. 1b is an enlargement of the circled area in FIG. 1a. As seen, only a portion of the data is seen on the display at a time, i.e. a line of the document does not fit from beginning to end on the display. Scrolling directions are shown by double-ended arrows. Other scrolling directions are also possible, e.g. in the diagonal direction.
  • the data is displayed proportionally to the orientation or location of the mobile phone. That is, data scrolling in the vertical direction when the mobile phone is tilted vertically, and correspondingly, the data scrolls horizontally when the mobile phone is tilted horizontally.
  • the portion of the view displayed is moved to the beginning of the document or appropriate chapter by tilting the mobile phone in a suitable way.
  • a movable cursor is used to indicate a position of interest on the display surface by tilting the mobile phone.
  • the cursor moves horizontally when the mobile phone is tilted towards the vertical axis of the display, and correspondingly, the cursor moves vertically when the mobile phone is tilted towards the horizontal axis of the display.
  • the display shown on the screen depends on the motion of the hand.
  • hand movements are inaccurate.
  • Vv th- out accurate guidance unwanted jitter arises, making the reading uncomfortable and slow. This drawback is eliminated by the guidance method described in more detail in the following.
  • the guidance method comprises three main steps: 1) the direction of the text lines shown on the display screen is periodically examined; 2) the movements of the mobile phone are periodically examined and, based on the movements, it is concluded whether the user is reading the text lines; 3) if the result of examination in step 2 indicates that the user is reading the text lines, the scrolling direction is reinforced in the direction of the text line so long as the difference between the current scrolling direction and the text line direction is less than a predetermined threshold value.
  • FIG. 2 shows as a flowchart an example of the implementation of examination of the direction of text lines.
  • the first task is to analyze roughly whether there is text in the current portion on display. If no text is detected, free scrolling of the data is allowed at stage 21 , and the control is returned to stage 20.
  • One alternative is that the portion of the data that is seen on the display screen is first analyzed by defining the major components, i.e. whether the type of component represents the text or non-text.
  • Some character recognition method such as an optical character recognition method OCR, can be used.
  • OCR optical character recognition method
  • information about the type and size of the document, and the type and size of the font may already be included in the document, in which case no character recognition is needed.
  • FIG. 1a most of the page is covered with text.
  • the direction of text lines is defined to be horizontal. However, if the column 13 had been shown on the display, the text lines would have been defined to be vertical.
  • direction definition of the text lines can be created on the basis of the middle point of the current portion of view displayed. This method will be considered later in greater detail.
  • Another alternative utilizes image analysis and character recognition. The direction is defined on the basis of features of the analyzed data.
  • the definition results concerning the direction of the text lines are saved at stage 23.
  • the information also includes current time information.
  • the above-described analysis and definition are came out periodically at certain intervals.
  • a flowchart in FIG. 3 is used to demonstrate how the need for guidance is examined and carried out while one is browsing a large document on the display screen of a terminal by scrolling the display.
  • Coordinates of the current partial view of the full-size image are read at the fixed reading point (xi, yi) of the display.
  • the fixed reading point is the middle point of the display.
  • the coordinates of the current view at the middle point of the display are then saved at certain time instances e.g. every second, at stage 30.
  • a set of motion vectors is obtained.
  • the motion distribution as a time function is calculated at stage 31 by using the motion vector set.
  • the need for guidance is examined. If the distribution is narrow, it means that movements have been found, which do not deflect much from the main movement direction or scrolling direction. In other words, if the scrolling direction is in the direction of the x-axis, the coordinates of the page, which have been read at the middle point of the display, seem to follow the general direction of the x-axis (the text line), i.e. the scrolling direction is not exactly rectilinear. If such movement as described above is not detected or the distribution is relatively broad, free scrolling is still allowed, at stage 35. Otherwise, the next stage 33 is to examine more accurately whether there is a need to guide the reading direction. In this case the distribution is compared with the saved information (see FIG.
  • stage 34 it is analyzed whether the result of the comparison indicates, in a given time, successive movements which are roughly in the same direction. If the result does not indicate such movements, free scrolling of the data is still allowed at stage 35. Otherwise, the data is filtered in such a way that the direction of the text lines are taken into account at stage 36. Regardless of the result of the comparison, the steps above are repeated from stage 30.
  • FIG. 4 demonstrates how the defining and filtering are carried out mathematically.
  • the assumption in this example is that the direction of the text lines on the display is defined to be horizontal by the character recognition method.
  • a vector 42 represents that direction.
  • the additional assumption is that coordinates of the partial view 40 of the full-size image are read at the middle point 43 of the display. Based on the successive coordinates, a set of motion vectors are obtained, wherein if the directions of said motion vectors are roughly in the direction of the text line, this indicates that the user is reading the text lines.
  • the curve 41 represents the set of motion vectors.
  • Coordinates of the partial view of the full-size image are controlled by a cer- tain time window.
  • the position of the middle point 43 on the full-size image 10 varies as time function.
  • FS sample rate
  • Each sample consists of the coordinates (xi, yi) of a point Pi on the curve at a given time.
  • a current coordinate pair (xi,yi) is saved every second within a certain time interval, such as 10 s.
  • These samples formulate a temporal matrix T, where the first row of the matrix represents the x-coordinates and the second row the y-coordinates, so that each column presents one coordinate pair (xi,yi).
  • the parameter D represents the direction (angle) of the text line under examination.
  • the definition value for D is 0 radians when the text line is in the vertical direction and ⁇ /2 radians when the text line is in the horizontal direction.
  • parameter D can have any angle value between 0 - n2 ⁇ radians.
  • the current direction (angle) between each consecutive point in temporal matrix T is calculated. For example, if at time t1 the coordinates at point P1 are (x1 , y1) and at time t2 at point P2 (x2, y1), the vector between the two points P1 and P2 defines the direction (angle) at time t1 , where ⁇ t is (t2-t1 , t2 > t1). In general the result of calculation is N-1 directions or vectors when the number of samples is N.
  • the calculated N-1 directions formulate a vector U.
  • the result is nine vectors, each of which has a direction (angle) between 0-n2 ⁇ radians. That is the result is the distribution of directions within 10 seconds.
  • the shape of distribution of the directions is narrow, a lot of movements have been found in the same direction.
  • the shape of distribution is broad, only some movements are in the same direction.
  • curve 41 and vector 42 are in the same direction. Otherwise curve 41 and vector 42 are in different directions. In the first case mentioned above, i.e. when curve 41 and vector
  • the scroll direction is guided to follow accurately the reading direction of the text lines by filtering from the scrolling motion those components which differ from the direction of the text lines.
  • FIG. 5a illustrates how the view shown on the display looks at time t1. It is seen that the middle point of the current view 500 is in point P1 at time t1. Within time (t1+ ⁇ t) - 11 the display on the screen has been moved or the middle point of the previous display has been moved on the full-size image from point P1 to point P2, when the current view 500 is now the view 501 as shown in FIG. 5b.
  • FIG. 6a and 6b illustrate a situation similar to what was explained above with reference to FIG. 5a-5b, but here the filtering is in action.
  • the vector a from the initial point P1 to the terminal point P2 represents the displacement of the full-size image within a given time.
  • the vector b is a unit vector (i.e.
  • 1) in the direction of the x-axis.
  • the initial point of vector b is at point P1.
  • FIG. 6b illustrates said determination.
  • p is the product of the magnitudes of a and b and the cosine angle ⁇ between them.
  • ⁇ is ⁇ /4.
  • the initial point of the vector a x is at point P1 and the terminal point at point PS.
  • the vector a x represents the displacement of the full-size image in the x-direction within the time ⁇ t.
  • the calculation described above is repeated correspondingly for displacements at intervals as long as the filtering is activated.
  • the time period is a sample period 1/FS.
  • the above-described method can be used in a hand-held terminal having a motion controlled scrolling operation by adapting the terminal to: read coordinates of the scrolling display at a fixed reading point of the screen at predetermined time intervals, wherein a set of motion vectors is obtained; determine the scrolling direction based on the set of motion vectors; examine whether the scrolling direction is roughly the same as the direction of a text line; and if so, reinforce the displayed scrolling in the direction of the text line as long as the difference between the current scrolling direction and the text line direction is less than a predetermined threshold value.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Controls And Circuits For Display Device (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne le défilement et la lecture d'un document de grande taille sur l'affichage d'équipements électroniques portables de taille réduite, de type téléphones portables ou assistants numériques personnels, dans lesquels la visualisation sur l'écran d'affichage est fondée sur un angle d'inclinaison desdits équipements. L'invention a pour objectif de fournir un procédé de guidage qui permet de lire des lignes de texte dans un document dont la taille réelle est plus grande que celle de l'écran d'affichage, sans obtenir d'effets non désirés de type effet de gigue ou d'instabilité. Le procédé de guidage de l'invention permet ainsi de suivre précisément le sens de lecture des lignes de texte du début à la fin de celles-ci.
PCT/FI2003/000598 2002-09-02 2003-08-12 Procede et dispositif de guidage WO2004021166A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP03790973A EP1535142A1 (fr) 2002-09-02 2003-08-12 Procede et dispositif de guidage
AU2003249135A AU2003249135A1 (en) 2002-09-02 2003-08-12 Guidance method and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FI20021560A FI115255B (fi) 2002-09-02 2002-09-02 Kannettavan päätelaitteen näytön ohjausmenetelmä ja kannettava päätelaite
FI20021560 2002-09-02

Publications (1)

Publication Number Publication Date
WO2004021166A1 true WO2004021166A1 (fr) 2004-03-11

Family

ID=8564507

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/FI2003/000598 WO2004021166A1 (fr) 2002-09-02 2003-08-12 Procede et dispositif de guidage

Country Status (4)

Country Link
EP (1) EP1535142A1 (fr)
AU (1) AU2003249135A1 (fr)
FI (1) FI115255B (fr)
WO (1) WO2004021166A1 (fr)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2412048A (en) * 2004-03-09 2005-09-14 Jitendra Jayantilal Ranpura Viewing an image larger than the display device
US7864163B2 (en) 2006-09-06 2011-01-04 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US8022970B2 (en) * 2004-10-14 2011-09-20 Canon Kabushiki Kaisha Image processing result display apparatus, image processing result display method, and program for implementing the method
US8214768B2 (en) 2007-01-05 2012-07-03 Apple Inc. Method, system, and graphical user interface for viewing multiple application windows
US8438504B2 (en) 2010-01-06 2013-05-07 Apple Inc. Device, method, and graphical user interface for navigating through multiple viewing areas
US8531423B2 (en) 2006-09-06 2013-09-10 Apple Inc. Video manager for portable multifunction device
US8736561B2 (en) 2010-01-06 2014-05-27 Apple Inc. Device, method, and graphical user interface with content display modes and display rotation heuristics
US8842074B2 (en) 2006-09-06 2014-09-23 Apple Inc. Portable electronic device performing similar operations for different gestures
US9367232B2 (en) 2007-01-07 2016-06-14 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US9383818B2 (en) 2013-12-27 2016-07-05 Google Technology Holdings LLC Method and system for tilt-based actuation
US9619143B2 (en) 2008-01-06 2017-04-11 Apple Inc. Device, method, and graphical user interface for viewing application launch icons
US9772751B2 (en) 2007-06-29 2017-09-26 Apple Inc. Using gestures to slide between user interfaces
US9933937B2 (en) 2007-06-20 2018-04-03 Apple Inc. Portable multifunction device, method, and graphical user interface for playing online videos
US9933913B2 (en) 2005-12-30 2018-04-03 Apple Inc. Portable electronic device with interface reconfiguration mode
US10313505B2 (en) 2006-09-06 2019-06-04 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US10620780B2 (en) 2007-09-04 2020-04-14 Apple Inc. Editing interface
US11126321B2 (en) 2007-09-04 2021-09-21 Apple Inc. Application menu user interface
US12028473B2 (en) 2023-06-16 2024-07-02 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5602566A (en) * 1993-08-24 1997-02-11 Hitachi, Ltd. Small-sized information processor capable of scrolling screen in accordance with tilt, and scrolling method therefor
EP0805389A2 (fr) * 1996-04-30 1997-11-05 Sun Microsystems, Inc. Défilement sur le sunpad selon son inclinaison
WO1998014863A2 (fr) * 1996-10-01 1998-04-09 Philips Electronics N.V. Dispositif tenu a la main et permettant d'afficher des images
GB2336747A (en) * 1998-04-22 1999-10-27 Nec Corp Hand held communication terminal and method of scrolling display screen of the same.

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5602566A (en) * 1993-08-24 1997-02-11 Hitachi, Ltd. Small-sized information processor capable of scrolling screen in accordance with tilt, and scrolling method therefor
EP0805389A2 (fr) * 1996-04-30 1997-11-05 Sun Microsystems, Inc. Défilement sur le sunpad selon son inclinaison
WO1998014863A2 (fr) * 1996-10-01 1998-04-09 Philips Electronics N.V. Dispositif tenu a la main et permettant d'afficher des images
GB2336747A (en) * 1998-04-22 1999-10-27 Nec Corp Hand held communication terminal and method of scrolling display screen of the same.

Cited By (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2412048A (en) * 2004-03-09 2005-09-14 Jitendra Jayantilal Ranpura Viewing an image larger than the display device
US8022970B2 (en) * 2004-10-14 2011-09-20 Canon Kabushiki Kaisha Image processing result display apparatus, image processing result display method, and program for implementing the method
US11650713B2 (en) 2005-12-30 2023-05-16 Apple Inc. Portable electronic device with interface reconfiguration mode
US11449194B2 (en) 2005-12-30 2022-09-20 Apple Inc. Portable electronic device with interface reconfiguration mode
US10915224B2 (en) 2005-12-30 2021-02-09 Apple Inc. Portable electronic device with interface reconfiguration mode
US10884579B2 (en) 2005-12-30 2021-01-05 Apple Inc. Portable electronic device with interface reconfiguration mode
US10359907B2 (en) 2005-12-30 2019-07-23 Apple Inc. Portable electronic device with interface reconfiguration mode
US9933913B2 (en) 2005-12-30 2018-04-03 Apple Inc. Portable electronic device with interface reconfiguration mode
US10656778B2 (en) 2006-09-06 2020-05-19 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US10778828B2 (en) 2006-09-06 2020-09-15 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US7864163B2 (en) 2006-09-06 2011-01-04 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US11736602B2 (en) 2006-09-06 2023-08-22 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US11592952B2 (en) 2006-09-06 2023-02-28 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US9690446B2 (en) 2006-09-06 2017-06-27 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US11106326B2 (en) 2006-09-06 2021-08-31 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US11023122B2 (en) 2006-09-06 2021-06-01 Apple Inc. Video manager for portable multifunction device
US11481112B2 (en) 2006-09-06 2022-10-25 Apple Inc. Portable electronic device performing similar operations for different gestures
US9927970B2 (en) 2006-09-06 2018-03-27 Apple Inc. Portable electronic device performing similar operations for different gestures
US11921969B2 (en) 2006-09-06 2024-03-05 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US8669950B2 (en) 2006-09-06 2014-03-11 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US10222977B2 (en) 2006-09-06 2019-03-05 Apple Inc. Portable electronic device performing similar operations for different gestures
US10228815B2 (en) 2006-09-06 2019-03-12 Apple Inc. Portable electronic device, method, and graphical user interface for displaying structured electronic documents
US10838617B2 (en) 2006-09-06 2020-11-17 Apple Inc. Portable electronic device performing similar operations for different gestures
US10313505B2 (en) 2006-09-06 2019-06-04 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US8547355B2 (en) 2006-09-06 2013-10-01 Apple Inc. Video manager for portable multifunction device
US8531423B2 (en) 2006-09-06 2013-09-10 Apple Inc. Video manager for portable multifunction device
US11481106B2 (en) 2006-09-06 2022-10-25 Apple Inc. Video manager for portable multifunction device
US11240362B2 (en) 2006-09-06 2022-02-01 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets
US8842074B2 (en) 2006-09-06 2014-09-23 Apple Inc. Portable electronic device performing similar operations for different gestures
US8214768B2 (en) 2007-01-05 2012-07-03 Apple Inc. Method, system, and graphical user interface for viewing multiple application windows
US10732821B2 (en) 2007-01-07 2020-08-04 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US10254949B2 (en) 2007-01-07 2019-04-09 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US11586348B2 (en) 2007-01-07 2023-02-21 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US9367232B2 (en) 2007-01-07 2016-06-14 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US11169691B2 (en) 2007-01-07 2021-11-09 Apple Inc. Portable multifunction device, method, and graphical user interface supporting user navigations of graphical objects on a touch screen display
US9933937B2 (en) 2007-06-20 2018-04-03 Apple Inc. Portable multifunction device, method, and graphical user interface for playing online videos
US10761691B2 (en) 2007-06-29 2020-09-01 Apple Inc. Portable multifunction device with animated user interface transitions
US9772751B2 (en) 2007-06-29 2017-09-26 Apple Inc. Using gestures to slide between user interfaces
US11507255B2 (en) 2007-06-29 2022-11-22 Apple Inc. Portable multifunction device with animated sliding user interface transitions
US10620780B2 (en) 2007-09-04 2020-04-14 Apple Inc. Editing interface
US11861138B2 (en) 2007-09-04 2024-01-02 Apple Inc. Application menu user interface
US11010017B2 (en) 2007-09-04 2021-05-18 Apple Inc. Editing interface
US11126321B2 (en) 2007-09-04 2021-09-21 Apple Inc. Application menu user interface
US11604559B2 (en) 2007-09-04 2023-03-14 Apple Inc. Editing interface
US9619143B2 (en) 2008-01-06 2017-04-11 Apple Inc. Device, method, and graphical user interface for viewing application launch icons
US10628028B2 (en) 2008-01-06 2020-04-21 Apple Inc. Replacing display of icons in response to a gesture
US9733812B2 (en) 2010-01-06 2017-08-15 Apple Inc. Device, method, and graphical user interface with content display modes and display rotation heuristics
US8736561B2 (en) 2010-01-06 2014-05-27 Apple Inc. Device, method, and graphical user interface with content display modes and display rotation heuristics
US8438504B2 (en) 2010-01-06 2013-05-07 Apple Inc. Device, method, and graphical user interface for navigating through multiple viewing areas
US9720514B2 (en) 2013-12-27 2017-08-01 Google Technology Holdings LLC Method and system for tilt-based actuation
US9383818B2 (en) 2013-12-27 2016-07-05 Google Technology Holdings LLC Method and system for tilt-based actuation
US12026352B2 (en) 2023-04-04 2024-07-02 Apple Inc. Portable electronic device with interface reconfiguration mode
US12028473B2 (en) 2023-06-16 2024-07-02 Apple Inc. Portable multifunction device, method, and graphical user interface for configuring and displaying widgets

Also Published As

Publication number Publication date
FI20021560A (fi) 2004-03-03
FI115255B (fi) 2005-03-31
AU2003249135A1 (en) 2004-03-19
EP1535142A1 (fr) 2005-06-01
FI20021560A0 (fi) 2002-09-02

Similar Documents

Publication Publication Date Title
WO2004021166A1 (fr) Procede et dispositif de guidage
US7129926B2 (en) Navigation tool
EP1507192B1 (fr) Détection d'un geste d'attente en examinant des paramètres associés au mouvement du stylo
EP1328919B2 (fr) Outil de pointage
JP4943543B2 (ja) 地図表示装置、地図表示方法、地図表示プログラムおよび記録媒体
US20070070037A1 (en) Graphic signal display apparatus and method for hand-held terminal
US8531410B2 (en) Finger occlusion avoidance on touch display devices
US20070018966A1 (en) Predicted object location
KR100518824B1 (ko) 필기 모션 획 구분 인식 시스템 및 그 인식방법
US20090002324A1 (en) Method, Apparatus and Computer Program Product for Providing a Scrolling Mechanism for Touch Screen Devices
EP1887776A1 (fr) Terminal portable et procédé de contrôle de son interface homme/machine basé sur reconnaissance de forme et analyse d'images capturées par une caméra
JP5604279B2 (ja) ジェスチャー認識装置、方法、プログラム、および該プログラムを格納したコンピュータ可読媒体
EP2306291A2 (fr) Dispositif d'affichage d'informations
US20080030477A1 (en) Display Motion Multiplier
US20040208394A1 (en) Image display device and method for preventing image Blurring
JPH0772970A (ja) 情報選択装置及び情報選択方法
KR100777107B1 (ko) 가속도 센서를 이용한 문자인식 장치 및 방법
US20110043453A1 (en) Finger occlusion avoidance on touch display devices
WO2008054185A1 (fr) Procédé de déplacement/d'agrandissement/de réduction d'un écran virtuel par déplacement du dispositif d'affichage et équipement de données à main utilisant ce dernier
EP1993025A2 (fr) Systèmes et procédés d'évaluation de retard
US8355599B2 (en) Methods and devices for detecting changes in background of images using multiple binary images thereof and hough transformation
US20060195800A1 (en) Apparatus for displaying screen and recording medium recording a program thereof
EP3125089B1 (fr) Dispositif terminal, procédé de commande d'affichage et programme
EP3379451A1 (fr) Dispositif de traitement d'informations
US20180300033A1 (en) Display method and display device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003790973

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2003790973

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP