WO1998022910A1 - Procede et dispositif d'affichage d'une image d'un document sur un ecran - Google Patents

Procede et dispositif d'affichage d'une image d'un document sur un ecran Download PDF

Info

Publication number
WO1998022910A1
WO1998022910A1 PCT/GB1997/003126 GB9703126W WO9822910A1 WO 1998022910 A1 WO1998022910 A1 WO 1998022910A1 GB 9703126 W GB9703126 W GB 9703126W WO 9822910 A1 WO9822910 A1 WO 9822910A1
Authority
WO
WIPO (PCT)
Prior art keywords
text
image
line
segments
window
Prior art date
Application number
PCT/GB1997/003126
Other languages
English (en)
Inventor
Paul Booth
Original Assignee
Geoworks Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Geoworks Corporation filed Critical Geoworks Corporation
Publication of WO1998022910A1 publication Critical patent/WO1998022910A1/fr

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text

Definitions

  • This invention relates to a method of and apparatus for displaying an image of a document on a display.
  • it relates to a method of and apparatus for displaying an image of a bit-mapped text document on a display, in which the text document has been received from a physically remote transmitting device, such as a remote facsimile machine.
  • One conventional approach is to display a portion of the bit-mapped image at a reduced magnification, with the user being able to select a region of the displayed bit-mapped image for extra magnification.
  • the user can call up a window that acts as if it is a "magnifying glass", magnifying the text underlying the window so that it can be read.
  • a user can read words falling within a typically rectangular frame and can scroll the magnifying glass over the displayed portion of the text so that the text can be viewed.
  • One disadvantage with this approach is that it is inconvenient to the user since the user must carefully control the scrolling of the magnifying glass to read even a single line of text. Returning to the start of the next line is often difficult. This is particularly the case for computers or telephones with small screens, such as personal digital assistants or mobile communicators.
  • Another conventional approach is to attempt to recognise text represented by bitmapped images using character recognition software. Once the bit-mapped text is converted to data, then it is easy to display the entire message by enabling the user to scroll through it.
  • this approach generally loses most or all of the format of the original image, which may be inconvenient.
  • character recognition software is not sufficiently accurate for this task, is expensive, slow in operation and requires significant processing capabilities that may be beyond simpler personal digital assistants.
  • a method of displaying an image of a document on a display screen comprises the steps of:
  • a bit mapped image of text such as a facsimile image
  • a computer screen so that the text can be easily read.
  • bit-mapped text could be divided into four segments of equal width, with the bit-mapped text from each segment being processed to a legible size and then displayed within a window divided into four rows, with the first row containing the processed text from the segment from the far left of the unmagnified line, the next row down containing the processed text from the next segment along and so forth.
  • step [2] displaying either some or all of the image either (i) at a magnification at which it is not readily legible or (ii) as a picture representative of the image.
  • This approach allows the user to select the data which is to be extracted and processed from the document image. For example, where that data corresponds to an entire line of bit-mapped text, then the user can select which particular line is to be extracted and re-assembled in magnified form. This can be achieved by providing a scrollable window (a "text selection window") or marker which can be moved to overlie the low magnification, illegible, portion of the image to be re-assembled.
  • a scrollable window a "text selection window” or marker which can be moved to overlie the low magnification, illegible, portion of the image to be re-assembled.
  • the low magnification, illegible image can be scrolled past a fixed marker such as a window covering the entire width of the image, which overlies that portion of the image to be re-assembled in magnified form.
  • a fixed marker such as a window covering the entire width of the image, which overlies that portion of the image to be re-assembled in magnified form. It is convenient if only a single line of text is processed for re-assembly in magnified form.
  • the height of characters, the line spacing etc. varies from document to document and may vary even within a document itself. It is therefore not possible to provide a fixed height narrow, rectangular text selection window [or other marker] for example, which will work with all documents. This problem can be solved by allowing the user to vary the height of such a window [or other marker].
  • the text selection window can be defined by a single line marking the centre of the short axis of the window; on screen buttons can then be provided which when selected either increase or decrease the height of the window.
  • Another approach is to provide "grab handles" at some or all corners of the window; these can be dragged to enlarge or decrease the height of the window.
  • Yet another alternative is to provide pattern recognition which can determine the height of a line of text, by for example, looking at a pre-determined narrow region of the text selection window and decreasing the height of that window in incremental steps until an output from a pattern recognition engine indicates that it most closely matches the pattern associated with a single line of text, preferably with a small- amount of unfilled space above and below the line of text.
  • the window may be dispensed with entirely: the system automatically work out work out the positions of each line of text using a pattern recognition engine. This removes the need for manual selection via a text selection window. Either approach can be implemented by those skilled in the recognisor arts. Further, since many of the devices for which this invention will be most apt will anyway incorporate hand-writing recognition software, the extra burden this approach places on cost and performance is minimal. Some areas of the image may not be full width lines of text. Conveniently, the width of the window [or other marker] can be controlled by the user, for instance by dragging "grab handles" at the corners of the window until the appropriate width is reached.
  • the window [or other marker] can be used to indicate, at the user's option, either a conventional "magnifying glass” region or the re-assembly and magnification approach of this invention.
  • the image comprises both text and some pictures
  • the user may wish to view the text using the method of the present invention, but switch to the conventional "magnifying glass” approach to view the picture.
  • the magnified image portions may be arranged to appear within the same window.
  • on-screen control buttons can present the user with the option of selecting either mode.
  • an apparatus for displaying an image of a document on a screen comprises:
  • a receiver for receiving, from a remote transmitting device, a bit-mapped image of a document comprising text
  • a processor programmed (i) to process the document by dividing a whole or part of a line of text into segments; (ii) to process the segments so that text in each segment can be displayed at a legible size and (iii) to re-arrange the segments which are positioned adjacently in a line or a part of a line into two or more rows so that their contents can be easily read and
  • Figure 1 is a schematic block diagram illustrating the major components of such an apparatus for displaying an image of a document on a screen in accordance with the present invention
  • Figure 2 is a plan view of such an apparatus showing what might be displayed by such an apparatus.
  • a display means 2 comprising a LCD type display, is shown forming part of a computer indicated generally at 1.
  • the computer comprises a translucent transducer pad 3 overlaying the display 2, together with a stylus 4.
  • the pad 3 is an Indium Tin Oxide (ITO) device which is well known in this art. It is operable to supply a signal indicative of the position at which the stylus 4 touches the pad 3 and allows the user to easily and naturally input graphical information for storage and subsequent, although nearly immediate, display by the apparatus.
  • ITO Indium Tin Oxide
  • the transducer ITO pad 3 also known as a digitiser, is shown schematically overlaying the LCD type display 2.
  • the stylus 4 is touching the pad 3 and electrical signals indicative of the position (X Y co-ordinates) at which it contacts the pad 3 are supplied from the stylus 4 to an A to D converter 14 feeding a data path or system bus 10.
  • a CPU 12 is connected for bi-directional data flow to the bus 10, as is a RAM 17.
  • a ROM 18 is also connected to bus 10, being programmed with the operating system for the apparatus.
  • CPU 12 provides all control signals via bus 10.
  • RAM 17 stores, inter alia, the data defining received bit-mapped facsimile messages.
  • RAM 17 may be an EEPROM or other form of memory.
  • CPU 12 may be a microprocessor such as an ARM RISC chip.
  • a serial data interface 19 connected to bus 10 for sending and receiving information.
  • a display driver 11 is connected to bus 10 and drives the display 2.
  • facsimile data defining the bit-mapped facsimile image is sent via the serial interface 19 from a fax/modem [not shown] and is stored in RAM 17 or other storage medium. A reduced size version of the image, with much information lost, is displayed on the display 2 at 21.
  • the text in facsimile image 21 is not legible.
  • the user selects the "Fax View" [TM] function from a drop down menu or other conventional system.
  • Fax View text selection window 22 appears on screen over a portion of the facsimile image 21.
  • the user can move text selection window 22 around facsimile image 21 using the conventional 4-way movement controller 23.
  • the user can simply drag the text selection window 22 to the desired location.
  • the height of the text selection window 22 may be automatically varied to match the height of the text in the facsimile by a pattern recognition engine as described earlier, in those implementations where a recognisor engine is available. The details of the pattern recognition engine will be familiar to the skilled implementer.
  • grab handles 24 are provided at each corner which enable the user to alter the height and width as necessary.
  • marker 25 is provided that indicates the centre of the short axis of the text selection window 22; marker 26 is provided that indicates the centre of the long axis of the text selection window 22. The user can drag markers 25 and 26 to the appropriate position using either the conventional 4-way movement controller 23 or, where the computer is pen driven, by dragging marker 25 or 26 with the pen.
  • Text selection window 22 is divided into four equal width sections 27 A, 27B, 27 C and 27D.
  • the bit maps in the segment of the facsimile image 21 which underlie each equal width section are processed by being subject to a simple magnification process which enlarges and maps the contents of each section 27A to 27D into a respective section of the viewing window 30; viewing window 30 is divided into four rows, 30A, 30B, 30C and 30D.
  • Section 27 A of the facsimile image 21 is mapped into row 30A; section 27B of the facsimile image 21 is mapped into row 30B; section 27C of the facsimile image 21 is mapped into row 30C; section 27D of the facsimile image 21 is mapped into row 30D.
  • the viewing window can be used not only merely to display single lines of the original facsimile image 21 broken down into a number of rows as described above; in addition, it can be used to select an area of the image 21 to be viewed without being split into segments and then re-assembled.
  • the viewing window 30 becomes a conventional "magnifying glass".
  • the text selection window is shrunk down to a size which enables the whole of the image that it underlies to be displayed within the viewing window 30. This feature enables the user to switch quickly from the "Fax View" embodiment of this invention to a conventional "magnifying glass".
  • a pattern recognition engine searches a narrow strip on the left hand border of each section 27 A, 27B, 27C and 27D for the presence of an underlying bit mapped text. If underlying text is indicated, the width of the relevant section is incrementally varied and the search of the narrow band repeated. The process continues until it is determined that no text underlies the narrow band. The process is then repeated for the next section along until all sections across the entire width of the line have been sized to ensure that no underlying word will be split into two when viewed in the viewing window 30.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'affichage d'un message fac-similé, à texte en mode point, sur un ordinateur à petit écran, tel qu'un assistant personnel, se révèle difficile étant donné la taille limitée de cet écran. L'invention concerne une fenêtre de sélection d'un texte défilant à l'écran, laquelle s'étend sur toute la largeur d'une image miniaturisée et donc non lisible du fac-similé reçu, et présente une hauteur telle qu'elle ne recouvre qu'une seule une ligne du texte en mode point. Cette fenêtre de sélection de texte est divisée en quatre segments de largeur égale, le texte en mode point situé dans le segment le plus à gauche étant agrandi pour être lisible, puis affiché en tant que première rangée dans une fenêtre de visualisation. Le segment suivant, se déplaçant vers la droite sur la ligne de texte est également soumis à un agrandissement et placé dans une rangée de la fenêtre de visualisation située en dessous de la rangée la plus haute. Le procédé se répète pour les quatre segments; la ligne originale est ainsi divisée en quatre sections qui sont affichées sous forme de quatre rangées dans la fenêtre de visualisation, permettant ainsi la lecture facile de la ligne dans cette fenêtre.
PCT/GB1997/003126 1996-11-22 1997-11-21 Procede et dispositif d'affichage d'une image d'un document sur un ecran WO1998022910A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GBGB9624281.3A GB9624281D0 (en) 1996-11-22 1996-11-22 Method of and apparatus for displaying an image of a document on a display
GB9624281.3 1996-11-22

Publications (1)

Publication Number Publication Date
WO1998022910A1 true WO1998022910A1 (fr) 1998-05-28

Family

ID=10803309

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB1997/003126 WO1998022910A1 (fr) 1996-11-22 1997-11-21 Procede et dispositif d'affichage d'une image d'un document sur un ecran

Country Status (2)

Country Link
GB (1) GB9624281D0 (fr)
WO (1) WO1998022910A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1215563A2 (fr) 2000-12-15 2002-06-19 Nokia Corporation Méthode et dispositif pour afficher des pages hypertextes
GB2424812A (en) * 2005-03-30 2006-10-04 Kyocera Corp Displaying document along with additional window to show character string
US7877704B2 (en) 2000-04-13 2011-01-25 Nokia Corporation Radio terminal
CN106104516A (zh) * 2014-03-25 2016-11-09 富士通株式会社 终端装置、显示控制方法以及程序

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4833627A (en) * 1986-08-29 1989-05-23 The Toles Group Computerized typesetting correction system
EP0397242A1 (fr) * 1989-05-08 1990-11-14 Océ-Nederland B.V. Publication assistée par ordinateur et procédé pour la formation de documents
WO1992016898A1 (fr) * 1991-03-12 1992-10-01 Wang Laboratories, Inc. Systeme d'affichage et procede de defilement dependant du contexte
EP0609030A1 (fr) * 1993-01-26 1994-08-03 Sun Microsystems, Inc. Méthode et appareil pour regarder des informations dans une base de données d'ordinateur
US5528732A (en) * 1994-10-17 1996-06-18 Xerox Corporation Reprographic device for making copies with multi-spaced lines
GB2298102A (en) * 1995-02-17 1996-08-21 Samsung Aerospace Ind Over head projector apparatus
US5562353A (en) * 1993-11-02 1996-10-08 Casio Computer Co., Ltd. Tape printing apparatus that calculates character sizes and line lengths

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4833627A (en) * 1986-08-29 1989-05-23 The Toles Group Computerized typesetting correction system
EP0397242A1 (fr) * 1989-05-08 1990-11-14 Océ-Nederland B.V. Publication assistée par ordinateur et procédé pour la formation de documents
WO1992016898A1 (fr) * 1991-03-12 1992-10-01 Wang Laboratories, Inc. Systeme d'affichage et procede de defilement dependant du contexte
EP0609030A1 (fr) * 1993-01-26 1994-08-03 Sun Microsystems, Inc. Méthode et appareil pour regarder des informations dans une base de données d'ordinateur
US5562353A (en) * 1993-11-02 1996-10-08 Casio Computer Co., Ltd. Tape printing apparatus that calculates character sizes and line lengths
US5528732A (en) * 1994-10-17 1996-06-18 Xerox Corporation Reprographic device for making copies with multi-spaced lines
GB2298102A (en) * 1995-02-17 1996-08-21 Samsung Aerospace Ind Over head projector apparatus

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7877704B2 (en) 2000-04-13 2011-01-25 Nokia Corporation Radio terminal
EP1215563A2 (fr) 2000-12-15 2002-06-19 Nokia Corporation Méthode et dispositif pour afficher des pages hypertextes
US7478322B2 (en) 2000-12-15 2009-01-13 Nokia Corporation Method and arrangement for displaying hypertext pages
GB2424812A (en) * 2005-03-30 2006-10-04 Kyocera Corp Displaying document along with additional window to show character string
GB2424812B (en) * 2005-03-30 2008-02-13 Kyocera Corp Portable terminal and document display control method thereof
CN106104516A (zh) * 2014-03-25 2016-11-09 富士通株式会社 终端装置、显示控制方法以及程序
EP3125089A4 (fr) * 2014-03-25 2017-03-15 Fujitsu Limited Dispositif terminal, procédé de commande d'affichage et programme
US10162501B2 (en) 2014-03-25 2018-12-25 Fujitsu Limited Terminal device, display control method, and non-transitory computer-readable recording medium
CN106104516B (zh) * 2014-03-25 2019-06-28 富士通株式会社 终端装置、显示控制方法以及程序

Also Published As

Publication number Publication date
GB9624281D0 (en) 1997-01-08

Similar Documents

Publication Publication Date Title
US7956845B2 (en) Apparatus and method for providing virtual graffiti and recording medium for the same
EP1026574B1 (fr) Interface utilisateur graphique pour régler la condition de traitement par une opération glisser-déplacer
EP0493990A2 (fr) Commande et méthode de défilement d'image affichée
US20010004256A1 (en) Display system, display control method and computer readable medium storing display control program code
WO1999032960A1 (fr) Dispositif d'affichage portatif et procede d'affichage de pages d'ecran
JP4807403B2 (ja) ウェブページ表示制御装置、ウェブページ表示方法、およびコンピュータプログラム
EP2958312A2 (fr) Unité d'affichage d'informations et procédé de type multiniveau, dispositif de commande et programme exécutable sur ordinateur
WO1994010678A1 (fr) Systeme de saisie de donnees pour ordinateurs a tablette electronique
JP2000172243A (ja) 表示装置及び表示方法並びに表示制御プログラムを記憶した記憶媒体
WO1998022910A1 (fr) Procede et dispositif d'affichage d'une image d'un document sur un ecran
JP2729026B2 (ja) コンテナ・オブジェクトの内容物を提示する方法及び装置
JPH04337873A (ja) 画像表示装置及び方法
EP0575316B1 (fr) Systeme d'affichage et procede de defilement dependant du contexte
JPH052584A (ja) 文書処理装置
JP2022179604A (ja) 情報処理装置、情報処理方法、及びプログラム
JP3376254B2 (ja) 表示装置、表示制御方法及び記録媒体
JP6372116B2 (ja) 表示処理装置、画面表示方法およびコンピュータープログラム
US6426760B1 (en) Information processing apparatus, area selection control method and storage medium
JP6485579B2 (ja) 表示処理装置、画面表示方法およびコンピュータープログラム
JP4941179B2 (ja) 情報処理装置及び文書閲覧プログラム
JP6541836B2 (ja) 情報処理装置、及びその制御方法、並びにプログラム
KR100228806B1 (ko) 휴대용 정보 단말기의 화면 표시방법
JPH07261736A (ja) 拡大表示装置
EP1091278A2 (fr) Appareil electronique
JP2995765B2 (ja) 画像記憶装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): GB JP SG US

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase