WO1998009446A2 - Systeme et procede de lecture rapide d'informations stockees dans un ordinateur - Google Patents

Systeme et procede de lecture rapide d'informations stockees dans un ordinateur Download PDF

Info

Publication number
WO1998009446A2
WO1998009446A2 PCT/SG1997/000036 SG9700036W WO9809446A2 WO 1998009446 A2 WO1998009446 A2 WO 1998009446A2 SG 9700036 W SG9700036 W SG 9700036W WO 9809446 A2 WO9809446 A2 WO 9809446A2
Authority
WO
WIPO (PCT)
Prior art keywords
computer
information
pages
signal
browsing
Prior art date
Application number
PCT/SG1997/000036
Other languages
English (en)
Other versions
WO1998009446A3 (fr
Inventor
Seng Beng Ho
Original Assignee
Seng Beng Ho
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US08/703,407 external-priority patent/US5909207A/en
Priority claimed from US08/703,404 external-priority patent/US6064384A/en
Application filed by Seng Beng Ho filed Critical Seng Beng Ho
Priority to AU44081/97A priority Critical patent/AU4408197A/en
Publication of WO1998009446A2 publication Critical patent/WO1998009446A2/fr
Publication of WO1998009446A3 publication Critical patent/WO1998009446A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547—Touch pads, in which fingers can move on a surface

Definitions

  • the present invention relates to a computer hardware and software system including a computer input device that can be operatively combined with several methods of display on a computer screen under software and hardware control for the purpose of browsing through documents stored in a computer.
  • the present invention facilitates the browsing of a document stored in a computer in such a way that it allows a rapid view of what contents are present and the organization of the material in the document, as well as rapid access to the items in the document involved.
  • a means is provided to scroll the document up and down or to jump to a particular point in the document (through the use of, for example, a "mouse" coupled with scroll bars at the edges of the document displayed on the screen or through the use of hypertext links) .
  • the printed version of the information involved is necessary, like in the case of printing a picture on a sheet of paper to be pasted on some surface (e.g., a wall), or in the case of the convenience of having a relatively light, hardy paperback book for reading in almost any possible situation and location, but there are times when a reader is quite happy to sit at a desk in front of a desktop computer or handle a notebook computer away from the desk, and yet the reader would still prefer a printed version of the document in a hand-held format. This is especially true in the case of looking through manuals, including software manuals, to understand how to operate a device or software application.
  • the irony is that computer software packages usually come with thick and heavy manuals containing information which can easily be stored on a lightweight CD-ROM, and even if the manuals are sometimes dispensed in the form of a CD-ROM, more often than not people would print them out into a hard-copy format in order to facilitate reading.
  • the browser has a glimpse of what are the contents of the book document.
  • the browser has an idea of approximately where the items of interest are so that the browser can (a) return to look for them later when needed, and (b) have an understanding of the relationships between the material currently being viewed and other material (i.e., an understanding of the hierarchical structure involved) .
  • many finger-operations are required of the browser in order to flip through the pages and, together with the inherent sequential order imposed by the pages, very quickly allow the browser to have an understanding of the nature, location and organization of the material involved.
  • U.S. Pat. No. 5,467,102 discloses a device for document viewing that consists of two display screens.
  • One of the purposes of using two display screens is to allow the user to display two different pages from the document so that they can be read side-by-side (e.g., a diagram and its textual explanation) .
  • Another purpose is to allow a large picture to be displayed simultaneously on both pages.
  • the Kuno et al. device allows users to change the speed of movement through the document through a pressure sensor — the more pressure applied, the faster the pages in the document are moved through.
  • the Kuno et al. device also allows the document to be viewed in the forward or backward direction by pressing on a forward sensor area or a reverse sensor area respectively.
  • the Kuno et aj.. device still does not provide the same convenience as browsing through a book, primarily because when switching between the operations for different controls — the speed of movement through the document, the change of direction of viewing, and the jumping to different parts of the document — there are a lot more hand and finger movements than is the case in manipulating a physical book.
  • the Kuno et al. device is a specialized, relatively costly device with sensors and hardware built onto two display screens, whereas the present inventor recognizes that a lower cost and more practical device would be one that adds modularly to the existing computer system.
  • mice that can eliminate the above-mentioned problem of positioning cursor on the computer screen with a conventional mouse (i.e., fine control of the hand or fingers is needed) .
  • These mice allow the user to specify "hot locations” on the screen on which the cursor "homes onto” with less fine control than conventional mice.
  • a subset of these mice can generate “vertical only” or “horizontal only” movement of the cursor so that the scrolling process requires less fine control of the muscle than is required with a conventional mouse.
  • These mice eliminate some, but not all, of the problems associated with the conventional methods of computer input as far as computer- based document browsing is concerned.
  • McTaggart discloses an electronic book that comprises laminated sheets bound together in the form of a book. On each of these sheets, printed material is arranged on the top layer and below that layer is an electronic backdrop containing thin light-emitting diodes (LED's) and pressure sensitive switches affixed onto a backing sheet.
  • LED's thin light-emitting diodes
  • the pressure switches positioned under certain items in the printed material, are for the purpose of sensing the user's selection of those items.
  • a speaker is also provided on the book to generate audio signals for explaining the text or giving the user audio feedback.
  • Contact or photo-sensitive switches are also embedded in the pages to allow the electronic circuits to know which pages are currently being viewed, so that the appropriate audio and visual signals can be generated.
  • this apparatus is in a form that allows a person to handle it like handling a typical book, with visual and audio enhancements of the printed material as well as facilities that accept the user's feedback, it is basically a hard-wired device that is not reprogrammable and different hardware has to be configured for books with different contents. No provision is available for downloading document files from a computer for display on the electronic book nor is the electronic book able to display any arbitrary document file. This device is hence not suitable for browsing through documents stored in a computer. Therefore, the inventor has identified there exists a need for a low-cost, modular device that can be connected to existing computer systems and that permits easy, effective computer-based document browsing that approaches that of browsing through a book.
  • one objective of the present invention is to provide a browsing device that exploits the use of finger operations normally involved in browsing through a book, namely, the change of speed of movement through the document involved, the change of direction of movement through the document, the jumping to other portions of the document, and the bookmarking of pages (e.g., when a page is bookmarked, it can be returned/jumped to later very quickly by using the controls operated by the fingers) .
  • Another objective of the invention is that the positioning and design of the controls for the above-mentioned operations performed by the fingers are such that they allow almost no movement of the hand and minimal movements of the fingers, thus maximizing the ease of browsing through the stored document.
  • the dexterity of the human fingers is to be fully exploited for these controls.
  • a further objective of the invention is to provide a low cost, modular browsing device that can be easily attached to existing computer systems much like how a mouse attaches to a computer system.
  • Still a further objective is to provide a reconfigurable construct for the browsing device so that it can be (a) configured into a hand-held controller; (b) attached to the sides of existing computer screens; (c) configured to cooperate with a mouse so that there is no need to move the user's hand(s) when switching between browser-related operations and mouse-related operations; and (d) configured to cooperate with a gyro-mouse so that the entire assembly can be used in the absence of a table top.
  • the method is chosen by the user depending on his/her preference.
  • Another objective of the invention is to provide a means to display, on the computer screen, the document to be browsed through using the browsing device.
  • the display is in the form of a computer book together with showing the thicknesses of material in the document before and after the currently viewed material, showing of the bookmarks, and showing, on the thicknesses, of the location of the pages that would be jumped to at any given time if jumping were to be effected.
  • Another objective of the invention is to provide the following five methods of organizing the material in the document and corresponding display formats: (a) organized into pages and can be flipped through page by page from right to left or vice versa, much like what happens when one flips through a book; (b) organized into pages and can be flipped through page by page from bottom to top or vice versa, much like what happens when one flips through a notepad; (c) organized into pages and slid through page by page from right to left or vice versa, much like what happens when one views a microfilm; (d) organized into pages that can be flashed one after another; (e) organized so to be scrolled through, with no distinct page boundaries, much like what is normally done in a word-processor.
  • the first three methods incur more cost in terms of storage space and processing time, but when used together with the aforementioned browsing device result in a browsing process that most resembles that of browsing through a book, a notepad, or a micro-film.
  • the last two methods demand less storage space and reduced processing time, and even though these two methods do not precisely emulate the book-browsing process, they can still benefit from the rapidity of finger control effected on the browsing device.
  • Another objective of the invention is to provide simultaneous multiple indexing in conjunction with the inventive browsing system.
  • a keyword of interest When a keyword of interest is encountered during the reading of the document, the user selects it using a cursor on the screen in conjunction with a pointing device such as a mouse, like what is normally done in current computer systems, or using his/her finger in conjunction with a touch or pressure sensing screen, or other methods.
  • a pointing device such as a mouse
  • the pages on which explanations or other issues related to this keyword reside are bookmarked by the inventive system, after which the user can quickly flip to one of these pages using the mechanisms provided in the browsing system.
  • Another objective of the invention is to use the above- mentioned browsing facility in conjunction with other software that can reorganize the material in the document involved to facilitate browsing/viewing - for example, the positioning of material for comparison side by side on the pages currently being viewed.
  • Another objective of the invention is to use the above- mentioned browsing facility in conjunction with software that can highlight selected portions of the material or annotate on the pages in the document involved to facilitate browsing/viewing/reading.
  • Yet another objective of the invention is to provide the above-mentioned browsing facility to a word processor to facilitate the entering, processing, and viewing/browsing of material in a word processor.
  • Another objective of the invention is to provide the above- mentioned browsing facility to any software in which information cannot be fitted within one computer screen for viewing or manipulating.
  • Yet another objective of the invention is to provide a new metaphor - the "library metaphor" - to the computer operating system's human interface in which information on the computer screen which is traditionally presented in the form of windows can now be presented in the form of "books”.
  • a browsing device for browsing through document that includes, a top surface, a sensor surface and a bottom surface.
  • a sensor area on the sensor surface detects the position of a finger along one direction and the force of the finger on the sensor area.
  • the browsing device also includes four buttons/on- off switches on the bottom surface, and four additional buttons/on-off switches on the said top surface, each of which is operated by the fingers.
  • An electrical circuit converts the force and position of the finger on the sensor area as detected by the force and position sensors on that area into electrical forms and outputs them.
  • the electrical circuit also outputs the on/off states of the four buttons/on-off switches on the bottom surface, and four additional buttons/on-off switches on the said top surface.
  • FIG. 1A is the block diagram of the browsing device according to the present invention, detailing input commands and output signa1s.
  • FIGS. IB and IC are a schematic perspective view (upper and lower view respectively) of a first embodiment of the browsing device.
  • FIGs. 2A and 2B are top/bottom perspective views of the browsing device configured into a mini-book configuration used in conjunction with a computer.
  • FIG. 2C is front perspective view of the browsing device configured into a screen configuration used in conjunction with a computer.
  • FIG. 2D is a front perspective view of the browsing device configured into a mouse configuration used in conjunction with a computer.
  • FIG. 2E is a front perspective view of the browsing device configured into a gyro-mouse configuration used in conjunction with a computer.
  • FIG. 2F is a front perspective view of the browsing device configured into a one-hand configuration used in conjunction with a computer.
  • FIG. 2G is a front perspective view of the browsing device configured into a one-hand-gyro-mouse configuration used in conjunction with a computer.
  • FIG. 3 is a top perspective view of a computer book displayed on a screen that is to be browsed through using browsing device of the present invention.
  • FIG. 4 (shown as Figures 4A and 4B) is a flowchart that details the mechanisms for jumping to other parts of the document being viewed/browsed through and movement through a document under the control of the thumb on the browsing device of present invention.
  • FIG. 5A is an top perspective view of the computer book of the present invention that uses a flipping method of moving through a document.
  • FIG. 5B is a top view of the computer book of the present invention that uses a sliding method of moving through a document.
  • FIG. 5C is a top view of the computer book of the present invention that uses a flashing method of moving through a document.
  • FIG. 5D is a top view of the computer book of the present invention that uses a scrolling method of moving through a document.
  • FIG. 5E is a top perspective view of the computer book of the present invention that uses a vertical flipping method of moving through a document.
  • FIG. 6A is a top perspective view of an open fan display for displaying pages and that is used in conjunction with the flipping method of moving through the document illustrated in FIG. 5A.
  • FIG. 6B is a top perspective view of a collapsed fan display for displaying pages and that is used in conjunction with the flipping method of moving through the document illustrated in FIG. 5A.
  • FIG. 7 is a schematic block diagram of the browsing system that incorporates the inventive browsing device of FIG. IB.
  • FIG. 8 is a schematic electrical block diagram of the browsing device of FIG. IB.
  • FIGS. 9A-9C are schematic perspective views of another embodiment of the browsing device that uses many thin, hard, and flexible pieces of material bound together in the manner of the binding of the pages of a book.
  • FIGS. 10A and 10B are top/bottom schematic perspective views of another embodiment of the browsing device that uses a display screen fitted to a slanted surface to display a material thicknesses before or after currently viewed material.
  • FIG. 11A is a comparative schematic diagram of directories/sub-directories in a "window" compared with pages of a computer book that uses the flipping method of FIG. 5A in order to move through the book.
  • FIG. 11B is a comparative schematic diagram of directories/sub-directories and the files in a "windows" system compared with chapters and sections in a computer book that uses the flipping method of FIG. 5A to move through the book.
  • FIG. lie is a comparative schematic diagram of working windows in a "windows" system compared with pages of a computer book that uses the flipping method of FIG. 5A to move through the book.
  • FIG. 12 is a flowchart of a method for displaying a set of information on a display screen as controlled by a browsing device.
  • FIG. 13 is a flowchart of a method for browsing a set of information on a display screen.
  • FIG. 14 is a flowchart of a user-interface method according to the library metaphor aspect of the present invention.
  • FIG. 1A depicts the browsing device 100 according to the present invention that can be used in conjunction with existing computer systems for the purpose of browsing through documents or any information stored in the computer.
  • commands include the following: (a) specifying whether a movement in a forward direction or in a backward direction through the document is to be performed; (b) specifying a speed of the movement described in (a) ; (c) jumping to a specified location in the document or information involved; and (d) specifying that certain portions of the document or the information involved is to be bookmarked.
  • signals are generated and output to effect the necessary operations in a computer system (e.g., computer 205 in FIG. 2A) attached to the browsing device 100.
  • FIGS. IB and IC depict one embodiment of the primary browsing device 100 according to the present invention.
  • the browsing device 100 consists of a slanted surface 120, extending from a top surface 110 of the browsing device 100.
  • the slanted surface 120 supports a user's thumb 122 on which to rest, although the user may use another instrument or finger as well.
  • four other fingers 141 - 144 are placed on a bottom surface 130 of the device, opposed to the thumb 122.
  • a set of force and position sensors disposed in a sensor area 121 detect (a) a force of the thumb 122 on the slanted surface 120 within the sensor area 121 and (b) the position of the thumb 122 (or one of the other fingers) in the sensor area 121 in the direction of the slant.
  • the direction of the slant is referred to as an x-direction, as shown in FIG. IB, where the positive x-direction points away from the edge that adjoins the top surface 110 and the slanted surface 120.
  • buttons/switches 131-134 are placed on the bottom surface 130, within easy reach of the four fingers (141 - 144) during those operations when these fingers (141 - 144) are placed on the bottom surface 130.
  • buttons/switches 111 - 114) are placed, preferably parallel to the edge adjoining the top surface 110 and the slanted surface 120, as shown in FIG. IB.
  • buttons (131 - 134, and 111 - 114) on the bottom (as shown in Figure IC) and top surfaces (130 and 110 respectively) are for the purposes of bookmarking.
  • the use of these buttons (131 - 134, 111 - 114) depends on the particular configuration in which the browsing device 100 is used and will be described below.
  • FIGS. 2A - 2G depict alternative configurations to employ the browsing device 100 for producing the browsing input.
  • the browsing device 100 depicted in FIG. IB is preferably used with an operator's right hand.
  • a left-hand version of the browsing device 101 as depicted in FIGS. 2A and 2B (where Figure 2B shows a bottom side) is employed in some of the embodiments depicted in FIGS. 2A-2G.
  • FIG. 2A depicts one embodiment of the mini-book configuration 200 in which a left-hand version 101 and a right- hand version 100 of the browsing device 100 are joined back-to- back through latching mechanisms 151 and 152 as shown in FIG. IC and the resulting assembly 200 is electrically operatively connected to the computer 205 (such as an IBM Aptiva A92, Part Number 42H0333) .
  • the left and the right hands operate the devices on the left and right respectively, hence the left thumb 172 and right thumb 122 rest on the left and right sensor areas (171 and 121) respectively.
  • the other four fingers of both hands are placed near the buttons (131 - 134, 181 - 184) on the bottom surfaces 130 and 180 of both the left and right devices.
  • the buttons (111 - 114, 161 - 164) on top surfaces 110, 160 are available for auxiliary functions.
  • the direction of movement i.e., forward or backward
  • the direction of movement is effected through the force applied by the right and left thumbs (122 and 172) on the sensor areas 121 and 171 respectively.
  • the right thumb 122 force activates a forward movement through the document and the left thumb 172 force activates a backward movement.
  • the speed of movement is preferably proportional to the force applied, although other force/speed relationships may be employed successfully.
  • the right thumb 122 operating the right sensor area 121 activates jumping to points in the document involved that lie between the currently viewed material in the document and the end of the document and the left thumb 171 operating the left sensor area 172 activates jumping to points in the document involved that lie between the currently viewed material in the document and the beginning of the document.
  • the right fingers other than the thumb 122 operating the buttons 131 - 134 on the bottom surface 130 create bookmarks for points in the document involved that lie between the currently viewed material in the document and the end of the document and the left fingers other than the thumb 172 operating the corresponding buttons 181 - 184 on the corresponding bottom surface 180 create bookmarks for points in the document involved that lie between the currently viewed material in the document and the beginning of the document.
  • An x-direction is defined along the slanted surface for the left-hand device 101 that is perpendicular to the edge adjoining the top surface 160 and the slanted surface 170 of the left-hand device 101 and the positive x-direction is taken to be the direction away from that edge as illustrated in FIG 2A.
  • the operations to be described below for the sensor areas 121 or 171 and for the buttons on the bottom surfaces 131 - 134 or 181 - 184 are similar for both the right-hand device 100 and the left-hand device 101 and unless necessary, only the operations for the right-hand device 100 will be described.
  • the position of the thumb 122 in the x-direction on the sensor area 121 determines the page in the document to jump to (for the cases in which the material in the document is organized into pages to be flipped, slid or flashed on the computer screen, the details of which will be described later) or the point in the document to jump to (for the case in which material in the document is not organized into pages like in the case of the use of scrolling to move through the document) .
  • x 0 (the origin) be the point at which the slanted surface 120 meets the top surface 110.
  • the thumb 122 will be referred to as being "at” position xl when it covers the point xl and some contiguous points to the "right” of xl, i.e., some of the contiguous points x such that x > xl, and "right” refers to the conventional positive axial direction. This is because the intersection of the thumb 122 and the slanted surface 120 (in the sensor area 121) on the browsing device 100 has a small spatial extent and hence it will have some dimension in the x-direction.
  • FIG. 3. shows the "book" 300 displayed on the computer screen, henceforth referred to as the computer book.
  • the thickness 310 of the computer book 300 on both sides is shown on the computer screen next to the displayed pages 301 as shown in FIG. 3.
  • the thumb selects the page to jump to by sliding along the side until it reaches that page.
  • the thumb slides along the side of the book in a direction perpendicular to the edge of the book the thumb is touching (similar to the x-direction in FIG. IB) by an amount proportional to how far along in the document the page to be jump to is from the current page.
  • the width of the slanted surface felt by the thumb does not change, even as the amount of material/number of pages present on that "side" of the "book” changes, the translation of the x-position of the thumb to a page in the document to jump to is slightly more complicated.
  • the distance along the slanted surface from the current thumb position XTl to the edge, XS is treated as being proportional to the number of pages remaining from that point to the end or beginning of the document.
  • PR becomes the amount of material, say the number of lines of material, remaining and PJ becomes the amount of material to be skipped over.
  • the thumb 122 moves from the starting position XTl in the positive x-direction, before it applies any force to effect a jump, it is at liberty to move between XTl and XS in the positive or negative x-directions to search for a page it wishes to jump to. If in this process the thumb 122 moves in the negative x-direction beyond the starting position XTl, whatever new position the thumb 122 finds itself in and after having applied a momentary force in that position, that position will become a new starting position XTl for the computation of any subsequent jump.
  • the thumb 122 did not apply any momentary force after having moved in the negative x-direction beyond the starting position XTl, and then it moves back past XTl in the positive x-direction, the starting position for any subsequent jump will be XTl.
  • step 401 the thumb 122 is placed at position XT on the sensor area 121.
  • step 402 a check is made if a force has been applied momentarily or longer (than a predefined, short time) . If not, nothing happens; the thumb 122 may move to a new position XT (step 403) or stay in the same position XT. If an affirmative response is received in step 402, a check is made to see if the thumb has applied the force longer than momentarily.
  • step 405 movement through the document is initiated (with a speed proportional to the force applied and a direction depending on whether the left-hand device 101 or the right-hand device 100 in the mini-book configuration 200 is activated) .
  • step 406 movement through the document is initiated (with a speed proportional to the force applied and a direction depending on whether the left-hand device 101 or the right-hand device 100 in the mini-book configuration 200 is activated) .
  • step 406 Similarly, after initiation of movement through the document in step 405, the process also flows to step 406.
  • step 406 the starting position XTl is assigned the value of the current thumb 122 position XT.
  • the process then flows to step 407 where the thumb 122 either stays in the current position or moves to a new position XT ( ⁇ > XTl) .
  • PR is the number of pages or amount of material remaining from the current page to the end of the document if the right-hand device 100 in the mini-book con iguration 200 is now being activated or from the current page to the beginning of the document if the left-hand device 110 in the mini-book configuration 200 is being activated.
  • XS is the width of the sensor area 121.
  • step 408 If in step 408, XT is found to be smaller than XTl, then the process flows to step 412 which checks if a force has been applied at XT momentarily or longer. If not, nothing happens, the process flows to step 407 where the thumb can move to a new position XT. If so, step 413 checks to see if the force applied is longer than a pre-defined, short period. If the force applied is longer than a pre-defined, short period, the process flows to step 414 where movement through the document is initiated (with a speed proportional to the force applied and a direction depending on whether the left-hand device 101 or the right-hand device 100 in the mini-book configuration 200 is activated) . If a negative response is received in step 413, the process flows to step 406 where the starting position XTl is assigned the current value of XT. After the initiation of movement through the document in step 414, the process also flows to step 406.
  • the above described method of jumping/skipping through the pages through the use of the sliding of the thumb 122 over a certain distance (in the x-direction) is referred to as the relative distance method whereas the jumping/skipping in the process of browsing through a physical book uses absolute distance (in the direction perpendicular to the edge of the book) .
  • Another embodiment of the browsing device 1000 that uses absolute distance will be described later in reference to FIG. 10.
  • an indication of the position of the thumb 122 is provided on the thickness 310 area of the book 300 displayed on the screen next to the pages 301 currently being viewed (FIG. 3) .
  • the thumb 122 starts from one point on the sensor area 121 and slides on the sensor area 121 in the x-direction before a force is applied to effect the jump. In this process, the thumb 122 slides over many points on the x-position sensor 121 on the slanted surface 120.
  • the other part corresponds to the pages that remain from the page jumped to if a force were applied to the end of the document (if one is moving forward through the document and the right hand device 100 in the mini-book configuration 200 is being activated) or to the beginning of the document (if one is moving backward through the document and the left-hand device 101 in the mini- book configuration 200 is being activated) .
  • a thin line Preferably within the thickness area 310 on the computer screen is shown by the boundary, a thin line, as being different in darkness, texture, or color (preferably darkness) from the rest of the thickness 310 - hence one would see a line oriented perpendicular to the x-direction (parallel to the y-direction, FIG. IB) and whose length is confined to the thickness 310 region moving in the positive or negative x-direction depending on the direction of movement of the thumb 122 on the sensor area 121.
  • one part say the left part
  • buttons 131 to 134 on the bottom surface 130 of the browsing device 100 will be described for bookmarking.
  • each of the other four fingers 141 to 144 except the thumb 122 is placed near each of the four buttons 131 to 134 and each of these buttons is meant to be operated by the finger nearest to it.
  • the page will then be bookmarked and a bookmark 320 is displayed on the screen as shown in FIG.
  • buttons 131 to 134 are used to bookmark more than one point/page. All the bookmarks 320 that are created by the same button (i.e., one of buttons 131 to 134) are clustered together (e.g., one of clusters 361 to 364) and displayed as such as shown in FIG. 3.
  • the bookmark After one has bookmarked a certain page/point on a certain side (right, 371, or left, 372, FIG. 3) of the book, if one moves through the document past that page/point (forward or backward respectively) , the bookmark will either disappear or be transferred to the other side, depending on whether the bookmark is a finger-bookmark or a permanent-bookmark respectively.
  • the finger-bookmarks are more like the bookmarks created by the use of the fingers when browsing through a physical book - they are more temporary and they "disappear" after the bookmarked page/point has been passed.
  • the permanent bookmarks are more like the bookmarks created by inserting, say, a slip of paper when one is browsing through a physical book.
  • the finger-bookmarks and the permanent-bookmarks are displayed differently on the computer screen. (They are differentiated either by shape, size, color, marking, or lettering. )
  • the finger-bookmark For the finger-bookmark, if one wishes that the bookmark not be removed after one has moved through the document past the corresponding page/point, one can transfer it to the other side by creating another bookmark using the fingers on the other hand, much like what one does when browsing through a physical book.
  • the permanent-bookmarking process tends to create many bookmarks and they should be used only if necessary.
  • this page was a finger-bookmarked page and one wishes to bookmark this page again, one has to press the button (one of 131 - 134 or one of 181 - 184) again (once or twice depending on whether now one wishes to finger-bookmark or permanent-bookmark it respectively) .
  • the button one of 131 - 134 or one of 181 - 184
  • it is to be avoided if possible.
  • buttons 131 - 134 or 181 - 184, depending on whether it is the right side 371 or left side 372 respectively that is involved
  • creating only one bookmark in each cluster This way, a speedier jump to a desired bookmarked page is possible because one does not have to jump through those unwanted pages bookmarked in the same cluster before one arrives at the intended page.
  • only one of the hands is supposed to perform operations (i.e., only one of the two browsing devices 100 and 101 is supposed to be activated) . If both hands try to perform operations at exactly the same time, there will be no operation performed. If one hand performs an operation before the other hand, then that hand takes priority.
  • One exception to this is when the device is used in conjunction with a flipping method 500 or 540 of moving through the document involved to be described in detail later (with reference to FIG. 5A and FIG. 5E) , whereby the operation of both hands is used to create a "fan display" 600 or 610 (with reference to FIG. 6A and FIG. 6B) .
  • FIG. 2C depicts one embodiment of the screen configuration 210.
  • the operations are identical to that described above for the mini-book configuration 200 depicted in FIG. 2A, except now, in this configuration 210, the two browsing devices 100 and 101 are separated and attached to the sides of a screen 216 (such as an IBM Color Monitor G50, Part Number 96G1593) . This is achieved by first attaching these devices to a frame 215, and then attaching the frame 215 to the screen 216. This is done because the browsing devices 100 and 101 need to be firmly attached and we would like to use existing computer screens 216 and hardware with no necessity of any physical modifications to them.
  • a screen 216 such as an IBM Color Monitor G50, Part Number 96G1593
  • FIG. 2D depicts one embodiment of the mouse configuration 220.
  • two browsing devices 100 and 101 are joined together in the same manner as in FIG. 2A and also mounted onto a mouse 225 (e.g., a mouse adapted from the IBM Enhanced Mouse II, Part Number 13H6714) .
  • a mouse 225 e.g., a mouse adapted from the IBM Enhanced Mouse II, Part Number 13H6714
  • the mouse-browser configuration 220 is preferably placed on a flat surface like the top of a table, but not typically held in the hands.
  • the four buttons 131 - 134 on the bottom surface 130 (FIG.
  • buttons 111 - 114 on the top surface 110 replace the functions of the four bottom buttons 131 - 134.
  • the four buttons 161 - 164 on the top surface 160 replace the functions of the four buttons 181 - 184 on the bottom surface 180 (FIG. 2A) .
  • the eight top buttons 111 - 114 and 161 - 164 are now operated only by the index finger which also operates the mouse buttons 226 and 227.
  • the thumb of the same hand is preferably used.
  • one of the other three fingers normally the middle finger, is used. (For a left-handed, "southpaw", this is reversed) .
  • FIG. 2E depicts one embodiment of the gyro-mouse configuration 230 (which includes an adapted gyro-mouse such as a GyroPoint® Desk from Gyration, Inc. of Saratoga, California, Part Number PA00038-001) .
  • an adapted gyro-mouse such as a GyroPoint® Desk from Gyration, Inc. of Saratoga, California, Part Number PA00038-001
  • This gyro-mouse 235 can be attached to the mini-book configuration 200 of FIG. 2A which consists of a right- hand browsing device 100 and a left-hand browsing device 101, and the whole assembly — the gyro-mouse configuration 230 — can be used in the hand away from the table top.
  • the gyro-mouse 230 must be attached to the mini-book configuration 200 in such a way that the index fingers can also be used to operate the gyro-mouse buttons 236 and 237, as shown in FIG. 2E.
  • the gyro-mouse buttons 236 and 237 must be near enough to the buttons 131 and 181 operated by the index fingers so that the index fingers can reach them (buttons 236 and 237) easily. While preferably a specially made gyro-mouse 235 will be constructed to join with the mini-book configuration 200 as shown in FIG. 2E, the mini-book 200, screen 210, and mouse 220 configurations of the browsing devices 100 and 101 preferably add modularly to existing computer hardware.
  • FIG. 2F depicts the one-hand configuration 240 of the browsing device.
  • the device 100 is held in one hand in much the same way as that in the mini-book configuration 200 - the thumb is placed on the sensor area 121 while the other fingers operate the buttons 131 - 134 on the bottom surface 130.
  • the operation is largely the same as that for the mini-book configuration 200 except now the browsing device 100 functions as the left device 101 as well as the right device 100 in the mini-book configuration 200.
  • a triple click of the button 131 (refer to FIG. IB - the button nearest the index finger) toggles between these two states.
  • This configuration 240 may not handle as well as the mini-book configuration 200 but it frees one hand for other operations. (Instead of triple-clicking an existing buttom such as button 131, an alternative is to add another buttom to the existing buttons and allow a single click of that button to effect the same operation.)
  • FIG. 2G depicts the one-hand-gyro-mouse configuration 250 of the browsing device.
  • a gyro-mouse 255 is attached to one browsing device 100.
  • the operation is largely the same as in the one-hand configuration 240 in FIG. 2F except now the one index finger also operates the mouse buttons 256 and 257.
  • buttons 256 and 257 of the gyro-mouse 255 must be positioned near the button 131 on the bottom surface 130 of the browsing device 100 that is nearest the index finger during normal operations of the device 100 so that the index finger can operate all three buttons 256, 257 and 131 easily. If no such gyro-mouse 255 exists, then a specially made one has to be used.
  • the browsing device 100 employed in the configurations 200, 210, 220, 230, 240, and 250, among others, can be used in conjunction with a number of different methods for displaying the movement through the document involved on the computer screen in a computer book. Among others, there are five methods which will be described here.
  • FIG. 5A depicts one preferred embodiment of the flipping method 500.
  • the material in the document is organized into pages and as one moves through the document, the pages are shown to flip across from right to left or vice versa, depending on the direction of movement, much like what happens when one flips through a physical book.
  • a permanent- ookmark when a permanent- ookmark is being transferred from one side to the other, it will be shown to be attached to the page, sticking out from the page, and flipped together with the page.
  • the pages skipped are shown to flip across together as a thick page (the thickness being proportional to the number of pages involved) like in the case of a physical book.
  • one method of generating flipping pages from a document stored in semiconductor, magnetic, optical, or other media on a personal (e.g. laptop) computer in the form of a text file, such as a text file in the Windows 95 operating system involves several steps. First, the contents of the text file is displayed on the computer screen (such as an IBM Color Monitor G50, part Number 96G1593) using, say a word processing software such as Microsoft® Word Version 7.0 from Microsoft Corporation, Part Number 62306 running on the computer. The image on the computer screen which is stored in the screen dump can then be put into the clipboard using the "Print Screen" key on the keyboard (such as an IBM Keyboard, Part Number 06H9742) .
  • the computer screen such as an IBM Color Monitor G50, part Number 96G1593
  • a word processing software such as Microsoft® Word Version 7.0 from Microsoft Corporation, Part Number 62306 running on the computer.
  • the image on the computer screen which is stored in the screen dump can then be put into the clipboard using the "Print Screen" key on the keyboard (such
  • the clipboard can be imported as an image file into a graphics software such as Visioneer PaperPort TM from Visioneer Communications, Inc. of Palo Alto, California, Part Number C1132-90000 running on the computer using the "Paste" command provided by the software, and then exported and stored as an image file in, say, the TIFF format. Each page in the document can be captured in this way in one TIFF file.
  • a graphics software such as Visioneer PaperPort TM from Visioneer Communications, Inc. of Palo Alto, California, Part Number C1132-90000 running on the computer using the "Paste" command provided by the software, and then exported and stored as an image file in, say, the TIFF format.
  • Each page in the document can be captured in this way in one TIFF file.
  • the TIFF files each containing one page of the document, can be imported into the software and using the Motion command and superimposition facilities provided by the software a "movie" of flipping pages can be generated and if necessary, exported and stored in a motion picture format such as a .AVI file.
  • a video editing/movie making software such as Adobe Premier TM 4.0 from Adobe Systems Incorporated of Mountain View, California, part Number 02970103 running on the computer
  • the TIFF files each containing one page of the document, can be imported into the software and using the Motion command and superimposition facilities provided by the software a "movie" of flipping pages can be generated and if necessary, exported and stored in a motion picture format such as a .AVI file.
  • the various components/operations described above for generating flipping pages from an existing document file using currently available software are preferably integrated into a single software process that may be conveniently ported from one computer to the next and which requires minimal human intervention.
  • An alternative method reads from the existing document file directly, generates the necessary images for all the pages, and then creates a "motion picture" of flipping pages from these images.
  • To move through the document forward or backward at any selected speed mechanisms similar to forwarding or reversing at any selected speed when viewing a motion picture file (such as one in the .AVI format) using a software video player (such as Video for Windows from Microsoft Corporation) are used.
  • the other features such as the thicknesses 310 (FIG. 3), the bookmarks 320 (FIG. 3) and the operations of bookmarking etc. are also incorporated.
  • FIG. 6A depicts one embodiment of a open fan display 600 and FIG. 6B depicts one embodiment of a collapsed fan display 610 that can be created in conjunction with the flipping method 500.
  • one thumb say, the right thumb 122, which operates the sensor area 121 in the configuration 200, say
  • This force will be referred to as the opposing force .
  • the force applied by the other thumb in this case, the right thumb 122) will be referred to as the flipping force.
  • fan display There are two kinds of fan display that can be created - the open fan display 600 or the collapsed fan display 610 - depending on the magnitude of the opposing force. If the opposing force is of a magnitude roughly the same as or smaller than the flipping force, the pages 603 that have been flipped since the beginning of the process (i.e., since the opposing force has been applied) form equal angles between themselves as well as the two "flat" pages 601 and 602 on the left and right sides of the book as depicted in FIG. 6A. This creates the open fan display 600. If the opposing force is greater than the other force, a collapsed fan display 610 is created as shown in FIG. 6B.
  • the open fan display 600 or the collapsed fan display 610 can also be created in conjunction with the process of jumping to another page.
  • the pages skipped are shown to flip across together as a thick page (the thickness being proportional to the number of pages involved) like in the case of a physical book.
  • This thick, flipping page will be treated like any of those flipping pages 603 in the process of creating the open fan display 600 or the flipping pages 605 in the process of creating the collapsed fan display 610.
  • the pages will freeze in the open fan display 600 or the collapsed fan display 610, depending on which type of display is being created.
  • the collapsed fan display 610 at the moment when the flipping force stops, there could be one page 605 that is still in the process of being flipped as depicted in FIG. 6B. This page will immediately collapse onto the center, thick page 604 that has collected in it all those pages flipped earlier.
  • the open fan display 600 facilitates the viewing of many pages simultaneously, even though only the rough contents of each page can be properly viewed.
  • the collapsed fan display 610 facilitates the viewing and comparison of the two flat pages 606 and 607 that are currently in view since all the flipped pages 605 have been collected in the center, thick page 604 that does not block the view of the two flat pages 606 and 607.
  • FIG. SB depicts one embodiment of the sliding method 510.
  • the material in the document is organized into pages and the pages are shown to slide across the screen, much like what happens when one views a microfilm.
  • more than one page can be displayed here, depending on the choice of the user.
  • FIG. 5B shows two pages being displayed at the same time but in this method 510 any number of pages can be displayed at the same time, depending on the user's preference and the selection made.
  • FIG. 5C depicts the flashing method 520, where the material in the document is organized into pages and one or more than one page at a time (as specified by the user) is flashed onto the screen as one moves through the document - that is, the current page(s) disappears and the next page(s) before or after the current page(s) appears.
  • FIG. 5C depicts, in particular, the case in which two pages are displayed at a time. When more than one page is displayed on the screen and flashing is effected, it can be effected in two modes - the exclusive mode or the overlapping mode. Consider the case of displaying two pages at one time on the screen as shown in FIG. 5C.
  • the next two pages that appear are the two pages that follow the righthand page of the previously displayed pages.
  • the next two pages that appear are the righthand page from the previously displayed pages and the page that follows that page.
  • the exclusive mode dictates that the next pages displayed will not be the same as the currently displayed pages and the overlapping mode dictates that the next pages displayed can have some but not all of the pages that are the same as the currently displayed pages.
  • the overlap refers to the same pages that are displayed in the current display as well as the very next display of the pages.
  • the user can specify the amount of overlap for the overlapping mode.
  • a permanent bookmark when a permanent bookmark is being transferred from one side to the other, it will be shown to disappear from the side from which it originates and appear on the other side when the page involved reaches the other side.
  • the display of the thicknesses of the material in the document on both sides of the displayed pages, the use and display of bookmarks (finger bookmarks or permanent bookmarks) , the operations of bookmarking, and the display of the location, on the thicknesses, of the page/point in the document that would be jumped to were jumping to be effected at any given moment based on, say, the thumb's x-position on the sensor area 121 at that moment are like what is described above for the computer book 300 in FIG. 3.
  • FIG. 5D depicts the scrolling method 530. Even though scrolling usually results in a blur, this method can still benefit from the ease of control using the browsing device 100.
  • this method 530 the material in the document is not organized into distinct pages. Instead, lines of text or portions of graphics disappear from the top of the display and appear at the bottom of the display or vice versa as the document is moved through forward or backward respectively.
  • the thicknesses 531 of material present before or after the currently viewed material are shown on the top and bottom of the display as shown in FIG. 5D.
  • the bookmarks 532 finger-bookmarks or permanent bookmarks
  • the user can rotate the mini-book configuration 200 held in his/her hand which is normally used "horizontally" - with the left-hand device 101 held to the left and the right-hand device 100 held to the right (FIG. 2A) - by, say, 90 degrees clockwise, so that the left-handed device 101 is now on the top and the right-handed device 100 is now on the bottom (to achieve this, the left and right wrists will have to bend a fair bit) .
  • the controls will now be more natural because they correspond better to what is seen on the screen - i.e., the left-hand/top device 101 and the right-hand/bottom device 100 will now operate the bookmarks on the top and bottom respectively of the material shown on the screen in the scrolling method 530.
  • a scroll bar 533 and a marker 534 on it can be added to one side, say the right side, of the displayed material, as shown in FIG. 5D, to indicate the position of the currently viewed material in the document involved, but the marker 534 here is not used in conjunction with the browsing device 100 for effecting the scrolling of the document. (In current word processors, normally the marker 534 is used in conjunction with the mouse for effecting the scrolling of the document.)
  • bookmarks 535 are added to the scroll bar 533 to indicate the pages bookmarked.
  • the display of the bookmarks 532 on the top and bottom of the currently viewed material is still necessary because their positions along the top and bottom edges give an indication of the fingers and buttons on the browsing devices 100 and/or 101 (depending on whether one or two devices are being used) that are to be used to jump to the pages that they mark.
  • this method 530 when a bookmark is inserted, it is associated with the material that is currently in view. For permanent-bookmarks , they disappear from one side (top or bottom) of the display and appear on the other side (bottom or top respectively) when the associated material has gone completely out of view.
  • the page(s) or parts of the document jumped to are flashed onto the screen, much like what happens when one uses the scroll bar in conjunction with the mouse to jump to some other parts of the document in a typical word processor.
  • FIG. 5E depicts the vertical flipping method 540 of the browsing device. This method is similar to the flipping method 500 depicted in FIG. 5A, and except for the flipping action that is effected vertically instead of horizontally, all other operations are the same as that described for the flipping method 500, including the vertical equivalents of the open and collapsed fan displays depicted in FIGS. 6A and 6B.
  • the user can rotate the mini-book configuration 200 held in his/her hand which is normally used "horizontally" - with the left-hand device 101 held to the left and the right-hand device 100 held to the right (FIG. 2A) - by, say, 90 degrees clockwise, so that the left- handed device 101 is now on the top and the right-handed device 100 is now on the bottom (to achieve this, the left and right wrists will have to bend a fair bit) .
  • the controls will now be more natural because they correspond better to what is seen on the screen - i.e., the left-hand/top device 101 and the right- hand/bottom device 100 will now operate the bookmarks on the top and bottom respectively of the material shown on the screen in the vertical flipping method 540.
  • the name of the selected item will also appear on the corresponding bookmark 320 (in case more than one item has been selected) .
  • the user can then quickly jump to these pages.
  • This facility allows the user to bypass the need of having to move through the document first to an index (usually at the end of the document) to locate the various references to the item of interest and then jump to those corresponding pages. Many returns to the index would also have o be carried out if there is more than one reference to the item involved.
  • FIG. 7 depicts an embodiment of a complete browsing system 700.
  • a conversion software 710 (a computer program preferably coded in a "C programming language") is provided to pre-convert the document 701 to be viewed that is stored in the computer in whatever existing form (e.g., such as in the form of a text file, stored on the hard disk in the Windows 95 operating environment) to a form 711 that allows one of the five methods (500, 510, 520, 530 and 540) of moving through the document as described above or other methods to be implemented and to be used in conjunction with the browsing device 740 (in one of the configurations 200, 210, 220, 230, 240, and 250 described above or other configurations) .
  • the browsing device 740 in one of the configurations 200, 210, 220, 230, 240, and 250 described above or other configurations
  • the document 701 in its existing form on the computer can also be converted on the fly which may require specialized hardware to achieve the required speed of operation.
  • a browsing/viewing software 720 is also needed to convert the signals from the browsing device to effect all the operations on the document as described above.
  • the browsing/viewing software 720 (a computer program preferably coded in a "C programming language") takes as its data input either the pre-converted data file 711 or the document in its existing form 701 (to be converted on the fly during the browsing process) .
  • the browsing device 740 sends the necessary signals through a bus 741 (preferably a 25 pin parallel port ribbon cable, although a serial bus or mouse line are example alternatives which require appropriate cooperating multiplexing circuitry) and to a computer input port 730 (preferably a 25 pin parallel port, or alteratively a mouse port or a RS-232 port) to the browsing/viewing software 720 to effect the necessary operations on the screen 721 of the computer.
  • a bus 741 preferably a 25 pin parallel port ribbon cable, although a serial bus or mouse line are example alternatives which require appropriate cooperating multiplexing circuitry
  • a computer input port 730 preferably a 25 pin parallel port, or alteratively a mouse port or a RS-232 port
  • FIG. 8 depicts one embodiment of the browsing device's 100 electrical block diagram 800.
  • the sensor area 121 on the browsing device 100 (FIG. IB) is made up of a force and position sensor that is used to sense the force and position of the thumb 122 (or one of the other fingers) on that area, and signals representing these two parameters are made available through a Force and Position Signals Generator Circuit 801 (preferably the separated Force and Position Analog LP Interface circuit described in the Interlink Electronics, Inc. document "FSR® Integration Guide and Evaluation Part Catalog with Suggested Electrical Interfaces" .
  • Respective Force and Position signals are presented to the computer through one of the input ports 730 (FIG. 7) , to the software 720 responsible to effect the necessary operations on the screen of the computer.
  • buttons 111 - 114 and 131 - 134 (of which are preferably on/off push-button toggle switches) on the top surface 110 and bottom surface 130 respectively of the browsing device 100 (FIG. IB) are also transmitted to the computer via the bus 741.
  • a common voltage line is available to send a corresponding common voltage through individual ones of the buttons 111 - 114 and 131-134 when the respective buttons are closed.
  • FIGS. 9A, 9B and 9C depicts another embodiment 900 of the browsing device 100 of FIG. IB.
  • This device 900 includes many thin, hard and flexible pieces of material 901 bound together in the manner of the binding of the pages in a book, except that the "flipping" side is made into a slanted surface 920 in much the same way as in the device 100 depicted in FIG. IB.
  • the thumb 122 applies a force onto the slanted surface 920
  • the "pages" 901 will bend like the pages in a normal book and the bending force is sensed to effect the same operations as those performed by the thumb's force on the slanted surface 121 of the browsing device 100.
  • the thumb 122 slides along the slanted surface 920 in the x-direction (similar to that defined for the browsing device 100) until it reaches the desired position, say XT, and then it bends the remaining pages 901, much like one would bend the pages of a book in the process of holding onto the left and right edges of the book to browse through the pages, which results in a slight separation 960 of the pages 901 for which x > XT from those pages for which x ⁇ XT and a gap 960 in the pages 901 is created where the thumb 122 is placed.
  • Thin film sensors 970 are placed on the surfaces of these mini-pages 901 to sense the separation 960 and hence the location to jump to in the document involved.
  • buttons 911 - 914 are provided on the top surface 9io and four buttons 931 - 934 are provided on the bottom surface 930 of the device 900 that function like the four buttons 111 - 114 on the top surface 110 and the four buttons 131 - 134 on the bottom surface 130 respectively of the browsing device 100.
  • Mechanisms 951 and 952 are also provided to join two devices 900 (a left-hand and a right-hand version) together. All other operations are identical to those described for the device 100 depicted in FIG. IB.
  • FIGS. 10a and 10B depict yet another embodiment 1000 of the browsing device 100 of FIG. IB.
  • an LCD, plasma or other type of display screen 1005 is fitted onto the slanted surface 1002 of the browsing device 1000 as shown in the upper and lower views of FIGS. 10A and 10B. It is used to display the amount of material present before and after the currently viewed material. To do this, a thickness 1007 is displayed on the screen 1005 that is proportional to the amount involved, that changes with the changes of the amount involved. On this thickness 1007, bookmarks 1020 can be displayed that indicate the locations of the pages/parts of the document involved. The same methods as described before for the computer book 300 depicted in FIG.
  • Transparent force and position sensors 1006 overlay the screen 1005 and function much like what has been described before for the sensor area 121 in the browsing device 100 except that now the thumb 122 can move to the "absolute" location of the page to be jumped to effect the jumping.
  • the thickness of the book displayed on the screen 1005 is XS - XH, where XS is the width of the screen 1005.
  • PR be the amount of remaining material in the document as defined before. The process of jumping can only be activated when the thumb 122 is at XT > XH, and when that happens, the amount of material skipped, PJ, is equal to PR * (XT - XH)/XS.
  • buttons 1011 - 1014 are provided on the top surface 1010 and four buttons 1031 - 1034 are provided on the bottom surface 1030 of the device 1000 that function like the fours buttons 111 - 114 on the top surface 110 and the four buttons 131 - 134 on the bottom surface 130 respectively of the browsing device 100.
  • Mechanisms 1051 and 1052 are also provided to join two devices 1000 (a left-hand and a right-hand version) together. All other operations are identical to those described for the device 100 depicted in FIG. IB.
  • the above browsing system 700 (FIG. 7) is adapted to be used in conjunction with any software method that allows the reorganization of the material in the document involved to facilitate browsing/viewing.
  • a mouse cum cursor method say, two or more pages in the document to be compared or parts of the document to be compared can all be brought together and displayed in the currently viewed page(s) . This may be achieved by, say, using the mouse cum cursor to first select parts of the current viewed pages by clicking the mouse button and dragging the mouse like what is normally done or to select one of the currently viewed pages by double clicking on that page where the cursor is now positioned.
  • the cursor can now be positioned over a point on one of the currently viewed pages and the selected material can be brought into view by one click of the mouse button.
  • the selected material if it is one page full, will simply cover the page on which the cursor was placed before the one click of the mouse button to bring it into view. If the selected material is not one page full, it will be positioned, say, to the right and bottom of the cursor, and cover part of the page on which the cursor was placed before the one click of the mouse button to bring it into view.
  • Another click of the mouse button will remove this temporarily placed material to allow one to see what was on the page originally. This temporarily placed material will also automatically disappear from the page on which it was placed after that page disappears from view after the user activates movement to other parts of the document.
  • the above browsing system 700 can also be used in conjunction with any software method that allows the highlighting of selected portions of the material or annotations of the pages in the document involved to facilitate browsing/viewing/reading.
  • the above browsing system 700 is suitable for use not just for browsing through or viewing documents that do not require any processing of their contents while they are being viewed, but also in conjunction with a word-processing system. Instead of creating a document and processing it on a computer screen like what is normally done, and then scroll up and down to view and browse through it using the usual mouse cum scroll bar method, the method of viewing and browsing through the document as described in the above browsing system 700 can be used.
  • the process of entering/deleting material in the document can also be made to be consonant with the method of movement through the document (i.e., one of the methods 500, 510, 520, 530 and 540 described in FIGS. 5A - SB) .
  • the word processing is used in conjunction with, say, the flipping method 500 of moving through the document, as one finishes entering material for the righthand page, the page will flip over to reveal a new, empty page for the entering of material.
  • continued deletion will effect a flipping back to the previous page.
  • Similar mechanisms can be used in conjunction with the other three non- scrolling methods of moving through the document - namely the sliding method 510, the flashing method 520, and the vertical flipping method 540.
  • the above browsing system 700 is adapted for use in conjunction with any software in which there is information/icons of control "buttons" to be displayed, either for viewing or manipulating, that cannot be fitted within one computer screen.
  • scrolling in conjunction with the use of a mouse is often done, or sub-menus and sub-operations can be selected by pressing icons of "buttons" on the screen.
  • the sub-menus or displays containing buttons for sub-operations are flashed on the screen once they are selected.
  • the human-computer interface can be improved by organizing these directories/sub-directories or temporary working windows into "books” to be manipulated by the browsing system 700 described above. All information on the computer can be organized into one big book or more than one book at any given moment, hence the "library metaphor". There are at least three possible improvements: (a) sub-directory and file icons that cannot be fitted onto one window/screen can be browsed through and better accessed if they are organized/implemented in a form to be used in conjunction with the browsing device/system 700 described above FIG.
  • FIG. 11A depicts one embodiment of this in conjunction with the flipping method 500 of moving through the document: items 1101 - directories/sub-directories or files- in a window 1105 are placed in the pages of the book 1100 which is an instance of the computer book 500 depicted in FIG. 5A; (b) sub-directories 1115 (FIG. 11B) and files 1116 that are normally found in windows 1114 in the current window-based systems can be organized into chapters, sections, etc. in a computer book 1120 (an instance of the computer book 500 depicted in FIG. 5A) instead and used in conjunction with the browsing system 700, an embodiment of which is depicted in FIG.
  • FIG. lie depicts one embodiment of this in conjunction with the flipping method 500 of moving through the document.
  • each window 1125 maps onto one page or many windows 1125 can map onto one page in a computer book 1130 (an instance of the computer book 500 depicted in FIG. 5A) .
  • FIG. 12 describes a method for displaying a computer-based set of information on a display screen controlled by the inventive browsing device.
  • Step 1 displays a thickness image of a set of information corresponding to the size of a data file which holds the set of information.
  • the thickness image includes a left side portion and a right side portion which are displayed on the display screen.
  • the left side portion of the thickness image is displayed on the left side of the screen and is proportional to an amount of the information that proceeds a given point in the set of information that is currently being displayed on the display screen.
  • the right-hand portion of the thickness image is displayed on the right-hand side of the display and is proportional to an amount of the information that comes after the point as currently displayed on the display screen. For example, if the currently displayed point is near the end of the document, the left-hand side of the display will have a thickness image that appears thicker than that on the right-hand side.
  • step 1 the process flows to step S2 where all existing finger-bookmarks are displayed in a first image format. Then, in step S3, all existing permanent-bookmarks, are displayed in a second format. Both the finger-bookmarks and the permanent- bookmarks are displayed in the location in the thickness display corresponding to the locations of the material they bookmark. Then the process flows to step 84 where the user elects to bookmark the currently viewed material and a new bookmark (finger-bookmark or permanent bookmark) is added to the display. After 84, the process flows to step 85 where a position within the set of information is jumped to in response to a jump position indicated by the instrument (e.g., the user's finger). Once the position is jumped to, the process ends.
  • the instrument e.g., the user's finger
  • FIG. 13 describes a method for browsing a computer-based set of information.
  • the process starts in step 811 where a move command is generated to move a pointer through a set of information hosted on the computer either in a forward direction or a backward direction.
  • the process then flows to step 812 where the pointer is moved in response to the command that was generated in step 811.
  • the process then flows to step 813 where the speed of movement of the pointer through the information is adjusted.
  • the process then flows to step 814 where a jump command is received.
  • the process then flows to step 815 where a pointer is moved to a jump position in response to the received jump command.
  • the process then moves to step 816 where a bookmark command is received to mark a desired portion of text or graphics information from the set of information.
  • FIG. 14 is flowchart for a computer-interface process.
  • the process starts in step 820 where a set of information hosted on the computer is arranged in a set of books. Each of the books includes a subset of the information from the set of information hosted on the computer. Once arranged, the process flows to step 821 where each of the books is labelled with a respective portion of the subset of information corresponding with each book.
  • the process then flows to step 822 where, based on user input, a user can select a selected book by first viewing books which are displayed as a single book document image. The book document image is made up of individual pages that correspond to the respective portions of the books.
  • the process then flows to step 822 where, based on user input, a user can select a selected book by first viewing books which are displayed as a single book document image. The book document image is made up of individual pages that correspond to the respective portions of the books.
  • the process then flows to step 822 where, based on user input, a user can select a selected book
  • step 823 where a command is generated, as actuated by the user, to move through the pages so that a user can view the individual pages and select a desired book. The process then flows to step
  • step 824 where the pages of the book are displayed in an animated image where the pages of the book document are either flipped (preferable) , scrolled, slid or flashed on the screen.
  • step 825 where, while viewing the animated image, the user via user input can select one of the pages. By selecting one of the pages, the user has selected the desired book.
  • step S26 the selected book is displayed as the image of a book document. However, pages of the selected book document include respective portions of the subset of information corresponding to the selected book.
  • step S27 where a move command is generated for moving a pointer through a subset of the pages of the selected book.
  • step 828 an animated image is displayed of the pages in the selected book being shown as either flipped (preferable) , scrolled, slid or flashed on the screen.
  • step 829 a selected book page of the selected book is selected by the user via a user input indication. Once the user has selected the desired book page, the process ends.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

L'invention concerne un dispositif de lecture rapide d'informations stockées dans un ordinateur, qui comprend les éléments suivants: un corps; un dispositif capteur, qui détecte la position d'un instrument dans une direction et une force de cet instrument s'exerçant sur ledit dispositif capteur; des ensembles de capteurs qui sont actionnés par ledit instrument, disposés sur ledit corps et conçus pour produire au moins un signal d'état lorsqu'au moins un des ensembles de capteurs est actionné par l'instrument; un circuit transducteur qui convertit la force et la position de l'instrument sur le dispositif capteur en au moins un signal; et une porte de sortie par laquelle passent le ou les signaux du transducteur et le ou les signaux d'état pour atteindre un ordinateur où sont stockées des informations, le ou les signaux du transducteur et le ou les signaux du capteur formant au moins une direction de commande de déplacement, une commande de changement de vitesse, une commande de saut vers un emplacement spécifique et une commande de signet utilisée par l'ordinateur pour manipuler une image affichée provenant de l'ensemble d'informations.
PCT/SG1997/000036 1996-08-26 1997-08-22 Systeme et procede de lecture rapide d'informations stockees dans un ordinateur WO1998009446A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU44081/97A AU4408197A (en) 1996-08-26 1997-08-22 A browsing system and method for computer information

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US08/703,404 1996-08-26
US08/703,407 US5909207A (en) 1996-08-26 1996-08-26 Browsing system and method for computer information
US08/703,404 US6064384A (en) 1996-08-26 1996-08-26 Computer user interface system and method having book image features
US08/703,407 1996-08-26

Publications (2)

Publication Number Publication Date
WO1998009446A2 true WO1998009446A2 (fr) 1998-03-05
WO1998009446A3 WO1998009446A3 (fr) 1998-04-16

Family

ID=27107136

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG1997/000036 WO1998009446A2 (fr) 1996-08-26 1997-08-22 Systeme et procede de lecture rapide d'informations stockees dans un ordinateur

Country Status (2)

Country Link
AU (1) AU4408197A (fr)
WO (1) WO1998009446A2 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1014295A2 (fr) * 1998-12-25 2000-06-28 Kabushiki Kaisha Tokai Rika Denki Seisakusho Dispositif d'entrée actionné par le toucher, système d'affichage et méthode d'assistance des opérations de toucher pour un dispositif d'entrée actionné par le toucher
WO2001042896A2 (fr) * 1999-12-07 2001-06-14 Microsoft Corporation Introduction de signet et de marque-page dans un document affiche dans un systeme informatique
US6714214B1 (en) 1999-12-07 2004-03-30 Microsoft Corporation System method and user interface for active reading of electronic content
US6820111B1 (en) 1999-12-07 2004-11-16 Microsoft Corporation Computer user interface architecture that saves a user's non-linear navigation history and intelligently maintains that history
US6891551B2 (en) 2000-11-10 2005-05-10 Microsoft Corporation Selection handles in editing electronic documents
US7002558B2 (en) 2000-12-21 2006-02-21 Microsoft Corporation Mode hinting and switching
US7259753B2 (en) 2000-06-21 2007-08-21 Microsoft Corporation Classifying, anchoring, and transforming ink
US8627197B2 (en) 1999-12-07 2014-01-07 Microsoft Corporation System and method for annotating an electronic document independently of its content

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9424240B2 (en) 1999-12-07 2016-08-23 Microsoft Technology Licensing, Llc Annotations for electronic content

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0246971A2 (fr) * 1986-05-21 1987-11-25 Pierre Edmond Gabriel Bourgain Dispositif d'entrée de données dans un système informatique
WO1991011769A1 (fr) * 1990-01-23 1991-08-08 Kim Robert Woodill Dispositif electronique portatif de lecture et de reference
WO1992008182A1 (fr) * 1990-10-30 1992-05-14 Wang Laboratories, Inc. Systeme informatique et procede de reproduction graphique d'un livre a feuilles mobiles
EP0635780A1 (fr) * 1993-07-21 1995-01-25 Xerox Corporation Interface utilisateur avec outils à cliquer à travers une feuille transparente, qui peuvent être composés par d'autres outils

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0246971A2 (fr) * 1986-05-21 1987-11-25 Pierre Edmond Gabriel Bourgain Dispositif d'entrée de données dans un système informatique
WO1991011769A1 (fr) * 1990-01-23 1991-08-08 Kim Robert Woodill Dispositif electronique portatif de lecture et de reference
WO1992008182A1 (fr) * 1990-10-30 1992-05-14 Wang Laboratories, Inc. Systeme informatique et procede de reproduction graphique d'un livre a feuilles mobiles
EP0635780A1 (fr) * 1993-07-21 1995-01-25 Xerox Corporation Interface utilisateur avec outils à cliquer à travers une feuille transparente, qui peuvent être composés par d'autres outils

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
MICROSOFT WORD FOR WINDOWS 95, Version 7.0. *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7129933B1 (en) 1998-06-23 2006-10-31 Kabushiki Kaisha Tokai-Rika-Denki Seisakusho Touch-operating input device, display system, and touch-operation assisting method for touch-operating input device
EP1014295A2 (fr) * 1998-12-25 2000-06-28 Kabushiki Kaisha Tokai Rika Denki Seisakusho Dispositif d'entrée actionné par le toucher, système d'affichage et méthode d'assistance des opérations de toucher pour un dispositif d'entrée actionné par le toucher
EP1014295A3 (fr) * 1998-12-25 2002-01-09 Kabushiki Kaisha Tokai Rika Denki Seisakusho Dispositif d'entrée actionné par le toucher, système d'affichage et méthode d'assistance des opérations de toucher pour un dispositif d'entrée actionné par le toucher
WO2001042896A2 (fr) * 1999-12-07 2001-06-14 Microsoft Corporation Introduction de signet et de marque-page dans un document affiche dans un systeme informatique
WO2001042896A3 (fr) * 1999-12-07 2002-01-10 Microsoft Corp Introduction de signet et de marque-page dans un document affiche dans un systeme informatique
US6714214B1 (en) 1999-12-07 2004-03-30 Microsoft Corporation System method and user interface for active reading of electronic content
US6820111B1 (en) 1999-12-07 2004-11-16 Microsoft Corporation Computer user interface architecture that saves a user's non-linear navigation history and intelligently maintains that history
US8627197B2 (en) 1999-12-07 2014-01-07 Microsoft Corporation System and method for annotating an electronic document independently of its content
US7259753B2 (en) 2000-06-21 2007-08-21 Microsoft Corporation Classifying, anchoring, and transforming ink
US6891551B2 (en) 2000-11-10 2005-05-10 Microsoft Corporation Selection handles in editing electronic documents
US7002558B2 (en) 2000-12-21 2006-02-21 Microsoft Corporation Mode hinting and switching

Also Published As

Publication number Publication date
AU4408197A (en) 1998-03-19
WO1998009446A3 (fr) 1998-04-16

Similar Documents

Publication Publication Date Title
US5909207A (en) Browsing system and method for computer information
US6340980B1 (en) Computer user interface system and method having book image features
US6407757B1 (en) Computer-based browsing method and computer program product for displaying information in an electronic book form
AU2002341563B2 (en) A method for displaying flipping pages via electromechanical information browsing device
AU2002341563A1 (en) A method for displaying flipping pages via electromechanical information browsing device
AU2002341562A1 (en) An electromechanical information browsing device
WO1998009446A2 (fr) Systeme et procede de lecture rapide d'informations stockees dans un ordinateur
AU2007202501A1 (en) A method for flipping pages via electromechanical information browsing device
AU2007203622A1 (en) An electromechanical information browsing device
AU2002341564A1 (en) A method for flipping pages via electromechanical information browsing device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH HU IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZW AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH KE LS MW SD SZ UG ZW AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT

AK Designated states

Kind code of ref document: A3

Designated state(s): AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE GH HU IL IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZW AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH KE LS MW SD SZ UG ZW AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase in:

Ref country code: JP

Ref document number: 1998511573

Format of ref document f/p: F

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: CA