US20180189929A1 - Adjusting margins in book page images - Google Patents

Adjusting margins in book page images Download PDF

Info

Publication number
US20180189929A1
US20180189929A1 US15/908,668 US201815908668A US2018189929A1 US 20180189929 A1 US20180189929 A1 US 20180189929A1 US 201815908668 A US201815908668 A US 201815908668A US 2018189929 A1 US2018189929 A1 US 2018189929A1
Authority
US
United States
Prior art keywords
book page
text
book
dimensions
sequence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/908,668
Inventor
Jeffrey Bartelma
Gopal Venu Vemula
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Priority to US15/908,668 priority Critical patent/US20180189929A1/en
Assigned to GOOGLE INC. reassignment GOOGLE INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BARTELMA, JEFFREY, VEMULA, GOPAL VENU
Assigned to GOOGLE LLC reassignment GOOGLE LLC CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: GOOGLE INC.
Publication of US20180189929A1 publication Critical patent/US20180189929A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483Interaction with page-structured environments, e.g. book metaphor

Definitions

  • the subject matter of this application is generally related to formatting content for presentation on a display area.
  • Electronic books can be purchased and downloaded from e-bookstores online and read on various devices, such as personal computers, personal digital assistants (PDAs), pocket-PCs, mobile phones, media player/recorders, dedicated e-book readers, etc.
  • An e-book is typically a collection of digital objects or documents, which are packaged and formatted with the intention of being displayed on a device or read by a speech generating application.
  • E-books can be distributed over a network as a sequence of images, for example, one image for each page.
  • E-books that are distributed over a network e.g., the Internet, wireless network
  • Hypertext Mark-up Language HTML
  • Microsoft® Internet Explorer e.g., Microsoft® Internet Explorer
  • a user interface (e.g., a browser window) includes a display area for displaying an image (e.g., a book page image).
  • the image can be rescaled based on the dimensions of the display area and other factors.
  • a method includes: receiving an image having a content space including content and at least one margin proximate to the content; determining the margin size; adjusting the margin size to modify the content space; and rescaling the image content to substantially fill the content space.
  • implementations are disclosed, including implementations directed to systems, methods, apparatuses, computer-readable mediums and user interfaces.
  • FIG. 1 illustrates an exemplary viewport for displaying images.
  • FIG. 3 is a flow diagram for an exemplary margin adjustment process.
  • FIG. 4 is a flow diagram for an exemplary table of contents creation process.
  • FIG. 5 is a block diagram of an exemplary viewport system architecture.
  • FIG. 6 is a screen shot illustrating an exemplary table of contents including links.
  • FIG. 1 illustrates an exemplary viewport 102 for displaying an image 104 .
  • the viewport 102 is displayed in a user interface 100 (e.g., a browser window).
  • the viewport 102 is used to view book page images in an e-book application.
  • the viewport 102 can be used to view other types of content (e.g., news articles, magazines, newspapers, .pdfs, blogs).
  • the viewport 102 can be provided by a server (e.g., a web server) over a network (e.g., the Internet, wireless network).
  • a server e.g., a web server
  • a network e.g., the Internet, wireless network
  • the viewport 102 can be presented on a web page interface for a book search engine.
  • a user can enter a search term (e.g., the title of a book) in a search box 112 , and click a button 114 to begin or otherwise activate the search process.
  • a book search engine is GoogleTM Book Search, developed by Google Inc. (Mountain View, Calif.).
  • the search results can be presented to the user with other information (e.g., a summary, image) and a link to allow the user to view one or more pages of the book.
  • a book page image 104 can be presented in a display area 108 of the viewport 102 .
  • the book page image 104 typically includes book page content 106 (e.g., text, images), which can be set-off by margins.
  • the book page image is a digital image of an actual book page.
  • a single page layout or a two page layout (pages displayed side by side) can be displayed in the display area 108 of the viewport 102 .
  • a panel 110 can be displayed (e.g., side panel as shown) for presenting information related to the book.
  • information can include, but is not limited to: title, author, summary or forward, title page link, copyright link, table of contents (TOC) link, index link, links to book retailers, library search link, a book search engine for searching for particular terms inside the book, etc.
  • TOC table of contents
  • the user can navigate (e.g., flip) through book pages using the controls 116 (e.g., arrow buttons).
  • the controls 116 can change according to the image that is displayed in the viewport 102 .
  • the user can enter a page number into a search box and go directly to that page without incrementing through other pages.
  • An example of a search box is the search box 608 shown in FIG. 6 .
  • the controls 116 can be provided.
  • Other controls for navigating a book can be included, such as scroll bars, buttons, links, speech command recognition, multi-touch displays, etc.
  • the viewport 102 (and the book page image contained therein) rescales with the user interface 100 .
  • the user interface 100 may be manually resized for display using an input device (e.g., a mouse), or the viewport 102 may be automatically resized for display by an application or operating system of a device that may have a limited screen space (e.g., a portable computer, mobile phone, media player/recorder, PDA).
  • a limited screen space e.g., a portable computer, mobile phone, media player/recorder, PDA.
  • FIG. 2 is a flow diagram for an exemplary scaling process 200 .
  • the process 200 begins when a viewport is launched in a user interface (e.g., a browser window) in response to a trigger event.
  • the dimensions of the viewport can be determined from default values or based on the current size of the user interface ( 202 ). For example, if a user clicks a link corresponding to a result of a book search, the viewport can be launched based on default settings, and a default image can be displayed in the viewport (e.g., a title page or first page of a book).
  • books are previously scanned and processed to extract and/or determine information (e.g., dimensions) that can be used to later manage the display of images in a viewport.
  • information e.g., dimensions
  • Such processing can include, but is not limited to: determining a typical text bounding box for the book page images, determining a text bounding box for each book page image, removing artifacts in book page images (e.g., artifacts due to systematic scanning error), etc.
  • the selected book page image can be retrieved from an image repository ( 204 ) or other suitable data structure for storing images (e.g., cache memory).
  • the image is scaled to fit in the viewport given the current dimensions of the viewport and other factors ( 206 ).
  • the user is provided with zoom controls with predetermined zoom “stops”.
  • the zoom stops can be set as a function of viewport size (e.g., height, width).
  • the zoom stops fit the image to the height and/or width of the viewport.
  • the zoom stops can have absolute bounds to prevent the image from being made arbitrarily large or small.
  • the scaled image is displayed in the viewport ( 208 ). If the user interface (e.g., browser window) is resized ( 210 ), then the viewport can be re-sized based on the current dimensions of the user interface ( 212 ) and the process 200 returns to step 206 . Alternatively, the viewport can be maintained based on user settings or preferences. For example, a user may want the size of the viewport to remain fixed when the user interface is resized.
  • the dimensions of the viewport 102 are provided by a window manager service, which is commonly included as part of an operating system (e.g., Windows XP).
  • a window manager service which is commonly included as part of an operating system (e.g., Windows XP).
  • Other factors that can be used to scale an image for display in the viewport can include, but are not limited to:
  • scaling can be determined empirically using some principles (e.g., rules, guidelines, options, etc.). Some exemplary principles for determining a scaled size include, but are not limited to:
  • a bounding box of the text on the page can be padded. If the padded bounding box is “close” to fitting in the display area 108 of the viewport 102 , then the image is scaled to fit the display area 108 . In some implementations, the scaling is performed provided the text does not drop below a minimum x-height. In some implementations, the bounding box is “close” to fitting in the viewport if a certain portion (e.g., a percentage) of the bounding box fits within the viewport. Otherwise, more than one “viewportful” of vertical space may be needed to display the page.
  • a certain portion e.g., a percentage
  • any given book page image can have a fixed aspect ratio
  • the viewport 102 containing the book page image does not have to have a fixed aspect ratio.
  • the image could be long and narrow if the whole page is being displayed or short and wide if the top half of the page is displayed.
  • the page image can be scaled to a size so that a predetermined percentage of the page image fits in the viewport 102 (e.g., the top 55% of the page).
  • a predetermined percentage of the page image fits in the viewport 102 (e.g., the top 55% of the page).
  • the remaining portion of the page image can be displayed in the viewport 102 (e.g., the bottom 55% of the page), rather than a new page.
  • a separate control e.g., a toggle button
  • a scaled image is displayed by default.
  • a zoom feature can be included that allows the user to zoom between a scaled image and the image with its original dimensions.
  • software can be used to implement a multi-stage zoom.
  • a zoom dropdown menu can be presented to the user with options such as 50%, 75%, default (the scaled size), zoom to fit, or actual size. Once a size is set, the size can persist from image to image.
  • images e.g., the next book page image of the sequence
  • the user is presented with zoom controls upon display of a default page.
  • the zoom controls allow users to zoom-in or zoom-out the book page images.
  • the zoom controls can include zoom “stops” which can be customized using, for example, information about the image that was previously determined during a scanning process (e.g., image dimensions).
  • the zoom “stops” can be zoom percentages (e.g., 10%, 38%) that have been customized to provide better user experience for the particular image being zoomed and the particular viewport size.
  • FIG. 3 is a flow diagram for an exemplary margin adjusting process 300 . Since book page images are digital images of actual book pages, the sometimes ample margins used in a conventional book are captured in the digital image. Such ample margins, however, can diminish the readability of the book in electronic form. The process 300 makes small adjustments to book page margins in the digital domain to maximize readability of book page images.
  • the process 300 begins by retrieving an image including content and margins from an image repository ( 302 ).
  • the process 300 determines whether margins exist, and if margins exist, also determines the dimensions of the margins ( 304 ). For example, the process 300 can look for white space in the outer portion of a page image to determine if page margins exist. If page margins exist, then a difference between page dimensions and a text bounding box can be calculated to determine page margin dimensions. Once the margin dimensions are known, standard image cropping or magnifying techniques can be used to adjust (e.g., trim or increase) the margins based on the margin dimensions to provide appropriate (e.g., additional or less) space for the content ( 306 ).
  • the image content (e.g., text) can be rescaled to fill the space provided by the margin adjusting ( 308 ).
  • the book page images with adjusted margins can be stored in an image repository (e.g., image repository 504 ) for future retrieval when a user requests a book page having a particular scale ( 310 ).
  • cropping rules are used to provide a uniform presentation of images in the viewport.
  • each book page image in a sequence of book page images can have a designated anchor point, such as the top left-hand corner of the book page image, which can be used to anchor the text in substantially the same location of the image.
  • a template can be used to scale each image in a uniform manner.
  • the template can be a page bounding box with standard dimensions (height, width). The dimensions of the template bounding box can be determined by processing an entire image sequence and determining a typical height and width of the text in the image sequence (e.g., a median height and width). If a given text is close to the template bounding box, than the template is used. Otherwise, the text is processed, as described in reference to FIG. 2 .
  • FIG. 4 is a flow diagram for an exemplary TOC creation process 400 .
  • a TOC is presented in the viewport 102 with hypertext links to other pages in a book page sequence.
  • the process 400 begins by retrieving a book page sequence for an image repository ( 402 ).
  • the book page sequence is searched using, for example, an OCR engine, to identify which images contain a TOC.
  • Various clues, attributes or heuristics can be used to determine whether an image includes a TOC. For example, an image can be determined to be a TOC if the image contains white space, text with large fonts (e.g., a large title), ellipses, roman numerals, italicized text, or any other attributes associated with TOCs.
  • Some or all of these clues, attributes or heuristics can be combined into a score, which can be compared to a reference to determine whether a TOC has been found.
  • the image is tagged ( 408 ) and hypertext links are created for one or more (e.g., each) of the TOC entries ( 410 ) and embedded in the TOC image.
  • the TOC image, including the links, can then be presented in the viewport 102 .
  • the various clues, attributes and heuristics can be used to determine breaks in the book page sequence ( 412 ). For example, the first page of each chapter or section in a book can be identified as a break in the book page sequence. The breaks in content can then be used to create a TOC ( 414 ). For example, the first page of each chapter or section of a book can be the entries of the TOC. Chapter and/or section title names used in the book can be used for naming entry points in the created TOC, if available. Otherwise, names can be created for the TOC entry points, for example, “Section 1”, “Section 2”, . . . , “Section N”.
  • links can be created for the TOC entries, and the TOC, including the links, can be presented in the viewport 102 , as described in reference to FIG. 6 .
  • the first few sentences or paragraphs of each chapter or section of a book can be displayed in a panel (e.g., a side panel 612 in FIG. 6 ).
  • FIG. 5 is a block diagram of an exemplary viewport system architecture 500 .
  • the architecture 500 includes one or more processors 502 (e.g., dual-core Intel® Xeon® Processors), an image repository 504 , one or more network interfaces 506 , an optional administrative computer 508 and one or more computer-readable mediums 510 (e.g., RAM, ROM, SDRAM, hard disk, optical disk, flash memory, SAN, etc.).
  • These components can exchange communications and data over one or more communication channels 512 (e.g., Ethernet, Enterprise Service Bus, PCI, PCI-Express, etc.), which can include various known network devices (e.g., routers, hubs, gateways, buses) and utilize software (e.g., middleware) for facilitating the transfer of data and control signals between devices.
  • communication channels 512 e.g., Ethernet, Enterprise Service Bus, PCI, PCI-Express, etc.
  • network devices e.g., routers, hubs, gateways, buses
  • software e.g., middleware
  • computer-readable medium refers to any medium that participates in providing instructions to a processor 502 for execution, including without limitation, non-volatile media (e.g., optical or magnetic disks), volatile media (e.g., memory) and transmission media.
  • Transmission media includes, without limitation, coaxial cables, copper wire and fiber optics. Transmission media can also take the form of acoustic, light or radio frequency waves.
  • the computer-readable medium 510 further includes an operating system 514 (e.g., Mac OS® server, Windows® NT server), a network communication module 516 and viewport system 518 .
  • the operating system 514 can be multi-user, multiprocessing, multitasking, multithreading, real time, etc.
  • the operating system 514 performs basic tasks, including but not limited to: recognizing input from and providing output to the administrator computer 508 ; keeping track and managing files and directories on computer-readable mediums 510 (e.g., memory or a storage device); controlling peripheral devices (e.g., repositories 504 ); and managing traffic on the one or more communication channels 512 .
  • the network communications module 516 includes various components for establishing and maintaining network connections (e.g., software for implementing communication protocols, such as TCP/IP, HTTP, etc.).
  • the viewport system 518 includes a web server 520 , a scaling process 522 , a margin adjusting process 524 , a TOC creation process 526 , a reference page creation process 528 and an OCR engine 530 . These components are described in reference to FIGS. 1-4 .
  • the architecture 500 is one example of a suitable architecture for hosting a viewport system. Other architectures are possible, which can include more or fewer components.
  • the image repository 504 and computer-readable medium 510 can be the same storage device or separate storage devices.
  • the components of architecture 500 can be located in the same facility or distributed among several facilities.
  • the architecture 500 can be implemented in a parallel processing or peer-to-peer infrastructure or on a single device with one or more processors.
  • the viewport system 518 can include multiple software components or it can be a single body of code. Some or all of the functionality of the viewport system 518 can be provided as a service to clients over a network. In such a case, these entities may need to install client applications. Some or all of the functionality of the viewport system 518 can be provided as part of a search engine application.
  • FIG. 6 is a screen shot illustrating an exemplary TOC 604 including links 610 .
  • the TOC 604 can be displayed on a book search engine web page 602 displayed in a web browser window 600 .
  • Controls 608 can be provided for navigating the pages of the book.
  • the controls 608 include buttons for flipping pages and a search box for jumping the user directly to a desired page.
  • a panel 612 included on the web page 602 is a panel 612 (e.g., the side panel shown) including information and links related to the book, as described in reference to FIG. 1 .
  • the TOC 604 including the links 610 , can be generated using the process 400 described in reference to FIG. 4 .
  • the user search for the book “Huckleberry Finn” using the book search engine.
  • a default book page image is displayed (e.g., a title page).
  • an image of the TOC 604 will be displayed, including links 610 . If the user clicks or otherwise interacts with a links 610 , a book page image in a sequence of book page images responsive to the link will be displayed.
  • FIG. 7 is a screen shot illustrating an exemplary book reference page 700 .
  • the reference page 700 includes a summary section 701 , a contents section 702 , a review section 704 , a pages with images section 706 and a key words section 708 .
  • the book reference page 700 is one example of a book reference page. Other configurations and formats for a book reference page are possible.
  • the summary section 701 includes a thumbnail image of the book's cover and basic information, such as, for example, title, author, publisher, number of pages, ISBN number, language, physical dimensions, format (i.e., paperback, hardback, e-book), etc.
  • the contents section 702 includes links to various chapters or sections of the book, and can list keywords that can be found in those chapters or sections.
  • a viewport is presented which allows the user to navigate pages of the chapter or section of the book corresponding to the link using navigation controls (e.g., controls 116 ).
  • the review section 704 includes links to book reviews and other information about the book, including reviewer ratings.
  • the pages with images section 706 displays thumbnails of pages of the book that includes images. If the user clicks on the image, the page with the image corresponding to the clicked thumbnail will be displayed in a viewport. If the viewport is not already presented, the viewport will be invoked in response to the click on the thumbnail image.
  • the key words section 708 includes categories of keywords contained in the book.
  • the keywords can be links that when clicked cause the book page or pages containing the keyword to be displayed a viewport. If the viewport is not already presented, the viewport will be invoked in response to the click on the keyword link.
  • the various information contained on the book reference page 700 can be gathered from the book, the World Wide Web and any other online resources.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A user interface (e.g., a browser window) includes a display area for displaying an image (e.g., a book page image). The image can be rescaled based on the dimensions of the display area and other factors. In some implementations, margins in book page images are adjusted to create additional or less display area.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This is a continuation of U.S. application Ser. No. 14/284,625, filed on May 22, 2014, which is a continuation of U.S. application Ser. No. 11/543,722, filed on Oct. 4, 2006 (now U.S. Pat. No. 8,782,551). The disclosures of the prior applications are considered part of and are incorporated by reference in the disclosure of this application.
  • TECHNICAL FIELD
  • The subject matter of this application is generally related to formatting content for presentation on a display area.
  • BACKGROUND
  • Information technology has provided new ways of publishing books, newspapers, magazines and periodicals. Electronic books (“e-books”) can be purchased and downloaded from e-bookstores online and read on various devices, such as personal computers, personal digital assistants (PDAs), pocket-PCs, mobile phones, media player/recorders, dedicated e-book readers, etc. An e-book is typically a collection of digital objects or documents, which are packaged and formatted with the intention of being displayed on a device or read by a speech generating application. E-books can be distributed over a network as a sequence of images, for example, one image for each page. E-books that are distributed over a network (e.g., the Internet, wireless network) using Hypertext Mark-up Language (HTML) can be read using a standard browser (e.g., Microsoft® Internet Explorer).
  • Conventional e-book technology suffers several drawbacks. For example, exploring an e-book typically requires horizontal motion (flipping through pages) and vertical motion (scrolling within every page), which makes regular sequential reading of book pages frustrating. Another drawback is the poor use of free space on large display screens and limited space on small display screens.
  • SUMMARY
  • A user interface (e.g., a browser window) includes a display area for displaying an image (e.g., a book page image). The image can be rescaled based on the dimensions of the display area and other factors.
  • In some implementations, a method includes: receiving an image having a content space including content and at least one margin proximate to the content; determining the margin size; adjusting the margin size to modify the content space; and rescaling the image content to substantially fill the content space.
  • Other implementations are disclosed, including implementations directed to systems, methods, apparatuses, computer-readable mediums and user interfaces.
  • DESCRIPTION OF DRAWINGS
  • FIG. 1 illustrates an exemplary viewport for displaying images.
  • FIG. 2 is a flow diagram for an exemplary scaling process for the viewport of FIG. 1.
  • FIG. 3 is a flow diagram for an exemplary margin adjustment process.
  • FIG. 4 is a flow diagram for an exemplary table of contents creation process.
  • FIG. 5 is a block diagram of an exemplary viewport system architecture.
  • FIG. 6 is a screen shot illustrating an exemplary table of contents including links.
  • FIG. 7 is a screen shot illustrating an exemplary book reference page.
  • DETAILED DESCRIPTION Viewport Overview
  • FIG. 1 illustrates an exemplary viewport 102 for displaying an image 104. In some implementations, the viewport 102 is displayed in a user interface 100 (e.g., a browser window). In the example shown, the viewport 102 is used to view book page images in an e-book application. The viewport 102, however, can be used to view other types of content (e.g., news articles, magazines, newspapers, .pdfs, blogs).
  • The viewport 102 can be provided by a server (e.g., a web server) over a network (e.g., the Internet, wireless network). In the example shown, the viewport 102 can be presented on a web page interface for a book search engine. A user can enter a search term (e.g., the title of a book) in a search box 112, and click a button 114 to begin or otherwise activate the search process. An example of a book search engine is Google™ Book Search, developed by Google Inc. (Mountain View, Calif.).
  • The search results can be presented to the user with other information (e.g., a summary, image) and a link to allow the user to view one or more pages of the book. For example, when the user clicks the link corresponding to a book the user wants to review, a book page image 104 can be presented in a display area 108 of the viewport 102. The book page image 104 typically includes book page content 106 (e.g., text, images), which can be set-off by margins. In some implementations, the book page image is a digital image of an actual book page. In some implementations, a single page layout or a two page layout (pages displayed side by side) can be displayed in the display area 108 of the viewport 102.
  • In addition to the viewport 102, a panel 110 can be displayed (e.g., side panel as shown) for presenting information related to the book. Such information can include, but is not limited to: title, author, summary or forward, title page link, copyright link, table of contents (TOC) link, index link, links to book retailers, library search link, a book search engine for searching for particular terms inside the book, etc. For example, if the user clicks the TOC link, then an image of the book's TOC will be displayed in the viewport 102, as shown in FIG. 6.
  • The user can navigate (e.g., flip) through book pages using the controls 116 (e.g., arrow buttons). By clicking the controls 116, the book page images can be displayed in two directions. The controls 116 can change according to the image that is displayed in the viewport 102. In some implementations where an entire book is viewable, the user can enter a page number into a search box and go directly to that page without incrementing through other pages. An example of a search box is the search box 608 shown in FIG. 6. In other implementations where only a few consecutive pages can be navigated (e.g., first few pages of a chapter), the controls 116 can be provided. Other controls for navigating a book can be included, such as scroll bars, buttons, links, speech command recognition, multi-touch displays, etc.
  • In some implementations, the viewport 102 (and the book page image contained therein) rescales with the user interface 100. For example, the user interface 100 may be manually resized for display using an input device (e.g., a mouse), or the viewport 102 may be automatically resized for display by an application or operating system of a device that may have a limited screen space (e.g., a portable computer, mobile phone, media player/recorder, PDA). To create a more comfortable user experience for extended reading, it is desirable to manage the screen space for displaying the book pages. This can be accomplished by filling the viewport 102 with a book page image 104 that has been rescaled to a size determined by the available display area 108 in the viewport 102 (i.e., the viewport dimensions) and other factors, which are described in reference to FIG. 2.
  • Scaling Process
  • FIG. 2 is a flow diagram for an exemplary scaling process 200. In some implementations, the process 200 begins when a viewport is launched in a user interface (e.g., a browser window) in response to a trigger event. The dimensions of the viewport can be determined from default values or based on the current size of the user interface (202). For example, if a user clicks a link corresponding to a result of a book search, the viewport can be launched based on default settings, and a default image can be displayed in the viewport (e.g., a title page or first page of a book). In some implementations, books are previously scanned and processed to extract and/or determine information (e.g., dimensions) that can be used to later manage the display of images in a viewport. Such processing can include, but is not limited to: determining a typical text bounding box for the book page images, determining a text bounding box for each book page image, removing artifacts in book page images (e.g., artifacts due to systematic scanning error), etc.
  • If the user clicks a control to select a different book page, the selected book page image can be retrieved from an image repository (204) or other suitable data structure for storing images (e.g., cache memory). In some implementations, the image is scaled to fit in the viewport given the current dimensions of the viewport and other factors (206). In other implementations, the user is provided with zoom controls with predetermined zoom “stops”. The zoom stops can be set as a function of viewport size (e.g., height, width). The zoom stops fit the image to the height and/or width of the viewport. The zoom stops can have absolute bounds to prevent the image from being made arbitrarily large or small.
  • The scaled image is displayed in the viewport (208). If the user interface (e.g., browser window) is resized (210), then the viewport can be re-sized based on the current dimensions of the user interface (212) and the process 200 returns to step 206. Alternatively, the viewport can be maintained based on user settings or preferences. For example, a user may want the size of the viewport to remain fixed when the user interface is resized.
  • In some implementations, the dimensions of the viewport 102 are provided by a window manager service, which is commonly included as part of an operating system (e.g., Windows XP). Other factors that can be used to scale an image for display in the viewport can include, but are not limited to:
      • the x-height (approximately the line height in pixels) of text on the book page, which can be provided by an optical character recognition (OCR) system, such as the Tesseract OCR engine developed by Hewlett-Packard, Inc.;
      • a bounding box for text on the book page image, as given by margin recognition or the user's current browser text size; and
      • the user's current browser text size. For example, text can be rendered to a hidden portion of the user interface (e.g., a browser window) and measured to estimate the user's browser text size, and a scale factor can be determined from the measurement for correcting the image size.
  • In some implementations, scaling can be determined empirically using some principles (e.g., rules, guidelines, options, etc.). Some exemplary principles for determining a scaled size include, but are not limited to:
      • Rule 1: At the scaled size there should not be horizontal scrolling within the viewport.
      • Rule 2: At the scaled size, the height “x” should not be below a threshold value of N (e.g., 10 or 12 pixels).
      • Guideline 1: If the text on the book page image is “close” to fitting in the viewport (vertically), the scaled size image should fit entirely in the viewport. In some implementations, the scaling can be performed by a user with “zoom” controls having zoom “stops” that are customized to the particular image being zoomed.
      • Guideline 2: In general, minimize the number of times the viewport is filled to consume a book page image. This minimization can be achieved in part through margin cropping, as described in reference to FIG. 3.
  • In some implementations, a bounding box of the text on the page can be padded. If the padded bounding box is “close” to fitting in the display area 108 of the viewport 102, then the image is scaled to fit the display area 108. In some implementations, the scaling is performed provided the text does not drop below a minimum x-height. In some implementations, the bounding box is “close” to fitting in the viewport if a certain portion (e.g., a percentage) of the bounding box fits within the viewport. Otherwise, more than one “viewportful” of vertical space may be needed to display the page.
  • Although any given book page image can have a fixed aspect ratio, the viewport 102 containing the book page image does not have to have a fixed aspect ratio. The image could be long and narrow if the whole page is being displayed or short and wide if the top half of the page is displayed. Thus, there can be at least two options:
      • Option 1: Minimize the number of “viewportfuls” needed to show a single book page image, at the expense of text size (e.g., place as much text into the viewport as possible by scaling down the text until the text reaches nearly the minimum line height).
      • Option 2: Scale the image up to get larger text, at the cost of needing more “viewportfuls” to consume a single book page. The upper bound on the up scaling can be set by Rule 1—no horizontal scrolling. This approach can be better suited for a shorter, wider viewport.
  • In some implementations, the page image can be scaled to a size so that a predetermined percentage of the page image fits in the viewport 102 (e.g., the top 55% of the page). When the user clicks the controls 116, the remaining portion of the page image can be displayed in the viewport 102 (e.g., the bottom 55% of the page), rather than a new page. Alternatively, a separate control (e.g., a toggle button) can be provided for handling the scenario described above.
  • Using A Scaled Image
  • In some implementations, a scaled image is displayed by default. A zoom feature can be included that allows the user to zoom between a scaled image and the image with its original dimensions. Alternatively, software can be used to implement a multi-stage zoom. For example, a zoom dropdown menu can be presented to the user with options such as 50%, 75%, default (the scaled size), zoom to fit, or actual size. Once a size is set, the size can persist from image to image. In some implementations, images (e.g., the next book page image of the sequence) can be aggressively preloaded, pre-scaled and potentially pre-rendered at the selected size.
  • In some implementations, the user is presented with zoom controls upon display of a default page. The zoom controls allow users to zoom-in or zoom-out the book page images. The zoom controls can include zoom “stops” which can be customized using, for example, information about the image that was previously determined during a scanning process (e.g., image dimensions). The zoom “stops” can be zoom percentages (e.g., 10%, 38%) that have been customized to provide better user experience for the particular image being zoomed and the particular viewport size.
  • Margin Adjusting Process
  • FIG. 3 is a flow diagram for an exemplary margin adjusting process 300. Since book page images are digital images of actual book pages, the sometimes ample margins used in a conventional book are captured in the digital image. Such ample margins, however, can diminish the readability of the book in electronic form. The process 300 makes small adjustments to book page margins in the digital domain to maximize readability of book page images.
  • In some implementations, the process 300 begins by retrieving an image including content and margins from an image repository (302). The process 300 determines whether margins exist, and if margins exist, also determines the dimensions of the margins (304). For example, the process 300 can look for white space in the outer portion of a page image to determine if page margins exist. If page margins exist, then a difference between page dimensions and a text bounding box can be calculated to determine page margin dimensions. Once the margin dimensions are known, standard image cropping or magnifying techniques can be used to adjust (e.g., trim or increase) the margins based on the margin dimensions to provide appropriate (e.g., additional or less) space for the content (306). The image content (e.g., text) can be rescaled to fill the space provided by the margin adjusting (308). In some implementations, the book page images with adjusted margins can be stored in an image repository (e.g., image repository 504) for future retrieval when a user requests a book page having a particular scale (310).
  • In some implementations, cropping rules are used to provide a uniform presentation of images in the viewport. For example, each book page image in a sequence of book page images can have a designated anchor point, such as the top left-hand corner of the book page image, which can be used to anchor the text in substantially the same location of the image. When the user navigates through a book page image sequence the presentation of the content in the viewport 102 will appear uniform. In some implementations, a template can be used to scale each image in a uniform manner. The template can be a page bounding box with standard dimensions (height, width). The dimensions of the template bounding box can be determined by processing an entire image sequence and determining a typical height and width of the text in the image sequence (e.g., a median height and width). If a given text is close to the template bounding box, than the template is used. Otherwise, the text is processed, as described in reference to FIG. 2.
  • TOC Creation Process
  • FIG. 4 is a flow diagram for an exemplary TOC creation process 400. In some implementations, a TOC is presented in the viewport 102 with hypertext links to other pages in a book page sequence.
  • The process 400 begins by retrieving a book page sequence for an image repository (402). The book page sequence is searched using, for example, an OCR engine, to identify which images contain a TOC. Various clues, attributes or heuristics can be used to determine whether an image includes a TOC. For example, an image can be determined to be a TOC if the image contains white space, text with large fonts (e.g., a large title), ellipses, roman numerals, italicized text, or any other attributes associated with TOCs. Some or all of these clues, attributes or heuristics can be combined into a score, which can be compared to a reference to determine whether a TOC has been found.
  • If a TOC is found (406), then the image is tagged (408) and hypertext links are created for one or more (e.g., each) of the TOC entries (410) and embedded in the TOC image. The TOC image, including the links, can then be presented in the viewport 102.
  • If the TOC is not found (406), the various clues, attributes and heuristics can be used to determine breaks in the book page sequence (412). For example, the first page of each chapter or section in a book can be identified as a break in the book page sequence. The breaks in content can then be used to create a TOC (414). For example, the first page of each chapter or section of a book can be the entries of the TOC. Chapter and/or section title names used in the book can be used for naming entry points in the created TOC, if available. Otherwise, names can be created for the TOC entry points, for example, “Section 1”, “Section 2”, . . . , “Section N”.
  • Once the TOC is determined, links can be created for the TOC entries, and the TOC, including the links, can be presented in the viewport 102, as described in reference to FIG. 6. In some implementations, rather than embedding links into a TOC, the first few sentences or paragraphs of each chapter or section of a book can be displayed in a panel (e.g., a side panel 612 in FIG. 6).
  • Viewport System Architecture
  • FIG. 5 is a block diagram of an exemplary viewport system architecture 500. Other architectures are possible, including architectures with more or fewer components. In some implementations, the architecture 500 includes one or more processors 502 (e.g., dual-core Intel® Xeon® Processors), an image repository 504, one or more network interfaces 506, an optional administrative computer 508 and one or more computer-readable mediums 510 (e.g., RAM, ROM, SDRAM, hard disk, optical disk, flash memory, SAN, etc.). These components can exchange communications and data over one or more communication channels 512 (e.g., Ethernet, Enterprise Service Bus, PCI, PCI-Express, etc.), which can include various known network devices (e.g., routers, hubs, gateways, buses) and utilize software (e.g., middleware) for facilitating the transfer of data and control signals between devices.
  • The term “computer-readable medium” refers to any medium that participates in providing instructions to a processor 502 for execution, including without limitation, non-volatile media (e.g., optical or magnetic disks), volatile media (e.g., memory) and transmission media. Transmission media includes, without limitation, coaxial cables, copper wire and fiber optics. Transmission media can also take the form of acoustic, light or radio frequency waves.
  • The computer-readable medium 510 further includes an operating system 514 (e.g., Mac OS® server, Windows® NT server), a network communication module 516 and viewport system 518. The operating system 514 can be multi-user, multiprocessing, multitasking, multithreading, real time, etc. The operating system 514 performs basic tasks, including but not limited to: recognizing input from and providing output to the administrator computer 508; keeping track and managing files and directories on computer-readable mediums 510 (e.g., memory or a storage device); controlling peripheral devices (e.g., repositories 504); and managing traffic on the one or more communication channels 512. The network communications module 516 includes various components for establishing and maintaining network connections (e.g., software for implementing communication protocols, such as TCP/IP, HTTP, etc.).
  • The viewport system 518 includes a web server 520, a scaling process 522, a margin adjusting process 524, a TOC creation process 526, a reference page creation process 528 and an OCR engine 530. These components are described in reference to FIGS. 1-4.
  • The architecture 500 is one example of a suitable architecture for hosting a viewport system. Other architectures are possible, which can include more or fewer components. For example, the image repository 504 and computer-readable medium 510 can be the same storage device or separate storage devices. The components of architecture 500 can be located in the same facility or distributed among several facilities. The architecture 500 can be implemented in a parallel processing or peer-to-peer infrastructure or on a single device with one or more processors. The viewport system 518 can include multiple software components or it can be a single body of code. Some or all of the functionality of the viewport system 518 can be provided as a service to clients over a network. In such a case, these entities may need to install client applications. Some or all of the functionality of the viewport system 518 can be provided as part of a search engine application.
  • Exemplary TOC with Hypertext Links
  • FIG. 6 is a screen shot illustrating an exemplary TOC 604 including links 610. In some implementations, the TOC 604 can be displayed on a book search engine web page 602 displayed in a web browser window 600. Controls 608 can be provided for navigating the pages of the book. In the example shown, the controls 608 include buttons for flipping pages and a search box for jumping the user directly to a desired page. Also, included on the web page 602 is a panel 612 (e.g., the side panel shown) including information and links related to the book, as described in reference to FIG. 1. The TOC 604, including the links 610, can be generated using the process 400 described in reference to FIG. 4.
  • In the example shown, the user search for the book “Huckleberry Finn” using the book search engine. After clicking on a link associated with Huckleberry Finn, a default book page image is displayed (e.g., a title page). Referring to FIG. 1, if a user clicks on the table of contents link, then an image of the TOC 604 will be displayed, including links 610. If the user clicks or otherwise interacts with a links 610, a book page image in a sequence of book page images responsive to the link will be displayed.
  • Exemplary Book Reference Page
  • FIG. 7 is a screen shot illustrating an exemplary book reference page 700. In some implementations, the reference page 700 includes a summary section 701, a contents section 702, a review section 704, a pages with images section 706 and a key words section 708. The book reference page 700 is one example of a book reference page. Other configurations and formats for a book reference page are possible.
  • The summary section 701 includes a thumbnail image of the book's cover and basic information, such as, for example, title, author, publisher, number of pages, ISBN number, language, physical dimensions, format (i.e., paperback, hardback, e-book), etc.
  • The contents section 702 includes links to various chapters or sections of the book, and can list keywords that can be found in those chapters or sections. When the user clicks a link, a viewport is presented which allows the user to navigate pages of the chapter or section of the book corresponding to the link using navigation controls (e.g., controls 116).
  • The review section 704 includes links to book reviews and other information about the book, including reviewer ratings.
  • The pages with images section 706 displays thumbnails of pages of the book that includes images. If the user clicks on the image, the page with the image corresponding to the clicked thumbnail will be displayed in a viewport. If the viewport is not already presented, the viewport will be invoked in response to the click on the thumbnail image.
  • The key words section 708 includes categories of keywords contained in the book. The keywords can be links that when clicked cause the book page or pages containing the keyword to be displayed a viewport. If the viewport is not already presented, the viewport will be invoked in response to the click on the keyword link.
  • The various information contained on the book reference page 700 can be gathered from the book, the World Wide Web and any other online resources.
  • Various modifications may be made to the disclosed implementations and still be within the scope of the following claims.

Claims (21)

1. (canceled)
2. A computer-implemented method comprising:
accessing an electronic book that includes a sequence of book page images, wherein at least one book page image includes text;
accessing a template that is generated by processing at least one book page image of the sequence of book page images, the processing at least one book page image of the sequence of book page images including determining a median height or a median width of text in the at least one book page image to determine the dimensions of the representative text bounding box of the template, wherein the template indicates dimensions of a representative text bounding box for the sequence of book page images;
determining, for at least one of one or more book page images of the sequence of book page images, whether the book page image has text that substantially fills the representative text bounding box, the determining whether the book page image has text that substantially fills the representative text bounding box including determining whether dimensions of the text are within prescribed thresholds of the median height or the median width;
for at least one of one or more of the book page images of the sequence of book page images that has text that substantially fills the representative text bounding box, scaling the book page image based at least on (i) dimensions of a user interface through which the book page image is displayed, and (ii) the dimensions of the representative text bounding box;
for at least one of one or more of the book page images of the sequence of book page images that has text that does not substantially fill the representative text bounding box, scaling the book page image based at least on (i) a minimum text height, or (ii) a maximum text width; and
providing one or more of the scaled book page images for display through the user interface.
3. The computer-implemented method of claim 2, further comprising determining an anchor point for positioning text within the at least one book page image of the sequence of book page images in substantially the same location in each book page image in the sequence of book page images.
4. The computer-implemented method of claim 2, further comprising changing the dimensions of the representative text bounding box based at least in part on changed dimensions of the user interface.
5. The computer-implemented method of claim 2, wherein the at least one book page image is a digital image of an actual book page.
6. The computer-implemented method of claim 2, wherein the user interface includes zoom controls to zoom the at least one book page.
7. The computer-implemented method of claim 6, wherein the zoom controls include at least one zoom stop.
8. The computer-implemented method of claim 7, wherein a zoom stop can include a zoom percentage that has been customized to prove a better user experiences for the at least one book image being zoomed.
9. The method of claim 1, wherein scaling the at least one book page image based at least on (i) a minimum text height, or (ii) a maximum text width, comprises:
determining that the dimensions of the at least one book page image match the dimensions of the user interface; and
in response to determining that the dimensions of the book page image match the dimensions of the user interface, scaling the book page image to be entirely displayed at once in the user interface.
10. A computer-implemented method comprising:
accessing an electronic book that includes a sequence of book page images, wherein at least one book page image includes text;
accessing a template that, indicates dimensions of a representative text bounding box for the sequence of book page images, the representative text bounding box having a height that corresponds to a median height of text in the sequence of book page images or a width that corresponds to a median width of text in the sequence of book page images;
determining, for at least one of one or more book page images of the sequence of book page images, whether the book page image has text that substantially fills the template by determining whether dimensions of the text are within prescribed thresholds of the median height or the median width;
for at least one of one or more of the book page images of the sequence of book page images that has text that substantially fills the template, scaling the book page image based at least on (i) dimensions of a user interface through which the book page image is displayed, and (ii) the dimensions of the template;
for at least one of one or more of the book page images of the sequence of book page images that has text that does not substantially fill the template, scaling the book page image based at least on (i) a minimum text height, or (ii) a maximum text width; and
providing one or more of the scaled book page images for display through the user interface.
11. The computer-implemented method of claim 10, further comprising determining an anchor point for positioning text within the at least one book page image of the sequence of book page images in substantially the same location in each book page image in the sequence of book page images.
12. The computer-implemented method of claim 10, further comprising changing the dimensions of the representative text bounding box based at least in part on changed dimensions of the user interface.
13. The computer-implemented method of claim 10, wherein the at least one book page image is a digital image of an actual book page.
14. The computer-implemented method of claim 10, wherein the user interface includes zoom controls to zoom the at least one book page.
15. The computer-implemented method of claim 14, wherein the zoom controls include at least one zoom stop.
16. The computer-implemented method of claim 15, wherein a zoom stop can include a zoom percentage that has been customized to provide a better user experience for the at least one book image being zoomed.
17. The computer-implemented method of claim 10, wherein scaling the at least one book page image based at least on (i) a minimum text height, or (ii) a maximum text width, comprises:
determining that the dimensions of the at least one book page image match the dimensions of the user interface; and
in response to determining that the dimensions of the book page image match the dimensions of the user interface, scaling the book page to be entirely displayed at once in the user interface.
18. A computer-implemented method comprising:
accessing an electronic book that includes a sequence of book page images, wherein at least one book page image includes text;
determining, for at least one of one or more book page images of the sequence of book page images, whether dimensions of the book page image text are within prescribed thresholds of a median height or a median width of the text in the sequence of book page images;
for at least one of one or more of the book page images of the sequence of book page images that has dimensions that are within prescribed thresholds of the median height or median width of the text in the sequence of book page images, scaling the book page image based at least on (i) the dimensions of the display area in the user interface and (ii) the median height or median width of the text in the sequences of book page images;
for at least one of one or more of the book page images of the sequence of book page images that does not have dimensions that are within prescribed thresholds of the median height or median width of the text in the sequence of book page images, scaling the book page image based at least on (i) a minimum text height, or (ii) a maximum text width; and
providing one or more of the scaled book page images for display through the display area in the user interface.
19. The computer-implemented method of claim 18, wherein the at least one book page image is a digital image of an actual book page.
20. The computer-implemented method of claim 18, wherein the user interface includes zoom controls to zoom the at least one book page.
21. The computer-implemented method of claim 20, wherein the zoom controls include at least one zoom stop.
US15/908,668 2006-10-04 2018-02-28 Adjusting margins in book page images Abandoned US20180189929A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/908,668 US20180189929A1 (en) 2006-10-04 2018-02-28 Adjusting margins in book page images

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US11/543,722 US8782551B1 (en) 2006-10-04 2006-10-04 Adjusting margins in book page images
US201414284625A 2014-05-22 2014-05-22
US15/908,668 US20180189929A1 (en) 2006-10-04 2018-02-28 Adjusting margins in book page images

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US201414284625A Continuation 2006-10-04 2014-05-22

Publications (1)

Publication Number Publication Date
US20180189929A1 true US20180189929A1 (en) 2018-07-05

Family

ID=51156631

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/543,722 Active 2028-05-08 US8782551B1 (en) 2006-10-04 2006-10-04 Adjusting margins in book page images
US15/908,668 Abandoned US20180189929A1 (en) 2006-10-04 2018-02-28 Adjusting margins in book page images

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US11/543,722 Active 2028-05-08 US8782551B1 (en) 2006-10-04 2006-10-04 Adjusting margins in book page images

Country Status (1)

Country Link
US (2) US8782551B1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5596914B2 (en) * 2008-09-16 2014-09-24 富士通株式会社 Terminal device, display control method, and program having display function
US9251123B2 (en) * 2010-11-29 2016-02-02 Hewlett-Packard Development Company, L.P. Systems and methods for converting a PDF file
US20130145252A1 (en) * 2011-12-02 2013-06-06 Opera Software Asa Page based navigation and presentation of web content
US9373155B2 (en) * 2012-08-17 2016-06-21 Google Inc. Search results with structured image sizes
US20150103092A1 (en) * 2013-10-16 2015-04-16 Microsoft Corporation Continuous Image Optimization for Responsive Pages
US10437918B1 (en) * 2015-10-07 2019-10-08 Google Llc Progressive image rendering using pan and zoom

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030048294A1 (en) * 2001-09-07 2003-03-13 Switchboard Incorporated System and method for the creation of interactive display ads
US20030204816A1 (en) * 2002-04-25 2003-10-30 Simard Patrice Y. Layout analysis
US20030208502A1 (en) * 2002-05-03 2003-11-06 Xiaofan Lin Method for determining a logical structure of a document
US20040164975A1 (en) * 2002-09-13 2004-08-26 E-Book Systems Pte Ltd Method, system, apparatus, and computer program product for controlling and browsing a virtual book
US20050062876A1 (en) * 2003-06-26 2005-03-24 Kyocera Corporation Imaging apparatus
US20070085845A1 (en) * 2005-10-13 2007-04-19 Pioneer Corporation Display control apparatus, display method, and computer product

Family Cites Families (88)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4484826A (en) * 1981-09-24 1984-11-27 International Business Machines Corporation Automatic intertext column spacing
US5021974A (en) * 1988-09-13 1991-06-04 Microsoft Corporation Method for updating a display bitmap with a character string or the like
EP0439087B1 (en) * 1990-01-25 1996-12-11 Radius Inc. Method for resizing and moving computer display windows
CA2096374C (en) * 1992-05-18 2006-08-08 Michael A. Sandifer Computer aided maintenance and repair information system for equipment subject to regulatory compliance
US7401286B1 (en) 1993-12-02 2008-07-15 Discovery Communications, Inc. Electronic book electronic links
US5463725A (en) * 1992-12-31 1995-10-31 International Business Machines Corp. Data processing system graphical user interface which emulates printed material
US5848184A (en) * 1993-03-15 1998-12-08 Unisys Corporation Document page analyzer and method
US7861166B1 (en) * 1993-12-02 2010-12-28 Discovery Patent Holding, Llc Resizing document pages to fit available hardware screens
US5613017A (en) 1994-09-29 1997-03-18 Kabushiki Kaisha Toshiba Apparatus for processing image data among media having different image output sizes
US5748931A (en) * 1994-10-24 1998-05-05 Infosis Group Ltd. Information display system for simultaneously displaying graphical images and text of a publication
US5729673A (en) * 1995-04-07 1998-03-17 Avid Technology, Inc. Direct manipulation of two-dimensional moving picture streams in three-dimensional space
US5754873A (en) * 1995-06-01 1998-05-19 Adobe Systems, Inc. Method and apparatus for scaling a selected block of text to a preferred absolute text height and scaling the remainder of the text proportionately
US5794257A (en) 1995-07-14 1998-08-11 Siemens Corporate Research, Inc. Automatic hyperlinking on multimedia by compiling link specifications
US6112201A (en) * 1995-08-29 2000-08-29 Oracle Corporation Virtual bookshelf
US6486895B1 (en) * 1995-09-08 2002-11-26 Xerox Corporation Display system for displaying lists of linked documents
AU7330396A (en) 1995-10-23 1997-05-29 Hypermed Ltd. Structured focused hypertext data structure
US6366933B1 (en) 1995-10-27 2002-04-02 At&T Corp. Method and apparatus for tracking and viewing changes on the web
US5761686A (en) * 1996-06-27 1998-06-02 Xerox Corporation Embedding encoded information in an iconic version of a text image
US5751283A (en) 1996-07-17 1998-05-12 Microsoft Corporation Resizing a window and an object on a display screen
US6091930A (en) * 1997-03-04 2000-07-18 Case Western Reserve University Customizable interactive textbook
JP3478725B2 (en) 1997-07-25 2003-12-15 株式会社リコー Document information management system
US5957697A (en) * 1997-08-20 1999-09-28 Ithaca Media Corporation Printed book augmented with an electronic virtual book and associated electronic data
WO1999022314A1 (en) * 1997-10-29 1999-05-06 Sharp Kabushiki Kaisha Display control device and reproduction display device for electronic books
US7047490B1 (en) * 1997-11-26 2006-05-16 Adobe Systems Incorporated Displaying the appearance of a printed and assembled document
US8479122B2 (en) * 2004-07-30 2013-07-02 Apple Inc. Gestures for touch sensitive input devices
US6732111B2 (en) 1998-03-03 2004-05-04 Siebel Systems, Inc. Method, apparatus, system, and program product for attaching files and other objects to a partially replicated database
US6377704B1 (en) * 1998-04-30 2002-04-23 Xerox Corporation Method for inset detection in document layout analysis
US6584479B2 (en) * 1998-06-17 2003-06-24 Xerox Corporation Overlay presentation of textual and graphical annotations
US6769096B1 (en) 1998-06-24 2004-07-27 Microsoft Corporation System and method for updating a table of contents in a frameset
US6456732B1 (en) 1998-09-11 2002-09-24 Hewlett-Packard Company Automatic rotation, cropping and scaling of images for printing
US6289512B1 (en) 1998-12-03 2001-09-11 International Business Machines Corporation Automatic program installation
WO2000068831A2 (en) 1999-05-07 2000-11-16 Argo Interactive Limited Graphical data within documents
US6934707B1 (en) * 1999-07-22 2005-08-23 International Business Machines Corporation Network transmission of pages in linkable markup language to receiving display stations with currently displayed pages controlled by tags in succeeding pages to produce aesthetically pleasing transitions between pages
US6820111B1 (en) * 1999-12-07 2004-11-16 Microsoft Corporation Computer user interface architecture that saves a user's non-linear navigation history and intelligently maintains that history
US6992687B1 (en) * 1999-12-07 2006-01-31 Microsoft Corporation Bookmarking and placemarking a displayed document in a computer system
US20020075504A1 (en) 1999-12-15 2002-06-20 Sergio Fernandez Method and apparatus for automatically indexing a document with tabbed sheets
JP2001195412A (en) * 2000-01-12 2001-07-19 Hitachi Ltd Electronic book system and method for displaying its contents
KR100319756B1 (en) 2000-01-21 2002-01-09 오길록 Method for analyzing structure of treatise typed of document image
US6470094B1 (en) * 2000-03-14 2002-10-22 Intel Corporation Generalized text localization in images
WO2001082279A2 (en) 2000-04-24 2001-11-01 The Trustees Of Columbia University In The City Of New York System and method for dynamic space management of a display space
US8055994B1 (en) * 2000-05-26 2011-11-08 Libredigital, Inc. Method, system and computer program product for displaying a version of a paper
US7259753B2 (en) * 2000-06-21 2007-08-21 Microsoft Corporation Classifying, anchoring, and transforming ink
CA2323569A1 (en) * 2000-10-18 2002-04-18 Advanced Numerical Methods Ltd. Elastic presentation space
US6704733B2 (en) * 2000-10-25 2004-03-09 Lightning Source, Inc. Distributing electronic books over a computer network
US20020083096A1 (en) 2000-12-18 2002-06-27 Hsu Liang Hua System and method for generating structured documents and files for network delivery
US7240291B2 (en) * 2000-12-21 2007-07-03 Xerox Corporation Methods, systems, and computer program products for display of information relating to a virtual three-dimensional book
US7356760B2 (en) * 2001-02-15 2008-04-08 Nbor Corporation System and method for editing an electronic document of text and graphic objects
EP1393189A4 (en) 2001-05-02 2007-06-13 Bitstream Inc Methods, systems, and programming for displaying media scaled-down by a variable scale factor
US7512879B2 (en) * 2001-05-11 2009-03-31 Microsoft Corporation Intelligent virtual paging paradigm
US7020663B2 (en) * 2001-05-30 2006-03-28 George M. Hay System and method for the delivery of electronic books
US20020182578A1 (en) * 2001-06-01 2002-12-05 Rachman Bruce A. Online course support method and system
US20030042319A1 (en) 2001-08-31 2003-03-06 Xerox Corporation Automatic and semi-automatic index generation for raster documents
US7071915B2 (en) * 2001-09-13 2006-07-04 E-Book Systems Pte Ltd. Method for displaying flipping pages via electromechanical information browsing device
US6907576B2 (en) 2002-03-04 2005-06-14 Microsoft Corporation Legibility of selected content
MXPA04011507A (en) * 2002-05-20 2005-09-30 Tata Infotech Ltd Document structure identifier.
DE10225316A1 (en) 2002-06-06 2003-12-18 Philips Intellectual Property User interface display optimization method in which display window sizes or objects are optimized according to the their content, available space and selected preference rules
AU2003270522A1 (en) * 2002-09-10 2004-04-30 Kirtas Technologies, Inc. Automated page turning apparatus to assist in viewing pages of a document
US7454707B2 (en) * 2002-09-30 2008-11-18 Canon Kabushiki Kaisha Image editing method, image editing apparatus, program for implementing image editing method, and recording medium recording program
US7271806B2 (en) * 2002-12-18 2007-09-18 Microsoft Corporation International automatic line height system and method
US20040155833A1 (en) * 2003-02-07 2004-08-12 Fuji Xerox Co., Ltd. Display control device, computer, image display device, and image display system
US20040225658A1 (en) * 2003-02-13 2004-11-11 Felix Horber Network-based document management systems
US7712034B2 (en) 2003-03-24 2010-05-04 Microsoft Corporation System and method for shell browser
US7391885B2 (en) 2003-07-30 2008-06-24 Xerox Corporation Method for determining overall effectiveness of a document
US20050039138A1 (en) 2003-08-13 2005-02-17 Aaron Urbina Method and system for displaying comic books and graphic novels on all sizes of electronic display screens.
US7548334B2 (en) * 2003-10-15 2009-06-16 Canon Kabushiki Kaisha User interface for creation and editing of variable data documents
WO2005050371A2 (en) 2003-11-13 2005-06-02 Knowledgeworks A system for obtaining, managing and providing retrieved content
US7360168B2 (en) 2004-02-12 2008-04-15 International Business Machines Corporation Automatically scaling the information and controls in navigation tabs per available window area
US20050193330A1 (en) 2004-02-27 2005-09-01 Exit 33 Education, Inc. Methods and systems for eBook storage and presentation
US20050237321A1 (en) * 2004-03-31 2005-10-27 Young Kenneth L Grid canvas
GB0416038D0 (en) 2004-07-16 2004-08-18 Portland Press Ltd Document display system
US7487190B2 (en) 2004-08-27 2009-02-03 Microsoft Corporation Automated identification and marking of new and changed content in a structured document
AU2004231206A1 (en) 2004-11-19 2006-06-08 Canon Kabushiki Kaisha Displaying a plurality of images in a stack arrangement
KR100703690B1 (en) * 2004-11-19 2007-04-05 삼성전자주식회사 User interface and method for managing icon by grouping using skin image
US8255796B1 (en) * 2005-01-09 2012-08-28 Apple Inc. Efficient creation of documents
US8706475B2 (en) 2005-01-10 2014-04-22 Xerox Corporation Method and apparatus for detecting a table of contents and reference determination
US8245131B2 (en) * 2005-02-10 2012-08-14 Hewlett-Packard Development Company, L.P. Constraining layout variations for accommodating variable content in electronic documents
CN100369049C (en) * 2005-02-18 2008-02-13 富士通株式会社 Precise dividing device and method for grayscale character
US20070117079A1 (en) 2005-06-02 2007-05-24 Robert Budlow System and method for media delivery
US7552386B2 (en) * 2005-06-10 2009-06-23 Microsoft Corporation Methods and systems for treating overflow conditions and for re-sizing printable content
US20070094591A1 (en) 2005-10-24 2007-04-26 Etgen Michael P System and method for text legibility enhancement
US7673019B2 (en) 2005-11-04 2010-03-02 Palo Alto Research Center Incorporated System and method for determining a quantitative measure of qualitative usability of related Web pages
KR100664311B1 (en) 2005-11-18 2007-01-04 삼성전자주식회사 Image forming apparatus for automatically forming index and the automatically index forming method thereof
US8650482B2 (en) * 2005-12-14 2014-02-11 Microsoft Corporation Dynamic positioning and aligning tabs relative to margins indent and column width
US20070171459A1 (en) * 2006-01-20 2007-07-26 Dawson Christopher J Method and system to allow printing compression of documents
US7743327B2 (en) 2006-02-23 2010-06-22 Xerox Corporation Table of contents extraction with improved robustness
US20080082911A1 (en) * 2006-10-03 2008-04-03 Adobe Systems Incorporated Environment-Constrained Dynamic Page Layout
US7912829B1 (en) 2006-10-04 2011-03-22 Google Inc. Content reference page
US7979785B1 (en) 2006-10-04 2011-07-12 Google Inc. Recognizing table of contents in an image sequence

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030048294A1 (en) * 2001-09-07 2003-03-13 Switchboard Incorporated System and method for the creation of interactive display ads
US20030204816A1 (en) * 2002-04-25 2003-10-30 Simard Patrice Y. Layout analysis
US20030208502A1 (en) * 2002-05-03 2003-11-06 Xiaofan Lin Method for determining a logical structure of a document
US20040164975A1 (en) * 2002-09-13 2004-08-26 E-Book Systems Pte Ltd Method, system, apparatus, and computer program product for controlling and browsing a virtual book
US20050062876A1 (en) * 2003-06-26 2005-03-24 Kyocera Corporation Imaging apparatus
US20070085845A1 (en) * 2005-10-13 2007-04-19 Pioneer Corporation Display control apparatus, display method, and computer product

Also Published As

Publication number Publication date
US8782551B1 (en) 2014-07-15

Similar Documents

Publication Publication Date Title
US7908284B1 (en) Content reference page
US7979785B1 (en) Recognizing table of contents in an image sequence
US20180189929A1 (en) Adjusting margins in book page images
JP6095596B2 (en) Rendering the visual column of the document with supplemental information content
Lam et al. Summary thumbnails: readable overviews for small screen web browsers
US8966361B2 (en) Providing summary view of documents
JP4814575B2 (en) System and method for displaying content on a small screen computing device
US8739073B2 (en) User interface for document table of contents
US6271840B1 (en) Graphical search engine visual index
US20060288280A1 (en) User-defined changing of page representations
US8683374B2 (en) Displaying a user's default activities in a new tab page
US8312388B2 (en) Information processing apparatus, information processing method and computer readable medium
US8775928B2 (en) Layout-based page capture
US20090313574A1 (en) Mobile document viewer
US20090183077A1 (en) Creating and Viewing Preview Objects
US20080092051A1 (en) Method of dynamically creating real time presentations responsive to search expression
US20110161308A1 (en) Evaluating preferences of content on a webpage
US20080301555A1 (en) System and method for providing animated browser thumbnails
JP2008234658A (en) Course-to-fine navigation through whole paginated documents retrieved by text search engine
US9286309B2 (en) Representation of last viewed or last modified portion of a document
US20060107205A1 (en) Determining a main content area of a page
US7861186B2 (en) Systems and methods for navigating page-oriented information assets
JP2008226110A (en) Information processor, information processing method and control program
US11681857B2 (en) Method and device for rendering text with combined typographical attributes for emphases to a computer display
US20080120549A1 (en) System and method for displaying numbered descriptions

Legal Events

Date Code Title Description
AS Assignment

Owner name: GOOGLE INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BARTELMA, JEFFREY;VEMULA, GOPAL VENU;REEL/FRAME:045082/0850

Effective date: 20071023

Owner name: GOOGLE LLC, CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:GOOGLE INC.;REEL/FRAME:045484/0256

Effective date: 20170929

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION