US20150100924A1 - Folding and unfolding images in a user interface - Google Patents
Folding and unfolding images in a user interface Download PDFInfo
- Publication number
- US20150100924A1 US20150100924A1 US14/569,475 US201414569475A US2015100924A1 US 20150100924 A1 US20150100924 A1 US 20150100924A1 US 201414569475 A US201414569475 A US 201414569475A US 2015100924 A1 US2015100924 A1 US 2015100924A1
- Authority
- US
- United States
- Prior art keywords
- image
- user interface
- presented
- video
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0485—Scrolling or panning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/12—Use of codes for handling textual entities
- G06F40/137—Hierarchical processing, e.g. outlines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
- G06F8/34—Graphical or visual programming
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/50—Lighting effects
- G06T15/60—Shadow generation
-
- H04L67/18—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/52—Network services specially adapted for the location of the user terminal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
Definitions
- This disclosure generally relates to presenting multimedia objects, such as images or videos, in a user interface.
- a user interface in the industrial design field of human-machine interaction, is the space where interactions between humans and machines occur.
- the goal of interactions between a human, often referred to as a “user”, and a machine at the user interface is user's control of the machine and its operations (e.g., through user input) and machine feedback (e.g., through program output).
- GUI graphical user interface
- a graphical user interface is a type of user interface that allows users to interact with software applications executing on electronic or computing devices through multimedia objects (e.g., images, videos, audios, etc.) rather than purely text commands.
- FIG. 1 illustrates a portion of an example object hierarchy.
- FIGS. 2A-2D illustrate example modes for presenting a video object in a user interface.
- FIGS. 3A-3C illustrate example modes for presenting an image object in a user interface.
- FIG. 4 illustrates an example map associated with a geo-tag attached to an image.
- FIGS. 5A-5D illustrate an example transition of an image between two presentation modes.
- FIGS. 6A-6G illustrate example user manipulations of folded images.
- FIG. 7 illustrates rotating a floating image
- FIGS. 8A-8B illustrate simulating an object being picked up in a three-dimensional virtual space.
- FIG. 9 illustrates an example method that enables a user to manipulate an image or a video.
- FIG. 10 illustrates an example electronic device.
- a user interface and more specifically, a graphical user interface (GUI) may include any number of UI components or elements arranged in a hierarchy.
- the components of a user interface may be presented to users according to the hierarchical structure.
- some of these UI components may correspond to or represent multimedia objects, such as images, videos, or audios.
- these multimedia UI components may be presented to users individually on their own. Other times, they may be presented to users while contained in other UI components, such as being included in a window, a panel, or a web page.
- a user may interact with a multimedia UI component using a suitable input device (e.g., a finger or stylus on a touch-sensitive screen or a mouse). For example, the user may play or pause a video, or zoom or pan or rotate an image.
- a suitable input device e.g., a finger or stylus on a touch-sensitive screen or a mouse.
- the user may play or pause a video, or zoom or pan or rotate an image.
- the user's interaction with the multimedia UI component may result in different behaviors from the multimedia UI component.
- objects may be organized into a hierarchy.
- objects may be organized into a hierarchy based on how the individual objects are related to each other.
- the object hierarchy may have any number of levels, and at each level, there may be any number of objects.
- Parent-child or sibling relationships may exist between specific objects in the hierarchy.
- a parent object is one level above the level of its child objects.
- Two sibling objects are at the same level and share the same parent object.
- any portion of the hierarchy may also be considered a hierarchy in itself.
- FIG. 1 illustrates a portion of an example object hierarchy 100 that includes a number of objects 110 .
- an object in a hierarchy may or may not have a parent. If an object does not have a parent, it may be referred to as a “root” object (e.g., object 110 A).
- an object in a hierarchy may or may not have any children. If an object does not have any children, it may be referred to as a “leaf” or “terminal” object (e.g., object 110 B). If an object does have children (e.g., object 110 C), it may have any number of children.
- objects sharing the same parent may be referred to as each other's “siblings”. For example, in FIG.
- object 110 C is the parent of objects 110 D and 110 B.
- Objects 110 D and 110 B are the children of object 110 C and are siblings to each other.
- a hierarchy of objects e.g., object hierarchy 100 ) not only includes the individual objects themselves but also indicates the relationships among the specific objects. Moreover, the position of a specific object within the hierarchy may indicate its relationships with other objects in the hierarchy.
- an object may be a component of a user interface.
- the object hierarchy may be a UI hierarchy (e.g., a hierarchy of UI components).
- components of a user interface may be organized into a hierarchy.
- the UI hierarchy may have any number of layers corresponding to the levels of the object hierarchy, and at each layer, there may be any number of UI components.
- the position of a specific UI component within the hierarchy may indicate its relationships with other UI components in the hierarchy.
- the UI components may be presented to users according to the hierarchical structure (e.g., in layers). In particular embodiments, some of these UI components may be multimedia objects, such as images, videos, or audios.
- an object may correspond to a piece of user-consumable content.
- an object may be consumed by a user if the user may, for example and without limitation, interact with, view, read, listen to, manipulate, or handle the object.
- some user-consumable objects may be texts, images, videos, audios, feeds, executables (e.g., application programs or games), websites, web pages, digital books, photo albums, posts, or messages.
- user-consumable content, or more specifically, user-consumable objects may be organized into a hierarchy based on, for example, the relationships among the individual pieces of user-consumable content.
- a hierarchy of user-consumable content may be represented as a hierarchy of objects, where individual objects in the hierarchy may correspond to specific pieces of user-consumable content (e.g., texts, images, videos, audios, executables, etc.).
- the structure of the hierarchy indicates the relationships among the specific pieces of user-consumable content.
- the relationships among the objects in a hierarchy may correspond to how the objects are organized and presented to users.
- the objects when presenting a hierarchy of objects to a user of a device, the objects may be organized and presented according to the structure of the object hierarchy. More specifically, the objects may be presented in a user interface provided on the device according to the structure of the object hierarchy so that the user interface itself becomes hierarchical as well. Consequently, the user interface may include a number of layers, respectively corresponding to the levels in the object hierarchy. The positions of the objects within the hierarchy are preserved in the user interface, such that a specific object at a specific position in the hierarchy is presented in the corresponding position in the user interface. The relationships among the objects within the hierarchy are maintained in the user interface. In other words, there may be an one-to-one correspondence between an object in the object hierarchy and a UI component in the user interface, such that each object is represented by a UI component.
- the desktop may be a parent object, and sometimes the root object of a hierarchy, whose child objects are the individual software applications available on the desktop.
- a software application while itself being one of the child objects of the desktop, is also the parent object of the individual components of that software application.
- Different software applications may include different components.
- a software application that manages digital books e.g., a book reader application
- its components may include the digital books available, the individual chapters of each book, the pages of each chapter, and the texts, images, videos, audios, or any graphical user interface (GUI) or content or media elements on each page.
- GUI graphical user interface
- the book application may be the parent object of the digital books.
- a digital book may be the parent object of the individual chapters of that book.
- a chapter while itself being one of the child objects of the book, is also the parent object of the pages in that chapter.
- a page is the parent object of the texts, images, videos, audios, or any GUI or content or media elements on that page.
- a text block, image, video, audio, or GUI or content or media element is one of the child objects of the page to which it belongs.
- its components may include the individual news channels and the news stories within each channel. Each of these may correspond to an object.
- the news-feed application while itself being one of the child objects of the desktop, is also the parent object of the news channels.
- a news channel in turn is the parent object of the news stories included in that channel.
- the Internet may be a parent object whose child objects are the individual websites.
- a website while itself being one of the child objects of the Internet, is also the parent object of the individual web pages of that website.
- Each text block, image, video, audio, or link may also correspond to a specific object in the hierarchy.
- Some of these objects may respectively correspond to UI components of a web-based user interface that may be presented to a user through a web browser.
- a website such as a social-networking website
- the social-networking website may be a parent object whose child objects are the components (e.g., photo albums, user profile pages, etc.) of the website.
- a photo album while itself being a child object of the social-networking website, may in turn be a parent object, and the individual photos within the album may be the child objects of the photo album.
- a user's profile page may be structured in such a hierarchical fashion as well. The profile page itself may be considered a parent object, and the individual objects on the profile page may be the child objects of the profile page.
- a profile page may be considered and rendered (e.g., for presentation to a user) as a linear timeline of objects, such as, for example and without limitation, photos, photo albums, check-ins, comments from other users, attended events, tags, etc.
- child objects in the hierarchy may also include applications the user has added to the profile page, such as a Spotify music sharing application.
- individual stories, songs the user has listened to, and playlists may be child objects at a lower hierarchical level.
- child objects in the hierarchy may include particular sections of a user's profile, such as the user's education and employment information, or the public “wall” of the user's profile page.
- This disclosure contemplates representing and addressing any collection of content in a hierarchical object or nodal structure. Again, these objects may respectively correspond to UI components of a web-based user interface that may be presented to a user through a web browser.
- an object may be of any type and this disclosure contemplates any applicable types of objects.
- the term “object” may refer to any type of content, including but not limited to images, videos, captions, text blocks or boxes, user interface elements, URLs, newsfeed stories, references to other objects, advertisements, calendar events, units for displaying open graph analysis that may be graphically rendered, applications, websites, web pages, books, chapters.
- the hierarchical relationships e.g., parent-child or sibling relationships, positions of the objects within the hierarchy
- the hierarchical relationships e.g., parent-child or sibling relationships, positions of the objects within the hierarchy
- an object in a hierarchy may be a video, which may be presented to a user for viewing. Consequently, there may be a video component in a user interface corresponding to the video object.
- there may be several modes for presenting a video object in a user interface and this disclosure contemplates any applicable presentation modes for presenting video objects.
- the video object may be presented to a user in any one of these available modes.
- a video object may be presented in a user interface in an index mode (also referred to as table-of-content (TOC) mode), as illustrated in FIG. 2A .
- a video object may be included in an index of user-consumable content or in a table of content, and the index mode may be suitable for presenting the video object in such a situation.
- a digital book may include a number of chapters; each chapter may include a number of pages; and each page may include a number of text blocks, images, videos, etc.
- These objects e.g., book, chapter, page, text block, image, video, etc.
- a specific page 213 includes a video 215 .
- Video 215 may be presented in TOC 211 , as a part of page 213 , in the index mode.
- Video 215 may be shown in a thumbnail (i.e., small) size, in proportion to the sizes of page 213 and TOC 211 .
- a social-networking website may include a number of user accounts; each user account may include a number of media folders or albums (among other items); and each media folder may include a number of videos or images.
- these objects may be organized in a hierarchy.
- the videos in that folder may be presented in an index of video objects so that a user may browse through these videos and perhaps select a specific video for playback.
- each video object may be presented in the index mode.
- a video object may be presented in a user interface in an on-page mode, as illustrated in FIG. 2B .
- a video object may be included in another UI component (e.g., a web page, a page of a book, etc.).
- the video object may be presented as a part of this other UI component.
- the on-page mode may be suitable for presenting the video object in such a situation.
- FIG. 2B suppose that a page 223 of a digital book includes a video 225 . When page 223 is presented, video 225 is presented as a part of page 223 , in the on-page mode, together with other content of page 223 .
- Video 225 may be shown in a size that is appropriate or in proportion to the size of page 223 (e.g., half or a quarter of the size of page 223 ).
- a web page may include a video object.
- the video object may be presented in the web page and as a part of the web page in the on-page mode, together with other content of the web page.
- a video object may be presented in a user interface in a full-screen mode, as illustrated in FIG. 2C .
- a video object may be presented by itself.
- the full-screen mode may be suitable for presenting the video object in such a situation.
- a video 235 is presented in the full-screen mode where it may be the only or the main UI component displayed on the screen of a device and may occupy substantially the entire display area of the screen (e.g., greater than 90% of the display area of the screen or 100% of the display area of the screen).
- a user may interact with a video object presented in any of the available modes, and in particular embodiments, depending on which mode the video object is in, the user's interaction with the video object may result in different behavioral responses. In some cases, the user's interaction with the video object in one presentation mode may cause the video object to automatically transition to another presentation mode.
- a playback control icon or buttons associated with a video object e.g., icon 217 in FIG. 2A , icon 227 in FIG. 2B , icon 237 in FIG. 2C .
- a user may tap on these control icons to cause the video to start or pause playing.
- a pause icon e.g., icon 237 in FIG. 2C
- the user may tap on the pause icon to cause the video to pause playing.
- a play icon e.g., icon 227 in FIG. 2B
- the user may tap on the play icon to cause the video to start or resume playing.
- the user may start or stop playback of the video at any time.
- the user may single tap any part of video 215 or pinch open video 215 (e.g., using two fingers on a touch-sensitive screen), which may cause the video object to transition to the on-page mode, such as video 225 in FIG. 2B .
- the on-page mode such as video 225 in FIG. 2B
- the user may single tap any part of video 225 or pinch open video 225 , which may cause the video object to transition to the full-screen mode, such as video 235 in FIG. 2C .
- a video object is presented in the full-screen mode, such as video 235 in FIG. 2C
- the user may double tap any part of video 235 or pinch close video 235 (e.g., using two fingers on a touch-sensitive screen), which may cause the video object to transition to the on-page mode, such as video 225 in FIG. 2B .
- the on-page mode such as video 225 in FIG. 2B
- the user may double tap any part of video 225 or pinch close video 225 , which may cause the video object to transition to the index mode, such as video 215 in FIG. 2A .
- the playback status of the video is unaffected. That is, if the video is being played while the mode transition occurs, the video continues to play, until either the user stops the playback or the video ends. On the other hand, if the video is paused while the mode transition occurs, the video continues to pause. The user may pause or resume playback of the video using, for example, the appropriate control icon.
- an object e.g., image, video
- the object is being manipulated by a user (e.g., picked up, rotated, zoomed in or out, etc.)
- the object itself is manipulated.
- This ensures the self-consistency of the user interface.
- the user may manipulate the video object (e.g., pinched down to the index mode or pinched up to the full-screen mode). While the video object is being manipulated by the user, the playback of the video continues uninterrupted.
- the video may automatically transition to the full-screen mode (e.g., video 235 in FIG. 2C ) and the control icon may fade away.
- the index mode e.g., video 215 in FIG. 2A
- the on-page mode e.g., video 225 in FIG. 2B
- the video may automatically transition to the full-screen mode (e.g., video 235 in FIG. 2C ) and the control icon may fade away.
- the video may automatically transition back to the index mode or the on-page mode (i.e., the original mode in which the video had been presented when the user had caused the video to transition to the full-screen mode by starting the playback).
- the display size for the visual portion of the video may change accordingly. For example, when transitioning from the index mode to the on-page mode, the size of the video images (i.e., the visual portion of the video) may increase appropriately. Similarly, when transitioning from the on-page mode to the full-screen mode, the size of the video images may increase to occupy the entire display area of the screen. Conversely, when transitioning from the full-screen mode to the on-page mode or from the on-page mode to the index mode, the size of the video images may decrease appropriately. In other words, there may be a suitable size for presenting the visual portion of a video object in each specific mode, and while the video object is presented in a specific mode, its visual portion is presented in the corresponding size for that mode.
- the volume level for the audio portion of the video may change accordingly.
- there may be a suitable volume level for presenting the audio portion of a video object in each specific mode and while the video object is presented in a specific mode, its audio is presented in the corresponding volume level for that mode.
- the audio of the video object may be presented in a lower volume level so that it does not create much disturbance.
- the audio of the video object may be presented in a volume level that is somewhat higher (e.g., louder) than that of the index mode.
- the audio of the video object may be presented in a volume level that is somewhat higher (e.g., louder) than that of the on-page mode (e.g., a higher volume level). While in each presentation mode, the user may manually adjust (e.g., increase or decrease) the volume level of the audio of the video object to override the default volume level for that mode as desired.
- the user while in the index mode (e.g., video 215 in FIG. 2A ), if a video is being played, the user may not be able to stop the playback directly in the index mode. Instead, the user needs to transition to the on-page mode (e.g., video 225 in FIG. 2B ) first and then uses the pause icon to pause or stop the playback of the video.
- the on-page mode e.g., video 225 in FIG. 2B
- a video object may “float” on top of the UI component containing that video object.
- video 225 floats on top of page 223 , and this floating status is visually indicated by showing a small portion (e.g., the top edge) of video 225 slightly outside the boundary of page 223 .
- the components of a user interface may be presented according to a hierarchical structure.
- page 223 may be the parent object of video 225 .
- page 223 may be at one layer beneath the layer of video 225 in the user interface.
- Page 223 and video 225 are two separate UI components corresponding to two objects.
- a floating video object indicates that a user may interact with that video object.
- the on-page mode e.g., video 225 in FIG. 2B
- the current position of the video may be recorded. If the user comes back to the UI component (e.g., the page) containing the video object at a later time, the video may resume playback from the position where the user has left it.
- the playback control icon (e.g., icon 237 in FIG. 2C ) associated with a video may disappear after it has not been used for a while (e.g., a few seconds) or if the user taps on the video. Only the video itself is presented on the screen, as illustrated in FIG. 2D , so that the user may watch the video undisturbed.
- the user may bring back the control icon by single tapping the video in the full-screen mode (e.g., video 235 in FIG. 2D ) in order to pause or resume playback of the video.
- single tapping on the video may cause the playback control icon associated with the video to appear or disappear.
- a time indicator e.g., slider icon 239 in FIG. 2C
- the video indicating how much time has elapsed in the video as well as enabling the user to jump to different positions in the video (e.g., be selecting a specific position along slider icon 239 ).
- the audio portion of the video object may fade out, instead of, for example, stopping abruptly.
- an object in a hierarchy may be an image, which may be presented to a user for viewing. Consequently, there may be an image component in a user interface corresponding to the image object.
- there may be several modes for presenting an image object in a user interface and this disclosure contemplates any applicable presentation modes for presenting image objects.
- the image object may be presented to a user in any one of these available modes.
- an image object may be presented in a user interface in an index mode (also referred to as table-of-content (TOC) mode), as illustrated in FIG. 3A .
- an image object may be included in an index of user-consumable content or in a table of content, and the index mode may be suitable for presenting the image object in such a situation.
- a digital book may include a number of chapters; each chapter may include a number of pages; and each page may include a number of text blocks, images, videos, etc.
- These objects e.g., book, chapter, page, text block, image, video, etc.
- each of these objects may correspond to a UI component. As illustrated in FIG.
- a specific page 313 includes an image 315 .
- Image 315 may be presented in TOC 311 , as a part of page 313 , in the index mode.
- Image 315 may be shown in a thumbnail (i.e., small) size, in proportion to the sizes of page 313 and TOC 311 . Different images may have different sizes or resolutions.
- an image When an image is included in a page, it may occupy a portion of the page, as in the case of image 315 (e.g., occupying a quarter or half of the page) or it may occupy the entire page, as in the case of image 317 .
- images 315 and 317 When images 315 and 317 are presented in the index mode, their sizes may decrease in proportion to the sizes of the pages that contain them.
- a social-networking website may include a number of user accounts; each user account may include a number of media folders or albums (among other items); and each media folder may include a number of videos or images.
- these objects e.g., website, user account, media folder, video, image, etc.
- Given a specific media folder, the images in that folder may be presented in an index of image objects so that a user may browse through these images and perhaps select a specific image for viewing. In this case, each image object may be presented in the index mode.
- an image object may be presented in a user interface in an on-page mode, as illustrated in FIG. 3B .
- an image object may be included in another UI component (e.g., a web page, a page of a book, etc.).
- the image object may be presented as a part of this other UI component.
- the on-page mode may be suitable for presenting the image object in such a situation.
- FIG. 3B suppose that a page 323 of a digital book includes an image 325 . When page 323 is presented, image 325 is presented as a part of page 323 , in the on-page mode, together with other content of page 323 .
- Image 325 may be shown in a size that is appropriate or in proportion to the size of page 323 .
- Different images may have different sizes or resolutions and may occupy different areas or portions of a page.
- an image may occupy a quarter of a page (e.g., top-left quarter, top-right quarter, bottom-left quarter, bottom-right quarter) or half of a page (e.g., top half, bottom half, left half, right half).
- a web page may include an image object. When the web page is presented (e.g., displayed in a web browser), the image object may be presented in the web page and as a part of the web page in the on-page mode, together with other content of the web page.
- an image object may be presented in a user interface in a full-screen mode, as illustrated in FIG. 3C .
- an image object may be presented by itself.
- the full-screen mode may be suitable for presenting the image object in such a situation.
- an image 335 is presented in the full-screen mode where it may be the only or the main UI component displayed on the screen of a device and may occupy substantially the entire display area of the screen (e.g., greater than 90% of the display area of the screen or 100% of the display area of the screen).
- the user may single tap any part of image 315 or pinch open image 315 (e.g., using two fingers on a touch-sensitive screen), which may cause the image object to transition to the on-page mode, such as image 325 in FIG. 3B .
- the user may single tap any part of image 325 or pinch open image 325 , which may cause the image object to transition to the full-screen mode, such as image 335 in FIG. 3C .
- an image object is presented in the full-screen mode, such as image 335 in FIG. 3C
- the user may double tap any part of image 335 or pinch close image 335 (e.g., using two fingers on a touch-sensitive screen), which may cause the image object to transition to the on-page mode, such as image 325 in FIG. 3B .
- the user may double tap any part of image 325 or pinch close image 325 , which may cause the image object to transition to the index mode, such as image 315 in FIG. 3A .
- an image object may have multiple cropped versions in addition to the original, full-size image.
- the cropped versions may be presented in different modes when appropriate. For example, when an image object is presented in the index mode or the on-page mode, sometimes, the area for displaying the image may be relatively small in comparison to the size of the image. To fit the image in the display area, the image may be re-sized down (e.g., to a smaller size) or a cropped version of the image may be displayed. For example, as illustrated in FIG. 5A , a cropped version 510 of an image is shown in the on-page mode when the image is included in a page of a digital book.
- the image when a user single taps or pinches open cropped version 510 of the image to cause the image to transition to the full-screen mode, initially, the image may still be shown in the cropped version, as illustrated in FIG. 5B .
- the cropped version of the image occupies the entire screen of the user's device, instead of being included in a page.
- the image may gradually zoom or pan out, as illustrated in FIG. 5C , until eventually the original, complete image is shown, as illustrated in FIG. 5D .
- text may be overlaid on top of the image (e.g., text 319 in FIG. 3A , text 329 in FIG. 3B , text 339 in FIG. 3C ).
- the text may be a caption or description of the associated image.
- an image object may “float” on top of the UI component containing that image object.
- image 325 floats on top of page 323 , and this floating status is visually indicated by showing a small portion (e.g., the top edge and bottom edge) of image 325 slightly outside the boundary of page 323 .
- the components of a user interface may be presented according to a hierarchical structure.
- page 323 may be the parent object of image 325 .
- page 323 may be at one layer beneath the layer of image 325 in the user interface.
- Page 323 and image 325 are two separate UI components corresponding to two objects.
- a floating image object indicates that a user may interact with that image object.
- a geo-tag may be associated with or attached to the image object.
- the geo-tag may represent a geographical location.
- a geo-tag as represented by geo-tag icon 337
- the underlying geo-tag may cause a map 400 to be presented, as illustrated in FIG. 4 .
- map 400 may be presented in the full-screen mode, replacing image 335 .
- Map 400 may include an indicator 401 indicating the geographical location of the subject matter in image 335 or where image 335 had been taken and another indicator 403 indicating, if known and enabled by the user and user's device, the current geographical location of the electronic device, and thus its user, displaying the map.
- an indicator 401 indicating the geographical location of the subject matter in image 335 or where image 335 had been taken
- another indicator 403 indicating, if known and enabled by the user and user's device, the current geographical location of the electronic device, and thus its user, displaying the map.
- there is a close icon 405 that enables the user to close map 400 and return to the image with which the corresponding geo-tag is associated (e.g., image 337 in FIG. 3C ).
- the display area for the image is smaller than the size of the image.
- a portion or a cropped version of the original image may be displayed. There may be different ways to crop an image, depending on, for example, the dimension or size of the image, the position of the image in the other UI component containing the image, or the size of the display area for the image.
- FIG. 6A illustrates an image 611 included in a page 610 .
- Image 611 is placed in the left half of page 610 and is folded in half vertically.
- FIG. 6D illustrates an image 621 included in a page 620 .
- Image 621 is placed in the top half of page 620 and is folded in half horizontally. Both images 611 and 621 are presented in the on-page mode, being included in pages 610 and 620 respectively.
- image 611 floats on top of page 610 , since the top and bottom edges of image 611 extend beyond the boundary of page 610 .
- image 621 floats on top of page 620 , since the top edge of image 621 extends beyond the boundary of page 620 .
- a first UI component e.g., image, video, text box, URL, caption, etc.
- a second UI component e.g., page
- a user may “lift” the image up and off the page by pinching the image with two fingers through a touch-sensitive screen, as illustrated in FIG. 6G .
- the two fingers may be placed anywhere near one or more edges of the image.
- image 611 has been lifted off page 610 when a user places two fingers near the left and right edges of image 611 and pinches image 611 up. Image 611 remains folded vertically, but both left and right sides of image 611 are visible. A horizontally folded image may be lifted off a page similarly.
- the user may drag the image to various positions on the screen or rotate the image by moving the fingers pinching the image appropriately.
- Shadow may be placed around the object.
- a light source may be simulated to cause the effect of shadowing around a floating object (e.g., a floating image).
- the simulated light source may be placed at any position on or off the screen.
- a simulated light source 650 is placed in the center of the display screen (e.g., the center of page 610 ).
- the shadow around folded image 611 may change depending on the position of image 611 in relation to simulated light source 650 .
- the object when simulating the effect of viewing an object in the three-dimensional virtual space, the object may be rotated or rolled (e.g., left or right, up or down) as needed or as appropriate to compensate for perspective.
- image 611 has been pinched up and moved toward the left side of the screen (e.g., near the left edge of page 610 ).
- the left side of image 611 there is more, darker shadow on the left side of image 611 and less, lighter shadow on the right side of image 611 , as the left side of image 611 faces away from simulated light source 650 and the right side of image 611 faces toward simulated light source 650 .
- image 611 is rotated more toward the left so that there is more of the right half of image 611 shown but less of the left half of image 611 shown.
- FIG. 6B image 611 has been pinched up and moved toward the left side of the screen (e.g., near the left edge of page 610 ).
- image 611 is
- image 611 has been pinched up and moved toward the right side of the screen (e.g., near the right edge of page 610 ). In this case, there is more, darker shadow on the right side of image 611 and less, lighter shadow on the left side of image 611 , as the right side of image 611 faces away from simulated light source 650 and the left side of image 611 faces toward simulated light source 650 . In addition, to compensate for perspective, image 611 is rotated more toward the right so that there is more of the left half of image 611 shown but less of the right half of image 611 shown.
- floating object e.g., floating image 611
- other objects such as page or text objects, layered below the floating image remain stationary, permitting the user to manipulate the floating image and read the entire text simultaneously.
- Similar shadowing effect may be applied to a floating image when the image is pinched up and moved toward the top or bottom of the screen.
- image 621 has been pinched up (e.g., by placing two fingers near the top and bottom edges of image 621 ) and moved toward the top side of the screen (e.g., near the top edge of page 620 ).
- Image 621 remains folded horizontally but both the top and bottom sides of image 621 are visible. In this case, to compensate for perspective, image 621 is rotated more toward the bottom so that more of the top half of image 621 is shown.
- Simulated light source 650 is now placed near the top of or above the screen so that there is more shadow on the bottom side of image 621 than on the top side of image 621 , since the top side of image 621 faces toward simulated light source 650 and the bottom side of image 621 faces away from simulated light source 650 .
- image 621 has been brought near the bottom of the screen. At this position, to compensate for perspective, image 621 is rotated more toward the top so that more of the bottom half of image 621 is shown.
- Simulated light source 650 is now placed near the bottom of or below the screen so that there is more shadow on the top side of image 621 than on the bottom side of image 621 , since the top side of image 621 faces away from simulated light source 650 and the bottom side of image 621 faces toward simulated light source 650 .
- a floating object e.g., a floating image
- it may be moved to different positions on the screen, as illustrated in FIGS. 6B , 6 C, 6 E, 6 F.
- it may also be rotated, as illustrated in FIG. 7 .
- an image 711 contained in a page 710 has been pinched up (e.g., using two fingers) and rotated (e.g., by rotating the fingers pinching image 711 ).
- the shadow around image 711 may rotate with image 711 accordingly to maintain the three-dimensional effect.
- a portion of image 711 overlays the text beneath it on page 710 .
- a floating object e.g., image or video
- another object e.g., text
- the appearance of the object under the floating object may be adjusted (e.g., slightly darkened or distorted) to simulate the effect of the shadow casted by the floating object on the underlaying object.
- the shadow of an object may be implemented as a separate layer.
- image 711 partially overlaps some text on page 710 .
- shadow surrounding image 711 The text covered by the shadow may be darkened accordingly as well.
- the shadow around an object e.g., an image
- the image when a user pinches or picks up an image with two fingers (e.g., through a touch-sensitive screen), as long as the user's fingers are in contact with the image (e.g., by staying in contact with the touch-sensitive screen), the image may move according to the movements of the user's fingers. In other words, there may be an one-to-one corresponding interaction between the movements of the user's fingers and the movements of the image.
- a folded image e.g., pinched up with two fingers
- the image may unfold more so that the two edges pinched by the user's fingers move further apart or the image may increase in size.
- the image may fold more so that the two edges pinched by the user's fingers move closer or the image may decrease in size.
- an un-folded image is picked up (e.g., pinched up with two fingers)
- its size may change with the movements of the two fingers.
- the image may be enlarged.
- the size of the image may be decreased.
- the image may follow and move with the user's fingers to different positions on the screen and may rotate appropriately to simulate the effect of viewing the image in a three-dimensional virtual space (e.g., to compensate for perspective).
- the shadow around the image may move with the image (e.g., as the image fold or unfold, increase or decrease in size, rotate, pan, etc.).
- the animation of the image's movements may give the perception that the user is holding the image at the same two points on the image where the user's fingers are in contact with the image throughout the movements.
- the locations of the user's fingers may be projected into the three-dimensional virtual space.
- the animation of its movements following the user's fingers may be based on spring motions. For example, how much should the image fold or unfold, how much should the image rotate, or how much should the image bounce against the edge of the screen, as the user's fingers move may be determined based on spring motions.
- an image's movements may be simulated by, supposedly, attaching the image to an imaginary spring.
- the supposed force the user's fingers exert on the image may cause the image to have supposed mass.
- an object with mass e.g., an image with supposed mass
- the spring may have properties such as, for example and without limitation, tension, stretch, and dampening. By selecting various values for these properties, different movements of the image may be simulated.
- a second object beneath the first object may be moved backward in the virtual three-dimensional space.
- image 711 when image 711 is pinched up, page 710 , together with the text on it, may be moved backward to create the visual effect of a greater distance between image 711 and page 710 , which in turn simulates the effect of image 711 being picked up from page 710 .
- the shadow casted by image 711 on page 710 may increase in size accordingly.
- FIG. 8 The simulation of the effect of picking up a two-dimensional object in a virtual three-dimensional space is further illustrated in FIG. 8 .
- the distance between objects 810 and 820 is D 1 .
- a light source 830 above object 810 causes object 810 to cast a shadow 841 of object 810 onto object 820 .
- object 810 has moved away from object 820 and closer to light source 830 .
- the distance between objects 810 and 820 is D 2 , which is greater than D 1 .
- Light source 830 again causes object 810 to cast a shadow 842 of object 810 onto object 820 . But because object 810 is now further away from object 820 , shadow 842 is larger than shadow 841 .
- the size of the shadow a first object casts onto a second object
- it may stimulate the effect that the first object is moving away from (e.g., increasing shadow size) or moving closer toward the second object (e.g., decreasing shadow size).
- it may stimulate the effect that the image is moving away from (e.g., increasing shadow size) or moving closer toward the page (e.g., decreasing shadow size).
- the image is moving away from the page, it appears that the image is picked up from the page.
- an image or video object presented in a user interface may be manipulated by a user.
- FIG. 9 illustrates an example method for a user to manipulate an image or a video presented in a user interface.
- an image or a video may be presented in a user interface in one of the available presentation modes (e.g., index mode, on-page mode, full-screen mode).
- a user may interacts with the image or video.
- the image or the video may be modified. How the image or the video is actually modified may depend on the presentation mode it is in or the user interaction. For example, as described above, the user interaction may cause the image or video to transition to a different presentation mode, to move or rotate or pan, to increase or decrease its size, and so on.
- the steps illustrated in FIG. 9 may be repeated as needed.
- FIG. 10 illustrates an example electronic device 1000 .
- computer system 1000 may be an embodiment for device 110 A or device 110 B illustrated in FIG. 1 .
- one or more computer systems 1000 perform one or more steps of one or more methods described or illustrated herein.
- one or more computer systems 1000 provide functionality described or illustrated herein.
- software running on one or more computer systems 1000 performs one or more steps of one or more methods described or illustrated herein or provides functionality described or illustrated herein.
- Particular embodiments include one or more portions of one or more computer systems 1000 .
- computer system 1000 may be an embedded computer system, a system-on-chip (SOC), a single-board computer system (SBC) (such as, for example, a computer-on-module (COM) or system-on-module (SOM)), a desktop computer system, a laptop or notebook computer system, an interactive kiosk, a mainframe, a mesh of computer systems, a mobile telephone, a personal digital assistant (PDA), a server, or a combination of two or more of these.
- SOC system-on-chip
- SBC single-board computer system
- COM computer-on-module
- SOM system-on-module
- computer system 1000 may include one or more computer systems 1000 ; be unitary or distributed; span multiple locations; span multiple machines; or reside in a cloud, which may include one or more cloud components in one or more networks.
- one or more computer systems 1000 may perform without substantial spatial or temporal limitation one or more steps of one or more methods described or illustrated herein.
- one or more computer systems 1000 may perform in real time or in batch mode one or more steps of one or more methods described or illustrated herein.
- One or more computer systems 1000 may perform at different times or at different locations one or more steps of one or more methods described or illustrated herein, where appropriate.
- computer system 1000 includes a processor 1002 , memory 1004 , storage 1006 , an input/output (I/O) interface 1008 , a communication interface 1010 , and a bus 1012 .
- I/O input/output
- this disclosure describes and illustrates a particular computer system having a particular number of particular components in a particular arrangement, this disclosure contemplates any suitable computer system having any suitable number of any suitable components in any suitable arrangement.
- processor 1002 includes hardware for executing instructions, such as those making up a computer program.
- processor 1002 may retrieve (or fetch) the instructions from an internal register, an internal cache, memory 1004 , or storage 1006 ; decode and execute them; and then write one or more results to an internal register, an internal cache, memory 1004 , or storage 1006 .
- processor 1002 may include one or more internal caches for data, instructions, or addresses. This disclosure contemplates processor 1002 including any suitable number of any suitable internal caches, where appropriate.
- processor 1002 may include one or more instruction caches, one or more data caches, and one or more translation lookaside buffers (TLBs). Instructions in the instruction caches may be copies of instructions in memory 1004 or storage 1006 , and the instruction caches may speed up retrieval of those instructions by processor 1002 . Data in the data caches may be copies of data in memory 1004 or storage 1006 for instructions executing at processor 1002 to operate on; the results of previous instructions executed at processor 1002 for access by subsequent instructions executing at processor 1002 or for writing to memory 1004 or storage 1006 ; or other suitable data. The data caches may speed up read or write operations by processor 1002 . The TLBs may speed up virtual-address translation for processor 1002 .
- TLBs translation lookaside buffers
- processor 1002 may include one or more internal registers for data, instructions, or addresses. This disclosure contemplates processor 1002 including any suitable number of any suitable internal registers, where appropriate. Where appropriate, processor 1002 may include one or more arithmetic logic units (ALUs); be a multi-core processor; or include one or more processors 1002 . Although this disclosure describes and illustrates a particular processor, this disclosure contemplates any suitable processor.
- ALUs arithmetic logic units
- memory 1004 includes main memory for storing instructions for processor 1002 to execute or data for processor 1002 to operate on.
- computer system 1000 may load instructions from storage 1006 or another source (such as, for example, another computer system 1000 ) to memory 1004 .
- Processor 1002 may then load the instructions from memory 1004 to an internal register or internal cache.
- processor 1002 may retrieve the instructions from the internal register or internal cache and decode them.
- processor 1002 may write one or more results (which may be intermediate or final results) to the internal register or internal cache.
- Processor 1002 may then write one or more of those results to memory 1004 .
- processor 1002 executes only instructions in one or more internal registers or internal caches or in memory 1004 (as opposed to storage 1006 or elsewhere) and operates only on data in one or more internal registers or internal caches or in memory 1004 (as opposed to storage 1006 or elsewhere).
- One or more memory buses (which may each include an address bus and a data bus) may couple processor 1002 to memory 1004 .
- Bus 1012 may include one or more memory buses, as described below.
- one or more memory management units reside between processor 1002 and memory 1004 and facilitate accesses to memory 1004 requested by processor 1002 .
- memory 1004 includes random access memory (RAM). This RAM may be volatile memory, where appropriate.
- this RAM may be dynamic RAM (DRAM) or static RAM (SRAM). Moreover, where appropriate, this RAM may be single-ported or multi-ported RAM. This disclosure contemplates any suitable RAM.
- Memory 1004 may include one or more memories 1004 , where appropriate. Although this disclosure describes and illustrates particular memory, this disclosure contemplates any suitable memory.
- storage 1006 includes mass storage for data or instructions.
- storage 1006 may include an HDD, a floppy disk drive, flash memory, an optical disc, a magneto-optical disc, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these.
- Storage 1006 may include removable or non-removable (or fixed) media, where appropriate.
- Storage 1006 may be internal or external to computer system 1000 , where appropriate.
- storage 1006 is non-volatile, solid-state memory.
- storage 1006 includes read-only memory (ROM).
- this ROM may be mask-programmed ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), electrically alterable ROM (EAROM), or flash memory or a combination of two or more of these.
- This disclosure contemplates mass storage 1006 taking any suitable physical form.
- Storage 1006 may include one or more storage control units facilitating communication between processor 1002 and storage 1006 , where appropriate.
- storage 1006 may include one or more storages 1006 .
- this disclosure describes and illustrates particular storage, this disclosure contemplates any suitable storage.
- I/O interface 1008 includes hardware, software, or both providing one or more interfaces for communication between computer system 1000 and one or more I/O devices.
- Computer system 1000 may include one or more of these I/O devices, where appropriate.
- One or more of these I/O devices may enable communication between a person and computer system 1000 .
- an I/O device may include a keyboard, keypad, microphone, monitor, mouse, printer, scanner, speaker, still camera, stylus, tablet, touch screen, trackball, video camera, another suitable I/O device or a combination of two or more of these.
- An I/O device may include one or more sensors. This disclosure contemplates any suitable I/O devices and any suitable I/O interfaces 1008 for them.
- I/O interface 1008 may include one or more device or software drivers enabling processor 1002 to drive one or more of these I/O devices.
- I/O interface 1008 may include one or more I/O interfaces 1008 , where appropriate. Although this disclosure describes and illustrates a particular I/O interface, this disclosure contemplates any suitable I/O interface.
- communication interface 1010 includes hardware, software, or both providing one or more interfaces for communication (such as, for example, packet-based communication) between computer system 1000 and one or more other computer systems 1000 or one or more networks.
- communication interface 1010 may include a network interface controller (NIC) or network adapter for communicating with an Ethernet or other wire-based network or a wireless NIC (WNIC) or wireless adapter for communicating with a wireless network, such as a WI-FI network.
- NIC network interface controller
- WNIC wireless NIC
- WI-FI network wireless network
- computer system 1000 may communicate with an ad hoc network, a personal area network (PAN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), or one or more portions of the Internet or a combination of two or more of these.
- PAN personal area network
- LAN local area network
- WAN wide area network
- MAN metropolitan area network
- computer system 1000 may communicate with a wireless PAN (WPAN) (such as, for example, a BLUETOOTH WPAN), a WI-FI network, a WI-MAX network, a cellular telephone network (such as, for example, a Global System for Mobile Communications (GSM) network), or other suitable wireless network or a combination of two or more of these.
- Computer system 1000 may include any suitable communication interface 1010 for any of these networks, where appropriate.
- Communication interface 1010 may include one or more communication interfaces 1010 , where appropriate.
- bus 1012 includes hardware, software, or both coupling components of computer system 1000 to each other.
- bus 1012 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a front-side bus (FSB), a HYPERTRANSPORT (HT) interconnect, an Industry Standard Architecture (ISA) bus, an INFINIBAND interconnect, a low-pin-count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCIe) bus, a serial advanced technology attachment (SATA) bus, a Video Electronics Standards Association local (VLB) bus, or another suitable bus or a combination of two or more of these.
- Bus 1012 may include one or more buses 1012 , where appropriate.
- a computer-readable non-transitory storage medium or media may include one or more semiconductor-based or other integrated circuits (ICs) (such, as for example, field-programmable gate arrays (FPGAs) or application-specific ICs (ASICs)), hard disk drives (HDDs), hybrid hard drives (HHDs), optical discs, optical disc drives (ODDs), magneto-optical discs, magneto-optical drives, floppy diskettes, floppy disk drives (FDDs), magnetic tapes, solid-state drives (SSDs), RAM-drives, SECURE DIGITAL cards or drives, any other suitable computer-readable non-transitory storage medium or media, or any suitable combination of two or more of these, where appropriate.
- ICs semiconductor-based or other integrated circuits
- HDDs hard disk drives
- HHDs hybrid hard drives
- ODDs optical disc drives
- magneto-optical discs magneto-optical drives
- FDDs floppy diskettes
- FDDs floppy disk drives
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
- This application is a continuation under 35 U.S.C. §120 of U.S. patent application Ser. No. 13/490,736, filed Jun. 7, 2012, which claims the benefit, under 35 U.S.C. §119(e), of U.S. Provisional Patent Application No. 61/593,841, filed 1 Feb. 2012, which is incorporated herein by reference.
- This disclosure generally relates to presenting multimedia objects, such as images or videos, in a user interface.
- A user interface (UI), in the industrial design field of human-machine interaction, is the space where interactions between humans and machines occur. The goal of interactions between a human, often referred to as a “user”, and a machine at the user interface is user's control of the machine and its operations (e.g., through user input) and machine feedback (e.g., through program output). A graphical user interface (GUI) is a type of user interface that allows users to interact with software applications executing on electronic or computing devices through multimedia objects (e.g., images, videos, audios, etc.) rather than purely text commands.
-
FIG. 1 illustrates a portion of an example object hierarchy. -
FIGS. 2A-2D illustrate example modes for presenting a video object in a user interface. -
FIGS. 3A-3C illustrate example modes for presenting an image object in a user interface. -
FIG. 4 illustrates an example map associated with a geo-tag attached to an image. -
FIGS. 5A-5D illustrate an example transition of an image between two presentation modes. -
FIGS. 6A-6G illustrate example user manipulations of folded images. -
FIG. 7 illustrates rotating a floating image. -
FIGS. 8A-8B illustrate simulating an object being picked up in a three-dimensional virtual space. -
FIG. 9 illustrates an example method that enables a user to manipulate an image or a video. -
FIG. 10 illustrates an example electronic device. - In particular embodiments, a user interface (UI), and more specifically, a graphical user interface (GUI) may include any number of UI components or elements arranged in a hierarchy. The components of a user interface may be presented to users according to the hierarchical structure. In particular embodiments, some of these UI components may correspond to or represent multimedia objects, such as images, videos, or audios. Sometimes, these multimedia UI components may be presented to users individually on their own. Other times, they may be presented to users while contained in other UI components, such as being included in a window, a panel, or a web page. In particular embodiments, there may be multiple presentations modes for presenting images or videos in a user interface.
- In particular embodiments, a user may interact with a multimedia UI component using a suitable input device (e.g., a finger or stylus on a touch-sensitive screen or a mouse). For example, the user may play or pause a video, or zoom or pan or rotate an image. In particular embodiments, depending on how or where a multimedia UI component is presented to a user (e.g., which presentation mode it is in), the user's interaction with the multimedia UI component may result in different behaviors from the multimedia UI component.
- Object Hierarchy
- In particular embodiments, objects may be organized into a hierarchy. For example, objects may be organized into a hierarchy based on how the individual objects are related to each other. The object hierarchy may have any number of levels, and at each level, there may be any number of objects. Parent-child or sibling relationships may exist between specific objects in the hierarchy. Within the hierarchy, a parent object is one level above the level of its child objects. Two sibling objects are at the same level and share the same parent object. In addition, any portion of the hierarchy may also be considered a hierarchy in itself.
-
FIG. 1 illustrates a portion of anexample object hierarchy 100 that includes a number ofobjects 110. In particular embodiments, an object in a hierarchy may or may not have a parent. If an object does not have a parent, it may be referred to as a “root” object (e.g.,object 110A). In particular embodiments, an object in a hierarchy may or may not have any children. If an object does not have any children, it may be referred to as a “leaf” or “terminal” object (e.g.,object 110B). If an object does have children (e.g.,object 110C), it may have any number of children. In addition, objects sharing the same parent may be referred to as each other's “siblings”. For example, inFIG. 1 ,object 110C is the parent ofobjects Objects object 110C and are siblings to each other. Thus, a hierarchy of objects (e.g., object hierarchy 100) not only includes the individual objects themselves but also indicates the relationships among the specific objects. Moreover, the position of a specific object within the hierarchy may indicate its relationships with other objects in the hierarchy. - Objects may be of any applicable types. In particular embodiments, an object may be a component of a user interface. In this case, the object hierarchy may be a UI hierarchy (e.g., a hierarchy of UI components). In other words, components of a user interface may be organized into a hierarchy. The UI hierarchy may have any number of layers corresponding to the levels of the object hierarchy, and at each layer, there may be any number of UI components. The position of a specific UI component within the hierarchy may indicate its relationships with other UI components in the hierarchy. The UI components may be presented to users according to the hierarchical structure (e.g., in layers). In particular embodiments, some of these UI components may be multimedia objects, such as images, videos, or audios.
- In particular embodiments, an object may correspond to a piece of user-consumable content. In particular embodiments, an object may be consumed by a user if the user may, for example and without limitation, interact with, view, read, listen to, manipulate, or handle the object. For example, some user-consumable objects may be texts, images, videos, audios, feeds, executables (e.g., application programs or games), websites, web pages, digital books, photo albums, posts, or messages. In particular embodiments, user-consumable content, or more specifically, user-consumable objects, may be organized into a hierarchy based on, for example, the relationships among the individual pieces of user-consumable content. Consequently, a hierarchy of user-consumable content may be represented as a hierarchy of objects, where individual objects in the hierarchy may correspond to specific pieces of user-consumable content (e.g., texts, images, videos, audios, executables, etc.). In addition, the structure of the hierarchy indicates the relationships among the specific pieces of user-consumable content.
- In particular embodiments, the relationships among the objects in a hierarchy may correspond to how the objects are organized and presented to users. In particular embodiments, when presenting a hierarchy of objects to a user of a device, the objects may be organized and presented according to the structure of the object hierarchy. More specifically, the objects may be presented in a user interface provided on the device according to the structure of the object hierarchy so that the user interface itself becomes hierarchical as well. Consequently, the user interface may include a number of layers, respectively corresponding to the levels in the object hierarchy. The positions of the objects within the hierarchy are preserved in the user interface, such that a specific object at a specific position in the hierarchy is presented in the corresponding position in the user interface. The relationships among the objects within the hierarchy are maintained in the user interface. In other words, there may be an one-to-one correspondence between an object in the object hierarchy and a UI component in the user interface, such that each object is represented by a UI component.
- As an example, in the context of the desktop of a computing device, the desktop may be a parent object, and sometimes the root object of a hierarchy, whose child objects are the individual software applications available on the desktop. A software application, while itself being one of the child objects of the desktop, is also the parent object of the individual components of that software application. Different software applications may include different components. For example, for a software application that manages digital books (e.g., a book reader application), its components may include the digital books available, the individual chapters of each book, the pages of each chapter, and the texts, images, videos, audios, or any graphical user interface (GUI) or content or media elements on each page. Each of these also corresponds to an object in the hierarchy. More specifically, when these objects are organized in a hierarchy, the book application may be the parent object of the digital books. A digital book may be the parent object of the individual chapters of that book. A chapter, while itself being one of the child objects of the book, is also the parent object of the pages in that chapter. A page is the parent object of the texts, images, videos, audios, or any GUI or content or media elements on that page. A text block, image, video, audio, or GUI or content or media element is one of the child objects of the page to which it belongs. Similarly, for a software application that manages news feeds, its components may include the individual news channels and the news stories within each channel. Each of these may correspond to an object. When these objects are arranged in a hierarchy, the news-feed application, while itself being one of the child objects of the desktop, is also the parent object of the news channels. A news channel in turn is the parent object of the news stories included in that channel. Some of these objects may respectively correspond to UI components of a user interface presented on the computing device.
- As another example, in the context of the Internet or the World Wide Web, the Internet may be a parent object whose child objects are the individual websites. A website, while itself being one of the child objects of the Internet, is also the parent object of the individual web pages of that website. A web page, while itself being one of the child objects of the website to which it belongs, is the parent object of the texts, images, videos, audios, or links (e.g., Uniform Resource Locators (URLs)) included in the web page. Each text block, image, video, audio, or link may also correspond to a specific object in the hierarchy. Some of these objects may respectively correspond to UI components of a web-based user interface that may be presented to a user through a web browser.
- As a third example, a website, such as a social-networking website, may also be arranged in such a hierarchical structure for navigating the content of the social-networking website. In this context, the social-networking website may be a parent object whose child objects are the components (e.g., photo albums, user profile pages, etc.) of the website. For example, a photo album, while itself being a child object of the social-networking website, may in turn be a parent object, and the individual photos within the album may be the child objects of the photo album. A user's profile page may be structured in such a hierarchical fashion as well. The profile page itself may be considered a parent object, and the individual objects on the profile page may be the child objects of the profile page. In particular embodiments, a profile page may be considered and rendered (e.g., for presentation to a user) as a linear timeline of objects, such as, for example and without limitation, photos, photo albums, check-ins, comments from other users, attended events, tags, etc. In particular embodiments, child objects in the hierarchy may also include applications the user has added to the profile page, such as a Spotify music sharing application. Moreover, individual stories, songs the user has listened to, and playlists may be child objects at a lower hierarchical level. In particular embodiments, child objects in the hierarchy may include particular sections of a user's profile, such as the user's education and employment information, or the public “wall” of the user's profile page. This disclosure contemplates representing and addressing any collection of content in a hierarchical object or nodal structure. Again, these objects may respectively correspond to UI components of a web-based user interface that may be presented to a user through a web browser.
- As these examples illustrate, an object may be of any type and this disclosure contemplates any applicable types of objects. For example and without limitation, the term “object” may refer to any type of content, including but not limited to images, videos, captions, text blocks or boxes, user interface elements, URLs, newsfeed stories, references to other objects, advertisements, calendar events, units for displaying open graph analysis that may be graphically rendered, applications, websites, web pages, books, chapters. In particular embodiments, given a hierarchy of objects, which may be a portion of another, larger hierarchy of objects, the hierarchical relationships (e.g., parent-child or sibling relationships, positions of the objects within the hierarchy) between specific objects may direct some aspects of how these objects behave in the context of a user interface or how the objects are presented to a user.
- Video Object
- In particular embodiments, an object in a hierarchy may be a video, which may be presented to a user for viewing. Consequently, there may be a video component in a user interface corresponding to the video object. In particular embodiments, there may be several modes for presenting a video object in a user interface, and this disclosure contemplates any applicable presentation modes for presenting video objects. The video object may be presented to a user in any one of these available modes. There may be different video components in the user interface for presenting the video object in different modes.
- In particular embodiments, a video object may be presented in a user interface in an index mode (also referred to as table-of-content (TOC) mode), as illustrated in
FIG. 2A . Sometimes, a video object may be included in an index of user-consumable content or in a table of content, and the index mode may be suitable for presenting the video object in such a situation. As an example, a digital book may include a number of chapters; each chapter may include a number of pages; and each page may include a number of text blocks, images, videos, etc. These objects (e.g., book, chapter, page, text block, image, video, etc.) may be organized in a hierarchy, and each of these objects may correspond to a UI component. As illustrated inFIG. 2A , given a specific chapter, the pages in that chapter may be presented in a table of content (TOC) 211 so that a user may browse through these pages quickly and perhaps select a specific page to read in further detail. Suppose that a specific page 213 includes a video 215. Video 215 may be presented in TOC 211, as a part of page 213, in the index mode. Video 215 may be shown in a thumbnail (i.e., small) size, in proportion to the sizes of page 213 and TOC 211. As another example, a social-networking website may include a number of user accounts; each user account may include a number of media folders or albums (among other items); and each media folder may include a number of videos or images. Again, these objects (e.g., website, user account, media folder, video, image, etc.) may be organized in a hierarchy. Given a specific media folder, the videos in that folder may be presented in an index of video objects so that a user may browse through these videos and perhaps select a specific video for playback. In this case, each video object may be presented in the index mode. - In particular embodiments, a video object may be presented in a user interface in an on-page mode, as illustrated in
FIG. 2B . Sometimes, a video object may be included in another UI component (e.g., a web page, a page of a book, etc.). When this other UI component is presented, the video object may be presented as a part of this other UI component. The on-page mode may be suitable for presenting the video object in such a situation. As an example, as illustrated inFIG. 2B , suppose that apage 223 of a digital book includes avideo 225. Whenpage 223 is presented,video 225 is presented as a part ofpage 223, in the on-page mode, together with other content ofpage 223.Video 225 may be shown in a size that is appropriate or in proportion to the size of page 223 (e.g., half or a quarter of the size of page 223). As another example, a web page may include a video object. When the web page is presented (e.g., displayed in a web browser), the video object may be presented in the web page and as a part of the web page in the on-page mode, together with other content of the web page. - In particular embodiments, a video object may be presented in a user interface in a full-screen mode, as illustrated in
FIG. 2C . Sometimes, a video object may be presented by itself. The full-screen mode may be suitable for presenting the video object in such a situation. For example, as illustrated inFIG. 2C , avideo 235 is presented in the full-screen mode where it may be the only or the main UI component displayed on the screen of a device and may occupy substantially the entire display area of the screen (e.g., greater than 90% of the display area of the screen or 100% of the display area of the screen). - A user may interact with a video object presented in any of the available modes, and in particular embodiments, depending on which mode the video object is in, the user's interaction with the video object may result in different behavioral responses. In some cases, the user's interaction with the video object in one presentation mode may cause the video object to automatically transition to another presentation mode.
- In particular embodiments, while in each of the presentation modes (e.g., index mode, on-page mode, full-screen mode), there may be playback control icons or buttons associated with a video object (e.g., icon 217 in
FIG. 2A ,icon 227 inFIG. 2B ,icon 237 inFIG. 2C ). A user may tap on these control icons to cause the video to start or pause playing. For example, while the video is being played, a pause icon (e.g.,icon 237 inFIG. 2C ) may be associated with the video. The user may tap on the pause icon to cause the video to pause playing. On the other hand, while the video is paused, a play icon (e.g.,icon 227 inFIG. 2B ) may be associated with the video. The user may tap on the play icon to cause the video to start or resume playing. The user may start or stop playback of the video at any time. - In particular embodiments, while a video object is presented in the index mode, such as video 215 in
FIG. 2A , the user may single tap any part of video 215 or pinch open video 215 (e.g., using two fingers on a touch-sensitive screen), which may cause the video object to transition to the on-page mode, such asvideo 225 inFIG. 2B . In particular embodiments, while a video object is presented in the on-page mode, such asvideo 225 inFIG. 2B , the user may single tap any part ofvideo 225 or pinchopen video 225, which may cause the video object to transition to the full-screen mode, such asvideo 235 inFIG. 2C . Conversely, in particular embodiments, while a video object is presented in the full-screen mode, such asvideo 235 inFIG. 2C , the user may double tap any part ofvideo 235 or pinch close video 235 (e.g., using two fingers on a touch-sensitive screen), which may cause the video object to transition to the on-page mode, such asvideo 225 inFIG. 2B . In particular embodiments, while a video object is presented in the on-page mode, such asvideo 225 inFIG. 2B , the user may double tap any part ofvideo 225 or pinchclose video 225, which may cause the video object to transition to the index mode, such as video 215 inFIG. 2A . - In particular embodiments, while a video object transitions from one presentation mode to another presentation mode, the playback status of the video is unaffected. That is, if the video is being played while the mode transition occurs, the video continues to play, until either the user stops the playback or the video ends. On the other hand, if the video is paused while the mode transition occurs, the video continues to pause. The user may pause or resume playback of the video using, for example, the appropriate control icon.
- In particular embodiments, there is a consistency between different presentation modes. When an object (e.g., image, video) is presented in a user interface and the object is being manipulated by a user (e.g., picked up, rotated, zoomed in or out, etc.), the object itself, not the UI component representing the object, is manipulated. This ensures the self-consistency of the user interface. For example, while a video is being played, the user may manipulate the video object (e.g., pinched down to the index mode or pinched up to the full-screen mode). While the video object is being manipulated by the user, the playback of the video continues uninterrupted.
- In particular embodiments, while in the index mode (e.g., video 215 in
FIG. 2A ) or the on-page mode (e.g.,video 225 inFIG. 2B ), if the user clicks or taps the play icon to start playing a video, the video may automatically transition to the full-screen mode (e.g.,video 235 inFIG. 2C ) and the control icon may fade away. Conversely, in particular embodiments, while in the full-screen mode, if the user pauses or stops the playback of the video or if the video ends, the video may automatically transition back to the index mode or the on-page mode (i.e., the original mode in which the video had been presented when the user had caused the video to transition to the full-screen mode by starting the playback). - In particular embodiments, when a video object transitions from one presentation mode to another presentation mode, the display size for the visual portion of the video may change accordingly. For example, when transitioning from the index mode to the on-page mode, the size of the video images (i.e., the visual portion of the video) may increase appropriately. Similarly, when transitioning from the on-page mode to the full-screen mode, the size of the video images may increase to occupy the entire display area of the screen. Conversely, when transitioning from the full-screen mode to the on-page mode or from the on-page mode to the index mode, the size of the video images may decrease appropriately. In other words, there may be a suitable size for presenting the visual portion of a video object in each specific mode, and while the video object is presented in a specific mode, its visual portion is presented in the corresponding size for that mode.
- In particular embodiments, when a video object transitions from one presentation mode to another presentation mode, the volume level for the audio portion of the video may change accordingly. In other words, there may be a suitable volume level for presenting the audio portion of a video object in each specific mode, and while the video object is presented in a specific mode, its audio is presented in the corresponding volume level for that mode. For example, while in the index mode, the audio of the video object may be presented in a lower volume level so that it does not create much disturbance. While in the on-page mode, the audio of the video object may be presented in a volume level that is somewhat higher (e.g., louder) than that of the index mode. While in the full-screen mode, the audio of the video object may be presented in a volume level that is somewhat higher (e.g., louder) than that of the on-page mode (e.g., a higher volume level). While in each presentation mode, the user may manually adjust (e.g., increase or decrease) the volume level of the audio of the video object to override the default volume level for that mode as desired.
- In particular embodiments, while in the index mode (e.g., video 215 in
FIG. 2A ), if a video is being played, the user may not be able to stop the playback directly in the index mode. Instead, the user needs to transition to the on-page mode (e.g.,video 225 inFIG. 2B ) first and then uses the pause icon to pause or stop the playback of the video. - In particular embodiments, while in the on-page mode (e.g.,
video 225 inFIG. 2B ), a video object may “float” on top of the UI component containing that video object. For example, as illustrated inFIG. 2B ,video 225 floats on top ofpage 223, and this floating status is visually indicated by showing a small portion (e.g., the top edge) ofvideo 225 slightly outside the boundary ofpage 223. In particular embodiments, the components of a user interface may be presented according to a hierarchical structure. In this case,page 223 may be the parent object ofvideo 225. Thus,page 223 may be at one layer beneath the layer ofvideo 225 in the user interface.Page 223 andvideo 225 are two separate UI components corresponding to two objects. In particular embodiments, a floating video object indicates that a user may interact with that video object. - In particular embodiments, while in the on-page mode (e.g.,
video 225 inFIG. 2B ), if a video is being played and the user navigates away from the UI component (e.g., the page) containing the video, the current position of the video may be recorded. If the user comes back to the UI component (e.g., the page) containing the video object at a later time, the video may resume playback from the position where the user has left it. - In particular embodiments, while in the full-screen mode, the playback control icon (e.g.,
icon 237 inFIG. 2C ) associated with a video may disappear after it has not been used for a while (e.g., a few seconds) or if the user taps on the video. Only the video itself is presented on the screen, as illustrated inFIG. 2D , so that the user may watch the video undisturbed. The user may bring back the control icon by single tapping the video in the full-screen mode (e.g.,video 235 inFIG. 2D ) in order to pause or resume playback of the video. In other words, while in the full-screen mode, single tapping on the video may cause the playback control icon associated with the video to appear or disappear. In particular embodiments, while in the full-screen mode, there may be a time indicator (e.g.,slider icon 239 inFIG. 2C ) associated with the video indicating how much time has elapsed in the video as well as enabling the user to jump to different positions in the video (e.g., be selecting a specific position along slider icon 239). - In particular embodiments, while in each of the presentation mode, if the user indicates that he or she no longer wishes to watch a video by, for example, swiping to the next page or chapter, closing the video object, or otherwise navigating away from the video object, the audio portion of the video object may fade out, instead of, for example, stopping abruptly.
- Image Object
- In particular embodiments, an object in a hierarchy may be an image, which may be presented to a user for viewing. Consequently, there may be an image component in a user interface corresponding to the image object. In particular embodiments, there may be several modes for presenting an image object in a user interface, and this disclosure contemplates any applicable presentation modes for presenting image objects. The image object may be presented to a user in any one of these available modes. There may be different image components in the user interface for presenting the image object in different modes.
- In particular embodiments, an image object may be presented in a user interface in an index mode (also referred to as table-of-content (TOC) mode), as illustrated in
FIG. 3A . Sometimes, an image object may be included in an index of user-consumable content or in a table of content, and the index mode may be suitable for presenting the image object in such a situation. As an example, a digital book may include a number of chapters; each chapter may include a number of pages; and each page may include a number of text blocks, images, videos, etc. These objects (e.g., book, chapter, page, text block, image, video, etc.) may be organized in a hierarchy, and each of these objects may correspond to a UI component. As illustrated inFIG. 3A , given a specific chapter, the pages in that chapter may be presented in a table of content (TOC) 311 so that a user may browse through these pages quickly and perhaps select a specific page to read in further detail. Suppose that aspecific page 313 includes animage 315.Image 315 may be presented inTOC 311, as a part ofpage 313, in the index mode.Image 315 may be shown in a thumbnail (i.e., small) size, in proportion to the sizes ofpage 313 andTOC 311. Different images may have different sizes or resolutions. When an image is included in a page, it may occupy a portion of the page, as in the case of image 315 (e.g., occupying a quarter or half of the page) or it may occupy the entire page, as in the case ofimage 317. Whenimages - In particular embodiments, an image object may be presented in a user interface in an on-page mode, as illustrated in
FIG. 3B . Sometimes, an image object may be included in another UI component (e.g., a web page, a page of a book, etc.). When this other UI component is presented, the image object may be presented as a part of this other UI component. The on-page mode may be suitable for presenting the image object in such a situation. As an example, as illustrated inFIG. 3B , suppose that apage 323 of a digital book includes animage 325. Whenpage 323 is presented,image 325 is presented as a part ofpage 323, in the on-page mode, together with other content ofpage 323.Image 325 may be shown in a size that is appropriate or in proportion to the size ofpage 323. Different images may have different sizes or resolutions and may occupy different areas or portions of a page. For example, an image may occupy a quarter of a page (e.g., top-left quarter, top-right quarter, bottom-left quarter, bottom-right quarter) or half of a page (e.g., top half, bottom half, left half, right half). As another example, a web page may include an image object. When the web page is presented (e.g., displayed in a web browser), the image object may be presented in the web page and as a part of the web page in the on-page mode, together with other content of the web page. - In particular embodiments, an image object may be presented in a user interface in a full-screen mode, as illustrated in
FIG. 3C . Sometimes, an image object may be presented by itself. The full-screen mode may be suitable for presenting the image object in such a situation. For example, as illustrated inFIG. 3C , animage 335 is presented in the full-screen mode where it may be the only or the main UI component displayed on the screen of a device and may occupy substantially the entire display area of the screen (e.g., greater than 90% of the display area of the screen or 100% of the display area of the screen). - In particular embodiments, while an image object is presented in the index mode, such as
image 315 inFIG. 3A , the user may single tap any part ofimage 315 or pinch open image 315 (e.g., using two fingers on a touch-sensitive screen), which may cause the image object to transition to the on-page mode, such asimage 325 inFIG. 3B . In particular embodiments, while an image object is presented in the on-page mode, such asimage 325 inFIG. 3B , the user may single tap any part ofimage 325 or pinchopen image 325, which may cause the image object to transition to the full-screen mode, such asimage 335 inFIG. 3C . Conversely, in particular embodiments, while an image object is presented in the full-screen mode, such asimage 335 inFIG. 3C , the user may double tap any part ofimage 335 or pinch close image 335 (e.g., using two fingers on a touch-sensitive screen), which may cause the image object to transition to the on-page mode, such asimage 325 inFIG. 3B . In particular embodiments, while an image object is presented in the on-page mode, such asimage 325 inFIG. 3B , the user may double tap any part ofimage 325 or pinchclose image 325, which may cause the image object to transition to the index mode, such asimage 315 inFIG. 3A . - In particular embodiments, an image object may have multiple cropped versions in addition to the original, full-size image. The cropped versions may be presented in different modes when appropriate. For example, when an image object is presented in the index mode or the on-page mode, sometimes, the area for displaying the image may be relatively small in comparison to the size of the image. To fit the image in the display area, the image may be re-sized down (e.g., to a smaller size) or a cropped version of the image may be displayed. For example, as illustrated in
FIG. 5A , a croppedversion 510 of an image is shown in the on-page mode when the image is included in a page of a digital book. In particular embodiments, when a user single taps or pinches open croppedversion 510 of the image to cause the image to transition to the full-screen mode, initially, the image may still be shown in the cropped version, as illustrated inFIG. 5B . However, inFIG. 5B , the cropped version of the image occupies the entire screen of the user's device, instead of being included in a page. The image may gradually zoom or pan out, as illustrated inFIG. 5C , until eventually the original, complete image is shown, as illustrated inFIG. 5D . In addition, in particular embodiments, there may be audio commentary associated with an image. While the image is zooming out, as illustrated inFIGS. 5B , 5C, 5D, the audio commentary associate with the image may be played automatically. - In particular embodiments, while an image object is presented in each of the presentation modes (e.g., index mode, on-page mode, full-screen mode), text may be overlaid on top of the image (e.g.,
text 319 inFIG. 3A ,text 329 inFIG. 3B ,text 339 inFIG. 3C ). For example, the text may be a caption or description of the associated image. - In particular embodiments, while in the on-page mode (e.g.,
image 325 inFIG. 3B ), an image object may “float” on top of the UI component containing that image object. For example, as illustrated inFIG. 3B ,image 325 floats on top ofpage 323, and this floating status is visually indicated by showing a small portion (e.g., the top edge and bottom edge) ofimage 325 slightly outside the boundary ofpage 323. In particular embodiments, the components of a user interface may be presented according to a hierarchical structure. In this case,page 323 may be the parent object ofimage 325. Thus,page 323 may be at one layer beneath the layer ofimage 325 in the user interface.Page 323 andimage 325 are two separate UI components corresponding to two objects. In particular embodiments, a floating image object indicates that a user may interact with that image object. - In particular embodiments, while an image object is presented in the full-screen mode, a geo-tag may be associated with or attached to the image object. The geo-tag may represent a geographical location. For example, as illustrated in
FIG. 3C , a geo-tag, as represented by geo-tag icon 337, is associated with or attached to image 335 in the full-screen mode. When a user interacts with geo-tag icon 337 (e.g., single tap or click it), the underlying geo-tag may cause amap 400 to be presented, as illustrated inFIG. 4 . With some implementations, map 400 may be presented in the full-screen mode, replacingimage 335.Map 400 may include anindicator 401 indicating the geographical location of the subject matter inimage 335 or whereimage 335 had been taken and anotherindicator 403 indicating, if known and enabled by the user and user's device, the current geographical location of the electronic device, and thus its user, displaying the map. In addition, there is aclose icon 405 that enables the user to closemap 400 and return to the image with which the corresponding geo-tag is associated (e.g.,image 337 inFIG. 3C ). - In particular embodiments, while an image object is presented in the on-page mode where the image is included in another UI component (e.g., a web page, a page of a digital book), sometimes, the display area for the image is smaller than the size of the image. To fit the image in the available display area, in particular embodiments, a portion or a cropped version of the original image may be displayed. There may be different ways to crop an image, depending on, for example, the dimension or size of the image, the position of the image in the other UI component containing the image, or the size of the display area for the image.
- As an example, when an image is presented in the left or right half of a page, the image may be folded in half vertically.
FIG. 6A illustrates animage 611 included in apage 610.Image 611 is placed in the left half ofpage 610 and is folded in half vertically. As another example, when an image is presented in the top or bottom half of a page, the image may be folded in half horizontally.FIG. 6D illustrates animage 621 included in apage 620.Image 621 is placed in the top half ofpage 620 and is folded in half horizontally. Bothimages pages - As illustrated in
FIG. 6A ,image 611 floats on top ofpage 610, since the top and bottom edges ofimage 611 extend beyond the boundary ofpage 610. Similarly, as illustrated inFIG. 6D ,image 621 floats on top ofpage 620, since the top edge ofimage 621 extends beyond the boundary ofpage 620. In particular embodiments, when a first UI component (e.g., image, video, text box, URL, caption, etc.) floats on top of a second UI component (e.g., page) that contains the first UI component, it is a visual indication that the first UI component may be manipulated by the user in various manners. - In particular embodiments, when an image floats on top of a page, such as in the case of
image 611 floating on top ofpage 610 as illustrated inFIG. 6A orimage 621 floating on top ofpage 620 as illustrated inFIG. 6D , a user may “lift” the image up and off the page by pinching the image with two fingers through a touch-sensitive screen, as illustrated inFIG. 6G . The two fingers may be placed anywhere near one or more edges of the image. With a folded image, when the image is pinched up and lifted off the page, the entire image appears, but remains folded at an angle relative to the distance between the two fingers the user uses to pinch the image. If the user pinches out beyond a predetermined or specified threshold distance (e.g., by moving the two fingers apart) and then takes his fingers off the image (e.g., by lifting the fingers off the touch-sensitive screen), the image may transition to the full-screen mode and expand to fill the entire screen. For the example illustrated inFIG. 6G ,image 611 has been lifted offpage 610 when a user places two fingers near the left and right edges ofimage 611 and pinchesimage 611 up.Image 611 remains folded vertically, but both left and right sides ofimage 611 are visible. A horizontally folded image may be lifted off a page similarly. - In particular embodiments, once the user has pinched up an image, the user may drag the image to various positions on the screen or rotate the image by moving the fingers pinching the image appropriately.
- In particular embodiments, to simulate the effect of a two-dimensional object (e.g., image) in a three-dimensional virtual space, shadow may be placed around the object. In particular embodiments, a light source may be simulated to cause the effect of shadowing around a floating object (e.g., a floating image). The simulated light source may be placed at any position on or off the screen. In the case illustrated in
FIG. 6G , a simulatedlight source 650 is placed in the center of the display screen (e.g., the center of page 610). The shadow around foldedimage 611 may change depending on the position ofimage 611 in relation to simulatedlight source 650. In addition, in particular embodiments, when simulating the effect of viewing an object in the three-dimensional virtual space, the object may be rotated or rolled (e.g., left or right, up or down) as needed or as appropriate to compensate for perspective. - For example, in
FIG. 6B ,image 611 has been pinched up and moved toward the left side of the screen (e.g., near the left edge of page 610). In this case, there is more, darker shadow on the left side ofimage 611 and less, lighter shadow on the right side ofimage 611, as the left side ofimage 611 faces away from simulatedlight source 650 and the right side ofimage 611 faces toward simulatedlight source 650. In addition, to compensate for perspective,image 611 is rotated more toward the left so that there is more of the right half ofimage 611 shown but less of the left half ofimage 611 shown. In contrast, inFIG. 6C ,image 611 has been pinched up and moved toward the right side of the screen (e.g., near the right edge of page 610). In this case, there is more, darker shadow on the right side ofimage 611 and less, lighter shadow on the left side ofimage 611, as the right side ofimage 611 faces away from simulatedlight source 650 and the left side ofimage 611 faces toward simulatedlight source 650. In addition, to compensate for perspective,image 611 is rotated more toward the right so that there is more of the left half ofimage 611 shown but less of the right half ofimage 611 shown. In particular embodiments, when a floating object (e.g., floating image 611) is manipulated when in the on-page mode, other objects, such as page or text objects, layered below the floating image remain stationary, permitting the user to manipulate the floating image and read the entire text simultaneously. - Similar shadowing effect may be applied to a floating image when the image is pinched up and moved toward the top or bottom of the screen. For example, in
FIG. 6E ,image 621 has been pinched up (e.g., by placing two fingers near the top and bottom edges of image 621) and moved toward the top side of the screen (e.g., near the top edge of page 620).Image 621 remains folded horizontally but both the top and bottom sides ofimage 621 are visible. In this case, to compensate for perspective,image 621 is rotated more toward the bottom so that more of the top half ofimage 621 is shown. Simulatedlight source 650 is now placed near the top of or above the screen so that there is more shadow on the bottom side ofimage 621 than on the top side ofimage 621, since the top side ofimage 621 faces toward simulatedlight source 650 and the bottom side ofimage 621 faces away from simulatedlight source 650. In contrast, inFIG. 6F ,image 621 has been brought near the bottom of the screen. At this position, to compensate for perspective,image 621 is rotated more toward the top so that more of the bottom half ofimage 621 is shown. Simulatedlight source 650 is now placed near the bottom of or below the screen so that there is more shadow on the top side ofimage 621 than on the bottom side ofimage 621, since the top side ofimage 621 faces away from simulatedlight source 650 and the bottom side ofimage 621 faces toward simulatedlight source 650. - When a floating object (e.g., a floating image) is pinched up, it may be moved to different positions on the screen, as illustrated in
FIGS. 6B , 6C, 6E, 6F. In particular embodiments, it may also be rotated, as illustrated inFIG. 7 . In this example, animage 711 contained in apage 710 has been pinched up (e.g., using two fingers) and rotated (e.g., by rotating the fingers pinching image 711). The shadow aroundimage 711 may rotate withimage 711 accordingly to maintain the three-dimensional effect. In addition, as illustrated inFIG. 7 , a portion ofimage 711 overlays the text beneath it onpage 710. In particular embodiments, when a floating object (e.g., image or video) overlays another object (e.g., text) beneath it, the appearance of the object under the floating object may be adjusted (e.g., slightly darkened or distorted) to simulate the effect of the shadow casted by the floating object on the underlaying object. - In particular embodiments, the shadow of an object (e.g., an image) may be implemented as a separate layer. For example, in
FIG. 7 ,image 711 partially overlaps some text onpage 710. There isshadow surrounding image 711. The text covered by the shadow may be darkened accordingly as well. In some implementations, the shadow around an object (e.g., an image) may be drawn as a blurry dot, sliced up horizontally and vertically, and then stretched up to fill the necessary shadow area. This allows the shadow of an object to be determined without performing ray tracing, which is very computationally intensive and thus resource demanding. - In particular embodiments, when a user pinches or picks up an image with two fingers (e.g., through a touch-sensitive screen), as long as the user's fingers are in contact with the image (e.g., by staying in contact with the touch-sensitive screen), the image may move according to the movements of the user's fingers. In other words, there may be an one-to-one corresponding interaction between the movements of the user's fingers and the movements of the image. As an example, when a folded image is picked up (e.g., pinched up with two fingers), if the user's fingers move apart, the image may unfold more so that the two edges pinched by the user's fingers move further apart or the image may increase in size. If the user's fingers move closer, the image may fold more so that the two edges pinched by the user's fingers move closer or the image may decrease in size. As another example, when an un-folded image is picked up (e.g., pinched up with two fingers), its size may change with the movements of the two fingers. By moving the two fingers further apart, the image may be enlarged. Conversely, by moving the two fingers closer together, the size of the image may be decreased. As a third example, if the user's fingers move to different positions on the screen, the image may follow and move with the user's fingers to different positions on the screen and may rotate appropriately to simulate the effect of viewing the image in a three-dimensional virtual space (e.g., to compensate for perspective). The shadow around the image may move with the image (e.g., as the image fold or unfold, increase or decrease in size, rotate, pan, etc.).
- In particular embodiments, the animation of the image's movements may give the perception that the user is holding the image at the same two points on the image where the user's fingers are in contact with the image throughout the movements. The locations of the user's fingers may be projected into the three-dimensional virtual space.
- In particular embodiments, when an image is picked up, the animation of its movements following the user's fingers may be based on spring motions. For example, how much should the image fold or unfold, how much should the image rotate, or how much should the image bounce against the edge of the screen, as the user's fingers move may be determined based on spring motions. In particular embodiments, an image's movements may be simulated by, supposedly, attaching the image to an imaginary spring. When the user's fingers pick up the image, the supposed force the user's fingers exert on the image may cause the image to have supposed mass. When an object with mass (e.g., an image with supposed mass) is attached to a spring, its movements may follow specific physical properties. In addition to the mass, the spring may have properties such as, for example and without limitation, tension, stretch, and dampening. By selecting various values for these properties, different movements of the image may be simulated.
- In particular embodiments, to simulate the effect of picking up an object (e.g., image, video) in the three-dimensional virtual space, when a first object is picked up, a second object beneath the first object may be moved backward in the virtual three-dimensional space. For example, when
image 711 is pinched up,page 710, together with the text on it, may be moved backward to create the visual effect of a greater distance betweenimage 711 andpage 710, which in turn simulates the effect ofimage 711 being picked up frompage 710. The shadow casted byimage 711 onpage 710 may increase in size accordingly. - The simulation of the effect of picking up a two-dimensional object in a virtual three-dimensional space is further illustrated in
FIG. 8 . InFIG. 8A , the distance betweenobjects light source 830 aboveobject 810 causes object 810 to cast ashadow 841 ofobject 810 ontoobject 820. InFIG. 8B ,object 810 has moved away fromobject 820 and closer tolight source 830. The distance betweenobjects Light source 830 again causes object 810 to cast ashadow 842 ofobject 810 ontoobject 820. But becauseobject 810 is now further away fromobject 820,shadow 842 is larger thanshadow 841. Thus, by changing the size of the shadow a first object casts onto a second object, it may stimulate the effect that the first object is moving away from (e.g., increasing shadow size) or moving closer toward the second object (e.g., decreasing shadow size). In the case of picking up an image from a page, by changing the size of the shadow the image casts onto the page, it may stimulate the effect that the image is moving away from (e.g., increasing shadow size) or moving closer toward the page (e.g., decreasing shadow size). When the image is moving away from the page, it appears that the image is picked up from the page. - User Manipulation of Image or Video Object
- In particular embodiments, an image or video object presented in a user interface may be manipulated by a user.
FIG. 9 illustrates an example method for a user to manipulate an image or a video presented in a user interface. In particular embodiments, at 910, an image or a video may be presented in a user interface in one of the available presentation modes (e.g., index mode, on-page mode, full-screen mode). At 920, a user may interacts with the image or video. At 930, in response to the user interaction, the image or the video may be modified. How the image or the video is actually modified may depend on the presentation mode it is in or the user interaction. For example, as described above, the user interaction may cause the image or video to transition to a different presentation mode, to move or rotate or pan, to increase or decrease its size, and so on. The steps illustrated inFIG. 9 may be repeated as needed. - Electronic Device
- Particular embodiments may be implemented on one or more electronic devices or computer systems.
FIG. 10 illustrates an exampleelectronic device 1000. For example,computer system 1000 may be an embodiment fordevice 110A ordevice 110B illustrated inFIG. 1 . In particular embodiments, one ormore computer systems 1000 perform one or more steps of one or more methods described or illustrated herein. In particular embodiments, one ormore computer systems 1000 provide functionality described or illustrated herein. In particular embodiments, software running on one ormore computer systems 1000 performs one or more steps of one or more methods described or illustrated herein or provides functionality described or illustrated herein. Particular embodiments include one or more portions of one ormore computer systems 1000. - This disclosure contemplates any suitable number of
computer systems 1000. This disclosure contemplatescomputer system 1000 taking any suitable physical form. As example and not by way of limitation,computer system 1000 may be an embedded computer system, a system-on-chip (SOC), a single-board computer system (SBC) (such as, for example, a computer-on-module (COM) or system-on-module (SOM)), a desktop computer system, a laptop or notebook computer system, an interactive kiosk, a mainframe, a mesh of computer systems, a mobile telephone, a personal digital assistant (PDA), a server, or a combination of two or more of these. Where appropriate,computer system 1000 may include one ormore computer systems 1000; be unitary or distributed; span multiple locations; span multiple machines; or reside in a cloud, which may include one or more cloud components in one or more networks. Where appropriate, one ormore computer systems 1000 may perform without substantial spatial or temporal limitation one or more steps of one or more methods described or illustrated herein. As an example and not by way of limitation, one ormore computer systems 1000 may perform in real time or in batch mode one or more steps of one or more methods described or illustrated herein. One ormore computer systems 1000 may perform at different times or at different locations one or more steps of one or more methods described or illustrated herein, where appropriate. - In particular embodiments,
computer system 1000 includes aprocessor 1002,memory 1004,storage 1006, an input/output (I/O)interface 1008, acommunication interface 1010, and abus 1012. Although this disclosure describes and illustrates a particular computer system having a particular number of particular components in a particular arrangement, this disclosure contemplates any suitable computer system having any suitable number of any suitable components in any suitable arrangement. - In particular embodiments,
processor 1002 includes hardware for executing instructions, such as those making up a computer program. As an example and not by way of limitation, to execute instructions,processor 1002 may retrieve (or fetch) the instructions from an internal register, an internal cache,memory 1004, orstorage 1006; decode and execute them; and then write one or more results to an internal register, an internal cache,memory 1004, orstorage 1006. In particular embodiments,processor 1002 may include one or more internal caches for data, instructions, or addresses. This disclosure contemplatesprocessor 1002 including any suitable number of any suitable internal caches, where appropriate. As an example and not by way of limitation,processor 1002 may include one or more instruction caches, one or more data caches, and one or more translation lookaside buffers (TLBs). Instructions in the instruction caches may be copies of instructions inmemory 1004 orstorage 1006, and the instruction caches may speed up retrieval of those instructions byprocessor 1002. Data in the data caches may be copies of data inmemory 1004 orstorage 1006 for instructions executing atprocessor 1002 to operate on; the results of previous instructions executed atprocessor 1002 for access by subsequent instructions executing atprocessor 1002 or for writing tomemory 1004 orstorage 1006; or other suitable data. The data caches may speed up read or write operations byprocessor 1002. The TLBs may speed up virtual-address translation forprocessor 1002. In particular embodiments,processor 1002 may include one or more internal registers for data, instructions, or addresses. This disclosure contemplatesprocessor 1002 including any suitable number of any suitable internal registers, where appropriate. Where appropriate,processor 1002 may include one or more arithmetic logic units (ALUs); be a multi-core processor; or include one ormore processors 1002. Although this disclosure describes and illustrates a particular processor, this disclosure contemplates any suitable processor. - In particular embodiments,
memory 1004 includes main memory for storing instructions forprocessor 1002 to execute or data forprocessor 1002 to operate on. As an example and not by way of limitation,computer system 1000 may load instructions fromstorage 1006 or another source (such as, for example, another computer system 1000) tomemory 1004.Processor 1002 may then load the instructions frommemory 1004 to an internal register or internal cache. To execute the instructions,processor 1002 may retrieve the instructions from the internal register or internal cache and decode them. During or after execution of the instructions,processor 1002 may write one or more results (which may be intermediate or final results) to the internal register or internal cache.Processor 1002 may then write one or more of those results tomemory 1004. In particular embodiments,processor 1002 executes only instructions in one or more internal registers or internal caches or in memory 1004 (as opposed tostorage 1006 or elsewhere) and operates only on data in one or more internal registers or internal caches or in memory 1004 (as opposed tostorage 1006 or elsewhere). One or more memory buses (which may each include an address bus and a data bus) may coupleprocessor 1002 tomemory 1004.Bus 1012 may include one or more memory buses, as described below. In particular embodiments, one or more memory management units (MMUs) reside betweenprocessor 1002 andmemory 1004 and facilitate accesses tomemory 1004 requested byprocessor 1002. In particular embodiments,memory 1004 includes random access memory (RAM). This RAM may be volatile memory, where appropriate. Where appropriate, this RAM may be dynamic RAM (DRAM) or static RAM (SRAM). Moreover, where appropriate, this RAM may be single-ported or multi-ported RAM. This disclosure contemplates any suitable RAM.Memory 1004 may include one ormore memories 1004, where appropriate. Although this disclosure describes and illustrates particular memory, this disclosure contemplates any suitable memory. - In particular embodiments,
storage 1006 includes mass storage for data or instructions. As an example and not by way of limitation,storage 1006 may include an HDD, a floppy disk drive, flash memory, an optical disc, a magneto-optical disc, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these.Storage 1006 may include removable or non-removable (or fixed) media, where appropriate.Storage 1006 may be internal or external tocomputer system 1000, where appropriate. In particular embodiments,storage 1006 is non-volatile, solid-state memory. In particular embodiments,storage 1006 includes read-only memory (ROM). Where appropriate, this ROM may be mask-programmed ROM, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), electrically alterable ROM (EAROM), or flash memory or a combination of two or more of these. This disclosure contemplatesmass storage 1006 taking any suitable physical form.Storage 1006 may include one or more storage control units facilitating communication betweenprocessor 1002 andstorage 1006, where appropriate. Where appropriate,storage 1006 may include one ormore storages 1006. Although this disclosure describes and illustrates particular storage, this disclosure contemplates any suitable storage. - In particular embodiments, I/
O interface 1008 includes hardware, software, or both providing one or more interfaces for communication betweencomputer system 1000 and one or more I/O devices.Computer system 1000 may include one or more of these I/O devices, where appropriate. One or more of these I/O devices may enable communication between a person andcomputer system 1000. As an example and not by way of limitation, an I/O device may include a keyboard, keypad, microphone, monitor, mouse, printer, scanner, speaker, still camera, stylus, tablet, touch screen, trackball, video camera, another suitable I/O device or a combination of two or more of these. An I/O device may include one or more sensors. This disclosure contemplates any suitable I/O devices and any suitable I/O interfaces 1008 for them. Where appropriate, I/O interface 1008 may include one or more device or softwaredrivers enabling processor 1002 to drive one or more of these I/O devices. I/O interface 1008 may include one or more I/O interfaces 1008, where appropriate. Although this disclosure describes and illustrates a particular I/O interface, this disclosure contemplates any suitable I/O interface. - In particular embodiments,
communication interface 1010 includes hardware, software, or both providing one or more interfaces for communication (such as, for example, packet-based communication) betweencomputer system 1000 and one or moreother computer systems 1000 or one or more networks. As an example and not by way of limitation,communication interface 1010 may include a network interface controller (NIC) or network adapter for communicating with an Ethernet or other wire-based network or a wireless NIC (WNIC) or wireless adapter for communicating with a wireless network, such as a WI-FI network. This disclosure contemplates any suitable network and anysuitable communication interface 1010 for it. As an example and not by way of limitation,computer system 1000 may communicate with an ad hoc network, a personal area network (PAN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), or one or more portions of the Internet or a combination of two or more of these. One or more portions of one or more of these networks may be wired or wireless. As an example,computer system 1000 may communicate with a wireless PAN (WPAN) (such as, for example, a BLUETOOTH WPAN), a WI-FI network, a WI-MAX network, a cellular telephone network (such as, for example, a Global System for Mobile Communications (GSM) network), or other suitable wireless network or a combination of two or more of these.Computer system 1000 may include anysuitable communication interface 1010 for any of these networks, where appropriate.Communication interface 1010 may include one ormore communication interfaces 1010, where appropriate. Although this disclosure describes and illustrates a particular communication interface, this disclosure contemplates any suitable communication interface. - In particular embodiments,
bus 1012 includes hardware, software, or both coupling components ofcomputer system 1000 to each other. As an example and not by way of limitation,bus 1012 may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a front-side bus (FSB), a HYPERTRANSPORT (HT) interconnect, an Industry Standard Architecture (ISA) bus, an INFINIBAND interconnect, a low-pin-count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCIe) bus, a serial advanced technology attachment (SATA) bus, a Video Electronics Standards Association local (VLB) bus, or another suitable bus or a combination of two or more of these.Bus 1012 may include one ormore buses 1012, where appropriate. Although this disclosure describes and illustrates a particular bus, this disclosure contemplates any suitable bus or interconnect. - Herein, a computer-readable non-transitory storage medium or media may include one or more semiconductor-based or other integrated circuits (ICs) (such, as for example, field-programmable gate arrays (FPGAs) or application-specific ICs (ASICs)), hard disk drives (HDDs), hybrid hard drives (HHDs), optical discs, optical disc drives (ODDs), magneto-optical discs, magneto-optical drives, floppy diskettes, floppy disk drives (FDDs), magnetic tapes, solid-state drives (SSDs), RAM-drives, SECURE DIGITAL cards or drives, any other suitable computer-readable non-transitory storage medium or media, or any suitable combination of two or more of these, where appropriate. A computer-readable non-transitory storage medium or media may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate.
- Herein, “or” is inclusive and not exclusive, unless expressly indicated otherwise or indicated otherwise by context. Therefore, herein, “A or B” means “A, B, or both,” unless expressly indicated otherwise or indicated otherwise by context. Moreover, “and” is both joint and several, unless expressly indicated otherwise or indicated otherwise by context. Therefore, herein, “A and B” means “A and B, jointly or severally,” unless expressly indicated otherwise or indicated otherwise by context.
- This disclosure encompasses all changes, substitutions, variations, alterations, and modifications to the example embodiments herein that a person having ordinary skill in the art would comprehend. Moreover, reference in the appended claims to an apparatus or system or a component of an apparatus or system being adapted to, arranged to, capable of, configured to, enabled to, operable to, or operative to perform a particular function encompasses that apparatus, system, component, whether or not it or that particular function is activated, turned on, or unlocked, as long as that apparatus, system, or component is so adapted, arranged, capable, configured, enabled, operable, or operative.
- Moreover, although this disclosure describes and illustrates respective embodiments herein as including particular components, elements, functions, operations, or steps, any of these embodiments may include any combination or permutation of any of the components, elements, functions, operations, or steps described or illustrated anywhere herein that a person having ordinary skill in the art would comprehend.
Claims (20)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/569,475 US20150100924A1 (en) | 2012-02-01 | 2014-12-12 | Folding and unfolding images in a user interface |
US15/421,725 US20170192661A1 (en) | 2012-02-01 | 2017-02-01 | Presenting Image Objects in a User Interface |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261593841P | 2012-02-01 | 2012-02-01 | |
US13/490,736 US9003305B2 (en) | 2012-02-01 | 2012-06-07 | Folding and unfolding images in a user interface |
US14/569,475 US20150100924A1 (en) | 2012-02-01 | 2014-12-12 | Folding and unfolding images in a user interface |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/490,736 Continuation US9003305B2 (en) | 2012-02-01 | 2012-06-07 | Folding and unfolding images in a user interface |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/421,725 Continuation US20170192661A1 (en) | 2012-02-01 | 2017-02-01 | Presenting Image Objects in a User Interface |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150100924A1 true US20150100924A1 (en) | 2015-04-09 |
Family
ID=48869809
Family Applications (22)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/488,076 Expired - Fee Related US9235318B2 (en) | 2012-02-01 | 2012-06-04 | Transitions among hierarchical user-interface layers |
US13/488,039 Active 2032-08-11 US9229613B2 (en) | 2012-02-01 | 2012-06-04 | Transitions among hierarchical user interface components |
US13/487,765 Active US9235317B2 (en) | 2012-02-01 | 2012-06-04 | Summary and navigation of hierarchical levels |
US13/487,805 Active US9552147B2 (en) | 2012-02-01 | 2012-06-04 | Hierarchical user interface |
US13/489,172 Abandoned US20130198261A1 (en) | 2012-02-01 | 2012-06-05 | Intelligent Downloading and Rendering of Content |
US13/489,265 Active 2032-08-08 US8984428B2 (en) | 2012-02-01 | 2012-06-05 | Overlay images and texts in user interface |
US13/490,343 Active 2032-10-18 US8990691B2 (en) | 2012-02-01 | 2012-06-06 | Video object behavior in a user interface |
US13/490,367 Abandoned US20130198668A1 (en) | 2012-02-01 | 2012-06-06 | Image Object Behavior in a User Interface |
US13/491,100 Active 2032-12-10 US9239662B2 (en) | 2012-02-01 | 2012-06-07 | User interface editor |
US13/490,736 Active 2032-09-24 US9003305B2 (en) | 2012-02-01 | 2012-06-07 | Folding and unfolding images in a user interface |
US13/555,657 Active 2033-04-19 US8990719B2 (en) | 2012-02-01 | 2012-07-23 | Preview of objects arranged in a series |
US13/555,876 Active 2033-02-14 US9606708B2 (en) | 2012-02-01 | 2012-07-23 | User intent during object scrolling |
US13/555,845 Active 2032-08-24 US8976199B2 (en) | 2012-02-01 | 2012-07-23 | Visual embellishment for objects |
US13/555,909 Expired - Fee Related US9098168B2 (en) | 2012-02-01 | 2012-07-23 | Spring motions during object animation |
US13/555,607 Active 2033-03-21 US9007371B2 (en) | 2012-02-01 | 2012-07-23 | Three-dimensional shadows cast by objects |
US14/569,475 Abandoned US20150100924A1 (en) | 2012-02-01 | 2014-12-12 | Folding and unfolding images in a user interface |
US14/572,405 Active 2033-12-24 US10775991B2 (en) | 2012-02-01 | 2014-12-16 | Overlay images and texts in user interface |
US14/961,227 Active 2034-03-27 US10613733B2 (en) | 2012-02-01 | 2015-12-07 | User interface editor |
US15/412,347 Abandoned US20170131889A1 (en) | 2012-02-01 | 2017-01-23 | Hierarchical User Interface |
US15/421,725 Abandoned US20170192661A1 (en) | 2012-02-01 | 2017-02-01 | Presenting Image Objects in a User Interface |
US15/470,652 Abandoned US20170199641A1 (en) | 2012-02-01 | 2017-03-27 | User Intent During Object Scrolling |
US16/824,893 Active US11132118B2 (en) | 2012-02-01 | 2020-03-20 | User interface editor |
Family Applications Before (15)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/488,076 Expired - Fee Related US9235318B2 (en) | 2012-02-01 | 2012-06-04 | Transitions among hierarchical user-interface layers |
US13/488,039 Active 2032-08-11 US9229613B2 (en) | 2012-02-01 | 2012-06-04 | Transitions among hierarchical user interface components |
US13/487,765 Active US9235317B2 (en) | 2012-02-01 | 2012-06-04 | Summary and navigation of hierarchical levels |
US13/487,805 Active US9552147B2 (en) | 2012-02-01 | 2012-06-04 | Hierarchical user interface |
US13/489,172 Abandoned US20130198261A1 (en) | 2012-02-01 | 2012-06-05 | Intelligent Downloading and Rendering of Content |
US13/489,265 Active 2032-08-08 US8984428B2 (en) | 2012-02-01 | 2012-06-05 | Overlay images and texts in user interface |
US13/490,343 Active 2032-10-18 US8990691B2 (en) | 2012-02-01 | 2012-06-06 | Video object behavior in a user interface |
US13/490,367 Abandoned US20130198668A1 (en) | 2012-02-01 | 2012-06-06 | Image Object Behavior in a User Interface |
US13/491,100 Active 2032-12-10 US9239662B2 (en) | 2012-02-01 | 2012-06-07 | User interface editor |
US13/490,736 Active 2032-09-24 US9003305B2 (en) | 2012-02-01 | 2012-06-07 | Folding and unfolding images in a user interface |
US13/555,657 Active 2033-04-19 US8990719B2 (en) | 2012-02-01 | 2012-07-23 | Preview of objects arranged in a series |
US13/555,876 Active 2033-02-14 US9606708B2 (en) | 2012-02-01 | 2012-07-23 | User intent during object scrolling |
US13/555,845 Active 2032-08-24 US8976199B2 (en) | 2012-02-01 | 2012-07-23 | Visual embellishment for objects |
US13/555,909 Expired - Fee Related US9098168B2 (en) | 2012-02-01 | 2012-07-23 | Spring motions during object animation |
US13/555,607 Active 2033-03-21 US9007371B2 (en) | 2012-02-01 | 2012-07-23 | Three-dimensional shadows cast by objects |
Family Applications After (6)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/572,405 Active 2033-12-24 US10775991B2 (en) | 2012-02-01 | 2014-12-16 | Overlay images and texts in user interface |
US14/961,227 Active 2034-03-27 US10613733B2 (en) | 2012-02-01 | 2015-12-07 | User interface editor |
US15/412,347 Abandoned US20170131889A1 (en) | 2012-02-01 | 2017-01-23 | Hierarchical User Interface |
US15/421,725 Abandoned US20170192661A1 (en) | 2012-02-01 | 2017-02-01 | Presenting Image Objects in a User Interface |
US15/470,652 Abandoned US20170199641A1 (en) | 2012-02-01 | 2017-03-27 | User Intent During Object Scrolling |
US16/824,893 Active US11132118B2 (en) | 2012-02-01 | 2020-03-20 | User interface editor |
Country Status (1)
Country | Link |
---|---|
US (22) | US9235318B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9098168B2 (en) | 2012-02-01 | 2015-08-04 | Facebook, Inc. | Spring motions during object animation |
US9557876B2 (en) | 2012-02-01 | 2017-01-31 | Facebook, Inc. | Hierarchical user interface |
US11886441B2 (en) * | 2020-10-30 | 2024-01-30 | Snowflake Inc. | Tag-based data governance auditing system |
Families Citing this family (194)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7885440B2 (en) | 2004-11-04 | 2011-02-08 | Dr Systems, Inc. | Systems and methods for interleaving series of medical images |
US7660488B2 (en) | 2004-11-04 | 2010-02-09 | Dr Systems, Inc. | Systems and methods for viewing medical images |
US7787672B2 (en) | 2004-11-04 | 2010-08-31 | Dr Systems, Inc. | Systems and methods for matching, naming, and displaying medical images |
US7920152B2 (en) | 2004-11-04 | 2011-04-05 | Dr Systems, Inc. | Systems and methods for viewing medical 3D imaging volumes |
US7970625B2 (en) | 2004-11-04 | 2011-06-28 | Dr Systems, Inc. | Systems and methods for retrieval of medical data |
US7953614B1 (en) | 2006-11-22 | 2011-05-31 | Dr Systems, Inc. | Smart placement rules |
US8380533B2 (en) | 2008-11-19 | 2013-02-19 | DR Systems Inc. | System and method of providing dynamic and customizable medical examination forms |
US8712120B1 (en) | 2009-09-28 | 2014-04-29 | Dr Systems, Inc. | Rules-based approach to transferring and/or viewing medical images |
EP3882750A1 (en) * | 2010-01-20 | 2021-09-22 | Nokia Technologies Oy | User input |
US9396167B2 (en) | 2011-07-21 | 2016-07-19 | Flipboard, Inc. | Template-based page layout for hosted social magazines |
US9092551B1 (en) | 2011-08-11 | 2015-07-28 | D.R. Systems, Inc. | Dynamic montage reconstruction |
US9323440B2 (en) * | 2011-12-16 | 2016-04-26 | International Business Machines Corporation | Scroll focus |
US9645724B2 (en) | 2012-02-01 | 2017-05-09 | Facebook, Inc. | Timeline based content organization |
TWI470481B (en) * | 2012-02-24 | 2015-01-21 | Lg Electronics Inc | Mobile terminal and control method for the mobile terminal |
US11847300B2 (en) * | 2012-03-12 | 2023-12-19 | Comcast Cable Communications, Llc | Electronic information hierarchy |
US9733813B2 (en) * | 2012-04-05 | 2017-08-15 | Isotropix | Device for processing information |
US20130321313A1 (en) * | 2012-05-31 | 2013-12-05 | Htc Corporation | Method, apparatus and computer program product for cropping screen frame |
US9626381B2 (en) * | 2012-06-19 | 2017-04-18 | International Business Machines Corporation | Photo album creation based on social media content |
US9508102B2 (en) * | 2012-07-25 | 2016-11-29 | Facebook, Inc. | Methods and systems for tracking of user interactions with content in social networks |
KR102004409B1 (en) * | 2012-08-23 | 2019-07-29 | 삼성전자주식회사 | Flexible display apparatus and contorlling method thereof |
US8907914B2 (en) * | 2012-08-31 | 2014-12-09 | General Electric Company | Methods and apparatus for documenting a procedure |
US9397844B2 (en) * | 2012-09-11 | 2016-07-19 | Apple Inc. | Automated graphical user-interface layout |
CN102929508B (en) * | 2012-10-11 | 2015-04-01 | 中兴通讯股份有限公司 | Touch method and device for electronic map |
US20140109012A1 (en) * | 2012-10-16 | 2014-04-17 | Microsoft Corporation | Thumbnail and document map based navigation in a document |
JP6081769B2 (en) * | 2012-10-23 | 2017-02-15 | 任天堂株式会社 | Program, information processing apparatus, information processing method, and information processing system |
JP2014086836A (en) * | 2012-10-23 | 2014-05-12 | Canon Inc | Image processing apparatus, control method, and program |
KR101990035B1 (en) * | 2012-10-31 | 2019-06-18 | 엘지전자 주식회사 | Mobile terminal and control method for the mobile terminal |
US9591339B1 (en) | 2012-11-27 | 2017-03-07 | Apple Inc. | Agnostic media delivery system |
US9774917B1 (en) | 2012-12-10 | 2017-09-26 | Apple Inc. | Channel bar user interface |
US10200761B1 (en) | 2012-12-13 | 2019-02-05 | Apple Inc. | TV side bar user interface |
US20140173466A1 (en) * | 2012-12-14 | 2014-06-19 | Microsoft Corporation | Transitions within views of conversation environments |
US9532111B1 (en) | 2012-12-18 | 2016-12-27 | Apple Inc. | Devices and method for providing remote control hints on a display |
CN103893971B (en) * | 2012-12-25 | 2015-05-27 | 腾讯科技(深圳)有限公司 | Game sound effect generating method and client |
US10521188B1 (en) | 2012-12-31 | 2019-12-31 | Apple Inc. | Multi-user TV user interface |
USD768659S1 (en) * | 2013-01-04 | 2016-10-11 | Level 3 Communications, Llc | Display screen or portion thereof with graphical user interface |
US9495604B1 (en) | 2013-01-09 | 2016-11-15 | D.R. Systems, Inc. | Intelligent management of computerized advanced processing |
US10175873B2 (en) * | 2013-01-21 | 2019-01-08 | Salesforce.Com, Inc. | System and method for retrieving data based on scrolling velocity |
US9361278B2 (en) * | 2013-03-15 | 2016-06-07 | Facebook, Inc. | Overlaying photographs with text on a social networking system |
US20140280783A1 (en) * | 2013-03-15 | 2014-09-18 | Haixiang He | Method and Apparatus for Improving Downloading Performance Based on Reading Intent for Digital Magazine |
US9785240B2 (en) * | 2013-03-18 | 2017-10-10 | Fuji Xerox Co., Ltd. | Systems and methods for content-aware selection |
CN105122200A (en) * | 2013-03-29 | 2015-12-02 | 惠普发展公司,有限责任合伙企业 | Adjustable timeline user interface |
US10341275B2 (en) | 2013-04-03 | 2019-07-02 | Dropbox, Inc. | Shared content item commenting |
KR102048041B1 (en) * | 2013-04-18 | 2019-11-22 | 삼성전자주식회사 | Electronic device and method for generating split screen image |
US20140351723A1 (en) * | 2013-05-23 | 2014-11-27 | Kobo Incorporated | System and method for a multimedia container |
US9740376B2 (en) * | 2013-06-21 | 2017-08-22 | Oracle International Corporation | User interface for relating enterprise information with public information using a private user profile and schema |
US9529790B2 (en) * | 2013-07-09 | 2016-12-27 | Flipboard, Inc. | Hierarchical page templates for content presentation in a digital magazine |
US9565233B1 (en) * | 2013-08-09 | 2017-02-07 | Google Inc. | Preloading content for requesting applications |
US9823824B2 (en) * | 2013-08-19 | 2017-11-21 | Kodak Alaris Inc. | Context sensitive adaptable user interface |
EP2846243B1 (en) * | 2013-09-04 | 2019-08-14 | Matthias Rath | Graphical user interface providing virtual super-zoom functionality |
US20150067582A1 (en) * | 2013-09-05 | 2015-03-05 | Storehouse Media, Inc. | Content navigation structure and transition mechanism |
US9530243B1 (en) | 2013-09-24 | 2016-12-27 | Amazon Technologies, Inc. | Generating virtual shadows for displayable elements |
US9224237B2 (en) | 2013-09-27 | 2015-12-29 | Amazon Technologies, Inc. | Simulating three-dimensional views using planes of content |
US9367203B1 (en) * | 2013-10-04 | 2016-06-14 | Amazon Technologies, Inc. | User interface techniques for simulating three-dimensional depth |
US9892550B2 (en) * | 2013-10-08 | 2018-02-13 | Here Global B.V. | Photorealistic rendering of scenes with dynamic content |
US20150106722A1 (en) * | 2013-10-14 | 2015-04-16 | Apple Inc. | Navigating Image Presentations |
US10482070B2 (en) * | 2013-11-12 | 2019-11-19 | Salesforce.Com, Inc. | Form field creation systems and methods |
US9519525B2 (en) * | 2013-11-14 | 2016-12-13 | Dropbox, Inc. | File-level commenting |
CN103593111A (en) | 2013-11-14 | 2014-02-19 | 三星电子(中国)研发中心 | Screen sharing method for mobile terminals and mobile terminals |
US10067651B2 (en) * | 2013-11-15 | 2018-09-04 | Thomson Reuters Global Resources Unlimited Company | Navigable layering of viewable areas for hierarchical content |
JP6213177B2 (en) * | 2013-11-18 | 2017-10-18 | 株式会社リコー | Display processing apparatus and display processing method |
US11010029B2 (en) | 2013-12-19 | 2021-05-18 | Samsung Electronics Co., Ltd. | Display apparatus and method of displaying image by display apparatus |
KR102308879B1 (en) * | 2013-12-19 | 2021-10-06 | 삼성전자주식회사 | Display apparatus and method for displaying a screen |
CN103729140A (en) * | 2013-12-20 | 2014-04-16 | 天津光电通信技术有限公司 | Method for implementing interaction on human-machine interfaces on basis of DRM (data rights management) |
US9952756B2 (en) * | 2014-01-17 | 2018-04-24 | Intel Corporation | Dynamic adjustment of a user interface |
KR101538576B1 (en) * | 2014-02-10 | 2015-07-22 | 한국과학기술원 | Structure aware navigation method using space and structure mapping between input device and digital data |
US10303324B2 (en) * | 2014-02-10 | 2019-05-28 | Samsung Electronics Co., Ltd. | Electronic device configured to display three dimensional (3D) virtual space and method of controlling the electronic device |
US10157593B2 (en) | 2014-02-24 | 2018-12-18 | Microsoft Technology Licensing, Llc | Cross-platform rendering engine |
US20150250294A1 (en) * | 2014-03-04 | 2015-09-10 | Rebecca Miller | Systems and methods for previewing beauty cosmetic applications using an electronic device |
KR102228856B1 (en) * | 2014-03-20 | 2021-03-17 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
US20150277678A1 (en) * | 2014-03-26 | 2015-10-01 | Kobo Incorporated | Information presentation techniques for digital content |
US20150277677A1 (en) * | 2014-03-26 | 2015-10-01 | Kobo Incorporated | Information presentation techniques for digital content |
US20150312375A1 (en) * | 2014-04-25 | 2015-10-29 | Microsoft Corporation | Pre-fetching grid blocks by user intent |
CN103957458B (en) * | 2014-04-28 | 2018-06-15 | 京东方科技集团股份有限公司 | Video play device, control device, audio/video player system and control method |
US9569062B2 (en) * | 2014-05-21 | 2017-02-14 | Facebook, Inc. | Asynchronous execution of animation tasks for a GUI |
US20150339841A1 (en) * | 2014-05-22 | 2015-11-26 | Microsoft Corporation | Layout animation panel |
CN104978119B (en) * | 2014-05-22 | 2019-11-22 | 腾讯科技(深圳)有限公司 | A kind of messagewindow display methods, device and user terminal |
TWD173248S (en) * | 2014-06-11 | 2016-01-21 | 樂視致新電子科技(天津)有限公司; | Display screen graphical user interface |
US9785340B2 (en) | 2014-06-12 | 2017-10-10 | Apple Inc. | Systems and methods for efficiently navigating between applications with linked content on an electronic device with a touch-sensitive display |
CN106462413A (en) * | 2014-06-12 | 2017-02-22 | 苹果公司 | Systems and methods for multitasking on an electronic device with a touch-sensitive display |
US9648062B2 (en) | 2014-06-12 | 2017-05-09 | Apple Inc. | Systems and methods for multitasking on an electronic device with a touch-sensitive display |
US9576393B1 (en) * | 2014-06-18 | 2017-02-21 | Amazon Technologies, Inc. | Dynamic rendering of soft shadows for interface elements |
US9886565B2 (en) * | 2014-06-20 | 2018-02-06 | Microsoft Technology Licensing, Llc | User-specific visualization of display elements |
CN106415475A (en) | 2014-06-24 | 2017-02-15 | 苹果公司 | Column interface for navigating in a user interface |
KR102608294B1 (en) | 2014-06-24 | 2023-11-30 | 애플 인크. | Input device and user interface interactions |
US9979894B1 (en) | 2014-06-27 | 2018-05-22 | Google Llc | Modifying images with simulated light sources |
US9081421B1 (en) * | 2014-06-30 | 2015-07-14 | Linkedin Corporation | User interface for presenting heterogeneous content |
US9898804B2 (en) * | 2014-07-16 | 2018-02-20 | Samsung Electronics Co., Ltd. | Display driver apparatus and method of driving display |
US20160019718A1 (en) * | 2014-07-16 | 2016-01-21 | Wipro Limited | Method and system for providing visual feedback in a virtual reality environment |
US8954521B1 (en) * | 2014-07-22 | 2015-02-10 | Google Inc. | Management and presentation of notification content |
US9874992B2 (en) * | 2014-08-18 | 2018-01-23 | Lenovo (Singapore) Pte. Ltd. | Preview pane for touch input devices |
US9965452B2 (en) * | 2014-09-04 | 2018-05-08 | Home Box Office, Inc. | Pre-children in a user interface tree |
EP3002666A1 (en) * | 2014-10-02 | 2016-04-06 | Huawei Technologies Co., Ltd. | Interaction method for user interfaces |
WO2016061738A1 (en) * | 2014-10-20 | 2016-04-28 | Schott Glass Technologies (Suzhou) Co. Ltd. | Optical arrangement for a camera module, camera module with optical arrangement and method of manufacturing the optical arrangement |
US10476937B2 (en) * | 2014-10-20 | 2019-11-12 | Facebook, Inc. | Animation for image elements in a display layout |
USD769308S1 (en) | 2015-01-20 | 2016-10-18 | Microsoft Corporation | Display screen with animated graphical user interface |
USD770520S1 (en) * | 2015-01-20 | 2016-11-01 | Microsoft Corporation | Display screen with animated graphical user interface |
USD771692S1 (en) * | 2015-01-20 | 2016-11-15 | Microsoft Corporation | Display screen with animated graphical user interface |
USD769306S1 (en) * | 2015-01-20 | 2016-10-18 | Microsoft Corporation | Display screen with animated graphical user interface |
USD759706S1 (en) * | 2015-01-20 | 2016-06-21 | Microsoft Corporation | Display screen with animated graphical user interface |
US9467608B2 (en) * | 2015-01-27 | 2016-10-11 | Moment Inc | Auxiliary lens for mobile photography |
US11107038B2 (en) | 2015-02-03 | 2021-08-31 | PEOZZLE Corporation | Multimedia resume distribution system |
DE102015102639A1 (en) * | 2015-02-24 | 2016-08-25 | Emporia Telecom Gmbh & Co Kg | Method for operating a mobile terminal, application for a mobile terminal and mobile terminal |
US9727797B2 (en) * | 2015-03-05 | 2017-08-08 | International Business Machines Corporation | Techniques for rotating language preferred orientation on a mobile device |
CN104699842B (en) * | 2015-03-31 | 2019-03-26 | 百度在线网络技术(北京)有限公司 | Picture display method and device |
US10691323B2 (en) * | 2015-04-10 | 2020-06-23 | Apple Inc. | Column fit document traversal for reader application |
US10275148B2 (en) * | 2015-04-21 | 2019-04-30 | Facebook, Inc. | Methods and systems for transitioning between native content and web content |
US10909168B2 (en) * | 2015-04-30 | 2021-02-02 | Merge Healthcare Solutions Inc. | Database systems and interactive user interfaces for dynamic interaction with, and review of, digital medical image data |
USD766296S1 (en) * | 2015-05-01 | 2016-09-13 | Microsoft Corporation | Display screen with animated graphical user interface |
USD767613S1 (en) * | 2015-05-01 | 2016-09-27 | Microsoft Corporation | Display screen with animated graphical user interface |
US20160328127A1 (en) * | 2015-05-05 | 2016-11-10 | Facebook, Inc. | Methods and Systems for Viewing Embedded Videos |
US10042532B2 (en) * | 2015-05-05 | 2018-08-07 | Facebook, Inc. | Methods and systems for viewing embedded content |
US10685471B2 (en) | 2015-05-11 | 2020-06-16 | Facebook, Inc. | Methods and systems for playing video while transitioning from a content-item preview to the content item |
US20160334969A1 (en) * | 2015-05-11 | 2016-11-17 | Facebook, Inc. | Methods and Systems for Viewing an Associated Location of an Image |
US11113022B2 (en) | 2015-05-12 | 2021-09-07 | D&M Holdings, Inc. | Method, system and interface for controlling a subwoofer in a networked audio system |
US11209972B2 (en) * | 2015-09-02 | 2021-12-28 | D&M Holdings, Inc. | Combined tablet screen drag-and-drop interface |
CN104933746B (en) * | 2015-05-21 | 2018-03-23 | 广东欧珀移动通信有限公司 | A kind of method and device that dynamic shadow is set for plane picture |
US20160371872A1 (en) * | 2015-06-18 | 2016-12-22 | Facebook, Inc. | Systems and methods for providing transitions between content interfaces |
US9886086B2 (en) * | 2015-08-21 | 2018-02-06 | Verizon Patent And Licensing Inc. | Gesture-based reorientation and navigation of a virtual reality (VR) interface |
US9904452B2 (en) * | 2015-08-25 | 2018-02-27 | Sap Se | Building user specific user interface instances |
US9766713B2 (en) * | 2015-09-08 | 2017-09-19 | Unity IPR ApS | System and method for providing user interface tools |
US10939167B2 (en) * | 2015-09-15 | 2021-03-02 | Piksel, Inc | Dynamic resource allocation of multimedia content based on usage patterns |
CN105338399A (en) * | 2015-10-29 | 2016-02-17 | 小米科技有限责任公司 | Image acquisition method and device |
US10599764B2 (en) | 2015-11-02 | 2020-03-24 | Microsoft Technology Licensing, Llc | Operations on images associated with cells in spreadsheets |
US9990349B2 (en) | 2015-11-02 | 2018-06-05 | Microsoft Technology Licensing, Llc | Streaming data associated with cells in spreadsheets |
US10585943B2 (en) | 2015-11-24 | 2020-03-10 | Cisco Technology, Inc. | Network-wide, location-independent object identifiers for high-performance distributed graph databases |
US20180152622A1 (en) * | 2015-12-01 | 2018-05-31 | Huizhou Tcl Mobile Communication Co., Ltd | Mobile terminal-based photographing method and mobile terminal |
US10430051B2 (en) * | 2015-12-29 | 2019-10-01 | Facebook, Inc. | Multi-user content presentation system |
CN105488761B (en) * | 2015-12-29 | 2019-03-26 | 北京金山安全软件有限公司 | Processing method and device for spliced pictures |
US10616662B2 (en) * | 2016-02-10 | 2020-04-07 | Disney Enterprises, Inc. | Systems and methods to provide video and control signals over an internet protocol communications network |
US10788966B2 (en) | 2016-02-10 | 2020-09-29 | Disney Enterprises, Inc. | Systems and methods for interacting with a virtual interface |
US10755360B1 (en) * | 2016-02-16 | 2020-08-25 | Wells Fargo Bank, N.A. | Receipt capture with goal encouragement |
US10691880B2 (en) | 2016-03-29 | 2020-06-23 | Microsoft Technology Licensing, Llc | Ink in an electronic document |
US10496419B2 (en) * | 2016-06-10 | 2019-12-03 | Apple Inc. | Editing inherited configurations |
DK201670581A1 (en) | 2016-06-12 | 2018-01-08 | Apple Inc | Device-level authorization for viewing content |
DK201670582A1 (en) | 2016-06-12 | 2018-01-02 | Apple Inc | Identifying applications on which content is available |
US9916225B1 (en) * | 2016-06-23 | 2018-03-13 | VCE IP Holding Company LLC | Computer implemented system and method and computer program product for testing a software component by simulating a computing component using captured network packet information |
US10546013B2 (en) * | 2016-07-18 | 2020-01-28 | Joshua Fagans | File management system facilitating the organization of content by using visualizations of the organizational state augmented by a configurable workflow |
US10225655B1 (en) * | 2016-07-29 | 2019-03-05 | Relay Cars LLC | Stereo user interface elements placed in 3D space for virtual reality applications in head mounted displays |
JP6812170B2 (en) * | 2016-08-29 | 2021-01-13 | キヤノン株式会社 | Information processing device, its control method, and control program |
CN106445116B (en) * | 2016-08-31 | 2020-10-27 | 维沃移动通信有限公司 | Method for calling out message notification bar and mobile terminal |
US10055871B2 (en) | 2016-10-12 | 2018-08-21 | International Business Machines Corporation | Applying an image overlay to an image based on relationship of the people identified in the image |
AT519289B1 (en) * | 2016-10-17 | 2018-08-15 | Wolfinger Gerd | Security device for burglary prevention |
US11966560B2 (en) | 2016-10-26 | 2024-04-23 | Apple Inc. | User interfaces for browsing content from multiple content applications on an electronic device |
CN108108194B (en) * | 2016-11-24 | 2020-12-04 | 腾讯科技(深圳)有限公司 | User interface editing method and user interface editor |
US11302041B2 (en) | 2017-01-13 | 2022-04-12 | Teledyne Flir, Llc | High visibility overlay systems and methods |
US11087512B2 (en) | 2017-01-13 | 2021-08-10 | Flir Systems, Inc. | High visibility overlay systems and methods |
US10235788B2 (en) | 2017-01-17 | 2019-03-19 | Opentv, Inc. | Overlay contrast control in augmented reality displays |
US10152815B2 (en) | 2017-01-17 | 2018-12-11 | Opentv, Inc. | Overlay emphasis modification in augmented reality displays |
JP6594359B2 (en) * | 2017-01-31 | 2019-10-23 | キヤノン株式会社 | Information processing apparatus, information processing method, and program |
US11416900B1 (en) * | 2017-02-24 | 2022-08-16 | Eugene E. Haba, Jr. | Dynamically generated items for user generated graphic user storytelling interface |
US10649640B2 (en) | 2017-05-02 | 2020-05-12 | Microsoft Technology Licensing, Llc | Personalizing perceivability settings of graphical user interfaces of computers |
WO2018208047A1 (en) | 2017-05-09 | 2018-11-15 | Samsung Electronics Co., Ltd. | Method and system for managing and displaying application |
US10755030B2 (en) * | 2017-06-29 | 2020-08-25 | Salesforce.Com, Inc. | Color theme maintenance for presentations |
US10573051B2 (en) | 2017-08-16 | 2020-02-25 | Google Llc | Dynamically generated interface transitions |
DK179931B1 (en) * | 2017-09-09 | 2019-10-11 | Apple Inc. | Devices, methods and graphical user interfaces for displaying an affordance on a background |
US10592091B2 (en) | 2017-10-17 | 2020-03-17 | Microsoft Technology Licensing, Llc | Drag and drop of objects to create new composites |
US11397511B1 (en) * | 2017-10-18 | 2022-07-26 | Nationwide Mutual Insurance Company | System and method for implementing improved user interface |
US10824800B2 (en) | 2017-11-10 | 2020-11-03 | Think Research Corporation | System and method for designing and editing computerized electronic data-entry forms |
JP7119408B2 (en) * | 2018-02-15 | 2022-08-17 | コニカミノルタ株式会社 | Image processing device, screen handling method, and computer program |
EP3564812B1 (en) * | 2018-04-30 | 2022-10-26 | Mphasis Limited | Method and system for automated creation of graphical user interfaces |
US11829581B2 (en) * | 2018-05-21 | 2023-11-28 | Huawei Technologies Co., Ltd. | Display control method and terminal |
US11966578B2 (en) | 2018-06-03 | 2024-04-23 | Apple Inc. | Devices and methods for integrating video with user interface navigation |
DK201870354A1 (en) | 2018-06-03 | 2019-12-20 | Apple Inc. | Setup procedures for an electronic device |
US10990421B2 (en) | 2018-06-27 | 2021-04-27 | Microsoft Technology Licensing, Llc | AI-driven human-computer interface for associating low-level content with high-level activities using topics as an abstraction |
US11354581B2 (en) | 2018-06-27 | 2022-06-07 | Microsoft Technology Licensing, Llc | AI-driven human-computer interface for presenting activity-specific views of activity-specific content for multiple activities |
US11449764B2 (en) * | 2018-06-27 | 2022-09-20 | Microsoft Technology Licensing, Llc | AI-synthesized application for presenting activity-specific UI of activity-specific content |
CN109407944A (en) * | 2018-09-29 | 2019-03-01 | 传线网络科技(上海)有限公司 | Multimedia resource plays adjusting method and device |
US10936156B2 (en) | 2018-11-05 | 2021-03-02 | International Business Machines Corporation | Interactive access to ascendants while navigating hierarchical dimensions |
US10635413B1 (en) * | 2018-12-05 | 2020-04-28 | Bank Of America Corporation | System for transforming using interface image segments and constructing user interface objects |
US10678521B1 (en) | 2018-12-05 | 2020-06-09 | Bank Of America Corporation | System for image segmentation, transformation and user interface component construction |
US10705687B1 (en) * | 2019-01-10 | 2020-07-07 | Pearson Education, Inc. | Visually indicating on a user interface lengths, types of content, structure and current user location within a corpus of electronic content |
USD918254S1 (en) | 2019-01-10 | 2021-05-04 | Pearson Education, Inc. | Display screen with graphical user interface |
JP7289661B2 (en) * | 2019-01-31 | 2023-06-12 | キヤノン株式会社 | Information processing device, control method, and its program |
US11683565B2 (en) | 2019-03-24 | 2023-06-20 | Apple Inc. | User interfaces for interacting with channels that provide content that plays in a media browsing application |
EP3928228A1 (en) | 2019-03-24 | 2021-12-29 | Apple Inc. | User interfaces for a media browsing application |
CN114115676A (en) | 2019-03-24 | 2022-03-01 | 苹果公司 | User interface including selectable representations of content items |
US11467726B2 (en) | 2019-03-24 | 2022-10-11 | Apple Inc. | User interfaces for viewing and accessing content on an electronic device |
WO2020243645A1 (en) | 2019-05-31 | 2020-12-03 | Apple Inc. | User interfaces for a podcast browsing and playback application |
US11863837B2 (en) | 2019-05-31 | 2024-01-02 | Apple Inc. | Notification of augmented reality content on an electronic device |
CN110489041B (en) * | 2019-07-12 | 2021-04-06 | 北京字节跳动网络技术有限公司 | Method, device, equipment and medium for automatically aligning small program dragging elements |
US11004254B2 (en) * | 2019-07-25 | 2021-05-11 | Nvidia Corporation | Performance of ray-traced shadow creation within a scene |
US11620696B2 (en) | 2020-01-03 | 2023-04-04 | International Business Machines Corporation | Dynamic order prioritization enablement |
CN111309415B (en) * | 2020-01-17 | 2024-01-02 | 北京有竹居网络技术有限公司 | User Interface (UI) information processing method and device of application program and electronic equipment |
JP2021124863A (en) * | 2020-02-04 | 2021-08-30 | 富士フイルムビジネスイノベーション株式会社 | Information processing device and computer program |
US11843838B2 (en) | 2020-03-24 | 2023-12-12 | Apple Inc. | User interfaces for accessing episodes of a content series |
US11474793B2 (en) | 2020-05-22 | 2022-10-18 | Salesforce.Com, Inc. | Polymorphic application architecture |
US11899895B2 (en) | 2020-06-21 | 2024-02-13 | Apple Inc. | User interfaces for setting up an electronic device |
US11698776B2 (en) * | 2020-07-24 | 2023-07-11 | Unity Technologies Sf | Method and system for processing computer code |
US11687714B2 (en) * | 2020-08-20 | 2023-06-27 | Adobe Inc. | Systems and methods for generating text descriptive of digital images |
US11720229B2 (en) | 2020-12-07 | 2023-08-08 | Apple Inc. | User interfaces for browsing and presenting content |
US11934640B2 (en) | 2021-01-29 | 2024-03-19 | Apple Inc. | User interfaces for record labels |
JP7120364B1 (en) * | 2021-03-15 | 2022-08-17 | 富士フイルムビジネスイノベーション株式会社 | Information processing device and program |
US12061863B2 (en) * | 2021-04-23 | 2024-08-13 | Samsung Electronics Co., Ltd. | Electronic device, and method for placing text-linked object in electronic device |
CN117836749A (en) * | 2021-08-31 | 2024-04-05 | 三星电子株式会社 | Electronic device for performing a function matching a graphical affordance and method of operating an electronic device |
Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5948040A (en) * | 1994-06-24 | 1999-09-07 | Delorme Publishing Co. | Travel reservation information and planning system |
US20040203902A1 (en) * | 2002-06-14 | 2004-10-14 | Brian Wilson | Data structures and methods for location-based services within a wireless network |
US20060007311A1 (en) * | 2004-06-09 | 2006-01-12 | Fuji Photo Film Co., Ltd. | Image mapping method and image mapping program |
US20070211151A1 (en) * | 2005-12-06 | 2007-09-13 | Sony Corporation | Image managing apparatus and image display apparatus |
US20070258642A1 (en) * | 2006-04-20 | 2007-11-08 | Microsoft Corporation | Geo-coding images |
US20080010605A1 (en) * | 2006-06-12 | 2008-01-10 | Metacarta, Inc. | Systems and methods for generating and correcting location references extracted from text |
US20080033642A1 (en) * | 2006-06-30 | 2008-02-07 | Aisin Aw Co., Ltd. | Navigation apparatuses, methods, and programs |
US20080092054A1 (en) * | 2006-10-17 | 2008-04-17 | Soujanya Bhumkar | Method and system for displaying photos, videos, rss and other media content in full-screen immersive view and grid-view using a browser feature |
US20080133526A1 (en) * | 2006-12-05 | 2008-06-05 | Palm, Inc. | Method and system for processing images using time and location filters |
US20080268876A1 (en) * | 2007-04-24 | 2008-10-30 | Natasha Gelfand | Method, Device, Mobile Terminal, and Computer Program Product for a Point of Interest Based Scheme for Improving Mobile Visual Searching Functionalities |
US20090119590A1 (en) * | 2007-11-05 | 2009-05-07 | Verizon Data Services Inc. | Interactive group content systems and methods |
US20100048242A1 (en) * | 2008-08-19 | 2010-02-25 | Rhoads Geoffrey B | Methods and systems for content processing |
US20100287195A1 (en) * | 2008-01-10 | 2010-11-11 | Koninklijke Philips Electronics N.V. | Method of searching in a collection of data items |
US20110099180A1 (en) * | 2009-10-22 | 2011-04-28 | Nokia Corporation | Method and apparatus for searching geo-tagged information |
US20110122132A1 (en) * | 2009-11-25 | 2011-05-26 | Electronics And Telecommunications Research Institute | Apparatus and method of managing objects and events with vector-based geographic information system |
US20130219322A1 (en) * | 2010-01-11 | 2013-08-22 | Apple Inc. | Electronic text manipulation and display |
US20130339891A1 (en) * | 2012-06-05 | 2013-12-19 | Apple Inc. | Interactive Map |
US20150007102A1 (en) * | 2013-06-28 | 2015-01-01 | Samsung Electronics Co., Ltd. | Method of displaying page and electronic device implementing the same |
US9026934B1 (en) * | 2011-09-29 | 2015-05-05 | Amazon Technologies, Inc. | Dynamic character biographies |
Family Cites Families (213)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3587625D1 (en) * | 1984-11-12 | 1993-11-18 | Advantest Corp | Logic analyzer. |
US7467137B1 (en) | 1994-09-02 | 2008-12-16 | Wolfe Mark A | System and method for information retrieval employing a preloading procedure |
JP3698273B2 (en) | 1995-07-20 | 2005-09-21 | ソニー株式会社 | Electronic program guide transmission apparatus and method, electronic program guide reception apparatus and method, and electronic program guide transmission / reception system and method |
US7124359B2 (en) | 1996-01-11 | 2006-10-17 | Canon Kabushiki Kaisha | Image edit device adapted to rapidly lay-out photographs into templates with means for preview and correction by user |
US5933525A (en) * | 1996-04-10 | 1999-08-03 | Bbn Corporation | Language-independent and segmentation-free optical character recognition system and method |
US5727129A (en) | 1996-06-04 | 1998-03-10 | International Business Machines Corporation | Network system for profiling and actively facilitating user activities |
US6562077B2 (en) | 1997-11-14 | 2003-05-13 | Xerox Corporation | Sorting image segments into clusters based on a distance measurement |
JP4183311B2 (en) | 1997-12-22 | 2008-11-19 | 株式会社リコー | Document annotation method, annotation device, and recording medium |
US6408128B1 (en) * | 1998-11-12 | 2002-06-18 | Max Abecassis | Replaying with supplementary information a segment of a video |
US7469381B2 (en) | 2007-01-07 | 2008-12-23 | Apple Inc. | List scrolling and document translation, scaling, and rotation on a touch-screen display |
US6847388B2 (en) | 1999-05-13 | 2005-01-25 | Flashpoint Technology, Inc. | Method and system for accelerating a user interface of an image capture unit during play mode |
US6421071B1 (en) | 1999-06-10 | 2002-07-16 | Lucent Technologies Inc. | Synchronous scrolling of time stamped log files |
US8397177B2 (en) * | 1999-07-22 | 2013-03-12 | Tavusi Data Solutions Llc | Graphic-information flow method and system for visually analyzing patterns and relationships |
US20010030667A1 (en) | 2000-04-10 | 2001-10-18 | Kelts Brett R. | Interactive display interface for information objects |
US20050055426A1 (en) | 2000-06-12 | 2005-03-10 | Kim Smith | System, method and computer program product that pre-caches content to provide timely information to a user |
US7002583B2 (en) * | 2000-08-03 | 2006-02-21 | Stono Technologies, Llc | Display of images and image transitions |
JP2004506349A (en) | 2000-08-04 | 2004-02-26 | コパン インコーポレイテッド | Method and system for displaying digital media |
US6934740B1 (en) | 2000-09-19 | 2005-08-23 | 3Com Corporation | Method and apparatus for sharing common data objects among multiple applications in a client device |
US20030046401A1 (en) | 2000-10-16 | 2003-03-06 | Abbott Kenneth H. | Dynamically determing appropriate computer user interfaces |
US20070226640A1 (en) | 2000-11-15 | 2007-09-27 | Holbrook David M | Apparatus and methods for organizing and/or presenting data |
US7181684B2 (en) | 2000-12-12 | 2007-02-20 | Oracle International Corporation | Dynamic tree control system |
US8166381B2 (en) | 2000-12-20 | 2012-04-24 | Heart Imaging Technologies, Llc | Medical image management system |
US7139982B2 (en) | 2000-12-21 | 2006-11-21 | Xerox Corporation | Navigation methods, systems, and computer program products for virtual three-dimensional books |
US20080082927A1 (en) * | 2000-12-22 | 2008-04-03 | Hillcrest Laboratories, Inc. | Methods and systems for personalizing a user interface |
US6985913B2 (en) * | 2000-12-28 | 2006-01-10 | Casio Computer Co. Ltd. | Electronic book data delivery apparatus, electronic book device and recording medium |
US6868528B2 (en) | 2001-06-15 | 2005-03-15 | Microsoft Corporation | Systems and methods for creating and displaying a user interface for displaying hierarchical data |
US7039879B2 (en) | 2001-06-28 | 2006-05-02 | Nokia Corporation | Method and apparatus for scrollable cross-point navigation in a user interface |
US20030046693A1 (en) | 2001-08-29 | 2003-03-06 | Digeo, Inc. | System and method for focused navigation within an interactive television user interface |
US7439975B2 (en) | 2001-09-27 | 2008-10-21 | International Business Machines Corporation | Method and system for producing dynamically determined drop shadows in a three-dimensional graphical user interface |
US7480864B2 (en) | 2001-10-12 | 2009-01-20 | Canon Kabushiki Kaisha | Zoom editor |
US6940497B2 (en) * | 2001-10-16 | 2005-09-06 | Hewlett-Packard Development Company, L.P. | Portable electronic reading apparatus |
US7312785B2 (en) | 2001-10-22 | 2007-12-25 | Apple Inc. | Method and apparatus for accelerated scrolling |
US20030093545A1 (en) * | 2001-11-14 | 2003-05-15 | Inventec Tomorrow Work Studio Corporation, Taiwan | Method and system for downloading data to portable electronic device |
US8539344B2 (en) | 2001-11-19 | 2013-09-17 | Ricoh Company, Ltd. | Paper-based interface for multimedia information stored by multiple multimedia documents |
US8635531B2 (en) | 2002-02-21 | 2014-01-21 | Ricoh Company, Ltd. | Techniques for displaying information stored in multiple multimedia documents |
US6948125B2 (en) | 2002-04-25 | 2005-09-20 | International Business Machines Corporation | Computer controlled user interactive display interface implementation for tracking the organization of items in a hierarchical tree of nested categories |
JP4082937B2 (en) | 2002-06-07 | 2008-04-30 | 任天堂株式会社 | GAME SYSTEM AND GAME PROGRAM |
US7441047B2 (en) | 2002-06-17 | 2008-10-21 | Microsoft Corporation | Device specific pagination of dynamically rendered data |
US20040001106A1 (en) | 2002-06-26 | 2004-01-01 | John Deutscher | System and process for creating an interactive presentation employing multi-media components |
US20040145603A1 (en) | 2002-09-27 | 2004-07-29 | Soares Stephen Michael | Online multimedia presentation builder and presentation player |
US6752174B2 (en) | 2002-10-03 | 2004-06-22 | Paul Eric Kristofferson | Safety plug |
US7769794B2 (en) * | 2003-03-24 | 2010-08-03 | Microsoft Corporation | User interface for a file system shell |
CA2525587C (en) | 2003-05-15 | 2015-08-11 | Comcast Cable Holdings, Llc | Method and system for playing video |
KR100500756B1 (en) | 2003-06-27 | 2005-07-11 | 주식회사 디엠에스 | Injector for a glass substrate processing of plat display panel |
US7360157B1 (en) | 2003-09-19 | 2008-04-15 | Microsoft Corporation | Aligning content in an electronic document |
US7743322B2 (en) | 2003-09-30 | 2010-06-22 | Hewlett-Packard Development Company, L.P. | Automatic photo album page layout |
CA2872357A1 (en) | 2004-01-21 | 2005-08-04 | Vernon W. Sparkes | Pivoting hitch assembly |
US7441204B2 (en) | 2004-02-06 | 2008-10-21 | Microsoft Corporation | Method and system for automatically displaying content of a window on a display that has changed orientation |
US7328411B2 (en) | 2004-03-19 | 2008-02-05 | Lexmark International, Inc. | Scrollbar enhancement for browsing data |
US7694233B1 (en) | 2004-04-30 | 2010-04-06 | Apple Inc. | User interface presentation of information in reconfigured or overlapping containers |
KR100601677B1 (en) | 2004-05-17 | 2006-07-14 | 삼성전자주식회사 | Method of reproducing along with data recorded on storage medium and downloaded data and apparatus thereof |
US7636891B2 (en) | 2004-08-31 | 2009-12-22 | Research In Motion Limited | Method for paginating a document structure of a document for viewing on a mobile communication device |
US20060059425A1 (en) | 2004-09-14 | 2006-03-16 | Anspach Mark S | Method and apparatus for enabling a user to select hierarchically arranged data in a graphical user interface |
US7890889B2 (en) | 2004-09-27 | 2011-02-15 | Nokia Corporation | User-interface application for media file management |
US8732610B2 (en) | 2004-11-10 | 2014-05-20 | Bt Web Solutions, Llc | Method and apparatus for enhanced browsing, using icons to indicate status of content and/or content retrieval |
US7512898B2 (en) | 2005-04-07 | 2009-03-31 | Microsoft Corporation | User interface with multi-state menu |
JP4533791B2 (en) | 2005-04-19 | 2010-09-01 | 株式会社日立製作所 | Information browsing device |
US20080052742A1 (en) * | 2005-04-26 | 2008-02-28 | Slide, Inc. | Method and apparatus for presenting media content |
JP2006323664A (en) | 2005-05-19 | 2006-11-30 | Sony Corp | Electronic equipment |
US7797641B2 (en) | 2005-05-27 | 2010-09-14 | Nokia Corporation | Mobile communications terminal and method therefore |
US7484182B1 (en) | 2005-06-30 | 2009-01-27 | Adobe Systems Incorporated | Rendition-based graphical layout management |
US7916157B1 (en) | 2005-08-16 | 2011-03-29 | Adobe Systems Incorporated | System and methods for selective zoom response behavior |
US20070073719A1 (en) | 2005-09-14 | 2007-03-29 | Jorey Ramer | Physical navigation of a mobile search application |
US20070088681A1 (en) | 2005-10-17 | 2007-04-19 | Veveo, Inc. | Method and system for offsetting network latencies during incremental searching using local caching and predictive fetching of results from a remote server |
US20070097089A1 (en) * | 2005-10-31 | 2007-05-03 | Battles Amy E | Imaging device control using touch pad |
US7689933B1 (en) | 2005-11-14 | 2010-03-30 | Adobe Systems Inc. | Methods and apparatus to preview content |
US8160400B2 (en) * | 2005-11-17 | 2012-04-17 | Microsoft Corporation | Navigating images using image based geometric alignment and object based controls |
US20070115300A1 (en) | 2005-11-23 | 2007-05-24 | Interactive Investments, Llc | System and method for creation of motor vehicle graphics |
US8006195B1 (en) | 2005-11-28 | 2011-08-23 | Meta Greek, LLC | Spectrum analyzer interface |
US7663620B2 (en) | 2005-12-05 | 2010-02-16 | Microsoft Corporation | Accessing 2D graphic content using axonometric layer views |
US8549442B2 (en) | 2005-12-12 | 2013-10-01 | Sony Computer Entertainment Inc. | Voice and video control of interactive electronically simulated environment |
US20080022229A1 (en) | 2005-12-23 | 2008-01-24 | Soujanya Bhumkar | Methods and systems for enhancing internet experiences using previews |
US7480870B2 (en) | 2005-12-23 | 2009-01-20 | Apple Inc. | Indication of progress towards satisfaction of a user input condition |
US8000741B2 (en) | 2006-02-13 | 2011-08-16 | Research In Motion Limited | Handheld wireless communication device with chamfer keys |
US7664739B2 (en) | 2006-02-14 | 2010-02-16 | Microsoft Corporation | Object search ui and dragging object results |
US7966573B2 (en) | 2006-02-17 | 2011-06-21 | Microsoft Corporation | Method and system for improving interaction with a user interface |
US8086332B2 (en) | 2006-02-27 | 2011-12-27 | Apple Inc. | Media delivery system with improved interaction |
US7724696B1 (en) * | 2006-03-29 | 2010-05-25 | Amazon Technologies, Inc. | Predictive reader power management |
US20070271367A1 (en) * | 2006-05-09 | 2007-11-22 | Zohar Yardeni | Systems and methods for location-based social web interaction and instant messaging system |
US7996788B2 (en) | 2006-05-18 | 2011-08-09 | International Apparel Group, Llc | System and method for navigating a dynamic collection of information |
US7844354B2 (en) | 2006-07-27 | 2010-11-30 | International Business Machines Corporation | Adjusting the volume of an audio element responsive to a user scrolling through a browser window |
JP4775179B2 (en) | 2006-08-28 | 2011-09-21 | ソニー株式会社 | Display scroll method, display device, and display program |
US7675518B1 (en) | 2006-09-05 | 2010-03-09 | Adobe Systems, Incorporated | System and method for generating image shadows with ray-coherent integration of extruded transparency maps |
US8564544B2 (en) | 2006-09-06 | 2013-10-22 | Apple Inc. | Touch screen device, method, and graphical user interface for customizing display of content category icons |
US7864163B2 (en) | 2006-09-06 | 2011-01-04 | Apple Inc. | Portable electronic device, method, and graphical user interface for displaying structured electronic documents |
US8564543B2 (en) | 2006-09-11 | 2013-10-22 | Apple Inc. | Media player with imaged based browsing |
US7689583B2 (en) | 2006-09-11 | 2010-03-30 | Microsoft Corporation | Flexible data presentation enabled by metadata |
GB2458037A (en) | 2006-09-22 | 2009-09-09 | Peter Walker | Method and system for selecting records from a database |
US7667719B2 (en) | 2006-09-29 | 2010-02-23 | Amazon Technologies, Inc. | Image-based document display |
US8725565B1 (en) * | 2006-09-29 | 2014-05-13 | Amazon Technologies, Inc. | Expedited acquisition of a digital item following a sample presentation of the item |
US7934194B2 (en) | 2006-10-17 | 2011-04-26 | The Mathworks, Inc. | User-defined hierarchies of user-defined classes of graphical objects in a graphical modeling environment |
US8473868B1 (en) | 2006-10-27 | 2013-06-25 | Arris Group, Inc. | System and method for reverse hierarchical navigation within a user interface |
US7663623B2 (en) | 2006-12-18 | 2010-02-16 | Microsoft Corporation | Spherical harmonics scaling |
AU2006252191B2 (en) | 2006-12-21 | 2009-03-26 | Canon Kabushiki Kaisha | Scrolling Interface |
US8276098B2 (en) | 2006-12-22 | 2012-09-25 | Apple Inc. | Interactive image thumbnails |
US8015581B2 (en) * | 2007-01-05 | 2011-09-06 | Verizon Patent And Licensing Inc. | Resource data configuration for media content access systems and methods |
US7844915B2 (en) * | 2007-01-07 | 2010-11-30 | Apple Inc. | Application programming interfaces for scrolling operations |
US20080222540A1 (en) | 2007-03-05 | 2008-09-11 | Apple Inc. | Animating thrown data objects in a project environment |
DE102007015099A1 (en) | 2007-03-29 | 2008-10-02 | Construction Research & Technology Gmbh | Paper valve bag with inner latch |
US7817823B1 (en) | 2007-04-27 | 2010-10-19 | Adobe Systems Incorporated | Calculating shadow from area light sources using a spatially varying blur radius |
US8065603B2 (en) | 2007-04-30 | 2011-11-22 | Google Inc. | Hiding portions of display content |
US8555186B2 (en) | 2007-05-08 | 2013-10-08 | Adobe Systems Incorporated | Interactive thumbnails for transferring content among electronic documents |
US20090013347A1 (en) | 2007-06-11 | 2009-01-08 | Gulrukh Ahanger | Systems and methods for reporting usage of dynamically inserted and delivered ads |
US8763058B2 (en) | 2007-06-28 | 2014-06-24 | Apple Inc. | Selective data downloading and presentation based on user interaction |
US9772751B2 (en) | 2007-06-29 | 2017-09-26 | Apple Inc. | Using gestures to slide between user interfaces |
WO2009026508A1 (en) | 2007-08-22 | 2009-02-26 | The Trustees Of Columbia University In The City Of New York | Methods, systems, and media for providing content-aware scrolling |
US8884981B2 (en) * | 2007-09-04 | 2014-11-11 | Apple Inc. | Dynamically reconfigurable graphics layer system and method |
US9477395B2 (en) | 2007-09-04 | 2016-10-25 | Apple Inc. | Audio file interface |
US8683378B2 (en) | 2007-09-04 | 2014-03-25 | Apple Inc. | Scrolling techniques for user interfaces |
JP5203655B2 (en) | 2007-09-07 | 2013-06-05 | キヤノン株式会社 | Content display device and display method thereof |
KR101542274B1 (en) | 2007-10-16 | 2015-08-06 | 힐크레스트 래보래토리스, 인크. | Fast and smooth scrolling of user interfaces operating on thin clients |
KR20090050577A (en) | 2007-11-16 | 2009-05-20 | 삼성전자주식회사 | User interface for displaying and playing multimedia contents and apparatus comprising the same and control method thereof |
US8416198B2 (en) | 2007-12-03 | 2013-04-09 | Apple Inc. | Multi-dimensional scroll wheel |
US9569086B2 (en) | 2007-12-12 | 2017-02-14 | Nokia Technologies Oy | User interface having realistic physical effects |
WO2009081478A1 (en) | 2007-12-21 | 2009-07-02 | Fujitsu Limited | Electronic device, control method, and program |
US8875023B2 (en) * | 2007-12-27 | 2014-10-28 | Microsoft Corporation | Thumbnail navigation bar for video |
US8373549B2 (en) * | 2007-12-31 | 2013-02-12 | Apple Inc. | Tactile feedback in an electronic device |
US20090199091A1 (en) * | 2008-02-01 | 2009-08-06 | Elmalik Covington | System for Electronic Display of Scrolling Text and Associated Images |
EP2469399B1 (en) | 2008-02-11 | 2019-09-11 | Idean Enterprises Oy | Layer-based user interface |
US9418171B2 (en) | 2008-03-04 | 2016-08-16 | Apple Inc. | Acceleration of rendering of web-based content |
US8997018B2 (en) | 2008-03-04 | 2015-03-31 | Synaptics Incorporated | Presenting a menu |
US20090249238A1 (en) | 2008-03-28 | 2009-10-01 | International Business Machines Corporation | Automated directing of data to an application |
US8117556B2 (en) | 2008-03-31 | 2012-02-14 | Vistaprint Technologies Limited | Target-alignment-and-drop control for editing electronic documents |
US8612888B2 (en) | 2008-04-01 | 2013-12-17 | Litl, Llc | Method and apparatus for managing digital media content |
US20090271731A1 (en) | 2008-04-27 | 2009-10-29 | Htc Corporation | Electronic device and user interface display method thereof |
AR071981A1 (en) | 2008-06-02 | 2010-07-28 | Spx Corp | WINDOW OF MULTIPLE PRESENTATION SCREENS WITH INPUT FOR CIRCULAR DISPLACEMENT |
US8423889B1 (en) | 2008-06-05 | 2013-04-16 | Amazon Technologies, Inc. | Device specific presentation control for electronic book reader devices |
WO2009152316A1 (en) | 2008-06-11 | 2009-12-17 | Teliris, Inc. | Surface computing collaboration system, method and apparatus |
US8516385B1 (en) | 2008-08-29 | 2013-08-20 | Adobe Systems Incorporated | Linking objects across states as shared objects |
US8279241B2 (en) | 2008-09-09 | 2012-10-02 | Microsoft Corporation | Zooming graphical user interface |
JP5346941B2 (en) | 2008-09-16 | 2013-11-20 | パナソニック株式会社 | Data display apparatus, integrated circuit, data display method, data display program, and recording medium |
US8194102B2 (en) * | 2008-10-06 | 2012-06-05 | Microsoft Corporation | Rendering annotations for images |
JP4683110B2 (en) | 2008-10-17 | 2011-05-11 | ソニー株式会社 | Display device, display method, and program |
US9928242B2 (en) | 2008-11-05 | 2018-03-27 | Oracle International Corporation | Managing the content of shared slide presentations |
US9201582B2 (en) * | 2008-11-11 | 2015-12-01 | Canon Kabushiki Kaisha | Display control apparatus and display control method |
KR101609162B1 (en) | 2008-11-13 | 2016-04-05 | 엘지전자 주식회사 | Mobile Terminal With Touch Screen And Method Of Processing Data Using Same |
US8365091B2 (en) | 2009-01-06 | 2013-01-29 | Microsoft Corporation | Non-uniform scrolling |
US8806371B2 (en) | 2009-03-26 | 2014-08-12 | Apple Inc. | Interface navigation tools |
US8812500B2 (en) * | 2009-04-24 | 2014-08-19 | Google Inc. | System and method of displaying related sites |
US8584027B2 (en) | 2009-06-02 | 2013-11-12 | Apple Inc. | Framework for designing physics-based graphical user interface |
US20120327009A1 (en) * | 2009-06-07 | 2012-12-27 | Apple Inc. | Devices, methods, and graphical user interfaces for accessibility using a touch-sensitive surface |
US8493344B2 (en) * | 2009-06-07 | 2013-07-23 | Apple Inc. | Devices, methods, and graphical user interfaces for accessibility using a touch-sensitive surface |
JP5172792B2 (en) * | 2009-07-31 | 2013-03-27 | 本田技研工業株式会社 | Membrane-electrode structure for polymer electrolyte fuel cell and polymer electrolyte fuel cell |
JP2011059820A (en) * | 2009-09-07 | 2011-03-24 | Sony Corp | Information processing apparatus, information processing method and program |
KR20110028834A (en) | 2009-09-14 | 2011-03-22 | 삼성전자주식회사 | Method and apparatus for providing user interface using touch pressure on touch screen of mobile station |
US8416262B2 (en) * | 2009-09-16 | 2013-04-09 | Research In Motion Limited | Methods and devices for displaying an overlay on a device display screen |
US8624933B2 (en) | 2009-09-25 | 2014-01-07 | Apple Inc. | Device, method, and graphical user interface for scrolling a multi-section document |
JP2011108186A (en) | 2009-11-20 | 2011-06-02 | Sony Corp | Apparatus, method, and program for processing information |
US9081464B2 (en) | 2009-11-20 | 2015-07-14 | Adobe Systems Incorporated | Object selection |
US20110122159A1 (en) | 2009-11-20 | 2011-05-26 | Sony Ericsson Mobile Communications Ab | Methods, devices, and computer program products for providing multi-region touch scrolling |
CN102096674B (en) * | 2009-12-11 | 2014-01-01 | 华为技术有限公司 | Method, equipment and system for releasing and downloading electronic book |
US20110157051A1 (en) | 2009-12-25 | 2011-06-30 | Sanyo Electric Co., Ltd. | Multilayer display device |
US20110161818A1 (en) | 2009-12-29 | 2011-06-30 | Nokia Corporation | Method and apparatus for video chapter utilization in video player ui |
US8949734B2 (en) | 2010-01-04 | 2015-02-03 | Verizon Patent And Licensing Inc. | Mobile device color-based content mapping and navigation |
US8698762B2 (en) * | 2010-01-06 | 2014-04-15 | Apple Inc. | Device, method, and graphical user interface for navigating and displaying content in context |
US8736561B2 (en) | 2010-01-06 | 2014-05-27 | Apple Inc. | Device, method, and graphical user interface with content display modes and display rotation heuristics |
US8438504B2 (en) | 2010-01-06 | 2013-05-07 | Apple Inc. | Device, method, and graphical user interface for navigating through multiple viewing areas |
US8499236B1 (en) * | 2010-01-21 | 2013-07-30 | Amazon Technologies, Inc. | Systems and methods for presenting reflowable content on a display |
KR101087479B1 (en) | 2010-01-29 | 2011-11-25 | 주식회사 팬택 | Multi display device and method for controlling the same |
US9417787B2 (en) | 2010-02-12 | 2016-08-16 | Microsoft Technology Licensing, Llc | Distortion effects to indicate location in a movable data collection |
US8826141B2 (en) * | 2010-02-12 | 2014-09-02 | Blackberry Limited | Image-based and predictive browsing |
US8539384B2 (en) | 2010-02-25 | 2013-09-17 | Microsoft Corporation | Multi-screen pinch and expand gestures |
US8799658B1 (en) | 2010-03-02 | 2014-08-05 | Amazon Technologies, Inc. | Sharing media items with pass phrases |
US9176748B2 (en) | 2010-03-25 | 2015-11-03 | Apple Inc. | Creating presentations using digital media content |
JP5329465B2 (en) | 2010-03-30 | 2013-10-30 | ルネサスエレクトロニクス株式会社 | Level voltage selection circuit, data driver and display device |
US8930498B2 (en) | 2010-03-31 | 2015-01-06 | Bank Of America Corporation | Mobile content management |
US8990702B2 (en) | 2010-09-30 | 2015-03-24 | Yahoo! Inc. | System and method for controlling a networked display |
US8448084B2 (en) | 2010-04-08 | 2013-05-21 | Twitter, Inc. | User interface mechanics |
US9501582B2 (en) | 2010-05-10 | 2016-11-22 | Amazon Technologies, Inc. | Providing text content embedded with protected multimedia content |
US8131898B2 (en) | 2010-05-27 | 2012-03-06 | Adobe Systems Incorporated | Event handling in an integrated execution environment |
US20110291964A1 (en) | 2010-06-01 | 2011-12-01 | Kno, Inc. | Apparatus and Method for Gesture Control of a Dual Panel Electronic Device |
US9542091B2 (en) | 2010-06-04 | 2017-01-10 | Apple Inc. | Device, method, and graphical user interface for navigating through a user interface using a dynamic object selection indicator |
US8819557B2 (en) * | 2010-07-15 | 2014-08-26 | Apple Inc. | Media-editing application with a free-form space for organizing or compositing media clips |
TWI427350B (en) | 2010-07-27 | 2014-02-21 | Tdk Taiwan Corp | Electromagnetic driving apparatus for lens |
US20120105489A1 (en) | 2010-10-28 | 2012-05-03 | Marshall Monroe | Method and Apparatus for Organizing and Delivering Digital Media Content and Interactive Elements |
US8997025B2 (en) | 2010-11-24 | 2015-03-31 | Fuji Xerox Co., Ltd. | Method, system and computer readable medium for document visualization with interactive folding gesture technique on a multi-touch display |
US9183653B2 (en) | 2010-12-14 | 2015-11-10 | Microsoft Technology Licensing, Llc | Extensions for modifying a graphical object to display data |
US9529866B2 (en) | 2010-12-20 | 2016-12-27 | Sybase, Inc. | Efficiently handling large data sets on mobile devices |
US9052806B2 (en) | 2010-12-20 | 2015-06-09 | Facebook, Inc. | User interface for presenting media items of social networking service in media reel |
US8140404B1 (en) | 2011-01-14 | 2012-03-20 | Amazon Technologies, Inc. | Browsing with static pages |
US9671825B2 (en) | 2011-01-24 | 2017-06-06 | Apple Inc. | Device, method, and graphical user interface for navigating through an electronic document |
US8694903B2 (en) | 2011-03-04 | 2014-04-08 | Verizon Patent And Licensing Inc. | Methods and systems for managing an e-reader interface |
US9075493B2 (en) | 2011-03-07 | 2015-07-07 | Sas Institute, Inc. | Techniques to present hierarchical information using orthographic projections |
US10007402B2 (en) | 2011-03-09 | 2018-06-26 | Apple Inc. | System and method for displaying content |
US9558013B2 (en) | 2011-04-12 | 2017-01-31 | Citrix Systems, Inc. | Responsive scroller controls in server-hosted applications |
US20120266103A1 (en) | 2011-04-15 | 2012-10-18 | Google Inc. | Method and apparatus of scrolling a document displayed in a browser window |
US20120272171A1 (en) | 2011-04-21 | 2012-10-25 | Panasonic Corporation | Apparatus, Method and Computer-Implemented Program for Editable Categorization |
US9182897B2 (en) | 2011-04-22 | 2015-11-10 | Qualcomm Incorporated | Method and apparatus for intuitive wrapping of lists in a user interface |
WO2012147579A1 (en) * | 2011-04-26 | 2012-11-01 | シャープ株式会社 | Display device, display method, display program, and processor |
US8812658B1 (en) * | 2011-05-20 | 2014-08-19 | Amazon Technologies, Inc. | Pre-fetching of network page content |
US8893184B2 (en) | 2011-07-15 | 2014-11-18 | Intel Corporation | Mechanism for facilitating multiple multimedia viewing planes in media display systems |
RU2014110393A (en) * | 2011-08-19 | 2015-09-27 | Эппл Инк. | INTERACTIVE CONTENT FOR DIGITAL BOOKS |
EP2592828A1 (en) * | 2011-11-09 | 2013-05-15 | OpenTV, Inc. | Apparatus and method for navigating an electronic program guide |
US20130073364A1 (en) * | 2011-09-16 | 2013-03-21 | Ysk Media Ltd. | Method of Downloading Contents |
GB201118784D0 (en) | 2011-10-31 | 2011-12-14 | Omnifone Ltd | Djml |
EP2587361A3 (en) | 2011-10-25 | 2016-05-11 | Samsung Electronics Co., Ltd | Method and apparatus for displaying e-book in terminal having function of e-book reader |
US9324183B2 (en) | 2011-11-29 | 2016-04-26 | Apple Inc. | Dynamic graphical interface shadows |
US9400600B2 (en) | 2011-12-16 | 2016-07-26 | Samsung Electronics Co., Ltd. | Method, apparatus, and graphical user interface for providing visual effects on a touchscreen display |
US8718613B2 (en) | 2012-01-17 | 2014-05-06 | Daniel TOW | Remote viewing apparatus for smartphone |
US8930992B2 (en) * | 2012-01-19 | 2015-01-06 | Sony Corporation | TV social network advertising |
US9557876B2 (en) | 2012-02-01 | 2017-01-31 | Facebook, Inc. | Hierarchical user interface |
US9235318B2 (en) | 2012-02-01 | 2016-01-12 | Facebook, Inc. | Transitions among hierarchical user-interface layers |
US9645724B2 (en) | 2012-02-01 | 2017-05-09 | Facebook, Inc. | Timeline based content organization |
KR102024587B1 (en) | 2012-02-02 | 2019-09-24 | 엘지전자 주식회사 | Mobile terminal and method for controlling thereof |
WO2013134854A1 (en) | 2012-03-13 | 2013-09-19 | Cognilore Inc. | Method of navigating through digital content |
US9454303B2 (en) * | 2012-05-16 | 2016-09-27 | Google Inc. | Gesture touch inputs for controlling video on a touchscreen |
US8904304B2 (en) | 2012-06-25 | 2014-12-02 | Barnesandnoble.Com Llc | Creation and exposure of embedded secondary content data relevant to a primary content page of an electronic book |
US9880703B2 (en) | 2012-08-07 | 2018-01-30 | Nook Digital, Llc | Electronic bookshelf system |
US9569083B2 (en) | 2012-12-12 | 2017-02-14 | Adobe Systems Incorporated | Predictive directional content queue |
US20140258849A1 (en) | 2013-03-06 | 2014-09-11 | Google Inc. | Automatic Alignment of a Multi-Dimensional Layout |
US9317188B2 (en) | 2013-03-15 | 2016-04-19 | Arris Enterprises, Inc. | Devices and methods for providing navigation images associated with adaptive bit rate video content |
KR102131824B1 (en) | 2013-05-14 | 2020-07-09 | 엘지전자 주식회사 | Display device and method for controlling the same |
US9542407B2 (en) * | 2013-09-30 | 2017-01-10 | Blackberry Limited | Method and apparatus for media searching using a graphical user interface |
-
2012
- 2012-06-04 US US13/488,076 patent/US9235318B2/en not_active Expired - Fee Related
- 2012-06-04 US US13/488,039 patent/US9229613B2/en active Active
- 2012-06-04 US US13/487,765 patent/US9235317B2/en active Active
- 2012-06-04 US US13/487,805 patent/US9552147B2/en active Active
- 2012-06-05 US US13/489,172 patent/US20130198261A1/en not_active Abandoned
- 2012-06-05 US US13/489,265 patent/US8984428B2/en active Active
- 2012-06-06 US US13/490,343 patent/US8990691B2/en active Active
- 2012-06-06 US US13/490,367 patent/US20130198668A1/en not_active Abandoned
- 2012-06-07 US US13/491,100 patent/US9239662B2/en active Active
- 2012-06-07 US US13/490,736 patent/US9003305B2/en active Active
- 2012-07-23 US US13/555,657 patent/US8990719B2/en active Active
- 2012-07-23 US US13/555,876 patent/US9606708B2/en active Active
- 2012-07-23 US US13/555,845 patent/US8976199B2/en active Active
- 2012-07-23 US US13/555,909 patent/US9098168B2/en not_active Expired - Fee Related
- 2012-07-23 US US13/555,607 patent/US9007371B2/en active Active
-
2014
- 2014-12-12 US US14/569,475 patent/US20150100924A1/en not_active Abandoned
- 2014-12-16 US US14/572,405 patent/US10775991B2/en active Active
-
2015
- 2015-12-07 US US14/961,227 patent/US10613733B2/en active Active
-
2017
- 2017-01-23 US US15/412,347 patent/US20170131889A1/en not_active Abandoned
- 2017-02-01 US US15/421,725 patent/US20170192661A1/en not_active Abandoned
- 2017-03-27 US US15/470,652 patent/US20170199641A1/en not_active Abandoned
-
2020
- 2020-03-20 US US16/824,893 patent/US11132118B2/en active Active
Patent Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5948040A (en) * | 1994-06-24 | 1999-09-07 | Delorme Publishing Co. | Travel reservation information and planning system |
US20040203902A1 (en) * | 2002-06-14 | 2004-10-14 | Brian Wilson | Data structures and methods for location-based services within a wireless network |
US20060007311A1 (en) * | 2004-06-09 | 2006-01-12 | Fuji Photo Film Co., Ltd. | Image mapping method and image mapping program |
US20070211151A1 (en) * | 2005-12-06 | 2007-09-13 | Sony Corporation | Image managing apparatus and image display apparatus |
US20070258642A1 (en) * | 2006-04-20 | 2007-11-08 | Microsoft Corporation | Geo-coding images |
US20080010605A1 (en) * | 2006-06-12 | 2008-01-10 | Metacarta, Inc. | Systems and methods for generating and correcting location references extracted from text |
US20080033642A1 (en) * | 2006-06-30 | 2008-02-07 | Aisin Aw Co., Ltd. | Navigation apparatuses, methods, and programs |
US20080092054A1 (en) * | 2006-10-17 | 2008-04-17 | Soujanya Bhumkar | Method and system for displaying photos, videos, rss and other media content in full-screen immersive view and grid-view using a browser feature |
US20080133526A1 (en) * | 2006-12-05 | 2008-06-05 | Palm, Inc. | Method and system for processing images using time and location filters |
US20080268876A1 (en) * | 2007-04-24 | 2008-10-30 | Natasha Gelfand | Method, Device, Mobile Terminal, and Computer Program Product for a Point of Interest Based Scheme for Improving Mobile Visual Searching Functionalities |
US20090119590A1 (en) * | 2007-11-05 | 2009-05-07 | Verizon Data Services Inc. | Interactive group content systems and methods |
US20100287195A1 (en) * | 2008-01-10 | 2010-11-11 | Koninklijke Philips Electronics N.V. | Method of searching in a collection of data items |
US20100048242A1 (en) * | 2008-08-19 | 2010-02-25 | Rhoads Geoffrey B | Methods and systems for content processing |
US20110099180A1 (en) * | 2009-10-22 | 2011-04-28 | Nokia Corporation | Method and apparatus for searching geo-tagged information |
US20110122132A1 (en) * | 2009-11-25 | 2011-05-26 | Electronics And Telecommunications Research Institute | Apparatus and method of managing objects and events with vector-based geographic information system |
US20130219322A1 (en) * | 2010-01-11 | 2013-08-22 | Apple Inc. | Electronic text manipulation and display |
US9026934B1 (en) * | 2011-09-29 | 2015-05-05 | Amazon Technologies, Inc. | Dynamic character biographies |
US20130339891A1 (en) * | 2012-06-05 | 2013-12-19 | Apple Inc. | Interactive Map |
US20150007102A1 (en) * | 2013-06-28 | 2015-01-01 | Samsung Electronics Co., Ltd. | Method of displaying page and electronic device implementing the same |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9098168B2 (en) | 2012-02-01 | 2015-08-04 | Facebook, Inc. | Spring motions during object animation |
US9229613B2 (en) | 2012-02-01 | 2016-01-05 | Facebook, Inc. | Transitions among hierarchical user interface components |
US9235317B2 (en) | 2012-02-01 | 2016-01-12 | Facebook, Inc. | Summary and navigation of hierarchical levels |
US9235318B2 (en) | 2012-02-01 | 2016-01-12 | Facebook, Inc. | Transitions among hierarchical user-interface layers |
US9239662B2 (en) | 2012-02-01 | 2016-01-19 | Facebook, Inc. | User interface editor |
US9552147B2 (en) | 2012-02-01 | 2017-01-24 | Facebook, Inc. | Hierarchical user interface |
US9557876B2 (en) | 2012-02-01 | 2017-01-31 | Facebook, Inc. | Hierarchical user interface |
US9606708B2 (en) | 2012-02-01 | 2017-03-28 | Facebook, Inc. | User intent during object scrolling |
US10775991B2 (en) | 2012-02-01 | 2020-09-15 | Facebook, Inc. | Overlay images and texts in user interface |
US11132118B2 (en) | 2012-02-01 | 2021-09-28 | Facebook, Inc. | User interface editor |
US11886441B2 (en) * | 2020-10-30 | 2024-01-30 | Snowflake Inc. | Tag-based data governance auditing system |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9003305B2 (en) | Folding and unfolding images in a user interface | |
US10015121B2 (en) | Smart positioning of chat heads | |
US9569062B2 (en) | Asynchronous execution of animation tasks for a GUI | |
US9696898B2 (en) | Scrolling through a series of content items | |
US9152173B2 (en) | Transparent display device | |
US20150339006A1 (en) | Asynchronous Preparation of Displayable Sections of a Graphical User Interface | |
KR20140126327A (en) | Thumbnail-image selection of applications | |
TWI847342B (en) | Methods and systems for presenting media content with multiple media elements in an editing environment | |
TW202325031A (en) | Methods and systems for presenting media content with multiple media elements in an editing environment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: META PLATFORMS, INC., CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:FACEBOOK, INC.;REEL/FRAME:058750/0660 Effective date: 20211028 |