New! View global litigation for patent families

US20050190273A1 - System and method for exchanging images - Google Patents

System and method for exchanging images Download PDF

Info

Publication number
US20050190273A1
US20050190273A1 US11118515 US11851505A US2005190273A1 US 20050190273 A1 US20050190273 A1 US 20050190273A1 US 11118515 US11118515 US 11118515 US 11851505 A US11851505 A US 11851505A US 2005190273 A1 US2005190273 A1 US 2005190273A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
client
image
server
user
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11118515
Inventor
Kentaro Toyama
David Vronay
Padmanabhan Anandan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network-specific arrangements or communication protocols supporting networked applications
    • H04L67/30Network-specific arrangements or communication protocols supporting networked applications involving profiles
    • H04L67/306User profiles
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/30Information retrieval; Database structures therefor ; File system structures therefor
    • G06F17/30244Information retrieval; Database structures therefor ; File system structures therefor in image databases
    • G06F17/30265Information retrieval; Database structures therefor ; File system structures therefor in image databases based on information manually generated or based on information not derived from the image data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00137Transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00148Storage
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00169Digital image input
    • H04N1/00172Digital image input directly from a still digital camera or from a storage medium mounted in a still digital camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00204Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server
    • H04N1/00244Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture with a digital computer or a digital computer system, e.g. an internet server with a server, e.g. an internet server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/92Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/9201Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving the multiplexing of an additional signal and the video signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/781Television signal recording using magnetic recording on disks or drums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/84Television signal recording using optical recording
    • H04N5/85Television signal recording using optical recording on discs or drums
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/907Television signal recording using static stores, e.g. storage tubes, semiconductor memories
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99931Database or file accessing
    • Y10S707/99933Query processing, i.e. searching

Abstract

A system and method for providing a peer-to-peer photo-sharing environment. The system includes: manual and automatic photo annotation at the client; periodic client-server synchronization; an index of client photos on a central server or a photo database that is resident on the central server, which is updated by the client-server synchronization function; end-user search functionality to search the centralized index or photo database; and transmission of the relevant photos to the client via an on-line image cache. In one embodiment, one client's new photos are automatically displayed on another client's computer (e.g., via screen saver or another mechanism).

Description

    BACKGROUND OF INVENTION
  • [0001]
    1. Technical Field
  • [0002]
    The invention is related to a system and method of providing an image-sharing environment.
  • [0003]
    2. Background Art
  • [0004]
    Digital Photo and Video technology promises to enhance our use of photographs and video by making them easy to store, access, and share. (Henceforth, all further references to “photos” or “photographs” should be considered shorthand for “photos and videos.”) Recent advances in media management and story telling have helped to deliver on this promise, but much work still remains.
  • [0005]
    The current model of photo sharing is through the use of online photo sharing websites. To share photographs on these websites, the user uploads copies of their photos to the hosting server, and their friends and family can view them by downloading them to their own computer or by viewing them while still resident on the server.
  • [0006]
    The current model of photo sharing is undesirable for several reasons. For example, the user already has the photos on their personal computer. Uploading them to a server is a slow and tedious additional step. In addition, many computer users that might like to share photographs are not computer savvy enough to upload them to the server.
  • [0007]
    As digital cameras become more affordable and digital photographs and images become more popular, more users will want to share photographs. At present, most servers impose a limit on the amount of space a user can use for photo-sharing typically, around 30 megabytes per user. As more and more users begin to use the available photo-sharing sites, servers will have to cut down on storage allotments to support more users. This problem is compounded by the fact that printers and displays are supporting higher and higher resolution images (and hence much greater sized files), so that each user has a larger number of higher resolution images that they want to share, yet less storage allotment is available for each user to share these photos. As the quality of digital images improves, and greater resolutions and file sizes result, this problem is sure to worsen.
  • [0008]
    Furthermore, most current photo-sharing systems are server-based, meaning that the images reside in a database on a server. The server model introduces a whole new level of management headache. The user must remember where on their computer their photographs are located to upload them to the server. If the user modifies a photograph—color corrects it, crops it, or removes red-eye—the user must remember to update it both on his local machine and on the photo site. Additionally, other users must be made aware that the photograph has changed. Other users too must know how to get to the site and how to find the modified image once there.
  • [0009]
    Another issue related to photo sites that allow sharing of photographs on the Internet is that photos are normally thought of as being extremely personal items. People are often hesitant to load their personal pictures up to a large server database, accessible to the entire world. For instance, pictures of one's children or pictures of the inside of one's home are typically held more closely than pictures of famous monuments or pictures of scenery taken on a family vacation. Most people do not want pictures of their children or family posted where they are available to anyone with access to the site.
  • [0010]
    Another problem associated with the management of photos is related to their indexing, search and retrieval. Consumer research has found that the organization and retrieval of photos and other digital images is a great source of frustration to many users of photo-sharing sites. There are a number of image management products that allow a user to search and retrieve visual information based on annotations associated with images. They allow a user to sort media by name, file type, or folder and browse through files as thumbnails or as textual lists. Some such image management products allow a user to perform key-word searches. They search the images based on keywords entered by the user and retrieve the images based on annotations or ‘metadata’ associated with each image. Metadata is basically data about data. For example, the title, subject, author, creation date, location, subject and size of a file constitute metadata about that file. The disadvantage with using this keyword scheme for image data retrieval is that it usually means that keywords and textual annotations must be manually entered for each image file. This is very time-consuming and labor-intensive. Additionally, for a search engine to identify an image based on such annotations, much annotation data must be entered for each image to increase the likelihood of obtaining a match between a user-entered keyword and an annotation related to a particular image.
  • [0011]
    Peer-to-Peer (P2P) is a much better model for sharing photographs and other images. The user can keep their photographs on their own computer, where they already are. Server storage limitations and problems related to updating multiple copies in different stores are resolved. The user can leverage existing “buddy lists” from Instant Messaging software to manage distribution of the photographs to selected circles of friends. A famous P2P file sharing system is Napster, where users exchange audio files over the Internet, each user maintaining their audio files on their own computer. The Napster servers maintain an index of all audio files and associated users that are on-line at a given time. The obvious problem with this P2P approach is that the two peers might not have their machines on at the same time.
  • [0012]
    For most people, having P2P ready access to a larger number of photos could enable many exciting new scenarios. For example, it could allow pictures of growing children to be automatically sent to a small circle of “photo” friends, conceivably as a screen saver that would automatically appear on these users computers automatically. However, If it were possible to at least potentially have access to a large number of peers, instead of Just the small circle of people, the possibilities grow. At first this seems like a useless feature for a photo database. After all, why would someone.want to look at the vacation photos from someone they didn't know? It is true that images are taken to capture a specific emotional, social moment. And it is further true that sharing this moment has historically been the primary use of photography. However, photographs also have another property: a photo is taken at a particular moment at a particular location. And this property in itself, when extracted over a large number of photos, can become as important as the emotional context. It can, in fact, be used to enable a broad range of completely new photo capabilities. For instance, if every photograph ever taken was available in a single worldwide database, and could be queried by the date and location where it was taken, many useful scenarios can be envisioned. A traveler planning to go to Rome in February could look at all of the photos taken in Rome in February to determine what the weather is like there that time of year. It could allow people to see pictures of a newsworthy or entertainment event that occurred. It could allow people to locate photos of themselves at a particular place or event. It could allow people to independently verify images in advertisements such as what a particular hotel looks like.
  • [0013]
    Therefore, what is needed is a system and method for allowing users to easily share photos with a specific small group of people, a larger group of people, or the whole world. It should overcome the difficulties of loading a user's photos to a server database. It should overcome server storage limitations, and it should ensure that photographs/images throughout the system are updated when one copy of the photograph/image is updated. Furthermore, it should ensure that available photos are easily locatable by all users, and allow transfer of photos even when users desiring to exchange photos are not on-line at the same time. Last but not least, it should allow the user to maintain the desired level of privacy with respect to their photographs/images and limit access to them accordingly. A system and method that encourages user to share a greater number of images would provide for a system that allows photographs and other images to provide more utility than just their social and emotional benefits.
  • SUMMARY OF INVENTION
  • [0014]
    The system and method according to the present invention solves the problems associated with sharing photographs and other images on-line. It allows a user to easily share images with a specific small group of people, a larger group of people, or the whole world. It allows a user to keep the images on his or her own computer, vice a server, thereby overcoming problems associated with downloading the images to a website. It overcomes server storage limitations, resolves photo management/update issues, and provides for a less labor-intensive image annotation scheme. It also adequately addresses privacy concerns through a sophisticated access design.
  • [0015]
    The system and method according to the present invention provides for a peer-to-peer photo-sharing environment. The system and method according to the present invention includes: manual and automatic image annotation at the client; a periodic client-server synchronization; an master index of client photographs or images on a central server or a photo database that is resident on the central server, which is updated by the client-server synchronization function; end-user search functionality to search the master index or photo database; and transmission of images from one client to another client. In one embodiment, one client's new photographs are automatically displayed on another client's computer (e.g., via screen saver or another mechanism).
  • [0016]
    It should be noted that even though the traditional server-client photo-exchange system, where images are hosted on the server, have a multitude of drawbacks as discussed above, even these systems can be improved with many of the novel features of the present invention. Many of these novel features can also be used in a distributed file-sharing system wherein files belonging to one user may be replicated, encrypted, cut up, and stored on any of a number of computers belonging to the same computer network. Distributed file-sharing systems nevertheless present a seamless, transparent file and directory structure to the user such that the underlying mechanisms of file distribution are not explicitly visible to the user.
  • [0017]
    In general, the system and method according to the present invention includes a central server, one or more clients, and an on-line image/photo cache (Photograph and image will be used here interchangeably, as it should be understood that the present invention applies to all images, including video and other forms of digital imagery, not just digital photographs). These components can be arranged in various configurations.
  • [0018]
    Each client periodically connects to the Internet or other network hosting the photo-sharing system of the present invention. A local image index (a list of the images on their computer) and an image database are hosted on each client. The client provides images for image-sharing and typically searches a master image/photo index, containing all images available for sharing, for images/photographs that they would like to download.
  • [0019]
    The central server is on-line on the Internet or on another more localized network. It can host a master index of photographs/images or, alternately, the central server can employ a database of photographs/images that reside on the central server itself. The central server responds to client queries of the master index or database. The central server can store requested images to an on-line photo/image cache. This on-line cache is live on the Internet or other network. Typically, the central server sends images extracted from its master photo database or another client to the photo cache so that a requesting client can download these images. To do this, the server coordinates the transfer of one or more images requested by a client to the on-line photo cache and then coordinates transfer of the image(s) from the on-line photo cache to the client who requested it/them. Storing images to the cache solves two problems. It allows for quicker transfer of the requested images to the requesting client, since popular images can remain cached and cache memory is always faster than main RAM memory. Additionally, use of the cache allows for transfer of images between peers (client to client) even when both clients are not present on the Internet or other network at the same time.
  • [0020]
    It should be noted that if both clients (the client requesting the image and the client hosting the image) are on-line at the same time the two clients can transfer the image(s) in question directly, without use of the cache. That is, if both clients are on the network or Internet at the same time the transfer can be done P2P, without going through the server. Users can, however, disable the P2P feature on their computers or limit the P2P transfer to user's on their “buddy list”, a circle of “photo friends” similar to that found in Instant Messaging applications. If the central server is configured with an image database containing all users images, instead of just a master index, it can also transfer images directly from its database to the requesting client/user, without employing use of the cache.
  • [0021]
    The invention employs a periodic client-server synchronization schema. The index of client photos that resides on the central server, or the photo database of the central server, is updated by the client-server synchronization function.
  • [0022]
    The system and method according to the present invention can include manual and automatic photo annotation at the user or client. These annotations are commonly referred to as metadata. This annotation data, or metadata, allows the user to effectively search and control access to the photo index or photo database. The metadata can include: the title, subject, author, creation date and time, location, subject and size of a file, level of privacy associated with the image, modification history, usage statistics (the number of times it was requested, posted, emailed), user rating, any and all user annotations, owner of the metadata and so on. Additionally, the owner of the metadata can be different from the owner of the photo that is, a different user can control a photo's metadata than the user that hosts the photo on their computer or the user that created the photograph.
  • [0023]
    Automatic annotations made by the system include the use face recognition techniques to identify a specific person within the images, automated vision techniques to determine whether an image is natural or man-made, and pixel comparison techniques using images of known type and origin. Additionally, the system and method according to the present invention automatically extracts various parameters of associated with the image, as available, such as creation date and time, location, size of file, and so on. Another automated annotation feature used by system is through the use of image hashing. That is, the system detects multiple images of the same object and combines metadata from the various sources to better annotate each of the images.
  • [0024]
    The system and method according to the present invention can include access control of images requested by the user or client. This access control is performed by using the metadata to control the search by the requesting client of the index or image/photo database. That is, metadata can be used to make certain images not available to certain users. The access control via metadata can also be made user-specific, governed by a user's “buddy list”, a circle of user's that grant each other access to each other's photographs. The user also has some control as to access of his or her images and photographs. They can annotate each photograph with a different level of privacy, e.g., share with no one, share with some, and provide access to everyone. Therefore, the system and method according to the present invention actually limits access in two ways. First by using the user's privacy designation, and secondly by simply not searching for metadata when the search criteria are determined to be inaccessible to a particular user, or any user for that matter.
  • [0025]
    The various system configurations having been discussed above, the primary tasks performed by the system and method according to the present invention include: 1) image annotation; 2) synchronization of the central server with the client(s); 3) search and access and 4) image transfer.
  • [0026]
    A small photo exchange software application is always running in the background on the client, handled by a shell. This photo exchange application checks for new images being added and old images being taken away at the client. The client maintains its own local database of the images and a local index, and preserves a change log that records the alterations made to the database and the index since the last central server-client synchronization. When new images have been detected at the client, the system prompts the user to annotate them. Many types of metadata are possible. Some types of metadata utilized by the system and method according to the present invention are: 1) the date and time the image was taken; 2) the location on earth where the picture was taken and the orientation of the camera when the picture was taken; 3) the level of privacy associated with the image; 4) the author of the image; 5) modification history; 6) user rating; 7) system imputed location based on time a photo was taken; 8) usage statistics (e.g., how often and when an image was posted; how often an image was emailed, how relevant an image was found to be in a search); 9) any and all user annotations; 10) the owner of the metadata.
  • [0027]
    All changes to the client's database and index are kept in a change log. Periodically, the client will connect to the central server. When it does, the local database synchronizes with the server's master index. Images are added and subtracted from the server's master index, and metadata is be updated. Note that metadata can come from the server to the client, as well as from the client to the central server. Additionally, all metadata can reside on the central server, or just some portions of the metadata.
  • [0028]
    In one embodiment of the invention, data on the server is aged. If a user does not synchronize with the server for a long time, the relevance of their images will start to decrease. Eventually, their data will be removed entirely. This feature addresses the issue of one client requesting images from another client that never synchronizes with the central server.
  • [0029]
    In one embodiment of the present invention the client has four ways of primary ways of searching the database. These are: 1) by user; 2) by space-time; 3) by event; and 4) by key. Where applicable, these searches can be combined.
  • [0030]
    Additionally, automatic keys that use advanced imaging technology, such as “indoor vs. outdoor” and “natural vs. man-made” can be used. To perform the search, the user (via the client) searches the master index or master database in order to search for photos meeting the desired criteria. To do this, the client connects to the central server. The user creates a query of the central server's master index or master database (if such a database is employed in that particular embodiment of the invention). This query is sent to the central server. The central server sends the search results to the client. Each search can return, but is not limited to, in any combination, 1) the metadata of the photo; 2) a thumbnail of the photo; 3) relevancy to the current query; and 4) whether the owner is connected, and if so, at what speed, and if not, when they last connected.
  • [0031]
    If a user is on another user's photo “buddy list” (similar to that commonly found in instant messaging software), the user can search that user's computer for photographs or images directly. Various photo “buddy lists” can exist for each user, each providing a different level of access to image data.
  • [0032]
    Once a search is complete, the user can give feedback on the search, indicating which images they thought closes matched their search criteria. This is added to the images' metadata, and used to weight their relevance in future searches. The hope is that over the long-term, a photo that is mislabeled or misannotated will eventually get several low votes, and the image's owner will correct the mislabeling.
  • [0033]
    If the user wants to get a particular image or photograph from the query result, he requests it from the central server. At the time the request is made, the user can also request a particular size. By default, the photo comes at its natural size. The user request is sent to the central server. The central server then queues the request, and waits for the client that owns the photo to synchronize with it. When a client synchronizes, the central server will instruct it to upload all of its requested images or photographs to the online cache. As each file finishes uploading, the client notifies the central server. The central server then queues a notification to all those clients waiting to receive the image file. When the client requesting the image synchronizes with the central server, the server instructs it to download the image from the cache. If both clients are online at the same time, the transfer can be done P2P, without going through the central server. However, users can disable the P2P feature on their machines, or limit it to people who are on their buddy list.
  • BRIEF DESCRIPTION OF DRAWINGS
  • [0034]
    The specific features, aspects, and advantages of the present invention will become better understood with regard to the following description, appended claims and accompanying drawings where:
  • [0035]
    FIG. 1 is a diagram depicting a general purpose computing device constituting an exemplary system for implementing the present invention.
  • [0036]
    FIG. 2 is a diagram depicting the system configuration for one embodiment of the present invention.
  • [0037]
    FIG. 3 is a flow diagram depicting the general process actions steps of the system and method according to the present invention.
  • [0038]
    FIG. 4 is a general flow diagram depicting the process action steps performed by the system and method according to the present invention in annotating a client's images.
  • [0039]
    FIG. 5 is a general flow diagram depicting the process action steps performed by the system and method according to the present invention in synchronizing a client's local image/photographic database and index with the central server's master image index/database.
  • [0040]
    FIG. 6 is a general flow diagram depicting the process action steps performed by the system and method according to the present invention in searching the central server's mater index/database and receiving a search result.
  • [0041]
    FIG. 7 is a general flow diagram depicting the process action steps performed by the system and method according to one embodiment of the present invention in transferring the desired image to the client.
  • [0042]
    FIG. 8A is a general flow diagram depicting the general process action steps for the embodiment of the system and method according to the present invention employing a master index on a central server and an image cache.
  • [0043]
    FIG. 8B is a continuation of the flow diagram shown in FIG. 9A.
  • [0044]
    FIG. 9 is a general flow diagram depicting the general process action steps for the embodiment of the system and method according to the present invention employing a client-server configuration, wherein the image database resides on the server.
  • [0045]
    FIG. 10 is a general flow diagram depicting the general process action steps for the embodiment of the system and method according to the present invention wherein clients on the same buddy list search and transfer images directly to each other (peer to peer).
  • DETAILED DESCRIPTION
  • [0046]
    In the following description of the preferred embodiments of the present invention, reference is made to the accompanying drawings, which form a part hereof, and which is shown by way of illustration of specific embodiments in which the invention may be practiced. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
  • [0047]
    Exemplary Operating Environment
  • [0048]
    FIG. 1 illustrates an example of a suitable computing system environment 100 on which the invention may be implemented. The computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100.
  • [0049]
    The invention is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
  • [0050]
    The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
  • [0051]
    With reference to FIG. 1, an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer 110. Components of computer 110 may include, but are not limited to, a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120. The system bus 121 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.
  • [0052]
    Computer 110 typically includes a variety of computer readable media. Computer readable media can be any available media that can be accessed by computer 110 and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computer 110. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer readable media.
  • [0053]
    The system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation, FIG. 1 illustrates operating system 134, application programs 135, other program modules 136, and program data 1 37.
  • [0054]
    The computer 110 may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only, FIG. 1 illustrates a hard disk drive 141 that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 141 is typically connected to the system bus 121 through an non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 150.
  • [0055]
    The drives and their associated computer storage media discussed above and illustrated in FIG. 1, provide storage of computer readable instructions, data structures, program modules and other data for the computer 110. In FIG. 1, for example, hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146, and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers here to illustrate that, at a minimum, they are different copies. A user may enter commands and information into the computer 110 through input devices such as a keyboard 162 and pointing device 161, commonly referred to as a mouse, trackball or touch pad. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus 121, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor 191 or other type of display device is also connected to the system bus 121 via an interface, such as a video interface 190. In addition to the monitor, computers may also include other peripheral output devices such as speakers 197 and printer 196, which may be connected through an output peripheral interface 195. Of particular significance to the present invention, a camera 163 (such as a digital/electronic still or video camera, or film/photographic scanner) capable of capturing a sequence of images 164 can also be included as an input device to the personal computer 110. Further, while just one camera is depicted, multiple cameras could be included as an input device to the personal computer 110. The images 164 from the one or more cameras are input into the computer 110 via an appropriate camera interface 165. This Interface 165 is connected to the system bus 121, thereby allowing the images to be routed to and stored in the RAM 132, or one of the other data storage devices associated with the computer 110. However, It is noted that image data can be input into the computer 110 from any of the aforementioned computer-readable media as well, without requiring the use of the camera 163.
  • [0056]
    The computer 110 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements. described above relative to the computer 110, although only a memory storage device 181 has been illustrated in FIG. 1. The logical connections depicted in FIG. 1 include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
  • [0057]
    When used in a LAN networking environment, the computer 110 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160, or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, FIG. 1 illustrates remote application programs 185 as residing on memory device 181. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
  • [0058]
    The exemplary operating environment having now been discussed, the remaining parts of this description section will be devoted to a description of the program modules embodying the invention.
  • [0059]
    System Overview
  • [0060]
    The system and method according to the present invention provides for a peer-to-peer photo-sharing environment. However, many novel features of the present invention can be implemented equally well in a traditional server-client configuration.
  • [0061]
    In general, as shown in FIG. 2, the system and method according to the present invention typically includes a central server 202, one or more clients 204, 206, and an on-line image cache 208. However, some of these components may not be necessary in all embodiments of the invention.
  • [0062]
    Each client 204, 206 periodically connects to the Internet or other network hosting the photo-sharing system of the present invention. Each client has a local image index 204 a, 206 a (a list of the images on their computer) and an image database 204 b, 206 b. The client provides images for image-sharing and typically searches a master image/photo index, containing all images available for sharing, for images/photographs that they would like to download.
  • [0063]
    The central server 202 is on-line on the Internet or on another more localized network. It can host a master index of photos 202 a, or, alternately, the central server 202 can employ a database of photos 202 b that reside on the server 202 itself. The central server 202 responds to client queries of the index 202 a or database 202 b and is responsible for coordinating transfer of photographs from a client 204 having a requested photograph (or the server photo database 202 b in the embodiment where the photo database resides on the server) to the on-line cache 208 or requesting client 206. The central server 202 can store requested images to the on-line image cache 208. This on-line cache 208 is live on the Internet or other network. Typically, the central server 202 sends images extracted from its master photo database 202 b or another client to the photo cache 208 so that a requesting client can download these images. To do this, the server 202 coordinates transfer of one or more images requested by a client 206 to the on-line photo cache 208 and then coordinates transfer of the image(s) from the on-line image cache 208 to the client 206 who requested it/them. Storing images to the cache solves two problems. It allows for quicker transfer of the requested images to the requesting client, since popular images can remain cached and there is no need to search and retrieve them from the client who owns them or from the server's master database if there is one. Additionally, use of the cache allows for transfer of images between peers (client to client) even when both clients are not present on the Internet or other network at the same time.
  • [0064]
    If both clients 204,206 are on-line, however, these clients 204,206 can coordinate the image transfer directly between them. That is, if both clients 204, 206 are on the network or Internet at the same time the transfer can be done peer-to-peer (P2P), without using the cache 208. Users can disable the P2P feature on their computers, however, or limit the P2P transfer to user's on their “buddy list”, a circle of “photo friends” similar to that found in Instant Messaging applications. If the central server 202 is configured with a photo database 202 b containing all users images, instead of just a master index 202 a, it can also transfer images directly from its database 202 b to the requesting client/user 206, without employing use of the cache 208.
  • [0065]
    The central server 202 can store requested images to the on-line photo/image cache 208. This on-line cache 208 is live on the Internet or other network employed by the system and method according to the present invention. The server 202 either sends images extracted from its database 202 b or another client 204 to the photo cache 208 so that a requesting client 206 can download these images.
  • [0066]
    The invention employs a periodic client-server synchronization schema. The master index 202 a of client images that resides on the central server 202, or the image database 202 b of the central server 202, is updated by the client-server synchronization function. The end-user (requesting client 206) is provided with search functionality to search this master index 202 a or photo database 202 b. Once the user locates the desired images the server 202 coordinates the transmission of the relevant photos to the requesting client 206, either from a hosting client 204 to the cache 208 or directly from the server database 202 b to the requesting client 206.
  • [0067]
    The system and method according to the present invention can include manual and automatic photo annotation at the user or client. This annotation data, or metadata, allows the user to effectively search and control access to the photo index or photo database. The owner of the metadata can be different from the owner of the photo that is, a different user can control a photo's metadata than the user that hosts the photo on their computer or the user that created the photo.
  • [0068]
    The system and method according to the present invention can include access control of images requested by the user or client. This access control is performed by using the metadata to control the search by the requesting client of the index or image/photo database. That is, metadata can be used to make certain photos not available to certain users. For instance, if a certain user searches by a specific time and location and enters a keyword “young children”, the system may bring up pictures related to the time and location in question, but not ones with young children. The access control via metadata can also be made user-specific, governed by a user's “buddy list”, a circle of user's that grant each other access to each other's photographs. The user also has some control as to access of his or her images and photographs. For example, the user has an index of their photographs on their computer. They can annotate each photograph with a different level of privacy, e.g., share with no one, share with some, and provide access to everyone. Therefore, the system and method according to the present invention actually limits access in two ways. First by using the user's privacy designation, and secondly by simply not searching for metadata when the search criteria are determined to be inaccessible to a particular user, or any user for that matter.
  • [0069]
    System Operation
  • [0070]
    The various system configurations having been discussed above, the primary tasks performed by the system and method according to the present invention, shown in FIG. 3, include: 1) image annotation (process action 302); 2) synchronization of the central server with the client(s) (process action 304); 3) search and access (process action 306) and 4) image transfer (process action 308). These tasks will be described in more detail in the following paragraphs.
  • [0071]
    1) Image Annotation
  • [0072]
    In the system and method according to the present invention a small photo exchange software application is always running in the background on the client, handled by a shell. As shown in FIG. 4 in process action 402, this photo/image exchange application 204 c checks for new images being added and old images being taken away at the client. The client maintains its own local database 204 b of the images and a local index 204 a, and preserves a change log 204 d that records the alterations made to the database 204 b and the local index 204 a since the last central server-client synchronization. When new images have been detected at the client, the system prompts the user to annotate them, as shown in process action 404. These annotations are commonly referred to as metadata. Many types of metadata are possible. Some types of metadata utilized by the system and method according to the present invention are: 1) the date and time the image was taken; 2) the location on earth where the picture was taken; 3) the level of privacy associated with the image; 4) the author of the image; 5) modification history; 6) user rating; 7) system imputed location based on time a photo was taken; 8) usage statistics (e.g., how often and when an image was posted; how often an image was emailed, how relevant an image was found to be in a search); 9) any and all user annotations; 10) the owner of the metadata. These types of metadata are described more fully below.
  • [0073]
    a) The Date and Time the Image was Taken.
  • [0074]
    Many photographs are annotated with a time stamp when they are taken, as many cameras are now equipped with a time-date tagging feature. Ideally the client's computer time is synchronized to the camera time when the camera is docked and the images are downloaded from the camera to the computer. Additionally, other devices associated with cameras may also provide such a stamp, such cameras integrated with a cellular telephone. This time stamp may be used by the present invention to determine when a given photo was taken. However, this time stamp is not always reliable. For instance, many camera users do not initially set the time and date in the camera. Or the batteries may run out in the camera and the time may be incorrect. Therefore, the system and method according to the present invention provides the capability to override a camera-induced time stamp. For instance, at the time of docking the user's camera with their computer (the client), the user typically has a fairly good sense of when a picture was taken. Hence, one embodiment of the present invention prompts the user to annotate the picture when the camera is docked to the client and the pictures are transferred to the client. The system and method according to the present invention detects common mistakes and offers to correct them.
  • [0075]
    b) The Location on Earth where the Image was Taken.
  • [0076]
    In order to provide an image database that provides utility the utility of letting the user search images by time and location, identifying the location each image is taken is critical. Ideally, every camera used by the system and method according to the present invention has a Global Positioning System (GPS) unit, a compass, and a method for measuring the pitch and roll of the camera when photographs are taken. The GPS can provide location information in the form of latitude and longitude and is accurate to approximately one meter in non-military applications. The other devices allow measurement of the camera's orientation. Cameras that are integrated with these devices allow for tagging each image with geographic location (geolocation), camera orientation, and a time stamp. However, most camera systems today do not have a GPS built in. Therefore, the system and method according to the present invention has various other methods of obtaining location data. It encourages the user to annotate each picture with geolocation, if a GPS's location/time stamp is not available. The system helps the user be as specific as they can be without encouraging them to be more specific but incorrect. One embodiment of such a user-annotation system takes advantage of place-name-to-geolocation translation applications or services, whereby a user can type or select the text name of a place and the associated geolocation is returned. Alternatively, a user may be presented with a navigable map and asked to place photographs on the map in the approximate location they were taken. Often, time and location information can be used together to impute a location to a photograph. For example, if several photos are known to be close in time and taken with a single camera, and the location of one photograph is known, then a imputed location can be given to the photos created at very close to the same time. Alternately, if the camera used to take the photo is somehow linked with a cell phone, cell site location may also provide an indication of the location where the picture was taken. In short, any form of location information that can be correlated with the time stamp or the content of a photograph can be used to provide geolocation and camera orientation information.
  • [0077]
    c) Level of Privacy of the Image.
  • [0078]
    Each photograph in the system can be labeled as to its level of privacy. The system and method according to the present invention supports a “buddy list”, a list of people the user trusts to view their photos. The system according to the present invention does not expose the owner of photos. Searching based on user name is limited to only those people in the user's buddy list. The system according to the present invention provides the user with the ability to tag some photos as being private. Photos can be private to one person or to the user's entire buddy list. Private photos cannot be seen by others. The present invention supports rules for doing public/private categorization automatically. The level of privacy assigned to each photograph is stored as metadata and set by the user, with one embodiment providing a default setting of completely private (access by the user only) and alternative default setting of completely public (accessible to all). Access to a photograph itself can require a net-aware system such as Microsoft Passport, which has the capacity to require users to authenticate themselves prior to accessing information available over a network.
  • [0079]
    d) Image Author.
  • [0080]
    The metadata includes the author of the image.
  • [0081]
    e) Image Modification History.
  • [0082]
    The modification history of each image is stored on the user's (client's) computer. Such modification history would include when the image was modified, how the image was modified, by whom the image was modified and any corresponding annotations made at the time of modification. This modification history is used by the system to update the central server's index or photo database.
  • [0083]
    f) User Rating.
  • [0084]
    One field of metadata, the user rating, allows the user to rate each image cited in a search to indicate how accurately it matched their search criteria. This user rating can provide the system with an indication of how closely the annotation of a photograph actually matches the photograph. This data is memorialized, added to the photos' metadata, and is used to weight their relevance in future searches. The hope is that over the long-term, an image that is mislabeled will eventually get several low votes. The low score will then come to the attention of the image's owner, and he will correct it.
  • [0085]
    g) Usage Statistics.
  • [0086]
    Another field of metadata, the usage statistics, allows the system to track how a given image has been used. Usage statistics can include, for example, age; how often the image was posted to a website; the times the image was posted to a website; the number of times the image was emailed; how relevant the image was found to be to a particular search; and how many times the image was requested from the server.
  • [0087]
    h) Owner of the Metadata.
  • [0088]
    The owner of the metadata is the party that has access rights to make changes to it. The owner of the metadata can be different from the owner of the photograph or image. That is, a different user can control a photograph's metadata than the user that hosts the photograph on their computer, or the user that created the photograph.
  • [0089]
    The system and method also automatically extracts available data associated with an image as it is available, and annotates the image accordingly (process action 406). Automatic annotations made by the system include the use face recognition techniques to identify a specific person within the images, automated vision techniques to determine whether an image is natural or man-made, and pixel comparison techniques using images of known type and origin. Additionally, the system and method according to the present invention can automatically extract various parameters of associated with the image, as available, such as creation date and time, location, size of file, and so on. Another automated annotation feature used by the system is through the use of image hashing. That is, the system detects multiple images of the same object at various locations throughout the network and elsewhere, and combines metadata from the various sources to better annotate each of the images.
  • [0090]
    As shown in process action 408 of FIG. 4, once the annotation of a new image is complete the client 204 updates the modification log 204 c that records modifications made to the client's local image database 204 b and local index 204 a since the client's last synchronization with the central server 202.
  • [0091]
    2) Client-Server Synchronization.
  • [0092]
    As discussed above, and shown in process actions 502 and 504, all changes to the client's database and index are kept in a change or modification log 204 c. Periodically, the user (client 204) will connect to the central server 202, as shown in process action 506. When they do, their local index 204 a and/or database 204 b will synchronize with the master index 202 a (process action 508). Photos are added and subtracted from the server's master index 202 a, and metadata is updated, as shown in process action 510. Note that metadata can come from the server to the client, as well as from the client to the central server. For instance, if another client has annotated a copy of an image or photograph owned by a client the mater server can send this annotation data to the client who created the photograph. Additionally, all metadata can reside on the central server, or just some portions of the metadata.
  • [0093]
    In one embodiment of the invention, data on the server is aged. If a user does not synchronize with the server for a long time, the relevance of their images will start to decrease. Eventually, after a period of, say, two weeks, their data will be removed entirely. This feature addresses the issue of one client requesting images from another client that never synchronizes with the central server.
  • [0094]
    3) Search.
  • [0095]
    The user (via the client) 206 searches the master index 202 a or master database 202 b in order to search for photos meeting the desired criteria. To do this, as shown in FIG. 6 in process action 602, the client 206 connects to the central server 202. The user 206 creates a query of the central server's 202 master index 202 a or master database 202 b (is such a database is employed in that particular embodiment of the invention), as shown in process action 604. The query is sent to the central server 202 (process action 606). The central server 202 sends the search results to the client including (in any combination) the metadata of each image, a thumbnail view of each image, each image's relevancy score to the current query and whether the owner of the image is on the network, and if not when they last connected (process action 608).
  • [0096]
    In one embodiment of the present invention the client has four ways of primary ways of searching the database. These are: 1) by user; 2) by space-time; 3) by event; and 4) by key. Where applicable, these searches can be combined. Additionally, a search over any of the metadata associated with the photos is also possible. Each search can return, but is not limited to, in any combination: 1) the metadata of the photo; 2) a thumbnail view of the photo; 3) relevancy to the current query; and 4) whether the owner is connected, and if so, at what speed, and if not, when they last connected. The primary methods of searching the database are more fully described below.
  • [0097]
    a) User Search: If a user is on another user's photo “buddy list” (similar to that commonly found in instant messaging software), the user can search that user's computer for photographs or images directly. Various photo “buddy lists” can exist for each user, each providing a different level of access to image data. For instance, a user can have a “buddy list” or photo circle that only involves his family and closest friends. He might then annotate photographs of his family and home in his computer as being “closely held” and accessible only to the buddy list that involves his friends and closest family members. He might have another buddy list that involves just his business colleagues. He might then annotate other photographs, such as those of the office Christmas party, on his computer as being accessible only to his co-workers. Some photographs, such as those of he took of monuments and landscape on his last vacation, he may annotate as being accessible to the whole world (e.g., all users of the system and method according to the present invention).
  • [0098]
    One embodiment of the invention provides the ability to display one client's new photographs automatically on another client's computer (e.g., via screen saver or another mechanism).
  • [0099]
    b) Space-Time Search The space-time search works by letting the user select a place on earth at a time frame. However, either location or time can be omitted from the search criteria. All pictures that fall into the requested coordinates and time frame are returned. The query results are returned, ranked by specificity. For instance, a search on Paris will return pictures of the Eiffel Tower above pictures tagged simply as being “in France”. Pictures with a GPS tag within Paris are considered more accurate than one that the user just said was in Paris. The search User Interface (UI) allows place names and famous landmarks to be entered simply, but also extends to exact specifications, such as longitude, latitude pairs from a GPS.
  • [0100]
    c) Event Search: At the simplest level, an event is basically a shortcut for a space-time coordinate. Many “events” are actually a collection of other events. For example, someone might want to see pictures from any concert on a band's tour, even if they do not know the times and locations of the shows. To facilitate this, the master photo exchange database, or a third party event register vendor, will contain a table of events, otherwise known as an event register, that cross-correlates events with location and time. A user can use the event register to find an image of a certain event. Likewise, a user can use an image known to be taken at a certain event to identify the event's time and location. Users can update the event register. Adding events to the table from live news sources is also possible.
  • [0101]
    d) Key Search: The system and method according to the present invention also supports user-defined key system. For instance, the system supports the user-defined key “picture of me”. That is, users can tag any picture in the database as being a picture of them. Additionally, automatic keys that use advanced imaging technology, such as “indoor vs. outdoor” and “natural vs. man-made” can be used.
  • [0102]
    Keys can be computed and refined on the client machines. For example, a face recognition algorithm may be run over all photos on a client machine, to discover which photos contain Uncle Jim or Aunt Mary. This information could be stored as additional metadata in the central database, or it could be computed on the fly, when such a search is requested.
  • [0103]
    e) Search Feedback: Referring again to FIG. 6, process action 610, once a search is complete, the user can give feedback on the search, indicating which images they thought most closely matched their search criteria. This feedback is added to the images' metadata, and used to weight their relevance in future searches. The hope is that over the long-term, a photo that is mislabeled or misannotated will eventually get several low votes, and the image's owner will correct the mislabeling.
  • [0104]
    4) Image Transfer. Referring now to FIG. 7, if the user wants to get a particular image or photograph from the query result, he requests it from the central serve 202 (process actions 702). At the time the request is made, the user can also request a particular size. By default, the photo comes at its natural size. The user request is sent to the central server (process action. 704). The central server 202 then queues the request, and waits for the client 204 that owns the photo to synchronize with it (process action 706). As shown in FIG. 7, process action 708, when the client 204 synchronizes with the central server 202, the server 202 will instruct it to upload all of its requested images or photographs to the online cache 208. As each file finishes uploading, the client 204 notifies the central server 202 that the image has been uploaded to the cache 208 (process action 710). The central server 202 then queues a notification to all those clients waiting to receive the image file (process action 712). When the client 206 requesting the image synchronizes with the central server 202, the server 202 instructs it to download the image from the cache 208 (process action 714). If both clients 204,206 are online at the same time, the transfer can be done P2P, without going through the central server 202. However, users can disable the P2P feature on their machines, or limit it to people who are on their buddy list.
  • Exemplary Implementations of the System and Method According to the Present Invention
  • [0105]
    The system and method according to the present invention having been described, it should be noted that the various features of the invention can be used in varying combinations and embodiments. Some exemplary implementations of the present invention are discussed in more detail below. These include: 1) an embodiment wherein a master image index, but not a photo database, resides on the server and a cache is used to transfer images; 2) an embodiment wherein a master photo database resides a server, but a cache is not used to transfer images from peer-to-peer; and 3) an embodiment wherein a client directly the searches photo index and photo database of another client that is on the first client's buddy list and both client's are on-line.
  • [0106]
    1) Embodiment wherein a Master Image Index, but not a Photo Database, Resides on a Server, and A Cache is used to Transfer Images.
  • [0107]
    FIGS. 8A and 8B depict a flow chart for an embodiment wherein a master image index, but not a photo database 202 b, resides on the central server 202. A cache 208 is used to transfer images peer-to-peer.
  • [0108]
    In this embodiment, manual and automatic annotations/metadata, as discussed previously, are made at the client 204, 206 whenever images are added or deleted to the client's local database 204 b, 206 b (process actions 802). A change log 204 c, 206 c is maintained to memorialize changes to the client's local index 204 a, 206 a and local image database 204 b, 204 b. The client periodically synchronizes with the central server 202, as shown in process action 804, and in the synchronization process the server's master index 202 a is synchronized with the client's local index 204 a, 206 a via the modification/change log 204 c, 206 c, as discussed more fully above. If a client wishes to search the master index 202 a, he creates a query, preferably by user, space-time, event or key, or any combination thereof, as discussed previously, and sends it to the central server 202 (process actions 806, 808). The central server 202, searches the master index 202 a, and returns search results to the client, as shown in process action 808. Each search can return, but is not limited to, in any combination: the metadata of the photo; a thumbnail view of the photo; relevancy of the image to the current query; and whether the owner is connected, and if so, at what speed, and if not, when they last connected. Access to images returned in the search are again limited by using the user's privacy designation, and by simply not searching for metadata when the search criteria are determined to be inaccessible to a particular user, or any user for that matter. The client then requests the desired images found in the search results and can provide feedback as to images found in the search, as shown in process action 810. The central server 202 then sends a request to the client who owns the desired image (process action 812). If both the requesting client and the client hosting the desired image are both on-line and the requesting client has not disabled P2P transfer or limited it to his buddy list (or the hosting client is on the buddy list), the client that hosts the image can transfer the image directly to the client who requested it (process actions 814, 816). If both the requesting client and the hosting client are not on-line at the same time, or the requesting client has P2P file transfer disabled in general or with respect to the hosting client, the client owning the image sends it to the on-line image cache 208 (process action 818). The client owning the image then informs the central server 202 that the image has been uploaded to the cache 208, as shown in process 820. The central server 202 then queues a notification to all clients that have requested the image that the image has been uploaded to the on-line image cache 208 (process action 822). As shown in process action 824, the next time the requesting client logs into the network and synchronizes with the central server 202, the notification is received. The client requesting the image then downloads it from the on-line cache 208, in a similar manner to that discussed previously.
  • [0109]
    2) Embodiment wherein a Photo Database Resides on a Server.
  • [0110]
    FIG. 9 depicts a general flow chart for an embodiment wherein a master image index 202 a and a photo database 202 b, reside on the central server 202. No cache is used to transfer images peer-to-peer.
  • [0111]
    In this embodiment, manual and automatic annotations/metadata, as discussed previously, are made at the client 204, 206 whenever images are added or deleted to the client's local database 204 b, 206 b (process actions 902). A change log 204 c, 206 c is maintained to memorialize changes to the client's local index 204 a, 206 a and local image database 204 b, 204 b. The client periodically synchronizes with the central server 202, as shown in process action 904, and in the synchronization process the server's master index 202 a and master database 202 b is synchronized with the client's local index 204 a, 206 a and local database 204 b, 206 b via the modification/change log 204 c, 206 c. If a client wishes to search the master index 202 a, he creates a query, preferably by user, space-time, event or key, or any combination thereof, as discussed previously, and sends it to the central server 202 (process actions 906). The central server 202, searches the master index 202 a and master photo database 202 b, and returns search results to the client, as shown in process action 908. Each search can return, but is not limited to, in any combination: the metadata of the photo; a thumbnail view of the photo; relevancy of the image to the current query; and whether the owner is connected, and if so, at what speed, and if not, when they last connected. Access to images returned in the search are again limited by using the user's privacy designation, and by simply not searching for metadata when the search criteria are determined to be inaccessible to a particular user, or any user for that matter. The client then requests the desired images found in the search results from the central server 202 and can provide feedback as to images found in the search, as shown in process action 910. The central server 202 then sends the requested image to the requesting client (process action 912).
  • [0112]
    3) Embodiment wherein a Client Directly Searches the Photo Index and Photo Database of Another Client that is on the First Client's Buddy List and Both Client's are On-Line.
  • [0113]
    FIG. 10 depicts a flow chart for an embodiment of the present invention wherein a first client is on a second client's buddy list and wherein the first client has access to search the second client's local image index 206 a, and photo database 204 b. The transfer of the desired images occurs peer-to-peer without use of an on-line cache.
  • [0114]
    In this embodiment, manual and automatic annotations/metadata, as discussed previously, are made at the client 204, 206 whenever images are added or deleted to the client's local database 204 b, 206 b (process actions 1002). A change log 204 c, 206 c is maintained to memorialize changes to the client's local index 204 a, 206 a and local image database 204 b, 204 b. The client periodically synchronizes with the central server 202, as shown in process action 1004, and in the synchronization process the server's master index 202 a is synchronized with the client's local index 204 a, 206 a via the modification/change log 204 c, 206 c, as discussed more fully above (process action 1004) . In this synchronization process the option of updating the client's local index with new information on the server's master index can also be available [usage statistics, would be an example of such information]). If a first client 206 is on a second client's 204 buddy list and wishes to search the second client's local index 204 a directly, and both clients 204, 206 are on-line at the same time, the first client 206 creates a query of the second client's local index/local database 204 a, 204 b and sends it to the second client 204 (process actions 1006, 1008. The second client 204, searches his local index 204 a and local database 204 b, and returns the search results to the client 206, as shown in process action 1010. Each search can return, but is not limited to, in any combination: the metadata of the photo; a thumbnail view of the photo; relevancy of the image to the current query; and whether the owner is connected, and if so, at what speed, and if not, when they last connected. Access to images returned in the search are again limited by using the user's privacy designation, and by simply not searching for metadata when the search criteria are determined to be inaccessible to a particular user, or any user for that matter. The first client 206 then requests the desired images found in the search results and can provide feedback as to images found in the search, as shown in process action 1012. The second client 206, the one hosting the requested image, then sends the image directly to the client requesting it, as shown in process action 1014.
  • [0115]
    The foregoing description of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the invention be limited not by this detailed description, but rather by the claims appended hereto.

Claims (24)

  1. 1-18. (canceled)
  2. 19. A computer-implemented process for sharing images comprising the process actions of:
    receiving at a central server a search query formatted using annotation data describing an image from a requesting client, said server hosting a master index of all images available for sharing;
    searching said master index at said central server using annotation data provided in said search query and obtaining a result; and
    sending said search result from said central server to said requesting client.
  3. 20. The computer-implemented process of claim 19 further comprising the process action of receiving feedback from said requesting client at said central server as to how well the images in the search result matched the search query.
  4. 21. The computer-implemented process of claim 20 further comprising the process action of using a user-rating annotation to weight an image's relevance in future searches.
  5. 22. The computer-implemented process of claim 19 wherein the process action of receiving a search query comprises at least one process action of:
    receiving a search query from a requesting user said search query employing a user identifier, to locate all images owned by a certain user;
    receiving a search query from a requesting user said search query employing location and/or time, to locate all images created in a given time span or at a given location, or created in a given time span and a given location;
    receiving a search query from a requesting user said search query employing an event name; and
    receiving a search query from a requesting user said search query employing a keyword.
  6. 23. The computer-implemented process of claim 22 wherein the process action of receiving a search query employing an event name further comprises the process actions of:
    creating a table associating event name with location and time said event occurred;
    processing a search query using location and time to identify said associated event name; and
    processing a search query using event name to identify event time and location.
  7. 24. The computer-implemented process of claim 22 wherein the process action of receiving a search query employing a keyword further comprises at least one of:
    using automatic keys identifying if the image was taken indoor versus outdoor, and
    using automatic keys identifying if the image was depicts something natural versus something man-made.
  8. 25. The computer-implemented process of claim 19 wherein the search result includes at least one of:
    annotation data associated with each image found in the search result;
    a thumbnail view of the image found in the search result;
    a relevancy score of the image to the search query; and
    an indication as to whether the image is available on a network, and if not the last time it was available.
  9. 26. The computer-implemented process of claim 19 wherein the process action of returning a search result further comprises a process action of using annotation data to limit access to an image identified in a search as meeting the search criteria, by not returning said image to said requesting client.
  10. 27. The computer-implemented process of claim 19 further comprising the process actions of:
    receiving a request from said requesting client for at least one desired image identified in said search of said central server's master index;
    sending a notification from said central server to a client hosting said at least one desired image to load said requested image to an on-line cache;
    loading said desired image to an on-line cache by said hosting client;
    downloading said requested image from said cache by said requesting client.
  11. 28. The computer-implemented process of claim 19 further comprising the process actions of:
    receiving a request from said requesting client for at least one desired image identified in by said search of said central server's master index;
    retrieving said at least one desired image from a master image database residing on said central server and correlating with said master index;
    sending said at least one desired image to said requesting client from said central server.
  12. 29. The computer-implemented process of claim 19 further comprising the process actions of:
    receiving a request from said requesting client for at least one desired image identified in said search of said central server's master index to be sent to a receiving client;
    retrieving said at least one desired image from a master image database residing on said central server and correlating with said master index;
    formatting said at least one desired image to automatically appear on said receiving client's computer display;
    sending said at least one desired image to said receiving client from said central server.
  13. 30. The computer-implemented process of claim 29 wherein said formatted at least one desired image appears as a screen-saver on a computer display of said receiving client.
  14. 31. The computer-implemented process of claim 19 further comprising the process actions of:
    receiving a request from said requesting client for at least one desired image identified in by said search of said central server's master index;
    verifying that said requesting client and a client hosting said at least one desired image are both on-line on a network;
    sending a notification from said central server to a client hosting said at least one desired image to send said requested image to said requesting client.
  15. 32. The computer-implemented process of claim 31 further comprising the process action of said hosting client sending said at least one desired image to a requesting client.
  16. 33. The computer-implemented process of claim 19 further comprising the process actions of:
    adding and removing images from the master index to coincide with changes made to a local index of images belonging to a client hosting said images using a modification log depicting changes made to said local index of said hosting client; and
    updating said annotation data of images listed on said master index using said modification log.
  17. 34. A computer-readable medium having computer-executable instructions for transferring images, said computer executable instructions comprising:
    inputting images at a first client;
    annotating said images with metadata;
    creating a local index of said images and local database of said images at said first client;
    synchronizing said first client's local index with a master index of a central server, said master index comprising all images available for sharing.
    searching by a second client of said central servers master index for a particular image using said metadata;
    returning a search result from said central server to said second client; and
    coordinating the transfer of a desired image found in said search result from said first client to said second client.
  18. 35. The computer-readable medium of claim 33 wherein the computer-executable instructions for returning a search result further comprises a process action of using metadata to limit access to an image identified in a search as meeting the search criteria by not returning said image in said search result.
  19. 36. The computer-readable medium of claim 34 wherein the computer-executable instructions for coordinating said transfer of the image further comprises:
    requesting at least one image by said second client from said central server's master index;
    sending a notification by said central server to said first client to load said requested image to an on-line cache;
    loading said requested image to said on-line cache by said first client;
    downloading said requested image from cache by said second client.
  20. 37. A system for transferring files, the system comprising:
    a general purpose computing device; and
    a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to,
    input files at a first client;
    annotate said files at said first client;
    create a local index of said files and a local database of said files at said first client;
    synchronize said first client's local index with a master index of a central server, said master index comprising all files available for sharing;
    search by a remote client of said central server's master index for a particular file using said annotated data;
    return a search result from said central server to said remote client; and
    transfer a desired file found in said search result to said remote client.
  21. 38. The system of claim 37 wherein the computer module to annotate said file further comprises sub-modules to:
    locate the same file as said file in other locations;
    extract all annotation data from said file located in said other locations;
    annotate said file with said annotation data extracted from said file in said other locations.
  22. 39. The system of claim 37 wherein the computer module to return a search result further comprises a sub-module to use annotation data to limit access to a file identified in a search as meeting a search criteria by not returning said image data in said search result.
  23. 40. The system of claim 37 wherein the computer module to transfer a file further comprises sub-modules to:
    request at least one file by said remote client from said central server's master index;
    send a notification from said central server to said first client to load said requested file to an on-line cache;
    load said requested file to said on-line cache by said first client;
    download said requested file from said on-line cache by said remote client.
  24. 41-54. (canceled)
US11118515 2001-10-09 2005-04-29 System and method for exchanging images Abandoned US20050190273A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US09682755 US7068309B2 (en) 2001-10-09 2001-10-09 Image exchange with image annotation
US11118515 US20050190273A1 (en) 2001-10-09 2005-04-29 System and method for exchanging images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US11118515 US20050190273A1 (en) 2001-10-09 2005-04-29 System and method for exchanging images

Publications (1)

Publication Number Publication Date
US20050190273A1 true true US20050190273A1 (en) 2005-09-01

Family

ID=32070205

Family Applications (3)

Application Number Title Priority Date Filing Date
US09682755 Active 2024-01-06 US7068309B2 (en) 2001-10-09 2001-10-09 Image exchange with image annotation
US11118515 Abandoned US20050190273A1 (en) 2001-10-09 2005-04-29 System and method for exchanging images
US11251041 Active 2022-03-11 US7508419B2 (en) 2001-10-09 2005-10-14 Image exchange with image annotation

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09682755 Active 2024-01-06 US7068309B2 (en) 2001-10-09 2001-10-09 Image exchange with image annotation

Family Applications After (1)

Application Number Title Priority Date Filing Date
US11251041 Active 2022-03-11 US7508419B2 (en) 2001-10-09 2005-10-14 Image exchange with image annotation

Country Status (1)

Country Link
US (3) US7068309B2 (en)

Cited By (77)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040070678A1 (en) * 2001-10-09 2004-04-15 Kentaro Toyama System and method for exchanging images
US20040139172A1 (en) * 2003-01-15 2004-07-15 Svendsen Hugh Blake Method and system for requesting image prints in an online photosharing system
US20050065979A1 (en) * 2002-03-01 2005-03-24 Ivan Vachovsky System and method for creating and maintaining an online photo album
US20050256925A1 (en) * 2004-04-30 2005-11-17 Microsoft Corporation Mechanism for controlling a decentralized multi-party conference
US20050278379A1 (en) * 2004-06-10 2005-12-15 Canon Kabushiki Kaisha Image retrieval device and image retrieval method
US20050285971A1 (en) * 2004-06-24 2005-12-29 Stavely Donald J Method and apparatus for controlling color balance in a digital imaging device
US20060069681A1 (en) * 2004-09-28 2006-03-30 Swisscom Mobile Ag Method and means for finding recorded data in a database
US20070050613A1 (en) * 2005-08-29 2007-03-01 Junaid Islam Architecture for Mobile IPv6 Applications over IPv4
US20070109616A1 (en) * 2005-10-04 2007-05-17 Kelly Thompson System and method for searching digital images
US20070118525A1 (en) * 2005-11-18 2007-05-24 Flashpoint Technology, Inc. System and method for controlling access to assets in a network-based media sharing system using tagging
US20070136370A1 (en) * 2005-12-09 2007-06-14 Ophir Frieder Peer-to-peer file sharing
US20070174246A1 (en) * 2006-01-25 2007-07-26 Sigurdsson Johann T Multiple client search method and system
US20070233732A1 (en) * 2006-04-04 2007-10-04 Mozes Incorporated Content request, storage and/or configuration systems and methods
US20070276844A1 (en) * 2006-05-01 2007-11-29 Anat Segal System and method for performing configurable matching of similar data in a data repository
US20080162557A1 (en) * 2006-12-28 2008-07-03 Nokia Corporation Systems, methods, devices, and computer program products providing for reflective media
US20080281919A1 (en) * 2007-05-09 2008-11-13 University Of Georgia Research Foundation, Inc. System and Method for Sharing Images
US20080301087A1 (en) * 2007-05-30 2008-12-04 Red Hat, Inc. Index clustering for full text search engines
US20090106202A1 (en) * 2007-10-05 2009-04-23 Aharon Mizrahi System And Method For Enabling Search Of Content
US20090177662A1 (en) * 2008-01-04 2009-07-09 Apple Inc. Abstraction for representing an object irrespective of characteristics of the object
US20090287782A1 (en) * 2008-05-14 2009-11-19 Daniel Brian Odess Interactive Multimedia Timeline
US20100082680A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Methods and systems for providing easy access to information and for sharing services
US20100145941A1 (en) * 2008-12-09 2010-06-10 Sudharsan Vasudevan Rules and method for improving image search relevance through games
US7747574B1 (en) 2005-09-19 2010-06-29 Qurio Holdings, Inc. System and method for archiving digital media
US20100177358A1 (en) * 2009-01-13 2010-07-15 Xerox Corporation Method for secure production printing
US20110081892A1 (en) * 2005-08-23 2011-04-07 Ricoh Co., Ltd. System and methods for use of voice mail and email in a mixed media environment
US7933972B1 (en) 2005-09-29 2011-04-26 Qurio Holdings, Inc. Method and system for organizing categories of content in a distributed network
US20110145693A1 (en) * 2009-12-10 2011-06-16 Fulcrum Medical Inc. Transfer of digital medical images and data
US20110158556A1 (en) * 2009-12-04 2011-06-30 Sony Corporation Imaging apparatus, data processing method, and program
US8041784B1 (en) 2006-06-27 2011-10-18 Qurio Holdings, Inc. Redundant hybrid P2P content sharing
US8073263B2 (en) 2006-07-31 2011-12-06 Ricoh Co., Ltd. Multi-classifier selection and monitoring for MMR-based image recognition
US8086038B2 (en) 2007-07-11 2011-12-27 Ricoh Co., Ltd. Invisible junction features for patch recognition
US8144921B2 (en) 2007-07-11 2012-03-27 Ricoh Co., Ltd. Information retrieval using invisible junctions and geometric constraints
US8156115B1 (en) 2007-07-11 2012-04-10 Ricoh Co. Ltd. Document-based networking with mixed media reality
US8156116B2 (en) 2006-07-31 2012-04-10 Ricoh Co., Ltd Dynamic presentation of targeted information in a mixed media reality recognition system
US8156427B2 (en) 2005-08-23 2012-04-10 Ricoh Co. Ltd. User interface for mixed media reality
US8176054B2 (en) 2007-07-12 2012-05-08 Ricoh Co. Ltd Retrieving electronic documents by converting them to synthetic text
US8184155B2 (en) 2007-07-11 2012-05-22 Ricoh Co. Ltd. Recognition and tracking using invisible junctions
US8195659B2 (en) 2005-08-23 2012-06-05 Ricoh Co. Ltd. Integration and use of mixed media documents
US8201076B2 (en) 2006-07-31 2012-06-12 Ricoh Co., Ltd. Capturing symbolic information from documents upon printing
US8238609B2 (en) 2007-01-18 2012-08-07 Ricoh Co., Ltd. Synthetic image and video generation from ground truth data
WO2012112780A2 (en) * 2011-02-18 2012-08-23 Google Inc. Affinity based ranked for search and display
US8276088B2 (en) 2007-07-11 2012-09-25 Ricoh Co., Ltd. User interface for three-dimensional navigation
US8332401B2 (en) 2004-10-01 2012-12-11 Ricoh Co., Ltd Method and system for position-based image matching in a mixed media environment
US8335789B2 (en) 2004-10-01 2012-12-18 Ricoh Co., Ltd. Method and system for document fingerprint matching in a mixed media environment
US8369655B2 (en) 2006-07-31 2013-02-05 Ricoh Co., Ltd. Mixed media reality recognition using multiple specialized indexes
US8385660B2 (en) 2009-06-24 2013-02-26 Ricoh Co., Ltd. Mixed media reality indexing and retrieval for repeated content
US8385589B2 (en) 2008-05-15 2013-02-26 Berna Erol Web-based content detection in images, extraction and recognition
US8489987B2 (en) 2006-07-31 2013-07-16 Ricoh Co., Ltd. Monitoring and analyzing creation and usage of visual content using image and hotspot interaction
US8510283B2 (en) 2006-07-31 2013-08-13 Ricoh Co., Ltd. Automatic adaption of an image recognition system to image capture devices
US8521737B2 (en) 2004-10-01 2013-08-27 Ricoh Co., Ltd. Method and system for multi-tier image matching in a mixed media environment
US8527492B1 (en) * 2005-11-17 2013-09-03 Quiro Holdings, Inc. Associating external content with a digital image
US8600989B2 (en) 2004-10-01 2013-12-03 Ricoh Co., Ltd. Method and system for image matching in a mixed media environment
US8676810B2 (en) 2006-07-31 2014-03-18 Ricoh Co., Ltd. Multiple index mixed media reality recognition using unequal priority indexes
US8719337B1 (en) 2009-04-27 2014-05-06 Junaid Islam IPv6 to web architecture
US8734872B2 (en) 2008-09-30 2014-05-27 Apple Inc. Access control to content published by a host
US20140161326A1 (en) * 2007-12-31 2014-06-12 Ray Ganong Method, system, and computer program for identification and sharing of digital images with face signatures
US8825682B2 (en) 2006-07-31 2014-09-02 Ricoh Co., Ltd. Architecture for mixed media reality retrieval of locations and registration of images
US8838591B2 (en) 2005-08-23 2014-09-16 Ricoh Co., Ltd. Embedding hot spots in electronic documents
US8856108B2 (en) 2006-07-31 2014-10-07 Ricoh Co., Ltd. Combining results of image retrieval processes
US8868555B2 (en) 2006-07-31 2014-10-21 Ricoh Co., Ltd. Computation of a recongnizability score (quality predictor) for image retrieval
US8949287B2 (en) 2005-08-23 2015-02-03 Ricoh Co., Ltd. Embedding hot spots in imaged documents
US8994731B2 (en) 2007-12-19 2015-03-31 Temporal Llc Apparatus, system, and method for organizing information by time and place
US9020966B2 (en) 2006-07-31 2015-04-28 Ricoh Co., Ltd. Client device for interacting with a mixed media reality recognition system
US9058331B2 (en) 2011-07-27 2015-06-16 Ricoh Co., Ltd. Generating a conversation in a social network based on visual search results
US9063952B2 (en) 2006-07-31 2015-06-23 Ricoh Co., Ltd. Mixed media reality recognition with image tracking
US9063953B2 (en) 2004-10-01 2015-06-23 Ricoh Co., Ltd. System and methods for creation and use of a mixed media environment
US9122645B1 (en) 2006-12-20 2015-09-01 Qurio Holdings, Inc. Method and system for tagging within virtual groups
US9171202B2 (en) 2005-08-23 2015-10-27 Ricoh Co., Ltd. Data organization and access for mixed media document system
US9176984B2 (en) 2006-07-31 2015-11-03 Ricoh Co., Ltd Mixed media reality retrieval of differentially-weighted links
US9373029B2 (en) 2007-07-11 2016-06-21 Ricoh Co., Ltd. Invisible junction feature recognition for document security or annotation
US9384619B2 (en) 2006-07-31 2016-07-05 Ricoh Co., Ltd. Searching media content for objects specified using identifiers
US9405751B2 (en) 2005-08-23 2016-08-02 Ricoh Co., Ltd. Database for mixed media document system
US9530050B1 (en) * 2007-07-11 2016-12-27 Ricoh Co., Ltd. Document annotation sharing
US9641523B2 (en) 2011-08-15 2017-05-02 Daon Holdings Limited Method of host-directed illumination and system for conducting host-directed illumination
US9721148B2 (en) 2007-12-31 2017-08-01 Applied Recognition Inc. Face detection and recognition
US9930505B2 (en) 2014-05-02 2018-03-27 International Business Machines Corporation Retrieval of digital content related to unavailable digital content
US9934504B2 (en) 2015-10-19 2018-04-03 Amazon Technologies, Inc. Image analysis for user authentication

Families Citing this family (358)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7450734B2 (en) * 2000-01-13 2008-11-11 Digimarc Corporation Digital asset management, targeted searching and desktop searching using digital watermarks
US7653925B2 (en) 1999-11-17 2010-01-26 Ricoh Company, Ltd. Techniques for receiving information during multimedia presentations and communicating the information
US7299405B1 (en) * 2000-03-08 2007-11-20 Ricoh Company, Ltd. Method and system for information management to facilitate the exchange of ideas during a collaborative effort
US7310801B2 (en) * 2000-04-27 2007-12-18 Microsoft Corporation Servicing a component-based software product throughout the software product lifecycle
US7830399B2 (en) * 2000-10-04 2010-11-09 Shutterfly, Inc. System and method for manipulating digital images
US7197160B2 (en) 2001-03-05 2007-03-27 Digimarc Corporation Geographic information systems using digital watermarks
US20020188735A1 (en) * 2001-06-06 2002-12-12 Needham Bradford H. Partially replicated, locally searched peer to peer file sharing system
US7124191B2 (en) * 2001-06-26 2006-10-17 Eastman Kodak Company Method and system for managing images over a communication network
US7243153B2 (en) * 2001-06-26 2007-07-10 Eastman Kodak Company System and method for managing images over a communication network
US6993642B2 (en) * 2001-07-24 2006-01-31 Microsoft Corporation Method and system for creating and employing an operating system having selected functionality
US20030037326A1 (en) * 2001-08-06 2003-02-20 Ryan Burkhardt Method and system for installing staged programs on a destination computer using a reference system image
US8825812B2 (en) 2001-10-11 2014-09-02 Oren Asher Method and system for peer-to-peer image streaming
US20030078939A1 (en) * 2001-10-24 2003-04-24 Tiger Color Inc. Method of automatically downloading photos from a web page
US7929808B2 (en) * 2001-10-30 2011-04-19 Hewlett-Packard Development Company, L.P. Systems and methods for generating digital images having image meta-data combined with the image data
US7251812B1 (en) 2001-10-31 2007-07-31 Microsoft Corporation Dynamic software update
US20040093349A1 (en) * 2001-11-27 2004-05-13 Sonic Foundry, Inc. System for and method of capture, analysis, management, and access of disparate types and sources of media, biometric, and database information
US7519656B2 (en) * 2002-03-19 2009-04-14 Canon Kabushiki Kaisha Information processing system, information processing apparatus, information processing method, storage medium that stores program for implementing that method to be readable by information processing apparatus, and program
US20030182324A1 (en) * 2002-03-19 2003-09-25 Canon Kabushiki Kaisha Information providing system
JP4047041B2 (en) * 2002-03-19 2008-02-13 キヤノン株式会社 The information processing system and information processing apparatus, information processing method and a program for realizing the
JP4280452B2 (en) * 2002-03-19 2009-06-17 キヤノン株式会社 The information processing apparatus and a control method and a program for realizing the
JP4147796B2 (en) * 2002-03-25 2008-09-10 ソニー株式会社 Information image utilization system, the information image management server, the information image managing method, and a program, a recording medium
JP3622913B2 (en) * 2002-03-25 2005-02-23 ソニー株式会社 Information image utilization system, the information image management apparatus, an information image management method, the user information image, and a program, a recording medium
JP4147795B2 (en) * 2002-03-25 2008-09-10 ソニー株式会社 Information image utilization system, the information image management apparatus, an information image managing method, a program and a recording medium
US20030187673A1 (en) * 2002-03-29 2003-10-02 Intel Corporation Distributed click-to-print
FR2838218B1 (en) * 2002-04-08 2004-10-08 Eastman Kodak Co Thumbnail display of a photographic medium on a terminal
US7555195B2 (en) * 2002-04-16 2009-06-30 Nippon Telegraph And Telephone Corporation Content combination reproducer, content combination reproduction method, program executing the method, and recording medium recording therein the program
US7016883B2 (en) * 2002-04-23 2006-03-21 Sprint Communications Company L.P. Reverse caching for residential end-users to reduce usage of access links to a core communication network
US7228526B2 (en) * 2002-06-12 2007-06-05 Microsoft Corporation Application imaging infrastructure
US6938250B2 (en) 2002-06-12 2005-08-30 Microsoft Corporation Image-based software installation
US20030232593A1 (en) * 2002-06-13 2003-12-18 Nokia Corporation Digital data transfer through different communication paths
US7236799B2 (en) 2002-06-14 2007-06-26 Cingular Wireless Ii, Llc Apparatus and systems for providing location-based services within a wireless network
US7017144B2 (en) 2002-06-17 2006-03-21 Microsoft Corporation Combined image views and method of creating images
US7464176B2 (en) * 2002-06-17 2008-12-09 Microsoft Corporation Multicast system and method for deploying multiple images simultaneously
US7260738B2 (en) * 2002-06-17 2007-08-21 Microsoft Corporation System and method for splitting an image across multiple computer readable media
US7062764B2 (en) * 2002-06-17 2006-06-13 Microsoft Corporation System and method for manipulating offline software
US6947954B2 (en) 2002-06-17 2005-09-20 Microsoft Corporation Image server store system and method using combined image views
US7392296B2 (en) * 2002-06-19 2008-06-24 Eastman Kodak Company Method and computer software program for sharing images over a communication network among a plurality of users in accordance with a criteria
US7290057B2 (en) * 2002-08-20 2007-10-30 Microsoft Corporation Media streaming of web content data
US7430003B2 (en) * 2002-08-23 2008-09-30 Candid Color Systems, Inc. Digital camera/computer synchronization method
US7873905B2 (en) * 2002-09-19 2011-01-18 Fuji Xerox Co., Ltd. Image processing system
US7848598B2 (en) * 2002-09-19 2010-12-07 Fuji Xerox Co., Ltd. Image retrieval processing to obtain static image data from video data
US20040066457A1 (en) * 2002-10-04 2004-04-08 Silverstein D. Amnon System and method for remote controlled photography
US7668842B2 (en) * 2002-10-16 2010-02-23 Microsoft Corporation Playlist structure for large playlists
US20040085318A1 (en) * 2002-10-31 2004-05-06 Philipp Hassler Graphics generation and integration
US20040107181A1 (en) * 2002-11-14 2004-06-03 FIORI Product Development, Inc. System and method for capturing, storing, organizing and sharing visual, audio and sensory experience and event records
US9563708B2 (en) * 2002-11-18 2017-02-07 Aol Inc. Matching members with shared interests
US20040117824A1 (en) * 2002-12-11 2004-06-17 Jeyhan Karaoguz Method and system for media processing providing access to distributed media via a channel guide
US20040117843A1 (en) * 2002-12-11 2004-06-17 Jeyhan Karaoguz Media exchange network supporting local and remote personalized media overlay
US20040174434A1 (en) 2002-12-18 2004-09-09 Walker Jay S. Systems and methods for suggesting meta-information to a camera user
US20040122918A1 (en) * 2002-12-19 2004-06-24 Eastman Kodak Company System and method of sharing images
US20040130634A1 (en) * 2003-01-06 2004-07-08 Delaney Beth M.P. Electronic image history attribute
US7769881B2 (en) * 2003-01-24 2010-08-03 Hitachi, Ltd. Method and apparatus for peer-to peer access
US20040192343A1 (en) * 2003-01-28 2004-09-30 Kentaro Toyama System and method for location annotation employing time synchronization
US7617279B2 (en) * 2003-02-27 2009-11-10 Fujifilm Corporation Image-printing system using peer-to-peer network
FR2852422B1 (en) * 2003-03-14 2005-05-06 Eastman Kodak Co Method for automatic identification of entities in a digital image
FR2852769B1 (en) * 2003-03-20 2005-09-16 Eastman Kodak Co Method for sharing multimedia data
US8001088B2 (en) * 2003-04-04 2011-08-16 Avid Technology, Inc. Indexing media files in a distributed, multi-user system for managing and editing digital media
WO2004102855A3 (en) * 2003-05-09 2005-01-27 Landmat Internat Inc Content publishing over mobile networks
US9607092B2 (en) * 2003-05-20 2017-03-28 Excalibur Ip, Llc Mapping method and system
US20050036692A1 (en) * 2003-05-26 2005-02-17 Takayuki Iida Method and device for determining time-of-photograph of individual image, and image retrieving method and computer program for the method
US7660864B2 (en) * 2003-05-27 2010-02-09 Nokia Corporation System and method for user notification
JP4280656B2 (en) * 2003-06-20 2009-06-17 キヤノン株式会社 The image display apparatus and image display method
US7177872B2 (en) * 2003-06-23 2007-02-13 Sony Corporation Interface for media publishing
US7177881B2 (en) * 2003-06-23 2007-02-13 Sony Corporation Network media channels
US7281247B2 (en) * 2003-06-24 2007-10-09 Microsoft Corporation Software image creation in a distributed build environment
US20050001903A1 (en) * 2003-07-02 2005-01-06 Endler Sean Christopher Methods and apparatuses for displaying and rating content
US20050033822A1 (en) * 2003-08-05 2005-02-10 Grayson George Dale Method and apparatus for information distribution and retrieval
US7398479B2 (en) * 2003-08-20 2008-07-08 Acd Systems, Ltd. Method and system for calendar-based image asset organization
US7356778B2 (en) * 2003-08-20 2008-04-08 Acd Systems Ltd. Method and system for visualization and operation of multiple content filters
US20050055455A1 (en) * 2003-09-10 2005-03-10 Oren Asher Development platform for peer-to-peer applications
US9380269B2 (en) * 2003-09-23 2016-06-28 Time Warner Cable Enterprises Llc Scheduling trigger apparatus and method
WO2005060364A3 (en) * 2003-11-18 2006-01-12 Francis A Flomerfelt Spatial for altering cell proliferation
US7689712B2 (en) 2003-11-26 2010-03-30 Ricoh Company, Ltd. Techniques for integrating note-taking and multimedia information
CN1622543A (en) * 2003-11-28 2005-06-01 因芬尼昂技术股份公司 Method, computer program, apparatus and system for the selective communication of data sets
CA2554135C (en) * 2003-12-24 2013-09-24 Walker Digital, Llc Method and apparatus for automatically capturing and managing images
JP2005227844A (en) * 2004-02-10 2005-08-25 Matsushita Electric Ind Co Ltd Information terminal, and program and method for displaying timetable information
US20050181790A1 (en) * 2004-02-10 2005-08-18 Yach David P. Apparatus, and associated method, for facilitating efficient communication of data communicated pursuant to a syncrhonization session
FI122372B (en) * 2004-02-13 2011-12-30 Futurice Oy Data Processing system
US8442331B2 (en) * 2004-02-15 2013-05-14 Google Inc. Capturing text from rendered documents using supplemental information
US20050197922A1 (en) * 2004-03-04 2005-09-08 Peter Pezaris Method and system for accessing and printing access-controlled photographs using a public computer network
US20050198305A1 (en) * 2004-03-04 2005-09-08 Peter Pezaris Method and system for associating a thread with content in a social networking environment
US20050216913A1 (en) * 2004-03-23 2005-09-29 Gemmell David J Annotating / rating / organizing / relating content rendered on computer device during idle mode thereof
US7460151B2 (en) * 2004-03-29 2008-12-02 Fujifilm Corporation Image file sharing method, and digital camera and center server used in image file sharing system
US8234414B2 (en) * 2004-03-31 2012-07-31 Qurio Holdings, Inc. Proxy caching in a photosharing peer-to-peer network to improve guest image viewing performance
US7847970B1 (en) * 2004-04-16 2010-12-07 Automed Technologies, Inc. System and method for reception, analysis, and annotation of prescription data
US8918367B2 (en) * 2004-04-30 2014-12-23 Sap Se Two phase commit emulation for non distributed transactions
US7580867B2 (en) 2004-05-04 2009-08-25 Paul Nykamp Methods for interactively displaying product information and for collaborative product design
US8266241B1 (en) 2004-06-22 2012-09-11 Apple Inc. Image sharing
US8316088B2 (en) 2004-07-06 2012-11-20 Nokia Corporation Peer-to-peer engine for object sharing in communication devices
US8370323B2 (en) 2004-08-31 2013-02-05 Intel Corporation Providing information services related to multimodal inputs
US20060080286A1 (en) * 2004-08-31 2006-04-13 Flashpoint Technology, Inc. System and method for storing and accessing images based on position data associated therewith
EP1810182A4 (en) * 2004-08-31 2010-07-07 Kumar Gopalakrishnan Method and system for providing information services relevant to visual imagery
US7873911B2 (en) * 2004-08-31 2011-01-18 Gopalakrishnan Kumar C Methods for providing information services related to visual imagery
US20060069734A1 (en) * 2004-09-01 2006-03-30 Michael Gersh Method and system for organizing and displaying message threads
GB0423100D0 (en) * 2004-10-18 2004-11-17 Sony Uk Ltd Storage of content data in a peer-to-peer network
US7752548B2 (en) * 2004-10-29 2010-07-06 Microsoft Corporation Features such as titles, transitions, and/or effects which vary according to positions
US20060092286A1 (en) * 2004-11-03 2006-05-04 Velhal Ravindra V Remote operation of wireless telescope over a network
EP1815353A2 (en) * 2004-11-10 2007-08-08 Philips Electronics N.V. System for automatically annotating information
US7698386B2 (en) * 2004-11-16 2010-04-13 Qurio Holdings, Inc. Serving content from an off-line peer server in a photosharing peer-to-peer network in response to a guest request
US20060109854A1 (en) * 2004-11-22 2006-05-25 Cancel Ramon C Systems and methods to share information between digital video recorders
US20060285150A1 (en) * 2005-01-31 2006-12-21 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Regional proximity for shared image device(s)
US9191611B2 (en) * 2005-06-02 2015-11-17 Invention Science Fund I, Llc Conditional alteration of a saved image
US9082456B2 (en) * 2005-01-31 2015-07-14 The Invention Science Fund I Llc Shared image device designation
US20060274154A1 (en) * 2005-06-02 2006-12-07 Searete, Lcc, A Limited Liability Corporation Of The State Of Delaware Data storage usage protocol
US20060171603A1 (en) * 2005-01-31 2006-08-03 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Resampling of transformed shared image techniques
US7782365B2 (en) * 2005-06-02 2010-08-24 Searete Llc Enhanced video/still image correlation
US9124729B2 (en) 2005-01-31 2015-09-01 The Invention Science Fund I, Llc Shared image device synchronization or designation
US9819490B2 (en) 2005-05-04 2017-11-14 Invention Science Fund I, Llc Regional proximity for shared image device(s)
US20060190968A1 (en) * 2005-01-31 2006-08-24 Searete Llc, A Limited Corporation Of The State Of The State Of Delaware Sharing between shared audio devices
US20070236505A1 (en) * 2005-01-31 2007-10-11 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Resampling of transformed shared image techniques
US8606383B2 (en) 2005-01-31 2013-12-10 The Invention Science Fund I, Llc Audio sharing
US9489717B2 (en) * 2005-01-31 2016-11-08 Invention Science Fund I, Llc Shared image device
US20060174203A1 (en) * 2005-01-31 2006-08-03 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Viewfinder for shared image device
US7920169B2 (en) 2005-01-31 2011-04-05 Invention Science Fund I, Llc Proximity of shared image devices
US9621749B2 (en) 2005-06-02 2017-04-11 Invention Science Fund I, Llc Capturing selected image objects
US20060187228A1 (en) * 2005-01-31 2006-08-24 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Sharing including peripheral shared image device
US8902320B2 (en) 2005-01-31 2014-12-02 The Invention Science Fund I, Llc Shared image device synchronization or designation
US20060173972A1 (en) * 2005-01-31 2006-08-03 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Audio sharing
US7872675B2 (en) * 2005-06-02 2011-01-18 The Invention Science Fund I, Llc Saved-image management
US20060170956A1 (en) * 2005-01-31 2006-08-03 Jung Edward K Shared image devices
US9001215B2 (en) 2005-06-02 2015-04-07 The Invention Science Fund I, Llc Estimating shared image device operational capabilities or resources
US9451200B2 (en) * 2005-06-02 2016-09-20 Invention Science Fund I, Llc Storage access technique for captured data
US9910341B2 (en) 2005-01-31 2018-03-06 The Invention Science Fund I, Llc Shared image device designation
US8681225B2 (en) * 2005-06-02 2014-03-25 Royce A. Levien Storage access technique for captured data
US7876357B2 (en) 2005-01-31 2011-01-25 The Invention Science Fund I, Llc Estimating shared image device operational capabilities or resources
US9325781B2 (en) 2005-01-31 2016-04-26 Invention Science Fund I, Llc Audio sharing
US20060187230A1 (en) * 2005-01-31 2006-08-24 Searete Llc Peripheral shared image device sharing
US20060274153A1 (en) * 2005-06-02 2006-12-07 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Third party storage of captured data
US20060190537A1 (en) * 2005-02-23 2006-08-24 Morris Robert P Method and system for enabling structured real-time conversations between multiple participants
US7818350B2 (en) * 2005-02-28 2010-10-19 Yahoo! Inc. System and method for creating a collaborative playlist
US7737995B2 (en) * 2005-02-28 2010-06-15 Microsoft Corporation Graphical user interface system and process for navigating a set of images
US20060221197A1 (en) * 2005-03-30 2006-10-05 Jung Edward K Image transformation estimator of an imaging device
US7353034B2 (en) 2005-04-04 2008-04-01 X One, Inc. Location sharing and tracking using mobile phones or other wireless devices
US8364185B2 (en) * 2005-04-18 2013-01-29 Samsung Electronics Co., Ltd. Method and system for synchronizing a clock for an adjacent network to a clock for an overlay network
US8732175B2 (en) * 2005-04-21 2014-05-20 Yahoo! Inc. Interestingness ranking of media objects
US8117277B2 (en) * 2005-04-27 2012-02-14 Microsoft Corporation Component based infrastructure for sharing files
US8570586B2 (en) * 2005-05-02 2013-10-29 Digimarc Corporation Active images through digital watermarking
US7765265B1 (en) 2005-05-11 2010-07-27 Aol Inc. Identifying users sharing common characteristics
GB2426136B (en) * 2005-05-11 2008-10-01 Idan Zuta Messaging system and method
US7606580B2 (en) 2005-05-11 2009-10-20 Aol Llc Personalized location information for mobile devices
US20060265383A1 (en) * 2005-05-18 2006-11-23 Pezaris Design, Inc. Method and system for performing and sorting a content search
GB0510158D0 (en) * 2005-05-18 2005-06-22 Vodafone Plc Searching data
CN1866264A (en) * 2005-05-21 2006-11-22 华为技术有限公司 Scene generating method and system for mobile game
GB0510713D0 (en) * 2005-05-26 2005-06-29 Ibm A method or apparatus for sharing image data
US20060271855A1 (en) * 2005-05-27 2006-11-30 Microsoft Corporation Operating system shell management of video files
US20060269090A1 (en) * 2005-05-27 2006-11-30 Roman Sapiejewski Supra-aural headphone noise reducing
US7467147B2 (en) * 2005-06-01 2008-12-16 Groundspeak, Inc. System and method for facilitating ad hoc compilation of geospatial data for on-line collaboration
US8072501B2 (en) * 2005-10-31 2011-12-06 The Invention Science Fund I, Llc Preservation and/or degradation of a video/audio data stream
US20070120980A1 (en) 2005-10-31 2007-05-31 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Preservation/degradation of video/audio aspects of a data stream
US20070098348A1 (en) * 2005-10-31 2007-05-03 Searete Llc, A Limited Liability Corporation Of The State Of Delaware Degradation/preservation management of captured data
US9167195B2 (en) * 2005-10-31 2015-10-20 Invention Science Fund I, Llc Preservation/degradation of video/audio aspects of a data stream
US8253821B2 (en) * 2005-10-31 2012-08-28 The Invention Science Fund I, Llc Degradation/preservation management of captured data
US8233042B2 (en) * 2005-10-31 2012-07-31 The Invention Science Fund I, Llc Preservation and/or degradation of a video/audio data stream
US8964054B2 (en) * 2006-08-18 2015-02-24 The Invention Science Fund I, Llc Capturing selected image objects
US8805929B2 (en) * 2005-06-20 2014-08-12 Ricoh Company, Ltd. Event-driven annotation techniques
US7746343B1 (en) * 2005-06-27 2010-06-29 Google Inc. Streaming and interactive visualization of filled polygon data in a geographic information system
US8688801B2 (en) 2005-07-25 2014-04-01 Qurio Holdings, Inc. Syndication feeds for peer computer devices and peer networks
US20090100096A1 (en) * 2005-08-01 2009-04-16 Phanfare, Inc. Systems, Devices, and Methods for Transferring Digital Information
US20070033142A1 (en) * 2005-08-05 2007-02-08 Microsoft Corporation Informal trust relationship to facilitate data sharing
US7853483B2 (en) * 2005-08-05 2010-12-14 Microsoft Coporation Medium and system for enabling content sharing among participants associated with an event
US8005889B1 (en) * 2005-11-16 2011-08-23 Qurio Holdings, Inc. Systems, methods, and computer program products for synchronizing files in a photosharing peer-to-peer network
US20070118509A1 (en) * 2005-11-18 2007-05-24 Flashpoint Technology, Inc. Collaborative service for suggesting media keywords based on location data
US7822746B2 (en) * 2005-11-18 2010-10-26 Qurio Holdings, Inc. System and method for tagging images based on positional information
US20070115149A1 (en) * 2005-11-23 2007-05-24 Macroport, Inc. Systems and methods for managing data on a portable storage device
US20070168419A1 (en) * 2005-12-19 2007-07-19 Sciammarella Eduardo A System, method, and article of manufacture for a network media channel
US8966537B2 (en) * 2005-12-19 2015-02-24 Eduardo Sciammarella System, method, and article of manufacture for a user interface for a network media channel
KR100719514B1 (en) * 2005-12-20 2007-05-11 엔에이치엔(주) Method and system for sorting/searching file and record media therefor
US8788572B1 (en) * 2005-12-27 2014-07-22 Qurio Holdings, Inc. Caching proxy server for a peer-to-peer photosharing system
US7525425B2 (en) * 2006-01-20 2009-04-28 Perdiem Llc System and method for defining an event based on relationship between an object location and a user-defined zone
KR100641791B1 (en) * 2006-02-14 2006-11-02 (주)올라웍스 Tagging Method and System for Digital Data
KR20070082027A (en) * 2006-02-14 2007-08-20 소니 가부시끼 가이샤 Search apparatus and method, and program
US9093121B2 (en) 2006-02-28 2015-07-28 The Invention Science Fund I, Llc Data management of an audio data stream
US20070203595A1 (en) * 2006-02-28 2007-08-30 Searete Llc, A Limited Liability Corporation Data management of an audio data stream
US9076208B2 (en) 2006-02-28 2015-07-07 The Invention Science Fund I, Llc Imagery processing
US8341219B1 (en) * 2006-03-07 2012-12-25 Adobe Systems Incorporated Sharing data based on tagging
US9002754B2 (en) 2006-03-17 2015-04-07 Fatdoor, Inc. Campaign in a geo-spatial environment
US9373149B2 (en) 2006-03-17 2016-06-21 Fatdoor, Inc. Autonomous neighborhood vehicle commerce network and community
US8965409B2 (en) 2006-03-17 2015-02-24 Fatdoor, Inc. User-generated community publication in an online neighborhood social network
US9070101B2 (en) 2007-01-12 2015-06-30 Fatdoor, Inc. Peer-to-peer neighborhood delivery multi-copter and method
US9459622B2 (en) 2007-01-12 2016-10-04 Legalforce, Inc. Driverless vehicle commerce network and community
US9071367B2 (en) 2006-03-17 2015-06-30 Fatdoor, Inc. Emergency including crime broadcast in a neighborhood social network
US9037516B2 (en) 2006-03-17 2015-05-19 Fatdoor, Inc. Direct mailing in a geo-spatial environment
US9064288B2 (en) 2006-03-17 2015-06-23 Fatdoor, Inc. Government structures and neighborhood leads in a geo-spatial environment
EP2405646A1 (en) * 2006-03-23 2012-01-11 Nikon Corporation Camera and image processing program
US8161111B2 (en) * 2006-03-27 2012-04-17 Packet Video, Corp System and method for identifying common media content
JP5649303B2 (en) * 2006-03-30 2015-01-07 エスアールアイ インターナショナルSRI International A method and apparatus for annotating media streams
US8024343B2 (en) 2006-04-07 2011-09-20 Eastman Kodak Company Identifying unique objects in multiple image collections
US20070239780A1 (en) * 2006-04-07 2007-10-11 Microsoft Corporation Simultaneous capture and analysis of media content
GB0607294D0 (en) * 2006-04-11 2006-05-24 Nokia Corp A node
KR100812332B1 (en) * 2006-05-18 2008-03-10 삼성전자주식회사 Apparatus and Method for managing Contents
US7945852B1 (en) * 2006-05-19 2011-05-17 Washington State University Research Foundation Strategies for annotating digital maps
US8341112B2 (en) * 2006-05-19 2012-12-25 Microsoft Corporation Annotation by search
US7945142B2 (en) * 2006-06-15 2011-05-17 Microsoft Corporation Audio/visual editing tool
US8301995B2 (en) * 2006-06-22 2012-10-30 Csr Technology Inc. Labeling and sorting items of digital data by use of attached annotations
US8010555B2 (en) * 2006-06-30 2011-08-30 Aperio Technologies, Inc. System and method for managing images over a network
US8086077B2 (en) 2006-06-30 2011-12-27 Aperio Technologies, Inc. Method for storing and retrieving large images via DICOM
US20090030952A1 (en) * 2006-07-12 2009-01-29 Donahue Michael J Global asset management
US7660787B2 (en) * 2006-07-19 2010-02-09 International Business Machines Corporation Customized, personalized, integrated client-side search indexing of the web
US7853100B2 (en) * 2006-08-08 2010-12-14 Fotomedia Technologies, Llc Method and system for photo planning and tracking
US8375039B2 (en) * 2006-08-11 2013-02-12 Microsoft Corporation Topic centric media sharing
US20080082264A1 (en) * 2006-09-11 2008-04-03 Broadcom Corporation, A California Corporation GPS route creation, photograph association, and data collection
US8436911B2 (en) * 2006-09-14 2013-05-07 Freezecrowd, Inc. Tagging camera
US7895275B1 (en) * 2006-09-28 2011-02-22 Qurio Holdings, Inc. System and method providing quality based peer review and distribution of digital content
WO2008041173A3 (en) * 2006-10-02 2008-07-03 Nokia Corp Method system and devices for network sharing or searching of resources
US7945653B2 (en) * 2006-10-11 2011-05-17 Facebook, Inc. Tagging digital media
US8296808B2 (en) * 2006-10-23 2012-10-23 Sony Corporation Metadata from image recognition
US8239916B2 (en) 2006-11-06 2012-08-07 At&T Intellectual Property I, L.P. Methods, data processing systems, and computer program products for assigning privacy levels to data elements
CN101535996A (en) * 2006-11-14 2009-09-16 皇家飞利浦电子股份有限公司 Method and apparatus for identifying an object captured by a digital image
JP2008140041A (en) * 2006-11-30 2008-06-19 Fujifilm Corp Image sharing server, system, method and program
US8818337B2 (en) * 2006-12-28 2014-08-26 Funmobility, Inc. Application of community-defined descriptors to mobile content
US7953736B2 (en) * 2007-01-04 2011-05-31 Intersect Ptp, Inc. Relevancy rating of tags
US8606854B2 (en) * 2007-01-08 2013-12-10 Apple Inc. System and method for opportunistic image sharing
US8949339B2 (en) * 2007-01-08 2015-02-03 Apple Inc. System and method for automatic opportunistic data and image sharing
US8977716B2 (en) * 2007-02-02 2015-03-10 Sony Corporation Information processing device, method, and program
WO2008093783A1 (en) * 2007-02-02 2008-08-07 Sony Corporation Information processing device, method, and program
JP5321065B2 (en) * 2007-02-02 2013-10-23 ソニー株式会社 An information processing apparatus and method, and program
US20090282365A1 (en) * 2007-02-06 2009-11-12 Nikon Corporation Image processing apparatus, image reproducing apparatus, imaging apparatus and program recording medium
US20080192059A1 (en) * 2007-02-09 2008-08-14 Microsoft Corporation Multi-user display
US8515460B2 (en) 2007-02-12 2013-08-20 Microsoft Corporation Tagging data utilizing nearby device information
US20080228689A1 (en) * 2007-03-12 2008-09-18 Microsoft Corporation Content recommendations
US8584013B1 (en) * 2007-03-20 2013-11-12 Google Inc. Temporal layers for presenting personalization markers on imagery
US20080282090A1 (en) * 2007-05-07 2008-11-13 Jonathan Leybovich Virtual Property System for Globally-Significant Objects
US7975215B2 (en) * 2007-05-14 2011-07-05 Microsoft Corporation Sharing editable ink annotated images with annotation-unaware applications
US7778973B2 (en) * 2007-05-18 2010-08-17 Tat Kuen Choi System, method, and program for sharing photos via the internet
WO2008147890A1 (en) * 2007-05-24 2008-12-04 Geospatial Experts Llc Systems and methods for incorporating data into digital files
US8189880B2 (en) * 2007-05-29 2012-05-29 Microsoft Corporation Interactive photo annotation based on face clustering
US20080320036A1 (en) * 2007-06-22 2008-12-25 Winter Gentle E Automatic data collection
US20090006342A1 (en) * 2007-06-26 2009-01-01 Nokia Corporation Method, Apparatus and Computer Program Product for Providing Internationalization of Content Tagging
US9098545B2 (en) 2007-07-10 2015-08-04 Raj Abhyanker Hot news neighborhood banter in a geo-spatial social network
US20090034781A1 (en) * 2007-07-30 2009-02-05 Natalia Marmasse Method and Computer Program Product for Providing Object Information
US20090044235A1 (en) * 2007-08-07 2009-02-12 Davidson Daniel L Method and system for on-line content acquisition and distribution
EP2186218A4 (en) * 2007-08-21 2012-07-11 Packetvideo Corp Mobile media router and method for using same
EP2031508A1 (en) * 2007-08-31 2009-03-04 Ricoh Europe PLC Network printing apparatus and method
EP2203826A1 (en) * 2007-09-11 2010-07-07 Packetvideo Corp. System and method for virtual storage for media service on a portable device
US20090119608A1 (en) * 2007-11-05 2009-05-07 Scott David Huskey Face and subject tagging with relationship indexing in files to enhance organization and usability
US8385950B1 (en) * 2007-11-09 2013-02-26 Google Inc. Capturing and automatically uploading media content
US8862582B2 (en) * 2007-11-15 2014-10-14 At&T Intellectual Property I, L.P. System and method of organizing images
US8898558B2 (en) * 2007-12-07 2014-11-25 Hewlett-Packard Development Company, L.P. Managing multimodal annotations of an image
US9497583B2 (en) 2007-12-12 2016-11-15 Iii Holdings 2, Llc System and method for generating a recommendation on a mobile device
US8095153B2 (en) * 2007-12-12 2012-01-10 Packet Video Corporation System and method for generating a recommendation on a mobile device
WO2009075771A1 (en) * 2007-12-12 2009-06-18 Packetvideo Corp. System and method for creating metadata
US9288539B2 (en) * 2007-12-12 2016-03-15 Intel Corporation System and method for a user interface to manage the recording, downloading and sharing of content from multiple sources
US9639740B2 (en) 2007-12-31 2017-05-02 Applied Recognition Inc. Face detection and recognition
US8335259B2 (en) 2008-03-12 2012-12-18 Packetvideo Corp. System and method for reformatting digital broadcast multimedia for a mobile device
US8793256B2 (en) 2008-03-26 2014-07-29 Tout Industries, Inc. Method and apparatus for selecting related content for display in conjunction with a media
US8224775B2 (en) * 2008-03-31 2012-07-17 Packetvideo Corp. System and method for managing, controlling and/or rendering media in a network
US8190703B2 (en) * 2008-04-23 2012-05-29 Microsoft Corporation Extensible browser platform for web applications
US20090287655A1 (en) * 2008-05-13 2009-11-19 Bennett James D Image search engine employing user suitability feedback
US20090300142A1 (en) * 2008-05-28 2009-12-03 Mauri Ahlberg Method and service in a public network for doing mutual business
US7890512B2 (en) 2008-06-11 2011-02-15 Microsoft Corporation Automatic image annotation using semantic distance learning
US8364721B2 (en) * 2008-06-12 2013-01-29 Groundspeak, Inc. System and method for providing a guided user interface to process waymark records
US9703806B2 (en) * 2008-06-17 2017-07-11 Microsoft Technology Licensing, Llc User photo handling and control
US20090316961A1 (en) * 2008-06-21 2009-12-24 Microsoft Corporation Method for tagging image content
EP2138941A1 (en) * 2008-06-23 2009-12-30 Alcatel Lucent System and method for providing metadata
GB0906569D0 (en) * 2008-07-11 2009-05-20 Icyte Pty Ltd Annotation system and method
JP5248225B2 (en) * 2008-07-11 2013-07-31 富士フイルム株式会社 Content display device, content display method, and program
US8867779B2 (en) * 2008-08-28 2014-10-21 Microsoft Corporation Image tagging user interface
US8396246B2 (en) * 2008-08-28 2013-03-12 Microsoft Corporation Tagging images with labels
US20100056188A1 (en) * 2008-08-29 2010-03-04 Motorola, Inc. Method and Apparatus for Processing a Digital Image to Select Message Recipients in a Communication Device
US9300993B2 (en) 2008-08-29 2016-03-29 Centurylink Intellectual Property Llc Method and system for providing a content notification for a set-top box
US8544046B2 (en) * 2008-10-09 2013-09-24 Packetvideo Corporation System and method for controlling media rendering in a network using a mobile device
WO2010049008A1 (en) * 2008-10-31 2010-05-06 Telefonaktiebolaget L M Ericsson (Publ) Method and system for verifying geographical descriptiveness of media file
US8301659B2 (en) 2008-11-18 2012-10-30 Core Wireless Licensing S.A.R.L. Method, apparatus, and computer program product for determining media item privacy settings
US20100130236A1 (en) * 2008-11-26 2010-05-27 Nokia Corporation Location assisted word completion
CN101414307A (en) 2008-11-26 2009-04-22 阿里巴巴集团控股有限公司 Method and server for providing picture searching
WO2010065107A1 (en) * 2008-12-04 2010-06-10 Packetvideo Corp. System and method for browsing, selecting and/or controlling rendering of media with a mobile device
US9571713B2 (en) * 2008-12-05 2017-02-14 International Business Machines Corporation Photograph authorization system
US8583682B2 (en) * 2008-12-30 2013-11-12 Microsoft Corporation Peer-to-peer web search using tagged resources
US20100198876A1 (en) * 2009-02-02 2010-08-05 Honeywell International, Inc. Apparatus and method of embedding meta-data in a captured image
US20100199166A1 (en) * 2009-02-04 2010-08-05 Fisk Iii Charles Mario Image Component WEB/PC Repository
WO2010093430A1 (en) * 2009-02-11 2010-08-19 Packetvideo Corp. System and method for frame interpolation for a compressed video bitstream
US9210313B1 (en) 2009-02-17 2015-12-08 Ikorongo Technology, LLC Display device content selection through viewer identification and affinity prediction
US9727312B1 (en) 2009-02-17 2017-08-08 Ikorongo Technology, LLC Providing subject information regarding upcoming images on a display
JP5289998B2 (en) * 2009-02-18 2013-09-11 オリンパスイメージング株式会社 An imaging apparatus and an imaging device program
US9210232B2 (en) * 2009-02-26 2015-12-08 Nokia Technologies Oy Method and apparatus for adaptive media transfer
CN101510217B (en) * 2009-03-09 2013-06-05 阿里巴巴集团控股有限公司 Image updating method in image database, server and system
US8380866B2 (en) * 2009-03-20 2013-02-19 Ricoh Company, Ltd. Techniques for facilitating annotations
US8843975B2 (en) * 2009-04-10 2014-09-23 At&T Intellectual Property I, L.P. Method and apparatus for presenting dynamic media content
US20100293198A1 (en) * 2009-05-12 2010-11-18 Marinucci Joseph L Mobile photo sharing
US8467275B2 (en) * 2009-05-29 2013-06-18 Centurylink Intellectual Property Llc System and method for sharing user content through a set-top box
JP5268787B2 (en) * 2009-06-04 2013-08-21 キヤノン株式会社 The information processing apparatus and a control method thereof, a program
US8253558B2 (en) 2009-06-11 2012-08-28 Embarq Holdings Company, Llc System and method for emergency communication of a location through a set-top box
US20100325205A1 (en) * 2009-06-17 2010-12-23 Microsoft Corporation Event recommendation service
US20100325153A1 (en) * 2009-06-17 2010-12-23 Microsoft Corporation Synchronized distributed media assets
US20110145275A1 (en) * 2009-06-19 2011-06-16 Moment Usa, Inc. Systems and methods of contextual user interfaces for display of media items
US9195775B2 (en) 2009-06-26 2015-11-24 Iii Holdings 2, Llc System and method for managing and/or rendering internet multimedia content in a network
US8463740B2 (en) * 2009-08-05 2013-06-11 Microsoft Corporation Sharing files on a computer through use of URIs
US8549437B2 (en) * 2009-08-27 2013-10-01 Apple Inc. Downloading and synchronizing media metadata
US8332281B2 (en) * 2009-09-02 2012-12-11 Image Holdings Method of displaying, managing and selling images in an event photography environment
WO2011033386A1 (en) * 2009-09-16 2011-03-24 Image Holdings Method and system of displaying, managing and selling images in an event photography environment
US20110072047A1 (en) * 2009-09-21 2011-03-24 Microsoft Corporation Interest Learning from an Image Collection for Advertising
US8374775B2 (en) 2009-11-05 2013-02-12 Apple Inc. Adaptive sensor-based activity classification
EP2507681A4 (en) * 2009-12-02 2013-08-07 Packetvideo Corp System and method for transferring media content from a mobile device to a home network
US20110183651A1 (en) * 2010-01-28 2011-07-28 Packetvideo Corp. System and method for requesting, retrieving and/or associating contact images on a mobile device
KR101157597B1 (en) * 2010-01-28 2012-06-19 주식회사 팬택 Mobile terminal and method for forming human network using mobile terminal
US8677502B2 (en) * 2010-02-22 2014-03-18 Apple Inc. Proximity based networked media file sharing
JP2011188210A (en) * 2010-03-08 2011-09-22 Olympus Imaging Corp Photographing apparatus and photographing system
US8495057B2 (en) 2010-05-17 2013-07-23 Microsoft Corporation Image searching with recognition suggestion
US8886709B2 (en) 2010-05-21 2014-11-11 Blackberry Limited System and method for efficient image and document upload
US8566348B2 (en) 2010-05-24 2013-10-22 Intersect Ptp, Inc. Systems and methods for collaborative storytelling in a virtual space
US9152734B2 (en) 2010-05-24 2015-10-06 Iii Holdings 2, Llc Systems and methods for identifying intersections using content metadata
US8903798B2 (en) 2010-05-28 2014-12-02 Microsoft Corporation Real-time annotation and enrichment of captured video
KR101660742B1 (en) * 2010-05-31 2016-09-28 엘지전자 주식회사 Mobile terminal and method for controlling thereof
US8825598B2 (en) 2010-06-16 2014-09-02 Apple Inc. Media file synchronization
US8832061B2 (en) * 2010-07-02 2014-09-09 Salesforce.Com, Inc. Optimizing data synchronization between mobile clients and database systems
KR101763593B1 (en) 2010-08-24 2017-08-01 엘지전자 주식회사 Method for synchronizing contents and user device enabling of the method
US8630494B1 (en) 2010-09-01 2014-01-14 Ikorongo Technology, LLC Method and system for sharing image content based on collection proximity
US8947547B1 (en) 2010-09-12 2015-02-03 Thomas Nathan Millikan Context and content based automated image and media sharing
US20120086792A1 (en) * 2010-10-11 2012-04-12 Microsoft Corporation Image identification and sharing on mobile devices
US8559682B2 (en) 2010-11-09 2013-10-15 Microsoft Corporation Building a person profile database
US9736524B2 (en) 2011-01-06 2017-08-15 Veveo, Inc. Methods of and systems for content search based on environment sampling
US9037600B1 (en) 2011-01-28 2015-05-19 Yahoo! Inc. Any-image labeling engine
US9218364B1 (en) * 2011-01-28 2015-12-22 Yahoo! Inc. Monitoring an any-image labeling engine
US8798777B2 (en) 2011-03-08 2014-08-05 Packetvideo Corporation System and method for using a list of audio media to create a list of audiovisual media
US20120254709A1 (en) * 2011-03-29 2012-10-04 Ronald Steven Cok Image collection text and audio annotation
US20120254708A1 (en) * 2011-03-29 2012-10-04 Ronald Steven Cok Audio annotations of an image collection
WO2012137341A1 (en) * 2011-04-08 2012-10-11 リプレックス株式会社 Image information processing server
US9678992B2 (en) 2011-05-18 2017-06-13 Microsoft Technology Licensing, Llc Text to image translation
US20130137419A1 (en) * 2011-05-25 2013-05-30 Centric Software, Inc. Mobile App for Design Management Framework
US20120307078A1 (en) * 2011-06-03 2012-12-06 Microsoft Corporation Automatic sharing and replacement of content based on network connectivity
US8831294B2 (en) 2011-06-17 2014-09-09 Microsoft Corporation Broadcast identifier enhanced facial recognition of images
US20130038756A1 (en) * 2011-08-08 2013-02-14 Samsung Electronics Co., Ltd. Life-logging and memory sharing
US9195679B1 (en) 2011-08-11 2015-11-24 Ikorongo Technology, LLC Method and system for the contextual display of image tags in a social network
WO2013060941A3 (en) * 2011-10-28 2013-06-20 Nokia Corporation Method and apparatus for generating a shared index for referencing content
CN103907120B (en) * 2011-12-16 2018-01-02 英派尔科技开发有限公司 Privacy management for automatic image sharing network
JP5857722B2 (en) * 2011-12-20 2016-02-10 ソニー株式会社 The information processing apparatus, information processing method, and program
US9239848B2 (en) 2012-02-06 2016-01-19 Microsoft Technology Licensing, Llc System and method for semantically annotating images
CN103327041B (en) * 2012-03-21 2016-10-12 腾讯科技(深圳)有限公司 For acquiring a method and system for user content
US9098584B1 (en) * 2012-07-19 2015-08-04 Google Inc. Image search privacy protection techniques
KR20140056519A (en) * 2012-10-29 2014-05-12 에스케이플래닛 주식회사 System and method for image filing in a portable terminal
US9720895B1 (en) 2012-12-26 2017-08-01 Metadata Authoring Technologies, LLC Device for construction of computable linked semantic annotations
US9432458B2 (en) * 2013-01-09 2016-08-30 Dell Products, Lp System and method for enhancing server media throughput in mismatched networks
US9633272B2 (en) 2013-02-15 2017-04-25 Yahoo! Inc. Real time object scanning using a mobile phone and cloud-based visual search engine
US9667473B2 (en) * 2013-02-28 2017-05-30 International Business Machines Corporation Recommending server management actions for information processing systems
US9542402B2 (en) * 2013-04-24 2017-01-10 Empire Technology Development Llc Computing devices with multi-layer file systems
US20140379661A1 (en) * 2013-06-20 2014-12-25 Cloudfinder Sweden AB Multi source unified search
US9892139B2 (en) * 2013-07-04 2018-02-13 Varonis Systems, Ltd. Distributed indexing in an enterprise
US9582513B2 (en) 2013-12-08 2017-02-28 Microsoft Technology Licensing, Llc Accessing data in a compressed container through dynamic redirection
US9439367B2 (en) 2014-02-07 2016-09-13 Arthi Abhyanker Network enabled gardening with a remotely controllable positioning extension
US9298746B2 (en) 2014-03-19 2016-03-29 International Business Machines Corporation Collaborative capture of photographic images
US20150278463A1 (en) 2014-04-01 2015-10-01 Merge Healthcare Incorporated Systems and methods for pre-authorizing image studies
US9457901B2 (en) 2014-04-22 2016-10-04 Fatdoor, Inc. Quadcopter with a printable payload extension system and method
US9004396B1 (en) 2014-04-24 2015-04-14 Fatdoor, Inc. Skyteboard quadcopter and method
US9022324B1 (en) 2014-05-05 2015-05-05 Fatdoor, Inc. Coordination of aerial vehicles through a central server
US9113301B1 (en) 2014-06-13 2015-08-18 Snapchat, Inc. Geo-location based event gallery
US9441981B2 (en) 2014-06-20 2016-09-13 Fatdoor, Inc. Variable bus stops across a bus route in a regional transportation network
US9451020B2 (en) 2014-07-18 2016-09-20 Legalforce, Inc. Distributed communication of independent autonomous vehicles to provide redundancy and performance
US9195912B1 (en) * 2014-07-24 2015-11-24 National Taipei University Of Technology Face annotation method and a face annotation system
US20160055185A1 (en) * 2014-08-21 2016-02-25 Dropbox, Inc. Multi-user search system with methodology for personalized search query autocomplete
US9015285B1 (en) 2014-11-12 2015-04-21 Snapchat, Inc. User interface for accessing media at a geographic location
US20160140146A1 (en) * 2014-11-14 2016-05-19 Zorroa Corporation Systems and Methods of Building and Using an Image Catalog
US20160142382A1 (en) * 2014-11-14 2016-05-19 William J. Ziebell Systems, Methods, and Media for a Cloud Based Social Media Network
US9521515B2 (en) 2015-01-26 2016-12-13 Mobli Technologies 2010 Ltd. Content request by location
US9384226B1 (en) * 2015-01-30 2016-07-05 Dropbox, Inc. Personal content item searching system and method
US9183303B1 (en) 2015-01-30 2015-11-10 Dropbox, Inc. Personal content item searching system and method
EP3065067A1 (en) * 2015-03-06 2016-09-07 Captoria Ltd Anonymous live image search
US9881094B2 (en) 2015-05-05 2018-01-30 Snap Inc. Systems and methods for automated local story generation and curation
WO2017048723A1 (en) * 2015-09-18 2017-03-23 Commvault Systems, Inc. Data storage management operations in a secondary storage subsystem using image recognition and image-based criteria

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5893095A (en) * 1996-03-29 1999-04-06 Virage, Inc. Similarity engine for content-based retrieval of images
US6367020B1 (en) * 1998-03-09 2002-04-02 Micron Technology, Inc. System for automatically initiating a computer security and/or screen saver mode
US20020055967A1 (en) * 2000-11-08 2002-05-09 Coussement Stefaan Valere Albert System for reporting client status information to communications-center agents
US6459809B1 (en) * 1999-07-12 2002-10-01 Novell, Inc. Searching and filtering content streams using contour transformations
US6493744B1 (en) * 1999-08-16 2002-12-10 International Business Machines Corporation Automatic rating and filtering of data files for objectionable content
US6504571B1 (en) * 1998-05-18 2003-01-07 International Business Machines Corporation System and methods for querying digital image archives using recorded parameters
US6611849B1 (en) * 2000-09-29 2003-08-26 Palm Source, Inc. System for synchronizing databases on multiple devices utilizing a home base
US6757684B2 (en) * 2001-10-01 2004-06-29 Ipac Acquisition Subsidiary I, Llc Network-based photosharing architecture
US6839843B1 (en) * 1998-12-23 2005-01-04 International Business Machines Corporation System for electronic repository of data enforcing access control on data retrieval
US6895128B2 (en) * 2001-05-29 2005-05-17 Mevis Breastcare Gmbh & Co. Kg Method and computer system for prefetching of images

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7756892B2 (en) * 2000-05-02 2010-07-13 Digimarc Corporation Using embedded data with file sharing
US5832499A (en) * 1996-07-10 1998-11-03 Survivors Of The Shoah Visual History Foundation Digital library system
US5760917A (en) * 1996-09-16 1998-06-02 Eastman Kodak Company Image distribution method and system
US6247009B1 (en) * 1997-03-10 2001-06-12 Canon Kabushiki Kaisha Image processing with searching of image data
US6573907B1 (en) * 1997-07-03 2003-06-03 Obvious Technology Network distribution and management of interactive video and multi-media containers
US6301586B1 (en) * 1997-10-06 2001-10-09 Canon Kabushiki Kaisha System for managing multimedia objects
US6301607B2 (en) * 1998-02-06 2001-10-09 Netergy Networks, Inc. Arrangement and method for displaying and sharing images
US6687878B1 (en) * 1999-03-15 2004-02-03 Real Time Image Ltd. Synchronizing/updating local client notes with annotations previously made by other clients in a notes database
US6985875B1 (en) * 1999-11-05 2006-01-10 Wolf Peter H Process for providing event photographs for inspection, selection and distribution via a computer network
US6583799B1 (en) * 1999-11-24 2003-06-24 Shutterfly, Inc. Image uploading
US6366907B1 (en) * 1999-12-15 2002-04-02 Napster, Inc. Real-time search engine
US7415662B2 (en) * 2000-01-31 2008-08-19 Adobe Systems Incorporated Digital media management apparatus and methods
EP1128285B1 (en) * 2000-02-21 2010-04-28 Hewlett-Packard Company, A Delaware Corporation Augmentation of sets of image recordings
US6813618B1 (en) * 2000-08-18 2004-11-02 Alexander C. Loui System and method for acquisition of related graphical material in a digital graphics album
US20020093678A1 (en) * 2000-10-17 2002-07-18 Skidgel John M. Managing and searching digital images
US6629104B1 (en) * 2000-11-22 2003-09-30 Eastman Kodak Company Method for adding personalized metadata to a collection of digital images
US6883146B2 (en) * 2000-12-20 2005-04-19 Eastman Kodak Company Picture database graphical user interface utilizing map-based metaphors for efficient browsing and retrieving of pictures
US6804684B2 (en) * 2001-05-07 2004-10-12 Eastman Kodak Company Method for associating semantic information with multiple images in an image database environment
US6999111B2 (en) * 2001-06-26 2006-02-14 Eastman Kodak Company Electronic camera and system for transmitting digital over a communication network
US7124191B2 (en) * 2001-06-26 2006-10-17 Eastman Kodak Company Method and system for managing images over a communication network
US7565441B2 (en) * 2001-07-23 2009-07-21 Romanik Philip B Image transfer and archival system
GB0118436D0 (en) * 2001-07-27 2001-09-19 Hewlett Packard Co Synchronised cameras with auto-exchange
US6629100B2 (en) * 2001-10-01 2003-09-30 Ipac Acquisition Subsidiary I, Llc Network-based photosharing architecture for search and delivery of private images and metadata
US7068309B2 (en) * 2001-10-09 2006-06-27 Microsoft Corp. Image exchange with image annotation
US20030078918A1 (en) * 2001-10-23 2003-04-24 Souvignier Todd J. Method, apparatus and system for file sharing between computers
US20030154178A1 (en) * 2002-02-08 2003-08-14 Eastman Kodak Company Method of automatically updating non-image data associated with a digital image
US6954543B2 (en) * 2002-02-28 2005-10-11 Ipac Acquisition Subsidiary I, Llc Automated discovery, assignment, and submission of image metadata to a network-based photosharing service
EP1589444A3 (en) * 2004-04-21 2008-03-12 Samsung Electronics Co., Ltd. Method, medium, and apparatus for detecting situation change of digital photos and method, medium, and apparatus for situation-based photo clustering in digital photo album
US8531551B2 (en) * 2004-10-21 2013-09-10 Hewlett-Packard Development Company, L.P. System and method for image sharing
JP2006163842A (en) * 2004-12-07 2006-06-22 Canon Inc Search system, information processor, its control method, and program
US20060168126A1 (en) * 2004-12-21 2006-07-27 Jose Costa-Requena Aggregated content listing for ad-hoc peer to peer networks
US7653302B2 (en) * 2005-03-24 2010-01-26 Syabas Technology Inc. Techniques for transmitting personal data and metadata among computing devices

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5893095A (en) * 1996-03-29 1999-04-06 Virage, Inc. Similarity engine for content-based retrieval of images
US6367020B1 (en) * 1998-03-09 2002-04-02 Micron Technology, Inc. System for automatically initiating a computer security and/or screen saver mode
US6504571B1 (en) * 1998-05-18 2003-01-07 International Business Machines Corporation System and methods for querying digital image archives using recorded parameters
US6839843B1 (en) * 1998-12-23 2005-01-04 International Business Machines Corporation System for electronic repository of data enforcing access control on data retrieval
US6459809B1 (en) * 1999-07-12 2002-10-01 Novell, Inc. Searching and filtering content streams using contour transformations
US6493744B1 (en) * 1999-08-16 2002-12-10 International Business Machines Corporation Automatic rating and filtering of data files for objectionable content
US6611849B1 (en) * 2000-09-29 2003-08-26 Palm Source, Inc. System for synchronizing databases on multiple devices utilizing a home base
US20020055967A1 (en) * 2000-11-08 2002-05-09 Coussement Stefaan Valere Albert System for reporting client status information to communications-center agents
US6895128B2 (en) * 2001-05-29 2005-05-17 Mevis Breastcare Gmbh & Co. Kg Method and computer system for prefetching of images
US6757684B2 (en) * 2001-10-01 2004-06-29 Ipac Acquisition Subsidiary I, Llc Network-based photosharing architecture

Cited By (107)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040070678A1 (en) * 2001-10-09 2004-04-15 Kentaro Toyama System and method for exchanging images
US7068309B2 (en) * 2001-10-09 2006-06-27 Microsoft Corp. Image exchange with image annotation
US20060107297A1 (en) * 2001-10-09 2006-05-18 Microsoft Corporation System and method for exchanging images
US7508419B2 (en) * 2001-10-09 2009-03-24 Microsoft, Corp Image exchange with image annotation
US20050065979A1 (en) * 2002-03-01 2005-03-24 Ivan Vachovsky System and method for creating and maintaining an online photo album
US20040139172A1 (en) * 2003-01-15 2004-07-15 Svendsen Hugh Blake Method and system for requesting image prints in an online photosharing system
US7970854B2 (en) * 2003-01-15 2011-06-28 Qurio Holdings, Inc. Method and system for requesting image prints in an online photosharing system
US7552175B2 (en) 2004-04-30 2009-06-23 Microsoft Corporation Mechanism for controlling communication paths between conference members
US20050256925A1 (en) * 2004-04-30 2005-11-17 Microsoft Corporation Mechanism for controlling a decentralized multi-party conference
US20050278379A1 (en) * 2004-06-10 2005-12-15 Canon Kabushiki Kaisha Image retrieval device and image retrieval method
US20050285971A1 (en) * 2004-06-24 2005-12-29 Stavely Donald J Method and apparatus for controlling color balance in a digital imaging device
US7978245B2 (en) * 2004-06-24 2011-07-12 Hewlett-Packard Development Company, L.P. Method and apparatus for controlling color balance in a digital imaging device
US20060069681A1 (en) * 2004-09-28 2006-03-30 Swisscom Mobile Ag Method and means for finding recorded data in a database
US9063953B2 (en) 2004-10-01 2015-06-23 Ricoh Co., Ltd. System and methods for creation and use of a mixed media environment
US8600989B2 (en) 2004-10-01 2013-12-03 Ricoh Co., Ltd. Method and system for image matching in a mixed media environment
US8335789B2 (en) 2004-10-01 2012-12-18 Ricoh Co., Ltd. Method and system for document fingerprint matching in a mixed media environment
US8332401B2 (en) 2004-10-01 2012-12-11 Ricoh Co., Ltd Method and system for position-based image matching in a mixed media environment
US8521737B2 (en) 2004-10-01 2013-08-27 Ricoh Co., Ltd. Method and system for multi-tier image matching in a mixed media environment
US9171202B2 (en) 2005-08-23 2015-10-27 Ricoh Co., Ltd. Data organization and access for mixed media document system
US9405751B2 (en) 2005-08-23 2016-08-02 Ricoh Co., Ltd. Database for mixed media document system
US20110081892A1 (en) * 2005-08-23 2011-04-07 Ricoh Co., Ltd. System and methods for use of voice mail and email in a mixed media environment
US8838591B2 (en) 2005-08-23 2014-09-16 Ricoh Co., Ltd. Embedding hot spots in electronic documents
US8156427B2 (en) 2005-08-23 2012-04-10 Ricoh Co. Ltd. User interface for mixed media reality
US8195659B2 (en) 2005-08-23 2012-06-05 Ricoh Co. Ltd. Integration and use of mixed media documents
US8949287B2 (en) 2005-08-23 2015-02-03 Ricoh Co., Ltd. Embedding hot spots in imaged documents
US7810149B2 (en) * 2005-08-29 2010-10-05 Junaid Islam Architecture for mobile IPv6 applications over IPv4
US20070050613A1 (en) * 2005-08-29 2007-03-01 Junaid Islam Architecture for Mobile IPv6 Applications over IPv4
US8976963B2 (en) * 2005-08-29 2015-03-10 Junaid Islam IPv6-over-IPv4 architecture
US20110023105A1 (en) * 2005-08-29 2011-01-27 Junaid Islam IPv6-over-IPv4 Architecture
US7747574B1 (en) 2005-09-19 2010-06-29 Qurio Holdings, Inc. System and method for archiving digital media
US7933972B1 (en) 2005-09-29 2011-04-26 Qurio Holdings, Inc. Method and system for organizing categories of content in a distributed network
US20070109616A1 (en) * 2005-10-04 2007-05-17 Kelly Thompson System and method for searching digital images
US8571329B2 (en) 2005-10-04 2013-10-29 Getty Images, Inc. System and method for searching digital images
US8144995B2 (en) * 2005-10-04 2012-03-27 Getty Images, Inc. System and method for searching digital images
US8527492B1 (en) * 2005-11-17 2013-09-03 Quiro Holdings, Inc. Associating external content with a digital image
US20070118525A1 (en) * 2005-11-18 2007-05-24 Flashpoint Technology, Inc. System and method for controlling access to assets in a network-based media sharing system using tagging
US9141825B2 (en) * 2005-11-18 2015-09-22 Qurio Holdings, Inc. System and method for controlling access to assets in a network-based media sharing system using tagging
US7779006B2 (en) * 2005-12-09 2010-08-17 Illinois Institute Of Technology Peer-to-peer file sharing
US20070136370A1 (en) * 2005-12-09 2007-06-14 Ophir Frieder Peer-to-peer file sharing
JP2009524889A (en) * 2006-01-25 2009-07-02 グーグル・インコーポレーテッド Multiple client search method and system of
US20070174246A1 (en) * 2006-01-25 2007-07-26 Sigurdsson Johann T Multiple client search method and system
US20070233732A1 (en) * 2006-04-04 2007-10-04 Mozes Incorporated Content request, storage and/or configuration systems and methods
US20070276844A1 (en) * 2006-05-01 2007-11-29 Anat Segal System and method for performing configurable matching of similar data in a data repository
US7542973B2 (en) * 2006-05-01 2009-06-02 Sap, Aktiengesellschaft System and method for performing configurable matching of similar data in a data repository
US8041784B1 (en) 2006-06-27 2011-10-18 Qurio Holdings, Inc. Redundant hybrid P2P content sharing
US9020966B2 (en) 2006-07-31 2015-04-28 Ricoh Co., Ltd. Client device for interacting with a mixed media reality recognition system
US9063952B2 (en) 2006-07-31 2015-06-23 Ricoh Co., Ltd. Mixed media reality recognition with image tracking
US8156116B2 (en) 2006-07-31 2012-04-10 Ricoh Co., Ltd Dynamic presentation of targeted information in a mixed media reality recognition system
US8868555B2 (en) 2006-07-31 2014-10-21 Ricoh Co., Ltd. Computation of a recongnizability score (quality predictor) for image retrieval
US8676810B2 (en) 2006-07-31 2014-03-18 Ricoh Co., Ltd. Multiple index mixed media reality recognition using unequal priority indexes
US8510283B2 (en) 2006-07-31 2013-08-13 Ricoh Co., Ltd. Automatic adaption of an image recognition system to image capture devices
US8489987B2 (en) 2006-07-31 2013-07-16 Ricoh Co., Ltd. Monitoring and analyzing creation and usage of visual content using image and hotspot interaction
US8201076B2 (en) 2006-07-31 2012-06-12 Ricoh Co., Ltd. Capturing symbolic information from documents upon printing
US8856108B2 (en) 2006-07-31 2014-10-07 Ricoh Co., Ltd. Combining results of image retrieval processes
US9384619B2 (en) 2006-07-31 2016-07-05 Ricoh Co., Ltd. Searching media content for objects specified using identifiers
US8073263B2 (en) 2006-07-31 2011-12-06 Ricoh Co., Ltd. Multi-classifier selection and monitoring for MMR-based image recognition
US8369655B2 (en) 2006-07-31 2013-02-05 Ricoh Co., Ltd. Mixed media reality recognition using multiple specialized indexes
US9176984B2 (en) 2006-07-31 2015-11-03 Ricoh Co., Ltd Mixed media reality retrieval of differentially-weighted links
US8825682B2 (en) 2006-07-31 2014-09-02 Ricoh Co., Ltd. Architecture for mixed media reality retrieval of locations and registration of images
US9122645B1 (en) 2006-12-20 2015-09-01 Qurio Holdings, Inc. Method and system for tagging within virtual groups
US20080162557A1 (en) * 2006-12-28 2008-07-03 Nokia Corporation Systems, methods, devices, and computer program products providing for reflective media
US8238609B2 (en) 2007-01-18 2012-08-07 Ricoh Co., Ltd. Synthetic image and video generation from ground truth data
US20080281919A1 (en) * 2007-05-09 2008-11-13 University Of Georgia Research Foundation, Inc. System and Method for Sharing Images
US20080301087A1 (en) * 2007-05-30 2008-12-04 Red Hat, Inc. Index clustering for full text search engines
US7827168B2 (en) * 2007-05-30 2010-11-02 Red Hat, Inc. Index clustering for full text search engines
US8276088B2 (en) 2007-07-11 2012-09-25 Ricoh Co., Ltd. User interface for three-dimensional navigation
US8184155B2 (en) 2007-07-11 2012-05-22 Ricoh Co. Ltd. Recognition and tracking using invisible junctions
US9373029B2 (en) 2007-07-11 2016-06-21 Ricoh Co., Ltd. Invisible junction feature recognition for document security or annotation
US9530050B1 (en) * 2007-07-11 2016-12-27 Ricoh Co., Ltd. Document annotation sharing
US8989431B1 (en) 2007-07-11 2015-03-24 Ricoh Co., Ltd. Ad hoc paper-based networking with mixed media reality
US8144921B2 (en) 2007-07-11 2012-03-27 Ricoh Co., Ltd. Information retrieval using invisible junctions and geometric constraints
US8086038B2 (en) 2007-07-11 2011-12-27 Ricoh Co., Ltd. Invisible junction features for patch recognition
US8156115B1 (en) 2007-07-11 2012-04-10 Ricoh Co. Ltd. Document-based networking with mixed media reality
US8176054B2 (en) 2007-07-12 2012-05-08 Ricoh Co. Ltd Retrieving electronic documents by converting them to synthetic text
US8577856B2 (en) * 2007-10-05 2013-11-05 Aharon Mizrahi System and method for enabling search of content
US20100223259A1 (en) * 2007-10-05 2010-09-02 Aharon Ronen Mizrahi System and method for enabling search of content
US20090106202A1 (en) * 2007-10-05 2009-04-23 Aharon Mizrahi System And Method For Enabling Search Of Content
US8994731B2 (en) 2007-12-19 2015-03-31 Temporal Llc Apparatus, system, and method for organizing information by time and place
US20140161326A1 (en) * 2007-12-31 2014-06-12 Ray Ganong Method, system, and computer program for identification and sharing of digital images with face signatures
US9721148B2 (en) 2007-12-31 2017-08-01 Applied Recognition Inc. Face detection and recognition
US9152849B2 (en) * 2007-12-31 2015-10-06 Applied Recognition Inc. Method, system, and computer program for identification and sharing of digital images with face signatures
US8533156B2 (en) 2008-01-04 2013-09-10 Apple Inc. Abstraction for representing an object irrespective of characteristics of the object
US20090177662A1 (en) * 2008-01-04 2009-07-09 Apple Inc. Abstraction for representing an object irrespective of characteristics of the object
US20090287782A1 (en) * 2008-05-14 2009-11-19 Daniel Brian Odess Interactive Multimedia Timeline
US8385589B2 (en) 2008-05-15 2013-02-26 Berna Erol Web-based content detection in images, extraction and recognition
US8734872B2 (en) 2008-09-30 2014-05-27 Apple Inc. Access control to content published by a host
US20100082680A1 (en) * 2008-09-30 2010-04-01 Apple Inc. Methods and systems for providing easy access to information and for sharing services
US8805846B2 (en) * 2008-09-30 2014-08-12 Apple Inc. Methods and systems for providing easy access to information and for sharing services
US8296305B2 (en) * 2008-12-09 2012-10-23 Yahoo! Inc. Rules and method for improving image search relevance through games
US20100145941A1 (en) * 2008-12-09 2010-06-10 Sudharsan Vasudevan Rules and method for improving image search relevance through games
US9280672B2 (en) * 2009-01-13 2016-03-08 Xerox Corporation Method for secure production printing
US20100177358A1 (en) * 2009-01-13 2010-07-15 Xerox Corporation Method for secure production printing
US9172594B1 (en) 2009-04-27 2015-10-27 Junaid Islam IPv6 to web architecture
US9178924B1 (en) 2009-04-27 2015-11-03 Junaid Islam IPv6 to web architecture
US8719337B1 (en) 2009-04-27 2014-05-06 Junaid Islam IPv6 to web architecture
US8385660B2 (en) 2009-06-24 2013-02-26 Ricoh Co., Ltd. Mixed media reality indexing and retrieval for repeated content
US8554017B2 (en) * 2009-12-04 2013-10-08 Sony Corporation Imaging apparatus, data processing method, and program
US20110158556A1 (en) * 2009-12-04 2011-06-30 Sony Corporation Imaging apparatus, data processing method, and program
US20110145693A1 (en) * 2009-12-10 2011-06-16 Fulcrum Medical Inc. Transfer of digital medical images and data
WO2012112780A3 (en) * 2011-02-18 2013-03-21 Google Inc. Affinity based ranked for search and display
WO2012112780A2 (en) * 2011-02-18 2012-08-23 Google Inc. Affinity based ranked for search and display
US8606776B2 (en) 2011-02-18 2013-12-10 Google Inc. Affinity based ranked for search and display
US9141644B2 (en) 2011-02-18 2015-09-22 Google Inc. Affinity based ranked for search and display
US9058331B2 (en) 2011-07-27 2015-06-16 Ricoh Co., Ltd. Generating a conversation in a social network based on visual search results
US9641523B2 (en) 2011-08-15 2017-05-02 Daon Holdings Limited Method of host-directed illumination and system for conducting host-directed illumination
US9930505B2 (en) 2014-05-02 2018-03-27 International Business Machines Corporation Retrieval of digital content related to unavailable digital content
US9934504B2 (en) 2015-10-19 2018-04-03 Amazon Technologies, Inc. Image analysis for user authentication

Also Published As

Publication number Publication date Type
US7508419B2 (en) 2009-03-24 grant
US7068309B2 (en) 2006-06-27 grant
US20040070678A1 (en) 2004-04-15 application
US20060107297A1 (en) 2006-05-18 application

Similar Documents

Publication Publication Date Title
US7454090B2 (en) Augmentation of sets of image recordings
US7216289B2 (en) Method and apparatus for synchronizing multiple versions of digital data
Naaman et al. From where to what: Metadata sharing for digital photographs with geographic coordinates
US6914626B2 (en) Location-informed camera
Whittaker et al. Easy on that trigger dad: a study of long term family photo retrieval
US7702681B2 (en) Query-by-image search and retrieval system
US6629100B2 (en) Network-based photosharing architecture for search and delivery of private images and metadata
US20100082653A1 (en) Event media search
US20030069803A1 (en) Method of displaying content
US20020087601A1 (en) Client-server system for merging of metadata with images
US20090132941A1 (en) Creation and use of digital maps
US20060221190A1 (en) Techniques for transmitting personal data and metadata among computing devices
US20020111956A1 (en) Method and apparatus for self-management of content across multiple storage systems
US20040111415A1 (en) Automatic organization of images uploaded to a photo-sharing site
US20100010994A1 (en) Mobile application discovery through mobile search
US20010022621A1 (en) Camera with user identity data
US20040139172A1 (en) Method and system for requesting image prints in an online photosharing system
US6768999B2 (en) Enterprise, stream-based, information management system
US20110125755A1 (en) Systems and methods for thumbnail management
US20040148453A1 (en) Data file storage device with automatic filename creation function, data file storage program and data file storage method
US20060155761A1 (en) Enhanced organization and retrieval of digital images
US20090222432A1 (en) Geo Tagging and Automatic Generation of Metadata for Photos and Videos
US20070258642A1 (en) Geo-coding images
US20050050028A1 (en) Methods and systems for searching content in distributed computing networks
US20020198962A1 (en) Method, system, and computer program product for distributing a stored URL and web document set

Legal Events

Date Code Title Description
AS Assignment

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034766/0001

Effective date: 20141014