WO2023102271A1 - Ai-powered raw file management - Google Patents

Ai-powered raw file management Download PDF

Info

Publication number
WO2023102271A1
WO2023102271A1 PCT/US2022/051874 US2022051874W WO2023102271A1 WO 2023102271 A1 WO2023102271 A1 WO 2023102271A1 US 2022051874 W US2022051874 W US 2022051874W WO 2023102271 A1 WO2023102271 A1 WO 2023102271A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
files
image files
raw
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2022/051874
Other languages
English (en)
French (fr)
Inventor
Evan Christopher DEFFLEY
Nathan Cosmo RAHN
Bobby Yang
Kaserin Tammie KONG-SANTOS
Don Macaskill
Brian FENTON
David Parry
Mikkel WILSON
Kevin BOYD
Lee SHEPHERD
Andres Ruiz
Erik GIBERTI
Ivy Tsai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Awes Me Inc
Original Assignee
Smugmug Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Smugmug Inc filed Critical Smugmug Inc
Priority to JP2024533232A priority Critical patent/JP2024542810A/ja
Priority to CA3240951A priority patent/CA3240951A1/en
Priority to EP22902293.4A priority patent/EP4441626A4/en
Priority to AU2022402119A priority patent/AU2022402119B2/en
Priority to CN202280080268.3A priority patent/CN118511169A/zh
Priority to KR1020247018558A priority patent/KR20240141232A/ko
Publication of WO2023102271A1 publication Critical patent/WO2023102271A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/532Query formulation, e.g. graphical querying
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/535Filtering based on additional data, e.g. user or group profiles
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53Querying
    • G06F16/538Presentation of query results
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/55Clustering; Classification
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/70Labelling scene content, e.g. deriving syntactic or semantic representations

Definitions

  • the present disclosure is generally related to digital file management. Specifically, the disclosure is related to automated management of image files.
  • a photograph from a digital camera may be saved as a raw image file, which is an unedited and uncompressed data file encompassing the full set of details captured in relation to the photograph.
  • the raw image file which may include such formats such as a .RAW, .DNG, .RAF, .TIF, and other similar formats— may often be very large in resolution and file size.
  • a compressed image file e.g., a .jpeg or .png file
  • standard image viewing software e.g., such as those associated with web browsers
  • standard image viewing software are not compatible with raw image files, which require specialized software to render for display.
  • the inability to render a raw image file may complicate or make more difficult the process of organizing and managing raw image files, which may further be exacerbated when there are numerous raw image files to manage and numerous different software applications for performing different functions upon the raw image files.
  • managing raw images files can be a time-consuming, fragmented process.
  • the user may create multiple versions of any single raw image file in order to evaluate different combinations of edits, which may exponentially increase the number of images and files associated with a photography project.
  • the different versions may further be stored using different photo editing applications or services, as well as presented to clients or buyers using different photo storage and secure access services. Different files of the different versions may therefore end up distributed across different services or storage locations.
  • the photographer may upload images to one or more digital storage and file sharing services that allow the buyer to review photographs online, as well as to request additional editing or changes to a photograph or select prints for purchase.
  • the photographer may need to locate and retrieve the associated raw image file(s) or edited versions thereof for further editing or printing, as well as upload the final edited images to the file sharing service for storage, access, and display to the user in a viewable format. Maintaining the integrity of version associations throughout can be extremely cumbersome and time-consuming for the user.
  • FIG. 1 illustrates an exemplary network environment.
  • FIG. 2 is a flowchart illustrating an exemplary method for associating digital files.
  • FIG. 3 is an exemplary screenshot of a display generated by the management interface.
  • FIG. 4 is an exemplary screenshot of a display generated by the management interface.
  • FIG. 5 is an exemplary screenshot of an asset organization view of the management interface.
  • a file association service may receive various raw image files, rendered image files, and associated sidecar files in a variety of digital file formats.
  • the file association service may extract metadata from each of the digital files and may link or associate one or more digital files with a different digital file based on extracted metadata.
  • Digital files with detected similarities in metadata may be associated by an asset file.
  • a user may manually associate files in cases where metadata from one or more files does not match.
  • the asset file may include common metadata for each included digital file and links to each raw, rendered, or sidecar file.
  • the asset file, raw files, rendered files, and sidecar files may be stored on a database of the file association service, and each file may further be accessed by a user via a user device.
  • FIG. 1 illustrates an exemplary network environment in which a system for automated association of digital files may be implemented.
  • a raw image file hereinafter referred to as a "raw file” 140 may be created and stored by a raw file source device 110, such as a digital camera or smartphone.
  • the raw file source device 110 may include a variety of sensors 120 capable of creating metadata for the raw file 140 during image capture, including a geolocation, a date and time, a make and model of the raw image device, and imaging parameters known by the raw image device used during capture (e.g. focal length, aperture, exposure time, ISO, etc.).
  • the raw file 140 and captured metadata may be transmitted to a user device 130, such as a desktop or laptop computer, tablet, or mobile device.
  • the user device 130 may act as the raw file source device 110, such as a smartphone capable of capturing raw files.
  • the user device 130 may include a plurality of different types of computing devices.
  • the user device 130 may include any number of different mobile devices, laptops, and desktops.
  • the user device 130 may be implemented in the cloud.
  • Such user device 130 may also be configured to access data from other storage media, such as, but not limited to memory cards or disk drives as may be appropriate in the case of downloaded or sensor captured data.
  • Such devices 130 may include standard hardware computing components such as, but not limited to network and media interfaces, non-transitory computer-readable storage (memory), and processors for executing instructions that may be stored in memory.
  • the user devices 130 may include various hardware sensors for detecting user interactions, such as a camera, microphone, and haptic feedback input mechanisms.
  • Hardware sensors in user devices may be used to capture user response and feedback, such as gestures, speech, and touch. These user devices 130 may also run using a variety of different operating systems, such as iOS or Android. The user devices 130 may also rim a variety of applications or computing languages, such as C++ or JavaScript. The user device may include one or more devices associated with a user or a user device capable of displaying on one or more screens.
  • Raw files 140 stored on the user device 130 may be digitally processed by software, such as Adobe® Lightroom or Capture One, that generates a rendered file 150, such as a .jpeg or .png file.
  • Raw file editing software may generate a sidecar file 160 during editing of the raw file 140 or during compression and storage of the rendered file 150 (e.g. an .xmp file from Adobe Lightroom, or a .cof file from Capture One).
  • Sidecar files 160 may include a history of the editing process of a raw file, may further be edited by the user, and may be used to generate multiple rendered files 150.
  • Raw files 140, rendered files 150, and sidecar files 160 may be stored and accessed separately on the user device 130.
  • the user device 130 may transmit raw files 140, rendered files 150, and sidecar files 160 to a file association service 170 via a communication transceiver 132 over a communication network, such as a wide-area network (WAN) or internet connection.
  • a file association service 170 may receive a transfer of files through various manual and automated methods initiated at the user device 130.
  • Each file received by the file association service 170 may be stored in a database 171 of the file association service 170.
  • the file association service 170 may include the database 171 and a processor 172.
  • the processor 172 may execute instructions stored in database 171 to associate raw files 140, rendered files 150, and sidecar files 160 previously received and stored in the database 171.
  • the file association may be saved in database 171 as an asset file 174.
  • Capture metadata from the raw file source device 110, file metadata of each associated file, and metadata for the combined asset file 174 may be maintained as separate sections of metadata and stored within the asset file 174.
  • the file association service 170 may extract capture metadata and file metadata from the transferred files, such as the filename, date captured, time of day, and imaging parameters captured by the source device (e.g. focal length, aperture, exposure time, ISO, etc.). Extracted metadata and links to each raw file 140, rendered file 150, and sidecar file 160 may be included in the metadata of the asset file 174.
  • the processor 172 may further execute instructions to generate a preview file 175 for raw files 140. Preview files, such as a compressed .jpg version of a raw file 140, may be stored in the database 171 as part of the asset file 174.
  • a management interface 180 may communicate with database 171 of the file association service 170 via an application programming interface (API) 173 based on a request from a user device 130.
  • the API 173 may act as an intermediary that allows one or more services of one or more software applications to communicate in a standardized request-response format.
  • the API 173 may require a security authorization to accept or send data to a service or software application, such as an access key that must be encoded and passed within each request.
  • the API 173 and may reject a request that fails to include the security authorization.
  • Encoded requests from connected services or applications may include a payload containing the security authorization and instructions for the API to execute the request, such as retrieving data from the database 171, storing new data in the database 171, or triggering instructions executed by processor 172 performing other functions of the file association service 170.
  • the management interface 180 may receive a user input via a graphical user interface (GUI) 181 displayed on the display 131 of the user device 130 and may execute one or more commands triggering an encoded request sent to the file association service 170 via the API 173.
  • GUI graphical user interface
  • the GUI 181 of the management interface 180 may include commands to perform various functions related to raw files 140, rendered files 150, sidecar files 160, preview files 175, and asset files 174, such as creating a gallery of files, searching files, overwriting or updating file associations, and viewing a display of transferred files.
  • the API 173 of the file association service 170 may be configured to accept requests encoded by third-party applications 190 in addition to requests from the management interface
  • third-party applications 190 may be a software installed on computer-readable storage media of user devices 130, or software accessed from an application cloud server via user devices 130. In some embodiments, third- party applications 190 may automatically transmit requests to the API 173 through various workflows configured by a user, such as automatically uploading sidecar files 160 from an editing application.
  • FIG. 2 is a flowchart illustrating an exemplary method for associating digital files.
  • the steps identified in FIG. 2 are exemplary and may include various alternatives, equivalents, or derivations thereof including but not limited to the order of execution of the same.
  • the steps of the process of FIG. 2 and any alternative similar processes may be embodied in hardware or software including a computer-readable storage medium including instructions executable by the likes of a processor in a computing device.
  • the exemplary process illustrated in FIG. 2 may be performed repeatedly during use of a file association service 170.
  • the file association service 170 may receive one or more digital files from the user device 130.
  • the user device 130 may transfer files to the file association service 170 through various manual and automated methods.
  • a user may manually select files and initiate transfer of files to the file association service 170 from the user device 130.
  • the user may select one or more files from storage on the user device 130 and may transfer a raw file 140, an rendered file 150, a sidecar file 160, or any combination therein.
  • the user device 130 may be configured to automatically transfer files to the file association service 170, such as automatically transferring a generated raw file 140 at the time of creation.
  • the received files on the file association service 170 may be stored in the database 171 of the file association service 170.
  • the user may initiate transfer of files at different times and from different user devices 130.
  • a user may upload rendered files 150 (e.g., JPGs) to database 171 through the Internet and then later send the raw files 140 via one or more storage or data transfer devices.
  • rendered files 150 e.g., JPGs
  • one set of files may be transferred at the time of creation from a digital camera, and another set of files may be transferred separately at a later time from a laptop.
  • files associated with the same shoot may be moved at different times using different devices.
  • the file association service 170 may associate files of different types.
  • the file association service 170 may associate raw files 140 with rendered files 150 and sidecar files 160 using metadata included in each file stored in database 171.
  • Metadata for raw files 140, rendered files 150, and sidecar files 160 may include standard metadata fields, such as a filename, or customized metadata fields (e.g. tags embedded in the file by a user), and capture metadata, such as focal length, aperture, exposure time, and ISO.
  • the file association service 170 may compare metadata fields of one or more files and may associate files that contain matching contents in a given metadata field.
  • the file associate service 170 may associate files received at different times and from different user devices 130 each time a new file is received. For example, a raw file 140, and a .jpg rendered file 150 may be received from a digital camera and associated together based on matching filename in metadata.
  • a sidecar file 160 may be uploaded from a laptop, and the file association service may associate the sidecar file 160 with the raw file 140 and rendered file 150 based on matching filename metadata.
  • the file association service 170 may associate files using image recognition technology.
  • Image recognition technology may compare raw files 140, rendered files 150, and sidecar files 160 through various Al and ML algorithms.
  • Image recognition technology may include one or more techniques to identify patterns and features in common between multiple files, such as deconstructing the data into numeric values that may be analyzed to identify similar repeated pixel color values between files.
  • the image recognition technology may associate files that are identified as having data with at least one pattern or feature in common.
  • the file association service 170 may track results of image recognition association based on user input confirming or rejecting images that have been associated as an output of image recognition.
  • the file association service 170 may retrain and adjust image recognition outputs based on confirmed and rejected images to improve successful file associations.
  • a user may also manually update file associations created by file association service
  • the user may overwrite associations previously created through automated processing, such as file associations created based on common metadata or image recognition.
  • the user may add or remove a file from the file association of an asset file 174 regardless of matching metadata or image recognition.
  • the file association service 170 may generate raw file previews.
  • Raw files 140 transferred to the file association service 170 in step 210 may be stored in database 171 as file formats that are unable to be displayed in a web browser, such as .raw, .raf, ,rw2, .dng, .dcr, .iiq, .tif, .bmp, ,x3f, and various other similar raw file formats.
  • the file association service 170 may automatically convert the raw files 140 to a compressed file format for display in a web browser, such as a .jpeg, .png, .gif, .svg, .webp, or other similar formats, and may save the generated file as a preview file 175.
  • the preview file 175 may be stored as a new and separate file from the raw file 140 on database 171, and may be automatically associated with the asset file 174 of the raw file 140.
  • the file association service 170 may receive a request for an asset file 174.
  • the request for an asset file 174 may be initiated via a user device 130 executing a function of management interface 180.
  • the request may include a user selection for an asset file 174 containing multiple files raw files 140, rendered files 150, and sidecar files 160.
  • the request from management interface 180 may be processed by the file association service 170 to retrieve the requested files from the database 171.
  • a user input to the user device 130 may request to create a gallery of files via management interface 180 to display on a website.
  • the management interface 180 may display one or more asset files 174 for inclusion in the gallery of files based on a selection made by the user.
  • the management interface 180 may include commands to filter which file formats are included in a gallery, such as selecting file formats like -jpeg, .png, or .webp files. For example, a user may select to display only .jpeg types of files for a gallery.
  • the management interface 180 may include -jpeg rendered files, but exclude other types of files included in the asset files 174 from the gallery, such as .png rendered files associated with the same asset file 174.
  • the management interface 180 may also send a request to the file association service 170 to generate a preview file 175 in .jpeg format for asset files 174 containing raw files 140 that do not also contain an associated rendered file 150.
  • a user input to the user device 130 may execute a search function of management interface 180 to filter and locate asset files 174.
  • the search function may display a search query including a text box.
  • the user may enter search terms in the text box via the user device 130 related to a variety of search criteria for locating asset files 174.
  • the search criteria may include metadata from asset files 174, raw files 140, rendered files 150, or sidecar files 160, such as the file name, date, geolocation, time of day, imaging parameters, or custom tags.
  • the search terms may further include search criteria for image recognition using artificial intelligence (Al) or machine learning (ML) technology, such as terms relating to the contents of a displayed image which may be absent from metadata.
  • Learning models may therefore be developed for image recognition and characterization based on such metadata.
  • Such learning models may further be updated based on user feedback, so that subsequent images are more likely to be recognized and characterized in accordance with the updated learning models.
  • image recognition may improve over time as user feedback continues to update the learning models.
  • the learning models may also be used to improve image search functions, which may provide the user device 130 with suggested filters and/or search criteria. Such suggestions may be presented by displaying toggles for enabling or disabling certain categories (e.g., toggles for geolocation-based criteria, image recognition-based searches).
  • Learning models may also be developed and refined for file management workflows for a specific user. Such learning models may be used to predict subsequent steps and parameters thereof (e.g., transfer to and launch of photo editing application, upload to photo sharing application), and such predictions may be used to automatically filter, launch, and/or automate certain workflow steps.
  • the management interface 180 may display the requested files on the display 131 of the user device 130.
  • the display 131 may include the requested asset file 174, raw files 140, rendered files 150, sidecar files 160, associated metadata of the asset file 174, or any combination therein, based on a type of request. For example, a user may request to view a particular .jpeg rendered file 150 that is associated with a raw file 140, and a sidecar file 160.
  • the management interface 180 may generate a display on the user device 130 of the -jpeg rendered file 150 and may excluding displaying the raw file 140 or sidecar file 160.
  • the user may request to view the entire asset file 174 containing the raw file 140, the rendered file 150, and the sidecar file 160.
  • the management interface 180 may generate a display including the raw file 140, rendered file 150, and sidecar file 160, and metadata for the asset file 174, such as the filename, image parameters, and date created.
  • FIG. 3 is an exemplary screenshot of a display of the management interface that displays a raw file and information about the metadata.
  • a user may access the raw file 140 from the management interface 180 to view a display 300 of the associated raw file 140.
  • the display 300 of the associated raw file 140 may include the preview file 175 and information about the metadata 310 of the raw file 140, such as camera information and imaging parameters.
  • the file association service 170 may automatically generate a preview file 175 for a received raw file 140 without receiving other files associated with the raw file 140.
  • the management interface 180 may generate commands 320 to add, edit, and view additional metadata of the raw file 140, such as adding tags, captions, notes, or comments. Metadata that has been added or edited by the user may be saved as part of the asset file 174 for the raw file 140 and may be stored in the database 171 of the file association service 170.
  • FIG. 4 is an exemplary screenshot of a display generated by the management interface displaying associated files of an asset file on the file association service.
  • the file association service 170 may automatically generate an asset file 174 containing associated files based on matching metadata in one or more received files, such a same filename 410.
  • a user may access the asset file 174 from the management interface 180 to view the display 400 displaying the asset file 174, which includes various asset file metadata and details of files associated with the asset file 174.
  • the details displayed for the asset file 174 and associated files may include a display of a rendered version of the raw file 140 rendered by the file association service 170, such as a preview file 175, or rendered by the user in editing software, such as a rendered file 150 generated from a sidecar file 160.
  • the displayed details may further include a filename 410, a file type, a file size, and a last updated date for each associated.
  • a raw file 140, a rendered file 150, and a sidecar file 160 have been uploaded and automatically associated to an asset file 174 by the file association service 170 based on each file metadata including a matching filename 410.
  • the display of the associated file details 420 may also include an interactable link to access each of the associated files, such as the raw file display in FIG. 3.
  • the display 400 of the asset file 174 may also include user-editable fields to add or edit asset metadata 430, such as adding a title or caption.
  • asset metadata 430 may be saved and stored in the database 171 for the asset file without updating metadata for each associated file. For example, a user may add or edit a title to the asset file metadata 430, while the filenames and title metadata for each associated raw file, rendered file, and sidecar file may remain unchanged.
  • the user may add asset metadata 430 that is automatically propagated to the metadata of each associated file by the file association service 170.
  • the file association service 170 may automatically propagate changes to asset metadata to associated file metadata based on various automated workflow triggers and user preference settings of the file association service 170.
  • the user may manually initiate metadata propagation via a function of the management interface 180.
  • a user may add a custom metadata tag field to the asset metadata 430, such as a "client" to store the name of a customer.
  • client the user may specify a user preference to automatically propagate changes in the custom metadata tag field to each associated file, and the user preference may be stored in the database 171.
  • the user may add text to the asset metadata 430 of an asset file 174 for the "client” tag, such as "client: John Smith.”
  • the file association service 170 may automatically propagate the same field and text to each associated file, based on the selected user preference stored in database 171. Additional automated workflow triggers and user preference settings are discussed in further detail in FIG. 5.
  • FIG. 5 is an exemplary screenshot of an asset organization view of the management interface for the file association service.
  • the asset organization view 500 may include various functions related to viewing and interacting with more than one asset file 174 simultaneously. Viewing and interacting with more than one asset file 174 simultaneously may include functions such as an asset assembly 510, user preference settings 520, an asset display table 530, and a variety of other functions.
  • the asset assembly 510 may include functions for compiling one or more asset files 174 into a group specified by a user. Asset files 174 may be grouped in various ways defined by the user, such as grouping by a capture event or by categories of subjects photographed.
  • the asset assembly 510 may include filters to include or exclude asset files 174 to display for browsing during assembly of a gallery.
  • the asset files 174 may be filtered by the metadata, file types, asset files 174 with or without associated files, and a variety of other similar filters. For example, a user may specify that only files having "dog" metadata be displayed. In another example, the user may specify that all files having "dog” metadata be excluded from the display.
  • the asset assembly 510 may operate in conjunction with the asset display table 530 to display images selected by a user for inclusion in a group.
  • the user preference settings 520 may include functions for preferred user actions, such as a configuration of automated workflow triggers.
  • Automated workflow triggers may be configured by the user to perform tasks repeatedly and automatically based on the completion of an action by the user or by the completion of an action by the file association service 170.
  • an automated workflow trigger may be configured by the user to track a history of changes to asset files 174.
  • Changes to asset files 174 may include tracking user actions such as, adding or removing files to the file service 170, updating metadata of files, manually creating file associations, overwriting existing files, and various similar actions.
  • the tracked history of changes to asset files 174 may also include tracking changes automatically made by the file association service 170 in addition to user-initiated changes.
  • the tracked history of changes to asset files 174 may be displayed in the details of each asset file, or as a log of all user actions for a given period of time.
  • an automated workflow trigger may be configured by the user to enable secure or permissioned access to asset files 174.
  • Secure or permissioned access to asset files 174 may be enabled in a variety of configurations to limit public access to files, such as restricting access to all newly created files, restricting access to types of files (e.g. disabling viewing asset files 174 that contain only a raw file 140), creating a private uniform resource locator (URL), or requiring a password to access a gallery or file.
  • Secure or permissioned access may be configured uniformly for all files of a user, or may be used in any combination on various subsections of files of a user.
  • an automated workflow trigger may be configured by the user to automatically retrieve files from a user device 130 or other storage location, such as a cloud server.
  • the automated workflow trigger may include a configuration to specify the types of files, location of files (e.g. a specified folder on a user device 130), and frequency to automatically check for and retrieve new files.
  • the file association service 170 may periodically check for and retrieve files to be stored in the database 171.
  • Automated retrieval of files may include the file association server 170 communicating with a user device 130 or a cloud server via the API 173.
  • an automated workflow trigger may be configured by the user to launch third-party applications 190 from the management interface 180.
  • the automated workflow trigger may include a configuration to select third-party applications 190 from a list of connected third-party applications that the file association service 170 has previously communicated with via the API 173.
  • the automated workflow trigger may further include conditions for launching the selected third-party applications 190, such as launching a storage application when a new file has been created on the file association service, or launching an image editing application for a raw file 140 the user has selected for editing from the management interface 180.
  • the asset display table 530 may include functions for visually sorting and selecting asset files 174.
  • the asset display table 530 may be used in conjunction with the asset assembly 510 and user preference settings 520, such as when selecting images to create a gallery, or selecting images to launch in an editing application.
  • the asset display table 530 may display simplified or scaled down versions of various images, metadata, and other information stored in each asset file 174.
  • the asset display table 530 may include a thumbnail image 531 of the asset file 174, a filename 532, and a raw file extension 533.
  • the thumbnail image 531 of the asset file 174 may include a miniature or cropped version of the preview file 175 included in the asset file 174.
  • the management interface 180 may prioritize displaying a preview file 175 for a raw image 140 of the asset file 174 as the thumbnail image 531 instead of displaying any subsequent version or edits of the raw file 140, such as a rendered file 150 included in the asset file 174.
  • the asset file 174 may not include a raw file 140, and the management interface may display a rendered file 150.
  • the filename 532 may include the filename of the raw file 140, or any other file (e.g. a rendered file 150 or sidecar file 160) in the absence of a raw file 140 within the asset file 174.
  • the raw file extension 533 may display the extension file type of the raw file 140 included in a specific asset file, or may display no extension file type in the absence of a raw file 140 within the asset file 174.
  • the thumbnail image of the asset file 531, filename 532, and raw file extension 533 may be used as simplified information concerning an asset file 174 that assist a user in identifying and selecting files to perform additional functions.
  • the asset display table 530 may further include interactable functions to display additional information without accessing an individual asset file details.
  • an overlay such as a hoverover 534
  • the hoverover 534 may include extended metadata information about the asset file 174 in addition the filename 532, such as a list of associated files included in the asset file 174.
  • the asset display table 530 may include an asset directory 535, including a file tree consisting of a hierarchy of folders and asset files 174 to assist the user in sorting, browsing, and locating files. Folders of the hierarchy may be manually generated by the user or may be automatically generated by the file association service 170 under certain conditions. For example, the file association service may generate and display a folder containing asset files that have been assembled into a gallery.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Processing Or Creating Images (AREA)
PCT/US2022/051874 2021-12-03 2022-12-05 Ai-powered raw file management Ceased WO2023102271A1 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
JP2024533232A JP2024542810A (ja) 2021-12-03 2022-12-05 Aiを利用したrawファイル管理
CA3240951A CA3240951A1 (en) 2021-12-03 2022-12-05 Ai-powered raw file management
EP22902293.4A EP4441626A4 (en) 2021-12-03 2022-12-05 AI-Powered Raw File Management
AU2022402119A AU2022402119B2 (en) 2021-12-03 2022-12-05 Ai-powered raw file management
CN202280080268.3A CN118511169A (zh) 2021-12-03 2022-12-05 Ai支持的原始文件管理
KR1020247018558A KR20240141232A (ko) 2021-12-03 2022-12-05 Ai-기반 원시 파일 관리

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202163285809P 2021-12-03 2021-12-03
US63/285,809 2021-12-03

Publications (1)

Publication Number Publication Date
WO2023102271A1 true WO2023102271A1 (en) 2023-06-08

Family

ID=86613056

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2022/051874 Ceased WO2023102271A1 (en) 2021-12-03 2022-12-05 Ai-powered raw file management

Country Status (8)

Country Link
US (2) US12248509B2 (enExample)
EP (1) EP4441626A4 (enExample)
JP (1) JP2024542810A (enExample)
KR (1) KR20240141232A (enExample)
CN (1) CN118511169A (enExample)
AU (1) AU2022402119B2 (enExample)
CA (1) CA3240951A1 (enExample)
WO (1) WO2023102271A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12248509B2 (en) 2021-12-03 2025-03-11 Awes.Me, Inc. AI-powered raw file management

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118733539B (zh) * 2024-09-04 2024-11-22 首都医科大学宣武医院 一种临床脑电图数据读取方法、装置、设备及介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140040712A1 (en) * 2012-08-02 2014-02-06 Photobucket Corporation System for creating stories using images, and methods and interfaces associated therewith
US20140133770A1 (en) 2009-11-02 2014-05-15 Apple Inc. Managing raw and processed image file pairs
US10719492B1 (en) * 2016-12-07 2020-07-21 GrayMeta, Inc. Automatic reconciliation and consolidation of disparate repositories
US20210241019A1 (en) * 2020-01-31 2021-08-05 Salesforce.Com, Inc. Machine learning photographic metadata

Family Cites Families (89)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7580952B2 (en) * 2005-02-28 2009-08-25 Microsoft Corporation Automatic digital image grouping using criteria based on image metadata and spatial information
JP4614363B2 (ja) * 2007-06-29 2011-01-19 キヤノンマーケティングジャパン株式会社 情報処理装置及び情報処理方法
US20170111694A1 (en) * 2007-08-22 2017-04-20 Time Warner Cable Enterprises Llc Apparatus and method for conflict resolution in remote control of digital video recorders and the like
US8295454B2 (en) * 2009-01-07 2012-10-23 Google Inc. Digital photo frame with dial-a-tag functionality
JP5035292B2 (ja) * 2009-05-11 2012-09-26 株式会社ニコン 撮像装置、データ生成装置、およびデータ生成プログラム
US20100293105A1 (en) * 2009-05-15 2010-11-18 Microsoft Corporation Social networking updates for image display devices
US8806331B2 (en) * 2009-07-20 2014-08-12 Interactive Memories, Inc. System and methods for creating and editing photo-based projects on a digital network
US10574614B2 (en) * 2009-08-03 2020-02-25 Picpocket Labs, Inc. Geofencing of obvious geographic locations and events
US20170221095A1 (en) * 2009-08-03 2017-08-03 Picpocket, Inc. Systems and networks to aggregate photo content for heuristic ad targeting
US8868506B1 (en) * 2010-06-17 2014-10-21 Evolphin Software, Inc. Method and apparatus for digital asset management
US20120213404A1 (en) * 2011-02-18 2012-08-23 Google Inc. Automatic event recognition and cross-user photo clustering
US20120266066A1 (en) * 2011-04-18 2012-10-18 Ting-Yee Liao Image display device providing subject-dependent feedback
US9521175B2 (en) * 2011-10-07 2016-12-13 Henk B. Rogers Media tagging
US9934522B2 (en) * 2012-03-22 2018-04-03 Ebay Inc. Systems and methods for batch- listing items stored offline on a mobile device
US20130311947A1 (en) * 2012-05-16 2013-11-21 Ekata Systems, Inc. Network image sharing with synchronized image display and manipulation
US9626381B2 (en) * 2012-06-19 2017-04-18 International Business Machines Corporation Photo album creation based on social media content
US8897485B2 (en) * 2012-06-29 2014-11-25 Intellectual Ventures Fund 83 Llc Determining an interest level for an image
US8879112B2 (en) * 2012-09-28 2014-11-04 Interactive Memories, Inc. Method for optimizing printing quality for image-laden PDF files at lower file sizes
JP2014154971A (ja) * 2013-02-06 2014-08-25 Canon Inc 画像表示装置、画像表示方法及びプログラム
US9208170B1 (en) * 2013-03-15 2015-12-08 Google Inc. Classifying natural mapping features
US20150020086A1 (en) * 2013-07-11 2015-01-15 Samsung Electronics Co., Ltd. Systems and methods for obtaining user feedback to media content
US9472166B2 (en) * 2013-10-10 2016-10-18 Pushd, Inc. Automated personalized picture frame method
US10824666B2 (en) * 2013-10-10 2020-11-03 Aura Home, Inc. Automated routing and display of community photographs in digital picture frames
US11797599B2 (en) * 2013-10-10 2023-10-24 Aura Home, Inc. Trend detection in digital photo collections for digital picture frames
US20200089702A1 (en) * 2013-10-10 2020-03-19 Pushd, Inc. Digital picture frames and methods of photo sharing
US10430986B2 (en) * 2013-10-10 2019-10-01 Pushd, Inc. Clustering photographs for display on a digital picture frame
US12443645B2 (en) * 2013-10-10 2025-10-14 Aura Home, Inc. Photo content clustering for digital picture frame display and automated frame conversation
US10474407B2 (en) * 2013-10-10 2019-11-12 Pushd, Inc. Digital picture frame with automated interactions with viewer and viewer devices
US10820293B2 (en) * 2013-10-10 2020-10-27 Aura Home, Inc. Digital picture frame with improved display of community photographs
US10540801B1 (en) * 2014-02-20 2020-01-21 William Ernest Miller Method and system for construction project management using photo imaging measurements
US20180107660A1 (en) * 2014-06-27 2018-04-19 Amazon Technologies, Inc. System, method and apparatus for organizing photographs stored on a mobile computing device
US10290019B2 (en) * 2014-10-24 2019-05-14 Dropbox, Inc. User re-engagement with online photo management service
US20160125062A1 (en) * 2014-10-30 2016-05-05 Futurewei Technologies, Inc. Multi-scale timeling photograph album management with incremental spectral photograph clustering
US9219830B1 (en) * 2014-10-31 2015-12-22 Interactive Memories, Inc. Methods and systems for page and spread arrangement in photo-based projects
US20160179302A1 (en) * 2014-12-19 2016-06-23 Smugmug, Inc. Photo selection and management application
KR102290419B1 (ko) * 2015-01-13 2021-08-18 삼성전자주식회사 디지털 컨텐츠의 시각적 내용 분석을 통해 포토 스토리를 생성하는 방법 및 장치
CN107408212B (zh) * 2015-02-11 2021-09-21 爱维士软件有限责任公司 用于识别存储在设备上的不需要的照片的系统和方法
US11743402B2 (en) * 2015-02-13 2023-08-29 Awes.Me, Inc. System and method for photo subject display optimization
US20160239188A1 (en) * 2015-02-13 2016-08-18 Smugmug, Inc. System and method for photo subject display optimization
US9858438B2 (en) * 2015-03-26 2018-01-02 International Business Machines Corporation Managing digital photograph metadata anonymization
US9955162B2 (en) * 2015-03-31 2018-04-24 Lenovo (Singapore) Pte. Ltd. Photo cluster detection and compression
WO2016176582A1 (en) * 2015-04-29 2016-11-03 Brecx Lionel Systems and methods for managing electronic requests for photographs and multimedia content, and enabling electronic social sharing thereof
US10170157B2 (en) * 2015-06-07 2019-01-01 Apple Inc. Method and apparatus for finding and using video portions that are relevant to adjacent still images
US20170039264A1 (en) * 2015-08-04 2017-02-09 Google Inc. Area modeling by geographic photo label analysis
US10803045B2 (en) * 2015-11-30 2020-10-13 Open Text Sa Ulc Systems and methods for multilingual metadata
US10726600B2 (en) * 2015-12-08 2020-07-28 Shutterfly, Llc Proactive creation of photo products
US20170192651A1 (en) * 2015-12-30 2017-07-06 Facebook, Inc. Editing photos over an online social network
US10346466B2 (en) * 2016-04-18 2019-07-09 International Business Machines Corporation Methods and systems of personalized photo albums based on social media data
JP6966443B2 (ja) * 2016-07-19 2021-11-17 富士フイルム株式会社 画像表示システム、並びにヘッドマウントディスプレイの制御装置とその作動方法および作動プログラム
US10127246B2 (en) * 2016-08-16 2018-11-13 Microsoft Technology Licensing, Llc Automatic grouping based handling of similar photos
US10218898B2 (en) * 2016-09-09 2019-02-26 International Business Machines Corporation Automated group photograph composition
US20180349367A1 (en) * 2017-06-06 2018-12-06 Tsunami VR, Inc. Systems and methods for associating virtual objects with electronic documents, and searching for a virtual object or an electronic document based on the association
US11182837B2 (en) * 2017-08-24 2021-11-23 Shutterfly, Llc System and method for automatically generating a new portion of a photo product design based on user input portion
US20190147620A1 (en) * 2017-11-14 2019-05-16 International Business Machines Corporation Determining optimal conditions to photograph a point of interest
US10521908B2 (en) * 2017-12-20 2019-12-31 International Business Machines Corporation User interface for displaying simulated anatomical photographs
US10791268B2 (en) * 2018-02-07 2020-09-29 Structionsite Inc. Construction photograph integration with 3D model images
US10572121B2 (en) * 2018-02-09 2020-02-25 International Business Machines Corporation Contextual user profile photo selection
US10755414B2 (en) * 2018-04-27 2020-08-25 International Business Machines Corporation Detecting and monitoring a user's photographs for health issues
US20190340305A1 (en) * 2018-05-07 2019-11-07 Shutterfly, Inc. Automated event detection and photo product creation
US10825246B2 (en) * 2018-09-27 2020-11-03 Adobe Inc. Generating immersive trip photograph visualizations
US10956718B2 (en) * 2018-11-08 2021-03-23 International Business Machines Corporation Photograph permission management integrated with real-time facial recognition
US11295026B2 (en) * 2018-11-20 2022-04-05 Forcepoint, LLC Scan, detect, and alert when a user takes a photo of a computer monitor with a mobile phone
US20200167401A1 (en) * 2018-11-27 2020-05-28 International Business Machines Corporation Photo sharing in social media networks
JP7303625B2 (ja) * 2018-12-18 2023-07-05 キヤノン株式会社 画像ファイル生成装置、画像ファイル生成方法、及びプログラム
US12079267B2 (en) * 2019-02-21 2024-09-03 Canon Kabushiki Kaisha Method and system for image searching and evaluation using tags
US10841482B1 (en) * 2019-05-23 2020-11-17 International Business Machines Corporation Recommending camera settings for publishing a photograph based on identified substance
US11120073B2 (en) * 2019-07-15 2021-09-14 International Business Machines Corporation Generating metadata for image-based querying
CN110516083B (zh) * 2019-08-30 2022-07-12 京东方科技集团股份有限公司 相册管理方法、存储介质及电子设备
US20210072869A1 (en) * 2019-09-05 2021-03-11 Comet Method for retrieving at least two captured photographs
US20210075754A1 (en) * 2019-09-05 2021-03-11 Comet Method for sharing a photograph
US11409788B2 (en) * 2019-09-05 2022-08-09 Albums Sas Method for clustering at least two timestamped photographs
US11436290B1 (en) * 2019-11-26 2022-09-06 ShotSpotz LLC Systems and methods for processing media with geographical segmentation
US11570165B2 (en) * 2019-12-09 2023-01-31 Vmware, Inc. Single sign-on service authentication through a voice assistant
US10942635B1 (en) * 2020-02-21 2021-03-09 International Business Machines Corporation Displaying arranged photos in sequence based on a locus of a moving object in photos
US11586767B2 (en) * 2020-05-21 2023-02-21 Meir Dahan Method for managing privacy of videos and photos recorded through a communication application
EP4158332A4 (en) * 2020-05-29 2024-07-10 Constellation Clearsight, LLC METHODS AND SYSTEMS FOR IDENTIFYING AND ANALYZING CONSTRUCTS
US11778309B2 (en) * 2020-09-11 2023-10-03 International Business Machines Corporation Recommending location and content aware filters for digital photographs
US11645349B2 (en) * 2020-09-16 2023-05-09 Adobe Inc. Generating location based photo discovery suggestions
US12217393B2 (en) * 2020-11-20 2025-02-04 Ancestry.Com Dna, Llc Photo composites
US20220171744A1 (en) * 2020-12-01 2022-06-02 Sony Interactive Entertainment LLC Asset management between remote sites
US11853106B2 (en) * 2020-12-01 2023-12-26 Sony Interactive Entertainment LLC Providing access to multi-file related tasks with version control
US12086631B2 (en) * 2020-12-01 2024-09-10 Sony Interactive Entertainment LLC Version control system
US11509819B2 (en) * 2021-01-19 2022-11-22 Adobe Inc. Providing contextual augmented reality photo pose guidance
US12354406B2 (en) * 2021-04-23 2025-07-08 Wrethink, Inc. Methods and apparatus for determining the date of a scanned photo from face data and using such date information
US12439130B2 (en) * 2021-04-30 2025-10-07 Adeia Guides Inc. Optimal method to signal web-based subtitles
US20220382803A1 (en) * 2021-06-01 2022-12-01 Apple Inc. Syndication of Secondary Digital Assets with Photo Library
US12056900B2 (en) * 2021-08-27 2024-08-06 MFTB Holdco, Inc. Automated mapping information generation from analysis of building photos
CN115769914A (zh) 2021-09-08 2023-03-10 深圳市合元科技有限公司 气溶胶生成装置及其控制方法
EP4441626A4 (en) 2021-12-03 2025-09-24 Awes Me Inc AI-Powered Raw File Management

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140133770A1 (en) 2009-11-02 2014-05-15 Apple Inc. Managing raw and processed image file pairs
US20140040712A1 (en) * 2012-08-02 2014-02-06 Photobucket Corporation System for creating stories using images, and methods and interfaces associated therewith
US10719492B1 (en) * 2016-12-07 2020-07-21 GrayMeta, Inc. Automatic reconciliation and consolidation of disparate repositories
US20210241019A1 (en) * 2020-01-31 2021-08-05 Salesforce.Com, Inc. Machine learning photographic metadata

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4441626A4

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12248509B2 (en) 2021-12-03 2025-03-11 Awes.Me, Inc. AI-powered raw file management

Also Published As

Publication number Publication date
US20250209115A1 (en) 2025-06-26
AU2022402119A1 (en) 2024-06-20
CA3240951A1 (en) 2023-06-08
EP4441626A4 (en) 2025-09-24
JP2024542810A (ja) 2024-11-15
KR20240141232A (ko) 2024-09-26
EP4441626A1 (en) 2024-10-09
US12248509B2 (en) 2025-03-11
AU2022402119B2 (en) 2025-08-14
CN118511169A (zh) 2024-08-16
US20230205812A1 (en) 2023-06-29

Similar Documents

Publication Publication Date Title
US11734335B2 (en) Method and system for organizing digital files
JP5801395B2 (ja) シャッタクリックを介する自動的メディア共有
US20250209115A1 (en) Ai-powered raw file management
EP2973013B1 (en) Associating metadata with images in a personal image collection
US20140195516A1 (en) Systems and methods for presenting content items in a collections view
CA3074961C (en) Technologies for analyzing and searching for features in image data
US9361135B2 (en) System and method for outputting and selecting processed content information
CN114911768B (zh) 基于Git的数据集版本管理方法、装置、设备及存储介质
TW201539210A (zh) 個人資訊管理服務系統
US20150082248A1 (en) Dynamic Glyph-Based Search
JP2017062859A (ja) 出席者によるイベントの検索
US10719492B1 (en) Automatic reconciliation and consolidation of disparate repositories
US20250110967A1 (en) Systems and methods for data retention while migrating objects and object metadata stored in object storage environments migrated across cloud ecosystems
KR20150096552A (ko) 사진 앨범 또는 사진 액자를 이용한 온라인 사진 서비스 시스템 및 방법
CN114385710B (zh) 数据分析方法、装置、电子设备及存储介质
Reilly Organization and Storage (with Michele Reilly)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22902293

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3240951

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2022402119

Country of ref document: AU

Ref document number: 811615

Country of ref document: NZ

Ref document number: AU2022402119

Country of ref document: AU

ENP Entry into the national phase

Ref document number: 2024533232

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 202280080268.3

Country of ref document: CN

ENP Entry into the national phase

Ref document number: 2022402119

Country of ref document: AU

Date of ref document: 20221205

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 202447050126

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022902293

Country of ref document: EP

Effective date: 20240703