US20160179314A9 - Interactive mobile video authoring experience - Google Patents

Interactive mobile video authoring experience Download PDF

Info

Publication number
US20160179314A9
US20160179314A9 US13/867,990 US201313867990A US2016179314A9 US 20160179314 A9 US20160179314 A9 US 20160179314A9 US 201313867990 A US201313867990 A US 201313867990A US 2016179314 A9 US2016179314 A9 US 2016179314A9
Authority
US
United States
Prior art keywords
media asset
media
information
computing device
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13/867,990
Other versions
US10191624B2 (en
US20140317510A1 (en
Inventor
Hans T. Ku
David M. Koenig
Edwin R. Leonard
David Moore
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Verizon Patent and Licensing Inc
Original Assignee
Dill Inc
Yahoo Inc until 2017
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US13/867,990 priority Critical patent/US10191624B2/en
Application filed by Dill Inc, Yahoo Inc until 2017 filed Critical Dill Inc
Assigned to DWA INVESTMENTS reassignment DWA INVESTMENTS ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KOENIG, DAVID M., MOORE, DAVID, LEONARD, EDWIN R., KU, HANS T.
Assigned to PTCH MERGER CORP. reassignment PTCH MERGER CORP. MERGER (SEE DOCUMENT FOR DETAILS). Assignors: DWA Investments, Inc.
Assigned to DILL, INC. reassignment DILL, INC. MERGER (SEE DOCUMENT FOR DETAILS). Assignors: PICKLE ACQUISITION CORP., PTCH MERGER CORP.
Assigned to YAHOO! INC. reassignment YAHOO! INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DILL INC.
Priority to PCT/US2014/035034 priority patent/WO2014176280A1/en
Publication of US20140317510A1 publication Critical patent/US20140317510A1/en
Publication of US20160179314A9 publication Critical patent/US20160179314A9/en
Assigned to YAHOO HOLDINGS, INC. reassignment YAHOO HOLDINGS, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YAHOO! INC.
Assigned to OATH INC. reassignment OATH INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YAHOO HOLDINGS, INC.
Publication of US10191624B2 publication Critical patent/US10191624B2/en
Application granted granted Critical
Assigned to VERIZON MEDIA INC. reassignment VERIZON MEDIA INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: OATH INC.
Assigned to VERIZON PATENT AND LICENSING INC. reassignment VERIZON PATENT AND LICENSING INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: VERIZON MEDIA INC.
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals

Definitions

  • the present disclosure relates generally to the social media, and more specifically, to user interfaces for authoring social media videos.
  • Media assets are visual and/or aural digital objects, such as computer images, video clips, audio clips, text verbiages, or the like.
  • Media assets may be stored at a variety of sources, e.g., social networking web sites, cloud-based image repositories, local repositories of portable computing devices, and the like.
  • a computer-implemented method for creating a social media video includes causing to be displayed, on one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset.
  • the method includes receiving a user selection of the first media asset from a user input device. The user selection is a swipe of the first icon from the first region towards the second region.
  • the method includes obtaining a first metadata information associated with the first media asset, obtaining a second icon representing a second icon representing a second media asset based at least in part on the first metadata information, and causing to be displayed, in the first region, the second icon representing the second media asset.
  • the second media asset is obtained based on the first metadata information.
  • the method includes obtaining, from a global positioning system (GPS) sensor, a GPS location of a computing device, and causes to be displayed the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
  • GPS global positioning system
  • the first metadata information includes a first location information that indicates the location at which the first media asset was created, and the second media asset was created at a location within a predetermined distance of the first location.
  • the first metadata information includes a first timestamp indicating a date and/or time at which the first media asset was created, and the second media asset was created within a timespan before or after the first timestamp.
  • the first metadata information comprises a social graph information
  • the social graph information identifies a first node of a social graph
  • the second media asset is associated with a second node of the social graph
  • the first node and the second node are connected on the social graph.
  • the social graph is a social graph of a social networking web site.
  • the second media asset when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business. In some embodiments, the second media asset is an advertisement for the business or includes a picture of the business.
  • the first metadata information includes image recognition information generated by an image recognition algorithm based on the first media asset, and the second icon representing the second media asset is displayed based on the image recognition information.
  • the recognition information may be generated using facial recognition, object recognition, and/or color matching technologies.
  • the first media asset includes audio
  • the audio is analyzed
  • the second icon representing the second media asset is displayed based on the analysis of the audio.
  • a non-transitory computer-readable storage medium having computer-executable instructions for creating a social media video includes instructions for causing to be displayed, on one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset.
  • the instructions include receiving a user selection of the first media asset from a user input device. The user selection is a swipe of the first icon from the first region towards the second region.
  • the instructions include obtaining a first metadata information associated with the first media asset, obtaining a second icon representing a second icon representing a second media asset based at least in part on the first metadata information, and causing to be displayed, in the first region, the second icon representing the second media asset.
  • the second media asset is obtained based on the first metadata information.
  • a computing device for creating a social media video based on media assets includes one or more processors operatively coupled to one or more display screens, a user input device, and a network interface, where the network interface is configured to connect with a network.
  • the one or more processors are configured to cause to be displayed, on the one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset.
  • the one or more processors are configured to receive, from the user input device, a user selection of the first media asset. The user selection is a swipe of the first icon from the first region towards the second region.
  • the one or more processors are configured to obtain a first metadata information associated with the first media asset, obtain a second icon representing a second media asset based at least in part on the first metadata information, and cause to be displayed, in the first region, the second icon representing the second media asset.
  • the second media asset is obtained based on first metadata information.
  • FIGS. 1A-1E depict an exemplary viewing of a Social Media Video.
  • FIGS. 2A-2D depict an exemplary user interface for authoring a Social Media Video.
  • FIGS. 3A-3E depict an exemplary scenario for populating a media carousel.
  • FIG. 4 depicts a block diagram of an exemplary process for displaying a media asset.
  • FIG. 5 depicts an exemplary Social Media Video system.
  • FIG. 6 depicts an exemplary computing system for performing Social Media Video processes.
  • a native application that operates on a computing device includes computer-executable instructions for authoring and viewing Social Media Videos.
  • the native application may be an APPLE iOS “app” or a GOOGLE ANDROID “application” or “widget”.
  • a user authors a Social Media Video using media assets.
  • Media assets are visual and/or aural digital objects, such as computer images, video clips, audio clips, text verbiages, or the like.
  • a computer media object in the form of a PNG file constitutes a media asset.
  • Media assets may be obtained from various sources, e.g., the memory of a computing device, a social media website, a Social Media Video service provider, a cloud-based repository of media assets, and so forth.
  • a source of media assets may be referred to as a media asset feed.
  • FIGS. 1A-1E illustrate an exemplary display of a Social Media Video on a computing device that is local to a user.
  • FIG. 1A thumbnail images representing Social Media Videos 101 - 102 are displayed on screen 100 of the local computing device.
  • FIGS. 1B-1E illustrate an exemplary viewing of Social Media Video 101 in response to a user's selection of the corresponding thumbnail image.
  • Social Media Video 101 begins with a display of text 111 , which indicates that the topic of Social Media Video 101 is a volleyball game. After a while, the view transitions to a display of text 121 overlaid onto image 122 , which is a still image of a volleyball team. After a while, the view further transitions to a display of video clip 131 , which shows a segment of gameplay.
  • the viewing of Social Media Video 101 concludes with a display of image 141 , which is a still image of the final play of the game.
  • the viewing of video 101 may be accompanied by audio.
  • FIGS. 2A-2D illustrate an exemplary authoring of a Social Media Video on a computing device.
  • Button 201 shown in in FIG. 2A , initiates the Social Media Video authoring process.
  • editing view 210 shown in FIG. 2B , is displayed on a screen of the computing device.
  • view is used here to refer to software and/or hardware components provided by a computer device and its operating system/platform for displaying a user interface, which as one of ordinary skill in the art would appreciate, encompass operating system-specific functionalities that are sometimes described by the same term. That is to say, editing view 210 may be provided by, e.g., MICROSOFT WINDOWS's windows and dialog components.
  • Editing view 210 may also be provided by, e.g., APPLE iOS views and GOOGLE ANDROID views. Multiple views may be displayed on one physical display screen or be displayed across multiple display screens. A single view may also be displayed on one physical display screen or be displayed across multiple display screens.
  • a view may have multiple regions. Editing view 210 includes two regions.
  • a first region called “media carousel” 211 , displays icons that each represents a media asset feed and/or a media asset.
  • media carousel 211 initially displays icons, e.g., icons 214 - 216 , that represent media asset feeds.
  • a user may select a media asset feed icon that is displayed in media carousel 211 .
  • FIG. 2D when a displayed media asset feed icon is selected, thumbnail versions of media assets that are available from the selected media asset feed are displayed in media carousel 211 .
  • FIG. 2D illustrates icons 221 - 225 , which each represents a media asset that is available from the media assets feed corresponding to icon 214 , being displayed in media carousel 211 .
  • Editing view 210 also includes a second region called “timeline” 212 .
  • Timeline 212 displays the contents of the Social Media Video that is being authored.
  • Media assets can be added from media carousel 211 to timeline 212 via user input. More specifically, as shown in FIG. 2D by block arrow 231 , a user may swipe an icon, e.g., icon 224 , downwardly from media carousel 211 to timeline 212 to add a corresponding media asset to the Social Media Video that is being authored. Also, a user may add a media asset to the Social Media Video by tapping the icon that represents the media asset.
  • icon e.g., icon 224
  • a larger version 232 of the added media asset is displayed in the timeline among other media assets of the Social Media Video.
  • the ordering of images on timeline 212 corresponds to the order in which the corresponding media assets are to be displayed during playback of the Social Media Video.
  • a Social Media Video comprising various media assets may be authored using editing view 210 .
  • FIGS. 2B-2D depict editing view 210 as having two regions, in some embodiments, editing view 210 has more than two regions. For instance, an additional region may be used to provide additional editing capabilities such as music selection or theme selection.
  • the user interface that is provided by editing view 210 may be implemented using multiple views.
  • the first region media carousel 211 and timeline 212 may each be displayed in its respective view.
  • the two corresponding views may be displayed on the same or across different physical display screens. That is, the above-described user interface may be adapted to take advantage of additional display hardware offered by a multi-display screen computing device.
  • Media carousel 211 may be populated dynamically based on conditions or criteria to increase the relevance of media assets that are displayed to a user. For example, a user who is authoring a Social Media Video of a wedding party may be more interested in media assets directed to the same wedding. It is thus beneficial for media carousel 211 to prioritize the display of media assets that are directed to the same wedding. As discussed further below, media carousel 211 may rely on metadata information associated with media assets (e.g., date/time, author, title, description, location) and/or information obtained through sensors (e.g., date/time, location, direction) to facilitate the display of more relevant media assets. In addition, media carousel 211 may rely on social networking information (e.g., social graph, user demographics) to facilitate the display of more relevant media assets.
  • social networking information e.g., social graph, user demographics
  • FIG. 3 depicts an exemplary scenario where a media carousel is populated based on date/time, location, and a social graph of the user.
  • user 301 and friend 303 are both in attendance at volleyball game 300 but are seated at different locations.
  • User 301 and friend 303 are both users of a social networking web site, e.g., FACEBOOK, and have profile accounts that are connected to each other on a social graph of the social networking web site.
  • User 301 and friend 303 have different perspectives of the game because the former sits near sideline 302 while the latter sits behind backline 304 of the volleyball court.
  • user 301 uses computing device 305 , e.g., a smartphone, to obtain photographs and video clips of volleyball game 300 in order to author a Social Media Video based on the game play.
  • the photographs, such as photograph 307 obtained by user 301 are limited to the sideline view because user 301 sits near sideline 302 .
  • friend 303 also uses a computing device 306 to obtain photographs including photograph 309 ( FIG. 3C ) of the game play from the backline perspective of the volleyball court.
  • Friend 303 does not author any Social Media Videos, but nonetheless uploads her photograph 309 to a social networking web site where she is socially connected to user 301 .
  • media carousel 311 prioritizes the display of media assets that are related to volleyball game 300 to increase the relevance of displayed media assets. For example, as shown in FIG. 3D , when the user selects icon 321 , which represents the local storage of computing device 305 , thumbnail versions of media assets 331 - 333 (e.g., photographs) that are taken recently and that were taken near the current global positioning system (GPS) location of computing device 305 may be prioritized for display. Two GPS coordinates may be considered to be near one another when they are separated by less than a predetermined distance.
  • GPS global positioning system
  • a radius of 300 feet may be useful for determining whether two photographs are likely to be taken on the same city block, or, in the present example, in the same stadium. That is, media assets 331 - 333 may be taken or otherwise created at locations that are within 300 feet of one another.
  • User 301 adds media asset 332 into the Social Media Video by swiping the icon representing media asset 332 into timeline 312 .
  • media carousel 311 may use media asset 332 to increase the relevance of other media assets that are displayed in media carousel 311 . More specifically, when user 301 selects icon 322 , which represents a social networking web site where user 301 is socially connected to friend 303 , media carousel 311 prioritizes the display of media assets that were taken near the GPS location of media asset 332 , at about the same time as when media asset 332 was taken, and by those who are socially connected with user 301 (e.g., friend 303 ). That is, media carousel 311 may display thumbnail versions of media assets 351 - 353 representing photographs of volleyball game 300 that were taken by user 303 .
  • media carousel 311 dynamically controls its display of media assets using metadata information associated with media assets and/or information associated with the local computing device. In this way, media carousel 311 provides a user with an improved user experience that also reduces the amount time of necessary to author a Social Media Video.
  • media carousel 311 selects and displays media assets are described in further detail, below.
  • a media carousel displays media assets based on logic conditions. Conditions may be based on location information, date/time information, user information, social graph information, media asset metadata information, or the like, as described below.
  • a media carousel may display media assets based on location information.
  • a computing device may contain a GPS sensor that provides the location of the computing device, which is deemed a reliable proxy for user location. Location information may also be obtained by other means such as cell tower triangulation, an IP address, user input, or the like.
  • GPS sensor information may be used to determine which media assets should be displayed in the media carousel.
  • a digital image file may have metadata in the form of a field that identifies the GPS location where the image was captured. The user's location may be compared to the metadata of the digital image file to determine whether the contents of the digital image file should be displayed as a relevant media asset. If the origin of a media asset is near the user's location, the media asset may be prioritized for display, meaning that the media asset may be displayed to the left of other media assets in a media carousel.
  • a media carousel may display media assets based on temporal (e.g., date/time) information.
  • a computing device may provide current date/time information
  • media assets may include metadata indicating when the media asset was created.
  • a media asset may be displayed on the condition that the media asset was created within a specified time before the current date/time.
  • the media carousel may display only media assets that were created within 24 hours of the current date/time.
  • media assets may be displayed based on the order in which they were created. For example, media assets created more recently are potentially more relevant to a user, and thus may be displayed ahead of media assets created longer ago.
  • a media carousel may display media assets based on social graphs.
  • a “social graph” is a mapping of the connections or relationships between people, places, events, pets, and other entities.
  • Various social networking web sites maintain social graphs of their users.
  • a media asset may be displayed in the media carousel on the condition that it is accessible, as determined by a relevant social graph, to the author of a Social Media Video.
  • Media assets may be accessible when two nodes (e.g., user accounts) in a social graph are connected.
  • the media carousel may display images uploaded by FACEBOOK friends, by TWITTER followers, by PTCH tribe members, or by GOOGLE+ circle members of a Social Media Video author.
  • a media carousel may display media assets based on image recognition information.
  • Image recognition information may be generated by applying an image recognition algorithm to a media asset.
  • the metadata of the media asset may include the image recognition information generated by the image recognition algorithm.
  • Image recognition algorithms may perform facial recognition, object recognition, color recognition, or the like.
  • Image recognition information may include facial information, object information, color matching information, or the like.
  • a media carousel may use image recognition information of media assets to identify and/or display other media asset(s) with matching or overlapping metadata information.
  • a media carousel may display media assets based on an audio signature.
  • An audio clip, a video clip containing audio, or any other media asset that has an audio component may be analyzed to generate an audio signature.
  • the audio signature may be included in the metadata of the analyzed media asset.
  • the audio signature of a media asset may be used to identify and/or display another media asset with similar or related metadata information.
  • the audio signature metadata information of two media assets may be considered similar if the metadata information, in terms of data values, are within a threshold of each other.
  • a media carousel may display media assets based on contents that have already been added into a Social Media Video.
  • the Social Media Video of FIG. 1 has the text “Varsity Volleyball.”
  • media assets associated with volleyball may be displayed in the media carousel.
  • a media asset may be considered to be associated with volleyball if its metadata includes the term “volleyball”.
  • the various conditions described above can be used in conjunction to identify media assets for display in a media carousel.
  • the media carousel may be populated with media assets that are produced by friends of the user at about the same place at about the same time.
  • FIG. 4 illustrates exemplary process 400 that may be carried out by a computing device to dynamically control the display of media assets in the media carousel based on one or more of the conditions described above.
  • a user interface for creating the Social Media Video is displayed.
  • the user interface includes a media carousel for displaying icons representing media assets and for selecting media assets.
  • the user interface also includes a timeline for displaying selected media assets.
  • a user selection of a first media asset is received.
  • the user selection may be a swipe of an icon representing a first media asset displayed in the media carousel from the media carousel towards the timeline.
  • the user selection may be a tap on the icon representing the first media asset.
  • metadata associated with the selected media asset is obtained. Metadata may include, for example, date/time, author, title, description, location, recognized faces, recognized objects, recognized colors, audio signatures, or the like.
  • an icon of a second media asset is obtained based on the metadata associated with the selected media asset.
  • the icon of the second media asset is displayed in the media carousel.
  • Process 400 may be repeated as media assets are added to the Social Media Video in order to continually update the media carousel with relevant content.
  • a condition may be set such that media assets are displayed based on the existing contents of the Social Media Video.
  • the metadata from the added content may be used in process 400 to update the media carousel with content related or similar to the media asset that was just added.
  • the media carousel can provide more relevant results as the user adds content because additional content provides a greater amount of information about the subject of the Social Media Video being authored.
  • FIG. 5 illustrates an exemplary Social Media Video system 500 that supports the authoring of Social Media Videos.
  • Exemplary Social Media Video system 500 includes Social Media Video service provider 510 , which includes server 511 and database 512 for storing media assets, Social Media Videos, and other related data.
  • Social Media Video service provider 510 is connected to cloud network 503 .
  • Mobile computing device 501 and computer 502 are connected to Social Media Video service provider 510 via cloud network 503 .
  • Third-party content provider 505 is connected to cloud network 503 .
  • Social Media Video service provider 510 , mobile computing device 501 , and desktop computer 502 are connected to third-party content provider 505 via cloud network 503 .
  • Mobile computing device 501 may be a cellular phone (e.g., a smartphone), a tablet computer, or a laptop computer, for example.
  • Cloud network 503 may include portions of the Internet, a public network, a private network, or a combination thereof.
  • One or more of Social Media Video service provider 510 may have computer-executable instructions for authoring, viewing, and/or revising Social Media Videos and their related data.
  • One or more of third-party content provider 505 , Social Media Video service provider 510 (e.g., server 511 ), mobile computing device 501 , and/or desktop computer 502 may provide media assets for use in Social Media Videos, i.e., may be a media asset feed.
  • Third-party content provider 505 may be a social networking web site, such as FACEBOOK.
  • a media carousel may also be populated with commercial content in some embodiments.
  • user-generated content is used consistent with its ordinary meaning in the art to refer to content created by technology consumers.
  • commercial content refers to content generated by a commercial provider of goods or services, such as a business organization. Exemplary commercial content includes product advertisements.
  • the media carousel when the media carousel recognizes that a Social Media Video directed to volleyball is being authored, among the media assets displayed by the media carousel may be advertisements for a volleyball equipment manufacturer or a sporting goods store.
  • the media carousel when the media carousel recognizes that a Social Media Video contains many media assets taken near a particular landmark, the media carousel may display a curated image of the landmark, such as a corporate logo or a “hero shot” of the landmark.
  • a Social Media Video service provider may store and provide commercial content to Social Media Video users for a fee.
  • a volleyball manufacturer may pay Social Media Video service provider 510 ( FIG. 5 ) to maintain and to cause the display of images of its volleyball products whenever the term “volleyball” is used in a Social Media Video being created on a computing device that is connected to the Social Media Video service provider.
  • computing system 600 comprises a motherboard with bus 608 that connects I/O section 602 , one or more central processing units (CPU) 604 , and a memory section 606 together.
  • Memory section 606 may contain computer executable instructions and/or data for carrying out process 400 .
  • the I/O section 602 may be connected to one or more display 610 , input device 612 , which may be a keyboard, a touch-sensitive surface, one or more buttons, a mouse, or the like.
  • I/O section 602 may also be connected to Wi-Fi unit 614 , cellular antenna 616 , and/or sensors 618 .
  • Sensors 618 may include a GPS sensor, a light sensor, a gyroscope, an accelerometer, or a combination thereof.
  • Memory 606 may include a non-transitory computer-readable medium that stores (e.g., tangibly embodies) one or more computer programs for performing any one of the above-described processes by means of a computer.
  • the computer program may be written, for example, in a general-purpose programming language (e.g., C including Objective C, Java, JavaScript including JSON, and/or HTML) or some specialized, application-specific language.

Abstract

Devices and methods for creating social media videos based on media assets are disclosed. A computing device displays a graphical user interface (“GUI”) for creating the social media video. The GUI includes a first region for selecting a media asset and a second region for displaying selected media assets. The device receives a user selection of the first media asset for use in a social media video. The device obtains a first metadata information associated with the first media asset, obtains a second media asset based at least in part on the first metadata information, and displays, in the first region, a thumbnail image of the second media asset. The second media asset is obtained based on first metadata information. In this way, related media assets are retrieved and display to optimize the creation of social media videos.

Description

    BACKGROUND
  • 1. Field
  • The present disclosure relates generally to the social media, and more specifically, to user interfaces for authoring social media videos.
  • 2. Description of Related Art
  • Social media technologies described in U.S. provisional application 61/649,916, filed on May 21, 2012, provide for the authoring of social media content using media assets, and are hereby incorporated by reference for all purposes. Media assets are visual and/or aural digital objects, such as computer images, video clips, audio clips, text verbiages, or the like. Media assets may be stored at a variety of sources, e.g., social networking web sites, cloud-based image repositories, local repositories of portable computing devices, and the like.
  • Given the limited display screen sizes of computing devices that are often used to author social media (e.g., smartphones), and the large pool of media assets that are often available via social media for use in social media content authoring, it would be advantageous to present relevant media assets in organized manners to facilitate social media content authoring.
  • SUMMARY
  • In some embodiments, a computer-implemented method for creating a social media video includes causing to be displayed, on one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset. The method includes receiving a user selection of the first media asset from a user input device. The user selection is a swipe of the first icon from the first region towards the second region. The method includes obtaining a first metadata information associated with the first media asset, obtaining a second icon representing a second icon representing a second media asset based at least in part on the first metadata information, and causing to be displayed, in the first region, the second icon representing the second media asset. The second media asset is obtained based on the first metadata information.
  • In some embodiments, the method includes obtaining, from a global positioning system (GPS) sensor, a GPS location of a computing device, and causes to be displayed the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
  • In some embodiments, the first metadata information includes a first location information that indicates the location at which the first media asset was created, and the second media asset was created at a location within a predetermined distance of the first location. In some embodiments, the first metadata information includes a first timestamp indicating a date and/or time at which the first media asset was created, and the second media asset was created within a timespan before or after the first timestamp.
  • In some embodiments, the first metadata information comprises a social graph information, the social graph information identifies a first node of a social graph, the second media asset is associated with a second node of the social graph, and the first node and the second node are connected on the social graph. In some embodiments, the social graph is a social graph of a social networking web site.
  • In some embodiments, when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business. In some embodiments, the second media asset is an advertisement for the business or includes a picture of the business.
  • In some embodiments, the first metadata information includes image recognition information generated by an image recognition algorithm based on the first media asset, and the second icon representing the second media asset is displayed based on the image recognition information. The recognition information may be generated using facial recognition, object recognition, and/or color matching technologies.
  • In some embodiments, the first media asset includes audio, the audio is analyzed, and the second icon representing the second media asset is displayed based on the analysis of the audio.
  • In some embodiments, a non-transitory computer-readable storage medium having computer-executable instructions for creating a social media video includes instructions for causing to be displayed, on one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset. The instructions include receiving a user selection of the first media asset from a user input device. The user selection is a swipe of the first icon from the first region towards the second region. The instructions include obtaining a first metadata information associated with the first media asset, obtaining a second icon representing a second icon representing a second media asset based at least in part on the first metadata information, and causing to be displayed, in the first region, the second icon representing the second media asset. The second media asset is obtained based on the first metadata information.
  • In some embodiments, a computing device for creating a social media video based on media assets includes one or more processors operatively coupled to one or more display screens, a user input device, and a network interface, where the network interface is configured to connect with a network. The one or more processors are configured to cause to be displayed, on the one or more display screens, a user interface for creating the social media video, where the user interface includes a first region for selecting a media asset and a second region for displaying selected media assets, and the first region includes a first icon representing a first media asset. The one or more processors are configured to receive, from the user input device, a user selection of the first media asset. The user selection is a swipe of the first icon from the first region towards the second region. The one or more processors are configured to obtain a first metadata information associated with the first media asset, obtain a second icon representing a second media asset based at least in part on the first metadata information, and cause to be displayed, in the first region, the second icon representing the second media asset. The second media asset is obtained based on first metadata information.
  • DESCRIPTION OF THE FIGURES
  • FIGS. 1A-1E depict an exemplary viewing of a Social Media Video.
  • FIGS. 2A-2D depict an exemplary user interface for authoring a Social Media Video.
  • FIGS. 3A-3E depict an exemplary scenario for populating a media carousel.
  • FIG. 4 depicts a block diagram of an exemplary process for displaying a media asset.
  • FIG. 5 depicts an exemplary Social Media Video system.
  • FIG. 6 depicts an exemplary computing system for performing Social Media Video processes.
  • DETAILED DESCRIPTION
  • The following description is presented to enable a person of ordinary skill in the art to make and use the various embodiments. Descriptions of specific devices, techniques, and applications are provided only as examples. Various modifications to the examples described herein will be readily apparent to those of ordinary skill in the art, and the general principles defined herein may be applied to other examples and applications without departing from the spirit and scope of the various embodiments. Thus, the various embodiments are not intended to be limited to the examples described herein and shown, but are to be accorded the scope consistent with the claims.
  • The embodiments described herein include technologies directed to the blogging of interactive videos in the social media (“Social Media Video”). In some embodiments, a native application that operates on a computing device includes computer-executable instructions for authoring and viewing Social Media Videos. For example, the native application may be an APPLE iOS “app” or a GOOGLE ANDROID “application” or “widget”.
  • 1. Social Media Videos
  • A user authors a Social Media Video using media assets. Media assets are visual and/or aural digital objects, such as computer images, video clips, audio clips, text verbiages, or the like. For instance, a computer media object in the form of a PNG file constitutes a media asset. Media assets may be obtained from various sources, e.g., the memory of a computing device, a social media website, a Social Media Video service provider, a cloud-based repository of media assets, and so forth. A source of media assets may be referred to as a media asset feed.
  • FIGS. 1A-1E illustrate an exemplary display of a Social Media Video on a computing device that is local to a user. In FIG. 1A, thumbnail images representing Social Media Videos 101-102 are displayed on screen 100 of the local computing device. FIGS. 1B-1E illustrate an exemplary viewing of Social Media Video 101 in response to a user's selection of the corresponding thumbnail image. Social Media Video 101 begins with a display of text 111, which indicates that the topic of Social Media Video 101 is a volleyball game. After a while, the view transitions to a display of text 121 overlaid onto image 122, which is a still image of a volleyball team. After a while, the view further transitions to a display of video clip 131, which shows a segment of gameplay. The viewing of Social Media Video 101 concludes with a display of image 141, which is a still image of the final play of the game. The viewing of video 101 may be accompanied by audio.
  • FIGS. 2A-2D illustrate an exemplary authoring of a Social Media Video on a computing device. Button 201, shown in in FIG. 2A, initiates the Social Media Video authoring process. In response to a user's selection of button 201, editing view 210, shown in FIG. 2B, is displayed on a screen of the computing device. The term “view” is used here to refer to software and/or hardware components provided by a computer device and its operating system/platform for displaying a user interface, which as one of ordinary skill in the art would appreciate, encompass operating system-specific functionalities that are sometimes described by the same term. That is to say, editing view 210 may be provided by, e.g., MICROSOFT WINDOWS's windows and dialog components. Editing view 210 may also be provided by, e.g., APPLE iOS views and GOOGLE ANDROID views. Multiple views may be displayed on one physical display screen or be displayed across multiple display screens. A single view may also be displayed on one physical display screen or be displayed across multiple display screens.
  • A view may have multiple regions. Editing view 210 includes two regions. A first region, called “media carousel” 211, displays icons that each represents a media asset feed and/or a media asset. As shown in FIG. 2C, media carousel 211 initially displays icons, e.g., icons 214-216, that represent media asset feeds. A user may select a media asset feed icon that is displayed in media carousel 211. As illustrated in FIG. 2D, when a displayed media asset feed icon is selected, thumbnail versions of media assets that are available from the selected media asset feed are displayed in media carousel 211. More specifically, FIG. 2D illustrates icons 221-225, which each represents a media asset that is available from the media assets feed corresponding to icon 214, being displayed in media carousel 211.
  • Editing view 210 (FIG. 2B) also includes a second region called “timeline” 212. Timeline 212 displays the contents of the Social Media Video that is being authored. Media assets can be added from media carousel 211 to timeline 212 via user input. More specifically, as shown in FIG. 2D by block arrow 231, a user may swipe an icon, e.g., icon 224, downwardly from media carousel 211 to timeline 212 to add a corresponding media asset to the Social Media Video that is being authored. Also, a user may add a media asset to the Social Media Video by tapping the icon that represents the media asset. Once a media asset is added to the Social Media Video, a larger version 232 of the added media asset is displayed in the timeline among other media assets of the Social Media Video. The ordering of images on timeline 212 corresponds to the order in which the corresponding media assets are to be displayed during playback of the Social Media Video. In this way, a Social Media Video comprising various media assets may be authored using editing view 210.
  • Note, although FIGS. 2B-2D depict editing view 210 as having two regions, in some embodiments, editing view 210 has more than two regions. For instance, an additional region may be used to provide additional editing capabilities such as music selection or theme selection.
  • Also, although not shown, the user interface that is provided by editing view 210 may be implemented using multiple views. For example, the first region media carousel 211 and timeline 212 may each be displayed in its respective view. The two corresponding views may be displayed on the same or across different physical display screens. That is, the above-described user interface may be adapted to take advantage of additional display hardware offered by a multi-display screen computing device.
  • 2. Media Carousel
  • Media carousel 211 (FIG. 2B) may be populated dynamically based on conditions or criteria to increase the relevance of media assets that are displayed to a user. For example, a user who is authoring a Social Media Video of a wedding party may be more interested in media assets directed to the same wedding. It is thus beneficial for media carousel 211 to prioritize the display of media assets that are directed to the same wedding. As discussed further below, media carousel 211 may rely on metadata information associated with media assets (e.g., date/time, author, title, description, location) and/or information obtained through sensors (e.g., date/time, location, direction) to facilitate the display of more relevant media assets. In addition, media carousel 211 may rely on social networking information (e.g., social graph, user demographics) to facilitate the display of more relevant media assets.
  • FIG. 3 depicts an exemplary scenario where a media carousel is populated based on date/time, location, and a social graph of the user. As illustrated in FIG. 3A, user 301 and friend 303 are both in attendance at volleyball game 300 but are seated at different locations. User 301 and friend 303 are both users of a social networking web site, e.g., FACEBOOK, and have profile accounts that are connected to each other on a social graph of the social networking web site. User 301 and friend 303 have different perspectives of the game because the former sits near sideline 302 while the latter sits behind backline 304 of the volleyball court.
  • During game play, user 301 uses computing device 305, e.g., a smartphone, to obtain photographs and video clips of volleyball game 300 in order to author a Social Media Video based on the game play. As illustrated by FIG. 3B, the photographs, such as photograph 307, obtained by user 301 are limited to the sideline view because user 301 sits near sideline 302. Coincidentally, friend 303 also uses a computing device 306 to obtain photographs including photograph 309 (FIG. 3C) of the game play from the backline perspective of the volleyball court. Friend 303 does not author any Social Media Videos, but nonetheless uploads her photograph 309 to a social networking web site where she is socially connected to user 301.
  • When user 301 uses editing view 310 shown in FIG. 3D to author a Social Media Video, media carousel 311 prioritizes the display of media assets that are related to volleyball game 300 to increase the relevance of displayed media assets. For example, as shown in FIG. 3D, when the user selects icon 321, which represents the local storage of computing device 305, thumbnail versions of media assets 331-333 (e.g., photographs) that are taken recently and that were taken near the current global positioning system (GPS) location of computing device 305 may be prioritized for display. Two GPS coordinates may be considered to be near one another when they are separated by less than a predetermined distance. For example, a radius of 300 feet may be useful for determining whether two photographs are likely to be taken on the same city block, or, in the present example, in the same stadium. That is, media assets 331-333 may be taken or otherwise created at locations that are within 300 feet of one another. User 301 adds media asset 332 into the Social Media Video by swiping the icon representing media asset 332 into timeline 312.
  • As another example, as shown in FIG. 3E, after media asset 332 is added to timeline 312, media carousel 311 may use media asset 332 to increase the relevance of other media assets that are displayed in media carousel 311. More specifically, when user 301 selects icon 322, which represents a social networking web site where user 301 is socially connected to friend 303, media carousel 311 prioritizes the display of media assets that were taken near the GPS location of media asset 332, at about the same time as when media asset 332 was taken, and by those who are socially connected with user 301 (e.g., friend 303). That is, media carousel 311 may display thumbnail versions of media assets 351-353 representing photographs of volleyball game 300 that were taken by user 303.
  • Thus, media carousel 311 dynamically controls its display of media assets using metadata information associated with media assets and/or information associated with the local computing device. In this way, media carousel 311 provides a user with an improved user experience that also reduces the amount time of necessary to author a Social Media Video.
  • The techniques by which media carousel 311 selects and displays media assets are described in further detail, below. A media carousel displays media assets based on logic conditions. Conditions may be based on location information, date/time information, user information, social graph information, media asset metadata information, or the like, as described below.
  • A media carousel may display media assets based on location information. For example, a computing device may contain a GPS sensor that provides the location of the computing device, which is deemed a reliable proxy for user location. Location information may also be obtained by other means such as cell tower triangulation, an IP address, user input, or the like. If media assets have metadata that identifies an origin of the media asset, then GPS sensor information may be used to determine which media assets should be displayed in the media carousel. For example, a digital image file may have metadata in the form of a field that identifies the GPS location where the image was captured. The user's location may be compared to the metadata of the digital image file to determine whether the contents of the digital image file should be displayed as a relevant media asset. If the origin of a media asset is near the user's location, the media asset may be prioritized for display, meaning that the media asset may be displayed to the left of other media assets in a media carousel.
  • A media carousel may display media assets based on temporal (e.g., date/time) information. For example, a computing device may provide current date/time information, while media assets may include metadata indicating when the media asset was created. A media asset may be displayed on the condition that the media asset was created within a specified time before the current date/time. For example, the media carousel may display only media assets that were created within 24 hours of the current date/time. Additionally, media assets may be displayed based on the order in which they were created. For example, media assets created more recently are potentially more relevant to a user, and thus may be displayed ahead of media assets created longer ago.
  • A media carousel may display media assets based on social graphs. Consistent with the ordinary meaning of the term in the art, a “social graph” is a mapping of the connections or relationships between people, places, events, pets, and other entities. Various social networking web sites maintain social graphs of their users. A media asset may be displayed in the media carousel on the condition that it is accessible, as determined by a relevant social graph, to the author of a Social Media Video. Media assets may be accessible when two nodes (e.g., user accounts) in a social graph are connected. For instance, the media carousel may display images uploaded by FACEBOOK friends, by TWITTER followers, by PTCH tribe members, or by GOOGLE+ circle members of a Social Media Video author.
  • A media carousel may display media assets based on image recognition information. Image recognition information may be generated by applying an image recognition algorithm to a media asset. The metadata of the media asset may include the image recognition information generated by the image recognition algorithm. Image recognition algorithms may perform facial recognition, object recognition, color recognition, or the like. Image recognition information may include facial information, object information, color matching information, or the like. A media carousel may use image recognition information of media assets to identify and/or display other media asset(s) with matching or overlapping metadata information.
  • A media carousel may display media assets based on an audio signature. An audio clip, a video clip containing audio, or any other media asset that has an audio component may be analyzed to generate an audio signature. The audio signature may be included in the metadata of the analyzed media asset. The audio signature of a media asset may be used to identify and/or display another media asset with similar or related metadata information. The audio signature metadata information of two media assets may be considered similar if the metadata information, in terms of data values, are within a threshold of each other.
  • A media carousel may display media assets based on contents that have already been added into a Social Media Video. For example, the Social Media Video of FIG. 1 has the text “Varsity Volleyball.” Based on the word “volleyball” appearing in the Social Media Video, media assets associated with volleyball may be displayed in the media carousel. A media asset may be considered to be associated with volleyball if its metadata includes the term “volleyball”.
  • Note, the various conditions described above can be used in conjunction to identify media assets for display in a media carousel. For example, the media carousel may be populated with media assets that are produced by friends of the user at about the same place at about the same time.
  • FIG. 4 illustrates exemplary process 400 that may be carried out by a computing device to dynamically control the display of media assets in the media carousel based on one or more of the conditions described above.
  • At block 410, a user interface for creating the Social Media Video is displayed. The user interface includes a media carousel for displaying icons representing media assets and for selecting media assets. The user interface also includes a timeline for displaying selected media assets. At block 420, a user selection of a first media asset is received. The user selection may be a swipe of an icon representing a first media asset displayed in the media carousel from the media carousel towards the timeline. Also, the user selection may be a tap on the icon representing the first media asset. At block 430, metadata associated with the selected media asset is obtained. Metadata may include, for example, date/time, author, title, description, location, recognized faces, recognized objects, recognized colors, audio signatures, or the like. At block 440, an icon of a second media asset is obtained based on the metadata associated with the selected media asset. At block 450, the icon of the second media asset is displayed in the media carousel.
  • Process 400 may be repeated as media assets are added to the Social Media Video in order to continually update the media carousel with relevant content. As an example, a condition may be set such that media assets are displayed based on the existing contents of the Social Media Video. For example, when a user adds a media asset to a Social Media Video, the metadata from the added content may be used in process 400 to update the media carousel with content related or similar to the media asset that was just added. By repeating process 400, the media carousel can provide more relevant results as the user adds content because additional content provides a greater amount of information about the subject of the Social Media Video being authored.
  • FIG. 5 illustrates an exemplary Social Media Video system 500 that supports the authoring of Social Media Videos. Exemplary Social Media Video system 500 includes Social Media Video service provider 510, which includes server 511 and database 512 for storing media assets, Social Media Videos, and other related data. Social Media Video service provider 510 is connected to cloud network 503. Mobile computing device 501 and computer 502 are connected to Social Media Video service provider 510 via cloud network 503. Third-party content provider 505 is connected to cloud network 503. Social Media Video service provider 510, mobile computing device 501, and desktop computer 502 are connected to third-party content provider 505 via cloud network 503. Mobile computing device 501 may be a cellular phone (e.g., a smartphone), a tablet computer, or a laptop computer, for example. Cloud network 503 may include portions of the Internet, a public network, a private network, or a combination thereof.
  • One or more of Social Media Video service provider 510 (e.g., server 511), mobile computing device 501, and/or desktop computer 502 may have computer-executable instructions for authoring, viewing, and/or revising Social Media Videos and their related data. One or more of third-party content provider 505, Social Media Video service provider 510 (e.g., server 511), mobile computing device 501, and/or desktop computer 502 may provide media assets for use in Social Media Videos, i.e., may be a media asset feed. Third-party content provider 505 may be a social networking web site, such as FACEBOOK.
  • 3. Display of Commercial/Advertising Content
  • Although the foregoing techniques are described in the context of user-generated content, it should be noted that a media carousel may also be populated with commercial content in some embodiments. As used here, the term “user-generated content” is used consistent with its ordinary meaning in the art to refer to content created by technology consumers. In contrast, the term “commercial content” refers to content generated by a commercial provider of goods or services, such as a business organization. Exemplary commercial content includes product advertisements.
  • For example, using the above-described techniques, when the media carousel recognizes that a Social Media Video directed to volleyball is being authored, among the media assets displayed by the media carousel may be advertisements for a volleyball equipment manufacturer or a sporting goods store. As another example, when the media carousel recognizes that a Social Media Video contains many media assets taken near a particular landmark, the media carousel may display a curated image of the landmark, such as a corporate logo or a “hero shot” of the landmark.
  • A Social Media Video service provider may store and provide commercial content to Social Media Video users for a fee. For example, a volleyball manufacturer may pay Social Media Video service provider 510 (FIG. 5) to maintain and to cause the display of images of its volleyball products whenever the term “volleyball” is used in a Social Media Video being created on a computing device that is connected to the Social Media Video service provider.
  • The above-described processes and techniques may be implemented in exemplary computing system 600. As shown in FIG. 6, computing system 600 comprises a motherboard with bus 608 that connects I/O section 602, one or more central processing units (CPU) 604, and a memory section 606 together. Memory section 606 may contain computer executable instructions and/or data for carrying out process 400. The I/O section 602 may be connected to one or more display 610, input device 612, which may be a keyboard, a touch-sensitive surface, one or more buttons, a mouse, or the like. I/O section 602 may also be connected to Wi-Fi unit 614, cellular antenna 616, and/or sensors 618. Sensors 618 may include a GPS sensor, a light sensor, a gyroscope, an accelerometer, or a combination thereof.
  • At least some data in the above-described process can be saved into memory such as memory 606 for subsequent use. Memory 606 may include a non-transitory computer-readable medium that stores (e.g., tangibly embodies) one or more computer programs for performing any one of the above-described processes by means of a computer. The computer program may be written, for example, in a general-purpose programming language (e.g., C including Objective C, Java, JavaScript including JSON, and/or HTML) or some specialized, application-specific language.
  • Although only certain exemplary embodiments have been described in detail above, those skilled in the art will readily appreciate that many modifications are possible in the exemplary embodiments without materially departing from the novel teachings and advantages of this disclosure. For example, aspects of embodiments disclosed above can be combined in other combinations to form additional embodiments. Accordingly, all such modifications are intended to be included within the scope of this technology.

Claims (42)

What is claimed is:
1. A computer-implemented method for creating a social media video, the method comprising:
causing to be displayed, on one or more display screens, a user interface for creating the social media video,
wherein the user interface comprises a first region for selecting a media asset and a second region for displaying selected media assets, and
wherein the first region includes a first icon representing a first media asset;
receiving, from a user input device, a user selection of the first media asset,
wherein the user selection is a swipe of the first icon from the first region towards the second region;
obtaining a first metadata information associated with the first media asset;
obtaining a second icon representing a second media asset based at least in part on the first metadata information; and
causing to be displayed, in the first region, the second icon representing the second media asset.
2. The method of claim 1, further comprising:
obtaining, from a global positioning system (GPS), a GPS location of a computing device; and
causing to be displayed, the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
3. The method of claim 1,
wherein the first metadata information comprises a first location information,
wherein the first location information indicates the location at which the first media asset was created, and
wherein the second media asset was created at a location within a predetermined distance of the first location.
4. The method of claim 1,
wherein the first metadata information comprises a first timestamp indicating a date and/or time at which the first media asset was created, and wherein the second media asset was created within a timespan before or after the first timestamp.
5. The method of claim 1,
wherein the first metadata information comprises a first social graph information,
wherein the social graph information identifies a first node of a social graph, and
wherein the second media asset is associated with a second node of the social graph, and the first node and the second node are connected on the social graph.
6. The method of claim 5, wherein the social graph is a social graph of a social networking website.
7. The method of claim 1, wherein when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business.
8. The method of claim 7, wherein the second media asset is an advertisement for the business.
9. The method of claim 7, wherein the second media asset includes a picture of the business.
10. The method of claim 1,
wherein the first metadata information comprises an image recognition information generated by an image recognition algorithm based on the first media asset, and
wherein the second media asset is obtained based on the image recognition information.
11. The method of claim 10,
wherein the generated recognition information is selected from the group consisting of facial information, object information, and color matching information.
12. The method of claim 1,
wherein the first media asset includes audio, and the method further comprises:
analyzing the audio, and
obtaining the second media asset based on the audio analysis.
13. The method of claim 1, wherein the user interface is caused to be displayed on a cellular phone.
14. The method of claim 1, wherein the user interface is caused to be displayed on a tablet computer.
15. A non-transitory computer-readable storage medium having computer-executable instructions for creating a social media video, the computer-executable instructions comprising instructions for:
causing to be displayed, on one or more display screens, a user interface for creating the social media video,
wherein the user interface comprises a first region for selecting a media asset and a second region for displaying selected media assets, and
wherein the first region includes a first icon representing a first media asset;
receiving, from a user input device, a user selection of the first media asset,
wherein the user selection is a swipe of the first icon from the first region towards the second region;
obtaining a first metadata information associated with the first media asset;
obtaining a second icon representing a second media asset based at least in part on the first metadata information; and
causing to be displayed, in the first region, the second icon representing the second media asset.
16. The non-transitory computer-readable storage medium of claim 15, further comprising instructions for:
obtaining, from a global positioning system (GPS), a GPS location of a computing device; and
causing to be displayed, the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
17. The non-transitory computer-readable storage medium of claim 15,
wherein the first metadata information comprises a first location information,
wherein the first location information indicates the location at which the first media asset was created, and
wherein the second media asset was created at a location within a predetermined distance of the first location.
18. The non-transitory computer-readable storage medium of claim 15,
wherein the first metadata information comprises a first timestamp indicating a date and/or time at which the first media asset was created, and
wherein the second media asset was created within a timespan before or after the first timestamp.
19. The non-transitory computer-readable storage medium of claim 15,
wherein the first metadata information comprises a first social graph information,
wherein the social graph information identifies a first node of a social graph, and
wherein the second media asset is associated with a second node of the social graph, and the first node and the second node are connected on the social graph.
20. The non-transitory computer-readable storage medium of claim 19, wherein the social graph is a social graph of a social networking website.
21. The non-transitory computer-readable storage medium of claim 15, wherein when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business.
22. The non-transitory computer-readable storage medium of claim 21, wherein the second media asset is an advertisement for the business.
23. The non-transitory computer-readable storage medium of claim 21, wherein the second media asset includes a picture of the business.
24. The non-transitory computer-readable storage medium of claim 15,
wherein the first metadata information comprises an image recognition information generated by an image recognition algorithm based on the first media asset, and
wherein the second media asset is obtained based on the image recognition information.
25. The non-transitory computer-readable storage medium of claim 24,
wherein the generated recognition information is selected from the group consisting of facial information, object information, and color matching information.
26. The non-transitory computer-readable storage medium of claim 15,
wherein the first media asset includes audio, and the computer-executable instructions further comprise instructions for:
analyzing the audio, and
obtaining the second media asset based on the audio analysis.
27. The non-transitory computer-readable storage medium of claim 15, wherein the user interface is caused to be displayed on a cellular phone.
28. The non-transitory computer-readable storage medium of claim 15, wherein the user interface is caused to be displayed on a tablet computer.
29. A computing device for creating a social media video based on media assets, the computing device comprising:
one or more processors operatively coupled to one or more display screens, a user input device, and a network interface, wherein the network interface is configured to connect with a network, and wherein the one or more processors are configured to:
cause to be displayed, on the one or more display screens, a user interface for creating the social media video,
wherein the user interface comprises a first region for selecting a media asset and a second region for displaying selected media assets, and
wherein the first region includes a first icon representing a first media asset;
receive, from the user input device, a user selection of the first media asset, wherein the user selection is a swipe of the first icon from the first region towards the second region;
obtain a first metadata information associated with the first media asset;
obtain a second icon representing a second media asset based at least in part on the first metadata information; and
cause to be displayed, in the first region, the second icon representing the second media asset.
30. The computing device of claim 29, further comprising:
a global positioning system (GPS) sensor operatively coupled to the one or more processors, wherein the GPS sensor is configured to obtain a GPS location of the computing device, and
wherein the one or more processors is further configured to cause to be displayed the first icon representing the first media asset if the first metadata information indicates a first location within a predetermined distance of the GPS location of the computing device.
31. The computing device of claim 29,
wherein the first metadata information comprises a first location information,
wherein the first location information indicates the location at which the first media asset was created, and
wherein the second media asset was created at a location within a predetermined distance of the first location.
32. The computing device of claim 29,
wherein the first metadata information comprises a first timestamp indicating a date and/or time at which the first media asset was created, and
wherein the second media asset was created within a timespan before or after the first timestamp.
33. The computing device of claim 29,
wherein the first metadata information comprises a first social graph information,
wherein the social graph information identifies a first node of a social graph, and
wherein the second media asset is associated with a second node of the social graph, and the first node and the second node are connected on the social graph.
34. The computing device of claim 33, wherein the social graph is a social graph of a social networking web site.
35. The computing device of claim 29, wherein when metadata of the first media asset indicates that the first media asset was created within a predetermined distance of a business, the second media asset represents the business.
36. The computing device of claim 35, wherein the second media asset is an advertisement for the business.
37. The computing device of claim 35, wherein the second media asset includes a picture of the business.
38. The computing device of claim 29,
wherein the first metadata information comprises an image recognition information generated by an image recognition algorithm based on the first media asset, and
wherein the second media asset is obtained based on the image recognition information.
39. The computing device of claim 38,
wherein the generated recognition information is selected from the group consisting of facial information, object information, and color matching information.
40. The computing device of claim 29,
wherein the first media asset includes audio, and the one or more processors are further configured to:
analyze the audio, and
obtain the second media asset based on the audio analysis.
41. The computing device of claim 29, wherein the computing device is a cellular phone.
42. The computing device of claim 29, wherein the computing device is a tablet computer.
US13/867,990 2012-05-21 2013-04-22 System and method for authoring interactive media assets Active 2033-12-01 US10191624B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/867,990 US10191624B2 (en) 2012-05-21 2013-04-22 System and method for authoring interactive media assets
PCT/US2014/035034 WO2014176280A1 (en) 2013-04-22 2014-04-22 Interactive mobile video authoring experience

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261649916P 2012-05-21 2012-05-21
US13/867,990 US10191624B2 (en) 2012-05-21 2013-04-22 System and method for authoring interactive media assets

Publications (3)

Publication Number Publication Date
US20140317510A1 US20140317510A1 (en) 2014-10-23
US20160179314A9 true US20160179314A9 (en) 2016-06-23
US10191624B2 US10191624B2 (en) 2019-01-29

Family

ID=51730005

Family Applications (1)

Application Number Title Priority Date Filing Date
US13/867,990 Active 2033-12-01 US10191624B2 (en) 2012-05-21 2013-04-22 System and method for authoring interactive media assets

Country Status (2)

Country Link
US (1) US10191624B2 (en)
WO (1) WO2014176280A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11099709B1 (en) * 2021-04-13 2021-08-24 Dapper Labs Inc. System and method for creating, managing, and displaying an interactive display for 3D digital collectibles
US11170582B1 (en) 2021-05-04 2021-11-09 Dapper Labs Inc. System and method for creating, managing, and displaying limited edition, serialized 3D digital collectibles with visual indicators of rarity classifications
US11210844B1 (en) 2021-04-13 2021-12-28 Dapper Labs Inc. System and method for creating, managing, and displaying 3D digital collectibles
US11227010B1 (en) 2021-05-03 2022-01-18 Dapper Labs Inc. System and method for creating, managing, and displaying user owned collections of 3D digital collectibles
US11533467B2 (en) 2021-05-04 2022-12-20 Dapper Labs, Inc. System and method for creating, managing, and displaying 3D digital collectibles with overlay display elements and surrounding structure display elements
USD991271S1 (en) 2021-04-30 2023-07-04 Dapper Labs, Inc. Display screen with an animated graphical user interface

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11386139B2 (en) * 2005-10-26 2022-07-12 Cortica Ltd. System and method for generating analytics for entities depicted in multimedia content
US20180067641A1 (en) * 2016-09-01 2018-03-08 PIQPIQ, Inc. Social networking application for real-time selection and sorting of photo and video content
US11714537B2 (en) * 2021-12-02 2023-08-01 Amazon Technologies, Inc. Techniques for providing a search interface within a carousel

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100281372A1 (en) * 2009-04-30 2010-11-04 Charles Lyons Tool for Navigating a Composite Presentation
US20120030569A1 (en) * 2010-07-30 2012-02-02 Migos Charles J Device, Method, and Graphical User Interface for Reordering the Front-to-Back Positions of Objects

Family Cites Families (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7657835B2 (en) 1997-01-31 2010-02-02 Making Everlasting Memories, L.L.C. Method and system for creating a commemorative presentation
US6295058B1 (en) 1998-07-22 2001-09-25 Sony Corporation Method and apparatus for creating multimedia electronic mail messages or greeting cards on an interactive receiver
US6389181B2 (en) 1998-11-25 2002-05-14 Eastman Kodak Company Photocollage generation and modification using image recognition
US6473778B1 (en) 1998-12-24 2002-10-29 At&T Corporation Generating hypermedia documents from transcriptions of television programs using parallel text alignment
US6590586B1 (en) 1999-10-28 2003-07-08 Xerox Corporation User interface for a browser based image storage and processing system
KR20020050780A (en) 2000-12-21 2002-06-27 조명래 Apparatus and method for producing and playing status information
US6964025B2 (en) 2001-03-20 2005-11-08 Microsoft Corporation Auto thumbnail gallery
US7362919B2 (en) 2002-12-12 2008-04-22 Eastman Kodak Company Method for generating customized photo album pages and prints based on people and gender profiles
US7823058B2 (en) 2002-12-30 2010-10-26 The Board Of Trustees Of The Leland Stanford Junior University Methods and apparatus for interactive point-of-view authoring of digital video content
US7181468B2 (en) 2003-04-28 2007-02-20 Sony Corporation Content management for rich media publishing system
CA2561936A1 (en) 2004-03-31 2005-10-20 Advertising Processing, Inc. Automatic creation of output file from images in database
US20050246649A1 (en) 2004-04-29 2005-11-03 Wilhelm Gerita S Online/offline multimedia directory system
US7788260B2 (en) 2004-06-14 2010-08-31 Facebook, Inc. Ranking search results based on the frequency of clicks on the search results by members of a social network who are within a predetermined degree of separation
KR100676672B1 (en) 2004-11-25 2007-01-31 한국전자통신연구원 Method for authoring majority view contents or panorama contents, system and apparatus and method for interactive multi-view contents using its
US20060253783A1 (en) 2005-05-09 2006-11-09 Microsoft Corporation Story template structures associated with story enhancing content and rules
WO2007024769A2 (en) 2005-08-22 2007-03-01 The Personal Bee, Inc. Semantic discovery engine
WO2007035637A2 (en) 2005-09-19 2007-03-29 Industrial Color, Inc. Digital file management
US8180826B2 (en) 2005-10-31 2012-05-15 Microsoft Corporation Media sharing and authoring on the web
US8196032B2 (en) 2005-11-01 2012-06-05 Microsoft Corporation Template-based multimedia authoring and sharing
US7979790B2 (en) 2006-02-28 2011-07-12 Microsoft Corporation Combining and displaying multimedia content
US8046411B2 (en) 2006-04-28 2011-10-25 Yahoo! Inc. Multimedia sharing in social networks for mobile devices
US20080052349A1 (en) 2006-08-27 2008-02-28 Michael Lin Methods and System for Aggregating Disparate Batches of Digital Media Files Captured During an Event for the Purpose of Inclusion into Public Collections for Sharing
US8812945B2 (en) 2006-10-11 2014-08-19 Laurent Frederick Sidon Method of dynamically creating real time presentations responsive to search expression
US9021045B2 (en) 2006-11-30 2015-04-28 Red Hat, Inc. Sharing images in a social network
US20080189591A1 (en) 2007-01-31 2008-08-07 Lection David B Method and system for generating a media presentation
US8024400B2 (en) 2007-09-26 2011-09-20 Oomble, Inc. Method and system for transferring content from the web to mobile devices
US20080215965A1 (en) 2007-02-23 2008-09-04 Tabblo, Inc. Method for modifying an initial layout of story elements in a user-generated online story
US20080215985A1 (en) 2007-02-23 2008-09-04 Tabblo, Inc. Method for initial layout of story elements in a user-generated online story
US20080215964A1 (en) 2007-02-23 2008-09-04 Tabblo, Inc. Method and system for online creation and publication of user-generated stories
KR101537329B1 (en) 2007-02-27 2015-07-17 삼성전자 주식회사 Apparatus and method for making digital collage
KR100948608B1 (en) 2007-03-02 2010-03-24 미디어코러스 주식회사 Method for personal media portal service
US7680882B2 (en) * 2007-03-06 2010-03-16 Friendster, Inc. Multimedia aggregation in an online social network
US8732161B2 (en) 2007-04-27 2014-05-20 The Regents Of The University Of California Event based organization and access of digital photos
WO2009055825A1 (en) 2007-10-26 2009-04-30 Facebook, Inc. Sharing digital content on a social network
US20090132527A1 (en) 2007-11-20 2009-05-21 Samsung Electronics Co., Ltd. Personalized video channels on social networks
CA2616324C (en) 2008-02-04 2015-06-16 Omnivex Corporation Digital signage display
US20090254643A1 (en) 2008-04-04 2009-10-08 Merijn Camiel Terheggen System and method for identifying galleries of media objects on a network
US20090259944A1 (en) 2008-04-10 2009-10-15 Industrial Technology Research Institute Methods and systems for generating a media program
US8074176B2 (en) 2008-04-30 2011-12-06 Beyondvia Technologies, Llc Electronic communications dialog using sequenced digital images stored in an image dictionary
US20090327035A1 (en) 2008-06-28 2009-12-31 Microsoft Corporation Media content service for renting jukeboxes and playlists adapted for personal media players
US8627192B2 (en) 2008-07-03 2014-01-07 Ebay Inc. System and methods for automatic media population of a style presentation
US8930817B2 (en) 2008-08-18 2015-01-06 Apple Inc. Theme-based slideshows
US8150464B2 (en) 2008-12-22 2012-04-03 At&T Intellectual Property I, L.P. Method and apparatus for providing a mobile video blog service
US9514355B2 (en) * 2009-01-05 2016-12-06 Apple Inc. Organizing images by correlating faces
US8860865B2 (en) 2009-03-02 2014-10-14 Burning Moon, Llc Assisted video creation utilizing a camera
US8701008B2 (en) 2009-06-18 2014-04-15 Cyberlink Corp. Systems and methods for sharing multimedia editing projects
WO2011014168A1 (en) * 2009-07-29 2011-02-03 Hewlett-Packard Development Company, L.P. System and method for producing a media compilation
US20120036444A1 (en) * 2010-07-01 2012-02-09 Andersen Ann-Cabell Baum Systems and Methods for Interactive Web-based Social Networking and Activities Coordination
US8880534B1 (en) * 2010-10-19 2014-11-04 Google Inc. Video classification boosting
US20120221687A1 (en) * 2011-02-27 2012-08-30 Broadcastr, Inc. Systems, Methods and Apparatus for Providing a Geotagged Media Experience
US20130091431A1 (en) * 2011-10-05 2013-04-11 Microsoft Corporation Video clip selector
US8868481B2 (en) * 2011-12-14 2014-10-21 Google Inc. Video recommendation based on video co-occurrence statistics
US9785883B2 (en) * 2012-04-27 2017-10-10 Excalibur Ip, Llc Avatars for use with personalized generalized content recommendations
US9606717B2 (en) * 2012-11-14 2017-03-28 Facebook, Inc. Content composer
US10546010B2 (en) * 2012-12-19 2020-01-28 Oath Inc. Method and system for storytelling on a computing device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100281372A1 (en) * 2009-04-30 2010-11-04 Charles Lyons Tool for Navigating a Composite Presentation
US20120030569A1 (en) * 2010-07-30 2012-02-02 Migos Charles J Device, Method, and Graphical User Interface for Reordering the Front-to-Back Positions of Objects

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11099709B1 (en) * 2021-04-13 2021-08-24 Dapper Labs Inc. System and method for creating, managing, and displaying an interactive display for 3D digital collectibles
US11922563B2 (en) 2021-04-13 2024-03-05 Dapper Labs, Inc. System and method for creating, managing, and displaying 3D digital collectibles
US11210844B1 (en) 2021-04-13 2021-12-28 Dapper Labs Inc. System and method for creating, managing, and displaying 3D digital collectibles
US11899902B2 (en) * 2021-04-13 2024-02-13 Dapper Labs, Inc. System and method for creating, managing, and displaying an interactive display for 3D digital collectibles
US11393162B1 (en) 2021-04-13 2022-07-19 Dapper Labs, Inc. System and method for creating, managing, and displaying 3D digital collectibles
US20220326836A1 (en) * 2021-04-13 2022-10-13 Dapper Labs Inc. System and method for creating, managing, and displaying an interactive display for 3d digital collectibles
US11526251B2 (en) * 2021-04-13 2022-12-13 Dapper Labs, Inc. System and method for creating, managing, and displaying an interactive display for 3D digital collectibles
USD991271S1 (en) 2021-04-30 2023-07-04 Dapper Labs, Inc. Display screen with an animated graphical user interface
US11734346B2 (en) 2021-05-03 2023-08-22 Dapper Labs, Inc. System and method for creating, managing, and displaying user owned collections of 3D digital collectibles
US11227010B1 (en) 2021-05-03 2022-01-18 Dapper Labs Inc. System and method for creating, managing, and displaying user owned collections of 3D digital collectibles
US11605208B2 (en) 2021-05-04 2023-03-14 Dapper Labs, Inc. System and method for creating, managing, and displaying limited edition, serialized 3D digital collectibles with visual indicators of rarity classifications
US11533467B2 (en) 2021-05-04 2022-12-20 Dapper Labs, Inc. System and method for creating, managing, and displaying 3D digital collectibles with overlay display elements and surrounding structure display elements
US11170582B1 (en) 2021-05-04 2021-11-09 Dapper Labs Inc. System and method for creating, managing, and displaying limited edition, serialized 3D digital collectibles with visual indicators of rarity classifications

Also Published As

Publication number Publication date
US10191624B2 (en) 2019-01-29
US20140317510A1 (en) 2014-10-23
WO2014176280A1 (en) 2014-10-30

Similar Documents

Publication Publication Date Title
US10191624B2 (en) System and method for authoring interactive media assets
US10535177B2 (en) Systems and methods for interactive broadcasting
US10685471B2 (en) Methods and systems for playing video while transitioning from a content-item preview to the content item
US8799300B2 (en) Bookmarking segments of content
US9338242B1 (en) Processes for generating content sharing recommendations
US11727018B1 (en) Selecting content and identifying users for identification to additional users of social networking system based on user attributes or content item characteristics
US20180300917A1 (en) Discovering augmented reality elements in a camera viewfinder display
US9531823B1 (en) Processes for generating content sharing recommendations based on user feedback data
US20160148651A1 (en) Facial detection, recognition and bookmarking in videos
US11138255B2 (en) Providing combinations of pre-generated and dynamic media effects to create customized media communications
US10706057B2 (en) Presenting groups of content item selected for a social networking system user based on content item characteristics
US11144182B1 (en) Determining user preference of an object from a group of objects maintained by a social networking system
US10373200B2 (en) Presenting additional content items to a social networking system user based on characteristics of a content item with which the user interacted
US9665965B2 (en) Video-associated objects
US10447643B2 (en) Presenting previously presented content items stored by users of a social networking system based on user-specified criteria
US20160306505A1 (en) Computer-implemented methods and systems for automatically creating and displaying instant presentations from selected visual content items
US20160371749A1 (en) Systems and methods for creating calls to action for social networking system resources
CN110019934B (en) Identifying relevance of video
US10721514B2 (en) Customizing a video trailer based on user-selected characteristics
US20150332335A1 (en) Interactive advertisements
US20190132650A1 (en) Providing a slide show in a live video broadcast
KR102376079B1 (en) Method and system for viewing embedded video
US11856255B2 (en) Selecting ads for a video within a messaging system
US20170310812A1 (en) Method And Apparatus For Communication Using Images, Sketching, And Stamping
US11270337B2 (en) Machine learning-based media content sequencing and placement

Legal Events

Date Code Title Description
AS Assignment

Owner name: DWA INVESTMENTS, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KU, HANS T.;KOENIG, DAVID M.;LEONARD, EDWIN R.;AND OTHERS;SIGNING DATES FROM 20130506 TO 20131005;REEL/FRAME:031393/0117

AS Assignment

Owner name: PTCH MERGER CORP., CALIFORNIA

Free format text: MERGER;ASSIGNOR:DWA INVESTMENTS, INC.;REEL/FRAME:032320/0031

Effective date: 20131202

AS Assignment

Owner name: DILL, INC., CALIFORNIA

Free format text: MERGER;ASSIGNORS:PICKLE ACQUISITION CORP.;PTCH MERGER CORP.;REEL/FRAME:032335/0981

Effective date: 20131203

AS Assignment

Owner name: YAHOO! INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DILL INC.;REEL/FRAME:032369/0888

Effective date: 20140227

AS Assignment

Owner name: YAHOO HOLDINGS, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAHOO! INC.;REEL/FRAME:042963/0211

Effective date: 20170613

AS Assignment

Owner name: OATH INC., NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:YAHOO HOLDINGS, INC.;REEL/FRAME:045240/0310

Effective date: 20171231

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: VERIZON MEDIA INC., NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:OATH INC.;REEL/FRAME:054258/0635

Effective date: 20201005

AS Assignment

Owner name: VERIZON PATENT AND LICENSING INC., NEW JERSEY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:VERIZON MEDIA INC.;REEL/FRAME:057453/0431

Effective date: 20210801

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4