Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
  • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
  • G06F16/43—Querying
  • G06F16/435—Filtering based on additional data, e.g. user or group profiles
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q10/00—Administration; Management
  • G06Q10/10—Office automation; Time management
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q30/00—Commerce
  • G06Q30/02—Marketing; Price estimation or determination; Fundraising
  • G06Q30/0241—Advertisements
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
  • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
  • G06Q50/01—Social networking

Definitions

• Embodiments generally relate to assemblies, methods, devices, and systems for
• Embodiments of the current disclosure describe a method for displaying information associated with a playable media file.
• the method comprises the steps of obtaining stored data describing the information, the stored data comprising a storage location of the playable media file and a plurality of virtual clips each associated with the playable media file and including a first data element identifying a first time within the playable media file at which the corresponding virtual clip begins, and a second data element identifying a first user profile associated with creating the corresponding virtual clip; accessing the playable media file at the storage location; causing a graphical user interface (GUI) to be displayed on a computing device of a user, wherein said GUI enables the user to generate user inputs by interacting with the GUI; receiving a first user input indicating a first interaction of the user with a first display position on the timeline; determining a selected time within the playable media file that corresponds to the first display position; identifying a first virtual clip of the plurality of the virtual clips and one or more of the virtual clips; and updating the
• certain embodiments of the current disclosure describe a method of annotating a playable media file.
• the method comprises the steps of obtaining a virtual clip comprising a first location within the playable media file and a second location within the playable media file, the first and second locations together defining a clip of the playable media file occurring between the first and second locations; causing, using the virtual clip, the clip to be displayed on a computing device of a user; receiving a first user input associated with the virtual clip;
• FIG. 1 illustrates an exemplary embodiment of a system for making a composite video with annotation(s);
• FIG. 4 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product
• FIG. 5 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product
• FIG. 6 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product;
• FIG. 7 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product
• FIG 8 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product
• FIG. 9 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product
• FIG. 10 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product
• FIG 1 1 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product;
• FIG. 1 2 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product;
• FIG. 13 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product;
• FIG. 14 summarizes steps in Applicants' method, steps implemented by Applicants' article of manufacture, and steps performed by a programmable processor implementing Applicants' computer program product;
• FIG. 1 5 is a flowchart of the method and/or process related to set a bookmark during a recording of a playable media file
• FIG. 1 6 is a flowchart of the method and/or process related to display annotations associated with a playable media file
• FIG 1 7 A is an example of a graphical user interface for tagging
• FIG. 17B is an example of a graphical user interface that enables a user to configure hi s user account to identify virtual clips in a particular subcategory
• FIGS. 4- 16 The schematic flow chart diagrams included are generally set forth as a logical flowchart diagram (e.g., FIGS. 4- 16). As such, the depicted order and labeled steps are indicative of one embodiment of the presented method. In certain embodiments, other steps and methods are conceived that are equivalent in function, logic, or effect to one or more steps, or portions thereof, of the illustrated method. Additionally, the format and symbols employed are provided to explain the logical steps of the method and are understood not to limit the scope of the method. Although various arrow types and line types are employed in the flow-chart diagrams, they are understood not to limit the scope of the corresponding method (e.g., FIGS. 4- 16).
• arrows or other connectors may be used to indicate only the logical flow of the method. For instance, an arrow indicates a waiting or monitoring period of unspecified duration between enumerated steps of the depicted method. Additionally, the order in which a particular method occurs may or may not strictly adhere to the order of the corresponding steps shown.
• Applicants' system and method includes a network wherein a video can be created using any available video format, and that video can be shared between a plurality of people.
• Applicants' system and method can be used by multiple members of a social network to associate annotations with a Playable Media File including a composite digital clip, and/or to initiate discussion threads associated with that Playable Media File including a composite digital clip.
• the network server 130 i s owned and/or operated by a social networking service provider while computing dev ices 1 10 and 150 are owned and/or operated by users or members of the social network 100, where a member has a profile containing information about the member stored in information 137 of the social network server 130.
• the computing device 1 10 is owned and operated by a first member and the computing device 1 50 is ow ned and operated by a second member.
• FIG. 1 shows a first computing dev ice 1 10, netw ork serv er
• FIG. 1 should not be taken as limiting. Rather, in other embodiments any number of entities and corresponding devices can be part of the network 100, and further, although FIG. 1 shows two communication fabrics 1 20 and 140, in other embodiments, less than, or more than, tw o
• communication fabrics are provided in the social netw ork 100.
• the communication fabric 1 20 and the communication fabric 140 are the same communication fabric.
• FIG. 1 illustrates the computing dev ice 1 10, the netw ork serv er 130, and the computing device 1 50 as each including a processor 1 1 2, 132, and 1 52, respectively, a non-transitory computer readable medium 1 1 3, 133, and 153, respectively, having a series of instructions 1 14, 1 34, and 1 54, respectively, encoded therein, an input/output means 1 1 1, 1 3 1 , and 1 5 1 , respectively, such as a keyboard, a mouse, a stylus, touch screen, a camera, a scanner, or a printer.
• Computer readable program code 1 14, 1 34, and 1 54 is encoded in non-transitory computer readable media I 1 3, 133, and 1 53, respectively.
• Processors 1 1 2, 132, and 1 52 utilize computer readable program code 1 14, 134, and 1 54, respectively, to operate computing devices 1 10, 130, and 1 50, respectively.
• the computing device 1 10, 130, and 1 50 employ hardware and/or software that supports accelerometers, gyroscopes, magnetometers (e.g., solid state compasses) and the like.
• Processors 1 1 2 and 1 52 utilize Applicants' Application Program Interfaces (APIs)
• Algorithm 136 comprises Applicants' source code to operate a public or priv ate social network, and when implemented by computing device 1 10 causes a graphic user interface ( "GUI" ) to be displayed on display screen 1 1 5, wherein that GUI compri ses and displays a plurality of graphical interactable objects.
• GUI graphic user interface
• a member using computing device 1 10 can utilize that GUI to access a logical volume, such as for example and without limitation logical volume 180 (FIG. 2 ), wherein information speci ic to that user are encoded in logical volume 1 80.
• the member and/or user can further utilize the GUI to access Applicants' social network as described herein.
• Processor 132 accesses the computer readable program code 134, encoded on the non-transitory computer readable medium 133, and executes an instruction 136 to electronically communicate with the computing device 1 10 via the communication fabric 1 20 or electronically communicate with the computing dev ice 1 50 via the communication fabric 140.
• Encoded information 137 includes, for example and without limitation, the data communicated or information fields communicated, e.g. , date and time of transmission, frequency of transmission and the like, with any or all of the computing device 1 10 and the computing device 150.
• information 137 is analyzed and/or mined.
• information 137 is encoded in a plurality of individual logical volumes specific to each member / user.
• computing devices 1 10 and 1 50 further comprise one or more display screens 1 1 5 and 1 55, respectively.
• display screens 1 1 5 and 1 55 comprise an LED display device.
• the information fields received from the computing device are identical to the information fields received from the computing device.
• the network serv er 1 30 are exchanged with other computing devices not shown in FIG. 1 .
• information fields received from a social network in which the member has an Internet presence is sent to the social network server 130 and stored at the information 137 in association with a profile of the member.
• the information fields transmitted from the computing device 1 10 to the social network server 130 is sent to an account of the member w ithin the social netw ork.
• information 137 is encoded in one or more hard disk drives, tape cartridge libraries, optical disks, combinations thereof, and/or any suitable data storage medium, storing one or more databases, or the components thereof, in a single location or in multiple locations, or as an array such as a Direct Access Storage Device (DASD), redundant array of independent disks (R AID), vi realization device, etc.
• information 137 is structured by a database model, such as a relational model , a hierarchical model, a network model, an entity-relationship model, an object-oriented model, or a combination thereof.
• the information 137 is structured in a relational model that stores a plurality of Identities for each of a plurality of members as attributes in a matrix.
• the computing dev ices 1 10, 130, and 1 50 include wired
• v arious communication protocols including near field (e.g., "Blue Tooth” ) and/or far field communication capabilities (e.g., satellite communication or communication to cell sites of a cellular network) that support any number of services such as: telephony.
• SMS Short Message Service
• MMS Multimedia Messaging Service
• Email electronic mail
• GPS Global Positioning System
• the communication fabrics 120 and 140 each comprise one or more switches and 141, respectively.
• communication fabrics 120 and 140 are the same.
• at least one of the communication fabrics 120 and 140 comprises the Internet, an intranet, an extranet, a storage area network (SAN ), a wide area network (WAN), a local area network (LAN), a virtual private network, a satellite communications network, an interactive television network, or any combination of the foregoing.
• at least one of the communication fabrics 120 and 140 contains either or both wired or wireless connections for the transmission of signal s including electrical connections, magnetic connections, or a combination thereof.
• communication fabrics 120 and 140 utilize any of a variety of communication protocol s, such as Transmission Control Protocol/Internet Protocol (TCP/IP), for example.
• TCP/IP Transmission Control Protocol/Internet Protocol
• the computing devices 1 10, 130 and 150 are each
• the network server 1 30 is a computing device that is owned and/or operated by a networking service provider, and computing devices 1 10 and 150 are owned and/or operated by individual network users.
• network server is owned and/or operated by a social network prov ider.
• the network server 130 provides access to the computing dev ices 1 10 and 1 50 to execute Applicants' source code 136 via a Software as a Service ( SaaS) means.
• SaaS Software as a Service
• information fields are received from one or more computing devices 1 10, 130 and/or 150 and stored on the "Cloud" such as data storage library 160 and/or 1 70.
• each of the data storage libraries 160 and 170 have corresponding physical storage devices, such as and without limitation physical data storage devices 163 - 169 for data storage library 160 and 1 73 - 179 for data storage library 170.
• physical storage device 163 is configured to comprise logical volume 180.
• each physical storage device in data storage library 160 i s configured to comprise a plurality of logical volumes.
• each physical storage dev ice in data storage library 1 70 is configured to comprise a corresponding plurality of logical volumes.
• each member of the social network is assigned a unique logical volume.
• a permission file 157 may be encoded in computer readable medium 133 or in data storage libraries 160 and 170 that associates each logical volume with a social network member and further associates each logical volume with access permi ssions for certain designated other social network users.
• Each social network user configures his/her own logical volume permissions.
• a first user desires to remov e access permissions from a second user
• that first member simply ctCCCSSCS his/her permissions file and deletes the second user. Thereafter, the second user cannot retriev e data stored on the logical volume associated with the first user.
• Applicants' algorithm 136 can be accessed by users of Applicants' network 100 to create, share, edit, associate one or more annotations with, and/or associate one or more discussion threads with, a Playable Media File.
• One member using a computing device such as computing device 1 10 or 150, to access network server 130, streams a Playable Media File from its original storage location.
• the Playable Media File is encoded in a unique logical volume accessible by a first user. That first user can grant access to the Playable Media Fi le to one or more other users by storing access permissions in permission file 1 57.
• the access includes levels such as, and without limitation, view only, view/edit, view/ ' edit/share, and the like. In certain embodiments the access includes conditions or restrictions such as expirations dates, limitations on the number of times the file can be viewed, and the like.
• a data profile 300 is created for the Playable Media File and is stored on network server 130, and optionally on data storage library 160 or 170.
• Data profile 300 includes various information fields, including the Global Unique Identifier (GUID) 302 associated with the creating member, a description 304 of the Playable Media File (e.g., a title), and permissions 306 held by various members to access, edit, and/or share the Playable Media File.
• GUID Global Unique Identifier
• Data profile 300 may further include subsequently added annotations 3 12 and discussion threads 328.
• Applicants ' system and method further disclose an article of manufacture comprising a platform for information management, such as computing device 1 10, 130, and/or 1 50, comprising computer readable program code, such as API 1 16, API 1 56, and/or Applicants' social network source code 1 36, residing in a non-transitory computer readable medium, such as computer readable medium 1 13, 133, and/or 1 53, where that computer readable program code can be executed by a processor, such as processor 1 1 2 (FIG 1) and/or 132 (FIG. 1), and/or 1 52, to implement Applicants' method recited in FIGS. 4- 16.
• a platform for information management such as computing device 1 10, 130, and/or 1 50
• computer readable program code such as API 1 16, API 1 56, and/or Applicants' social network source code 1 36
• a non-transitory computer readable medium such as computer readable medium 1 13, 133, and/or 1 53
• processor 1 1 2 FIG. 4- 16
• Applicants' system and method further disclose a non -transitory computer readable medium wherein Applicants' computer program product is encoded herein.
• Applicants' computer program product comprises computer readable program code that can be executed by a programmable processor to implement Applicants' method recited in FIGS. 4- 16.
• the computer readable program code is encoded in a non-transitory computer readable medium comprising, for example, a magnetic information storage medium, an optical information storage medium, an electronic information storage medium, and the like.
• “Electronic storage media” means, for example and without limitation, one or more devices, such as and without limitation, a PROM, F.PROM, EEPROM, Flash PROM, compactflash, smartmedia, and the like.
• a method for setting a bookmark during a recording of a playable media file is
• a network user can use one of the computing devices 1 10 and 150 (FIG. 1) to record a playable media file of a live event.
• FIG. 1 should not be taken as limiting.
• any number of computing device that is capable of recording a playable media file of a live event can be used by a network user and can be part of the network 100.
• a user device may be configured to, on its own or in cooperation with one or more servers as described above, create a virtual clip of a playable media fi le encoding a recording of a live event while the event and/or the recording is taking place.
• the exemplary method is described with reference to a touchscreen user device that is recording the event, and variations on the exemplary method are contemplated.
• the user device may be configured to receive audio inputs and/or inputs from peripheral devices such as a keyboard, remote controller, and/or mouse.
• the user device may not be recording the live event and may not create or store the playable media file; another device may create the playable media file and store it in a location from which the user dev ice or another dev ice accessible by the user may concurrently and/or later download and/or stream the media file.
• the user device receives a user input signaling the user device to begin recording the live event, and starts to record a playable media file of the live event.
• the user device may also display a user interface including one or more interactable graphical objects that serve as the user's controls for the virtual clip.
• the user device receiv es another user input, and at step 530 the user device determines that the user input includes a command to start a virtual clip of the recording.
• the user device generates a temporal place marker that indexes the temporal point of interest in the recording that corresponds to the time that the user initiated the virtual clip.
• the temporal place marker is stored on the user device or the recording computing device in step 550.
• the user device continues to record the live ev ent, subsequently receiving another user input at step 560.
• the user device determines whether the user input includes a command to stop capturing the virtual clip; this command may be a selection of an END CLIP object in the user interface, or it may be a selection by the user to stop recording the live event.
• the user device generates a temporal place marker that indexes the temporal point of interest in the recording that corresponds to the time that the user ended the virtual clip.
• the user device may create and store the virtual clip containing an identi ier for the media file encoding the recording of the live event, the first temporal place marker identifying the start time (i .e., time elapsed from the beginning of the recording) of the virtual clip, and the second temporal place marker identifying the end time of the v irtual clip.
• the steps 520-590 of creating a virtual clip may be repeated to capture a second virtual clip of the media file.
• the user input that ends the capture of the first virtual clip may also serve as the user input that starts the capture of the second v irtual clip.
• the playable media file and the virtual clip(s) may be transferred by the user device to a server or other computer storage device and later accessed using the systems described herein.
• the temporal place markers may be used to identify "trim" locations within the media file; the user device or recording device may store - only or additionally - the encoded content captured between the temporal place markers.
• the user device may be used to view the media file subsequent to the live event occurring, and to generate virtual clips of the media file as described above.
• a user can communicate to a recording computing dev ice to generate a temporal bookmark that indexes a temporal point of interest during recording of a liv e ev ent.
• the algorithm 136 comprising Applicants' source code generates a temporal place marker.
• the algorithm 136 comprises voice recognition source code so that when the user speaks verbal ly to the recording computing dev ice, a temporal place marker is generated.
• the user is able to communicate to recording computing device using a control dev ice 105 (FIG. 1), which is connected to the recording computing dev ice via a connected data link .
• control dev ice is connected to the recording computing dev ice remotely via Bluetooth, ultra-wideband, wireless local area network, Wi-Fi, AirPort, Infrared, ZigBee, and or other similar technologies.
• a signal can be transferred from the control dev ice 105 to the recording computing dev ice so that the algorithm 136 comprising Applicants " source code generates a temporal place marker during the recording of a liv e event.
• a "Media File, playable or static,” may be a file containing data that encodes one or more types of media content, such as audio content, video content, audiovisual content, image and other computer graphic content, text content, slide-show and similar sequenced-graphic content, and the like.
• media files include, AVI file, MP3 file, MP4 file, WMA file, WAV file, Flash, MPEG file, an image file (JPG, TIF, PNG, GIF, Bitmap, and the like), a PDF file, a text file (e.g., a .doc file), a VISIO file, a .ppt file, a .key file, a spreadsheet file, and any type of 3D media file.
• such a 3D media file requires holographic projection / holographic viewing.
• “Media File, playable or static” further includes any file which generates a Stereoscopic visual display that can be viewed through stereoscopic eyewear or played on 3D display technology such as 3D TV, and in certain embodiments comprises a Virtual Reality/ Augmented Realty file that can be viewed through Virtual Reality devices such as Hololense, Oculus Rift, Sony
• Playstation VR HCT VIVE, Razer OSBR HDK, Zeiss VRl, SOV VR, Freefly, and the like.
• a "virtual clip" created from one or more of such media files may, in some embodiments, be a set of data points that together delineate a particular subset of the content encoded in the media file.
• the virtual clip is comprised of references that identify specific content in the corresponding media file, but the virtual clip is not necessarily itself a stored media file containing the content data.
• the content data may remain in its original storage location, and the present systems (e.g., described in FIGS. 1 and 2) may obtain the virtual clip, read the set of data points, access the media file in its original stored location, and then obtain (e.g., via file transfer or streaming) the subset of content that is delineated by the data points.
• the set of data points may include a start point and an end point; together with an identifier of the media file, the start point and end point may identify the content to be included in the virtual clip.
• the data describing the data points may be selected depending on the type of media file encoding the content.
• start and end points include: in a video or audio file, a start time (e.g., a duration measured from the beginning of the video/audio content at time 0.0) and an end time which together define a "clip" of the video/audio content; in an image, a starting coordinate (e.g., with respect to a top-left corner of the image being at coordinate (0, 0)) of a first pixel representing the top-left corner of a rectangular region of the image, and an ending coordinate of a second pixel representing the lower- right corner of the region; in a slide show, a starting slide number and an ending slide number; in a plain text, formatted text, or binary text file, a starting pointer and an ending pointer identifying positions in the character stream.
• start time e.g., a duration measured from the beginning of the video/audio content at time 0.0
• end time which together define a "clip" of the video/audio content
• a starting coordinate e.g., with respect to a top-left corner of
• each data point in the set may include a time (e.g., time elapsed since the beginning of the simulation), a coordinate location within the simulated environment (e.g., xyz coordinates of a user-controlled camera within a geographic environment mapped to a Cartesian coordinate system), and data (e.g., a vector) identifying the camera line-of-sight.
• a time e.g., time elapsed since the beginning of the simulation
• a coordinate location within the simulated environment e.g., xyz coordinates of a user-controlled camera within a geographic environment mapped to a Cartesian coordinate system
• data e.g., a vector
• step 7 10 the method, without pausing the media play, displays an END CLIP interactable graphical object and a CANCEL CLIP interactable graphical object.
• step 720 If the user activates the CANCEL CLIP interactable graphical object in step 720, then the method transitions from step 720 to step 750 and ends. Alternatively, if the user does not activate the CANCEL CLIP interactable graphical object in step 7 10, then the method transitions from step 7 10 to step 730 wherein the method determines if the END CLIP interactable graphical object has been activated. If the method determines in step 730 that the END CLIP interactable graphical object has not been activated, then the method waits at step 730, while the system continues to play or otherwise display the media file, until the user activates the END CLIP interactable graphical object. At step 740, the system determines that the user has selected to end the virtual clip, determines the location w ithin the media file at which the virtual clip should end, and temporarily stores a start point, an end point, and any other data needed to identify the virtual clip.
• step 740 for a virtual clip of a video or audio file may include identifying the time elapsed in the content when the END CLIP interactable graphical object was selected, and then creating and storing a virtual clip containing the media file identifier, a start time of 0.0, and an end time representing the time elapsed.
• the system may subtract the start time from the end time to determine a duration of the virtual clip, and may store the start time and the duration in the virtual clip.
• step 740 for a virtual clip of an image file may include identifying an end coordinate of the pixel over which a mouse cursor was 1 ocated when the END CLIP interactable graphical object was selected, and then creating and storing a virtual clip containing the media file identifier, a start point of (0, 0), and an end point at the end coordinate.
• the virtual clip would thus identify the region within an implied bounding box; if the end coordinate were (x, y), the bounding box would have clock wi se corners at (0, 0), (x, 0), (x, y), and (0, y).
• step 740 for a virtual clip of a text file may include identifying a cursor location within the text file and determining a target position, within the data stream (e.g., ASCII or other plain text stream, rich text or other formatted text stream, binary file stream, etc. ) representing the text file, corresponding to the cursor location, then creating and storing a virtual clip containing the media file identifier, a starting stream position of 0, and the target position as an ending stream position.
• a virtual clip is saved to the user's computing device.
• the virtual clip is sav ed to Applicants' network serv er 130 (FIG. 1).
• step 610 if the user elects in step 610 NOT to create a plurality of virtual clips each from a beginning of the media file to a designated end point, then the method transitions from step 6 10 to step 620 wherein the user may elect to create a plurality of virtual clips comprising content from one or more Media File, playable or static from a designated start point to a designated end point.
• the system may display on the user's device a user interface that displays the media file along with a START CLIP interactable graphical object, and the system may receiv e a user input indicating the START CLIP interactable graphical object was selected.
• the system may identify, as the start point of the virtual clip, the point within the media file that was "in focus" when the START CLIP interactable graphical object was selected, and then transitions from step 620 to step 8 10 (FIG. 6).
• a determination of the "in focus" point, and thus the start point, may depend on the type of the content file, but in any case can be objectiv ely determined.
• the time during playback that the START CLIP object is selected may be the start point; additional data may be needed for 2D or 3 D recorded simulations, such as the camera location and line-of-sight when the START CLIP object is selected.
• the "in focus" point may be the slide being di splayed when the START CLIP object is selected, and in other static files such as text and image files, the cursor position may identify the "in focus" point.
• step 8 1 0 the method streams the Media File, playable or static from a designated start point, and without pausing the media play, displays an
• the system determines that the user has selected to end the virtual clip, determines the location within the media file at which the virtual clip should end, and temporarily stores a start point, an end point, and any other data needed to identify the virtual clip.
• Any of the above examples described with respect to step 740 of FIG. 5 may illustrate the system's operation to create and store the virtual clip, with the additional processing required to identify the start point within the media file.
• the system may provide a user interface that enables the user to draw a visible bounding box (e.g., using a mouse cursor and clicks), and may identify the start and end points using the top-left and lower- right coordinates of the visible bounding box.
• step 840 the virtual clip is saved to the user's computing device. In certain embodiments, in step 840 the virtual clip is saved to Applicants' network server 130 (FIG. 1 ).
• step 610 if the user elects in step 610 NOT to create a plurality of virtual clips each from a beginning to a designated end point, and if the user elects NOT to create a plurality of virtual clips, where each virtual clip compri ses content from one or more Media File, playable or statics, and wherein the user specifies a designated timeline location to begin the virtual clip, then the method transitions from step 620 to step 630 wherein the method detennines if the user elects to configure a composite v irtual clip. [00068] If the user elects to configure a composite virtual clip in step 630, the method transitions from step 630 to step 910. Referring now to FIG. 7, in step 910 the method selects (N) saved virtual clips to configure a composite virtual clip, and determines an order of presentation for those (N) virtual clips.
• step 920 the method sets (M) initially to 1 .
• step 930 the method configures a
• step 930 the method saves the (M)th link in a composite virtual clip file.
• step 950 the method determines if (M) equals (N), i .e. if all (N) links to the (N) selected (N) saved virtual clips have been created and saved. If the method determines in step 950 that (M ) does not equal (N), then the method transitions from step 950 to step 960 wherein the method increments (M) by 1, i .e. sets (M) equal to ( M)+ l . The method transitions from step 960 to step 930 and continues as described herein. Alternativ ely, if the method determines in step 950 that (M) equals (N), then the method transitions from step 950 to step 970 and ends.
• step 6 10 If the user elects in step 6 10 NOT to create a plurality of virtual clips each from a beginning to a designated end point, and if the user elects in step 620 NOT to create a plurality of virtual clips, where each virtual clip comprises content from one or more Media File, playable or statics, and wherein the user specifies a designated timeline location to begin the virtual clip, and if the user does NOT elect in step 630 to configure a composite virtual clip in step 630, then in step 640 the method determines whether to display a composite virtual clip.
• step 1010 the method provides a storage location for a composite virtual clip file configured to access (M) saved clips.
• step 1020 the method sets ( P) initially to 1 .
• step 1030 the method activates a (P)th link encoded in the composite virtual clip file to stream a (P)th saved virtual clip to the user's device.
• step 1040 the method determines if all (N) clips comprising the selected composite virtual clip have been displayed, i .e. if (P) equals (N). If the method determines in step 1040 that (P) does not equal (N), then the method transitions from step 1040 to step 1050 and increments (P) by 1 , i .e. sets (P) equal to ( P) + 1. The method transitions from step 1050 to step 1030 and continues as described herein.
• step 1040 determines in step 1040 that (P) equals (N)
• step 962 the method displays an Annotation Panel .
• step 964 the method determines if the user entered an annotation in the Annotation panel of step 962. If the method determines in step 964 is a user entered an annotation in the Annotation Panel, then the method transitions from step 964 to step 14 10. Alternatively, if the user did not enter an annotation in the Annotation panel of step 962, then the method transitions from step 964 to step 966 wherein the method determines if the user elects to change visibility from PUBLIC to PRIVATE.
• step 964 is a user entered an annotation in the Annotation Panel
• the method transitions from step 964 to step 14 10.
• step 1410 the method saves the annotation entered into the Annotation Panel of step 962.
• the user's annotation is saved to the user's computing device.
• step 14 10 the user's annotation is saved to server 140 (FIG. 1).
• the method determines whether a user input associated with the virtual clip, such as an annotation, conforms to a predetermined format.
• the format comprises a tag identifier indicating the user input includes taxonomy tags, a first tag following the tag identifier and identifying a first category of the composite virtual clip, and (P) subtag(s) sequentially following the first tag and each including a delimiter indicating a previous tag is complete and an additional tag follows, identifying an additional category of the virtual clip.
• the tag identi ier may be a character (the "#" or hash symbol in the examples herein), character string, or other data element that the system is configured to identify as an indicator that the text fol lowing the tag identifier should conform to the taxonomy tag format, and contains at least one tag if so.
• the format comprises zero subtags. In other embodiments, the format compri ses 1, 2, 3, 4, 5, or any number that is greater than 1 subtags.
• the method creates and saves a taxonomy tag for the annotation saved in step 14 10.
• the taxonomy tag comprises a form " content:TITLE.
• the taxonomy tag comprises a form "#first tag:subtag 1 :subtag2: . . . :subtagP," where the first tag and each subtag( 1 . . P) are character strings separated by the delimiter character
• the method also identifies one or more taxonomy tags from the user and associates the virtual clip with one or more categories identified by the one or more taxonomy tags.
• each tag immediately following a tag identifier corresponds to a main category
• each subtag corresponds to a subcategory of the (sub)category corresponding to the immediately preceding tag (i .e., the tag to the left of the delimiter).
• one or more categories are arranged into a hierarchy determined from a sequence of the corresponding tags identified in the user input.
• each taxonomy tag identifies a corresponding hierarchy of categories.
• the method associates the virtual clip with each of the one or more categories corresponding to one of the tags/subtags in each taxonomy tag associated with the v irtual clip.
• the categories and any corresponding hierarchy may exist in a data store (e.g., the global data store), and associating the taxonomy tags with the categories may include matching the tags to the categories.
• the taxonomy tags and their respective tagging sequence may represent a realtime, ad hoc "categorization" in absence of a centralized hierarchy.
• the virtual clip may be associated with the taxonomy tags to produce a searchable virtual clip that is delivered to a requesting device in response to a query from the requesting device for any of the plurality of virtual clips that are associated with the taxonomy tags.
• the system may require that the taxonomy tags of the query appear in the same sequence of the stored taxonomy tags, in order to improve accuracy and relevance of the search results.
• associating a virtual clip with the taxonomy tags may include creating, based on an order in an input character string of the one or more taxonomy tags, a directed relationship between a first taxonomy tag and a second taxonomy tag sequentially following the first taxonomy tag in the character string, the directed relationship enabling a user to retrieve the first virtual clip from the stored data using an ordered combination of the first and second taxonomy tags as the query.
• the system may provide for the query to include a user identifier, such that the virtual clips may further be searched to return any virtual clips that have the corresponding taxonomy tags and were created by a particular user.
• This configuration also provides for a user to configure the associated user account to "follow" a particular user, and further a particular set of taxonomy tags; subsequent to implementing this configuration, the system may automatically send matching virtual clips to the user's account.
• GUI graphical user interface
• the GUI 1700 may include a navigation element 1 702 that displays visual representations of one or more of the category hierarchies, in accordance with parameters that may be provided by the user.
• the GUI may enable the user to configure the navigation element 1702 to display a particular subset of all accessible (i.e., to the user via permissions in a user account) hierarchies, non-limiting examples of such a subset including: all hierarchies derived from taxonomy tags associated with virtual clips created, stored, and/or saved (e.g., via a bookmark function) by the user; all hierarchies derived from taxonomy tags of virtual clips shared with the user's user account; each hierarchy derived from a taxonomy tag used within a specified portion of a social network; and the like.
• the GUI 1700 may enable the user to interact with the displayed hierarchies, such as by displaying an interactable icon (e.g., an arrow 1 704) indicating that a displayed category 1 706 has one or more subcategories; selecting the icon may cause the system to update the navigation element 1 702 to display the subcategory/ies that were previously hidden.
• an interactable icon e.g., an arrow 1 704
• selecting the icon may cause the system to update the navigation element 1 702 to display the subcategory/ies that were previously hidden.
• the user may be able to select a displayed category 1 706;
• the system may filter all virtual clips accessible by the user to produce a subset of such virtual clips that are also associated with the selected category 1 706, as specified by a taxonomy tag associated with the virtual clip.
• the system may then update the GU I 1700 to include a content di splay panel 1 7 12 displaying visual representations 1 7 14 of the virtual clips that belong to the filtered subset.
• the visual representations 1 7 14 may be interactable graphical objects, such as a selectable element that generates a user input causing the system to update the GUI 1700 to include a virtual clip display panel (not shown) that di splays the virtual clip associated with the selected visual representation 1 7 14.
• FIG. 1 7B illustrates an example GUI 1 760 that enables a user to configure his user account to identify virtual clips in a particular subcategory, and further to identify virtual clips created by a particular user and belonging to a particular subcategory.
• FIG. 17B further shows that the system may configure such filtering in-context - that is, the filtering may be performed upon encountering a taxonomy tag 1 764 of a virtual clip
• the system may configure the GUI 1760 to render the taxonomy tag 1 764 as an interactable object; the user may, for example, tap on or direct a mouse cursor to hover over the taxonomy tag 1 764, producing a user input that the system processes and in turn updates the GUI 1 760 to include a popup information window 1770 containing information as well as objects that may initiate commands.
• One such object 1 772 may invoke a filtering command that causes the system to
• the user is enabled to click on the object 1 772 to "follow" the subcategory
• Another such object 1 774 may invoke a filtering command that is constructed from the category hierarchy of the taxonomy tag as well as additional metadata of the virtual clip.
• the additional metadata includes the user identifier of the user that created or "posted” the virtual clip 1 762. The object 1 774 thus invites the user to aggregate virtual clips associated with the subcategory only if the virtual clips were created or posted by the identified user.
• taxonomy tags may further be used to aggregate information about social
• step 1440 the method determines if the user activates a
• step 1440 determines that the user does activate the CANCEL graphical interactable object. If the method determines that the user does activate the CANCEL graphical interactable object, then the method transitions from step 1440 to step 1490 wherein the method ends without saving any selected content. Alternatively, if the method determines in step 1440 that the user does not activate the CANCEL graphical interactable object, then the method transitions from step 1440 to step 1450 wherein the method determines if the user activates the SAVE graphical interactable object.
• step 1460 transitions from step 1460 to step 1470 wherein the method indexes and saves the collected data of step 1460.
• step 1470 transitions from step 1470 to step 1480 wherein the method resumes the media file play.
• step 966 the method transitions from step 966 to step 1 5 1 0 (FIG. 13) wherein the method does NOT include a location for the media file, or a location for any saved data abstracted from that media file, in a sitemap published to search engines.
• the method transitions from step 1 5 10 to step 1440 and continues as described herein.
• step 968 If a user elects to provide saved content to specific persons in step 968, then the method transitions from step 968 to step 1610 wherein the method enters recipients in the form of name(s), email(s), and/or social media account(s). The method transitions from step 16 10 to step 1440 and continues as described herein.
• a “transition” comprises an animation-like effect when Applicants' method to display a composite virtual clip moves from one previously saved virtual clip to a next previously saved virtual clip during an onscreen presentation.
• Applicants' method allows control the speed of each transition effect.
• Applicants' method also permits the addition of sound transitions when moving from a saved virtual clip to the next saved virtual clip.
• step 650 If a user desires in step 650 to add one or more transition effects to a previously configured composite virtual clip.
• Applicants' method transitions from step 650 to step 1 1 10 (FIG. 9).
• step 1 1 10 the method selects a previously configured composite virtual clip, wherein that composite virtual clip is configured to include (N) previously saved virtual clips in an order from 1 to (N).
• step 1 120 the method selects a transition effect having a known storage location.
• step 1 130 the method configures an (i )th transition effect link pointing to the known storage location for the desired transition effect.
• step 1 140 the method configures the (i )th transition effect link to be activated after activation of a link to an (i)th virtual clip and before activation of a link to an (i+l)th virtual clip.
• step 1 1 the method updates the composite virtual clip file to include the (i)th transition effect link.
• step 1 160 the method determines if the user desires to configure additional transition effects for the selected composite v irtual clip. If the user elects to configure additional transition effect links, then the method transition from step 1 160 to step 1 120 and continues as described herein. Alternatively, if the user does not elect to configure additional transition effect links, then the method transition from step 1 160 to step 1 1 70 and ends.
• step 660 If a user desires in step 660 to add one or more lensing effects to a previously configured composite virtual clip. Applicants' method transitions from step 660 to step 12 10 (FIG. 10) As those skilled in the art will appreciate, a "lensing" effect includes, for example and without limitation, overlay of one or more color filters, image distortions, and annotations.
• step 1260 the method determines if the user desires to configure additional 1 en sing effects for the selected composite virtual clip. If the user elects to configure additional transition effect links, then the method transition from step 1260 to step 1220 and continues as described herein. Alternatively, if the user does not elect to configure additional transition effect links, then the method transition from step 1 260 to step 1270 and ends.
• step 670 If a user desires in step 670 to add one or more sound effects to a previously
• step 1320 the method selects a sound effect having a known storage location.
• step 1330 the method configures an (i)th sound effect link pointing to the known storage location for the desired 1 en sing effect.
• step 1340 the method configures the (i)th sound effect link to be simultaneously with activation of a link to an (i)th virtual clip.
• step 1 350 the method updates the composite virtual clip file to include the (i )th sound effect link.
• the graphical user interface 1 800 may include a display window 1 802 for displaying content encoded by the playable media file.
• the system may generate the GUI 1 800 to include such playback (or other display) of the playable media file.
• the system may obtain a virtual clip as described herein, and may determine a storage location of the playable media file from the virtual clip; then, the system may include, in the program instructions for displaying the GU I 1800, instructions that cause the display device 107 to access and/or retrieve the playable media file at the storage location . Additionally or alternatively, the system may itself access and/or retrieve the playable media file at the storage location, and may deliver the playable media file to the user's device for playback.
• the GUI 1 800 may include a first interactable graphical object 1 8 1 0, which displays a timeline representing a duration of play of a playable media file.
• the first interactable graphical object 1 8 10 may overlay the display window 1 802 that displays the playable media file content.
• the first interactable graphical object 1 8 10 may display a plurality of vi sible annotation indicators.
• a visible annotation indicator may be a clip indicator 1830 associated with a corresponding v irtual clip that i s associated with the playable media file.
• the clip indicator 1 830 may identify a start time of the associated v irtual clip, and may appear at the corresponding location along the timeline.
• each virtual clip associated with the playable media file in a global data store may have a corresponding clip indicator 1830 appearing in the appropriate display position for the corresponding start time of the virtual clip.
• the clip indicator 1 830 of each v irtual clip may have a corresponding color that is selected based on an access type of the virtual clip with respect to the active user account.
• the colors of clip indicators 1 830 are associated with: a public access type, wherein any user and non-user v isitor can access the virtual clip; a shared access type, wherein another user of the social network has shared the virtual clip with the user of the active user account; and, a private access type, which are virtual clips created by the active user.
• the GUI 1800 may further include a second interactable graphical object 1 820 that also overlays a portion of the display window 1 802.
• the second interactable graphical object 1 820 may be configured to dynamically display up to a maximum number of graphic elements each associated with a corresponding virtual clip of the plurality of virtual clips; the graphic elements may be selected based on an interaction by the user with a certain display position on the timeline.
• a user input indicating that the user interacted with
• the system may create each of the graphic elements to include information related to a v irtual clip that has a start time within a certain duration from the time associated with the first display position.
• the system may identify one, some, or all of the virtual clips as display able virtual clips: the virtual clip having its start time closest to the time at the first display position may be selected as a first clip; then, one or more virtual clips preceding (e.g., sequentially preceding) the first clip and/or one or more virtual clips subsequent (e.g., sequentially subsequent) may be selected, such that a number of virtual clips no greater than the maximum number of graphic elements are selected.
• the second interactable graphical object 1 820 may have a setting that the system can switch to make the second interactable graphical object 1 820 vi sible or not visible within the GUI 1 800.
• the system causes the second interactable graphical object 1 820 not to be displayed when the GUI 1 800 i s first displayed. Then (e.g., in step 1 740 of FIG. 16), when a user interacts with a visible annotation indicator 1830, or any other part of the first interactable graphical object 1 8 10, the system update the GUI 1 800 to display the second interactable graphical object 1 820, itself displaying the list of graphical elements (e.g., annotations 1 822a-g).
• the system may create additional annotation indicators, which are displayed on the first interactable graphical object 1 8 10, based on a user's input.
• the data profile 300 in FIG. 3 further comprises an access type indication whether an annotation is a public annotation available to all network users of a social network, a shared annotation made accessible to a user by one of the network users, or a private annotation accessible only by a user; and an identifier of a creating user of an annotation.
• the graphical user interface 1 800 may further include a third interactable graphical object 1 840 overlaying a third portion of the display window.
• the third interactable graphical object 1 840 could be made vi sible by the system, as described above.
• the system may receive a user input indicative of a user interaction with the first graphic element.
• the system may obtain entries in a di scussion thread associated with the first clip, and may render information from the discussion thread into the third interactable graphical object 1 840 and update the GUI 1800 to display the third interactable graphical object 1 840.
• a machine learning engine can learn what a user of a network behavior looks like and the machine learning engine can interact with the computing device and the control device within the network 100.

Landscapes

• Engineering & Computer Science (AREA)
• Business, Economics & Management (AREA)
• Theoretical Computer Science (AREA)
• Strategic Management (AREA)
• General Physics & Mathematics (AREA)
• Physics & Mathematics (AREA)
• General Business, Economics & Management (AREA)
• Human Resources & Organizations (AREA)
• Entrepreneurship & Innovation (AREA)
• Economics (AREA)
• Marketing (AREA)
• Tourism & Hospitality (AREA)
• Accounting & Taxation (AREA)
• Finance (AREA)
• Data Mining & Analysis (AREA)
• Development Economics (AREA)
• Operations Research (AREA)
• Quality & Reliability (AREA)
• Game Theory and Decision Science (AREA)
• Multimedia (AREA)
• Databases & Information Systems (AREA)
• General Engineering & Computer Science (AREA)
• Computing Systems (AREA)
• Health & Medical Sciences (AREA)
• General Health & Medical Sciences (AREA)
• Primary Health Care (AREA)
• User Interface Of Digital Computer (AREA)

Applications Claiming Priority (2)

Publications (2)

Family

ID=63712323

Family Applications (1)

Country Status (2)

Families Citing this family (1)

Family Cites Families (5)

• 2018
  • 2018-04-05 WO PCT/US2018/026194 patent/WO2018187534A1/en unknown
  • 2018-04-05 EP EP18781305.0A patent/EP3607457A4/de not_active Withdrawn

Also Published As

Similar Documents

Legal Events