WO2013096701A1 - Systems and methods involving features of creation/viewing/utilization of information modules - Google Patents

Systems and methods involving features of creation/viewing/utilization of information modules Download PDF

Info

Publication number
WO2013096701A1
WO2013096701A1 PCT/US2012/071095 US2012071095W WO2013096701A1 WO 2013096701 A1 WO2013096701 A1 WO 2013096701A1 US 2012071095 W US2012071095 W US 2012071095W WO 2013096701 A1 WO2013096701 A1 WO 2013096701A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
mixed
user
content
interface
Prior art date
Application number
PCT/US2012/071095
Other languages
French (fr)
Inventor
Doug Imbruce
Owen BOSSOLA
Rasmus KNUTTSSON
Hakim EL HATTAB
Tommy CHHENG
Original Assignee
Qwiki, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qwiki, Inc. filed Critical Qwiki, Inc.
Priority to EP12859456.1A priority Critical patent/EP2795444A4/en
Priority to CA2857519A priority patent/CA2857519A1/en
Priority to CN201280061447.9A priority patent/CN103988162B/en
Publication of WO2013096701A1 publication Critical patent/WO2013096701A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/44Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 

Definitions

  • aspects of the present innovations relate to information modules, and, more particularly, to associated systems and methods, such as those involving creation, viewing and/or utilization of mixed-media modules.
  • Editing requires expensive software, a skilled editor with technical and story-telling skills, and, possibly, the hiring of a graphic designer, special effects artist and/or narrator. Editing software also utilizes a lot of computing resources, typically requiring sophisticated, expensive and fast computing/storage equipment. There is also a high learning curve when it comes to using any of these editing tools and each piece of software usually requires a large financial commitment.
  • video is a stand-alone, self-contained, linear medium. It is not interactive and it is difficult to embed a layer of meta-data which would make it interactive. For instance, it is not easy for a content producer to link on-screen content to information elsewhere on the web. While a video may contain motion graphics, still photos or animations, it cannot display PDF files, text files and links to other content in a way that is useful for the audience. Nor is it easy to create "chapters.” For example, in a YouTube video a viewer cannot jump ahead to a specific chapter or section within the video. Any content that is embedded is "locked in” and is not easy to move or change. It can't contain links embedded into player for a true interactive experience.
  • Advertising connected to video is also not ideal because it interrupts the flow of the video.
  • Advertising in the pre-roll of a video prevents a user from getting to the content quickly, post-roll advertising is easy to ignore and if ads are inserted into the middle of content it is annoying and disruptive.
  • One negative result of video advertising or banner ads is that it can send a viewer on a detour away from their desired content.
  • banner or overlay ads completely disrupt the user's experience, appear cheap, have no visual relevance and reflect poorly on the advertiser. None of these ads are related to the content or relevant to the user.
  • the advertising mostly annoys the user, isn't helpful and doesn't have a great return on investment (ROI) for the advertiser. This is reflected by the low click-through rates on web ads.
  • ROI return on investment
  • Embodiments herein are directed to web-based tools for editing content into a rich, mixed-media capable, interactive components, or "mixed-media modules".
  • other embodiments herein are directed to a "Player” configured to present coordinated text, images, documents, narrations and links all available in one or more, interactive screen format(s) and/or window(s).
  • Player implementations may be embedded into mobile devices and appliances, played on a webpage, or integrated into various other processing environments.
  • FIG. 1 is a box diagram of an illustrative web or network-based implementations consistent with certain aspects related to the innovations herein.
  • FIG. 2 is an exemplary screenshot showing an illustrative mobile device display including a search engine results page with integrated mixed-media component consistent with certain aspects related to the innovations herein.
  • FIG. 3 is an illustration of an exemplary search engine results page showing user action with a mobile device display search results page consistent with certain aspects related to the innovations herein.
  • FIG. 4 is an exemplary screenshot illustrating further mobile device display functionality consistent with certain aspects related to the innovations herein.
  • FIG 5 is an exemplary screenshot illustrating mobile device display of a search results content such as a mixed-media module consistent with certain aspects related to the innovations herein.
  • FIG 6 is an exemplary screenshot of an illustrative mobile device display showing user interaction with a mixed-media module from the search results consistent with certain aspects related to the innovations herein.
  • FIG 7 is an exemplary screenshot of a mobile device display showing an illustrative result of a user interaction consistent with certain aspects related to the innovations herein.
  • FIG. 8 is an illustration of a Mixed-Media Module creator dashboard consistent with certain aspects related to the innovations herein.
  • FIG. 9 is an illustration of a Mixed-Media Module creator showing aspects of removing a module consistent with certain aspects related to the innovations herein.
  • FIG. 10 is an illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein.
  • FIG. 1 1 is another illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein.
  • FIG. 12 is another illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein.
  • FIG. 13 is another illustration of a Mixed-Media Module creator showing aspects of creating a title card consistent with certain aspects related to the innovations herein.
  • FIG. 14 is another illustration of a Mixed-Media Module creator showing aspects of creating a media library for the first time consistent with certain aspects related to the innovations herein.
  • FIG. 15 is another illustration of a Mixed-Media Module creator showing aspects of media library uploading implementations consistent with certain aspects related to the innovations herein.
  • FIG. 16 is another illustration of a Mixed-Media Module creator showing aspects of example media library implementations, where the library is full, consistent with certain aspects related to the innovations herein.
  • FIG. 17 is another illustration of a Mixed-Media Module creator showing aspects of example media library implementations, where the library is off, consistent with certain aspects related to the innovations herein.
  • FIG. 18 is another illustration of a Mixed-Media Module creator showing aspects of example chapter 2 hover implementations consistent with certain aspects related to the innovations herein.
  • FIG. 19 is another illustration of a Mixed-Media Module creator showing aspects of example remove chapter implementations consistent with certain aspects related to the innovations herein.
  • FIG. 20 is another illustration of a Mixed-Media Module creator showing aspects of example chapter 2 implementations consistent with certain aspects related to the innovations herein.
  • FIG. 21 is another illustration of a Mixed-Media Module creator showing aspects of example element mouse hover implementations consistent with certain aspects related to the innovations herein.
  • FIG. 22 is an illustration of a Mixed-Media Module creator showing aspects of example remove single image implementations consistent with certain aspects related to the innovations herein.
  • FIG. 23 is an illustration of a Mixed-Media Module creator showing aspects of example visual list mouse hover implementations consistent with certain aspects related to the innovations herein.
  • FIG. 24 is an illustration of a Mixed-Media Module creator showing aspects of example visual list implementations consistent with certain aspects related to the innovations herein.
  • FIG. 25 is an illustration of a Mixed-Media Module creator showing aspects of example generic error wrong mix implementations consistent with certain aspects related to the innovations herein.
  • FIG. 26 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example screen mouse hover implementations consistent with certain aspects related to the innovations herein.
  • FIG. 27 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example screen write caption implementations consistent with certain aspects related to the innovations herein.
  • FIG. 28 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example caption save implementations consistent with certain aspects related to the innovations herein.
  • FIG. 29 is an illustration of a Mixed-Media Module creator showing aspects of example generic error implementations where the narration is missing consistent with certain aspects related to the innovations herein.
  • FIG. 30 is an illustration of a Mixed-Media Module creator showing aspects of adding example narration implementations consistent with certain aspects related to the innovations herein.
  • FIG. 31 is an illustration of a Mixed-Media Module creator showing aspects of example narration from a media library implementations consistent with certain aspects related to the innovations herein.
  • FIG. 32 is an illustration of a Mixed-Media Module creator showing aspects of example narration from a media library add implementations consistent with certain aspects related to the innovations herein.
  • FIG. 33 is an illustration of a Mixed-Media Module creator showing aspects of enabled webcam implementations consistent with certain aspects related to the innovations herein.
  • FIG. 34 is an illustration of a Mixed-Media Module creator showing aspects of example countdown and instruction implementations consistent with certain aspects related to the innovations herein.
  • FIG. 35 is an illustration of a Mixed-Media Module creator showing aspects of an example first image implementations consistent with certain aspects related to the innovations herein.
  • FIG. 36 is an illustration of a Mixed-Media Module creator showing aspects of an example second image implementations consistent with certain aspects related to the innovations herein.
  • FIG. 37 is an illustration of a Mixed-Media Module creator showing aspects of an example third image implementations consistent with certain aspects related to the innovations herein.
  • FIG. 38 is an illustration of a Mixed-Media Module creator showing aspects of an example visual list implementations consistent with certain aspects related to the innovations herein.
  • FIG. 39 is an illustration of a Mixed-Media Module creator showing aspects of an example last image of a visual list implementations consistent with certain aspects related to the innovations herein.
  • FIG. 40 is an illustration of a Mixed-Media Module creator showing aspects of example processing and soundtrack implementations consistent with certain aspects related to the innovations herein.
  • FIG. 41 is an illustration of a Mixed-Media Module creator showing aspects of example implementations where users are allowed to upload their own files consistent with certain aspects related to the innovations herein.
  • FIG. 42 is an illustration of a Mixed-Media Module creator showing aspects of example implementations where users are allowed to play their own files consistent with certain aspects related to the innovations herein.
  • FIG. 43 is an illustration of a Mixed-Media Module creator showing aspects of example preview implementations consistent with certain aspects related to the innovations herein.
  • FIG. 44 is an illustration of a Mixed-Media Module creator showing aspects of example preview implementations, where the preview narration is missing, consistent with certain aspects related to the innovations herein.
  • FIG. 45 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
  • FIG. 46 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
  • FIG. 47 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
  • FIG. 48 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
  • systems and methods consistent with the innovations herein are directed to creation, viewing, playing, sharing and/or utilization of information modules, such as mixed-media modules.
  • aspects herein involve innovative aspects of a rich, mixed-media, interactive components, as also sometimes referred to in places herein via the 'Qwiki'TM brand component or module.
  • this component or module may be an interactive narrative presentation of media and/or content and it may feature an interactive layer configured to allow viewers to receive more detailed information from within the information module.
  • FIG. 1 is a box diagram of an illustrative web or network-based implementations consistent with certain aspects related to the innovations herein. While the description of FIG. 1 shows various elements, the components of the system can be implemented through any suitable unitary or distributed combination of hardware, software and/or firmware. Referring to FIG. 1
  • the illustrated system may include a mixed-media module (“MMM”) component 160, users at access devices 121 (e.g., one or more of access devices 121A-121 D), one or more connectivity components 125A 125B, as well as possibly other unitary, connected, interconnected or distributed processing entities or components such as additional providers 165 such as network management components, content servers 130, ad components 140, service/business components 150, and other third party servers or components 155, all connected over a network 170.
  • the mixed-media module component 160 may, in some implementations, be the web-based creation and/or playing/viewing tool for handling certain mixed-media module innovations herein.
  • systems and methods associated with creation of information modules herein may be web-based tools for editing online content into a rich, mixed- media capable, interactive component referred to as a "mixed-media module.”
  • a web-based method for creating mixed-media modules comprising providing an interface operable by a user to access a web-based information module creator engine/component(s), providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media, providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface, and generating a mixed-media module via integration of the selected content into a playable presentation of the content.
  • the playable mixed-media module may be configured such that the mixed-media module comprises of a plurality of image media elements connected in sequence as well as two or more types of media content selected from
  • a web-based method for utilizing mixed-media modules comprising providing an interface operable a user to access a web- based information module utilizing engine/component(s), providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation, and providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content.
  • the mixed-media module may comprises of a plurality of image media elements connected in sequence as well as two or more types of media content selected from text, hyperlink, image, audio, document and video.
  • implementations may be configured such that the user may interact with the mixed- media module and/or associated content configured to provide access to at least one of additional third party information, sites, content, applications and/or other multimedia.
  • Systems and methods of mixed-media module creation and playing give online content producers tools to create a professional looking presentation without the time and expense of video. Implementations allow "media editing in the cloud,” but innovations herein also go beyond straightforward web or cloud advantages.
  • Authors of information modules herein can create an audio-visual presentation by compiling multimedia content (photos, videos, documents, maps, etc), from their devices or across the web, into a creator application
  • the Creator available via the web or downloaded onto their device.
  • the author can "drag and drop” the desired content into the Creator and build a "playable” presentation, as explained in more detail below. That presentation may be viewed much like video and may include a linear story line, but it is improves upon video technology because the audience is not required to experience the module in a linear fashion.
  • the technology is innovative for content producers because - unlike video - they do not merely create a finite, linear presentation.
  • the Creator allows an author to create a limitless and updatable, searchable story within the compact, module or component. For example, an author may edit a module that plays for three minutes from start to finish, but contains thirty minutes of searchable content.
  • the Player may derive a layer of interactivity from individual pieces of content which are linked to their original sources on the web. This means that a viewer can either watch a mixed-media module in a linear format or they can self-select a path through the content by clicking on hyperlinks within the Qwiki. The viewer is able to explore the information that is of the most interest to them, in greater detail, and in their preferred format (i.e. text, photos, or video). Further, according to some systems and methods herein, Creator/Player implementations may innovative over existing systems due to the information density and mixed-media/multimedia capabilities of the mixed-media module component(s).
  • systems and methods herein are an improvement on other rich media such as online video technology because they use less bandwidth, are easily customizable, flexible, incorporate interactive video, images, text and other types of media.
  • mixed-media module integrated implementations can incorporate interactive images, text and other types of media. Further, given such implementations operate without large-bandwidth video transmissions especially rendered video content for audiovisual/multimedia experience, systems and methods herein provide improved functionality between mixed media and mobile devices, thus allowing for quicker loads and consumption of less bandwidth during utilization.
  • implementations herein with mixed-media module integrations involving video can yield improved/higher quality on mobile devices, consistent with aspects of the innovations herein.
  • Such implementations may be web-based or downloadable applications downloaded to the mobile device.
  • a method for providing a downloadable application for creating mixed-media modules comprising providing an executable application for download to a user device, the executable application configured for providing an interface operable by a user to execute an information module creator engine/component(s), providing interactive functionality, via the interface, to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media, providing interactive functionality, via the interface, to allow the user to edit the content and/or presentation of the content via the interface, and generating a mixed-media module via integration of the selected content into a playable presentation of the content configured for low-bandwidth and/or non- rendered utilization to facilitate display on a mobile device.
  • systems and methods herein may include features and implementations involving interactive and coordinated hyperlinks for deeper exploration of the content within the embedded media— this feature of coordinating links/content inside of the mixed-media module interactive summary allow new attribution and monetization capabilities by content creators and other entities involved with handling the underlying module(s).
  • a “mobile device” can be any kind of smartphone, tablet computer, laptop, notebook, or any kind of similar device. These devices are typically touch screen enabled and retain internet connectivity through either a shorter range radio such as those used in WiFi technologies, or through cellular telephone connections, or both. The device may connect to the internet in any fashion.
  • FIG. 2 depicts an illustrative web page involving a mixed-media module implementation, formatted for a mobile smartphone or tablet computer, consistent with aspects of the
  • an illustrative "Play Qwiki module” icon is shown directly beneath an associated piece of identifying textual information, here, a search result in a search result screen.
  • FIG. 3 is an illustration of the web page of Figure 2 showing the integration of touch-enable functionality consistent with aspects of the innovations herein.
  • a user is shown tapping the "Play Qwiki module” icon using their finger.
  • Touch enabled screens allow such interaction with a stylus or other such device as well, while such features may be navigated with various cursor-based functionality, as well.
  • FIG. 4 is an illustration of exemplary mobile device display and functionality consistent with aspects of the innovations herein.
  • the mobile smartphone may be rotated to initiate a specified function associated with mixed-media module creation and/or playing, or to transition between landscape display and portrait display, among other functions.
  • FIG. 5 is an exemplary screenshot showing mobile device display of an illustrative mixed-media module consistent with certain aspects related to the innovations herein.
  • FIG 6 is an exemplary screenshot of an illustrative mobile device display showing user interaction with a mixed-media module from the web page consistent with certain aspects related to the innovations herein.
  • Figure 6 shows a user interacting with a portion of the mixed-media module, here tapping the particular media or object with respect to which additional content (details, information, etc) or further functionality is desired.
  • associated servers or engines may be configured to interoperate with such action in a variety of ways.
  • FIG 7 is an exemplary screenshot of a mobile device display showing an illustrative result of a user interaction consistent with certain aspects related to the innovations herein.
  • this example shows an illustrative re-direct associated with the tapped object to a particular web page.
  • the result shows a multimedia text and image or video within the web page.
  • an illustrative multimedia presentation herein may be configured as an interactive system of mixed-media/interactive content with clickable components. These mixed-media modules may also provides visual relevancy - the multimedia nature of such interactive component provides more in-depth detail of a topic than text alone.
  • mixed-media module interactive summaries as integrated herein are lightweight - they use less bandwidth than pure video and are a rich, interactive, multi-media experience. Viewing such mixed-media module is faster and easier than video alone because they are interactive and have more discrete sets of contents that can easily be traversed beyond a simple play bar associated with most traditional video.
  • Mixed-media modules herein also contain more information (meta-data) than video because of its multitude of components (mixed media), interactive nature and because of being configured to be interactive with users/viewers.
  • creator implementations allow an author to create interactive, meta-data rich, playable content for the web. These implementations are intuitive to use, thus demand only a low-learning curve.
  • the creator is touch-enabled, such as via gestrures (see below) for mobile devices and the interface is "drag and drop” for ease of use, as explained further below.
  • the interactive component requires no lengthy production process or rendering time. It's much lighter weight than video because it uses up five times less bandwidth.
  • the individual elements within a module are not hosted on the server of an author, instead the preview may be stored on local servers for guaranteed availability.
  • the images and files may be linked to the original source.
  • the Creator allows an author to link to content in its original location which solves storage problems and possibly helps preserve the owners copyright protection.
  • the Creator also offers an animation platform that includes a custom graphics tool with no rendering issues as with traditional video. The processing of the animation is also off-loaded to device playing back the module which means precious bandwidth is preserved - this is especially valuable when playing on mobile devices.
  • Content creators can add depth to the narrative presentation in a way that is not possible with video.
  • the module can be viewed as a linear story, but the embedded and coordinated links mean that the audience can self-select its path through the module.
  • the producer of a video cannot link to a partner site, get credit for referring customers to an ecommerce site or, simply, strengthen their content with references via hyperlinks.
  • "Chaptering" is another technology that enhances the experience of creating and viewing a mixed-media module.
  • the author can divide a Qwiki into chapters - something that is not easily possible with streaming video - and give the audience the ability to easily jump around and navigate through the content.
  • the Creator gives an author the tools to do all of these things via editor tools, explained below.
  • the "choose your own adventure" style of viewing a module herein also means that advertising can be more sophisticated with such products.
  • the path a viewer chooses through the hyperlinks can determine the type of advertising they see because it builds a consumption profile. Advertising can also be targeted more effectively as the author may have control over the types of advertising viewed by their audience.
  • An ad suggestion engine may enhance the advertising experience for both the author and the audience.
  • Ads in the modules herein are like the ads in a magazine— selected by the author or publisher to fit the audience and the adjacent content. The added context for these ads may result in a higher CPM for advertisers who will pay higher rates for better results and more targeted viewers.
  • the advertising can be integrated seamlessly without interrupting the viewing experience.
  • the Creator also potentially creates a new revenue stream for an author. If the author embeds a link to a site - perhaps a product that they recommend - and that click-through results in a sale, the author could get a sales commission or credit for that sale. These innovations make it much easier for an author to create a referral and get credit for that referral. This could work with all types of e-commerce ranging from catalogs to travel sites.
  • Qwiki's can include, but are not limited to, PDFs, images, video, documents, text, and other web pages. This becomes content based meta-data, not merely "tags.”
  • the Qwiki Creator is a vast improvement over online video because it "levels the playing field" when it comes to the creation of playable media. The Creator opens the door to almost anyone who wants to create playable, narrative content online without expensive equipment and steep learning curves. A low barrier to entry (i.e. time, money, skill-set) means that anyone with a story to tell and internet access - regardless of their resources - now has an authoring tool for multimedia communication.
  • the Creator also provides better opportunities for SEO and the implementation of meta-data on a website which is useful for anyone wishing to bolster their online presence in a way that is rich and engaging.
  • FIG. 8 is an illustration of a Mixed-Media Module creator dashboard consistent with certain aspects related to the innovations herein.
  • the dashboard 800 may comprise icons (options) such as creating a new Mixed-Media Module 810, and a list of existing Mixed- Media Modules 820A, 820B, 820C, 820D, among other items and options set forth below.
  • FIG. 9 is an illustration of a Mixed-Media Module creator showing aspects of removing a module consistent with certain aspects related to the innovations herein.
  • users are able to remove Mixed-Media Modules by clicking a delete button. This, for example, could prompt a notification 910 for the user to confirm deletion of a Mixed-Media Module.
  • FIG. 10 is an illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein. Referring to FIG. 10 the module is created via the navigation window 1010 that allows a user to organize and manage the Mixed-Media Module files 1020.
  • FIG. 1 1 is another illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein.
  • the Mixed-Media Module could show an icon 1 1 10 with a place to name the file 1 120 and select "create" button 1 130. This, for example, could launch the creation of the Mixed-Media Module substance.
  • FIG. 12 is another illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein. Referring to FIG.12, the user can add a cover photo and set the title, 1210 to the Mixed-Media Module.
  • FIG. 13 is another illustration of a Mixed-Media Module creator showing aspects of creating a title card consistent with certain aspects related to the innovations herein.
  • the Mixed-Media Module creation window 1310 allows users to edit different portions of the module.
  • the title section 1320 reflects the title 1322 and subtitle 1324 entry boxes.
  • the style selection bar 1330 could allow users to pick a style for the Mixed-Media Module.
  • FIG. 14 is another illustration of a Mixed-Media Module creator showing aspects of creating a media library for the first time consistent with certain aspects related to the innovations herein.
  • the media timeline section 1410 can reflect the order of the media that is organized from the general media selection area 1420 in the library.
  • the system can notify the user, as in this example, that the image selected has been added to the library, through a notification bubble 1422. Any media files can be dragged and dropped into this media selection area 1420 for use in the Mixed-Media Module.
  • the chapters can be added to via an add chapter button 1412 to designate different subtopics in the Mixed-Media Module.
  • the general media selection area of the library 1420 shows the different media files that are to be arranged in the timeline above 1410.
  • the user can select the "publish” 1440 or "preview” 1450 buttons in this example, to see their Module play.
  • the updates bar 1430 shows how many media files, animation files, and other files have been associated with this Mixed-Media Module.
  • search button 1434 that allows users to search through files to decide to drag them to the general media selection section 1420.
  • FIG. 15 is another illustration of a Mixed-Media Module creator showing aspects of media library uploading implementations consistent with certain aspects related to the innovations herein.
  • the timeline 1410 reflects what media has been included by the user.
  • the video 1528 and images 1524 are shown in this example, in the general media selection section library 1420.
  • the files are shown in a "loading" mode, as they are uploaded to the system, with an icon instead of the preview of media.
  • FIG. 16 is another illustration of a Mixed-Media Module creator showing aspects of example media library implementations, where the library is full, consistent with certain aspects related to the innovations herein.
  • the files, once loaded, are shown in the video bar 1524 and images bar 1528. These files, in this example, are shown with a preview f the media in their icon, after they have fully loaded and are ready for implementation into the Mixed-Media Module timeline.
  • FIG. 17 is another illustration of a Mixed-Media Module creator showing aspects of example media library implementations, where the library is off, consistent with certain aspects related to the innovations herein.
  • the library is not shown in this example display.
  • the media timeline section 1410 is shown without the other files, not loaded.
  • FIG. 18 is another illustration of a Mixed-Media Module creator showing aspects of example chapter 2 hover implementations consistent with certain aspects related to the innovations herein.
  • the library again shows that files loaded into the general selection section 1420, are included in the Mixed-Media Module and those that are not.
  • the image 1810 happens to be loaded into the timeline 1410. So is image 1820. Therefore, they are reflected both in the timeline 1410 and in the general selection area 1420 but there, with a check mark or other indication, acknowledging that it is included in the final presentation.
  • FIG. 19 is another illustration of a Mixed-Media Module creator showing aspects of example remove chapter implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 19, the user is able to remove a chapter if so desired.
  • a prompt 1910 can be displayed to ensure that the user knows what they are attempting to delete, and to confirm or cancel that deletion.
  • FIG. 20 is another illustration of a Mixed-Media Module creator showing aspects of example chapter 2 implementations consistent with certain aspects related to the innovations herein.
  • the Mixed-Media Module can include multiple chapters.
  • a second chapter is shown and indicated in the chapter selection bar 2010.
  • FIG. 21 is another illustration of a Mixed-Media Module creator showing aspects of example element mouse hover implementations consistent with certain aspects related to the innovations herein.
  • the user can hover the mouse or pointer or tap selector over a portion of the timeline 21 10 and that portion can be selected.
  • FIG. 22 is an illustration of a Mixed-Media Module creator showing aspects of example remove single image implementations consistent with certain aspects related to the innovations herein.
  • the user has decided to delete this picture, after selecting in as shown in FIG. 21.
  • a prompt appears 2210 to confirm that the user wishes to select the file, in this case an image, for deletion.
  • FIG. 23 is an illustration of a Mixed-Media Module creator showing aspects of example visual list mouse hover implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 23, the user can hover the mouse or pointer or tap selector, over an image and a visual list will appear 2310.
  • FIG. 24 is an illustration of a Mixed-Media Module creator showing aspects of example visual list implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 24, after the user selected an image in a visual list 2410.
  • FIG. 25 is an illustration of a Mixed-Media Module creator showing aspects of example generic error wrong mix implementations consistent with certain aspects related to the innovations herein.
  • the system rejected the attempt to mix an image and video in the same portion, for example.
  • the error notification box 2510 explains this to the user. Any number of errors could be conveyed in a similar manner.
  • FIG. 26 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example screen mouse hover implementations consistent with certain aspects related to the innovations herein.
  • the Mixed-Media Module creation window 1310 shows the Mixed-Media Module creation progress.
  • the media timeline bar 2610 shows the different media uploaded and ordered in the current presentation.
  • the user in FIG. 26 is hovering the mouse or pointer or tap selector over one particular media portion 2620 which highlights that portion, and allows for a user to delete the portion via the "x" in the corner.
  • FIG. 27 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example screen write caption implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 27, the user is also able to add a caption to each individual media portion through a media screen write window 2710.
  • FIG. 28 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example caption save implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 28 Referring to FIG. 28, the user can save the caption for each individual media portion and the system displays a notification 2810 indicating so.
  • FIG. 29 is an illustration of a Mixed-Media Module creator showing aspects of example generic error implementations where the narration is missing consistent with certain aspects related to the innovations herein.
  • the system can indicate that there is a missing narration for the Mixed-Media Module and can indicate so with a notification box 2910.
  • FIG. 30 is an illustration of a Mixed-Media Module creator showing aspects of adding example narration implementations consistent with certain aspects related to the innovations herein.
  • users can add audio narration to a Mixed-Media Module.
  • the system prompts the user to allow the microphone to be accessed by the system through a notification box 3010.
  • the user can click on the computer prompted microphone allowance button 3020.
  • the system allows the user to upload video to use as a narration.
  • FIG. 31 is an illustration of a Mixed-Media Module creator showing aspects of example narration from a media library implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 31 , the user is able to add video as narration to the Mixed-Media Module through the drag and drop box 31 10.
  • FIG. 32 is an illustration of a Mixed-Media Module creator showing aspects of example narration from a media library add implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 32, the video narration is shown uploading to the system 3210.
  • FIG. 33 is an illustration of a Mixed-Media Module creator showing aspects of enabled webcam implementations consistent with certain aspects related to the innovations herein.
  • the user is able to record video and or audio from an attached webcam.
  • the system prompts the user to hit a start recording button 3310 and shows the user the webcam video in a preview window 3320.
  • FIG. 34 is an illustration of a Mixed-Media Module creator showing aspects of example countdown and instruction implementations consistent with certain aspects related to the innovations herein.
  • the system prompts the user to prepare to record the video from the webcam by a countdown display timer 3410.
  • the user is able to restart the timer using a spacebar, as explained in the window 3420. Further, the user is able to navigate using the arrow keys as shown 3430.
  • FIG. 35 is an illustration of a Mixed-Media Module creator showing aspects of an example first image implementations consistent with certain aspects related to the innovations herein.
  • the Mixed-Media Module shows the first image of the presentation 3510.
  • the timer is also shown as counting up as the Mixed-Media Module plays through 3520.
  • the record light is shown 3530 as well.
  • FIG. 36 is an illustration of a Mixed-Media Module creator showing aspects of an example second image implementations consistent with certain aspects related to the innovations herein.
  • a second image 3610 is shown as the Mixed-Media Module progresses. The user is still narrating the video as it plays back and the timer 3520 progresses..
  • FIG. 37 is an illustration of a Mixed-Media Module creator showing aspects of an example third image implementations consistent with certain aspects related to the innovations herein.
  • a third image 3710 is shown as the Mixed-Media Module progresses. The user is still narrating the video as it plays back and the timer 3520 progresses.
  • FIG. 38 is an illustration of a Mixed-Media Module creator showing aspects of an example visual list implementations consistent with certain aspects related to the innovations herein.
  • FIG. 39 is an illustration of a Mixed-Media Module creator showing aspects of an example last image of a visual list implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 39, a last image 3910 is shown as the Mixed-Media Module finishes.
  • FIG. 40 is an illustration of a Mixed-Media Module creator showing aspects of example processing and soundtrack implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 40, the soundtrack selection window 4010, allows users to choose an audio track for the Mixed-Media Module playback. Different audio tracks are displayed for the user to select in a categorized manner 4020.
  • the soundtracks could take any number of variations and could be displayed in many ways, in a drop down menu, in a list, in a mosaic, etc.
  • FIG. 39 is an illustration of a Mixed-Media Module creator showing aspects of an example last image of a visual list implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 39, a last image 3910 is shown as the Mixed-Media Module finishes.
  • FIG. 40
  • FIG. 41 is an illustration of a Mixed-Media Module creator showing aspects of example implementations where users are allowed to upload their own files consistent with certain aspects related to the innovations herein.
  • the hard drive or networked drives of the user's computer are accessed through the system 41 10. Users can select a file to upload to their Mixed-Media Module through this example interface.
  • FIG. 42 is an illustration of a Mixed-Media Module creator showing aspects of example implementations where users are allowed to play their own files consistent with certain aspects related to the innovations herein.
  • the user is able to start to play an audio file, as shown in the selected list 4210.
  • the display also allows users to begin to play back the Mixed-Media Module by selecting the "play" button 4220.
  • FIG. 43 is an illustration of a Mixed-Media Module creator showing aspects of example preview implementations consistent with certain aspects related to the innovations herein.
  • the example preview screen shows the playing back Mixed-Media Module 4310.
  • the images are shown 4320 as well as the narration video 4330.
  • the system displays topics that a user can select to delve more deeply into a particular subject
  • These selectable topics relate to different aspects of the overall Mixed-Media Module and allow for additional windows to pop open for a user to view that selected material. Other embodiments include the ability to navigate through different selectable topics within the Mixed- Media Module display itself. Further, the progress bar at the bottom of the Mixed-Media Module preview screen 4350 shows the location of the currently playing back Mixed-Media Module. Generalized topic names within the process bar indicate the chapter location in the module, in this example, "the city,” “nightlife,” and "karaoke” chapters.
  • FIG. 44 is an illustration of a Mixed-Media Module creator showing aspects of example preview implementations, where the preview narration is missing, consistent with certain aspects related to the innovations herein.
  • the Mixed-Media Module example shows that the narration portion is missing through a notification 4410. The user can, to help finalize the Mixed-Media Module, record a narration by clicking the icon 4410.
  • FIG. 45 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
  • an example Gesture is shown consistent with aspects of the innovations herein.
  • systems and methods herein may be configured to respond to a user tap or click of an object in the grid or in the feed to open another Mixed-Media Module, webpage, video, or detailed animation in an overlay over the current screen.
  • some embodiments include methods wherein the interaction includes a tap of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
  • FIG. 46 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
  • another example Gesture is shown consistent with aspects of the innovations herein.
  • a user can pinch into an object in the grid to see detailed or related information on the object including source, related media, access interactive animations, view full video, read full article, and the like.
  • some embodiments include methods wherein interactions include a pinch of a portion, button or link of the selected multimedia presentation used in the generation of a search results page.
  • FIG. 47 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
  • FIG. 47 another example Gesture is shown, consistent with aspects of the innovations herein.
  • systems and methods herein may be configured such that a user can tap or click and hold on an element in the grid or in the feed to provide various or additional options.
  • options may include, though are not limited to, open now, queue for later, add to favorites, etc.
  • some embodiments include methods wherein interactions include a tap and hold of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
  • FIG. 48 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
  • FIG. 48 another example Gesture is shown consistent with aspects of the innovations herein.
  • a user can swipe or scroll with one finger left or right over the grid to advance or rewind the presentation of the mixed-media.
  • some embodiments include methods wherein interactions include a swipe or scroll of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
  • the mixed-media modules are specifically configured such that the end user is not required to experience the module in a linear fashion.
  • a user can readily jump to different collections of media once a quick scan assures them the present set of options do not include anything they wish to see further, know more about, etc.
  • Modules may also be configured such that users can also choose their path through the content by clicking on hyperlinks (meta-data) within the mixed-media module. This allows the end-user to explore the information that is of the most interest to them, in greater detail and in their preferred format (i.e. text, photos, or video).
  • Innovations herein also work across multiple platforms. For example, mixed-media module interactive components herein can run inside a standard web browser and its player software can be integrated into mobile devices, TV devices, video game units, etc. Further, such mixed-media module(s) may be configured as a universal component across all media and devices.
  • the mobile wireless devices can be touch screen enabled, using a stylus or finger or other such thing to interact with the screen, and objects on the screen.
  • the touch screen enabled technologies also allow for pinching in or out to zoom in or out or enlarge or shrink an object or the display. Sliding a touch can scroll either in vertical or horizontal directions, or any other direction supported by the system.
  • the touch screens can also detect a prolonged tap, opening further functionality when a prolonged tap and hold occurs on an object.
  • Such functionality can be accomplished by a cursor or pointer of some sort, typically controlled by a mouse, pointer stick, roller ball, etc.
  • a cursor or pointer of some sort typically controlled by a mouse, pointer stick, roller ball, etc.
  • There may be additional functionality embedded into the display objects to allow for some of the functionality such as a scroll bar or zoom buttons, etc.
  • each module can be implemented as a software program stored on a tangible memory (e.g., random access memory, read only memory, CD-ROM memory, hard disk drive) within or associated with the computing elements, sensors, receivers, etc. disclosed above, e.g., to be read by a processing unit to implement the functions of the innovations herein.
  • the modules can comprise programming instructions transmitted to a general purpose computer or to processing hardware via a transmission carrier wave.
  • the modules can be implemented as hardware logic circuitry implementing the functions
  • modules can be implemented using special purpose instructions (SIMD instructions), field programmable logic arrays or any mix thereof which provides the desired level performance and cost.
  • SIMD instructions special purpose instructions
  • implementations and features of the invention may be implemented through computer-hardware, software and/or firmware.
  • the systems and methods disclosed herein may be embodied in various forms including, for example, a data processor, such as a computer that also includes a database, digital electronic circuitry, firmware, software, or in combinations of them.
  • components such as software, systems and methods consistent with the innovations herein may be implemented with any combination of hardware, software and/or firmware.
  • aspects of the method and system described herein may be implemented as functionality programmed into any of a variety of circuitry, including programmable logic devices (“PLDs”), such as field programmable gate arrays (“FPGAs”), programmable array logic (“PAL”) devices, electrically programmable logic and memory devices and standard cell-based devices, as well as application specific integrated circuits.
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • PAL programmable array logic
  • electrically programmable logic and memory devices and standard cell-based devices as well as application specific integrated circuits.
  • Some other possibilities for implementing aspects include: memory devices, microcontrollers with memory (such as EEPROM), embedded microprocessors, firmware, software, etc.
  • aspects may be embodied in microprocessors having software-based circuit emulation, discrete logic (sequential and combinatorial), custom devices, fuzzy (neural) logic, quantum devices, and hybrids of any of the above device types.
  • the underlying device technologies may be provided in a variety of component types, e.g., metal-oxide
  • MOSFET semiconductor field-effect transistor
  • CMOS complementary metal-oxide semiconductor
  • ECL emitter-coupled logic
  • polymer technologies e.g., silicon-conjugated polymer and metal-conjugated polymer-metal structures
  • mixed analog and digital and so on.
  • CMOS complementary metal-oxide semiconductor
  • ECL emitter-coupled logic
  • polymer technologies e.g., silicon-conjugated polymer and metal-conjugated polymer-metal structures
  • mixed analog and digital and so on.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Systems and methods consistent with the present innovations are directed to implementations involving creation, viewing, playing, sharing and/or utilization of information modules, such as mixed-media modules.

Description

SYSTEMS AND METHODS INVOLVING FEATURES OF CREATION/VIEWING/ UTILIZATION OF INFORMATION MODULES
CROSS-REFERENCE TO RELATED APPLICATIONS
This application claims benefit/priority of U.S. provisional patent application No. 61/578,209 filed 20 December 201 1 , which is incorporated herein by reference in entirety.
BACKGROUND
Field:
Aspects of the present innovations relate to information modules, and, more particularly, to associated systems and methods, such as those involving creation, viewing and/or utilization of mixed-media modules.
Description of Related Information:
At the moment, narrative - or playable - content on the internet primarily exists in the form of streaming video. This poses several problems for content creators. First of all, media consumers are sophisticated and recognize the difference between professionally produced video projects and amateur ones. Most consumer devices display High Definition video and most people are used to seeing that level of quality in media they consume. Therefore, a producer of online content must invest significant time and money to create video content at the level to which consumers have grown accustomed. Producing video is time-consuming, expensive and often requires specialized skills. For example, a video editor might spend hours editing just five minutes of video. Production often entails a professional production crew, on- camera talent, and equipment such as a professional lighting kit, high-end cameras, and audio gear.
The video post-production process is also time-consuming. Editing requires expensive software, a skilled editor with technical and story-telling skills, and, possibly, the hiring of a graphic designer, special effects artist and/or narrator. Editing software also utilizes a lot of computing resources, typically requiring sophisticated, expensive and fast computing/storage equipment. There is also a high learning curve when it comes to using any of these editing tools and each piece of software usually requires a large financial commitment.
Another complication with video production is that the audio tracks are often recorded and edited separately from the video tracks and the two (or more than two) must be synchronized and edited into one timeline. This can be laborious and time-consuming. Moreover, if needed, animation is costly, often proprietary, and difficult to produce. It often requires specific software in addition to the software used for editing. Video and animation files are large and
cumbersome which means that a powerful computer, with a great deal of storage space, is needed. Finally, the amount of time it takes for the software to render a final product also adds to the overall time and expense. Once a video is complete it is difficult to make changes. This is a problem because, without updates, video is outdated quickly. Re-editing a video is time- consuming and complicated and there is no way to integrate "live data" or "updatable components." Video is also bandwidth-heavy when streaming on the web and does not play in an acceptable manner over a poor internet connection.
Additionally, video is a stand-alone, self-contained, linear medium. It is not interactive and it is difficult to embed a layer of meta-data which would make it interactive. For instance, it is not easy for a content producer to link on-screen content to information elsewhere on the web. While a video may contain motion graphics, still photos or animations, it cannot display PDF files, text files and links to other content in a way that is useful for the audience. Nor is it easy to create "chapters." For example, in a YouTube video a viewer cannot jump ahead to a specific chapter or section within the video. Any content that is embedded is "locked in" and is not easy to move or change. It can't contain links embedded into player for a true interactive experience. In sum, many such issues stem from the requirement that it be rendered (or re-rendered). As such, the creator of the content cannot easily link a video back to their own site so their only option is to place that information in the credits along with any other links they may wish to share.
Once a video is complete it may not reach everyone in the intended audience. For one thing, video is tough to view on mobile devices which are optimized for portability rather than processing power. Animations, in particular, are not compatible with all mobile platforms (i.e. iOS, Android, Blackberry, flash/non-flash) which means that potential audience members are excluded.
Advertising connected to video is also not ideal because it interrupts the flow of the video.
Advertising in the pre-roll of a video prevents a user from getting to the content quickly, post-roll advertising is easy to ignore and if ads are inserted into the middle of content it is annoying and disruptive. One negative result of video advertising or banner ads is that it can send a viewer on a detour away from their desired content. Another option, banner or overlay ads, completely disrupt the user's experience, appear cheap, have no visual relevance and reflect poorly on the advertiser. None of these ads are related to the content or relevant to the user. As a result, the advertising mostly annoys the user, isn't helpful and doesn't have a great return on investment (ROI) for the advertiser. This is reflected by the low click-through rates on web ads.
Yet another challenge is that, without human curation, video is complicated to search and requires highly intelligent, algorithm-based content scanning systems to "tag" content as a specific category. This is time consuming, not always accurate and would be improved if there were a way for meta-data from the embedded content to be included in the content. Most systems are reliant on user input, like PageRank, which is impossible to scale in video. There is a need for a richer, searchable set of data.
As such, there is a need for systems and methods that address the above drawbacks an/or provide other beneficial functionality or advantages to parties involved with creating, viewing, sharing and/or utilizing such information modules.
SUMMARY
Systems and methods consistent with the present innovations are directed to implementations involving creation, viewing, playing, sharing and/or utilization of information modules, such as mixed-media modules. Embodiments herein are directed to web-based tools for editing content into a rich, mixed-media capable, interactive components, or "mixed-media modules". In regard to content that is already edited together into such modules, other embodiments herein are directed to a "Player" configured to present coordinated text, images, documents, narrations and links all available in one or more, interactive screen format(s) and/or window(s). These Player implementations may be embedded into mobile devices and appliances, played on a webpage, or integrated into various other processing environments.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the inventions, as described. Further features and/or variations may be provided in addition to those set forth herein. For example, the present inventions may be directed to various combinations and subcombinations of the disclosed features and/or combinations and subcombinations of several further features disclosed below in the detailed description.
DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which constitute a part of this specification, illustrate various implementations and features of the present inventions and, together with the description, explain aspects of innovations herein. In the drawings: FIG. 1 is a box diagram of an illustrative web or network-based implementations consistent with certain aspects related to the innovations herein.
FIG. 2 is an exemplary screenshot showing an illustrative mobile device display including a search engine results page with integrated mixed-media component consistent with certain aspects related to the innovations herein.
FIG. 3 is an illustration of an exemplary search engine results page showing user action with a mobile device display search results page consistent with certain aspects related to the innovations herein.
FIG. 4 is an exemplary screenshot illustrating further mobile device display functionality consistent with certain aspects related to the innovations herein.
FIG 5 is an exemplary screenshot illustrating mobile device display of a search results content such as a mixed-media module consistent with certain aspects related to the innovations herein.
FIG 6 is an exemplary screenshot of an illustrative mobile device display showing user interaction with a mixed-media module from the search results consistent with certain aspects related to the innovations herein.
FIG 7 is an exemplary screenshot of a mobile device display showing an illustrative result of a user interaction consistent with certain aspects related to the innovations herein.
FIG. 8 is an illustration of a Mixed-Media Module creator dashboard consistent with certain aspects related to the innovations herein.
FIG. 9 is an illustration of a Mixed-Media Module creator showing aspects of removing a module consistent with certain aspects related to the innovations herein.
FIG. 10 is an illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein.
FIG. 1 1 is another illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein.
FIG. 12 is another illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein.
FIG. 13 is another illustration of a Mixed-Media Module creator showing aspects of creating a title card consistent with certain aspects related to the innovations herein. FIG. 14 is another illustration of a Mixed-Media Module creator showing aspects of creating a media library for the first time consistent with certain aspects related to the innovations herein.
FIG. 15 is another illustration of a Mixed-Media Module creator showing aspects of media library uploading implementations consistent with certain aspects related to the innovations herein. FIG. 16 is another illustration of a Mixed-Media Module creator showing aspects of example media library implementations, where the library is full, consistent with certain aspects related to the innovations herein.
FIG. 17 is another illustration of a Mixed-Media Module creator showing aspects of example media library implementations, where the library is off, consistent with certain aspects related to the innovations herein.
FIG. 18 is another illustration of a Mixed-Media Module creator showing aspects of example chapter 2 hover implementations consistent with certain aspects related to the innovations herein.
FIG. 19 is another illustration of a Mixed-Media Module creator showing aspects of example remove chapter implementations consistent with certain aspects related to the innovations herein.
FIG. 20 is another illustration of a Mixed-Media Module creator showing aspects of example chapter 2 implementations consistent with certain aspects related to the innovations herein.
FIG. 21 is another illustration of a Mixed-Media Module creator showing aspects of example element mouse hover implementations consistent with certain aspects related to the innovations herein.
FIG. 22 is an illustration of a Mixed-Media Module creator showing aspects of example remove single image implementations consistent with certain aspects related to the innovations herein.
FIG. 23 is an illustration of a Mixed-Media Module creator showing aspects of example visual list mouse hover implementations consistent with certain aspects related to the innovations herein.
FIG. 24 is an illustration of a Mixed-Media Module creator showing aspects of example visual list implementations consistent with certain aspects related to the innovations herein. FIG. 25 is an illustration of a Mixed-Media Module creator showing aspects of example generic error wrong mix implementations consistent with certain aspects related to the innovations herein.
FIG. 26 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example screen mouse hover implementations consistent with certain aspects related to the innovations herein.
FIG. 27 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example screen write caption implementations consistent with certain aspects related to the innovations herein.
FIG. 28 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example caption save implementations consistent with certain aspects related to the innovations herein.
FIG. 29 is an illustration of a Mixed-Media Module creator showing aspects of example generic error implementations where the narration is missing consistent with certain aspects related to the innovations herein.
FIG. 30 is an illustration of a Mixed-Media Module creator showing aspects of adding example narration implementations consistent with certain aspects related to the innovations herein.
FIG. 31 is an illustration of a Mixed-Media Module creator showing aspects of example narration from a media library implementations consistent with certain aspects related to the innovations herein.
FIG. 32 is an illustration of a Mixed-Media Module creator showing aspects of example narration from a media library add implementations consistent with certain aspects related to the innovations herein.
FIG. 33 is an illustration of a Mixed-Media Module creator showing aspects of enabled webcam implementations consistent with certain aspects related to the innovations herein.
FIG. 34 is an illustration of a Mixed-Media Module creator showing aspects of example countdown and instruction implementations consistent with certain aspects related to the innovations herein.
FIG. 35 is an illustration of a Mixed-Media Module creator showing aspects of an example first image implementations consistent with certain aspects related to the innovations herein. FIG. 36 is an illustration of a Mixed-Media Module creator showing aspects of an example second image implementations consistent with certain aspects related to the innovations herein.
FIG. 37 is an illustration of a Mixed-Media Module creator showing aspects of an example third image implementations consistent with certain aspects related to the innovations herein.
FIG. 38 is an illustration of a Mixed-Media Module creator showing aspects of an example visual list implementations consistent with certain aspects related to the innovations herein.
FIG. 39 is an illustration of a Mixed-Media Module creator showing aspects of an example last image of a visual list implementations consistent with certain aspects related to the innovations herein.
FIG. 40 is an illustration of a Mixed-Media Module creator showing aspects of example processing and soundtrack implementations consistent with certain aspects related to the innovations herein.
FIG. 41 is an illustration of a Mixed-Media Module creator showing aspects of example implementations where users are allowed to upload their own files consistent with certain aspects related to the innovations herein.
FIG. 42 is an illustration of a Mixed-Media Module creator showing aspects of example implementations where users are allowed to play their own files consistent with certain aspects related to the innovations herein.
FIG. 43 is an illustration of a Mixed-Media Module creator showing aspects of example preview implementations consistent with certain aspects related to the innovations herein.
FIG. 44 is an illustration of a Mixed-Media Module creator showing aspects of example preview implementations, where the preview narration is missing, consistent with certain aspects related to the innovations herein.
FIG. 45 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
FIG. 46 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
FIG. 47 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein. FIG. 48 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein.
DETAILED DESCRIPTION OF ILLUSTRATIVE IMPLEMENTATIONS
Reference will now be made in detail to the invention, examples of which are illustrated in the accompanying drawings. The implementations set forth in the following description do not represent all implementations consistent with the claimed invention. Instead, they are merely some examples consistent with certain aspects related to the invention. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
According to some implementations, systems and methods consistent with the innovations herein are directed to creation, viewing, playing, sharing and/or utilization of information modules, such as mixed-media modules. For example, aspects herein involve innovative aspects of a rich, mixed-media, interactive components, as also sometimes referred to in places herein via the 'Qwiki'™ brand component or module. In some implementations, this component or module may be an interactive narrative presentation of media and/or content and it may feature an interactive layer configured to allow viewers to receive more detailed information from within the information module.
FIG. 1 is a box diagram of an illustrative web or network-based implementations consistent with certain aspects related to the innovations herein. While the description of FIG. 1 shows various elements, the components of the system can be implemented through any suitable unitary or distributed combination of hardware, software and/or firmware. Referring to FIG. 1 , the illustrated system may include a mixed-media module ("MMM") component 160, users at access devices 121 (e.g., one or more of access devices 121A-121 D), one or more connectivity components 125A 125B, as well as possibly other unitary, connected, interconnected or distributed processing entities or components such as additional providers 165 such as network management components, content servers 130, ad components 140, service/business components 150, and other third party servers or components 155, all connected over a network 170. The mixed-media module component 160 may, in some implementations, be the web-based creation and/or playing/viewing tool for handling certain mixed-media module innovations herein. According to some implementations, systems and methods associated with creation of information modules herein may be web-based tools for editing online content into a rich, mixed- media capable, interactive component referred to as a "mixed-media module." In one illustrative implementation, for example, there is provided a web-based method for creating mixed-media modules comprising providing an interface operable by a user to access a web-based information module creator engine/component(s), providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media, providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface, and generating a mixed-media module via integration of the selected content into a playable presentation of the content. Further, the playable mixed-media module may be configured such that the mixed-media module comprises of a plurality of image media elements connected in sequence as well as two or more types of media content selected from text, hyperlink, image, audio, document and video.
With respect to media thereby assembled into such modules, other embodiments herein are directed to "Player" implementations configured to present coordinated text, images,
documents, narrations and links all available in one or more, interactive screen format(s) and/or window(s). These Player implementations may be embedded into mobile devices and appliances, played on a webpage, or integrated into various other processing environments. In one illustrative implementation, for example, there is provided a web-based method for utilizing mixed-media modules, comprising providing an interface operable a user to access a web- based information module utilizing engine/component(s), providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation, and providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content. Here, again, the mixed-media module may comprises of a plurality of image media elements connected in sequence as well as two or more types of media content selected from text, hyperlink, image, audio, document and video.
Further implementations may be configured such that the user may interact with the mixed- media module and/or associated content configured to provide access to at least one of additional third party information, sites, content, applications and/or other multimedia. Systems and methods of mixed-media module creation and playing give online content producers tools to create a professional looking presentation without the time and expense of video. Implementations allow "media editing in the cloud," but innovations herein also go beyond straightforward web or cloud advantages. Authors of information modules herein can create an audio-visual presentation by compiling multimedia content (photos, videos, documents, maps, etc), from their devices or across the web, into a creator application
("Creator") available via the web or downloaded onto their device. Here, for example, the author can "drag and drop" the desired content into the Creator and build a "playable" presentation, as explained in more detail below. That presentation may be viewed much like video and may include a linear story line, but it is improves upon video technology because the audience is not required to experience the module in a linear fashion. The technology is innovative for content producers because - unlike video - they do not merely create a finite, linear presentation. The Creator allows an author to create a limitless and updatable, searchable story within the compact, module or component. For example, an author may edit a module that plays for three minutes from start to finish, but contains thirty minutes of searchable content.
In some implementations, once a mixed-media module has been created, the Player may derive a layer of interactivity from individual pieces of content which are linked to their original sources on the web. This means that a viewer can either watch a mixed-media module in a linear format or they can self-select a path through the content by clicking on hyperlinks within the Qwiki. The viewer is able to explore the information that is of the most interest to them, in greater detail, and in their preferred format (i.e. text, photos, or video). Further, according to some systems and methods herein, Creator/Player implementations may innovative over existing systems due to the information density and mixed-media/multimedia capabilities of the mixed-media module component(s).
Further integrations of such components with search results also involve creation of new ad units (and thereby, in some implementations, new sources of revenue) inside of the mixed- media interactive summary, as explained further below.
Consistent with certain implementations, another way systems and methods herein may depart from the traditional media experiences, especially from online video, is that the end user does not have to experience the mixed-media module in a linear fashion. The user can choose their path through the content with various functionality, such as clicking on hyperlinks within the mixed-media module, via navigation functionality/gestures, and the like. This allows the end- user to explore the information that is of the most interest to them, in greater detail and in their preferred format, e.g., text, photos, video, etc.
In addition to the display of related media/links in a new window on the same page, further implementations provide functionality to display associated content on the same page by instantly modifying it or the contents around it. Here, for example, this new integrated content may be displayed without triggering new tabs.
Especially in view of the issued with traditional video content noted above, systems and methods herein are an improvement on other rich media such as online video technology because they use less bandwidth, are easily customizable, flexible, incorporate interactive video, images, text and other types of media.
In still other exemplary embodiments herein, mixed-media module integrated implementations can incorporate interactive images, text and other types of media. Further, given such implementations operate without large-bandwidth video transmissions especially rendered video content for audiovisual/multimedia experience, systems and methods herein provide improved functionality between mixed media and mobile devices, thus allowing for quicker loads and consumption of less bandwidth during utilization.
Referring now to FIGs. 2-7, implementations herein with mixed-media module integrations involving video can yield improved/higher quality on mobile devices, consistent with aspects of the innovations herein. Such implementations may be web-based or downloadable applications downloaded to the mobile device. In one illustrative implementation, for example, there is provided a method for providing a downloadable application for creating mixed-media modules, the method comprising providing an executable application for download to a user device, the executable application configured for providing an interface operable by a user to execute an information module creator engine/component(s), providing interactive functionality, via the interface, to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media, providing interactive functionality, via the interface, to allow the user to edit the content and/or presentation of the content via the interface, and generating a mixed-media module via integration of the selected content into a playable presentation of the content configured for low-bandwidth and/or non- rendered utilization to facilitate display on a mobile device. Additionally, given the flexible and non-rendered nature of the mixed-media modules, streaming and picture quality can be easily optimized for specific mobile devices. Further, such implementations allow ease of interactions by providing a standard universal layer for interactivity. In other embodiments, systems and methods herein may include features and implementations involving interactive and coordinated hyperlinks for deeper exploration of the content within the embedded media— this feature of coordinating links/content inside of the mixed-media module interactive summary allow new attribution and monetization capabilities by content creators and other entities involved with handling the underlying module(s).
Here, it should be noted that a "mobile device" can be any kind of smartphone, tablet computer, laptop, notebook, or any kind of similar device. These devices are typically touch screen enabled and retain internet connectivity through either a shorter range radio such as those used in WiFi technologies, or through cellular telephone connections, or both. The device may connect to the internet in any fashion.
FIG. 2 depicts an illustrative web page involving a mixed-media module implementation, formatted for a mobile smartphone or tablet computer, consistent with aspects of the
innovations herein. As shown, for example, an illustrative "Play Qwiki module" icon is shown directly beneath an associated piece of identifying textual information, here, a search result in a search result screen.
FIG. 3 is an illustration of the web page of Figure 2 showing the integration of touch-enable functionality consistent with aspects of the innovations herein. In FIG. 3, a user is shown tapping the "Play Qwiki module" icon using their finger. Touch enabled screens allow such interaction with a stylus or other such device as well, while such features may be navigated with various cursor-based functionality, as well.
FIG. 4 is an illustration of exemplary mobile device display and functionality consistent with aspects of the innovations herein. In the example of FIG 4, the mobile smartphone may be rotated to initiate a specified function associated with mixed-media module creation and/or playing, or to transition between landscape display and portrait display, among other functions.
FIG. 5 is an exemplary screenshot showing mobile device display of an illustrative mixed-media module consistent with certain aspects related to the innovations herein. FIG 6 is an exemplary screenshot of an illustrative mobile device display showing user interaction with a mixed-media module from the web page consistent with certain aspects related to the innovations herein. Figure 6 shows a user interacting with a portion of the mixed-media module, here tapping the particular media or object with respect to which additional content (details, information, etc) or further functionality is desired. As set forth elsewhere herein, associated servers or engines may be configured to interoperate with such action in a variety of ways. FIG 7 is an exemplary screenshot of a mobile device display showing an illustrative result of a user interaction consistent with certain aspects related to the innovations herein. Here, this example shows an illustrative re-direct associated with the tapped object to a particular web page. The result shows a multimedia text and image or video within the web page.
Turning to some more general aspects, an illustrative multimedia presentation herein may be configured as an interactive system of mixed-media/interactive content with clickable components. These mixed-media modules may also provides visual relevancy - the multimedia nature of such interactive component provides more in-depth detail of a topic than text alone.
In accordance with aspects of the present innovations, mixed-media module interactive summaries as integrated herein are lightweight - they use less bandwidth than pure video and are a rich, interactive, multi-media experience. Viewing such mixed-media module is faster and easier than video alone because they are interactive and have more discrete sets of contents that can easily be traversed beyond a simple play bar associated with most traditional video. Mixed-media modules herein also contain more information (meta-data) than video because of its multitude of components (mixed media), interactive nature and because of being configured to be interactive with users/viewers.
According to certain aspects, creator implementations allow an author to create interactive, meta-data rich, playable content for the web. These implementations are intuitive to use, thus demand only a low-learning curve. The creator is touch-enabled, such as via gestrures (see below) for mobile devices and the interface is "drag and drop" for ease of use, as explained further below.
Easy coordination and timing of the audio and video tracks are other innovative features of the Creator. This includes a "talking head" narrator who can be filmed on a laptop or mobile phone camera. Because it is simple to time a "talking head" or narrator's voice with a visual, mixed- media presentation and there is no need to edit it in a complicated video timeline. Additionally, there are custom filters for the creation of special effects and graphics which are simple to use. The drag-and-drop editing that makes the Creator easy to use also means that it is simple to grab photos and images from a mobile device or online photo sharing site. Another advantage to the Creator is that is can be used collaboratively, especially implementations stored in the cloud. Implementations are also easy to update and change at any point because the content isn't "locked in" (rendered) like video. In essence, an online content producer can create a professional looking presentation without the time and expense of video.
Unlike traditional video production (mixed-media modules herein are not video), the interactive component requires no lengthy production process or rendering time. It's much lighter weight than video because it uses up five times less bandwidth. The individual elements within a module are not hosted on the server of an author, instead the preview may be stored on local servers for guaranteed availability. The images and files may be linked to the original source. The Creator allows an author to link to content in its original location which solves storage problems and possibly helps preserve the owners copyright protection. The Creator also offers an animation platform that includes a custom graphics tool with no rendering issues as with traditional video. The processing of the animation is also off-loaded to device playing back the module which means precious bandwidth is preserved - this is especially valuable when playing on mobile devices.
Content creators can add depth to the narrative presentation in a way that is not possible with video. The module can be viewed as a linear story, but the embedded and coordinated links mean that the audience can self-select its path through the module. For example, there is currently no method for including hyperlinks with online video. The producer of a video cannot link to a partner site, get credit for referring customers to an ecommerce site or, simply, strengthen their content with references via hyperlinks. "Chaptering" is another technology that enhances the experience of creating and viewing a mixed-media module. The author can divide a Qwiki into chapters - something that is not easily possible with streaming video - and give the audience the ability to easily jump around and navigate through the content. The Creator gives an author the tools to do all of these things via editor tools, explained below.
The "choose your own adventure" style of viewing a module herein also means that advertising can be more sophisticated with such products. The path a viewer chooses through the hyperlinks can determine the type of advertising they see because it builds a consumption profile. Advertising can also be targeted more effectively as the author may have control over the types of advertising viewed by their audience. An ad suggestion engine may enhance the advertising experience for both the author and the audience. Ads in the modules herein are like the ads in a magazine— selected by the author or publisher to fit the audience and the adjacent content. The added context for these ads may result in a higher CPM for advertisers who will pay higher rates for better results and more targeted viewers. Also, the advertising can be integrated seamlessly without interrupting the viewing experience.
The Creator also potentially creates a new revenue stream for an author. If the author embeds a link to a site - perhaps a product that they recommend - and that click-through results in a sale, the author could get a sales commission or credit for that sale. These innovations make it much easier for an author to create a referral and get credit for that referral. This could work with all types of e-commerce ranging from catalogs to travel sites.
Another advantage to systems and methods herein is their cross-platform capabilities. Because the present implementations work across platforms it will result in the wider consumption of information on sites that contain a module. It has auto-resize for different screens and internet connections - it doesn't simply rely on compression - which results in a product that is more easily viewed. Mobile device users, in particular, will find it easier to view modules herein.
Qwiki's can include, but are not limited to, PDFs, images, video, documents, text, and other web pages. This becomes content based meta-data, not merely "tags." The Qwiki Creator is a vast improvement over online video because it "levels the playing field" when it comes to the creation of playable media. The Creator opens the door to almost anyone who wants to create playable, narrative content online without expensive equipment and steep learning curves. A low barrier to entry (i.e. time, money, skill-set) means that anyone with a story to tell and internet access - regardless of their resources - now has an authoring tool for multimedia communication. The Creator also provides better opportunities for SEO and the implementation of meta-data on a website which is useful for anyone wishing to bolster their online presence in a way that is rich and engaging.
FIG. 8 is an illustration of a Mixed-Media Module creator dashboard consistent with certain aspects related to the innovations herein. Referring to FIG. 8, the dashboard 800 may comprise icons (options) such as creating a new Mixed-Media Module 810, and a list of existing Mixed- Media Modules 820A, 820B, 820C, 820D, among other items and options set forth below.
FIG. 9 is an illustration of a Mixed-Media Module creator showing aspects of removing a module consistent with certain aspects related to the innovations herein. Referring to FIG. 9, users are able to remove Mixed-Media Modules by clicking a delete button. This, for example, could prompt a notification 910 for the user to confirm deletion of a Mixed-Media Module. FIG. 10 is an illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein. Referring to FIG. 10 the module is created via the navigation window 1010 that allows a user to organize and manage the Mixed-Media Module files 1020.
FIG. 1 1 is another illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein. Referring to FIG. 1 1 , once the file is selected, the Mixed-Media Module could show an icon 1 1 10 with a place to name the file 1 120 and select "create" button 1 130. This, for example, could launch the creation of the Mixed-Media Module substance.
FIG. 12 is another illustration of a Mixed-Media Module creator showing aspects of creating a module consistent with certain aspects related to the innovations herein. Referring to FIG.12, the user can add a cover photo and set the title, 1210 to the Mixed-Media Module.
FIG. 13 is another illustration of a Mixed-Media Module creator showing aspects of creating a title card consistent with certain aspects related to the innovations herein. Referring to FIG.13, the Mixed-Media Module creation window 1310, allows users to edit different portions of the module. The title section 1320 reflects the title 1322 and subtitle 1324 entry boxes. Further, the style selection bar 1330 could allow users to pick a style for the Mixed-Media Module.
FIG. 14 is another illustration of a Mixed-Media Module creator showing aspects of creating a media library for the first time consistent with certain aspects related to the innovations herein. Referring to FIG.14, the media timeline section 1410 can reflect the order of the media that is organized from the general media selection area 1420 in the library. The system can notify the user, as in this example, that the image selected has been added to the library, through a notification bubble 1422. Any media files can be dragged and dropped into this media selection area 1420 for use in the Mixed-Media Module.
Continuing with FIG. 14, the chapters can be added to via an add chapter button 1412 to designate different subtopics in the Mixed-Media Module. Further, the general media selection area of the library 1420 shows the different media files that are to be arranged in the timeline above 1410. Once completed, the user can select the "publish" 1440 or "preview" 1450 buttons in this example, to see their Module play. Also, the updates bar 1430 shows how many media files, animation files, and other files have been associated with this Mixed-Media Module. There is also a search button 1434 that allows users to search through files to decide to drag them to the general media selection section 1420. FIG. 15 is another illustration of a Mixed-Media Module creator showing aspects of media library uploading implementations consistent with certain aspects related to the innovations herein. Referring to FIG.15, the timeline 1410 reflects what media has been included by the user. The video 1528 and images 1524 are shown in this example, in the general media selection section library 1420. The files are shown in a "loading" mode, as they are uploaded to the system, with an icon instead of the preview of media.
FIG. 16 is another illustration of a Mixed-Media Module creator showing aspects of example media library implementations, where the library is full, consistent with certain aspects related to the innovations herein. Referring to FIG.16, the files, once loaded, are shown in the video bar 1524 and images bar 1528. These files, in this example, are shown with a preview f the media in their icon, after they have fully loaded and are ready for implementation into the Mixed-Media Module timeline.
FIG. 17 is another illustration of a Mixed-Media Module creator showing aspects of example media library implementations, where the library is off, consistent with certain aspects related to the innovations herein. Referring to FIG.17, the library is not shown in this example display. The media timeline section 1410 is shown without the other files, not loaded.
FIG. 18 is another illustration of a Mixed-Media Module creator showing aspects of example chapter 2 hover implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 18, the library again shows that files loaded into the general selection section 1420, are included in the Mixed-Media Module and those that are not. For example, the image 1810 happens to be loaded into the timeline 1410. So is image 1820. Therefore, they are reflected both in the timeline 1410 and in the general selection area 1420 but there, with a check mark or other indication, acknowledging that it is included in the final presentation.
FIG. 19 is another illustration of a Mixed-Media Module creator showing aspects of example remove chapter implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 19, the user is able to remove a chapter if so desired. A prompt 1910 can be displayed to ensure that the user knows what they are attempting to delete, and to confirm or cancel that deletion.
FIG. 20 is another illustration of a Mixed-Media Module creator showing aspects of example chapter 2 implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 20, the Mixed-Media Module can include multiple chapters. In FIG. 20, a second chapter is shown and indicated in the chapter selection bar 2010.
FIG. 21 is another illustration of a Mixed-Media Module creator showing aspects of example element mouse hover implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 21 , the user can hover the mouse or pointer or tap selector over a portion of the timeline 21 10 and that portion can be selected.
FIG. 22 is an illustration of a Mixed-Media Module creator showing aspects of example remove single image implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 22, the user has decided to delete this picture, after selecting in as shown in FIG. 21. Next, a prompt appears 2210 to confirm that the user wishes to select the file, in this case an image, for deletion.
FIG. 23 is an illustration of a Mixed-Media Module creator showing aspects of example visual list mouse hover implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 23, the user can hover the mouse or pointer or tap selector, over an image and a visual list will appear 2310.
FIG. 24 is an illustration of a Mixed-Media Module creator showing aspects of example visual list implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 24, after the user selected an image in a visual list 2410.
FIG. 25 is an illustration of a Mixed-Media Module creator showing aspects of example generic error wrong mix implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 25, the system rejected the attempt to mix an image and video in the same portion, for example. The error notification box 2510, explains this to the user. Any number of errors could be conveyed in a similar manner.
FIG. 26 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example screen mouse hover implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 26, the Mixed-Media Module creation window 1310 shows the Mixed-Media Module creation progress. Further, the media timeline bar 2610 shows the different media uploaded and ordered in the current presentation. The user in FIG. 26 is hovering the mouse or pointer or tap selector over one particular media portion 2620 which highlights that portion, and allows for a user to delete the portion via the "x" in the corner. FIG. 27 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example screen write caption implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 27, the user is also able to add a caption to each individual media portion through a media screen write window 2710.
FIG. 28 is an illustration of a Mixed-Media Module creator showing aspects of attributes of example caption save implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 28 Referring to FIG. 28, the user can save the caption for each individual media portion and the system displays a notification 2810 indicating so.
FIG. 29 is an illustration of a Mixed-Media Module creator showing aspects of example generic error implementations where the narration is missing consistent with certain aspects related to the innovations herein. Referring to FIG. 29, the system can indicate that there is a missing narration for the Mixed-Media Module and can indicate so with a notification box 2910.
FIG. 30 is an illustration of a Mixed-Media Module creator showing aspects of adding example narration implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 30, users can add audio narration to a Mixed-Media Module. The system prompts the user to allow the microphone to be accessed by the system through a notification box 3010. The user can click on the computer prompted microphone allowance button 3020. Or, the system allows the user to upload video to use as a narration.
FIG. 31 is an illustration of a Mixed-Media Module creator showing aspects of example narration from a media library implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 31 , the user is able to add video as narration to the Mixed-Media Module through the drag and drop box 31 10.
FIG. 32 is an illustration of a Mixed-Media Module creator showing aspects of example narration from a media library add implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 32, the video narration is shown uploading to the system 3210.
FIG. 33 is an illustration of a Mixed-Media Module creator showing aspects of enabled webcam implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 33, the user is able to record video and or audio from an attached webcam. The system prompts the user to hit a start recording button 3310 and shows the user the webcam video in a preview window 3320. FIG. 34 is an illustration of a Mixed-Media Module creator showing aspects of example countdown and instruction implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 34, the system prompts the user to prepare to record the video from the webcam by a countdown display timer 3410. The user is able to restart the timer using a spacebar, as explained in the window 3420. Further, the user is able to navigate using the arrow keys as shown 3430.
FIG. 35 is an illustration of a Mixed-Media Module creator showing aspects of an example first image implementations consistent with certain aspects related to the innovations herein.
Referring to FIG. 35, the Mixed-Media Module shows the first image of the presentation 3510. The timer is also shown as counting up as the Mixed-Media Module plays through 3520. The record light is shown 3530 as well.
FIG. 36 is an illustration of a Mixed-Media Module creator showing aspects of an example second image implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 36, a second image 3610 is shown as the Mixed-Media Module progresses. The user is still narrating the video as it plays back and the timer 3520 progresses..
FIG. 37 is an illustration of a Mixed-Media Module creator showing aspects of an example third image implementations consistent with certain aspects related to the innovations herein.
Referring to FIG. 37, a third image 3710 is shown as the Mixed-Media Module progresses. The user is still narrating the video as it plays back and the timer 3520 progresses.
FIG. 38 is an illustration of a Mixed-Media Module creator showing aspects of an example visual list implementations consistent with certain aspects related to the innovations herein.
FIG. 39 is an illustration of a Mixed-Media Module creator showing aspects of an example last image of a visual list implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 39, a last image 3910 is shown as the Mixed-Media Module finishes. FIG. 40 is an illustration of a Mixed-Media Module creator showing aspects of example processing and soundtrack implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 40, the soundtrack selection window 4010, allows users to choose an audio track for the Mixed-Media Module playback. Different audio tracks are displayed for the user to select in a categorized manner 4020. The soundtracks could take any number of variations and could be displayed in many ways, in a drop down menu, in a list, in a mosaic, etc. FIG. 41 is an illustration of a Mixed-Media Module creator showing aspects of example implementations where users are allowed to upload their own files consistent with certain aspects related to the innovations herein. Referring to FIG. 41 , the hard drive or networked drives of the user's computer are accessed through the system 41 10. Users can select a file to upload to their Mixed-Media Module through this example interface.
FIG. 42 is an illustration of a Mixed-Media Module creator showing aspects of example implementations where users are allowed to play their own files consistent with certain aspects related to the innovations herein. Referring to FIG. 42, the user is able to start to play an audio file, as shown in the selected list 4210. The display also allows users to begin to play back the Mixed-Media Module by selecting the "play" button 4220.
FIG. 43 is an illustration of a Mixed-Media Module creator showing aspects of example preview implementations consistent with certain aspects related to the innovations herein. Referring to FIG. 43, the example preview screen shows the playing back Mixed-Media Module 4310. The images are shown 4320 as well as the narration video 4330. Further, in this example, the system displays topics that a user can select to delve more deeply into a particular subject
4340. These selectable topics relate to different aspects of the overall Mixed-Media Module and allow for additional windows to pop open for a user to view that selected material. Other embodiments include the ability to navigate through different selectable topics within the Mixed- Media Module display itself. Further, the progress bar at the bottom of the Mixed-Media Module preview screen 4350 shows the location of the currently playing back Mixed-Media Module. Generalized topic names within the process bar indicate the chapter location in the module, in this example, "the city," "nightlife," and "karaoke" chapters.
FIG. 44 is an illustration of a Mixed-Media Module creator showing aspects of example preview implementations, where the preview narration is missing, consistent with certain aspects related to the innovations herein. Referring to FIG. 44, the Mixed-Media Module example shows that the narration portion is missing through a notification 4410. The user can, to help finalize the Mixed-Media Module, record a narration by clicking the icon 4410.
FIG. 45 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein. Referring now to FIG. 45 an example Gesture is shown consistent with aspects of the innovations herein. Here, within a Mixed-Media Module, systems and methods herein may be configured to respond to a user tap or click of an object in the grid or in the feed to open another Mixed-Media Module, webpage, video, or detailed animation in an overlay over the current screen. Thus, some embodiments include methods wherein the interaction includes a tap of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
FIG. 46 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein. Referring to FIG. 46, another example Gesture is shown consistent with aspects of the innovations herein. Here, a user can pinch into an object in the grid to see detailed or related information on the object including source, related media, access interactive animations, view full video, read full article, and the like. Thus, some embodiments include methods wherein interactions include a pinch of a portion, button or link of the selected multimedia presentation used in the generation of a search results page.
FIG. 47 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein. Referring to FIG. 47, another example Gesture is shown, consistent with aspects of the innovations herein. Here, for example, systems and methods herein may be configured such that a user can tap or click and hold on an element in the grid or in the feed to provide various or additional options. Such options may include, though are not limited to, open now, queue for later, add to favorites, etc. Thus, some embodiments include methods wherein interactions include a tap and hold of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
FIG. 48 is an illustration showing an example gesture consistent with certain aspects related to the innovations herein. Referring to FIG. 48, another example Gesture is shown consistent with aspects of the innovations herein. Here, a user can swipe or scroll with one finger left or right over the grid to advance or rewind the presentation of the mixed-media. Thus, some embodiments include methods wherein interactions include a swipe or scroll of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
With regard to certain aspects of the innovations herein, another way that implementations herein are an improvement over the traditional information conveyance, especially from online video, is that that the mixed-media modules are specifically configured such that the end user is not required to experience the module in a linear fashion. A user can readily jump to different collections of media once a quick scan assures them the present set of options do not include anything they wish to see further, know more about, etc. Modules may also be configured such that users can also choose their path through the content by clicking on hyperlinks (meta-data) within the mixed-media module. This allows the end-user to explore the information that is of the most interest to them, in greater detail and in their preferred format (i.e. text, photos, or video). Innovations herein also work across multiple platforms. For example, mixed-media module interactive components herein can run inside a standard web browser and its player software can be integrated into mobile devices, TV devices, video game units, etc. Further, such mixed-media module(s) may be configured as a universal component across all media and devices.
In the description here, it is to be understood that both mouse / cursor enabled computing devices, and those without cursors, but use touch screen technologies are both fully
supported. To that, the terms "click" or "tap" or "touch" can be used synonymously and interchangeably. Thus, a clickthrough is the same as a tap-through or any other term with the equivalent meaning. The mobile wireless devices can be touch screen enabled, using a stylus or finger or other such thing to interact with the screen, and objects on the screen. The touch screen enabled technologies also allow for pinching in or out to zoom in or out or enlarge or shrink an object or the display. Sliding a touch can scroll either in vertical or horizontal directions, or any other direction supported by the system. The touch screens can also detect a prolonged tap, opening further functionality when a prolonged tap and hold occurs on an object. In devices that do not support a touch screen, such functionality can be accomplished by a cursor or pointer of some sort, typically controlled by a mouse, pointer stick, roller ball, etc. There may be additional functionality embedded into the display objects to allow for some of the functionality such as a scroll bar or zoom buttons, etc. These functionalities are also fully supported here and can be used interchangeably with the touch screen enabled technologies.
In the present description, the terms component, module, device, etc. may refer to any type of logical or functional process or blocks that may be implemented in a variety of ways. For example, the functions of various blocks can be combined with one another into any other number of modules. Each module can be implemented as a software program stored on a tangible memory (e.g., random access memory, read only memory, CD-ROM memory, hard disk drive) within or associated with the computing elements, sensors, receivers, etc. disclosed above, e.g., to be read by a processing unit to implement the functions of the innovations herein. Or, the modules can comprise programming instructions transmitted to a general purpose computer or to processing hardware via a transmission carrier wave. Also, the modules can be implemented as hardware logic circuitry implementing the functions
encompassed by the innovations herein. Finally, the modules can be implemented using special purpose instructions (SIMD instructions), field programmable logic arrays or any mix thereof which provides the desired level performance and cost. As disclosed herein, implementations and features of the invention may be implemented through computer-hardware, software and/or firmware. For example, the systems and methods disclosed herein may be embodied in various forms including, for example, a data processor, such as a computer that also includes a database, digital electronic circuitry, firmware, software, or in combinations of them. Further, while some of the disclosed implementations describe components such as software, systems and methods consistent with the innovations herein may be implemented with any combination of hardware, software and/or firmware. Moreover, the above-noted features and other aspects and principles of the innovations herein may be implemented in various environments. Such environments and related applications may be specially constructed for performing the various processes and operations according to the invention or they may include a general-purpose computer or computing platform selectively activated or reconfigured by code to provide the necessary functionality. The processes disclosed herein are not inherently related to any particular computer, network, architecture, environment, or other apparatus, and may be implemented by a suitable combination of hardware, software, and/or firmware. For example, various general-purpose machines may be used with programs written in accordance with teachings of the invention, or it may be more convenient to construct a specialized apparatus or system to perform the required methods and techniques.
Aspects of the method and system described herein, such as the location estimate features, may be implemented as functionality programmed into any of a variety of circuitry, including programmable logic devices ("PLDs"), such as field programmable gate arrays ("FPGAs"), programmable array logic ("PAL") devices, electrically programmable logic and memory devices and standard cell-based devices, as well as application specific integrated circuits. Some other possibilities for implementing aspects include: memory devices, microcontrollers with memory (such as EEPROM), embedded microprocessors, firmware, software, etc.
Furthermore, aspects may be embodied in microprocessors having software-based circuit emulation, discrete logic (sequential and combinatorial), custom devices, fuzzy (neural) logic, quantum devices, and hybrids of any of the above device types. The underlying device technologies may be provided in a variety of component types, e.g., metal-oxide
semiconductor field-effect transistor ("MOSFET") technologies like complementary metal-oxide semiconductor ("CMOS"), bipolar technologies like emitter-coupled logic ("ECL"), polymer technologies (e.g., silicon-conjugated polymer and metal-conjugated polymer-metal structures), mixed analog and digital, and so on. It should also be noted that the various logic and/or functions disclosed herein may be enabled using any number of combinations of hardware, firmware, and/or as data and/or instructions embodied in various machine-readable or computer-readable media, in terms of their behavioral, register transfer, logic component, and/or other characteristics. Computer-readable media in which such formatted data and/or instructions may be embodied to include, but are not limited to, non-volatile storage media in various forms (e.g., optical, magnetic or semiconductor storage media), though do not include non-tangible media.
Unless the context clearly requires otherwise, throughout the description and the claims, the words "comprise," "comprising," and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is to say, in a sense of "including, but not limited to." Words using the singular or plural number also include the plural or singular number respectively. Additionally, the words "herein," "hereunder," "above," "below," and words of similar import refer to this application as a whole and not to any particular portions of this application. When the word "or" is used in reference to a list of two or more items, that word covers all of the following interpretations of the word: any of the items in the list, all of the items in the list and any combination of the items in the list.
Other implementations of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the disclosure above in combination with the following paragraphs describing the scope of one or more implementations of the following invention

Claims

Claims: We Claim:
1 . A web-based method for creating mixed-media modules, the method comprising:
providing an interface operable by a user to access a web-based information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured such that the mixed-media module comprises three or more types of content including text, hyperlink, an image, a document, video, audio, narration and a web page.
2. A web-based method for creating mixed-media modules, the method comprising:
providing an interface operable by a user to access a web-based information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured such that the mixed-media module comprises of a plurality of image media elements connected in sequence as well as two or more types of media content selected from text, hyperlink, image, audio, document and video.
3. A web-based method for creating mixed-media modules, the method comprising:
providing an interface operable by a user to access a web-based information module creator engine/component(s); providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured to provide access to at least one of additional third party information, sites, content, applications and/or other multimedia.
4. A web-based method for creating mixed-media modules, the method comprising:
providing an interface operable by a user to access a web-based information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured for low-bandwidth and/or are non-rendered to facilitate display on a mobile device.
5. A web-based method for creating mixed-media modules, the method comprising:
providing an interface operable by a user to access a web-based information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured for creation without video rendering.
6. A web-based method for creating mixed-media modules, the method comprising: providing an interface operable by a user to access a web-based information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured by the user editing and arranging the selected content.
7. The method of claim 1 or other claims herein wherein the mixed-media module comprises content of a plurality of different media types as well as an interactive layer having interactive media or functionality that is configured to allow a viewer to interact with content associated with the interactive layer.
8. The method of claim 1 or other claims herein wherein the mixed-media module is configured such that a viewer may interact with and or access, via user interaction with the mixed-media module, one or more of a plurality of types of content linked to their original sources on the web.
9. The method of claim 1 or other claims herein wherein the mixed-media module is configured such that a viewer may navigate the module and/or associated content via viewer-action functionality provided in the mixed-media module.
10. The method of claim 1 or other claims herein wherein the mixed-media module is configured such that a viewer may self-select a path through the media/module via viewer-action functionality provided in the mixed-media module.
1 1. The method of claim 1 or other claims wherein the viewer-action functionality includes functionality that allows the viewer to navigate the mixed-media module in a non-linear manner.
12. The method of claim 1 or other claims wherein the viewer-action functionality includes hyperlinks within the information module configured to allow a viewer to skip to more desired media/content in a non-linear manner.
13. The method of claim 1 or other claims wherein the mixed media module is transmitted to a viewer of the mixed media module as a webpage.
14. The method of claim 1 or other claims, further comprising:
providing webpage and functionality to allow the user to generate respective meta data corresponding to each piece of content in the information module.
15. The method of claim 1 or other claims, further comprising:
providing webpage and functionality to allow the user to apply a plurality of filters for the creation of special effects and graphics to the information module.
16. The method of claim 1 or other claims, wherein the content in the information module is not hosted on a server of the information module; and
storing a preview of the playable presentation on a local server for guaranteed availability such that the content is linked to an original source.
17. The method of claim 1 or other claims, further comprising:
providing webpage and functionality to allow the user to create animation within the information module.
18. The method of claim 1 or other claims, further comprising:
providing webpage and functionality to allow the user to divide the information module into chapters.
The method of claim 1 or other claims, further comprising:
building a consumption profile based on user interaction with the information module.
20. The method of claim 1 or other claims, further comprising:
providing webpage and functionality to allow the user to insert advertising within the playable presentation of the information module based on the consumption profile.
21. The method of claim 1 or other claims, further comprising:
providing webpage and functionality to allow assignment of a sales commission to an information module creator based on user interaction with the mixed media module.
22. The method of claim 1 or other claims, further comprising:
providing webpage and functionality to allow the user to form a set of meta data based on the plurality of types of content in the information module for search engine optimization.
23. A web-based method for utilizing mixed-media modules, the method comprising:
providing an interface operable a user to access a web-based information module utilizing engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content such that the mixed-media module comprises three or more types of content including text, hyperlink, an image, a document, video, audio, narration and a web page.
24. A web-based method for utilizing mixed-media modules, the method comprising:
providing an interface operable a user to access a web-based information module utilizing engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content such that the mixed-media module comprises of a plurality of image media elements connected in sequence as well as two or more types of media content selected from text, hyperlink, image, audio, document and video.
25. A web-based method for utilizing mixed-media modules, the method comprising:
providing an interface operable a user to access a web-based information module utilizing engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content configured to provide access to at least one of additional third party information, sites, content, applications and/or other multimedia.
26. A web-based method for utilizing mixed-media modules, the method comprising:
providing an interface operable a user to access a web-based information module utilizing engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content configured for low- bandwidth and/or are non-rendered to facilitate display on a mobile device.
27. A web-based method for utilizing mixed-media modules, the method comprising:
providing an interface operable a user to access a web-based information module utilizing engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content configured for creation without video rendering.
28. A web-based method for utilizing mixed-media modules, the method comprising:
providing an interface operable a user to access a web-based information module utilizing engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content via a gesture by the user on a mobile device.
29. A web-based method for utilizing mixed-media modules, the method comprising: providing an interface operable a user to access a web-based information module utilizing engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content by interacting with one or more of a plurality of types of content linked to their original sources on the web to self- select a path through the content by selecting the content corresponding to hyperlinks within the information module in a non-linear process.
30. A web-based method for utilizing mixed-media modules, the method comprising:
providing an interface operable a user to access a web-based information module utilizing engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content configured such that a viewer may self-select a path through the media/module via viewer-action functionality provided in the mixed-media module.
31. The method of claim 1 or other claims wherein the mixed-media module includes an interactive layer with interactive media or functionality that is configured to allow a viewer to interact with content associated with the interactive layer.
32. The method of claim 1 or other claims, wherein
processing of the playable presentation is performed on a user device playing the information module to reduce bandwidth.
33. The method of any claim herein wherein the server is configured to provide the multimedia presentation for display in an expanded view in the search result page.
34. The method of any claim herein wherein the search results further include advertisements provided as a function of the user's interaction with the multimedia presentation.
35. A multimedia information module authoring device, comprising:
a display providing display of a web-based information module interface providing a user to select a plurality of types of content to create a playable presentation without video rendering, wherein the information module interface edits the plurality of types of content in the creator interface, wherein the information module includes an interactive layer and is a rich, mixed- media, user interactive component.
36. The device according to claim 35, wherein
the interface provides access to at least one of, additional third party information, sites, content, applications and/or other multimedia;
wherein, the multimedia presentation is configured to,
allow user interaction to manipulate the presentation;
cause display of more than one kind of media.
37. The method of any claim herein wherein the presentations are configured to be displayed on at least one mobile device.
38. The method of any claim herein wherein the server is configured to provide the multimedia presentation for display in an expanded view in the search result page.
39. The method of any claim herein wherein the search results further include advertisements provided as a function of the user's interaction with the multimedia presentation.
40. An interactive multimedia presentation system comprising:
one or more servers and/or processing components configured to,
communicate with at least a user device;
perform processing regarding interaction with the user device associated with generation and display of the interactive multimedia presentation, wherein the presentation includes
a plurality of interactive multimedia content; and/or at least one hyperlink.
41. The system of claim 40 or any claim herein further comprising a customizable caption that is configured to be played by the user.
42. The system of claim 40 or any claim herein wherein the multimedia presentation includes metadata, allowing interaction with a search engine.
43. The system of claim 40 or any claim herein wherein the playable caption is configured to expand on a display and offer further search options.
44. The system of claim 40 or any claim herein wherein the meta data is derived from parsed unstructured data or selecting media.
45. The system of claim 46 or any claim herein wherein the computer server is further configured to run a script on a search engine to obtain structured data.
46. The system of claim 46 or any claim herein wherein the multimedia presentation includes information based on the obtained structured data.
47. The system of claim 46 or any claim herein wherein the server is further configured to detect entities in text.
48. The system of claim 46 or any claim herein wherein the display of the multimedia
presentation is configured and/or formatted for display on a mobile smartphone.
49. The system of claim 46 or any claim herein wherein the search results are configured and/or formatted for display on a tablet computer.
50. The system of claim 46 or any claim herein wherein the search results are further configured with advertisements, such as advertisements embedded within the multimedia presentation.
51. The system of claim 46 or any claim herein wherein the interaction includes a tap of a portion, button or link of the selected multimedia presentation used in the generation of a new search results page.
52. The system of claim 46 or any claim herein wherein the interaction includes a swipe or scroll of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
53. The system of claim 46 or any claim herein wherein the interaction includes a tap and hold of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
54. The system of claim 46 or any claim herein wherein the interaction includes a pinch of a portion, button or link of the selected multimedia presentation used in the generation of the new search results page.
55. The system of claim 46 or any claim herein wherein the server is configured to provide the multimedia presentation for display in an expanded view in a search result page.
56. The system of claim 46 or any claim herein wherein the search results further include advertisements provided as a function of the user's interaction with the multimedia presentation.
57. The method or system of any claim above wherein the multimedia presentation includes a mixed media module comprising at least two items of text, animation, images, pictures and/or video, such as presentation of three or more items in a non-rendered format.
58. The method or system of claim 64 or any claim herein wherein the mixed media module is comprised of one or more slots into which the server causes media to display.
59. The method or system of any claim above wherein the mixed media modules include realtime information objects.
60. The method or system of any claim above wherein narration of the multimedia presentation includes causing portions of the multimedia presentation to highlight in coordination with played audio, and/or wherein the highlighted portion is magnified.
61. The method or system of any claim above further comprising, creating at least one index file including one or more of a summary of the media objects, a snippet, location, title alias, overall quality rank, and/or an iconic picture.
62. The method or system of any claim above wherein:
the search engine further causes display of related information to the user entered search, in the multimedia presentation; and/or
wherein the multimedia presentation further includes a film strip tool bar configured to allow a user to scroll portions of a video.
63. The invention of any claim herein, wherein the mixed media module includes an interactive layer for user interaction and providing a deeper exploration of search results without leaving the original search results page.
64. The invention of any claim herein, wherein the mixed medial module is expandable in display size within its original search result page.
65. The invention of any claim herein, wherein the mixed media module includes playable captions to display and describe the mixed media content being displayed so as to provide narrative context to the search results displayed.
66. The invention of any claim herein, wherein the mixed media module includes advertising monetization units in place of, or in addition to, advertising monetization units within the search results page and outside the mixed media module.
67. The invention of any claim herein, further comprising a second mixed media module as an advertising monetization unit.
68. The invention of any claim herein, wherein the mixed media module includes a play mode to visually advance the plurality of media content displayed in time.
69. The invention of any claim herein, wherein the mixed media module displays playable captions generated by a site publisher of the media content being displayed such that a brand and an appearance of the of media content displayed within the mixed media module on the search results page is determined by the site publisher and not a search results page algorithm or search engine.
70. The invention of any claim herein, wherein the site publisher controls the display of the site publisher content displayed in the mixed media module.
71. The invention of any claim herein, wherein the playable captions are not algorithmically generated.
72. The invention of any claim herein, wherein the mixed media module provides visual relevancy where the plural types of media content displayed provides more in-depth detail of a topic than text alone.
73. The invention of any claim herein, wherein the mixed media module provides additional data to rank pages for search results.
74. The invention of any claim herein, wherein the media content of the mixed media module includes more meta-data than meta-data of video.
75. The invention of any claim herein, wherein the user operates does not operate to control the mixed media module display linearly such that a user chooses a display path through the media content of the plurality of media types within the mixed media module.
76. The invention of any claim herein, wherein the mixed medial module provides an interactive summary in narrative form of curated mixed media content from a search result.
77. The invention of any claim herein, wherein the mixed media module displaying re-query suggestions of related search concepts.
78. The invention of any claim herein, wherein the mixed media module provides higher information density display over display of a single media type.
79. The invention of any claim herein, further configured with functionality that allows a user to select a re-query search within an original mixed media module opens a new mixed media module to provide high information density.
80. The invention of any claim herein, wherein the mixed media module comprises three or more different types of content selected from text, image, video, audio, document, text entry, interactive icon, toolbar and/or video.
81. The invention of any claim herein, wherein the mixed media module comprises three or more different types of content selected from text, image, video, audio, document, text entry, interactive icon, toolbar and/or video to provide a user experience characterized as visually rich by the three or more different types of content displayed at once in the mixed media module.
82. The invention of any claim herein, further configured such that multiple different pieces of media content of the mixed media module being displayed each provide the user with additional information of differing scope.
83. The invention of any claim herein, wherein the mixed media module provides a layer of interactivity such that deeper exploration of search results is provided to the user without leaving the original search result page.
84. The invention of any claim herein, wherein the mixed media module displays media content without the search engine generating previews of websites to save bandwidth.
85. The invention of any claim herein, wherein the user operates the interactive layer to customize the content of the mixed media module display.
86. The invention of any claim herein, wherein the mixed media module loads audio and video data within the mixed media module so as to prevent loading of the audio and video data to an external page.
87. The invention of any claim herein, wherein the mixed media module loads audio and video data within the mixed media module such that bandwidth is reduced.
88. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured such that the mixed-media module comprises three or more types of content including text, hyperlink, an image, a document, video, audio, narration and a web page.
89. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured such that the mixed-media module comprises of a plurality of image media elements connected in sequence as well as two or more types of media content selected from text, hyperlink, image, audio, document and video.
90. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured to provide access to at least one of additional third party information, sites, content, applications and/or other multimedia.
91. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured for low-bandwidth and/or are non-rendered to facilitate display on a mobile device.
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media; providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured for creation without video rendering.
92. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to select a plurality of types of content and drop the selected content into a narrative presentation outline to create a presentation of media;
providing web pages and interactive functionality, via the interface, programmed to allow the user to edit the content and/or presentation of the content via the interface;
generating a mixed-media module via integration of the selected content into a playable presentation of the content configured by the user editing and arranging the selected content.
93. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content such that the mixed-media module comprises three or more types of content including text, hyperlink, an image, a document, video, audio, narration and a web page.
94. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content such that the mixed-media module comprises of a plurality of image media elements connected in sequence as well as two or more types of media content selected from text, hyperlink, image, audio, document and video.
95. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
96. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content configured to provide access to at least one of additional third party information, sites, content, applications and/or other multimedia.
97. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content configured for low- bandwidth and/or are non-rendered to facilitate display on a mobile device.
98. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content configured for creation without video rendering.
99. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s); providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content via a gesture by the user on a mobile device.
100. A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content by interacting with one or more of a plurality of types of content linked to their original sources on the web to self- select a path through the content by selecting the content corresponding to hyperlinks within the information module in a non-linear process.
101 . A method for providing a downloadable application for creating mixed-media modules, the method comprising:
providing an executable application for download to a user device, the executable application configured for:
providing an interface operable by a user to access an information module creator engine/component(s);
providing web pages and interactive functionality, via the interface, programmed to allow the user to view the information module playing over a web-based interface as a playable presentation; and
providing web pages and interactive functionality, via the interface, programmed to allow the user to interact with the mixed-media module and/or associated content configured such that a viewer may self-select a path through the media/module via viewer-action functionality provided in the mixed-media module.
PCT/US2012/071095 2011-12-20 2012-12-20 Systems and methods involving features of creation/viewing/utilization of information modules WO2013096701A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP12859456.1A EP2795444A4 (en) 2011-12-20 2012-12-20 Systems and methods involving features of creation/viewing/utilization of information modules
CA2857519A CA2857519A1 (en) 2011-12-20 2012-12-20 Systems and methods involving features of creation/viewing/utilization of information modules
CN201280061447.9A CN103988162B (en) 2011-12-20 2012-12-20 It is related to the system and method for the establishment of information module, viewing and the feature utilized

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161578209P 2011-12-20 2011-12-20
US61/578,209 2011-12-20

Publications (1)

Publication Number Publication Date
WO2013096701A1 true WO2013096701A1 (en) 2013-06-27

Family

ID=48669513

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2012/071095 WO2013096701A1 (en) 2011-12-20 2012-12-20 Systems and methods involving features of creation/viewing/utilization of information modules

Country Status (4)

Country Link
EP (1) EP2795444A4 (en)
CN (1) CN103988162B (en)
CA (1) CA2857519A1 (en)
WO (1) WO2013096701A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105376651B (en) 2014-08-29 2018-10-19 北京金山安全软件有限公司 Method and device for generating video slides
WO2018076174A1 (en) * 2016-10-25 2018-05-03 深圳市大疆创新科技有限公司 Multimedia editing method and device, and smart terminal

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070294619A1 (en) * 2006-06-16 2007-12-20 Microsoft Corporation Generating media presentations
US7912827B2 (en) * 2004-12-02 2011-03-22 At&T Intellectual Property Ii, L.P. System and method for searching text-based media content
US20110161308A1 (en) * 2009-12-31 2011-06-30 Microsoft Corporation Evaluating preferences of content on a webpage
US20110225066A1 (en) * 2010-03-09 2011-09-15 Carter Jeffery L Web service for generating portable multimedia presentations

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200801998A (en) * 2005-11-29 2008-01-01 Wayv Corp Systems, methods, and computer program products for the creation, monetization distribution, and consumption of metacontent
CN101262395A (en) * 2008-04-22 2008-09-10 盛中华 Isomerous multi-source media coordinated playing system and realization method based on time stream

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7912827B2 (en) * 2004-12-02 2011-03-22 At&T Intellectual Property Ii, L.P. System and method for searching text-based media content
US20070294619A1 (en) * 2006-06-16 2007-12-20 Microsoft Corporation Generating media presentations
US20110161308A1 (en) * 2009-12-31 2011-06-30 Microsoft Corporation Evaluating preferences of content on a webpage
US20110225066A1 (en) * 2010-03-09 2011-09-15 Carter Jeffery L Web service for generating portable multimedia presentations

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2795444A4 *

Also Published As

Publication number Publication date
EP2795444A1 (en) 2014-10-29
EP2795444A4 (en) 2016-01-27
CN103988162B (en) 2018-07-10
CN103988162A (en) 2014-08-13
CA2857519A1 (en) 2013-06-27

Similar Documents

Publication Publication Date Title
US20220342519A1 (en) Content Presentation and Interaction Across Multiple Displays
US9843823B2 (en) Systems and methods involving creation of information modules, including server, media searching, user interface and/or other features
US20100241962A1 (en) Multiple content delivery environment
CN101233573B (en) Media user interface start menu
US9092437B2 (en) Experience streams for rich interactive narratives
US10296158B2 (en) Systems and methods involving features of creation/viewing/utilization of information modules such as mixed-media modules
US9239662B2 (en) User interface editor
US20140310746A1 (en) Digital asset management, authoring, and presentation techniques
US20050071736A1 (en) Comprehensive and intuitive media collection and management tool
US20080010585A1 (en) Binding interactive multichannel digital document system and authoring tool
US20090049384A1 (en) Computer desktop multimedia widget applications and methods
US20120198412A1 (en) Software cinema
CA2857517A1 (en) Systems and methods involving features of search and/or search integration
US11099714B2 (en) Systems and methods involving creation/display/utilization of information modules, such as mixed-media and multimedia modules
US10504555B2 (en) Systems and methods involving features of creation/viewing/utilization of information modules such as mixed-media modules
KR20140020852A (en) Method for customizing the display of descriptive information about media assets
WO2013096701A1 (en) Systems and methods involving features of creation/viewing/utilization of information modules
US10387503B2 (en) Systems and methods involving features of search and/or search integration
KR20200022995A (en) Content production system
Harrington et al. An Editor's Guide to Adobe Premiere Pro
Miser iTunes and iCloud for iPhone, iPad, & iPod touch Absolute Beginner's Guide
Jakobsson Video approval app for iPad
Kim et al. iFlix

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12859456

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2857519

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2012859456

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2012859456

Country of ref document: EP