JP2024525120A - Frames and child frames for video and web page rendering - Google Patents

Abstract

Techniques are disclosed for display using frame and child frame techniques for rendering video and web pages. A video stream is received. The video stream is displayed as a video in a window on a device display along with a link. The link includes a web page uniform resource locator (URL). A selection of the link made by a user is received. The selection is made in response to a call to action. The video is rendered along with a result of the selected link. The rendering of the result of the link includes a web page associated with the web page URL. The user can interact with the web page while the video is being rendered. The video is scaled down and the video is rendered as a scaled down video on a portion of the device display. Rendering the scaled down video and web page is accomplished without pop-up windows.
[Selected figure] Figure 6

Description

RELATED APPLICATIONS This application claims priority to U.S. Provisional Patent Application No. 63/196,252, entitled "Frame And Child Frame For Video And Webpage Rendering," filed on June 3, 2021.

The aforementioned applications are hereby incorporated by reference in their entirety in jurisdictions where permitted.

This application relates generally to displays, and more specifically to frames and child frames for rendering video and web pages.

Video streaming is becoming an increasingly popular source of entertainment, information, and commerce. For years, video viewers were constrained to television and movie theaters, but streaming has opened up more and more opportunities to create, promote, and consume content, especially using mobile devices. More than ever before, viewers have control over what they watch, when and where they want to watch it. Streaming companies can provide subscribers with video content 24/7. Viewers are no longer constrained by television program schedules or theater showtimes. For a monthly fee that is often less than the cost of a family trip to the movie theater, subscribers can watch unlimited movies, TV shows, documentaries, and more. Content created decades ago is just as readily available as content created within the past year. Streaming services can even create their own exclusive content for subscribers, encouraging consumers to purchase the service to watch that particular content. Video streaming providers can recommend new content based on past viewing choices, thus tailoring suggestions to each user and improving customer satisfaction.

Gaming sites allow people to stream videos of professional gamers playing video games, providing commentary, and showcasing their skills. While watching the gamers, viewers can interact with other viewers through live posting of messages, thus creating an online community of people with similar interests. Gamers can generate so many followers that they can even attract sponsorships. Some companies offer their streaming content for free in order to monetize using an ad-supported business model. Through these sites, adults, teenagers, and children can post content they create and share it with an audience, whether it be a private audience that requires a password to access or a general audience where the content is available to anyone. Parents can share their child's piano recital with relatives who couldn't attend. Friends can share holiday wishes from anywhere in the world. Sports teams can share players' competition highlights with fans. Entrepreneurs can share their products and services with customers. Influencers can use video streaming to create and promote their brands and reinvent the wheel with personalized behavior they offer. Viewers can interact directly with influencers, building relationships and deepening connections. This way, viewers can feel at one with the influencer. Viewers can also share the live videos using social media, helping to quickly amplify the influencer's brand.

When much of the world shut down during the pandemic, individuals were able to stay in touch with loved ones using companies' live streaming video services. These services also enabled employees to continue working from home and allowed businesses to stay connected with customers when traditional face-to-face meetings were not an option. Live streaming video allows viewers to experience events in real time while on the go. Fans can watch their favorite teams compete as they wait in line at a store. Voters can watch a live presidential debate while out for an evening stroll. From real-time news coverage to award ceremonies to product launches, entertainment, information and commerce are instantly available at viewers' fingertips.

Electronic devices, which may include desktop computers, laptop computers, tablets, smartphones, and PDAs, are widely used by people who want to watch and interact with content, such as video streaming. Video streaming may include live streaming, where an individual or team of individuals may present thoughts, comments, offers of goods or services, etc. Video streaming may be used to advertise individuals, goods, or services, etc., and may be used to present information, such as news, sports, government announcements, and entertainment, educational materials, etc. Video streaming may be viewed in a window associated with a video app or player, using a plug-in associated with a web browser window, etc. The originator of a video stream, such as an individual, may include a link or uniform resource locator (URL) in the stream. Further information may include a website associated with the individual, details about the goods or services that are the subject of the video stream, etc. The further information may be accessed by selecting a link in the video stream. The result of the link may include web content, which may include text, photos or images, audio, video, etc. The result of the link may be rendered along with the video. To make the link result and video fit within the size of the app or browser window, the video can be scaled down and the scaled down video can be rendered "on top" of the link result. Rendering can be accomplished using frames of the video and child frames of the link result.

The display is based on frames and child frames for rendering of videos and web pages. Video streaming can be provided by an individual, a team, a streaming provider, etc. Video streaming can include live streaming video. Video streaming is displayed as a video in a window on the device display along with a link. Video streaming can be displayed in a frame associated with the window. Displaying the video can be accomplished using an app, a window associated with a web browser, etc. Links can access content such as text, images, audio, video, etc. Links can include URLs of web pages. A selection of a link by a user can be received. Links can be selected by clicking a link displayed along with the video, clicking an image to access a hidden link, or selecting a link in a chat. The video is rendered along with the results of the selected link. The results of the link can be displayed in a child frame associated with the window. The video is scaled down and the video is rendered as a scaled down video on a portion of the device display. The scaled down video can be rendered above the results of the selected link. Rendering the scaled down video and web page is accomplished without a pop-up window.

Various features, aspects, and advantages of the various embodiments will become more apparent from the further description below.

The following detailed description of certain embodiments can be understood by reference to the following figures:

FIG. 13 is a flow diagram for rendering a frame and child frames. 1 illustrates user interaction with a frame and child frames. 1 is an example showing an animation window with a link. 13 is an example showing a video scaled down in a child frame with a link result. Shows video streaming and the results of selected links. FIG. 1 is a system block diagram for video and web page rendering. FIG. 1 is a system diagram for display.

Techniques are disclosed for frame and child frame based display for rendering of videos and web pages. Videos, such as video streaming videos, can be received by an individual. The received video streams can be received using electronic devices, such as desktop computers, laptop computers, tablets, smartphones, personal digital assistants (PDAs), etc. The video streaming videos can be viewed using apps, such as video players loaded on the electronic devices, web browsers with plug-ins, etc. Video streaming allows individuals to reach out to subscribers, followers, like-minded individuals, the curious, etc. Video streaming can present messages, such as opinions, messages, product promotions or criticisms. Providers can present links, such as web links, that can be displayed with the video streaming videos. Links can be used to present messages, communicate emotions or provoke visceral responses, explore themes or experiences, and access text, images, videos, audio, and other content related to or associated with the topic of the video streaming video. Video streaming can also include a chat feature where viewers can share comments, support, rants, web links, etc. Viewers can click on links to receive the results of the links. Video Streaming Video and link results can be rendered within the app or browser window, using the video's frame and a child frame of the link result. The video can be reduced in size and rendered on top of the link result.

A display is enabled using frames and child frames for rendering of videos and web pages. A video stream is received. The video stream can include live streaming, which can be provided by individuals wishing to talk about products, share opinions, comment on news stories, and the like. The video stream is displayed as a video in a window on a device display along with a link. The window can be associated with an app or a web browser. The link can include web links to content such as text, photos, audio, video, and the like. A selection of a link by a user is received. The selected link can include a link presented along with the video stream, a link embedded within the video, a link in a chat stream, and the like. The video is rendered along with the results of the selected link. The video can be rendered in a frame associated with the window, and the results of the link can be rendered in a child frame further associated with the window. The video is scaled down and the video is rendered as a scaled down video on a portion of the device display. The scaled down video can be rendered in front of the results of the link. The scaled down video can be rendered initially at a location within the window and can be moved to another location based on an action taken by the user. In embodiments, rendering of miniaturized videos and web pages is accomplished without pop-up windows.

FIG. 1A is a flow diagram of frames and child frames for rendering videos and web pages. Videos can include various media and content types, including video streaming videos, short videos, and the like. Video streaming videos can include live or recorded videos provided by individuals, teams of collaborators, and the like, while some videos can include news videos, entertainment videos, political message videos, and the like. Video streaming videos can be provided by social media influencers, tastemakers, celebrities, and the like. Anyone with access to minimal equipment such as a camera, microphone, electronic device, and something to say can provide a video stream to inform, entertain, or inspire others, or simply themselves. Videos can be viewed on an electronic device used by an individual. Viewing can be accomplished by rendering the video in a frame associated with a window. The window can include a window provided by an app, a window associated with a web browser, and the like. Videos can include links to various content such as text, images, audio, video, and websites. Content resulting from selecting a link can be rendered in a child frame associated with the viewing window. The user can continue to watch the video and can interact with the content rendered in the child frame. Videos can be paused and resumed, while content in child frames can be scrolled, clicked, etc. Content in child frames may be scrollable horizontally, vertically, etc. Results from links can autoplay, start and stop, pause, etc.

The flow 100 includes receiving 110 a video stream. The video stream may include multimedia content such as audio and video, soundtracks, slideshows, etc. In an embodiment, the video stream may include live streaming. The video stream may be provided by an individual or team, a media company, a political organization, an educational institution, etc. The video stream may include entertainment content, social sharing content, etc. The video stream may be based on various encoding and decoding, or "codec," technologies, including H.264, H.265/HVEC, etc. The flow 100 includes displaying 120 the video stream as a video. Displaying the video stream may be accomplished using a general-purpose video app such as QuickTime™, VLC Media Player™, GOM Player™, etc. Displaying the video may be accomplished using a dedicated media player, browser plug-in, etc. In the flow 100, the video stream is displayed in a window 122 on the device. A window in which a video can be displayed can include a window associated with an app, a window associated with a web browser or browser tab, etc. A window can include a frame in which a video can be displayed. A frame can include a portion of a window in which a video stream can be displayed, independent of the frame's container. A frame's container can include other content that can be displayed along with the video stream, browser window, etc. A frame's content, such as a video stream, can be loaded independent of the frame's container. In the flow 100, a video stream is displayed 124 along with a link. The link can include a link to content, which can include media such as text, images, audio files, video files, etc. In an embodiment, the link can include a web page associated with a web page URL. The link can include a visible link, an embedded link, etc. The link may be displayed in a chat stream associated with the video stream (discussed below). The link is rendered "in front" of the video from the user's perspective, but clicking on the link can cause the navigation it implies to be intercepted by another server, as described below.

The webpage is launched in an enlarged container window that can display both the webpage and the miniature video. The flow 100 includes receiving 130 a selection of a link by a user. Selection of the link can be accomplished by clicking on a link displayed with the video streaming video, clicking on the video and selecting an embedded link, clicking on a selection in a menu, clicking on a link in a chat, etc. Selection can include using a mouse or trackpad, swiping a cursor over the video, etc. Selection of the link can cause results for the link to be provided. The results can include media such as text, images, audio, video, etc. In an embodiment, the link can include a webpage URL. The webpage can be associated with a provider of the video streaming, can reference goods or services, can provide further information, etc. In an embodiment, the user selection can be responsive to a call to action. The call to action can include a purchase link, a survey link, a support link, etc. The flow 100 includes rendering 140 the video with results for the selected link. Rendering results for the link can include displaying a file or image, playing audio or video, displaying a new webpage, etc. In an embodiment, the rendering of the link result may include a web page associated with the web page URL. The flow 100 further includes initiating 142 a child frame in which the web page is displayed. The child frame may also be used to display text, images, and video, play audio, etc. In an embodiment, the child frame may surround the video being rendered. The child frame may, phenomenologically speaking, be displayed in front of the web page, overlaid on top of the video, or overlaid in front of the video, but then allowing a scaled-down video to be displayed. The child frame may be a reloaded version of the web page that contains the web page and the video, where the video is scaled down and placed, for example, in a corner of the display such that the web page is visible in the child frame with the scaled-down video. The video may be scaled down (described below) for display with the link result. The flow 100 further includes a user interacting with the web page 144 while the video is being rendered. Interacting may also include interacting with text, images, audio, video, etc. Interacting may include clicking on links, selecting menu options, etc. The flow 100 further includes a user manipulating 146 the link results. The web page or other content rendered with the video may not simply be static, but may be manipulated, operated, etc. by the user. In embodiments, manipulating may include scrolling the results. For example, the web page may be scrolled up, scrolled down, swiped left or right. In other embodiments, manipulating may include starting and pausing the rendering of the results. Start, pause, stop, and scrub (e.g., fast forward or rewind) techniques may be used to control the playback or playback of audio files, video files, etc.

The flow 100 includes scaling down the video to render the video as a scaled down video on a portion of the device display 150. Scaling down the video may include reducing the dimensions of the video based on a percentage, an aspect ratio, a user selection, etc. In an embodiment, scaling down the video may be responsive to a scaling down selection by a user. The scaling down may be performed to improve visibility of the results of the link, which may be rendered in a child frame surrounding the frame in which the scaled down video is rendered. In an embodiment, the scaled down video may be rendered over the results of the selected link. Recall that the results of the link may include a web page. In an embodiment, rendering the scaled down video and web page is accomplished without a pop-up window. Rendering without a pop-up window allows for the rendering of the scaled down video and web page and prevents interruption of pop-up blockers associated with the web browser. In another embodiment, the web page may be launched within a magnified container window that includes a representation of both the web page and the scaled down video. The magnified container may include the frame in which the video is rendered and the child frame in which the web page is rendered. In other embodiments, the shrinking may cause the video to be rendered in the bottom right corner of the window. The video may be rendered in other locations relative to the results of the link. The flow 100 further includes changing 152 the location for the shrink-framed video to be displayed. Changing the location of the window may include repositioning the window to a corner of the browser window, the top, left, right, or bottom center of the window, the center of the window, etc. Changing the location of the shrink-framed video may be based on a user-set location, a menu selection, or other action that may be performed by the user. In embodiments, changing the location may occur in response to a mouse drag action performed by the user, a trackpad drag-and-drop action, a finger slide on a touch-sensitive display, etc. The flow 100 further includes scrolling the web page 154 while the location of the video remains fixed. The fixed video may continue to play, may be paused and resumed, etc. In embodiments, the video may be paused and resumed based on a selection by the user. The video may also be paused and resumed by the video provider.

In an embodiment, by rendering the scaled down video, a picture-in-picture function can be achieved. The scaled down video can be rendered as one picture while the web page, video, etc. can be rendered as a second picture. In an embodiment, the web page can be the outer picture for the picture-in-picture function. The outer picture, which can be thought of as a magnified container, can be used to allow viewing of a larger portion of the web page compared to the portion of the web page that can be viewed within the smaller picture. In other embodiments, rendering the video can include an inner picture for the picture-in-picture function. The video can continue to play within the inner picture. It is noted throughout that in further embodiments, the web page can include another video that is displayed along with the scaled down video. The video included in the web page can be played, paused, resumed, etc. In an embodiment, by rendering the scaled down video, a page-in-page function can be achieved. The page-in-page function can include displaying a web page within a web page. Recall that video streaming video, link results, etc. can be displayed within a window associated with the web browser. In embodiments, the rendering may be accomplished using inline frame functionality within the internet browser application. The contents of the frame may be updated, changed, reloaded, etc., without affecting the internet browser application.

The flow 100 further includes maximizing 160 the video after shrinking. Maximizing the video may be based on a window size associated with rendering the video, a user size preference, a preset size based on the video resolution, etc. Maximizing may include filling an app window or browser window with the video streaming video, upscaling or downscaling the video to fit the window, etc. Maximizing the video may be accomplished by selecting an appropriately sized video for rendering. The flow 100 includes restoring 162 the rendering of the video to the original size of the video. Restoring the rendering of the video may include closing child frames. Restoring the video may include stretching the frame to fill the window.

The various steps of flow 100 may be reordered, repeated, omitted, or the like without departing from the disclosed concepts. Various embodiments of flow 100 may be included in a computer program product embodied in a computer-readable medium that includes code executable by one or more processors.

Figure 1B illustrates user interaction with frames and child frames. The frames and child frames enable the rendering of videos and web pages. A video stream is received. The video stream is displayed as a video in a window on the device display along with a link. A user selection of a link is received. A video is rendered along with the results of the selected link. The video is scaled down and the video is rendered as a scaled down video on a portion of the device display. User interaction with the links, frames, and child frames enables various operations by the user.

In the example diagram 102, various user interactions 170 enable the rendering of video and web pages of frames and child frames. As previously described, a selection of a displayed link is received by a user. Various types of links can be used, such as a uniform resource locator (URL) link 172. The URL link 172 can point to Internet and intranet web pages, cloud server files, local server files, and the like. Links, including URL links, can include a call to action (CTA) 174. The CTA 174, which can also be known as a "click to action," enables various user interactions, including, but not limited to, initiating a web-based transaction. Various other user interactions are included in FIG. 102, such as user interactions during video playback 176, displaying a scaled-out selection 178, displaying a scaled-down rendering of the video in a corner of the display 180, changing the location of the scaled-down video within the display 182, scrolling the web page while the scaled-down video remains in a fixed location on the display 184, restoring the video to its original size 186, and pausing and/or resuming the video 188, to name just a few user interactions within the video and web page renderings of a frame and child frames.

FIG. 2 is an example showing a video window with a link. A video, such as a video streaming video, can be rendered in a frame associated with a window, such as a video window. The video window can be associated with an application or app, the browser window can be associated with a web browser, and so on. A user can open an app, window, or browser tab in a web browser on an electronic device to watch a video. The web browser can include common web browsing applications or apps, such as Edge™, Safari™, Chrome™, Firefox™, Opera™, Lycos™, and so on. The electronic device can include a computer, a smartphone, a tablet, a PDA, a set-top box, a game console, and so on. A user can click on a link associated with a video streaming to receive a result of the link. The result of the link can include a file, a website, and so on. The result of the link, such as a website, can be rendered in a child frame within the app or browser window. The child frame can display content that can be presented and accessed independently from the frame containing the video. The window containing the video and the result of the link can also be referred to as a container. The frames and child frames enable the rendering of video and web pages. A video stream is received. The video stream is displayed as a video in a window on the device display along with a link. A user selection of a link is received. A video is rendered along with the results of the selected link. The video is scaled down and the video is rendered as a scaled down video on a portion of the device display.

An exemplary video window with links is shown at 200. The video window 210 may include a window associated with an app, a web browser window or tab, etc. The window may be used to render a video 212, such as a video streaming video. The video streaming video may include videos from individuals 214, such as celebrities, influencers, tastemakers, individuals who like to stream videos, etc. In an embodiment, the video window may include a chat 216. The chat may include chat text, emojis, GIFs, one or more links to content, etc., and may be provided by subscribers, followers, fans, colleagues, and others interested in the video streaming video. In an embodiment, the individual streaming the video may offer a product 220, a service, a recommendation, an offer, etc. In another embodiment, the video window may include a link 222. The link may be associated with the individual 214, the product 220, etc. in the video. The link may include a link provided by the video streaming provider, a link in the chat, a link embedded in the video streaming, etc. A viewer of the video may select the selected link. Selecting a link can provide content, such as a file, a web page, etc., as described throughout.

Figure 3 is an example showing a scaled down video with a link result in a child frame. A user may experience the video streaming by viewing the stream on an electronic device, such as a computer or personal electronic device. The video streaming may be viewed using an app, a window associated with a web browser, or the like. An individual experiencing the video streaming video may click on a link associated with the video streaming. The video may be rendered along with the results of the selected link. The video may be scaled down and the scaled down video may be rendered in a frame on a portion of the device display. The link result may be rendered in a child frame on the device display. The link result may include a web page. Rendering of the video and the web page is enabled using frames and child frames.

An example of a scaled down video and linking result is shown at 300. The scaled down video and linking result may be rendered on a display 310, and the rendering may be accomplished using an app, a browser window, or the like. The video streaming video may be scaled down so that the video can be rendered in a portion of the app or browser window along with the results of the selected link. The video 320 may be rendered in a frame. The frame may allow for viewing of the video streaming video, pausing, playing, and stopping the video, and the like. In an embodiment, scaling down the video to render the video in a portion of the app or browser window may include launching a third party webpage 322 and rendering the video to be overlaid on top of the third party webpage. The webpage may be rendered in a child frame. The scaled down window may be rendered in various locations within the browser window. In an embodiment, scaling down may cause the video to be rendered in the bottom right corner of the app or browser window. The location of the scaled down video may be fixed, predefined, user defined, or the like. An embodiment may include changing the location for rendering. Changing may include clicking on a grid, selecting a menu option, or the like. In embodiments, the location change may be in response to a user dragging a mouse or trackpad.

FIG. 4 illustrates a video streaming and a result of a selected link. The video streaming video and the result of a selected link by an individual can be rendered in a frame and one or more child frames. The frame and child frames can be used to render a video and a web page. A video streaming is received. The video streaming is displayed as a video in a window on a device display along with a link. A selection of a link by a user is received. The video is rendered along with the result of the selected link. The video is scaled down and rendered as a scaled down video on a portion of the device display. An exemplary video streaming video and result of a selected link is shown at 400. The video and the result of the selected link, which can include a web page, can be rendered in an application or app, in a window associated with a web browser, etc. The app or web browser can be executed on an electronic device 410. The rendering can be accomplished on a display 412 associated with the electronic device. The electronic device can include a computer, a laptop computer, a smartphone, a tablet, a PDA, etc. Rendering of the video streaming video 420 can be accomplished using a frame 422. The frame can occupy a portion of the display. The frames may include frames within an app, frames within a browser window, etc. In embodiments, rendering miniaturized videos and web pages is accomplished without pop-up windows. The results 424 of a selected link may be rendered within a child frame 426. In an example use case, the results of a selected link may include a web page. An embodiment includes launching a child frame in which the web page is displayed. The child frame may be larger than the parent frame 422. In an embodiment, the child frame may surround the video being rendered.

The location of the scaled down video 420 within the frame 422 may include a corner, a center, etc. Results from a link, such as a third party webpage, may be scrolled to allow viewing of the third party content. In an embodiment, scaling down the video to render the video in a portion of a window along with the third party webpage may result in the video being rendered such that the video remains fixed within the browser window while the third party webpage is scrolled. The scaled down video may play while the third party website is scrolled. Content presented on the third party website may be selected for viewing, watching, listening, reading, etc. In an embodiment, rendering the video may achieve a picture-in-picture functionality. The scaled down video may be accompanied by one or more options for selecting further content. The further content may include video, images, text, audio files, etc. The further content may include a webpage. The further content may be rendered. In an embodiment, rendering the video may achieve a page-in-page functionality.

Figure 5 is a system block diagram 500 for rendering videos and web pages. Video, such as video streaming, and results from links, such as links to web pages, can be rendered on a display associated with a computer, personal electronic device, or the like. The rendering can be based on the use of a frame and one or more child frames to display the video and the results of the links. The rendering of the video and web pages is enabled by the frame and child frames. A video stream is received. The video stream is displayed as a video in a window on the device display along with the link. A user selection of a link is received. A video is rendered along with the results of the selected link. The video is scaled down to render the video as a scaled down video on a portion of the device display.

As described throughout, the video associated with the video stream may be viewed by users who are interested in the content of the stream, who are interested in the stream, who are avid followers of the individual associated with the stream, etc. The video associated with the video stream may be received from a server or a social media site, may be provided by an individual, etc. An individual viewing the video associated with the video stream may make a selection of a link to content that may be of interest to the individual. The selection of the link may be indicated by clicking on a link presented with the video stream, a link shared by another viewer in a chat stream, a link embedded in the video stream, etc. The link may point to a webpage, a file such as a text, PDF, audio or image file, an application or app, etc. The webpage pointed to by the link may include one of a number of webpages that may be viewed by the user. The webpage may be rendered with a scaled-down version of the video. The user may interact with the webpage while the video stream continues to play. An embodiment includes the user interacting with the webpage based on the selection of the link while the video is being rendered. The rendering of the webpage and the scaled-down video may be viewed on the electronic device 510. The electronic device may include a desktop or laptop computer, a tablet or smartphone, a personal digital assistant (PDA), etc. The electronic device is coupled to a display 512 capable of rendering video, such as a downscaled video associated with a video stream 514. The video stream may be rendered within a frame 516. The frame may be used to display content, such as a video stream, independent of an app, browser window, etc., that may contain the frame.

The video stream may be received from a video streaming server 518. The video streaming server may include a web-based or cloud-based server, a local server, an electronic device associated with a provider of video streaming, and the like. The video streaming server may provide the video stream using a communication channel 520. The communication channel may include a wired channel, a wireless channel, and the like. As described below, an individual or user may click on a link associated with the video stream. Results 522 from the link may be rendered in a frame 524, which may include a child frame. An embodiment includes launching a child frame in which a web page or other content is displayed. Note that in the system block diagram 500, the frame in which the results from the link may be rendered surrounds the scaled video being rendered. In an embodiment, by rendering the scaled video, a picture-in-picture function may be achieved. The results from the link rendered in the child frame 524 may include a video. In another embodiment, the rendering may be achieved using an inline frame function in an internet browser application. The individual may watch the video while interacting with the content in the child frame. Interactions can include swiping, scrolling, clicking links, radio buttons, and menu selections.

The system block diagram 500 may include a link selection detector 530. The link selection detector may detect when an individual selects a link, which may include a link provided by a provider or originator of the video stream, a link provided in a chat associated with the video stream, a link embedded in the video stream, and the like. The link may be selected by clicking on the link, swiping, selecting the link from a menu, and the like. The link selection may be received by the link selection detector using a communication channel, such as a wireless communication channel 532. The link selection detector effectively hijacks the link selection and provides a link to a link result server 540, which may be a different server than the server originally accessed by the user. The link result server may provide access to link results by accessing a web page, opening a file, such as a text, PDF, or image file, starting playback of an audio or video file, connecting to a video stream, and the like. The link result server may access link result data 542, such as the files mentioned above. The link result server may provide link results to the child frame 524 using the communication channel. In an embodiment, the communication channel may include a wireless communication channel 544.

6 is a system diagram for display. The display is based on frames and child frames for rendering of videos and web pages. The system 600 can include one or more processors 610 coupled to a memory 612 that stores instructions. The system 600 can include a display 614 coupled to the one or more processors 610 for displaying data, video streaming, videos, web pages, intermediate steps, instructions, and the like. In an embodiment, the one or more processors 610 are coupled to the memory 612 and are configured, when the one or more processors execute the stored instructions, to receive a video stream, display the video stream with a link as a video in a window on a device display, receive a selection of a link by a user, launch a child frame from the window, render the video with the results of the selected link, and scale the video to render the video as a scaled video on a portion of the device display.

The system 600 can include a first receiving component 620. The first receiving component 620 can include functionality and instructions for receiving video streaming. The video streaming can include live video streaming, and the originator of the video streaming can include tastemakers, influencers, artists, musicians, DJs, individuals with content to share, product or service providers, and the like. The video streaming can include content such as news, sports, advertising, political advertising, culture, popular news such as celebrity updates, real-time cute puppy and kitten videos, nature news, and the like. The video streaming can include curated streams, videos from streaming websites, video servers, social media, or other sharing sites, and the like. The videos can be viewed using an app, a web browser, and the like. The system 600 can include a display component 630. The display component 630 can include functionality and instructions for displaying the video streaming as a video in a window on a device display along with a link. Display can be achieved using an app, a window such as a web browser window, a web browser add-on, and the like. Links may include links displayed with the video, links provided by the video provider, URLs included in comments from viewers of the video, links accessible by clicking within the video, etc.

The system 600 may include a second receiving component 640. The second receiving component 640 may include functionality and instructions for receiving a user's selection of a link. A user may select a link by clicking on the link, selecting the link from a menu, or hovering a mouse over a video. In an embodiment, the link may include a webpage Uniform Resource Locator (URL). The user's selection of the link may access a webpage using the URL, open a file such as a text file or an image file, start a video, or open a GIF. In an embodiment, the user's selection is in response to a call to action. The call to action may include a "click here now!" request, answering a question from a live streaming provider, answering a survey, etc. Accessing a webpage, opening a file, etc. generates one or more results for the link. The results for the link may be provided to the receiving component. The system 600 may include a rendering component 650. The rendering component 650 may include functionality and instructions for rendering the video with the results for the selected link. The rendering may be accomplished using an app, a window associated with a web browser, etc. In embodiments, the rendering of the link result may include a web page associated with the web page URL. The rendering may include displaying the video and the link result on a device display. The device may include a server, a computing device such as a desktop or laptop computer, a personal electronic device such as a smart phone, tablet or PDA, etc. The display may include a display associated with the computing device or personal electronic device, a television screen, a projector, etc.

The system 600 may include a minification component 660. The minification component 660 may include functionality and instructions for minifying a video and rendering the video as a minified video on a portion of a device display. The rendering may include displaying the minified video along with the results of the link in a portion of a window associated with an app, browser window, or the like. In an embodiment, the minified video may be rendered over the results of a selected link. The minified video may block or mask portions including the outer web page. In an embodiment, the rendering may be accomplished using an inline frame feature within an internet browser application. In an embodiment, the minifying of the video may be accomplished in response to a minification selection by a user. The minification selection may include clicking or double-clicking the video, clicking a button such as a radio button, clicking a menu selection, or the like. Recall that a link may enable access to a web page, opening a text or image file, playing a video, or the like. In an embodiment, the rendering of the minified video and web page may be accomplished without a pop-up window. The rendering of the results of the link may be accomplished without user action or intervention. In an embodiment, the web page may be launched in an enlarged container window that includes a display of both the web page and the scaled down video. In an embodiment, scaling down may cause the video to be rendered in the bottom right corner of the display. Other locations within the display may be changed. In an embodiment, the change of location may be implemented in response to a user dragging a mouse. Scaling down the video may be accomplished by clicking on the video, moving a cursor away from the video, etc. In an embodiment, scaling down the video is accomplished in response to a user selecting to scale down. User selection may include a button click, menu selection, etc. Further embodiments may include a user interacting with the web page while the video is being rendered. The video may continue to stream, play, etc. In an embodiment, the video may be paused and resumed based on a selection by the user.

The user may interact with the link result. Interaction may include clicking, swiping, zooming, menu selection, etc. In other embodiments, the video may be rendered such that the video remains fixed within the browser window while the link result is scrolled by scaling the video down to render it in a portion of the window along with the link result. The video may continue to play while the web page is scrolled, loaded, viewed, etc. Further embodiments may include scrolling the web page while the location of the video remains fixed. The user may continue to view, interact, etc. with the link result rendered along with the video, may "close" or discard the link result, etc. In embodiments, rendering a scaled-down video may achieve a picture-in-picture function. The smaller picture may include the video and the larger "picture" may include the video, web page, file, etc. In embodiments, the web page may be the outer picture for the picture-in-picture function. Additionally, rendering the video may be displayed as the inner picture for the picture-in-picture function. Other configurations may be used. In embodiments, the video can be rendered to achieve page-in-page functionality. Embodiments can include maximizing the video, after shrinking, within the browser window along with the third-party web page to restore the rendering of the video to its original size. Child frames can be closed.

System 600 is a computer program product embodied in a computer-readable medium for display, the computer program product including code that causes one or more processors to perform the following operations: receive a video stream; display the video stream with a link as a video in a window on a device display; receive a user selection of a link; launch a child frame from the window; render the video with the results of the selected link; and scale the video to render the video as a scaled video on a portion of the device display.

Each of the above methods may be executed on one or more processors of one or more computer systems. Embodiments may include various forms of distributed computing, client/server computing, and cloud-based computing. Furthermore, it will be understood that the illustrated steps or boxes contained in the flowcharts of the present disclosure are merely exemplary and explanatory. These steps may be modified, omitted, repeated, or reordered without departing from the scope of the present disclosure. Furthermore, each step may include one or more substeps. While the foregoing drawings and description illustrate functional aspects of the disclosed systems, no particular implementation or arrangement of software and/or hardware should be inferred from these descriptions unless expressly stated or otherwise clear from the context. All such software and/or hardware arrangements are intended to be within the scope of the present disclosure.

The block diagrams and flow charts illustrate methods, apparatus, systems, and computer program products. Elements and combinations of elements in the block diagrams and flow charts illustrate functions, steps, or groups of steps of methods, apparatus, systems, computer program products, and/or computer-implemented methods. Any and all such functions, referred to generally herein as "circuits," "modules," or "systems," may be implemented by computer program instructions, by special purpose hardware-based computer systems, by a combination of special purpose hardware and computer instructions, by a combination of general purpose hardware and computer instructions, etc.

A programmable apparatus for executing any of the computer program products or computer-implemented methods described above may include one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors, programmable devices, programmable gate arrays, programmable array logic, memory devices, application specific integrated circuits, etc. Each may be suitably used or configured for processing computer program instructions, executing computer logic, storing computer data, etc.

It will be understood that the computer may include the computer program product from a computer-readable storage medium, which may be internal or external, removable and replaceable, or fixed. In addition, the computer may include a basic input/output system (BIOS), firmware, operating system, databases, etc., which may include, interface with, or support the software and hardware described herein.

Embodiments of the invention are not limited to conventional computer applications, nor to programmable devices for executing them. By way of practical example, embodiments of the presently claimed invention may include optical computers, quantum computers, analog computers, and the like. The computer program may be loaded into a computer to produce a particular machine capable of performing any and all of the illustrated functions. The particular machine provides the means for performing any and all of the illustrated functions.

Any combination of one or more computer readable media may be utilized, including, but not limited to, non-transitory computer readable media for storage, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor computer readable storage media, or any suitable combination of the foregoing, portable computer diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM, flash, MRAM, FeRAM, or phase change memory), optical fibers, portable compact disks, optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium of expression that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device.

It will be appreciated that computer program instructions may include computer executable code. Various languages for expressing computer program instructions may include, but are not limited to, C, C++, Java, JavaScript™, ActionScript™, assembly language, Lisp, Perl, Tcl, Python, Ruby, hardware description languages, database programming languages, functional programming languages, imperative programming languages, and the like. In embodiments, computer program instructions may be stored, compiled, or interpreted for execution on a computer, programmable data processing device, heterogeneous combination of processors or processor architectures, and the like. Without being limited thereto, embodiments of the present invention may take the form of web-based computer software, including client/server software, software as a service, peer-to-peer software, and the like.

In embodiments, a computer may enable the execution of computer program instructions including multiple programs or threads. Multiple programs or threads may be processed substantially simultaneously to increase processor utilization and facilitate substantially simultaneous functionality. In implementations, any and all methods, program code, program instructions, etc. described herein may be implemented with one or more threads, which may in turn spawn other threads, which may have priorities associated with them. In some embodiments, a computer may process these threads based on a priority or other order.

Unless expressly stated or otherwise clear from the context, the verbs "perform" and "process" may be used interchangeably to indicate executing, processing, interpreting, compiling, assembling, linking, loading, or combinations of the foregoing. Thus, embodiments that execute or process computer program instructions, computer executable code, or the like, may act on the instructions or code in any and all of the manners described. Furthermore, the illustrated method steps are intended to include any suitable manner of causing one or more parties or entities to perform those steps. The parties performing the steps, or portions of the steps, need not be located within a particular geographic location or national borders. For example, if an entity located within the United States causes a method step, or portions thereof, to be performed outside the United States, the method is deemed to be performed within the United States by the responsible entity.

While the present invention has been disclosed in connection with the preferred embodiments shown and described in detail, various modifications and improvements thereon will become apparent to those skilled in the art. Accordingly, the foregoing examples should not be construed as limiting the spirit and scope of the present invention, which is to be understood in the broadest sense permitted by law.

Claims (41)

1. A computer-implemented method for displaying, comprising:
Receiving video streaming; and
displaying the video stream together with a link as a video in a window on a device display;
receiving a selection of the link by a user;
launching a child frame from said window;
Rendering the animation along with the result of the link being selected, where the result of the link is displayed and the child frame surrounds the animation being rendered;
and scaling down the animation to render the animation as a scaled down animation on a portion of the device display. The method of claim 1, further comprising the user interacting with a web page based on the selection of the link while the video is being rendered. The method of claim 1, wherein the selection by the user is in response to a call to action. The method of claim 1, wherein the video streaming includes live streaming. The method of claim 1, wherein the shrinking of the video is in response to a shrink selection by the user. The method of claim 1, wherein the shrinking causes the video to be rendered in a lower right corner of the window. The method of claim 1, wherein the link includes a web page uniform resource locator (URL). The method of claim 7, wherein the rendering of the result of the link includes a web page associated with the web page URL. The method of claim 8, wherein the rendering of the scaled down video and web page is accomplished without pop-up windows. The method of claim 1, further comprising changing the location for displaying the reduced video. The method of claim 10, wherein the changing of location is in response to the user dragging a mouse. The method of claim 1, further comprising scrolling the web page while the location of the video remains fixed. The method of claim 1, further comprising maximizing the video after the shrinking to restore rendering of the video to its original size. The method of claim 1, wherein the rendering of the reduced video achieves a picture-in-picture function. The method of claim 14, wherein a web page is the outer picture for the picture-in-picture feature. The method of claim 15, wherein the rendering of the video is an inner picture for the picture-in-picture function. The method of claim 16, wherein the web page includes another video that is displayed along with the reduced video. The method of claim 1, wherein the rendering of the scaled down video achieves a page-in-page function. The method of claim 1, wherein the rendering is accomplished using an inline frame feature within an internet browser application. The method of claim 1, wherein the web page is launched in an enlarged container window that includes a representation of both the web page and a scaled version of the video. The method of claim 1, wherein the scaled down video is rendered over the result of the selected link. The method of claim 1, wherein the video is paused and resumed based on a selection by the user. The method of claim 1, further comprising the user manipulating the results of the link. 24. The method of claim 23, wherein the manipulating includes scrolling through the results. 24. The method of claim 23, wherein the manipulating includes starting and pausing the rendering of the result. A computer program product embodied in a computer readable medium for display, the computer program product including code, the code configured to cause one or more processors to:
Receiving video streaming; and
displaying the video stream together with a link as a video in a window on a device display;
receiving a selection of the link by a user;
launching a child frame from said window;
Rendering the animation along with the result of the link being selected, where the result of the link is displayed and the child frame surrounds the animation being rendered;
and scaling down the animation to render the animation as a scaled down animation on a portion of the device display. 27. The computer program product of claim 26, further comprising the user interacting with a web page based on the selection of the link while the video is being rendered. The computer program product of claim 26, wherein the selection by the user is in response to a call to action. The computer program product of claim 26, wherein the shrinking of the video is in response to a shrink selection by the user. The computer program product of claim 29, wherein the shrinking causes the video to be rendered in a lower right corner of the window. 27. The computer program product of claim 26, wherein the link includes a web page uniform resource locator (URL). The computer program product of claim 31, wherein the rendering of the result of the link includes a web page associated with the web page URL. The computer program product of claim 26, further comprising changing the location for displaying the scaled down video. A computer system for displaying,
A memory storing instructions;
one or more processors coupled to the memory, wherein, when the one or more processors execute the stored instructions,
Receiving video streaming; and
displaying the video stream together with a link as a video in a window on a device display;
receiving a selection of the link by a user;
launching a child frame from said window;
Rendering the animation along with the result of the link being selected, where the result of the link is displayed and the child frame surrounds the animation being rendered;
and one or more processors configured to: downscale the animation and render the animation as a downscaled animation on a portion of the device display. The computer system of claim 34, further configured to cause the user to interact with a web page based on the selection of the link while the video is being rendered. The computer system of claim 34, wherein the selection by the user is in response to a call to action. The computer system of claim 34, wherein the shrinking of the video is in response to a shrink selection by the user. The computer system of claim 37, wherein the shrinking causes the video to be rendered in a lower right corner of the window. The computer system of claim 34, wherein the link includes a web page uniform resource locator (URL). The computer system of claim 39, wherein the rendering of the result of the link includes a web page associated with the web page URL. The computer system of claim 34, further configured to change the location for displaying the scaled down video.