US20220398996A1 - Customizable compact overlay window - Google Patents

Customizable compact overlay window Download PDF

Info

Publication number
US20220398996A1
US20220398996A1 US17/667,239 US202217667239A US2022398996A1 US 20220398996 A1 US20220398996 A1 US 20220398996A1 US 202217667239 A US202217667239 A US 202217667239A US 2022398996 A1 US2022398996 A1 US 2022398996A1
Authority
US
United States
Prior art keywords
application
overlay window
compact overlay
window
user input
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US17/667,239
Inventor
Nils Sundelin
Bret Anderson
Samuel George Gates
Richard Fang
Miron Vranjes
Christopher Doan
Abhishek Malani
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Priority to US17/667,239 priority Critical patent/US20220398996A1/en
Publication of US20220398996A1 publication Critical patent/US20220398996A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14Display of multiple viewports
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/12Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels

Definitions

  • a computing system includes one or more processors and a storage device that stores computer executable instructions that can be executed by the processors to cause the computing system to perform the following.
  • the system receives from an application running on the computing system customization parameters that define how the application is to be configured in a compact overlay window.
  • the system generates the compact overlay window so that the compact overlay window is customizable according to the customization parameters.
  • the system positions the compact overlay window in a portion of a display of the computing system.
  • a computing system includes one or more processors and a storage device that stores computer executable instructions that can be executed by the processors to cause the computing system to perform the following.
  • the system receives a definition of one or more regions of a customizable compact overlay window where user input is to be passed directly to an application that uses the compact overlay window.
  • the system generates the customizable compact overlay window with the defined regions in a display of the computing system.
  • the user input is directly passed to the application, where the user input can be interpreted by the application in a manner determined by the application.
  • the computing system interprets the user input.
  • a computing system includes one or more processors and a storage device that stores computer executable instructions that can be executed by the processors to cause the computing system to perform the following.
  • the system implements in a display a customizable compact overlay window that is customizable by an application that uses the compact overlay window.
  • the system receives input into at least a portion of the compact overlay window.
  • the system directly passes the input to the application. If the application has defined a response to the input to the at least one portion of the compact overlay window, any response to the input is determined by the defined response of the application. If the application has not defined a response, the system determines a response to the input.
  • FIG. 1 illustrates an example computing system in which the principles described herein may be employed
  • FIGS. 2 A- 2 E illustrate embodiments of a compact overlay window
  • FIG. 3 illustrates an embodiment of a computing system for implementing a customizable compact overlay window in a display
  • FIGS. 4 A- 4 D illustrate embodiments of implementing a customizable compact overlay window in a display
  • FIGS. 5 A and 5 B illustrate embodiments of a customizable compact overlay window having defined regions for passing user input directly to an application
  • FIG. 6 illustrates an alternative embodiment of a computing system for implementing a customizable compact overlay window in a display that passes all user input to an application
  • FIG. 7 illustrates a flow chart of an example method for implementing a compact overlay window in a display
  • FIG. 8 illustrates a flow chart of an alternative example method for implementing a compact overlay window in a display
  • FIG. 9 illustrates a flow chart of an alternative example method for implementing a compact overlay window in a display.
  • FIG. 1 Some introductory discussion of a computing system will be described with respect to FIG. 1 . Then, the computing system for implementing a compact overlay window will be described with respect to FIG. 2 through FIG. 9 .
  • Computing systems are now increasingly taking a wide variety of forms.
  • Computing systems may, for example, be handheld devices, appliances, laptop computers, desktop computers, mainframes, distributed computing systems, datacenters, or even devices that have not conventionally been considered a computing system, such as wearables (e.g., glasses).
  • the term “computing system” is defined broadly as including any device or system (or combination thereof) that includes at least one physical and tangible processor, and a physical and tangible memory capable of having thereon computer-executable instructions that may be executed by a processor.
  • the memory may take any form and may depend on the nature and form of the computing system.
  • a computing system may be distributed over a network environment and may include multiple constituent computing systems.
  • a computing system 100 typically includes at least one hardware processing unit 102 and memory 104 .
  • the memory 104 may be physical system memory, which may be volatile, non-volatile, or some combination of the two.
  • the term “memory” may also be used herein to refer to non-volatile mass storage such as physical storage media. If the computing system is distributed, the processing, memory and/or storage capability may be distributed as well.
  • the computing system 100 also has thereon multiple structures often referred to as an “executable component”.
  • the memory 104 of the computing system 100 is illustrated as including executable component 106 .
  • executable component is the name for a structure that is well understood to one of ordinary skill in the art in the field of computing as being a structure that can be software, hardware, or a combination thereof.
  • the structure of an executable component may include software objects, routines, methods, and so forth, that may be executed on the computing system, whether such an executable component exists in the heap of a computing system, or whether the executable component exists on computer-readable storage media.
  • the structure of the executable component exists on a computer-readable medium such that, when interpreted by one or more processors of a computing system (e.g., by a processor thread), the computing system is caused to perform a function.
  • Such structure may be computer-readable directly by the processors (as is the case if the executable component were binary).
  • the structure may be structured to be interpretable and/or compiled (whether in a single stage or in multiple stages) so as to generate such binary that is directly interpretable by the processors.
  • executable component is also well understood by one of ordinary skill as including structures that are implemented exclusively or near-exclusively in hardware, such as within a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or any other specialized circuit. Accordingly, the term “executable component” is a term for a structure that is well understood by those of ordinary skill in the art of computing, whether implemented in software, hardware, or a combination. In this description, the terms “component”, “agent”, “manager”, “service”, “engine”, “module”, “virtual machine” or the like may also be used. As used in this description and in the case, these terms (whether expressed with or without a modifying clause) are also intended to be synonymous with the term “executable component”, and thus also have a structure that is well understood by those of ordinary skill in the art of computing.
  • FPGA field programmable gate array
  • ASIC application specific integrated circuit
  • embodiments are described with reference to acts that are performed by one or more computing systems. If such acts are implemented in software, one or more processors (of the associated computing system that performs the act) direct the operation of the computing system in response to having executed computer-executable instructions that constitute an executable component.
  • processors of the associated computing system that performs the act
  • Such computer-executable instructions may be embodied on one or more computer-readable media that form a computer program product.
  • An example of such an operation involves the manipulation of data.
  • the computer-executable instructions may be stored in the memory 104 of the computing system 100 .
  • Computing system 100 may also contain communication channels 108 that allow the computing system 100 to communicate with other computing systems over, for example, network 110 .
  • the computing system 100 includes a user interface system 112 for use in interfacing with a user.
  • the user interface system 112 may include output mechanisms 112 A as well as input mechanisms 112 B.
  • output mechanisms 112 A might include, for instance, speakers, displays, tactile output, holograms and so forth.
  • Examples of input mechanisms 112 B might include, for instance, microphones, touchscreens, holograms, cameras, keyboards, mouse of other pointer input, sensors of any type, and so forth.
  • Embodiments described herein may comprise or utilize a special purpose or general-purpose computing system including computer hardware, such as, for example, one or more processors and system memory, as discussed in greater detail below.
  • Embodiments described herein also include physical and other computer-readable media for carrying or storing computer-executable instructions and/or data structures.
  • Such computer-readable media can be any available media that can be accessed by a general purpose or special purpose computing system.
  • Computer-readable media that store computer-executable instructions are physical storage media.
  • Computer-readable media that carry computer-executable instructions are transmission media.
  • embodiments of the invention can comprise at least two distinctly different kinds of computer-readable media: storage media and transmission media.
  • Computer-readable storage media includes RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other physical and tangible storage medium which can be used to store desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computing system.
  • a “network” is defined as one or more data links that enable the transport of electronic data between computing systems and/or modules and/or other electronic devices.
  • a network or another communications connection can include a network and/or data links which can be used to carry desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computing system. Combinations of the above should also be included within the scope of computer-readable media.
  • program code means in the form of computer-executable instructions or data structures can be transferred automatically from transmission media to storage media (or vice versa).
  • computer-executable instructions or data structures received over a network or data link can be buffered in RAM within a network interface module (e.g., a “NIC”), and then eventually transferred to computing system RAM and/or to less volatile storage media at a computing system.
  • a network interface module e.g., a “NIC”
  • storage media can be included in computing system components that also (or even primarily) utilize transmission media.
  • Computer-executable instructions comprise, for example, instructions and data which, when executed at a processor, cause a general purpose computing system, special purpose computing system, or special purpose processing device to perform a certain function or group of functions. Alternatively or in addition, the computer-executable instructions may configure the computing system to perform a certain function or group of functions.
  • the computer executable instructions may be, for example, binaries or even instructions that undergo some translation (such as compilation) before direct execution by the processors, such as intermediate format instructions such as assembly language, or even source code.
  • the invention may be practiced in network computing environments with many types of computing system configurations, including, personal computers, desktop computers, laptop computers, message processors, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile telephones, PDAs, pagers, routers, switches, datacenters, wearables (such as glasses) and the like.
  • the invention may also be practiced in distributed system environments where local and remote computing systems, which are linked (either by hardwired data links, wireless data links, or by a combination of hardwired and wireless data links) through a network, both perform tasks.
  • program modules may be located in both local and remote memory storage devices.
  • Cloud computing environments may be distributed, although this is not required. When distributed, cloud computing environments may be distributed internationally within an organization and/or have components possessed across multiple organizations.
  • cloud computing is defined as a model for enabling on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services). The definition of “cloud computing” is not limited to any of the other numerous advantages that can be obtained from such a model when properly deployed.
  • FIGS. 2 A- 2 D which will be used to explain the concept of a compact overlay window, which may also be commonly referred to as a Picture-in-Picture or PIP window.
  • a compact overlay window is defined to mean a computer window that is “on top” of at least one other computer window in a display of a computing system.
  • the term “on top” is from a Z-order perspective of how the various windows are stacked in the display.
  • a compact overlay window is stacked “on top” of another window when it is “closest” to the eye of a user who is looking at the display.
  • the compact overlay window may be the most on top window in a stack of displays.
  • one of the compact overlay windows may be on top of another compact overlay window, but may have another compact overlay window on top of it.
  • a notification or other UI element may be on top of a compact overlay window.
  • a compact overlay window is generally the most on top window in the display stack, but this need not always be the case.
  • FIGS. 2 A- 2 D are drawn for ease of explanation only and thus the relative size differences between the windows, the amount of space each window is shown occupying in the display, or the amount unoccupied space in the display is not to be limiting of the embodiments disclosed herein. Further, these figures show the windows as rectangles or having rectangular regions. Again, this is for ease of illustration only. It will be appreciated that a compact overlay region can have any reasonable shape. Further, a compact overlay window can have non-rectangular regions or no regions at all.
  • FIG. 2 A illustrates one embodiment of a compact overlay window.
  • a display 210 is shown.
  • the display 210 may be a display or monitor of a computer, a tablet, a smartphone, or the like.
  • a window 220 is displayed in the display 210 .
  • the window 220 may be implemented by a first application so that the window 220 shows at least some of the visual portions of the application such as User Interface (UI) elements as the application is running or being executed by the computing system.
  • UI User Interface
  • a compact overlay window 230 is also shown in the display. In the embodiment of FIG. 2 A , the compact overlay window 230 is on top of or overlays a portion of the window 220 .
  • the compact overlay window 230 may be implemented by the first application so that the compact overly window 230 shows at least some of the visual portions of the first application such as User Interface (UI) elements as the application is running or being executed by the computing system.
  • the compact overly window may be implemented by a second application so that the compact overly window 230 shows at least some of the visual portions of the second application such as User Interface (UI) elements as the second application is running or being executed by the computing system.
  • UI User Interface
  • the compact overlay window 230 is generally of a smaller size than at least one other window in the display such as window 220 , as is shown in FIG. 2 A .
  • the compact overlay window 230 need not necessarily be smaller as long as it is “on top” as previously described. It will be appreciated, however, that if the compact overlay window 230 is the same size or close to the same size as the window 220 , then the window 220 may not be viewable or useable by a user of the computing system 200 .
  • FIG. 2 B shows an alternative embodiment of a compact overlay window.
  • the compact overlay window 230 is not on top of a portion of the window 220 .
  • FIG. 2 C illustrates a further embodiment of a compact overlay window.
  • the compact overlay window 230 is on top of the window 220 and a second window 221 .
  • this embodiment shows that a compact overlay window may be on top of more than one window. In this embodiment, all of the window may be active simultaneously.
  • FIG. 2 D illustrates another embodiment of a compact overlay window.
  • a second compact overlay window 231 is on top of the window 220 along with the compact overlay window 230 .
  • This embodiment shows that there can be more than one compact overlay window that is implemented in the display 210 at the same time. As with the other embodiments, all of the window may be active simultaneously.
  • FIG. 2 E illustrates another embodiment of a compact overlay window
  • a second compact overlay window 231 is on top of a portion of the compact overlay window 230 .
  • This embodiment shows, as discussed above, where there are multiple compact overlay windows, then one of the compact overlay windows may be on top of another compact overlay window. Although not illustrated. As with the other embodiments, all of the window may be active simultaneously.
  • FIG. 3 illustrates an embodiment of a computing system 300 , which may correspond to the computing system 100 previously described.
  • the computing system 300 includes various components or functional blocks that may implement the various embodiments disclosed herein as will be explained.
  • the various components or functional blocks of computing system 300 may be implemented on a local computing system or may be implemented on a distributed computing system that includes elements resident in the cloud or that implement aspects of cloud computing.
  • the various components or functional blocks of the computing system 300 may be implemented as software, hardware, or a combination of software and hardware.
  • the computing system 300 may include more or less than the components illustrated in FIG. 3 and some of the components may be combined as circumstances warrant.
  • the various components of the computing system 300 may access and/or utilize a processor and memory, such as processor 102 and memory 104 , as needed to perform their various functions.
  • the computing system 300 may include an application 310 , an application 320 , and any number of additional applications as denoted by ellipses 330 .
  • the applications 310 , 320 , and 330 may be any type of program or executable code that is configured to run on or be executed by the computing system 300 .
  • Examples of the applications include, but are not limited to, video streaming applications, audio streaming applications, other media applications, browsing applications, gaming applications, and coding applications.
  • video streaming application as an example application
  • any type of application may be implemented as a compact overlay window and thus the embodiments disclosed herein are not limited to video, audio, or media streaming applications. Accordingly, the embodiments disclosed herein are not limited to any particular type of application.
  • the application 310 may include various customization parameters 315 A, 315 B, 315 C and any number of additional customization parameters as denoted by ellipses 315 D, hereinafter also referred to as customization parameters 315 .
  • the customization parameters 315 may define various features that the application 310 may render in a compact overlay window of the computing system as will be discussed in more detail to follow.
  • the customization parameters may be declarative statements that define the given features.
  • the customization parameters 315 may define application specific controls, application specific branding, or any type of application specific User Interface (UI) element as circumstances warrant.
  • UI User Interface
  • the application specific controls for a video or audio streaming application may include, but are not limited to, a play button, a stop button, a pause button, or a scrub bar that moves to a desired portion of a video or audio stream.
  • the application specific branding may include, but is not limited to, the name of the company or developer who developed the application or it may include other types of advertising.
  • the application specific UI elements may include, but are not limited to, an element such as a thumb up or down for rating the content, a picture of a user, information about the application, a work pane, or any other type of UI element that is needed for the application to perform its intended task. Accordingly, the customization parameters 315 allow the application 310 to customize the compact overlay window in any desired manner.
  • the customization parameters 315 allow the application 310 to have full or near full control or ownership of the compact overlay window as will be discussed in more detail to follow. This is an advantage over existing systems where an application does not have any control over a compact overlay window, but is limited to the customization determined by the computing system.
  • the customization parameters 315 may also specify a desired size of the compact overlay window or a desired location of the compact overlay window in a display of the computing system.
  • the customization parameters 315 may specify that the application 310 that is running in a non-compact overlay window in a display of the computing system should become a compact overlay window or should launch a new compact overlay window as will be explained in more detail to follow.
  • the customization parameters 315 may specify that the application 310 launch as a compact overlay window as will also be explained in more detail to follow.
  • the application 320 may include various customization parameters 325 A, 325 B, 325 C and any number of additional customization parameters as denoted by ellipses 325 D, hereinafter also referred to as “customization parameters 325 .
  • the customization parameters 325 may define various features that the application 320 may render in a compact overlay window of the computing system in the manner discussed previously in relation to the customization parameters 315 .
  • the computing system 300 may also include a compact overlay window manger component 340 (hereinafter also referred to as “compact overlay window manager”).
  • the compact overlay window manager 340 may include various components or modules for allowing one of the applications to generate or render a compact overlay window and then for positioning the compact overlay window in the display.
  • the compact overlay window manager 340 may include a generation module 345 .
  • the generation module 345 may include or access those elements of the computing system 300 that allow the applications 310 , 320 , and/or 330 to generate the compact overlay window.
  • the generation module 345 may include or expose various APIs that allow the applications to access or expose the underlying elements of the computing system 300 that are used by the application in generating the compact overlay window.
  • the generation module 345 may receive the customization parameters 315 from the application 310 or the customization parameters 325 from the application 320 .
  • the generation module 345 may then generate or cause to be generated a compact overlay window on behalf of the application 310 or 320 so that the application 310 or 320 may run or execute in the compact overlay window.
  • the compact overlay window manager 340 may also include a system constraint manager component 346 that includes various system constraints 347 A, 347 B, and any number of additional system constraints as denoted by the ellipses 347 C, which may also be referred to jointly as system constraints 347 .
  • the system constraints 347 define constraints that may be applied to the customization parameters 315 and/or 325 so that the compact overlay window specified by customization is configured in a manner acceptable to the computing system. It will be noted that the system constraints 347 may include any other reasonable constraint and thus the embodiments disclosed herein are not limited by any particular type of system constraint.
  • the system constraint 347 A may specify a minimum and/or a maximum size for the compact overlay window. If one of the customization parameters 315 and/or 325 specify a size of the compact overlay window that is larger than the specified maximum size or that is smaller than the specified minimum size, the generation module 345 will not follow the customization parameter, but will instead generate the compact overlay window that is within the defined minimum and maximum sizes.
  • the system constraint 347 B may specify what portions of a display of the computing system the compact overlay window may be positioned in. If one of the customization parameters 315 and/or 325 specifies a location that violates the specified portions of the display, then this customization parameter will be ignored and the compact overlay window will be placed in a position that is acceptable to the computing system. For example, the customization parameters 315 and/or 325 may specify a position in the display that is already occupied by an existing compact overlay window and so the compact overlay window will need to be placed in another portion of the display.
  • the makeup and feel in terms of a user experience of the compact overlay window is left the application 310 , 320 , and/or 330 as the compact overlay window manager 340 will allow the applications to render any of the customization parameters 315 or 325 that do not conflict with the system constraints 347 .
  • the compact overlay window manager 340 may only prevent the rendering of a customization parameter when the conflict with the system constraints 347 is present.
  • the compact overlay window manager 340 may also include a positioning component 348 .
  • the positioning component 348 may position the compact overlay window in the display of the computing system. As mentioned above, if a customization parameter specifies a location that is acceptable to the computing system, then the positioning component 348 will position the compact overlay window at that location. In addition, the positioning component 348 may resize and reposition the compact overlay window in the display in response to various user input.
  • the positioning component 348 may also be configured to interpret various user input and then to cause the compact overlay window manager 340 to react accordingly.
  • some user input may be directed at various controls and other UI elements rendered in the compact overlay window as specified by one or more of the customization parameters 315 and/or 325 .
  • Such input may be passed to the application to interpret in a manner determined by the application, which will usually be in accordance with the control or UI element.
  • input directed at a play button will usually be interpreted by the application to mean the user wants to activate the play button to start a video or audio stream.
  • some user input may be directed towards areas of the compact overlay window that do not include UI elements specified by the customization parameters.
  • the positioning component 348 may then interpret such user input and determine an appropriate response to the input.
  • the computing system 300 may also include a computer system display 350 , a computer system display 360 , and any number of additional computer system displays as denoted by the ellipses 370 .
  • the computing system displays may be a display or monitor of a computer, a tablet, a smartphone, or the like. Thus, the embodiments disclosed herein are not limited by the type of the computing system display.
  • one or more compact overlay windows may be implemented in one or more of the computing system displays 350 , 360 , or 370 .
  • FIG. 4 A illustrates a window 410 that implements the application 310 that is displayed in the computing system display 350 .
  • the application 310 may be a video streaming application that shows video stream 411 .
  • some of the customization parameters 315 have been rendered as the following features for a video stream: a play button 412 , a stop button 413 , a scrub bar 414 , and other UI elements 415 that are helpful for the playing of the video stream 411 .
  • a customization parameter 315 may cause the name of the application developer “Streaming Video Service” 416 to be rendered in the window.
  • the customization parameters 315 may specify that non-standard video controls or the like 417 and 418 may also be rendered in the compact overlay window 410 .
  • a non-standard controller 417 may be a favorite button that allows a user to mark his or her favorite video or part thereof so that the video or part thereof can be found easily at a later time.
  • the non-standard controller 418 may be a thumbs up or down element that allows the user to rate the video stream or to otherwise leave comments regarding the video stream.
  • non-standard video controls or the like 417 and 418 may be any type of controller.
  • the compact overlay windows of the embodiments disclosed herein provide for customization as desired by a developer or user and are not limited to a small sub-set of customizations.
  • the window 410 may include a user input element 420 .
  • a user may enter input into the user input element 420 to initiate the generation of a compact overlay window for the application 310 .
  • one of the customization parameters 315 may initiate the generation of the compact overlay window 430 by specifying that application 310 should be configured as a compact overlay window, and this may be considered as input that initiates the generation of a compact overlay window for the application 310 .
  • a second application such as application 320 may initiate the generation of compact overlay window for the application 310 .
  • the customization parameters 315 may specify that the window 410 become the compact overlay window 430 .
  • the application 310 may choose to make itself the compact overlay window 430 .
  • the compact overlay window 430 is a smaller sized version of the window 410 that includes the same user interface elements or features. In this way, a user is able to continue to watch the video stream 411 in the compact overlay window 430 .
  • the positioning component 348 may position and/or size the compact overlay window 230 in the display 350 , for example in the right corner of the display 350 as shown in FIG. 4 B .
  • the positioning and sizing will typically be specified by one of the customization parameters 315 as determined by the application 310 . However, if the customization parameter is in conflict with the system constraints 347 , then the positioning component 348 may move and/or resize the compact overlay window 430 .
  • the positioning component 348 may also move and/or resize the compact overlay window 430 in response to user input. This is illustrated in FIG. 4 B , where the dashed line window 430 has been moved to the left corner of the display 350 .
  • the positioning component 348 may dynamically reposition and/or resize the compact overlay window 230 as circumstances warrant to ensure that the compact overlay window 430 remains on top of any other windows or other elements such as pop-ups or notifications that may appear in the display 350 .
  • a window 440 may then implement the application 310 or the application 320 while the compact overlay window 430 is implementing the application 310 .
  • both the compact overlay window 430 and the window 440 may be active simultaneously. For example, suppose the application 320 was a web browser that was implemented in the window 440 . Accordingly, a user would be able to actively watch the video stream 411 in the compact overlay window 430 at the same time as browsing the internet in the window 440 .
  • the customization parameters 315 may specify that a second compact overlay window 450 for implementing the application 310 should also be generated while the compact overlay window 430 exists.
  • the compact overlay window 450 may include UI elements 451 , 452 , and any number of additional UI elements as denoted by ellipses 453 that are specified by the customization parameters 315 .
  • the compact overlay window 450 may show the video stream 411 or it may show some other aspect of the application 310 , such as a scene guide or actor explanation.
  • the window 440 it will be appreciated that all three of the windows 430 , 440 , and 450 may be active and usable by the user at the same time. Accordingly, the embodiments disclosed herein are not limited to any specific number of compact overlay windows that may be implemented by an application as there may any reasonable number that does not violate the system constraints 348 and that can be handled in the available space of the display 350 .
  • the customization parameters 315 may specify that a new compact overlay window 460 be generated.
  • the application 310 may choose to generate a new compact overlay window while the original window remains in the display rather than make itself the compact overlay window. Accordingly, as shown in FIG. 4 C , a compact overlay window 460 is implemented for the application 310 in addition to the window 410 .
  • the compact overlay window 460 is related to the video stream 411 of window 410 and shows various UI elements specified by the customization parameters 315 such as an UI element 461 that lists the actors of the video stream 411 , a UI element 462 that shows a scene guide for the video stream 411 , and a UI element that lists the name of the music played in the video stream 411 .
  • the compact overlay window 460 may show other aspects of the application 310 or it may even show a mirror of the window 410 as circumstance warrant.
  • both the window 410 and the compact overlay window 460 may be active at the same time so that a user may use them simultaneously.
  • the application 320 may specify that a compact overlay window be implemented in the display 350 at the same time as the compact overlay window 460 is implemented. Accordingly, as also shown in FIG. 4 C , a compact overlay window 470 is implemented for the application 320 in the display 350 . In other words, the application 320 may be launched as the compact overlay window 470 .
  • the application 320 may be a video streaming application that shows a live action video stream 471 of a sporting event.
  • the compact overlay window 470 may include UI elements 472 , 473 , and any number of additional UI elements as denoted by ellipses 473 that are specified by the customization parameters 325 .
  • FIG. 4 C shows that it is possible to have compact overlay windows that implement different applications at the same time.
  • a user would be able to watch the video stream 411 and the live sports stream 471 at the same time.
  • the web browser were implemented in the window 440 , then the user would be able to also to browse the internet while also watching the video stream 411 and the live sports stream 471 .
  • the display 350 may be a display for a smartphone or a small tablet. Accordingly, the display is relatively small.
  • a user is watching the video stream 411 in the display 350 as shown in FIG. 4 D and that the user also is writing code in a window 480 of a display 360 that is a monitor for a computer.
  • the application 310 in conjunction with the compact overlay window manager 340 may generate the compact overlay window 430 in the display 360 so as to overlay or be on top of the window 480 .
  • this may be accomplished by informing a version of the application 310 associated with the display 360 that it should launch as a compact overlay window and also informing the version of the application what UI elements to render and where in the video streaming to begin at.
  • the positioning component 248 of the computing system or a positioning component that is associated with the display 360 may then position the compact overlay window in the appropriate place in the display 360 . In this way, the user is more easily able to continue watching the video stream 411 while also coding in the window 480 .
  • the embodiments disclosed herein contemplate generating compact overlay windows on multiple displays of the computing system 300 .
  • the application 310 may generate a definition 316 of specific regions or portions of a compact overlay window where any user input is to be passed directly by the compact overlay window manager 340 to the application.
  • the definition 316 may define any number of regions of the compact overlay window.
  • the definition 316 is used in conjunction with the customization parameters 315 by defining those regions of the compact overlay window where any user input that is to be passed directly to the application to correspond to those regions where the customization parameters define controls and other UI elements in the manner previously described.
  • the generation module 345 receives the definition 316 and ensures that the compact overlay window is generated with the defined regions.
  • the applications 320 and 330 may also include a definition similar to the definition 316 as circumstances warrant.
  • FIG. 5 A illustrates a compact overlay window 510 that implements or runs a video stream 511 where specific regions of the window have been defined where any user input is to be passed directly to an application, such as application 310 .
  • an application such as application 310 .
  • the display and other windows are omitted and only the compact overlay window 510 is shown in the figure.
  • the compact overlay window 510 may correspond to any of the previously described embodiments of a compact overlay window and so may include any of the properties and advantages previously discussed in relation to any of the previously described embodiments of a compact overlay window.
  • the defined regions of the compact overlay window 510 where any user input is to be passed directly to the application are denoted by dashed boxes 520 , 530 , 540 , 550 , and 560 .
  • the defined regions 520 , 530 , 540 , and 550 may also correspond to the location of various video steaming features specified by the customization parameters 315 such as a play button 525 , a stop button 535 , other UI elements 545 , and a scrub bar 555 .
  • the defined region 560 does not correspond to the location of any features specified by the customization parameters 315 .
  • the defined region 520 may receive user input represented by the arrow 575 and hereinafter called user input 575 .
  • the user input 575 (and the user input 576 and 577 and all other user input discussed herein) may correspond to a mouse click, to a touch of a finger or stylus, to a keyboard entry, or any other reasonable form of user input.
  • the user input 575 may then be passed directly by the compact overlay window manager 340 to the application 310 . This allows the application 310 to interpret the user input 375 in a manner determined by the application and to respond to the input in a manner determined by the application.
  • the application 310 will likely interpret the user input 276 as indicating that the user desires to play the video stream 511 and will correspond accordingly. Similar results would also occur if the user input 575 were received by the defined regions 530 , 540 , and 550 .
  • the defined region 560 may receive user input represented by the arrow 576 (hereinafter called user input 576 ) that may be passed directly by the compact overlay window manager 540 to the application 310 .
  • the application 310 may then interpret this input in a manner determined by the application. For example, in one embodiment the application 310 may hide the controls 525 , 535 , 545 , and 555 while the video 511 is playing to increase the user experience by not crowding the compact overlay window.
  • the application 310 may interpret the user input 376 as an indication that the user wants to see one or more of the controls. Accordingly, the application 310 may respond by causing the compact overlay window manager 340 to make the controls visible to the user so that user may use the controls.
  • FIG. 5 B illustrates an alternative embodiment of the compact overlay window 5 B.
  • the defined regions 520 , 530 , 540 , and 550 in addition to the defined region 560 do not necessarily correspond to a location of a feature specified by the customization parameters 315 .
  • the application 310 may interpret and respond to the input dynamically. For example, in one instance the application 310 may interpret the user input 575 as a request to play the video stream 511 in a manner similar to the embodiment of FIG. 5 A and may respond by playing the video stream 511 and/or causing the play button 525 to be rendered in the region by the compact overlay window manager 340 .
  • the application may interpret the user input 575 as being a request to stop or pause the video stream 511 and may respond by stopping or pausing the video stream and/or causing the stop button 535 to be rendered in the defined region 520 causing the compact overlay window manager 340 .
  • the defined regions are able to be dynamically interpreted in any manner at any time by the application 310 as the application deems appropriate.
  • those portions of the compact overlay window 510 that are not part of the defined regions 520 , 530 , 540 , 550 , and 560 may be considered part of a non-defined region 580 .
  • the non-defined region 580 may include the remaining portions of window not part of the defined region or it may include a subset of the remaining portions.
  • the non-defined region 580 may receive user input represented by the arrow 577 and hereinafter called user input 577 .
  • the user input is not passed to the application 310 , but is interpreted by the positioning component 348 or some other part of compact overlay manager 340 . Based on the interpretation, the positioning component 348 may respond to the input in an appropriate way.
  • the user input 577 may be a mouse or finger movement that drags the compact overlay window 510 and thus is indicative that the user desires to move the compact overlay window 510 to a different location of the display. Assuming that such movement does not violate one of the system constraints 347 , the positioning component 348 may move the compact overlay window to the new location.
  • the user input 577 may be a pinch finger movement or a mouse zoom movement that widens the compact overlay window 510 and thus is indicative that the user desires to resize the compact overlay window 510 . Assuming that such resizing does not violate one of the system constraints 347 , the positioning component 348 may resize the compact overlay window 510 to the desired new size.
  • the compact overlay window manager 340 may inform the application 310 of the user input 577 so that the application may interpret and respond to the input in a manner determined by the application.
  • the user input 577 may be a mouse click or finger tap in the non-defined region 580 .
  • Such user input would not typically be indicative of the user wanting to move or resize the compact overlay window 510 or of some other typical windowing action performed by the compact overlay window manager 340 .
  • the compact overlay window manager 340 may inform the application 310 of the user input 577 so that the application may interpret and respond to the input.
  • the mouse click or finger tap may indicate that the user desires to hide or unhide the controls 535 , 535 , 545 , and 555 in the manner similar to that discussed in relation to defined region 560 .
  • the application 310 may cause that the controls be hidden or unhidden.
  • FIG. 6 represents an alternative embodiment of the computing system 300 .
  • the application 310 may include one or more defined responses to various user inputs.
  • the defined responses may include one or more event handlers that are part of a tree structure that defines the controls rendered by the application 310 . If one of the defined responses corresponds to the user input, then the application determines a response to the input in accordance with the defined response. However, if one of the defined responses does not correspond to the user input, then the user input is passed to the compact overlay window manager 340 .
  • the compact overlay window manager specifically the positioning component 348 may then determine an appropriate response to the user input.
  • a compact overlay window 610 that implements or runs a video stream 611 is shown in FIG. 6 .
  • the display and other windows are omitted and only the compact overlay window 610 is shown in the figure.
  • the compact overlay window 610 may correspond to any of the previously described embodiments of a compact overlay window and so may include any of the properties and advantages previously discussed in relation to any of the previously described embodiments of a compact overlay window.
  • some of the customization parameters 315 have been rendered as the following features for a video stream: a play button 620 , a stop button 630 , and a scrub bar 640 .
  • user input represented by the arrow 661 may be received by the play button 620 .
  • This user input may be passed directly to the application 310 as illustrated by arrow 670 .
  • the application 310 may include, as discussed above, defined responses for various user inputs.
  • the application 310 may include various event handlers 671 , 672 , 673 and any number of additional event handlers as denoted by ellipses 674 .
  • the event handler 671 may be configured to be triggered by user input for a play button control. Accordingly, the event handler 671 may be triggered by the user input 661 and the application 310 may make an appropriate response as illustrated by arrow 675 , which in this case would be to play the video stream 611 .
  • user input represented by the arrow 662 may be received by the stop button 630 and user input represented by the arrow 663 (hereinafter referred to as user input 663 ) may be received by the scrub bar 640 . Both the user inputs 662 and 663 may be passed directly to the application 310 as illustrated by arrow 670 .
  • the event handler 672 may be configured to be triggered by user input for a stop button control. Accordingly, the event handler 672 may be triggered by the user input 662 and the application 310 may make an appropriate response as illustrated by arrow 675 , which in this case would be to stop the video stream 611 .
  • the event handler 673 may be configured to be triggered by user input for a scrub bar control. Accordingly, the event handler 673 may be triggered by the user input 663 and the application 310 may make an appropriate response as illustrated by arrow 675 , which in this case would be to advance the video stream 611 according to the amount of scrub bar is moved.
  • user input represented by the arrow 665 may be received by a region 650 of the compact overlay window 610 that does not include a control specified by the application 310 .
  • the user input 665 may be passed directly to the application 310 as represented by the arrow 670 .
  • the application 310 does not include an event handler that is configured to be triggered by the user input 665 . Accordingly, the application 310 may pass the user input 665 to the compact overlay window manager 340 as illustrated by arrow 680 .
  • the positioning component 348 may then determine an appropriate response to the user input as illustrated by arrow 685 . For example, if the user input 577 is a mouse or finger movement that drags the compact overlay window 610 and is thus is indicative that the user desires to move the compact overlay window 610 to a different location of the display, the positioning component 348 may move the compact overlay window to the new location. Alternatively, if the user input 577 is a pinch finger movement or a mouse zoom movement that widens the compact overlay window 610 and thus is indicative that the user desires to resize the compact overlay window 610 , the positioning component 348 may resize the compact overlay window 610 to the desired new size.
  • FIG. 7 illustrates a flow chart of an example method 700 for implementing a customizable compact overlay window in a display. The method 700 will be described with respect to one or more of FIGS. 2 - 6 discussed previously.
  • the method 700 includes an act of receiving from an application running on a computing system one or more customization parameters that define how the application is to be configured in a compact overlay window (act 710 ).
  • the application 310 may include the customization parameters 315 and the application 320 may include the customization parameters 325 .
  • These customization parameters define how the application is to be configured in compact overlay window such as those discussed previously in the various embodiments.
  • These customization parameters may be received by the compact overlay window manager component 340 in the manner previously described.
  • the method 700 includes an act of generating the compact overlay window, the compact overlay window being customizable according to the customization parameters (act 720 ).
  • the application 310 and/or the application 320 may cause the generation module 345 to generate the compact overlay window.
  • the generation module 345 may include or expose various APIs that allow the applications to access or expose the underlying elements of the computing system 300 that are used by the application in generating the compact overlay window as previously described.
  • the method 700 includes an act of positioning the compact overlay window in a portion of a display of the computing system (act 730 ).
  • the positioning component 348 may position the compact overlay window in a display 350 or 360 in the manner previously described.
  • FIG. 8 illustrates a flow chart of an example method 800 for implementing a customizable compact overlay window in a display. The method 800 will be described with respect to one or more of FIGS. 2 - 6 discussed previously.
  • the method 800 includes an act of receiving a definition of one or more regions of a compact overlay window where user input is to be passed directly to an application that uses the compact overlay window (act 810 ).
  • the compact overlay window manager component 340 may receive the definition 316 of the specific regions or portions of the compact overlay window where any user input is to be passed directly by the compact overlay window manager 340 to the application 310 .
  • the method 800 includes an act of generating the compact overlay window with the one or more defined regions in a display of the computing system (act 820 ).
  • the generation component 345 may generate the compact overlay window 510 that includes the defined regions 520 , 530 , 540 , 550 , and 560 .
  • the method 500 includes in response to user input being entered into at least one of the one or more defined regions, an act of directly passing the user input to the application (act 830 ).
  • the user input is interpretable by the application in a manner determined by the application. For example, as previously discussed the user input 575 and 576 may be entered into one of the defined regions 520 , 530 , 540 , 550 , and 560 and is passed by the compact overlay window manager component 340 directly to the application 310 .
  • the application 310 is able to interpret and respond to the user input in a manner that is determined by the application 310 .
  • the method 800 includes in response to the user input being entered into a region of the compact overlay window that is not part of the one or more defined regions, an act of the computing system interpreting the user input (act 840 ). For example, as previously discussed the user input 577 may be entered into the non-defined region 580 . This user input is not passed to the application 310 , but is rather interpreted by the positioning component 348 . As previously described, based on the interpretation, the positioning component 348 may respond to the input in an appropriate manner.
  • FIG. 9 illustrates a flow chart of an example method 900 for implementing a customizable compact overlay window in a display.
  • the method 900 will be described with respect to one or more of FIGS. 2 - 6 discussed previously.
  • the method 900 includes an act of implementing in a display of the computing system a customizable compact overlay window that is customizable by an application that uses the compact overlay window (act 910 ).
  • a customizable compact overlay window may be customizable by the application 310 and/or 320 .
  • the compact overlay window 610 may be implemented.
  • the method 900 includes an act of receiving input into at least a portion of the compact overlay window (act 920 ). For example, as previously discussed user input 661 , 662 , 663 , and 665 may be received in various portions of the compact overlay window 610 .
  • the method 900 includes an act of directly passing the input to the application (act 930 ). If the application has defined a response to the input to the at least one portion of the compact overlay window, any response to the input is determined by the defined response of the application. For example, as previously described the user input 661 , 662 , 663 , and 665 may be passed directly to the application 310 .
  • the application 310 may include the event handlers 671 - 674 , which may be configured to be triggered by certain types of user input. As previously discussed, when the user input 661 , 662 , and 663 triggers the event handles 671 - 673 , the application responds to the input in the manner defined by the event handler.
  • the method 900 includes, in response to an indication that the application has not defined a response to the input to the at least one portion of the compact overly window, an act of the computing system determining a response to the input (act 940 ). For example, as previously described when the application 310 does not have an event handler for the user input 665 , the application 310 passes the user input to the compact overlay window manager component 340 . The positioning component 348 is then able to determine an appropriate response to the user input.

Abstract

Embodiments disclosed herein are related to systems and methods for implementing a customizable compact overlay window in a display. In one embodiment, a computing system includes one or more processors and a storage device that stores computer executable instructions that can be executed by the processors to cause the computing system to perform the following. The system receives from an application running on the computing system customization parameters that define how the application is to be configured in a compact overlay window. The system generates the compact overlay window so that the compact overlay window is customizable according to the customization parameters. The system positions the compact overlay window in a portion of a display of the computing system.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a Continuation of U.S. patent application Ser. No. 15/199,647 filed Jun. 30, 2016, entitled “Customizable Compact Overlay Window,” which is incorporated herein by reference in its entirety.
  • BACKGROUND
  • Many existing computing system platforms, especially those primarily designed for mobile devices, do not allow developers and users to implement or use fully customizable compact overlay windows in a display of the computing system. These systems often limit the compact overlay window to only a few controls that are determined by the system platform and thus applications running in the compact overlay window are not able to customize controls and other UI elements that would add to the user's experience. In addition, these system platforms often do not allow for more than one compact overlay window to be active at the same time and also do not allow the compact overlay window to remain active if a user begins to perform a task in another window of the display.
  • The subject matter claimed herein is not limited to embodiments that solve any disadvantages or that operate only in environments such as those described above. Rather, this background is only provided to illustrate one exemplary technology area where some embodiments described herein may be practiced.
  • BRIEF SUMMARY
  • This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
  • Embodiments disclosed herein are related to systems and methods for implementing a customizable compact overlay window in a display. In one embodiment, a computing system includes one or more processors and a storage device that stores computer executable instructions that can be executed by the processors to cause the computing system to perform the following. The system receives from an application running on the computing system customization parameters that define how the application is to be configured in a compact overlay window. The system generates the compact overlay window so that the compact overlay window is customizable according to the customization parameters. The system positions the compact overlay window in a portion of a display of the computing system.
  • In another embodiment, a computing system includes one or more processors and a storage device that stores computer executable instructions that can be executed by the processors to cause the computing system to perform the following. The system receives a definition of one or more regions of a customizable compact overlay window where user input is to be passed directly to an application that uses the compact overlay window. The system generates the customizable compact overlay window with the defined regions in a display of the computing system. When user input is entered into one of the defined regions, the user input is directly passed to the application, where the user input can be interpreted by the application in a manner determined by the application. When user input is entered into a region of the customizable compact overlay window that is not part of the one or more defined regions, the computing system interprets the user input.
  • In another embodiment, a computing system includes one or more processors and a storage device that stores computer executable instructions that can be executed by the processors to cause the computing system to perform the following. The system implements in a display a customizable compact overlay window that is customizable by an application that uses the compact overlay window. The system receives input into at least a portion of the compact overlay window. The system directly passes the input to the application. If the application has defined a response to the input to the at least one portion of the compact overlay window, any response to the input is determined by the defined response of the application. If the application has not defined a response, the system determines a response to the input.
  • Additional features and advantages will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of the teachings herein. Features and advantages of the invention may be realized and obtained by means of the instruments and combinations particularly pointed out in the appended claims. Features of the present invention will become more fully apparent from the following description and appended claims, or may be learned by the practice of the invention as set forth hereinafter.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • In order to describe the manner in which the above-recited and other advantages and features can be obtained, a more particular description of the subject matter briefly described above will be rendered by reference to specific embodiments which are illustrated in the appended drawings. Understanding that these drawings depict only typical embodiments and are not therefore to be considered to be limiting in scope, embodiments will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
  • FIG. 1 illustrates an example computing system in which the principles described herein may be employed;
  • FIGS. 2A-2E illustrate embodiments of a compact overlay window;
  • FIG. 3 illustrates an embodiment of a computing system for implementing a customizable compact overlay window in a display;
  • FIGS. 4A-4D illustrate embodiments of implementing a customizable compact overlay window in a display;
  • FIGS. 5A and 5B illustrate embodiments of a customizable compact overlay window having defined regions for passing user input directly to an application;
  • FIG. 6 illustrates an alternative embodiment of a computing system for implementing a customizable compact overlay window in a display that passes all user input to an application;
  • FIG. 7 illustrates a flow chart of an example method for implementing a compact overlay window in a display;
  • FIG. 8 illustrates a flow chart of an alternative example method for implementing a compact overlay window in a display; and
  • FIG. 9 illustrates a flow chart of an alternative example method for implementing a compact overlay window in a display.
  • DETAILED DESCRIPTION
  • Many existing computing system platforms, especially those primarily designed for mobile devices, do not allow developers and users to implement or use fully customizable compact overlay windows in a display of the computing system. These systems often limit the compact overlay window to only a few controls that are determined by the system platform and thus applications running in the compact overlay window are not able to customize controls and other UI elements that would add to the user's experience. In addition, these system platforms often do not allow for more than one compact overlay window to be active at the same time and also do not allow the compact overlay window to remain active if a user begins to perform a task in another window of the display. These limitations diminish from a user's experience since the application is not able to provide to the user the full amount of controls and other UI elements that are available for non-compact overlay windows. Advantageously, the embodiments disclosed herein provide for the full customization of the compact overly window.
  • There are various technical effects and benefits that can be achieved by implementing the aspects of the disclosed embodiments. By way of example, it is now possible to provide full customization of the compact overlay window. Further, the technical effects related to the disclosed embodiments can also include improved user convenience and efficiency gains.
  • Some introductory discussion of a computing system will be described with respect to FIG. 1 . Then, the computing system for implementing a compact overlay window will be described with respect to FIG. 2 through FIG. 9 .
  • Computing systems are now increasingly taking a wide variety of forms. Computing systems may, for example, be handheld devices, appliances, laptop computers, desktop computers, mainframes, distributed computing systems, datacenters, or even devices that have not conventionally been considered a computing system, such as wearables (e.g., glasses). In this description and in the claims, the term “computing system” is defined broadly as including any device or system (or combination thereof) that includes at least one physical and tangible processor, and a physical and tangible memory capable of having thereon computer-executable instructions that may be executed by a processor. The memory may take any form and may depend on the nature and form of the computing system. A computing system may be distributed over a network environment and may include multiple constituent computing systems.
  • As illustrated in FIG. 1 , in its most basic configuration, a computing system 100 typically includes at least one hardware processing unit 102 and memory 104. The memory 104 may be physical system memory, which may be volatile, non-volatile, or some combination of the two. The term “memory” may also be used herein to refer to non-volatile mass storage such as physical storage media. If the computing system is distributed, the processing, memory and/or storage capability may be distributed as well.
  • The computing system 100 also has thereon multiple structures often referred to as an “executable component”. For instance, the memory 104 of the computing system 100 is illustrated as including executable component 106. The term “executable component” is the name for a structure that is well understood to one of ordinary skill in the art in the field of computing as being a structure that can be software, hardware, or a combination thereof. For instance, when implemented in software, one of ordinary skill in the art would understand that the structure of an executable component may include software objects, routines, methods, and so forth, that may be executed on the computing system, whether such an executable component exists in the heap of a computing system, or whether the executable component exists on computer-readable storage media.
  • In such a case, one of ordinary skill in the art will recognize that the structure of the executable component exists on a computer-readable medium such that, when interpreted by one or more processors of a computing system (e.g., by a processor thread), the computing system is caused to perform a function. Such structure may be computer-readable directly by the processors (as is the case if the executable component were binary). Alternatively, the structure may be structured to be interpretable and/or compiled (whether in a single stage or in multiple stages) so as to generate such binary that is directly interpretable by the processors. Such an understanding of example structures of an executable component is well within the understanding of one of ordinary skill in the art of computing when using the term “executable component”.
  • The term “executable component” is also well understood by one of ordinary skill as including structures that are implemented exclusively or near-exclusively in hardware, such as within a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or any other specialized circuit. Accordingly, the term “executable component” is a term for a structure that is well understood by those of ordinary skill in the art of computing, whether implemented in software, hardware, or a combination. In this description, the terms “component”, “agent”, “manager”, “service”, “engine”, “module”, “virtual machine” or the like may also be used. As used in this description and in the case, these terms (whether expressed with or without a modifying clause) are also intended to be synonymous with the term “executable component”, and thus also have a structure that is well understood by those of ordinary skill in the art of computing.
  • In the description that follows, embodiments are described with reference to acts that are performed by one or more computing systems. If such acts are implemented in software, one or more processors (of the associated computing system that performs the act) direct the operation of the computing system in response to having executed computer-executable instructions that constitute an executable component. For example, such computer-executable instructions may be embodied on one or more computer-readable media that form a computer program product. An example of such an operation involves the manipulation of data.
  • The computer-executable instructions (and the manipulated data) may be stored in the memory 104 of the computing system 100. Computing system 100 may also contain communication channels 108 that allow the computing system 100 to communicate with other computing systems over, for example, network 110.
  • While not all computing systems require a user interface, in some embodiments, the computing system 100 includes a user interface system 112 for use in interfacing with a user. The user interface system 112 may include output mechanisms 112A as well as input mechanisms 112B. The principles described herein are not limited to the precise output mechanisms 112A or input mechanisms 112B as such will depend on the nature of the device. However, output mechanisms 112A might include, for instance, speakers, displays, tactile output, holograms and so forth. Examples of input mechanisms 112B might include, for instance, microphones, touchscreens, holograms, cameras, keyboards, mouse of other pointer input, sensors of any type, and so forth.
  • Embodiments described herein may comprise or utilize a special purpose or general-purpose computing system including computer hardware, such as, for example, one or more processors and system memory, as discussed in greater detail below. Embodiments described herein also include physical and other computer-readable media for carrying or storing computer-executable instructions and/or data structures. Such computer-readable media can be any available media that can be accessed by a general purpose or special purpose computing system. Computer-readable media that store computer-executable instructions are physical storage media. Computer-readable media that carry computer-executable instructions are transmission media. Thus, by way of example, and not limitation, embodiments of the invention can comprise at least two distinctly different kinds of computer-readable media: storage media and transmission media.
  • Computer-readable storage media includes RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other physical and tangible storage medium which can be used to store desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computing system.
  • A “network” is defined as one or more data links that enable the transport of electronic data between computing systems and/or modules and/or other electronic devices. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a computing system, the computing system properly views the connection as a transmission medium. Transmissions media can include a network and/or data links which can be used to carry desired program code means in the form of computer-executable instructions or data structures and which can be accessed by a general purpose or special purpose computing system. Combinations of the above should also be included within the scope of computer-readable media.
  • Further, upon reaching various computing system components, program code means in the form of computer-executable instructions or data structures can be transferred automatically from transmission media to storage media (or vice versa). For example, computer-executable instructions or data structures received over a network or data link can be buffered in RAM within a network interface module (e.g., a “NIC”), and then eventually transferred to computing system RAM and/or to less volatile storage media at a computing system. Thus, it should be understood that storage media can be included in computing system components that also (or even primarily) utilize transmission media.
  • Computer-executable instructions comprise, for example, instructions and data which, when executed at a processor, cause a general purpose computing system, special purpose computing system, or special purpose processing device to perform a certain function or group of functions. Alternatively or in addition, the computer-executable instructions may configure the computing system to perform a certain function or group of functions. The computer executable instructions may be, for example, binaries or even instructions that undergo some translation (such as compilation) before direct execution by the processors, such as intermediate format instructions such as assembly language, or even source code.
  • Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the described features or acts described above. Rather, the described features and acts are disclosed as example forms of implementing the claims.
  • Those skilled in the art will appreciate that the invention may be practiced in network computing environments with many types of computing system configurations, including, personal computers, desktop computers, laptop computers, message processors, hand-held devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, mobile telephones, PDAs, pagers, routers, switches, datacenters, wearables (such as glasses) and the like. The invention may also be practiced in distributed system environments where local and remote computing systems, which are linked (either by hardwired data links, wireless data links, or by a combination of hardwired and wireless data links) through a network, both perform tasks. In a distributed system environment, program modules may be located in both local and remote memory storage devices.
  • Those skilled in the art will also appreciate that the invention may be practiced in a cloud computing environment. Cloud computing environments may be distributed, although this is not required. When distributed, cloud computing environments may be distributed internationally within an organization and/or have components possessed across multiple organizations. In this description and the following claims, “cloud computing” is defined as a model for enabling on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services). The definition of “cloud computing” is not limited to any of the other numerous advantages that can be obtained from such a model when properly deployed.
  • Attention is first given to FIGS. 2A-2D, which will be used to explain the concept of a compact overlay window, which may also be commonly referred to as a Picture-in-Picture or PIP window. As used herein, a compact overlay window is defined to mean a computer window that is “on top” of at least one other computer window in a display of a computing system. The term “on top” is from a Z-order perspective of how the various windows are stacked in the display. Thus, a compact overlay window is stacked “on top” of another window when it is “closest” to the eye of a user who is looking at the display. In some embodiments, the compact overlay window may be the most on top window in a stack of displays. In other embodiments where there are multiple compact overlay windows, then one of the compact overlay windows may be on top of another compact overlay window, but may have another compact overlay window on top of it. Further, there may be instances where a notification or other UI element may be on top of a compact overlay window. Thus, a compact overlay window is generally the most on top window in the display stack, but this need not always be the case.
  • It will be appreciated the compact overlay windows shown in FIGS. 2A-2D are drawn for ease of explanation only and thus the relative size differences between the windows, the amount of space each window is shown occupying in the display, or the amount unoccupied space in the display is not to be limiting of the embodiments disclosed herein. Further, these figures show the windows as rectangles or having rectangular regions. Again, this is for ease of illustration only. It will be appreciated that a compact overlay region can have any reasonable shape. Further, a compact overlay window can have non-rectangular regions or no regions at all.
  • FIG. 2A illustrates one embodiment of a compact overlay window. In the figure, a display 210 is shown. The display 210 may be a display or monitor of a computer, a tablet, a smartphone, or the like. A window 220 is displayed in the display 210. The window 220 may be implemented by a first application so that the window 220 shows at least some of the visual portions of the application such as User Interface (UI) elements as the application is running or being executed by the computing system. A compact overlay window 230 is also shown in the display. In the embodiment of FIG. 2A, the compact overlay window 230 is on top of or overlays a portion of the window 220. The compact overlay window 230 may be implemented by the first application so that the compact overly window 230 shows at least some of the visual portions of the first application such as User Interface (UI) elements as the application is running or being executed by the computing system. Alternatively, the compact overly window may be implemented by a second application so that the compact overly window 230 shows at least some of the visual portions of the second application such as User Interface (UI) elements as the second application is running or being executed by the computing system. It will be noted that in the embodiments disclosed herein, even though the compact window is on top of or overlays the window 220, the window 220 remains “active” such that the first application is able to run in the window 220 simultaneously with the first or second application that is also running in the compact overlay window 230. This advantageously allows a user to use or view both windows at the same time as needed.
  • It will be appreciated that the compact overlay window 230 is generally of a smaller size than at least one other window in the display such as window 220, as is shown in FIG. 2A. However, the compact overlay window 230 need not necessarily be smaller as long as it is “on top” as previously described. It will be appreciated, however, that if the compact overlay window 230 is the same size or close to the same size as the window 220, then the window 220 may not be viewable or useable by a user of the computing system 200.
  • FIG. 2B shows an alternative embodiment of a compact overlay window. As shown in this figure, the compact overlay window 230 is not on top of a portion of the window 220. Thus, it is not necessary for the compact overlay window 230 to actually be on top of another window for it to be a compact overlay window. If at a later time, a window is opened in the space 240 or the window 220 is expanded into the space 240, the compact overlay window 230 would remain “on top”.
  • FIG. 2C illustrates a further embodiment of a compact overlay window. As shown in this embodiment, the compact overlay window 230 is on top of the window 220 and a second window 221. Thus, this embodiment shows that a compact overlay window may be on top of more than one window. In this embodiment, all of the window may be active simultaneously.
  • FIG. 2D illustrates another embodiment of a compact overlay window. As shown in this figure, a second compact overlay window 231 is on top of the window 220 along with the compact overlay window 230. This embodiment shows that there can be more than one compact overlay window that is implemented in the display 210 at the same time. As with the other embodiments, all of the window may be active simultaneously.
  • FIG. 2E illustrates another embodiment of a compact overlay window As shown in this figure, a second compact overlay window 231 is on top of a portion of the compact overlay window 230. This embodiment shows, as discussed above, where there are multiple compact overlay windows, then one of the compact overlay windows may be on top of another compact overlay window. Although not illustrated. As with the other embodiments, all of the window may be active simultaneously.
  • Attention is now given to FIG. 3 , which illustrates an embodiment of a computing system 300, which may correspond to the computing system 100 previously described. The computing system 300 includes various components or functional blocks that may implement the various embodiments disclosed herein as will be explained. The various components or functional blocks of computing system 300 may be implemented on a local computing system or may be implemented on a distributed computing system that includes elements resident in the cloud or that implement aspects of cloud computing. The various components or functional blocks of the computing system 300 may be implemented as software, hardware, or a combination of software and hardware. The computing system 300 may include more or less than the components illustrated in FIG. 3 and some of the components may be combined as circumstances warrant. Although not necessarily illustrated, the various components of the computing system 300 may access and/or utilize a processor and memory, such as processor 102 and memory 104, as needed to perform their various functions.
  • As illustrated in FIG. 3 , the computing system 300 may include an application 310, an application 320, and any number of additional applications as denoted by ellipses 330. The applications 310, 320, and 330 may be any type of program or executable code that is configured to run on or be executed by the computing system 300. Examples of the applications include, but are not limited to, video streaming applications, audio streaming applications, other media applications, browsing applications, gaming applications, and coding applications. Thus, even though many of the embodiments that will be discussed in more detail to follow use a video streaming application as an example application, it will appreciated that any type of application may be implemented as a compact overlay window and thus the embodiments disclosed herein are not limited to video, audio, or media streaming applications. Accordingly, the embodiments disclosed herein are not limited to any particular type of application.
  • The application 310 may include various customization parameters 315A, 315B, 315C and any number of additional customization parameters as denoted by ellipses 315D, hereinafter also referred to as customization parameters 315. The customization parameters 315 may define various features that the application 310 may render in a compact overlay window of the computing system as will be discussed in more detail to follow. In some embodiments, the customization parameters may be declarative statements that define the given features. The customization parameters 315 may define application specific controls, application specific branding, or any type of application specific User Interface (UI) element as circumstances warrant.
  • For example, the application specific controls for a video or audio streaming application may include, but are not limited to, a play button, a stop button, a pause button, or a scrub bar that moves to a desired portion of a video or audio stream. The application specific branding may include, but is not limited to, the name of the company or developer who developed the application or it may include other types of advertising. The application specific UI elements may include, but are not limited to, an element such as a thumb up or down for rating the content, a picture of a user, information about the application, a work pane, or any other type of UI element that is needed for the application to perform its intended task. Accordingly, the customization parameters 315 allow the application 310 to customize the compact overlay window in any desired manner. In other words, the customization parameters 315 allow the application 310 to have full or near full control or ownership of the compact overlay window as will be discussed in more detail to follow. This is an advantage over existing systems where an application does not have any control over a compact overlay window, but is limited to the customization determined by the computing system.
  • In some embodiments, the customization parameters 315 may also specify a desired size of the compact overlay window or a desired location of the compact overlay window in a display of the computing system. In other embodiments, the customization parameters 315 may specify that the application 310 that is running in a non-compact overlay window in a display of the computing system should become a compact overlay window or should launch a new compact overlay window as will be explained in more detail to follow. In further embodiments, the customization parameters 315 may specify that the application 310 launch as a compact overlay window as will also be explained in more detail to follow.
  • Likewise, the application 320 may include various customization parameters 325A, 325B, 325C and any number of additional customization parameters as denoted by ellipses 325D, hereinafter also referred to as “customization parameters 325. The customization parameters 325 may define various features that the application 320 may render in a compact overlay window of the computing system in the manner discussed previously in relation to the customization parameters 315.
  • The computing system 300 may also include a compact overlay window manger component 340 (hereinafter also referred to as “compact overlay window manager”). The compact overlay window manager 340 may include various components or modules for allowing one of the applications to generate or render a compact overlay window and then for positioning the compact overlay window in the display.
  • For example, the compact overlay window manager 340 may include a generation module 345. The generation module 345 may include or access those elements of the computing system 300 that allow the applications 310, 320, and/or 330 to generate the compact overlay window. For example, the generation module 345 may include or expose various APIs that allow the applications to access or expose the underlying elements of the computing system 300 that are used by the application in generating the compact overlay window. In operation, the generation module 345 may receive the customization parameters 315 from the application 310 or the customization parameters 325 from the application 320. The generation module 345 may then generate or cause to be generated a compact overlay window on behalf of the application 310 or 320 so that the application 310 or 320 may run or execute in the compact overlay window.
  • The compact overlay window manager 340 may also include a system constraint manager component 346 that includes various system constraints 347A, 347B, and any number of additional system constraints as denoted by the ellipses 347C, which may also be referred to jointly as system constraints 347. The system constraints 347 define constraints that may be applied to the customization parameters 315 and/or 325 so that the compact overlay window specified by customization is configured in a manner acceptable to the computing system. It will be noted that the system constraints 347 may include any other reasonable constraint and thus the embodiments disclosed herein are not limited by any particular type of system constraint.
  • For example, the system constraint 347A may specify a minimum and/or a maximum size for the compact overlay window. If one of the customization parameters 315 and/or 325 specify a size of the compact overlay window that is larger than the specified maximum size or that is smaller than the specified minimum size, the generation module 345 will not follow the customization parameter, but will instead generate the compact overlay window that is within the defined minimum and maximum sizes.
  • Likewise, the system constraint 347B may specify what portions of a display of the computing system the compact overlay window may be positioned in. If one of the customization parameters 315 and/or 325 specifies a location that violates the specified portions of the display, then this customization parameter will be ignored and the compact overlay window will be placed in a position that is acceptable to the computing system. For example, the customization parameters 315 and/or 325 may specify a position in the display that is already occupied by an existing compact overlay window and so the compact overlay window will need to be placed in another portion of the display.
  • Accordingly, the makeup and feel in terms of a user experience of the compact overlay window is left the application 310, 320, and/or 330 as the compact overlay window manager 340 will allow the applications to render any of the customization parameters 315 or 325 that do not conflict with the system constraints 347. In other words, the compact overlay window manager 340 may only prevent the rendering of a customization parameter when the conflict with the system constraints 347 is present.
  • The compact overlay window manager 340 may also include a positioning component 348. In operation, the positioning component 348 may position the compact overlay window in the display of the computing system. As mentioned above, if a customization parameter specifies a location that is acceptable to the computing system, then the positioning component 348 will position the compact overlay window at that location. In addition, the positioning component 348 may resize and reposition the compact overlay window in the display in response to various user input.
  • In some embodiments, the positioning component 348 may also be configured to interpret various user input and then to cause the compact overlay window manager 340 to react accordingly. As will be explained in more detail to follow, some user input may be directed at various controls and other UI elements rendered in the compact overlay window as specified by one or more of the customization parameters 315 and/or 325. Such input may be passed to the application to interpret in a manner determined by the application, which will usually be in accordance with the control or UI element. For example, input directed at a play button will usually be interpreted by the application to mean the user wants to activate the play button to start a video or audio stream. However, some user input may be directed towards areas of the compact overlay window that do not include UI elements specified by the customization parameters. As will be explained in more detail to follow, the positioning component 348 may then interpret such user input and determine an appropriate response to the input.
  • The computing system 300 may also include a computer system display 350, a computer system display 360, and any number of additional computer system displays as denoted by the ellipses 370. The computing system displays may be a display or monitor of a computer, a tablet, a smartphone, or the like. Thus, the embodiments disclosed herein are not limited by the type of the computing system display. As will be discussed in more detail to follow, one or more compact overlay windows may be implemented in one or more of the computing system displays 350, 360, or 370.
  • Having described the computing system 300, specific embodiments of implementing a compact overlay window will now be explained. FIG. 4A illustrates a window 410 that implements the application 310 that is displayed in the computing system display 350. In this embodiment, the application 310 may be a video streaming application that shows video stream 411. As shown in the window, some of the customization parameters 315 have been rendered as the following features for a video stream: a play button 412, a stop button 413, a scrub bar 414, and other UI elements 415 that are helpful for the playing of the video stream 411. In addition, a customization parameter 315 may cause the name of the application developer “Streaming Video Service” 416 to be rendered in the window.
  • In some embodiments the customization parameters 315 may specify that non-standard video controls or the like 417 and 418 may also be rendered in the compact overlay window 410. For example, a non-standard controller 417 may be a favorite button that allows a user to mark his or her favorite video or part thereof so that the video or part thereof can be found easily at a later time. The non-standard controller 418 may be a thumbs up or down element that allows the user to rate the video stream or to otherwise leave comments regarding the video stream. Accordingly, non-standard video controls or the like 417 and 418 may be any type of controller. Thus, as previously described, the compact overlay windows of the embodiments disclosed herein provide for customization as desired by a developer or user and are not limited to a small sub-set of customizations.
  • In some embodiments, the window 410 may include a user input element 420. In such embodiments, a user may enter input into the user input element 420 to initiate the generation of a compact overlay window for the application 310. In other embodiments, one of the customization parameters 315 may initiate the generation of the compact overlay window 430 by specifying that application 310 should be configured as a compact overlay window, and this may be considered as input that initiates the generation of a compact overlay window for the application 310. In still other embodiments, a second application such as application 320 may initiate the generation of compact overlay window for the application 310.
  • In one embodiment, upon receipt of any of the input discussed above, the customization parameters 315 may specify that the window 410 become the compact overlay window 430. In other words, the application 310 may choose to make itself the compact overlay window 430. Accordingly, as shown in FIG. 4B, the compact overlay window 430 is a smaller sized version of the window 410 that includes the same user interface elements or features. In this way, a user is able to continue to watch the video stream 411 in the compact overlay window 430.
  • As mentioned above, the positioning component 348 may position and/or size the compact overlay window 230 in the display 350, for example in the right corner of the display 350 as shown in FIG. 4B. The positioning and sizing will typically be specified by one of the customization parameters 315 as determined by the application 310. However, if the customization parameter is in conflict with the system constraints 347, then the positioning component 348 may move and/or resize the compact overlay window 430. The positioning component 348 may also move and/or resize the compact overlay window 430 in response to user input. This is illustrated in FIG. 4B, where the dashed line window 430 has been moved to the left corner of the display 350. It will be appreciated that the positioning component 348 may dynamically reposition and/or resize the compact overlay window 230 as circumstances warrant to ensure that the compact overlay window 430 remains on top of any other windows or other elements such as pop-ups or notifications that may appear in the display 350.
  • In some embodiments, a window 440 may then implement the application 310 or the application 320 while the compact overlay window 430 is implementing the application 310. As discussed above, both the compact overlay window 430 and the window 440 may be active simultaneously. For example, suppose the application 320 was a web browser that was implemented in the window 440. Accordingly, a user would be able to actively watch the video stream 411 in the compact overlay window 430 at the same time as browsing the internet in the window 440.
  • In some embodiments, the customization parameters 315 may specify that a second compact overlay window 450 for implementing the application 310 should also be generated while the compact overlay window 430 exists. The compact overlay window 450 may include UI elements 451, 452, and any number of additional UI elements as denoted by ellipses 453 that are specified by the customization parameters 315. Although not illustrated, the compact overlay window 450 may show the video stream 411 or it may show some other aspect of the application 310, such as a scene guide or actor explanation. In those embodiments including the window 440, it will be appreciated that all three of the windows 430, 440, and 450 may be active and usable by the user at the same time. Accordingly, the embodiments disclosed herein are not limited to any specific number of compact overlay windows that may be implemented by an application as there may any reasonable number that does not violate the system constraints 348 and that can be handled in the available space of the display 350.
  • In another embodiment, upon receipt of any of the input discussed above, the customization parameters 315 may specify that a new compact overlay window 460 be generated. In other words, the application 310 may choose to generate a new compact overlay window while the original window remains in the display rather than make itself the compact overlay window. Accordingly, as shown in FIG. 4C, a compact overlay window 460 is implemented for the application 310 in addition to the window 410. In the illustrated embodiment, the compact overlay window 460 is related to the video stream 411 of window 410 and shows various UI elements specified by the customization parameters 315 such as an UI element 461 that lists the actors of the video stream 411, a UI element 462 that shows a scene guide for the video stream 411, and a UI element that lists the name of the music played in the video stream 411. Of course, it will be appreciated that the compact overlay window 460 may show other aspects of the application 310 or it may even show a mirror of the window 410 as circumstance warrant. In addition, as with the other embodiments disclosed herein both the window 410 and the compact overlay window 460 may be active at the same time so that a user may use them simultaneously.
  • In some embodiments, the application 320 may specify that a compact overlay window be implemented in the display 350 at the same time as the compact overlay window 460 is implemented. Accordingly, as also shown in FIG. 4C, a compact overlay window 470 is implemented for the application 320 in the display 350. In other words, the application 320 may be launched as the compact overlay window 470. In this embodiment, the application 320 may be a video streaming application that shows a live action video stream 471 of a sporting event. The compact overlay window 470 may include UI elements 472, 473, and any number of additional UI elements as denoted by ellipses 473 that are specified by the customization parameters 325.
  • Accordingly, FIG. 4C shows that it is possible to have compact overlay windows that implement different applications at the same time. Thus, a user would be able to watch the video stream 411 and the live sports stream 471 at the same time. Further, if the web browser were implemented in the window 440, then the user would be able to also to browse the internet while also watching the video stream 411 and the live sports stream 471.
  • In a further embodiment illustrated in FIG. 4D, the display 350 may be a display for a smartphone or a small tablet. Accordingly, the display is relatively small. Suppose that a user is watching the video stream 411 in the display 350 as shown in FIG. 4D and that the user also is writing code in a window 480 of a display 360 that is a monitor for a computer. As will be appreciated, it would not be convenient for the user to code in the window 480 of the display 360 while also watching the video stream in the window 410 of the display 350. Accordingly, since the display 360 will typically be much larger than the display 350, in the embodiment the application 310 in conjunction with the compact overlay window manager 340 may generate the compact overlay window 430 in the display 360 so as to overlay or be on top of the window 480. In one embodiment, this may be accomplished by informing a version of the application 310 associated with the display 360 that it should launch as a compact overlay window and also informing the version of the application what UI elements to render and where in the video streaming to begin at. The positioning component 248 of the computing system or a positioning component that is associated with the display 360 may then position the compact overlay window in the appropriate place in the display 360. In this way, the user is more easily able to continue watching the video stream 411 while also coding in the window 480. Accordingly, the embodiments disclosed herein contemplate generating compact overlay windows on multiple displays of the computing system 300.
  • In some embodiments, as shown in FIG. 3 , the application 310 may generate a definition 316 of specific regions or portions of a compact overlay window where any user input is to be passed directly by the compact overlay window manager 340 to the application. The definition 316 may define any number of regions of the compact overlay window. In some embodiments, the definition 316 is used in conjunction with the customization parameters 315 by defining those regions of the compact overlay window where any user input that is to be passed directly to the application to correspond to those regions where the customization parameters define controls and other UI elements in the manner previously described. In operation, the generation module 345 receives the definition 316 and ensures that the compact overlay window is generated with the defined regions. Although not illustrated, the applications 320 and 330 may also include a definition similar to the definition 316 as circumstances warrant.
  • FIG. 5A illustrates a compact overlay window 510 that implements or runs a video stream 511 where specific regions of the window have been defined where any user input is to be passed directly to an application, such as application 310. It will be noted that for ease of explanation the display and other windows are omitted and only the compact overlay window 510 is shown in the figure. However, the compact overlay window 510 may correspond to any of the previously described embodiments of a compact overlay window and so may include any of the properties and advantages previously discussed in relation to any of the previously described embodiments of a compact overlay window.
  • As illustrated in FIG. 5A, the defined regions of the compact overlay window 510 where any user input is to be passed directly to the application are denoted by dashed boxes 520, 530, 540, 550, and 560. The defined regions 520, 530, 540, and 550 may also correspond to the location of various video steaming features specified by the customization parameters 315 such as a play button 525, a stop button 535, other UI elements 545, and a scrub bar 555. However, not all of the defined regions of the compact overlay window 510 need correspond to a location of a feature specified by the customization parameters. Accordingly, the defined region 560 does not correspond to the location of any features specified by the customization parameters 315.
  • In operation, the defined region 520 may receive user input represented by the arrow 575 and hereinafter called user input 575. The user input 575 (and the user input 576 and 577 and all other user input discussed herein) may correspond to a mouse click, to a touch of a finger or stylus, to a keyboard entry, or any other reasonable form of user input. The user input 575 may then be passed directly by the compact overlay window manager 340 to the application 310. This allows the application 310 to interpret the user input 375 in a manner determined by the application and to respond to the input in a manner determined by the application. For example, since the defined region 520 also includes the play button 525, the application 310 will likely interpret the user input 276 as indicating that the user desires to play the video stream 511 and will correspond accordingly. Similar results would also occur if the user input 575 were received by the defined regions 530, 540, and 550.
  • The defined region 560 may receive user input represented by the arrow 576 (hereinafter called user input 576) that may be passed directly by the compact overlay window manager 540 to the application 310. As mentioned previously, the application 310 may then interpret this input in a manner determined by the application. For example, in one embodiment the application 310 may hide the controls 525, 535, 545, and 555 while the video 511 is playing to increase the user experience by not crowding the compact overlay window. In such embodiments, the application 310 may interpret the user input 376 as an indication that the user wants to see one or more of the controls. Accordingly, the application 310 may respond by causing the compact overlay window manager 340 to make the controls visible to the user so that user may use the controls.
  • FIG. 5B illustrates an alternative embodiment of the compact overlay window 5B. In this embodiment, the defined regions 520, 530, 540, and 550 in addition to the defined region 560 do not necessarily correspond to a location of a feature specified by the customization parameters 315. Rather, in this embodiment, when the user input is received by a defined region such as region 520 and directly passed to application 310, the application 310 may interpret and respond to the input dynamically. For example, in one instance the application 310 may interpret the user input 575 as a request to play the video stream 511 in a manner similar to the embodiment of FIG. 5A and may respond by playing the video stream 511 and/or causing the play button 525 to be rendered in the region by the compact overlay window manager 340. However, at a second instance of the user input 575 being received in the defined region 520 and directly passed to the application 310, the application may interpret the user input 575 as being a request to stop or pause the video stream 511 and may respond by stopping or pausing the video stream and/or causing the stop button 535 to be rendered in the defined region 520 causing the compact overlay window manager 340. In this way, the defined regions are able to be dynamically interpreted in any manner at any time by the application 310 as the application deems appropriate.
  • In both FIGS. 5A and 5B, those portions of the compact overlay window 510 that are not part of the defined regions 520, 530, 540, 550, and 560 may be considered part of a non-defined region 580. The non-defined region 580 may include the remaining portions of window not part of the defined region or it may include a subset of the remaining portions. As shown in FIGS. 5A and 5B, the non-defined region 580 may receive user input represented by the arrow 577 and hereinafter called user input 577. In operation, when the user input is received by the non-defined region 580, the user input is not passed to the application 310, but is interpreted by the positioning component 348 or some other part of compact overlay manager 340. Based on the interpretation, the positioning component 348 may respond to the input in an appropriate way.
  • For example, the user input 577 may be a mouse or finger movement that drags the compact overlay window 510 and thus is indicative that the user desires to move the compact overlay window 510 to a different location of the display. Assuming that such movement does not violate one of the system constraints 347, the positioning component 348 may move the compact overlay window to the new location.
  • In another example, the user input 577 may be a pinch finger movement or a mouse zoom movement that widens the compact overlay window 510 and thus is indicative that the user desires to resize the compact overlay window 510. Assuming that such resizing does not violate one of the system constraints 347, the positioning component 348 may resize the compact overlay window 510 to the desired new size.
  • There may be instances, however, where the user input 577 received in the non-defined region 580 is interpreted by the positioning component 348 to be of a type that is not usually handled by the computing system, but that is more likely to be intended for the application 310 to interpret and respond to. The compact overlay window manager 340 may inform the application 310 of the user input 577 so that the application may interpret and respond to the input in a manner determined by the application.
  • For example, in one instance the user input 577 may be a mouse click or finger tap in the non-defined region 580. Such user input would not typically be indicative of the user wanting to move or resize the compact overlay window 510 or of some other typical windowing action performed by the compact overlay window manager 340. The compact overlay window manager 340 may inform the application 310 of the user input 577 so that the application may interpret and respond to the input. For example, the mouse click or finger tap may indicate that the user desires to hide or unhide the controls 535, 535, 545, and 555 in the manner similar to that discussed in relation to defined region 560. Accordingly, in response to the user input 577, the application 310 may cause that the controls be hidden or unhidden.
  • FIG. 6 represents an alternative embodiment of the computing system 300. In the embodiment of FIG. 6 , all user input received by any portion of the compact overlay window is directly passed to the application 310. The application 310 may include one or more defined responses to various user inputs. The defined responses may include one or more event handlers that are part of a tree structure that defines the controls rendered by the application 310. If one of the defined responses corresponds to the user input, then the application determines a response to the input in accordance with the defined response. However, if one of the defined responses does not correspond to the user input, then the user input is passed to the compact overlay window manager 340. The compact overlay window manager, specifically the positioning component 348 may then determine an appropriate response to the user input.
  • For example, a compact overlay window 610 that implements or runs a video stream 611 is shown in FIG. 6 . It will be noted that for ease of explanation the display and other windows are omitted and only the compact overlay window 610 is shown in the figure. However, the compact overlay window 610 may correspond to any of the previously described embodiments of a compact overlay window and so may include any of the properties and advantages previously discussed in relation to any of the previously described embodiments of a compact overlay window. As shown in the compact overly window 610, some of the customization parameters 315 have been rendered as the following features for a video stream: a play button 620, a stop button 630, and a scrub bar 640.
  • As illustrated, user input represented by the arrow 661 (hereinafter referred to as user input 661) may be received by the play button 620. This user input may be passed directly to the application 310 as illustrated by arrow 670.
  • The application 310 may include, as discussed above, defined responses for various user inputs. For example, the application 310 may include various event handlers 671, 672, 673 and any number of additional event handlers as denoted by ellipses 674. In the present embodiment, the event handler 671 may be configured to be triggered by user input for a play button control. Accordingly, the event handler 671 may be triggered by the user input 661 and the application 310 may make an appropriate response as illustrated by arrow 675, which in this case would be to play the video stream 611.
  • Likewise, user input represented by the arrow 662 (hereinafter referred to as user input 662) may be received by the stop button 630 and user input represented by the arrow 663 (hereinafter referred to as user input 663) may be received by the scrub bar 640. Both the user inputs 662 and 663 may be passed directly to the application 310 as illustrated by arrow 670.
  • In the present embodiment, the event handler 672 may be configured to be triggered by user input for a stop button control. Accordingly, the event handler 672 may be triggered by the user input 662 and the application 310 may make an appropriate response as illustrated by arrow 675, which in this case would be to stop the video stream 611. Likewise, the event handler 673 may be configured to be triggered by user input for a scrub bar control. Accordingly, the event handler 673 may be triggered by the user input 663 and the application 310 may make an appropriate response as illustrated by arrow 675, which in this case would be to advance the video stream 611 according to the amount of scrub bar is moved.
  • As also illustrated, user input represented by the arrow 665 (hereinafter referred to as user input 665) may be received by a region 650 of the compact overlay window 610 that does not include a control specified by the application 310. As with the previous user inputs, the user input 665 may be passed directly to the application 310 as represented by the arrow 670. However, in this case the application 310 does not include an event handler that is configured to be triggered by the user input 665. Accordingly, the application 310 may pass the user input 665 to the compact overlay window manager 340 as illustrated by arrow 680.
  • The positioning component 348 may then determine an appropriate response to the user input as illustrated by arrow 685. For example, if the user input 577 is a mouse or finger movement that drags the compact overlay window 610 and is thus is indicative that the user desires to move the compact overlay window 610 to a different location of the display, the positioning component 348 may move the compact overlay window to the new location. Alternatively, if the user input 577 is a pinch finger movement or a mouse zoom movement that widens the compact overlay window 610 and thus is indicative that the user desires to resize the compact overlay window 610, the positioning component 348 may resize the compact overlay window 610 to the desired new size.
  • The following discussion now refers to a number of methods and method acts that may be performed. Although the method acts may be discussed in a certain order or illustrated in a flow chart as occurring in a particular order, no particular ordering is required unless specifically stated, or required because an act is dependent on another act being completed prior to the act being performed.
  • FIG. 7 illustrates a flow chart of an example method 700 for implementing a customizable compact overlay window in a display. The method 700 will be described with respect to one or more of FIGS. 2-6 discussed previously.
  • The method 700 includes an act of receiving from an application running on a computing system one or more customization parameters that define how the application is to be configured in a compact overlay window (act 710). For example, as previously described the application 310 may include the customization parameters 315 and the application 320 may include the customization parameters 325. These customization parameters define how the application is to be configured in compact overlay window such as those discussed previously in the various embodiments. These customization parameters may be received by the compact overlay window manager component 340 in the manner previously described.
  • The method 700 includes an act of generating the compact overlay window, the compact overlay window being customizable according to the customization parameters (act 720). For example, as previously described the application 310 and/or the application 320 may cause the generation module 345 to generate the compact overlay window. The generation module 345 may include or expose various APIs that allow the applications to access or expose the underlying elements of the computing system 300 that are used by the application in generating the compact overlay window as previously described.
  • The method 700 includes an act of positioning the compact overlay window in a portion of a display of the computing system (act 730). For example, the positioning component 348 may position the compact overlay window in a display 350 or 360 in the manner previously described.
  • FIG. 8 illustrates a flow chart of an example method 800 for implementing a customizable compact overlay window in a display. The method 800 will be described with respect to one or more of FIGS. 2-6 discussed previously.
  • The method 800 includes an act of receiving a definition of one or more regions of a compact overlay window where user input is to be passed directly to an application that uses the compact overlay window (act 810). For example, as previously discussed the compact overlay window manager component 340 may receive the definition 316 of the specific regions or portions of the compact overlay window where any user input is to be passed directly by the compact overlay window manager 340 to the application 310.
  • The method 800 includes an act of generating the compact overlay window with the one or more defined regions in a display of the computing system (act 820). For example, as previously discussed the generation component 345 may generate the compact overlay window 510 that includes the defined regions 520, 530, 540, 550, and 560.
  • The method 500 includes in response to user input being entered into at least one of the one or more defined regions, an act of directly passing the user input to the application (act 830). The user input is interpretable by the application in a manner determined by the application. For example, as previously discussed the user input 575 and 576 may be entered into one of the defined regions 520, 530, 540, 550, and 560 and is passed by the compact overlay window manager component 340 directly to the application 310. As also discussed, the application 310 is able to interpret and respond to the user input in a manner that is determined by the application 310.
  • The method 800 includes in response to the user input being entered into a region of the compact overlay window that is not part of the one or more defined regions, an act of the computing system interpreting the user input (act 840). For example, as previously discussed the user input 577 may be entered into the non-defined region 580. This user input is not passed to the application 310, but is rather interpreted by the positioning component 348. As previously described, based on the interpretation, the positioning component 348 may respond to the input in an appropriate manner.
  • FIG. 9 illustrates a flow chart of an example method 900 for implementing a customizable compact overlay window in a display. The method 900 will be described with respect to one or more of FIGS. 2-6 discussed previously.
  • The method 900 includes an act of implementing in a display of the computing system a customizable compact overlay window that is customizable by an application that uses the compact overlay window (act 910). For example, as previously discussed in the various embodiments disclosed here, a customizable compact overlay window may be customizable by the application 310 and/or 320. In one embodiment, the compact overlay window 610 may be implemented.
  • The method 900 includes an act of receiving input into at least a portion of the compact overlay window (act 920). For example, as previously discussed user input 661, 662, 663, and 665 may be received in various portions of the compact overlay window 610.
  • The method 900 includes an act of directly passing the input to the application (act 930). If the application has defined a response to the input to the at least one portion of the compact overlay window, any response to the input is determined by the defined response of the application. For example, as previously described the user input 661, 662, 663, and 665 may be passed directly to the application 310. The application 310 may include the event handlers 671-674, which may be configured to be triggered by certain types of user input. As previously discussed, when the user input 661, 662, and 663 triggers the event handles 671-673, the application responds to the input in the manner defined by the event handler.
  • The method 900 includes, in response to an indication that the application has not defined a response to the input to the at least one portion of the compact overly window, an act of the computing system determining a response to the input (act 940). For example, as previously described when the application 310 does not have an event handler for the user input 665, the application 310 passes the user input to the compact overlay window manager component 340. The positioning component 348 is then able to determine an appropriate response to the user input.
  • For the processes and methods disclosed herein, the operations performed in the processes and methods may be implemented in differing order. Furthermore, the outlined operations are only provided as examples, and some of the operations may be optional, combined into fewer steps and operations, supplemented with further operations, or expanded into additional operations without detracting from the essence of the disclosed embodiments.
  • The present invention may be embodied in other specific forms without departing from its spirit or characteristics. The described embodiments are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is, therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.

Claims (21)

1-20. (canceled)
21. A computing system for implementing a customizable compact overlay window in a display, the computing system comprising:
a processor; and
a storage device having stored thereon computer-executable instructions which, when executed by the processor, causes the computing system to perform operations comprising:
execute a first application within a first application window on the display of the computing system;
execute a second application, wherein the first application and the second application are different applications;
based on executing the second application, receive, from the second application, one or more customization parameters that define how a second application window is to be configured as a compact overlay window; and
generate the compact overlay window, the compact overlay window being customized according to the received customization parameters, wherein the first application window displaying the first application and the compact overlay window displaying the second application are concurrently displayed at the computing system.
22. The computing system of claim 21, wherein the customization parameters define regions of the compact overlay window.
23. The computing system of claim 22, wherein the operations further comprise:
receiving a first user input in one of the defined regions of the compact overlay window; and
based on the first user input being received in one of the defined regions, passing the first user input to the second application to be interpreted by the second application.
24. The computing system of claim 23, wherein the operations further comprise:
receiving a second user input in a non-defined region of the compact overlay window; and
based on the second user input being received in the non-defined region, interpreting the second user input by a compact overlay manager.
25. The computing system of claim 24, wherein the second user input causes the compact overlay window to be repositioned or resized.
26. The computing system of claim 21, wherein the defined regions include at least three separate regions.
27. A computer-implemented method performed by a computing system, the method comprising:
executing a first application within a first application window on a display of the computing system;
executing a second application, wherein the first application and the second application are different applications;
based on executing the second application, receiving, from the second application, one or more customization parameters that define how a second application window is to be configured as a compact overlay window; and
generating the compact overlay window, the compact overlay window being customized according to the received customization parameters, wherein the first application window displaying the first application and the compact overlay window displaying the second application are concurrently displayed at the computing system.
28. The computer-implemented method of claim 27, wherein the customization parameters define regions of the compact overlay window.
29. The computer-implemented method of claim 28, further comprising:
receiving a first user input in one of the defined regions of the compact overlay window; and
based on the first user input being received in one of the defined regions, passing the first user input to the second application to be interpreted by the second application.
30. The computer-implemented method of claim 29, further comprising:
receiving a second user input in a non-defined region of the compact overlay window; and
based on the second user input being received in the non-defined region, interpreting the second user input by a compact overlay manager.
31. The computer-implemented method of claim 30, wherein the second user input causes the compact overlay window to be repositioned or resized.
32. The computer-implemented method of claim 27, wherein the defined regions include at least three separate regions.
33. A computer-implemented method executed by a computing system, the method comprising:
executing a first application within a first application window on a display of the computing system;
executing a second application, wherein the first application and the second application are different applications;
based on executing the second application, receiving, from the second application, one or more customization parameters that define how a second application window is to be configured as a compact overlay window, wherein the customization parameters define one or more regions of the compact overlay window; and
generating the compact overlay window, the compact overlay window being customized according to the received customization parameters, wherein the compact overlay window includes the one or more defined regions and one or more non-defined regions and wherein the first application window and the compact overlay window are concurrently displayed.
34. The computer-implemented method of claim 33, further comprising:
receiving a first user input in one of the defined regions of the compact overlay window; and
based on the first user input being received in one of the defined regions, passing the first user input to the second application to be interpreted by the second application.
35. The computer-implemented method of claim 34,
receiving a second user input in one of the non-defined regions of the compact overlay window; and
based on the second user input being received in the non-defined region, interpreting the second user input by a compact overlay manager.
36. The computer-implemented method of claim 35, wherein the second user input causes the compact overlay window to be repositioned or resized.
37. The computer-implemented method of claim 35, further comprising:
receiving a third user input in one of the non-defined regions;
determining that the third user input is not a type of input that is to be handled by the computing system;
notifying the first application that the third user input has occurred in one of the non-defined regions; and
allowing the first application to respond to the third user input in a manner determined by the first application.
38. The computer-implemented method of claim 33, wherein the customization parameters further define a size for the compact overlay window.
39. The computer-implemented method of claim 33, wherein the customization parameters further define a position for the compact overlay window.
40. The computer-implemented method of claim 33, wherein the one or more defined regions include a play button.
US17/667,239 2016-06-30 2022-02-08 Customizable compact overlay window Pending US20220398996A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/667,239 US20220398996A1 (en) 2016-06-30 2022-02-08 Customizable compact overlay window

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/199,647 US11295706B2 (en) 2016-06-30 2016-06-30 Customizable compact overlay window
US17/667,239 US20220398996A1 (en) 2016-06-30 2022-02-08 Customizable compact overlay window

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/199,647 Continuation US11295706B2 (en) 2016-06-30 2016-06-30 Customizable compact overlay window

Publications (1)

Publication Number Publication Date
US20220398996A1 true US20220398996A1 (en) 2022-12-15

Family

ID=59295334

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/199,647 Active 2038-03-19 US11295706B2 (en) 2016-06-30 2016-06-30 Customizable compact overlay window
US17/667,239 Pending US20220398996A1 (en) 2016-06-30 2022-02-08 Customizable compact overlay window

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US15/199,647 Active 2038-03-19 US11295706B2 (en) 2016-06-30 2016-06-30 Customizable compact overlay window

Country Status (4)

Country Link
US (2) US11295706B2 (en)
EP (1) EP3479220B1 (en)
CN (1) CN109416638B (en)
WO (1) WO2018005247A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10904325B2 (en) * 2018-05-04 2021-01-26 Citrix Systems, Inc. WebRTC API redirection with screen sharing
US20220309424A1 (en) * 2021-03-23 2022-09-29 Citrix Systems, Inc. Display of resources based on context

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031530A (en) * 1995-06-07 2000-02-29 Sony Corporation Always-visible window class with overlap prevention
US20080222569A1 (en) * 2007-03-08 2008-09-11 International Business Machines Corporation Method, Apparatus and Program Storage Device For Providing Customizable, Immediate and Radiating Menus For Accessing Applications and Actions
US20120110507A1 (en) * 2010-10-28 2012-05-03 Microsoft Corporation Context Menu
US20130055154A1 (en) * 2011-08-30 2013-02-28 Google Inc. User Graphical Interface for Displaying a Belonging-Related Stream
US20130054692A1 (en) * 2011-08-30 2013-02-28 Google Inc. Organizing and Tracking Belongings Using Social Graph Information
US20130120295A1 (en) * 2011-11-16 2013-05-16 Samsung Electronics Co., Ltd. Mobile device for executing multiple applications and method for same
US20140047413A1 (en) * 2012-08-09 2014-02-13 Modit, Inc. Developing, Modifying, and Using Applications
US20140129457A1 (en) * 2012-11-02 2014-05-08 Stroz Friedberg, LLC An interactive organizational decision-making and compliance facilitation portal
US20140208216A1 (en) * 2013-01-22 2014-07-24 Tealium Inc. Activation of dormant features in native applications
US20140297516A1 (en) * 2013-03-26 2014-10-02 Research In Motion Limited Method for providing composite user interface controls and an online storefront for same
US20140344754A1 (en) * 2013-05-20 2014-11-20 Citrix Systems, Inc. Providing Enhanced User Interfaces
US20150149967A1 (en) * 2012-12-29 2015-05-28 Apple Inc. Device, Method, and Graphical User Interface for Navigating User Interface Hierarchies

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040230992A1 (en) 1993-05-27 2004-11-18 Gemstar Development Corporation Method and apparatus for displaying video clips
ES2266399T3 (en) 1996-03-15 2007-03-01 Gemstar Development Corporation METHOD AND APPLIANCE FOR DISPLAYING TELEVISION PROGRAMS AND ASSOCIATED TEXT.
AU6099200A (en) 1999-07-13 2001-01-30 Sun Microsystems, Inc. Methods and apparatus for creating a video window with parameters defining position and scaling factor
US20020070957A1 (en) 2000-12-12 2002-06-13 Philips Electronics North America Corporation Picture-in-picture with alterable display characteristics
US7055169B2 (en) * 2002-04-19 2006-05-30 Opentv, Inc. Supporting common interactive television functionality through presentation engine syntax
EP1465047A1 (en) 2003-04-03 2004-10-06 Deutsche Thomson-Brandt Gmbh Method for presenting menu buttons
US8239453B2 (en) 2005-02-25 2012-08-07 Microsoft Corporation System and method for providing one class of users of an application a view of what another class of users of the application is visually experiencing
US7502545B2 (en) 2005-04-28 2009-03-10 Microsoft Corporation Picture-in-picture window for video replay
US7580080B2 (en) 2005-11-22 2009-08-25 Gateway, Inc. Automatic launch of picture-in-picture during commercials
KR100817315B1 (en) 2006-09-25 2008-03-27 삼성전자주식회사 Mobile terminal for receiving digital broadcasting having touch screen and method for controlling pip screen thereof
TR200804561A2 (en) 2008-06-23 2010-01-21 Vestel Elektroni̇k Sanayi̇ Ve Ti̇caret A.Ş. The use of television-like structures in the display of advertising or information broadcasts
US20100188579A1 (en) 2009-01-29 2010-07-29 At&T Intellectual Property I, L.P. System and Method to Control and Present a Picture-In-Picture (PIP) Window Based on Movement Data
US9898675B2 (en) 2009-05-01 2018-02-20 Microsoft Technology Licensing, Llc User movement tracking feedback to improve tracking
US9201563B2 (en) * 2012-10-10 2015-12-01 Google Inc. Mobile device friendly window management for remote desktop
US20140164935A1 (en) 2012-12-12 2014-06-12 Dror Frommer System for rapid browsing of content
US20140195675A1 (en) * 2013-01-09 2014-07-10 Giga Entertainment Media Inc. Simultaneous Content Data Streaming And Interaction System
US20140201681A1 (en) * 2013-01-16 2014-07-17 Lookout, Inc. Method and system for managing and displaying activity icons on a mobile device
US20140259079A1 (en) 2013-03-06 2014-09-11 Eldon Technology Limited Trick play techniques for a picture-in-picture window rendered by a video services receiver
CN103338340B (en) 2013-06-18 2016-06-22 北京汉博信息技术有限公司 Realize picture-in-picture module and the method for the multiple video strems self-defined combination of frame picture
US9973722B2 (en) 2013-08-27 2018-05-15 Qualcomm Incorporated Systems, devices and methods for displaying pictures in a picture
US9113039B2 (en) 2013-09-20 2015-08-18 Intel Corporation Wireless sharing of content between computing devices
US20150128042A1 (en) 2013-11-04 2015-05-07 Microsoft Corporation Multitasking experiences with interactive picture-in-picture
KR102262051B1 (en) 2014-08-01 2021-06-09 삼성전자 주식회사 Display apparatus, multi display system and controlling method thereof
CN104994314B (en) 2015-08-10 2019-04-09 优酷网络技术(北京)有限公司 Pass through the method and system of gesture control PIP video on mobile terminals

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6031530A (en) * 1995-06-07 2000-02-29 Sony Corporation Always-visible window class with overlap prevention
US20080222569A1 (en) * 2007-03-08 2008-09-11 International Business Machines Corporation Method, Apparatus and Program Storage Device For Providing Customizable, Immediate and Radiating Menus For Accessing Applications and Actions
US20120110507A1 (en) * 2010-10-28 2012-05-03 Microsoft Corporation Context Menu
US20130055154A1 (en) * 2011-08-30 2013-02-28 Google Inc. User Graphical Interface for Displaying a Belonging-Related Stream
US20130054692A1 (en) * 2011-08-30 2013-02-28 Google Inc. Organizing and Tracking Belongings Using Social Graph Information
US20130120295A1 (en) * 2011-11-16 2013-05-16 Samsung Electronics Co., Ltd. Mobile device for executing multiple applications and method for same
US20140047413A1 (en) * 2012-08-09 2014-02-13 Modit, Inc. Developing, Modifying, and Using Applications
US20140129457A1 (en) * 2012-11-02 2014-05-08 Stroz Friedberg, LLC An interactive organizational decision-making and compliance facilitation portal
US20150149967A1 (en) * 2012-12-29 2015-05-28 Apple Inc. Device, Method, and Graphical User Interface for Navigating User Interface Hierarchies
US20140208216A1 (en) * 2013-01-22 2014-07-24 Tealium Inc. Activation of dormant features in native applications
US20140297516A1 (en) * 2013-03-26 2014-10-02 Research In Motion Limited Method for providing composite user interface controls and an online storefront for same
US20140344754A1 (en) * 2013-05-20 2014-11-20 Citrix Systems, Inc. Providing Enhanced User Interfaces

Also Published As

Publication number Publication date
CN109416638B (en) 2022-04-01
US11295706B2 (en) 2022-04-05
US20180005602A1 (en) 2018-01-04
EP3479220B1 (en) 2021-08-18
EP3479220A1 (en) 2019-05-08
WO2018005247A1 (en) 2018-01-04
CN109416638A (en) 2019-03-01

Similar Documents

Publication Publication Date Title
EP3680766B1 (en) Split screen display method, apparatus, terminal, and storage medium
US10613701B2 (en) Customizable bladed applications
KR102391699B1 (en) Dynamic joint dividers for application windows
JP6046126B2 (en) Multi-application environment
KR102118223B1 (en) Cross window animation
US7512892B2 (en) Method and system for displaying and interacting with paginated content
US20220398996A1 (en) Customizable compact overlay window
US20130093764A1 (en) Method of animating a rearrangement of ui elements on a display screen of an electronic device
US11868605B2 (en) Application bar display method and electronic device
US9804767B2 (en) Light dismiss manager
JP2017532681A (en) Heterogeneous application tab
US20120185798A1 (en) Application view region
US9817966B2 (en) Extension interaction with applications
US9214005B2 (en) Methods and systems for overriding graphics commands
TW201545052A (en) Methods for handling applications running in the extend mode and tablet computers using the same
TW201826109A (en) Method and apparatus for page presentation
US8572500B2 (en) Application screen design allowing interaction
US8982137B2 (en) Methods and systems for overriding graphics commands
US11243679B2 (en) Remote data input framework
KR20140148470A (en) Associating content with a graphical interface window using a fling gesture
KR102223554B1 (en) Terminal, method for contrlling thereof and recording medium on which a program for implemeting the method
US20230008653A1 (en) Display method, apparatus and computer-readable storage medium
US11366571B2 (en) Visualization components including sliding bars
Kuisma Opportunities and challenges of touch interfaces: Analysing mobile usability with heuristic evaluation

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: APPLICATION DISPATCHED FROM PREEXAM, NOT YET DOCKETED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED