WO2014165976A1 - Fonctionnement multitâches et partage d'écrans sur dispositifs informatiques portables - Google Patents

Fonctionnement multitâches et partage d'écrans sur dispositifs informatiques portables Download PDF

Info

Publication number
WO2014165976A1
WO2014165976A1 PCT/CA2014/000345 CA2014000345W WO2014165976A1 WO 2014165976 A1 WO2014165976 A1 WO 2014165976A1 CA 2014000345 W CA2014000345 W CA 2014000345W WO 2014165976 A1 WO2014165976 A1 WO 2014165976A1
Authority
WO
WIPO (PCT)
Prior art keywords
eoa
region
app
given
interface
Prior art date
Application number
PCT/CA2014/000345
Other languages
English (en)
Inventor
Jeremy BERRYMAN
Original Assignee
Berryman Jeremy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Berryman Jeremy filed Critical Berryman Jeremy
Priority to CA2945675A priority Critical patent/CA2945675C/fr
Priority to US14/784,143 priority patent/US20160071491A1/en
Publication of WO2014165976A1 publication Critical patent/WO2014165976A1/fr

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14Display of multiple viewports
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04803Split screen, i.e. subdividing the display area or the window area into separate subareas
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Definitions

  • the subject matter disclosed generally relates to screen sharing on portable computing devices.
  • Portable computing devices have small displays, especially smartphones. By default, these devices allow for running multiple applications in the background, but only one application may be displayed on the screen at a given time.
  • Apple ® 's IOS ® in particular is very adamant on a developer's environment confined within the application itself. For instance IOS® does not allow for merging two applications, and does not allow for overlapping two applications or running them at the same time. It also does not allow the user to exit the app visually running and minimize the size into a mini screen over its operating system, and does not allow for playing with the content of the way other applications run.
  • a method for screen sharing on a portable computing device having a display device comprising:
  • a banner comprising a list of content elements pertaining to different apps (EOA), each EOA representing only a portion of available functions in a given app;
  • the steps of receiving to running the selected EOA exclude any pausing and/or interruption of the primary media element of the first app.
  • the method further comprises extracting the EOAs from existing apps using an API (application program interface) feed.
  • API application program interface
  • the method further comprises receiving a user input touching/pressing/clicking over another predefined region of the display area, and, in response, displaying a search box for searching primary media of the first app in the second region without interrupting/pausing a media element content currently playing in the first region.
  • the method further comprises receiving a user input swiping the first region in a given direction, and, in response, displaying the primary media of a second app different than the first app.
  • the method further comprises receiving a user input swiping the first region in a given direction, and, in response, displaying a menu bar in the second region without interrupting/pausing a media content currently playing in the first region.
  • the method further comprises receiving a user input swiping the banner in a given direction, and in response, displaying further EOAs.
  • the method further comprises providing a location in the banner, said location when touched/pressed/clicked over causes an original order of EOAs to be restored in the banner.
  • each EOA represents a single function of available functions in the given app.
  • each EOA represents two or more functions of available functions in the given app.
  • the method further comprises providing an invisible grid over the second region, the invisible grid comprising a plurality of different spaces, each space being associated with a given EOA, wherein upon receiving a user input over a given space running the EOA associated with the given space in the second region.
  • the method further comprises providing a number of EOAs in groups and providing a virtual rolling wheel for displaying the EOAs associated with a given group in the banner.
  • the method further comprises: color coding the groups.
  • the portable computing device comprises an orientation sensing device, the method further comprising running the primary media on the entire display when sensing a change of orientation of the portable computing device.
  • the change of orientation comprises a change from a portrait mode to a landscape mode.
  • a user interface implemented on a computing device having a display, the interface comprising:
  • a display area for running a first application comprising a primary media wherein upon detecting a user input over a selected region of the display area the interface displays a banner comprising a list of content elements pertaining to different apps (EOA), each EOA representing only a portion of available functions in a given app; wherein upon receiving a user input selecting a given EOA of a different app the interface divides the display area into two regions:
  • the interface displays the banner and runs the secondary EOA without pausing/interrupting the primary media.
  • the interface is adapted to provide a number of EOAs in groups and provide a virtual rolling wheel for displaying the EOAs associated with a given group in the banner.
  • the interface is adapted to extract the EOAs from existing apps using API.
  • the embodiments describe an interface on a portable smart device e.g. iPhone or the like (iPad, iPod, tablets, computers, laptops, smart TVs), which allows for dividing the display into two regions or more.
  • a portable smart device e.g. iPhone or the like
  • iPad iPod, tablets, computers, laptops, smart TVs
  • One region for running a primary media element of a first app e.g. a Netflix ® video
  • another region for running a secondary element from a second app which may be different than the first app and without interrupting the primary media during activation or search of the secondary element.
  • Portable device Portable device, portable computing device, device, smart phone, and phone.
  • Display and screen are used interchangeably to mean the display of the portable device.
  • the display may be touch sensitive whereby the user may interface with the portable device by touching/taping on the display over selected areas/links.
  • - Primary Media A video, streaming video, live cam, video game or video chat, or any video based media.
  • API Feed A developers code used to allow content from an outside source; such as, a server, a website or application to be accessed and shown within their website or application (i.e. video feed, user comments, Nexmo ® SMS and voice messaging, OpenTok ® live face to face video, weather temperatures in various countries etc.)
  • Multi sharing screens Miniature windows within a smart device which are interchangeable with each other.
  • - Launch bar (aka banner or taskbar): A bar with linked icons accessing specific apps
  • EOA element of app
  • EOAs represent only a portion of the functionalities provided in a given app (one or few). Examples of EOAs include Youtube ® videos, Youtube ® search, Youtube ® , Nexmo ® (SMS and voice messaging), comments etc.
  • Figures 1 a to 1 i illustrate different examples of an interface in accordance with the present embodiments;
  • Figures 2a, 2b, 2c, 2d and 2e illustrate an example for providing EOAs in groups, in accordance with an embodiment;
  • Figures 3a to 3c illustrate screenshots of two applications sharing the same screen of a portable device in accordance with an embodiment
  • Figure 4 illustrates an example of how the position of the applications may be changed within the screen
  • Figure 5a and 5b illustrate an example of how one application may expand on the expense of another application, in one embodiment
  • Figure 6 illustrates an example of how a first application may be split in two portions to provide a second application between the two portions
  • Figures 7a and 7b illustrate an example of how an application may be paused by changing the orientation of the phone
  • Figures 8a and 8b illustrate an example of how the embodiments may be applied in the domain of sale
  • Figures 8c and 8d illustrate an example of how the embodiments may be applied in the domain of education
  • Figures 9a to 9c illustrate an example of how the embodiments may be applied in the domain of gaming
  • Figures 10a and 10b illustrate an example of how the embodiments may be applied for synchronous viewing of videos from remote locations
  • Figures 1 1 a to 11c illustrate an example of how the embodiments may be applied for making emergency calls
  • Figure 12 is a flowchart of a method for screen sharing on a portable computing device having a small display device, in accordance with an embodiment; and [0049] Figure 13 illustrates an exemplary diagram of a suitable computing operating environment in which embodiments of the invention may be practiced.
  • a framework which may run on any smartphone software platform e.g. IOS®, Android® etc., and which allows users to watch a primary media while being able to select and run one or more other programs on the screen simultaneously and without interrupting the primary media being watched.
  • the frameworks allows for extracting and selecting content elements from different applications using API and web browsers and running these elements simultaneously on the display (aka screen) without having to run the entire applications.
  • the Facebook® app may include several elements such as video, pictures, comments, search, wall posts, newsfeed, timeline, etc.
  • the Youtube® app includes several elements such as videos, comments, search, history, playlists etc.
  • the embodiments describe an interface which combines primary media elements of one application with one or more secondary elements (media and non-media) from other applications, whereby the user may choose to run a primary media element on a portion of the display e.g. a Youtube® video, and select to run a secondary element (or more) of another application (or more) e.g. Facebook® wall, or Facebook® newsfeed, Google® search etc.
  • searching for, selecting and running the secondary element is done without interrupting (i.e. pausing) the first media.
  • An example is provided below with reference to Figure 1 b.
  • an interface 800 is provided on a mobile device such as an iPhone® or the like, in accordance with an embodiment.
  • the interface 800 may be used for running a first app 802 e.g. an app including a primary element like Youtube®.
  • the interface 800 may run the first app 802 in its standard manner (as the original app usually runs) and by making available all the functionalities that the app 802 provides.
  • the app 802 is the Youtube® app
  • the interface 800 may run a video on a portion of the display and provide the users' comments on the video or suggestions below the video like in a standard Youtube® app.
  • the user decides to activate the screen sharing mode and run another element e.g. check their Facebook® newsfeed, at the same time of watching the Youtube® video, the user may choose to activate/display a banner including a list of available secondary elements and select the secondary element(s) that they wish to run in a screen sharing mode.
  • the user may press over/touch the display anywhere or at a given location e.g. region 804 as shown in Figure 1 b to display the banner 806 as shown in Figure 1c.
  • the banner 806 (aka taskbar 806) includes a plurality of elements of apps (EOA) 808 which may be run as secondary elements in the screen sharing mode at the same time as the primary media is running.
  • the user may navigate/explore all the EOAs 808 by sliding the banner 806 to the left or right as indicated by arrow 810.
  • the banner 806 may include a region 812 which when pressed on by the user brings back the original order of apps e.g. appl followed by app 2 etc.
  • the user may customize the order of the EOAs for a quick access to the EOA that are most used.
  • the interface may arrange the order of the EOAs based on the frequency of use.
  • the selection of a banner EOA may also be set to switch both the current primary media screen 814 and EOA 816 simultaneously or separate to a new EOA and primary media.
  • the interface upon receiving a user selection of a given EOA e.g. EOA 3 the interface may change its operation to run only the media element of the first app 802 (e.g. only the video of the Youtube® app) in one region 814 of the interface 800 and the selected EOA 3 in another second region 816 of the interface as exemplified in Figure 1d.
  • the interface may be used to maximize region 816 over the primary media in play to fit most of most of 800 still exposing the top EOA region (EOA 1 , EOA 2 and EOA 3) as exemplified in Figure 1d.
  • EOA 1 , EOA 2 and EOA 3 the interface may be used to maximize region 816 over the primary media in play to fit most of most of 800 still exposing the top EOA region (EOA 1 , EOA 2 and EOA 3) as exemplified in Figure 1d.
  • This allows access to the top EOA selections to access the banner for yet another EOA selection to reduce the maximized EOA 3 back to region 816, all without disrupting the primary media audio in play (in a case where the visual of the primary media is less important than the audio).
  • the user may select another primary media to run in the region 814 by swiping the region 814 in one direction as exemplified by arrow 819.
  • the media element of another app 819 e.g. Vimeo, Quicktime, Facebook videos etc. is run as a primary media element in the first region 814 as indicated in Figure 1e.
  • the user may also open the menu bar 822 by swiping the region 814 in the opposite direction as exemplified by arrow 818.
  • An example is shown in Figure 1g.
  • the user may select another shared screen to run in the region 816 by swiping the region 816 in one direction as exemplified by arrow 819.
  • the user may also open the menu bar 822 by swiping the region 816 in the opposite direction as exemplified by arrow 818.
  • Figure 1g is shown in Figure 1g.
  • the interface 800 may be configured so that upon detecting a user input pressing over another region 818, the interface may display a search box 820 which allows the user to search for more media from the app for which the media element is running in the primary region 814. For example, if the user is watching a Youtube® video in the region 814 and the user touches the region 818 a search box 820 may be displayed which allows the user to search for more videos from Youtube®. An example is shown in Figure 1f.
  • the interface may display transparent browser arrows 824 in the second region 816 as shown in Figure 1 h. These arrows allow the user to transition to next and previous web browser pages and browser apps within the sharing screens without the need for a taskbar taking away from screen spacing.
  • the transparent arrows are fixed in place on the bottom corner of browsing multi sharing screens.
  • the fixed arrows may be repositioned higher and/or more spaced out within the 816 region.
  • an added icon which may be transparent may also be added within the 816 region; such as, maximize/minimize icon (to maximize the 816 region to the 800 region and then back again to the 816 region without disruption of the primary media's audio in play), a volume button, etc.
  • an invisible grid defining a plurality of spaces may be provided in the interface over the primary media region 814 for selecting/changing the secondary EOAs in the second region 816.
  • Each space may be linked to a different EOA whereby by pressing over a given region of the grid the associated EOA e.g. EOA 3 may run in the secondary region 816, as exemplified in Figure 1 i and without interrupting the primary media running in the primary region 814.
  • FIG. 1 i illustrates the grid and associated apps for illustrations purposes only.
  • a top banner above the primary media in play may be provided covering a portion of EOA 1 , EOA 2 and EOA 3 to assist in guiding users to the EOA selections.
  • the interface may provide the EOAs 808 in the banner 806 (shown in Figure 1c) in the form of groups, whereby the user may personalize the interface to their choice by providing related EOAs in the same group.
  • the user may group together EOAs related to social media, music, news, friends, chat etc.
  • the user may switch between a group and another by rolling a virtual wheel on the interface as exemplified in Figures 2a and 2b.
  • the banner 806 may include a virtual rolling wheel 826 which by rolling up or down allows for changing the EOA groups.
  • a visual indication 828 may also be displayed in the secondary region indicating the group name as indicated in Figures 2a and 2b.
  • the user may personalize the size and location of the applications on the display to fit two or more simultaneously running applications on the display.
  • the user may personalize the location of the applications further by splitting a given application in two (or more) portions and inserting another application between these portions. These new portions will be best displayed on larger devices like tablets and larger Smartphone devices.
  • the user may layer an application to run over the primary media in play as the process indicated in Figures 2c and 2d, allowing 2 applications plus the primary media's audio to run simultaneously.
  • the portable device may include an accelerometer (or compass, or the like) for sensing when the orientation of the portable device is changed; e.g., when the portable device is rotated between a portrait mode and a landscape mode (or vice versa).
  • the portable device may be configured to pause an application; e.g., video or game, when the orientation of the portable device is changed and to un-pause when the original orientation is resumed.
  • the interface may allocate the entire display area to the primary media. The interface may resume the screen sharing when the device is returned to the portrait orientation.
  • Figures 3a to 11c illustrate different examples and screenshots of the present and other embodiments.
  • Figures 3a and 3b illustrate an example of two applications sharing the same screen of a portable device in accordance with an embodiment.
  • a video application 51 e.g., Youtube®
  • a banner 52 may appear which includes a plurality of applications 54 the user may choose one or more of the applications 54 to run simultaneously on the screen 50.
  • the chatting application 54b may run and share the screen with the video application 51 on the same screen 50, as illustrated in Figure 3b.
  • activation of the screen sharing mode may be done by dragging the second application 54b toward the screen and/or over the already running application 51 , as exemplified in Figure 3c. Other methods may also be used.
  • the user may adjust the size of each application on the screen to increase the size of one and to reduce the size of the other.
  • the size of the other application may adjust automatically based on the first adjustment. For example, if two applications share the screen equally (50%-50%), and the user decides to increase to size of one of them to become 60%, the size of the other application may automatically shrink from 50% to 40% to avoid the overlap.
  • the resolution of one application may change to increase/decrease depending on the nature of the size change, whereby the content of the application will be shown in its entirety.
  • the second method a portion of the content may be hidden without changing the resolution.
  • the user may select the position of each application on the screen.
  • Figure 4 illustrates an example of how the position of the applications may be changed within the screen. For example, if the user wants to see the video at the lower half of the screen, the user may do so by dragging the lower half up, or the upper half down, or by putting a finger on each application and rotating the two fingers, etc. as exemplified in Figure 4 which illustrates that the positions of the two applications 51 and 54b have been inverted with respect to Figure 3b.
  • Figure 5a and 5b illustrate an example of how one application may expand at the expense of another application, in accordance with another embodiment. If the user decides to engage in a chatting session, the user may click/touch the text entry area to receive the screen displayed in Figure 5a wherein the keyboard replaces the comments received from other users in the chat room. In the present embodiment, as the user types, the area 60 would expand upward over the video application 51 as exemplified in Figure 5b.
  • the user may personalize the view further by splitting one application in two portions and providing the other application between the two portions.
  • An example is provided in Figure 6.
  • Figure 6 illustrates an example of how a first application may be split in two portions to provide a second application between the two portions. As shown in Figure 6, the text receiving portion associated with the keyboard is provided above at the top of the screen, the keyboard 62 is provided at the bottom of the screen and the video application 51 is provided between the two.
  • the application may pause by rotating the telephone or changing its orientation; e.g., portrait to landscape or vice versa.
  • the application may un- pause when the phone is returned to its original orientation.
  • An example is illustrated in Figures 7a and 7b.
  • Figures 7a and 7b illustrate an example of how an application may be paused by changing the orientation of the phone, in accordance with an embodiment.
  • This embodiment may be implemented with any of the embodiments above. For example, if the user is watching a video and they receive a text message, a visual indication may be displayed (by default) for a second or less to alert the user that a message has been received. The user may then rotate the phone, launch the messaging application to reply and return the phone to its original orientation to un-pause the video after writing the reply and sending it or while writing the reply (this way the user can watch the video after un-pausing it while typing the reply). Needless to say, the action of rotating the phone replaces the manual pausing/ un-pausing of the application. In other words, the user does not have to manually pause/un-pause the application if they rotate the phone when practicing the present embodiment.
  • embodiments of the invention allow for multiple levels of screen personalization comprising: running multiple applications on the same screen, adjusting the size of each application within the screen, positioning the applications in any user selected location within the screen, splitting a first application and providing a second application between different portions of the first application, and pausing and un-pausing an application by changing the orientation of the phone.
  • the application maybe used for conducting 911 calls and at the same time viewing the agent answering the call and recording or video streaming the caller or the crime screen. For instance, if the phone is in portrait mode, the user may view the police/security agent answering the call in one window and view what the camera of the phone is recording in a second window. For example, this allows the security agent to better guide the caller and/or witness the crime as it happens etc.
  • the front and back cameras of a portable device it is possible to activate the front and back cameras of a portable device and allocate a portion of the screen to each camera, whereby the user may record themselves and the scene they are looking at simultaneously, while streaming one or both screens to a second user over a wireless connection.
  • the user may video tape themselves as well as the beach and stream one or both windows to a remote user.
  • the user may also share the window of the beach they are recording with another user, as that user is viewed in a second window reacting to the recordings while taking part in the overall recording.
  • the recording is interchanged in various time allotments where every few seconds camera 1 switches to record on camera 2 or vice versa providing the user a visual seemingly as simultaneous when in actuality it is interchanging quickly.
  • user 1 may upload or record a video to send to user 2.
  • User 2 receives and views the video as another recording occurs capturing the reaction of user 2.
  • User 1 receives the final completed video, one window shows the original recorded video and the second window showing the reaction of user 2 synced with the video.
  • the receiving user 2 may be receiving the completed video on another device with a standard screen in screen view of user 1 within both screens.
  • the app may be used by sale personnel or the like, whereby the user receiving the call may browse a web site and/or view the salesperson at the same time.
  • the salesperson can guide the user receiving the call through the different products and promotions as exemplified in Figures 8a and 8b.
  • this video call may auto start via touch/press as a user is browsing the site and/or products and promotions.
  • the application may be used for educational purposes whereby one portion of the screen may show a live feed of an experiment, surgery etc. while the second portion may display related notes, comments, questions or interactions, social media etc. as exemplified in Figures 8c and 8d.
  • the second portion may display a synced slideshow of visuals or products for sale timed to the primary media.
  • the application may be used for enhancing the gaming experience, whereby the user may see the opponent or other gamers playing other games at the same time in one portion of the screen and the gaming table/device e.g. poker, slot machine in the second portion as exemplified in Figures 9a to 9c.
  • the gaming table/device e.g. poker, slot machine in the second portion as exemplified in Figures 9a to 9c.
  • the user may switch the locations of the windows as desired. In one example, this may be done by placing a finger one each window and rotating the two fingers simultaneously. In other embodiment, the switching may occur by placing a finger on one window and pushing that window in an opposite direction e.g. pushing the upper window down, or the lower window up etc.
  • the app may allow the user to choose one or more players to view when playing.
  • the user may also have the option of blocking a certain player, blocking or activating the sound etc.
  • the app may be configured to obtain and push a live feed of the corresponding player to a central server, which then, based on what each user selects may push the camera feed of a selected player/opponent or combine the views of more than one players and push this data to the user making the selection.
  • the player may have different modes to choose from. 1- portrait mode viewing the game only with no video cam, 2- portrait mode with the live cam of other players in one window and the game in play in the other, 3- Landscape mode viewing the game only, 4- Landscape mode with the live cam of other players in one window, and the game in play in the other.
  • there may be a master volume or separate volume levels for each video and/or game initiated by touching/pressing the screen as an EOA and/or an EOA banner selection.
  • the player may switch live cam to other players by simply swiping on the live cam window (up, down, left or right).
  • the interface may be adapted so that the screen sharing mode may be implemented when the device is in a portrait mode and when the device's orientation is changed to be in a landscape mode, the primary media would take over the entire display. The screen sharing mode may then be resumed when the device is brought back to portrait mode. It should be noted that this embodiment may be implemented without interrupting the playing of the primary media (the video).
  • the application may allow two or more remote users to watch a video synchronously while viewing each other's reactions to it.
  • the application may cause a video to be played synchronously on the devices of the remote users in one window while the second window streams a video from the other device.
  • Figure 10a shows the video that is being played in the upper window, and the second user in the lower window.
  • Figure 10b illustrates a further embodiment, in which the lower window shows the second user as well as the first user that is associated with the mobile device shown in the Figure (realize a smaller window within the second window).
  • all occurrences may be recorded and/or exported to social media for viewing later.
  • one of the windows may occupy the full screen by changing the orientation of the device from portrait mode to a landscape mode and vice versa.
  • Each user may choose to view the movie in full landscape mode from time to time or within the portrait mode to switch the live cam reaction window to other multi-tasking events such as checking e-mail, Facebook or other social media.
  • other multi-tasking events such as checking e-mail, Facebook or other social media.
  • the audio between both users may remain in the background.
  • a second browser window is provided allowing the user to access social media and websites as they watch their videos.
  • buttons are added to the top of the screen playing the video. Tapping the top left or center of the screen opens up the launch bar in the second window with quick access links to popular sites and social media. Tapping the top right of the video screen opens up a search bar to search for videos.
  • FIG. 12 is a flowchart of a method for screen sharing on a portable computing device having a small display device, in accordance with an embodiment.
  • Step 100 comprises running a first application (app) comprising a primary media on a display area.
  • Step 102 comprises receiving a user input touching/pressing/clicking over a predefined region of the display area.
  • Step 104 comprises, in response to the user input, displaying a banner comprising a list of content elements pertaining to different apps (EOA), each EOA representing only a portion of available functions in a given app.
  • Step 106 comprises receiving a user input selecting a given EOA of a second app different than the first app.
  • Step 108 comprises, in response to the user selection of the given EOA: dividing the display area into two different region including a first region and a second region; running only the primary media of the first app as a primary EOA in the first region; and running the selected EOA of the second app as a secondary EOA in the second region.
  • Figure 13 illustrates an exemplary diagram of a suitable computing operating environment in which embodiments of the invention may be practiced.
  • the following description is associated with Figure 13 and is intended to provide a brief, general description of suitable computer hardware and a suitable computing environment in conjunction with which the embodiments may be implemented. Not all the components are required to practice the embodiments, and variations in the arrangement and type of the components may be made without departing from the spirit or scope of the embodiments.
  • program modules include routines, programs, objects, components, data structures, etc., that perform particular tasks or implement particular abstract data types.
  • the embodiments may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network PCS, minicomputers, mainframe computers, cellular telephones, smart phones, display pagers, radio frequency (RF) devices, infrared (IR) devices, Personal Digital Assistants (PDAs), laptop computers, wearable computers, tablet computers, a device of the I POD or I PAD family of devices manufactured by Apple Computer, integrated devices combining one or more of the preceding devices, or any other computing device capable of performing the methods and systems described herein.
  • the embodiments may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network.
  • program modules may be located in both local and remote memory storage devices.
  • the exemplary hardware and operating environment of Figure 13 includes a general purpose computing device in the form of a computer 720, including a processing unit 721 , a system memory 722, and a system bus 723 that operatively couples various system components including the system memory to the processing unit 721 .
  • a general purpose computing device in the form of a computer 720, including a processing unit 721 , a system memory 722, and a system bus 723 that operatively couples various system components including the system memory to the processing unit 721 .
  • the computer 720 may be a conventional computer, a distributed computer, or any other type of computer; the embodiments are not so limited.
  • the system bus 723 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures.
  • the system memory may also be referred to as simply the memory, and includes read only memory (ROM) 724 and random access memory (RAM) 725.
  • ROM read only memory
  • RAM random access memory
  • BIOS basic input/output system
  • the computer 720 further includes a hard disk drive 727 for reading from and writing to a hard disk, not shown, a magnetic disk drive 728 for reading from or writing to a removable magnetic disk 729, and an optical disk drive 730 for reading from or writing to a removable optical disk 731 such as a CD ROM or other optical media.
  • the functionality provided by the hard disk drive 727, magnetic disk 729 and optical disk drive 730 is emulated using volatile or non-volatile RAM in order to conserve power and reduce the size of the system.
  • the RAM may be fixed in the computer system, or it may be a removable RAM device, such as a Compact Flash memory card.
  • the hard disk drive 727, magnetic disk drive 728, and optical disk drive 730 are connected to the system bus 723 by a hard disk drive interface 732, a magnetic disk drive interface 733, and an optical disk drive interface 734, respectively.
  • the drives and their associated computer-readable media provide nonvolatile storage of computer- readable instructions, data structures, program modules and other data for the computer 720. It should be appreciated by those skilled in the art that any type of computer-readable media which can store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memories (RAMs), read only memories (ROMs), and the like, may be used in the exemplary operating environment.
  • a number of program modules may be stored on the hard disk, magnetic disk 729, optical disk 731 , ROM 724, or RAM 725, including an operating system 735, one or more application programs 736, other program modules 737, and program data 738.
  • a user may enter commands and information into the personal computer 720 through input devices such as a keyboard 740 and pointing device 742.
  • Other input devices may include a microphone, joystick, game pad, satellite dish, scanner, touch sensitive pad, or the like.
  • serial port interface 746 that is coupled to the system bus, but may be connected by other interfaces, such as a parallel port, game port, or a universal serial bus (USB).
  • input to the system may be provided by a microphone to receive audio input.
  • a monitor 747 or other type of display device is also connected to the system bus 723 via an interface, such as a video adapter 748.
  • the monitor comprises a Liquid Crystal Display (LCD).
  • computers typically include other peripheral output devices (not shown), such as speakers and printers.
  • the monitor may include a touch sensitive surface which allows the user to interface with the computer by pressing on or touching the surface.
  • the computer 720 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 749. These logical connections are achieved by a communication device coupled to or a part of the computer 720; the embodiment is not limited to a particular type of communications device.
  • the remote computer 749 may be another computer, a server, a router, a network PC, a client, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 720, although only a memory storage device 750 has been illustrated in Figure 6.
  • the logical connections depicted in Figure 6 include a local-area network (LAN) 751 and a wide-area network (WAN) 752. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.
  • the computer 720 When used in a LAN-networking environment, the computer 720 is connected to the local network 751 through a network interface or adapter 753, which is one type of communications device.
  • the computer 720 When used in a WAN-networking environment, the computer 720 typically includes a modem 754, a type of communications device, or any other type of communications device for establishing communications over the wide area network 752, such as the Internet.
  • the modem 754, which may be internal or external, is connected to the system bus 723 via the serial port interface 746.
  • program modules depicted relative to the personal computer 720, or portions thereof, may be stored in the remote memory storage device. It is appreciated that the network connections shown are exemplary and other means of and communications devices for establishing a communications link between the computers may be used.
  • the computer in conjunction with which embodiments of the invention may be practiced may be a conventional computer a hand-held or palm-size computer, a computer in an embedded system, a distributed computer, or any other type of computer; the invention is not so limited.
  • a computer typically includes one or more processing units as its processor, and a computer-readable medium such as a memory.
  • the computer may also include a communications device such as a network adapter or a modem, so that it is able to communicatively couple other computers.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • User Interface Of Digital Computer (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

L'invention concerne un environnement d'applications qui permet d'exécuter une application de média principaux, et de sélectionner et de manipuler simultanément une ou plusieurs autres applications sur l'écran sans perturber les média principaux. L'environnement peut même être doté de la capacité d'envoyer un message SMS sans perturber les média principaux en cours de lecture. Il s'agit d'un processus d'environnement de fonctionnement multitâches doté d'un potentiel illimité de média principaux et de partage d'écrans.
PCT/CA2014/000345 2013-04-10 2014-04-10 Fonctionnement multitâches et partage d'écrans sur dispositifs informatiques portables WO2014165976A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CA2945675A CA2945675C (fr) 2013-04-10 2014-04-10 Fonctionnement multitaches et partage d'ecrans sur dispositifs informatiques portables
US14/784,143 US20160071491A1 (en) 2013-04-10 2014-04-10 Multitasking and screen sharing on portable computing devices

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201361810443P 2013-04-10 2013-04-10
US61/810,443 2013-04-10
US201361910104P 2013-11-28 2013-11-28
US61/910,104 2013-11-28

Publications (1)

Publication Number Publication Date
WO2014165976A1 true WO2014165976A1 (fr) 2014-10-16

Family

ID=51688780

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2014/000345 WO2014165976A1 (fr) 2013-04-10 2014-04-10 Fonctionnement multitâches et partage d'écrans sur dispositifs informatiques portables

Country Status (3)

Country Link
US (1) US20160071491A1 (fr)
CA (1) CA2945675C (fr)
WO (1) WO2014165976A1 (fr)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150199085A1 (en) * 2014-01-13 2015-07-16 Microsoft Corporation Resuming Items in their Last-Used Presentation Modes
US20160196006A1 (en) * 2015-01-05 2016-07-07 Microsoft Technology Licensing, Llc Customizable Bladed Applications
WO2019162958A1 (fr) * 2018-02-26 2019-08-29 Sohrab Hanif Système portatif et dispositif multi-tâches et procédé associé
WO2020085636A1 (fr) * 2018-10-26 2020-04-30 Samsung Electronics Co., Ltd. Dispositif électronique pour afficher une liste d'applications exécutables sur un écran partagé, et procédé de fonctionnement associé
CN112672092A (zh) * 2020-12-18 2021-04-16 北京字跳网络技术有限公司 展示方法、装置和电子设备
US11861084B2 (en) 2021-11-18 2024-01-02 International Business Machines Corporation Splitting a mobile device display and mapping content with single hand

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10022619B2 (en) * 2014-04-18 2018-07-17 Sony Interactive Entertainment, LLC System and method for multi-player video gaming
US9349414B1 (en) * 2015-09-18 2016-05-24 Odile Aimee Furment System and method for simultaneous capture of two video streams
JP6578901B2 (ja) * 2015-11-13 2019-09-25 株式会社デンソー 表示制御装置
US9789403B1 (en) 2016-06-14 2017-10-17 Odile Aimee Furment System for interactive image based game
KR102629341B1 (ko) * 2017-02-24 2024-01-25 삼성전자 주식회사 멀티태스킹을 위한 인터페이스 제공 방법 및 이를 구현하는 전자 장치
US11439902B2 (en) * 2020-05-01 2022-09-13 Dell Products L.P. Information handling system gaming controls
US11076128B1 (en) * 2020-10-20 2021-07-27 Katmai Tech Holdings LLC Determining video stream quality based on relative position in a virtual space, and applications thereof

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2354914A1 (fr) * 2010-01-19 2011-08-10 LG Electronics Inc. Terminal mobile et son procédé de contrôle
US20110265040A1 (en) * 2010-04-22 2011-10-27 Samsung Electronics Co., Ltd. Method for providing graphical user interface and mobile device adapted thereto
US20120290966A1 (en) * 2011-05-11 2012-11-15 KT Corporation, KT TECH INC. Multiple screen mode in mobile terminal
US20130012273A1 (en) * 2010-03-26 2013-01-10 Kyocera Corporation Mobile terminal device
US20130120294A1 (en) * 2011-11-16 2013-05-16 Samsung Electronics Co. Ltd. Apparatus with touch screen for preloading multiple applications and method of controlling the same
US20130120295A1 (en) * 2011-11-16 2013-05-16 Samsung Electronics Co., Ltd. Mobile device for executing multiple applications and method for same

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001306581A (ja) * 2000-04-18 2001-11-02 Sony Corp ミドルウェアおよびミドルウェアを用いたメディアデータ視聴機器
US20030149967A1 (en) * 2000-05-04 2003-08-07 Tomihisa Kamada Information processing method and system
EP1393189A4 (fr) * 2001-05-02 2007-06-13 Bitstream Inc Procedes, systemes et programmation permettant d'afficher des contenus reduits a l'aide d'un facteur d'echelle variable
SE523636C2 (sv) * 2001-07-22 2004-05-04 Tomer Shalit Ab Portabelt datoriserat handhållet organ och förfarande för hantering av ett på en skärm visat objekt
US6980979B2 (en) * 2001-09-19 2005-12-27 Sun Microsystems, Inc. Method and apparatus for customizing Java API implementations
US20040030986A1 (en) * 2002-02-26 2004-02-12 Toru Matsuda Method of controlling user information and information processing apparatus
US20050010644A1 (en) * 2003-07-07 2005-01-13 Brown Scott T. High performance electronic message delivery engine
EP1908051A4 (fr) * 2005-07-22 2012-01-25 Matthew G Pallakoff Systeme et procede pour une interface d'utilisateur d'ecran tactile optimise pour le pouce
US20080114727A1 (en) * 2006-11-09 2008-05-15 Computer Associates Think, Inc. Universal statistical data mining component
US9870130B2 (en) * 2008-05-13 2018-01-16 Apple Inc. Pushing a user interface to a remote device
US9176620B2 (en) * 2008-07-22 2015-11-03 Lg Electronics Inc. Mobile terminal and method for displaying information list thereof
US8860765B2 (en) * 2008-09-08 2014-10-14 Qualcomm Incorporated Mobile device with an inclinometer
US8610830B2 (en) * 2008-09-11 2013-12-17 Apple Inc. Video rotation method and device
CN102292154A (zh) * 2008-12-08 2011-12-21 Sasol技术股份有限公司 烯烃选择性ft催化剂组合物及其制备方法
JP5352299B2 (ja) * 2009-03-19 2013-11-27 株式会社日立製作所 高信頼性計算機システムおよびその構成方法
KR101674205B1 (ko) * 2009-10-27 2016-11-08 엘지전자 주식회사 이동 통신 단말기에서의 아이콘 표시 제어 방법 및 이를 적용한 이동 통신 단말기
EP2362001A1 (fr) * 2010-02-25 2011-08-31 Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNO Procédé et dispositif pour le dépôt de couches
US9069584B2 (en) * 2010-09-13 2015-06-30 Samsung Electronics Co., Ltd. Multi-platform application player
US9244606B2 (en) * 2010-12-20 2016-01-26 Apple Inc. Device, method, and graphical user interface for navigation of concurrently open software applications
US20120278616A1 (en) * 2011-04-26 2012-11-01 Mark Liu Stevens System and Method for Securely Decrypting Files Wirelessly Transmitted to a Mobile Device
CA2834782A1 (fr) * 2011-04-29 2013-10-10 Diagnotes, Inc. Systeme et procede de traitement de demandes medicales a distance
US9361715B2 (en) * 2011-06-02 2016-06-07 Microsoft Technology Licensing, Llc Global composition system
KR101590386B1 (ko) * 2011-09-07 2016-02-01 네이버 주식회사 검색 서비스 제공 장치 및 방법
GB201115501D0 (en) * 2011-09-08 2011-10-26 Ideaworks 3D Ltd A method and system for producing executable applications
US20130135265A1 (en) * 2011-11-30 2013-05-30 Motorola Mobility, Inc. Display mode-based input key function reassignment in a communication device
CN103593594A (zh) * 2012-01-09 2014-02-19 明智视觉有限公司 用于使用脸部生物特征识别和屏幕手势来提供对电子设备的安全访问的系统和方法
KR101914117B1 (ko) * 2012-01-18 2018-11-02 삼성전자주식회사 휴대 단말들 간에 무선 랜 링크를 형성하는 방법 및 이를 위한 장치
KR20130090138A (ko) * 2012-02-03 2013-08-13 삼성전자주식회사 다중 터치 패널 운용 방법 및 이를 지원하는 단말기
KR20130093043A (ko) * 2012-02-13 2013-08-21 삼성전자주식회사 터치 및 스와이프 내비게이션을 위한 사용자 인터페이스 방법 및 모바일 디바이스
WO2013134102A1 (fr) * 2012-03-05 2013-09-12 Telecommunication Systems, Inc. Données de requête de recherche filtrées pour le contexte et l'intention de l'utilisateur dans un moteur de recherche basé sur la localisation
KR101899548B1 (ko) * 2012-04-16 2018-09-17 삼성전자 주식회사 휴대단말에서 피드 정보 수집 방법 및 장치
US20130282775A1 (en) * 2012-04-23 2013-10-24 Abb Technology Ag. Data manager centralized storage for multiple service applications
JP2013251763A (ja) * 2012-05-31 2013-12-12 Toshiba Corp 電子機器、電子機器の制御方法、電子機器の制御プログラム
US9430120B2 (en) * 2012-06-08 2016-08-30 Apple Inc. Identification of recently downloaded content
US20130332872A1 (en) * 2012-06-11 2013-12-12 EVERYTHINK Ltd. System and method for drag hover drop functionality
KR101960306B1 (ko) * 2012-07-13 2019-03-20 엘지전자 주식회사 이동 단말기 및 이의 제어 방법
KR102006413B1 (ko) * 2012-09-05 2019-08-01 삼성전자주식회사 메신저 서비스를 제공하기 위한 방법 및 그 전자 장치
US8887182B2 (en) * 2012-10-16 2014-11-11 Yahoo! Inc. Hybrid applications
TWI493437B (zh) * 2013-06-19 2015-07-21 義隆電子股份有限公司 經由識別掃滑手勢來開啓視窗控制列的方法及觸控系統
US9875150B2 (en) * 2015-06-02 2018-01-23 Apple Inc. Method and system for processing notifications amongst applications of a data processing system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2354914A1 (fr) * 2010-01-19 2011-08-10 LG Electronics Inc. Terminal mobile et son procédé de contrôle
US20130012273A1 (en) * 2010-03-26 2013-01-10 Kyocera Corporation Mobile terminal device
US20110265040A1 (en) * 2010-04-22 2011-10-27 Samsung Electronics Co., Ltd. Method for providing graphical user interface and mobile device adapted thereto
US20120290966A1 (en) * 2011-05-11 2012-11-15 KT Corporation, KT TECH INC. Multiple screen mode in mobile terminal
US20130120294A1 (en) * 2011-11-16 2013-05-16 Samsung Electronics Co. Ltd. Apparatus with touch screen for preloading multiple applications and method of controlling the same
US20130120295A1 (en) * 2011-11-16 2013-05-16 Samsung Electronics Co., Ltd. Mobile device for executing multiple applications and method for same

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150199085A1 (en) * 2014-01-13 2015-07-16 Microsoft Corporation Resuming Items in their Last-Used Presentation Modes
US9910884B2 (en) * 2014-01-13 2018-03-06 Microsoft Technology Licensing, Llc Resuming items in their last-used presentation modes
US10642827B2 (en) 2014-01-13 2020-05-05 Microsoft Technology Licensing, Llc Presenting items in particular presentation modes
US20160196006A1 (en) * 2015-01-05 2016-07-07 Microsoft Technology Licensing, Llc Customizable Bladed Applications
WO2016111873A1 (fr) * 2015-01-05 2016-07-14 Microsoft Technology Licensing, Llc Applications visibles en lame pouvant être personnalisées
CN107111496A (zh) * 2015-01-05 2017-08-29 微软技术许可有限责任公司 可定制刀片应用
US9946432B2 (en) 2015-01-05 2018-04-17 Microsoft Technology Licensing, Llc. Customizable bladed applications
WO2019162958A1 (fr) * 2018-02-26 2019-08-29 Sohrab Hanif Système portatif et dispositif multi-tâches et procédé associé
WO2020085636A1 (fr) * 2018-10-26 2020-04-30 Samsung Electronics Co., Ltd. Dispositif électronique pour afficher une liste d'applications exécutables sur un écran partagé, et procédé de fonctionnement associé
US11249643B2 (en) 2018-10-26 2022-02-15 Samsung Electronics Co., Ltd Electronic device for displaying list of executable applications on split screen and operating method thereof
CN112672092A (zh) * 2020-12-18 2021-04-16 北京字跳网络技术有限公司 展示方法、装置和电子设备
US11861084B2 (en) 2021-11-18 2024-01-02 International Business Machines Corporation Splitting a mobile device display and mapping content with single hand

Also Published As

Publication number Publication date
CA2945675A1 (fr) 2014-10-16
CA2945675C (fr) 2018-10-23
US20160071491A1 (en) 2016-03-10

Similar Documents

Publication Publication Date Title
US20160071491A1 (en) Multitasking and screen sharing on portable computing devices
US10565288B2 (en) Video streaming in a web browser
CN107341018B (zh) 一种在页面切换后继续显示视图的方法和装置
WO2019120008A1 (fr) Télévision intelligente et procédé d'affichage d'une interface utilisateur graphique d'une capture d'écran de télévision
WO2019165905A1 (fr) Procédé d'affichage d'informations, interface utilisateur graphique et terminal
JP6469313B2 (ja) 情報処理方法、端末、およびコンピュータ記憶媒体
US10928983B2 (en) Mobile user interface for contextual browsing while playing digital content
BR112018013301B1 (pt) Método e dispositivo para facilitar acesso a itens de conteúdo, e meio de armazenamento legível por computador
EP2294576B1 (fr) Fourniture de plusieurs degrés de contexte pour les contenus consommés sur des ordinateurs et lecteurs multimédias
US20110161818A1 (en) Method and apparatus for video chapter utilization in video player ui
US20140033040A1 (en) Portable device with capability for note taking while outputting content
US20140337792A1 (en) Display apparatus and user interface screen providing method thereof
US20130326583A1 (en) Mobile computing device
US20140282746A1 (en) Method and system for managing channel indexed content and electronic device implemented with said system
KR101926852B1 (ko) 홈 스크린 숏컷들을 표현하기 위한 시스템들 및 방법들
KR20140133353A (ko) 디스플레이 장치 및 그 ui 화면 제공 방법
WO2018157812A1 (fr) Procédé et appareil pour mettre en œuvre une sélection et une lecture de branche vidéo
EP2934017A1 (fr) Appareil d'affichage et son procédé de commande
EP3459262B1 (fr) Dispositif électronique, et procédé de rendu de contenu multimédia à 360°
KR102519592B1 (ko) 디스플레이 장치 및 이의 제어 방법
US20160205427A1 (en) User terminal apparatus, system, and control method thereof
WO2023024921A1 (fr) Procédé et appareil d'interaction vidéo, et dispositif et support
US11076121B2 (en) Apparatus and associated methods for video presentation
WO2022199406A1 (fr) Procédé de présentation d'évènement controversé pour application, et dispositif électronique
US20090094548A1 (en) Information Processing Unit and Scroll Method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14782348

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 14784143

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 14782348

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2945675

Country of ref document: CA