WO2016118793A1 - Commande d'accès à un contenu - Google Patents

Commande d'accès à un contenu Download PDF

Info

Publication number
WO2016118793A1
WO2016118793A1 PCT/US2016/014408 US2016014408W WO2016118793A1 WO 2016118793 A1 WO2016118793 A1 WO 2016118793A1 US 2016014408 W US2016014408 W US 2016014408W WO 2016118793 A1 WO2016118793 A1 WO 2016118793A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
layer
user
displayed
client application
Prior art date
Application number
PCT/US2016/014408
Other languages
English (en)
Inventor
Stuart A. BAYSTON
Guilherme SCHNEIDER
Daniel WINSTON
Richard James WEST
Daniele Pizziconi
Original Assignee
Microsoft Technology Licensing, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from GBGB1501079.6A external-priority patent/GB201501079D0/en
Application filed by Microsoft Technology Licensing, Llc filed Critical Microsoft Technology Licensing, Llc
Publication of WO2016118793A1 publication Critical patent/WO2016118793A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas

Definitions

  • client application software it is known for client application software to be executed on one or more processors of a computing device to enable the application to provide functionality to a user of the computing device.
  • a client application provides content to an operating system executed on the one or more processors of the computing device.
  • the operating system is responsible for rendering this content in a user interface provided by the client application that is displayed on a display of the computing device.
  • the content displayed in the user interface is controlled by the user of the computing device using an input device of the computing device.
  • the operating system is responsible for communicating detected input selections to the client application such that the client application can deliver appropriate content to the display via the operating system based on the input selections.
  • the navigation history of a client application is represented as a last-in, first-out structure commonly called a stack, backstack, or navigation backstack, as it contains layers of content (e.g. levels) in a stack structure that represents the back navigation of the client application.
  • This stack is stored in memory of the computing device.
  • the last layer of content that is added to the stack (based on a user making a selection in the user interface provided by the client application) is the first layer of content that can be removed.
  • a layer of content can be retrieved from the stack only by removing layers one at a time from the top of the stack (for example by the user iteratively pressing a 'back' button).
  • the single layer of content at the top of the stack is displayed on the display of the computing device.
  • a known client application may display a first layer of content in the user interface provided by the client application which displays a plurality of selectable inputs (e.g. icons, tabs, buttons, images, text etc.).
  • the known client application In response to detecting a user selection of one of these selectable inputs, the known client application is configured to add a further layer of content to the stack and provide the further layer of content to the operating system for rendering on the display to replace the first layer of content. In response to detecting a user selection to return to the first layer of content, the known client application is configured to remove the further layer of content from the stack and provide the first layer of content to the operating system for rendering on the display to replace the further layer of content.
  • the navigation between the first layer of content and further layers of content requires the re-rendering of the first layer of content each time the user selects to return to the first layer of content as only a single layer of content is rendered on the display at any one time, and this incurs a large amount of processor resource.
  • a user terminal comprising: a display having an available display area; one or more processors configured to run a client application having a user interface capable of operating in a full screen mode whereby a single layer of content is displayed in the available display area or in a split-view mode to display content; wherein the client application is configured to: detect, whilst controlling the user interface to operate in the full screen mode, a user selection that the user interface operates in the split-view mode, and in response display a first layer of content in a predetermined position to partially overlap a second layer of content in the available display area such that a portion of the second layer of content is displayed in the available display area and a remaining portion of the second layer of content is not displayed in the available display area; and display an indicator providing an indication of how content displayed on the first layer of content is related to content displayed on the portion of the second layer of content.
  • At least one computer readable medium storing a client application having a user interface and which, when executed on one or more processors of a user terminal comprising a display having an available display area, is configured to: detect, whilst controlling the user interface to operate in a full screen mode whereby a single layer of content is displayed in the available display area, a user selection that the user interface operates in a split-view mode, and in response display a first layer of content in a predetermined position to partially overlap a second layer of content in the available display area such that a portion of the second layer of content is displayed in the available display area and a remaining portion of the second layer of content is not displayed in the available display area; and display an indicator providing an indication of how content displayed on the first layer of content is related to content displayed on the portion of the second layer of content.
  • a method implemented by a client application having a user interface the method implemented by the client application when executed on one or more processors of a user terminal comprising a display having an available display area, the method comprising: detecting, whilst controlling the user interface to operate in a full screen mode whereby a single layer of content is displayed in the available display area, a user selection that the user interface operates in a split-view mode, and in response displaying a first layer of content in a predetermined position to partially overlap a second layer of content in the available display area such that a portion of the second layer of content is displayed in the available display area and a remaining portion of the second layer of content is not displayed in the available display area; and displaying an indicator providing an indication of how content displayed on the first layer of content is related to content displayed on the portion of the second layer of content.
  • Figure 1 is a schematic illustration of a communication system
  • Figure 2 is a schematic block diagram of a user terminal
  • Figure 3 is flow chart for a process performed by a communication client application when executed on the user terminal; and [00016] Figures 4a-c illustrates communication client user interfaces provided in accordance with exemplary embodiments of the present disclosure.
  • VoIP Voice over internet protocol
  • IM instant messages
  • file transfers etc.
  • client software provides the VoIP connections as well as other functions such as registration and authentication.
  • Figure 1 shows a communication system 100 comprising a first user 104
  • the user terminals 102 and 108 can communicate over a communication network 106 in the communication system 100, thereby allowing the users 104 and 110 to communicate with each other over the communication network 106.
  • the communication network 106 may be any suitable network which has the ability to provide a communication channel between the user terminal 102 and the second user terminal 108.
  • the communication network 106 may be the Internet or another type of network such as a High data rate mobile network, such as a 3 rd generation (“3G”) mobile network.
  • 3G 3 rd generation
  • user terminals can connect to the communication network 106 via an additional intermediate network not shown in Figure 1.
  • the user terminal 102 is a mobile device, then it can connect to the communication network 106 via a cellular mobile network (not shown in Figure 1), for example a GSM or UMTS network.
  • a cellular mobile network not shown in Figure 1
  • GSM Global System for Mobile communications
  • the user terminal 102 may be, for example, a mobile phone, a personal digital assistant ("PDA"), a personal computer (“PC”) (including, for example, WindowsTM, Mac OSTM and LinuxTM PCs), a tablet computer, a gaming device or other embedded device able to connect to the communication network 106.
  • the user terminal 102 is arranged to receive information from and output information to User A 104.
  • the user terminal 102 executes a communication client application 112, provided by a software provider associated with the communication system 100.
  • the communication client application 112 is a software program executed on a local processor in the user terminal 102.
  • the communication client application 112 performs the processing required at the user terminal 102 in order for the user terminal 102 to transmit and receive data over the communication system 100.
  • the communication client application 112 executed at the user terminal 102 may be authenticated to communicate over the communication system through the presentation of digital certificates (e.g. to prove that user 104 is a genuine subscriber of the communication system - described in more detail in WO 2005/009019).
  • the user terminal 108 may correspond to the user terminal 102.
  • the user terminal 108 executes, on a local processor, a communication client application 114 which corresponds to the communication client application 112 executed at the user terminal 102.
  • the communication client application 114 at the user terminal 108 performs the processing required to allow User 110 to communicate over the network 106 in the same way that the communication client application 112 at the user terminal 102 performs the processing required to allow the User A 104 to communicate over the network 106.
  • the user terminals 102 and 108 are end points in the communication system.
  • Figure 1 shows only two users (104 and 110) and two user terminals (102 and 108) for clarity, but many more users and user devices may be included in the communication system 100, and may communicate over the communication system 100 using respective communication clients executed on the respective user devices, as is known in the art.
  • FIG. 2 illustrates a detailed view of the user terminal 102 on which is executed a communication client application for communicating over the communication system 100.
  • the user terminal 102 comprises a central processing unit ("CPU") 202, to which is connected a display 204 such as a screen or touch screen, input devices such as a keypad 206, a camera 208, and touch screen 204.
  • the camera 208 may be a conventional webcam that is integrated into the user terminal 102, or coupled to the user device via a wired or wireless connection.
  • the camera 208 may be a depth-aware camera such as a time of flight or structured light camera.
  • An output audio device 210 e.g. a speaker
  • an input audio device 212 e.g.
  • the CPU 202 is connected to a network interface 224 such as a modem for communication with the communication network 106.
  • the network interface 224 may be integrated into the user terminal 102 as shown in Figure 2.
  • the network interface 224 is not integrated into the user terminal 102.
  • the user terminal 102 also comprises a memory 226 for storing data as is known in the art.
  • the memory 226 may be a permanent memory, such as ROM.
  • the memory 226 may alternatively be a temporary memory, such as RAM.
  • the user terminal 102 is installed with the communication client application 112, in that the communication client application 112 is stored in the memory 226 and arranged for execution on the CPU 202.
  • the memory 226 may also store navigation history associated with the communication client application 112.
  • Figure 2 also illustrates an operating system ("OS") 214 executed on the CPU 202.
  • OS operating system
  • Running on top of the OS 214 is a software stack 216 for the communication client application 112 referred to above.
  • the software stack shows an I/O layer 218, a client engine layer 220 and a client user interface layer ("UP') 222.
  • Each layer is responsible for specific functions. Because each layer usually communicates with two other layers, they are regarded as being arranged in a stack as shown in Figure 2.
  • the operating system 214 manages the hardware resources of the computer and handles data being transmitted to and from the communication network 106 via the network interface 224.
  • the I/O layer 218 comprises audio and/or video codecs which receive incoming encoded streams and decodes them for output to speaker 210 and/or display 204 as appropriate, and which receive unencoded audio and/or video data from the microphone 212 and/or camera 208 and encodes them for transmission as streams to other end-user terminals of the communication system 100.
  • the client engine layer 220 handles the connection management functions of the VoIP system as discussed above, such as establishing calls or other connections by server-based or P2P address look-up and authentication. The client engine may also be responsible for other secondary functions not discussed herein.
  • the client engine 220 also communicates with the client user interface layer 222.
  • the client engine 220 may be arranged to control the client user interface layer 222 to present information to the user of the user terminal 102 via the user interface of the communication client application 112 which is displayed on the display 204 and to receive information from the user of the user terminal 102 via the user interface.
  • Figure 2 shows one CPU but as an alternative, the user terminal 102 may comprise more than one CPU e.g. which constitute cores of a multi-core processor.
  • FIG. 3 is a flow chart for a process 300 performed by the communication client application 112 when executed on the user terminal 102.
  • the process 300 will first be described with reference to Figures 4a-c which illustrate exemplary client user interfaces presented in various embodiments as part of the process 300.
  • the user interface provided by the communication client application 112 can operate in one of at least two modes.
  • the first mode is a "full screen” mode in which a single layer of content provided by the communication client application 112 is displayed on the display 204.
  • the second mode is a "split view” mode in which both a first layer of content and a second layer of content provided by the communication client application 112 are displayed on the display 204.
  • the communication client application 112 controls the user interface provided by the communication client application 112 to operate in the full screen mode.
  • FIG. 4a The left-hand illustration of Figure 4a illustrates the client user interface displaying a layer of content 401 in an available area 400 of the display 204 responsive to the communication client application 112 supplying a single layer of content to the OS 214 for rendering on the display 204.
  • This layer of content 401 is stored at the top of the navigation backstack associated with the communication client application 112.
  • the layer of content 401 displayed on the display 204 when the communication client application 112 controls the user interface provided by the communication client application 112 to operate in the full screen mode may comprise information pertaining to the recent communication activity associated with User A 104 within a predetermined period. "Recent" activity is typically meant time-ordered information, with most recent activity being displayed first in a list or most prominently, and less recent activity being displayed later in a list or at a less-prominent position.
  • FIG. 4a illustrates that User A 104 has recent communication activity with Users B-G of the communication system 100.
  • the displayed recent activity may include for example avatars 402 (which are images chosen by users to represent themselves within the VoIP system) of those users that User A 104 has had recent communication activity with, the usernames 404 of those users that User A 104 has had a recent communication session with, and information 406 pertaining to the last communication event in the communication session conducted with the respective users e.g. last IM message received, contact acceptance, missed call etc.
  • Figure 4a illustrates (i) an avatar 402a and username 404a associated with User B 110 and information 406a pertaining to the last communication event (e.g. an exchanged FM) in the communication session conducted with User B 110; (ii) an avatar 402b and username 404b associated with a User C and information 406b pertaining to the last communication event (e.g. an exchanged IM) in the communication session conducted with User C; (iii) an avatar 402c and username 404c associated with a User D and information 406c pertaining to the last communication event (e.g.
  • the last communication event e.g. an exchanged FM
  • an avatar 402b and username 404b associated with a User C and information 406b pertaining to the last communication event
  • the last communication event e.g. an exchanged IM
  • an avatar 402e and username 404e associated with a User F and information 406e pertaining to the last communication event e.g. an unanswered voice call
  • an avatar 402f and username 404f associated with a User G and information 406f pertaining to the last communication event e.g.
  • an exchanged FM in the communication session conducted with User G
  • User A 104 is able to select a selectable input displayed on the layer of content 401 using an input device of the user terminal 102 to view more detailed information on one of the communication sessions. For example, by using a keypad 206, moving a cursor displayed on the display 204 by physically moving a mouse (not shown in Figure 2) coupled to the user terminal 102, or touching an area of the display 204 if the display 204 is a touch screen.
  • the selectable input may for example be an avatar 402, a username 404 or a predetermined area of the displayed layer of content surrounding a particular avatar 402, username 404 and information 406 associated with a communication session.
  • the communication client application 112 detects a user selection that the user interface provided by the communication client application 112 operates in the split-view mode. This may be based on detecting selection of a selectable input that is displayed on the layer of content 401 that is displayed when the communication client application 112 is operating in the full screen mode.
  • FIG. 4a An example user selection is indicated in Figure 4a by the circle 408 which represents an area of the display 204 (a touch screen) that has been tapped by User A 104 using their finger or other computing instrument used to input command to the touch screen (such as a stylus).
  • Figure 4a illustrates that User A has selected to view more detailed information on the communication session with User B 110.
  • a known communication client application would be configured in response to detecting this user selection, to add a further layer of content comprising detailed information on the communication session with User B 110 to the navigation backstack and provide the further layer of content to the OS for rendering on the display.
  • the default behaviour of the OS is to display the further layer in full screen mode. That is to replace the layer of content displaying the recent communication activity associated with User A 104 with the further layer of content.
  • step S304 in response to detecting the user selection at step S304, the process 300 proceeds to step S306 whereby the communication client application 112 controls the user interface provided by the communication client application 112 to operate in the split- view mode (depicted in the right-hand illustration of Figure 4a).
  • the communication client application 112 adds a further layer of content 403 to the navigation backstack (on top of the layer of content 401) and provides both the lower layer of content 401 and the upper further layer of content 403 comprising detailed information on the communication session with User B 110 e.g. a chat view featuring all conversation and call history with User B 110, to the the OS 214 for rendering on the display 204 in the available display area 400.
  • the communication client application 112 controls the OS 214 to render the further layer of content 403 in a predetermined position in the available display area 400 to partially overlap the layer of content 401 displaying the recent communication activity associated with User A 104. That is, the communication client application 112 controls the OS 214 to operate in accordance with a custom behaviour (such that the OS 214 does not display the further layer 403 in accordance with its default behaviour).
  • the above described interaction between the OS 214 and the communication client application 112 is based on the OS 214 exposing at least one API (application programming interface) that the communication client application 112 can use to implement custom behaviours and interactions that are in accordance with embodiments described herein.
  • API application programming interface
  • the communication client application 112 is configured to control the OS 214 such that the further layer of content 403 is scaled (resized) by the OS 214 to fill a portion of the available display area 400 that corresponds to the predetermined position referred to above. This is depicted in the right-hand illustration of Figure 4a.
  • the predetermined position referred to above is dependent on the content displayed on the layer of content 401.
  • the lower layer of content e.g. the layer of content 401
  • the upper layer of content e.g. the further layer of content 403
  • the lower layer of content may overlap the lower layer of content to leave the plurality of selectable inputs exposed and displayed on the display 204.
  • the portion of the layer of content 401 that is displayed in the available display area 400 comprises selectable inputs (e.g. avatars 402 of the users that User A 104 has had recent communication activity with) that may be selected by User A 104. That is, the partial overlapping of the further layer of content 403 on top of the layer of content 401 displaying the recent communication activity associated with User A 104 creates a tabbed sidebar comprising these selectable inputs.
  • selectable inputs e.g. avatars 402 of the users that User A 104 has had recent communication activity with
  • the further layer of content 403 displaying detailed information on the communication session with User B 110 in the available display area 400 illustrated in Figure 4a shows IM messages previously exchanged between User A 104 and User B 110 however this chat view may include other information such as call history information (placed calls, end of calls, missed calls) and file transfer information.
  • the further layer of content 403 comprises a message field 412 into which
  • User A 104 can enter text using the keypad 206 or by tapping an area of the display 204 (a touch screen) when a virtual keypad is displayed on the display 204.
  • the further layer of content 403 comprises a toolbar 414 which displays selectable inputs for initiating a communication event with User B 110 (e.g. to place a voice or video call to User B 110) and a selectable menu button which may provide User A 104 with one or more selectable options pertaining to the functionality provided by the communication client application (e.g. to add User B 110 to a favourite contacts list, to edit contact information for User B 110, to view profile information of User B 110, to block further communication with User B 110, to remove User B 110 as a contact) .
  • selectable inputs for initiating a communication event with User B 110 e.g. to place a voice or video call to User B 110
  • a selectable menu button which may provide User A 104 with one or more selectable options pertaining to the functionality provided by the communication client application (e.g. to add User B 110 to a favourite contacts list, to edit contact information for User B 110, to view profile information of User B 110, to block further communication with User B 110, to remove User B 110 as
  • the communication client application 112 controls the user interface provided by the communication client application 112 to display an indicator 410 providing an indication of how content displayed on the further layer of content 403 is related to content on the displayed portion of the layer of content 401.
  • the indicator 410 provides an indication that the communication session information displayed on the further layer of content 403 relates to a communication session with User B 110 due to the indicator 410 being displayed adjacent to the avatar 402a of User B 110 (rather than adjacent to the avatars 402b-g of the other users that User A 104 has had recent communication activity with).
  • Whist Figure 4a shows the indicator 410 being displayed on the further layer of content 403, additionally or alternatively the indicator 410 may be displayed on the layer of content 401 displaying the recent communication activity associated with User A 104.
  • the communication client application 112 may control the user interface provided by the communication client application 112 to display the indicator 410 at a position on the layer of content 401 to indicate that the communication session information displayed on the further layer of content 403 relates to a communication session with User B 110 (for example the indicator 410 may be displayed adjacent to, on, or around the avatar 402a associated with User B 110.
  • the communication client application 112 may display the indicator 410 on the layer of content 401 in a particular colour, and additionally control the further layer of content 403 to be displayed in this particular colour. This providing an indication that content displayed on the further layer of content 403 is related to content on the displayed portion of the layer of content 401.
  • User A 104 may select another selectable input (e.g. an avatar 402 other than avatar 402a) that is displayed on the portion of the layer of content 401 (the created tabbed sidebar) that is displayed in the available display area 400 when the communication client application 112 is operating in the split-view mode.
  • another selectable input e.g. an avatar 402 other than avatar 402a
  • the communication client application 112 removes the further layer of content 403 from the navigation backstack and adds another further layer of content 403 comprising detailed information on the communication session with the user associated with the selected avatar 402, to the navigation backstack (on top of the layer of content 401) and provides this other further layer of content (along with the layer of content 401) to the the OS 214 for rendering on the display 204 in the available display area 400 in place of the further layer of content 403 in the predetermined position to display detailed information on the communication session with the user associated with the selected avatar 402.
  • the selectable inputs e.g. avatars 402 that are displayed on the portion of the layer of content 401 act as tabs to advantageously allow User A 104 to quickly and easily jump between conversations, and see contextual information in the layer of content 401 displaying the recent communication activity associated with User A 104, whilst actively communicating with one or more users.
  • embodiments of the present disclosure negate the need for User A 104 to 'jump' up and down levels of content to navigate through the user interface provided by the communication client application 112 as User A 104 does not need to leave the layer of content that is in focus (the upper further layer of content) to interact with the lower layer of content (e.g. the layer of content 401).
  • User A 104 may make a selection to control the user interface provided by the communication client application 112 to operate in the full screen mode to display only the further layer of content 403 in the available area 400 of the display 204.
  • the communication client application 112 instructs the OS 214 to render the further layer of content 403 on the display 204 in the available display area 400 to fully overlap the layer of content 401 displaying the recent communication activity associated with User A 104 (such that no portion of the layer of content 401 is displayed in the available display area 400 of the display 204).
  • both the layer of content 401 and the further layer of content 403 are rendered on the display 204 by the OS 214, only a single layer of content (the further layer of content 403) provided by the communication client application 112 is displayed on the display 204 due to the overlapping described above.
  • Figure 4b illustrates the transition from the user interface provided by the communication client application 112 operating in the split-view mode to operating in the full screen mode in response to a user selection.
  • This user selection may for example be a dragging of the further layer of content 403 in a direction to fully overlap the layer of content 401 displaying the recent communication activity associated with User A 104.
  • FIG. 4b An example user selection is indicated in Figure 4b by the circles 408 which represents a finger swipe gesture on an area of the display 204 (a touch screen) that has been made by User A 104 using their finger or other computing instrument used to input command to the touch screen (such as a stylus) to drag the further layer of content in a substantially horizontal direction (right to left in this example).
  • the finger swipe gesture includes the user making contact with the display (a finger-down event), moving the contact from right to left in a substantially horizontal direction across the touch- sensitive surface of the display 204 (a finger-dragging event), and the user ceasing contact with the display 204 (a finger-up (lift off) event).
  • This dragging of the further layer of content 403 may also be implemented by User A 104 moving a cursor displayed on the display 204 by physically moving a mouse (not shown in Figure 2) coupled to the user terminal 102.
  • the lock point 416 is associated with a lock threshold area in the available display area 400 which is defined by the communication client application 112.
  • the lock threshold area is defined by a left-side edge that is parallel and positioned to the left of the lock point 416, and a right-side edge that is parallel and positioned to the right of the lock point 416 (described with respect to the viewpoint of User A 104 noting that the lock threshold area is not visible to User A 104).
  • the communication client application 112 instructs the OS 214 to render the further layer of content 403 on the display 204 in the available display area 400 to fully overlap the layer of content 401 displaying the recent communication activity associated with User A 104.
  • the communication client application 112 controls the OS 214 to move the left hand edge of the further layer of content 403 horizontally from right to left (as viewed by User A 104) along a fixed axis as User A 104 makes the right-to-left finger swipe.
  • the communication client application 112 is further configured to control the OS 214 such that the content displayed on the further layer of content 403 when the user interface provided by the communication client application 112 operates in the split-view mode is scaled-up in size by the OS 214 as the further layer of content 403 is expanded in size.
  • the further layer of content 403 (after scaling) is displayed in the user interface provided by the communication client application 112 operating in full screen mode. This is depicted in the right-hand illustration of Figure 4b.
  • User A 104 can drag back the previously created tabbed sidebar comprising the selectable inputs at any point allowing for quick and easy switching between the recent communication sessions.
  • the communication client application 112 controls the user interface provided by the communication client application 112 to operate in the split-view mode (depicted in the right-hand illustration of Figure 4a).
  • the communication client application 112 determines where the dragging gesture ends based on an area in the available display area that the swipe reaches prior to the user ceasing contact with the display 204.
  • the communication client application 112 determines where the dragging gesture ends based on an area in the available display area that the cursor reaches prior to the user releasing a button on the mouse.
  • the communication client application 112 controls the OS 214 to move the left hand edge of the further layer of content 403 horizontally from left to right (as viewed by User A 104) along the fixed axis as User A 104 makes the left-to-right finger swipe.
  • the communication client application 112 may be further configured to control the OS 214 such that the content displayed on the further layer of content 403 when the user interface provided by the communication client application 112 operates in the full screen mode, is scaled-down in size by the OS 214 and displayed in the user interface provided by the communication client application 112 operating in the split-view mode.
  • the communication client application 112 may not control the OS 214 to perform any scaling such that the further layer content 403 retains a fixed size so that content displayed along the right-hand side of the further layer of content 403 is cut-off and not displayed in the available display area 400.
  • the communication client application 112 In response to detecting dragging of the left hand edge of the further layer of content 403 in a direction to expose the layer of content 401 (e.g. a left-to-right finger swipe) whereby the dragging gesture ends out of the lock threshold area (beyond the right- side edge of the lock threshold area), the communication client application 112 removes the further layer of content 403 from the navigation backstack to control the user interface provided by the communication client application 112 to not display the further layer of content 403 and reveal the lower layer of content 401 displaying the recent communication activity associated with User A 104 that has been rendered on the display 204 by the OS 214. This is illustrated in Figure 4c.
  • the user interface provided by the communication client application 112 maintains operating in the full screen mode in which a single layer of content provided by the communication client application 112 is displayed on the display 204.
  • the communication client application 112 Prior to the left-to-right finger swipe, the communication client application 112 provides both the layer of content 401 displaying the recent communication activity associated with User A 104 and the further layer of content 403 to the OS 214 for rendering on the display 204, but due to the communication client application 112 instructing the OS 214 to completely overlapping the layer of content 401 with the upper further layer of content 403, no portion of the layer of content 401 is displayed.
  • the communication client application 112 provides only the layer of content 401 displaying the recent communication activity associated with User A 104 to the OS 214 for rendering on the display 204.
  • the communication client application 112 continually provides the layer of content 401 displaying the recent communication activity associated with User A 104 to the OS 214 for rendering on the display 204.
  • the layer of content 401 may be fully displayed on the display 204, partially displayed on the display 204 (due to the further layer of content 403 being rendered partially on top of the layer of content 401, or not displayed at all on the display 204.
  • the layer of content 401 does not have to be re-rendered by the OS 214 each time User A 104 navigates through the user interface provided by the communication client application 112 to view this content. This advantageously reduces the amount of processor resource that is incurred when User A 104 navigates through the user interface provided by the communication client application 112.
  • the communication client application 112 controls the user interface provided by the communication client application 112 to operate in the split-view mode, the portion of the layer of content 401 that is displayed in the available display area 400 is still able to alert User A 104 to activity (e.g. incoming communication events) happening behind the layer of content that is in focus (e.g. the upper further layer of content 403).
  • the selectable inputs displayed on the portion of the layer of content 401 that is displayed in the available display area 400 may be dynamically rearranged by the communication client application 112. That is, if User A 104 receives a communication event (e.g. an instant message) from a user (e.g.
  • the communication client application 112 may modify the displayed tabbed sidebar by displaying an avatar 402 associated with User I at the top of the recent activity list and shift the remaining avatars 402a-402g down to be positioned under the avatar 402 associated with User I.
  • the communication client application 112 continues to control the user interface provided by the communication client application 112 to display the further layer of content 403 which displays detailed information on the communication session with User B 110, and alters the position of the indicator 410 such that it remains being displayed alongside the avatar 402a of User B 110 in its new position in the displayed tabbed sidebar.
  • the communication client application 112 may modify the displayed tabbed sidebar by displaying the avatar 402 associated with the User at the top of the recent activity list and shift the remaining avatars 402 down to be positioned under the avatar 402 associated with User that transmitted the instant message.
  • a communication event e.g. an instant message
  • the communication client application 112 may modify the displayed tabbed sidebar by displaying the avatar 402 associated with the User at the top of the recent activity list and shift the remaining avatars 402 down to be positioned under the avatar 402 associated with User that transmitted the instant message.
  • the communication client application 112 may modify the displayed tabbed sidebar by displaying a visual indication next to, on, or around the avatar 402 associated with the User that transmitted the instant message to alert User A 104 to the received communication event.
  • a communication event e.g. an instant message
  • the communication client application 112 may modify the displayed tabbed sidebar by displaying a visual indication next to, on, or around the avatar 402 associated with the User that transmitted the instant message to alert User A 104 to the received communication event.
  • the communication client application 112 may control the user interface provided by the communication client application 112 to continue operating in the full screen mode.
  • the communication client application 112 may add the further layer of content comprising detailed information on the communication session with User B 110 to the navigation backstack (on top of the layer of content 401) and provide the further layer of content 403 to the OS 214 for rendering on the display 204 to fully overlap the layer of content 401 displaying the recent communication activity associated with User A 104 (such that no portion of the layer of content 401 is displayed in the available display area 400 of the display 204).
  • the further layer of content 403 displays detailed information on the communication session with User B 110 in the available display area 400 e.g. a chat view featuring all conversation and call history with User B 110. This is depicted in the right- hand illustration in Figure 4b.
  • User A 104 may then make a selection (e.g. a left-to-right finger swipe) to control the user interface provided by the communication client application 112 to operate in the split- view mode (depicted in the right-hand illustration of Figure 4a) or to continue operating in the full screen mode whereby the layer of content 401 displaying the recent communication activity associated with User A 104 is displayed on the display 204 (depicted in the right-hand illustration of Figure 4c).
  • a selection e.g. a left-to-right finger swipe
  • Embodiments extend to other types of client applications which display a window of content comprising a plurality of selectable inputs (e.g. icons, tabs, buttons, images, text etc.) that provides links to further content associated with the respect selectable inputs.
  • selectable inputs e.g. icons, tabs, buttons, images, text etc.
  • the client user interface provided by the communication client application 112 displays content in the available area 400 of the display 204.
  • the available area 400 of the display 204 is the whole of the display.
  • the available area of the display may constitute only a portion of the display e.g. with the remainder of the display being used by the OS 214 and/or other application(s) executed thereon to display other content.
  • a user terminal comprising: a display having an available display area; one or more processors configured to run a client application having a user interface capable of operating in a full screen mode whereby a single layer of content is displayed in the available display area or in a split-view mode to display content; wherein the client application is configured to: detect, whilst controlling the user interface to operate in the full screen mode, a user selection that the user interface operates in the split-view mode, and in response display a first layer of content in a predetermined position to partially overlap a second layer of content in the available display area such that a portion of the second layer of content is displayed in the available display area and a remaining portion of the second layer of content is not displayed in the available display area; and display an indicator providing an indication of how content displayed on the first layer of content is related to content displayed on the portion of the second layer of content.
  • the second layer of content may be displayed in the available display area in the full screen mode.
  • the user selection that the user interface operates in the split-view mode is a selection of a selectable input displayed on the second layer of content.
  • the first layer of content may be selected for display in dependence on said selection of the selectable input.
  • the display may be touch-sensitive, and the client application may be configured to detect the user selection based on detection of a tap gesture on the touch-sensitive display.
  • the user terminal may be coupled to a computer mouse, and the client application may be configured to detect the user selection based on an input received from the computer mouse.
  • the first layer of content may be displayed in the available display area in the full screen mode, the first layer of content completely overlapping the second layer of content that is rendered on the display.
  • the user selection that the user interface operates in the split-view mode may be dragging of the first layer of content in a direction to within a threshold area of the available display area.
  • the display may be touch-sensitive, the client application may be configured to detect the user selection based on detection of a swipe gesture in said direction on the touch-sensitive display.
  • the user terminal may be coupled to a computer mouse, and the client application may be configured to detect the selection of the selectable input based on an input received from the computer mouse.
  • the client application may be further configured to detect, whilst controlling the user interface to operate in the split-view mode, a user selection of a selectable input displayed on the second layer of content, and in response, remove the first layer of content and display a further layer of content in the predetermined position to partially overlap the second layer of content, wherein the further layer of content is selected for display in dependence on said selection of the selectable input.
  • the client application may be further configured to detect, whilst controlling the user interface to operate in the split-view mode, a user selection that the user interface operates in the full screen mode, and in response display the first layer of content to fully overlap the second layer of content in the available display area such that no portion of the second layer of content is displayed in the available display area.
  • the user selection that the user interface operates in the full screen mode may be dragging of the first layer of content in a direction outside of a threshold area of the available display area.
  • the client application may be further configured to detect, whilst controlling the user interface to operate in the split-view mode, an event associated with content displayed on the second layer of content, and in response modify the portion of the second layer of content that is displayed in the available display area to alert a user of the user terminal to said event.
  • the predetermined position may be dependent on the content displayed on the second layer of content.
  • the indicator may be displayed on at least one of the first layer of content and the second layer of content.
  • the available display area may be the whole of the area of a display screen of the device.
  • the client application may be a communication client application configured to exchange communication events over a communication network with other user terminals.
  • the second layer of content may comprise information related to at least one communication session conducted by the user of the user terminal with one or more further users, and the first layer of content comprises information on communication events exchanged in a selected one of said communication sessions.
  • any of the functions described herein can be implemented using software, firmware, hardware (e.g., fixed logic circuitry), or a combination of these implementations.
  • the terms "functionality” and "application” as used herein generally represent software, firmware, hardware, or a combination thereof.
  • the functionality or application represents program code that performs specified tasks when executed on a processor (e.g. CPU or CPUs).
  • the program code can be stored in one or more computer readable memory devices.
  • the user terminals may also include an entity (e.g. software) that causes hardware of the user terminals to perform operations, e.g., processors functional blocks, and so on.
  • the user terminals may include a computer- readable medium that may be configured to maintain instructions that cause the user terminals, and more particularly the operating system and associated hardware of the user terminals to perform operations.
  • the instructions function to configure the operating system and associated hardware to perform the operations and in this way result in transformation of the operating system and associated hardware to perform functions.
  • the instructions may be provided by the computer-readable medium to the user terminals through a variety of different configurations.
  • One such configuration of a computer-readable medium is signal bearing medium and thus is configured to transmit the instructions (e.g. as a carrier wave) to the computing device, such as via a network.
  • the computer-readable medium may also be configured as a computer-readable storage medium and thus is not a signal bearing medium. Examples of a computer-readable storage medium include a random-access memory (RAM), read-only memory (ROM), an optical disc, flash memory, hard disk memory, and other memory devices that may use magnetic, optical, and other techniques to store instructions and other data.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un terminal d'utilisateur comprenant : un dispositif d'affichage dont une zone d'affichage est disponible ; un processeur configuré pour exécuter une application de client dont une interface utilisateur peut fonctionner dans un mode plein écran, moyennant quoi une couche unique de contenu est affichée dans la zone d'affichage disponible ou dans un mode de visualisation fractionné ; l'application de client étant configurée pour : détecter, tout en commandant l'interface utilisateur pour qu'elle fonctionne dans le mode plein écran, une sélection d'utilisateur que l'interface utilisateur exploite dans le mode de visualisation fractionné et, en réponse, afficher une première couche de contenu à une position prédéfinie pour qu'elle recouvre partiellement une seconde couche de contenu, de sorte qu'une partie de la seconde couche de contenu soit affichée dans la zone d'affichage disponible et qu'une partie restante de la seconde couche de contenu ne soit pas affichée ; et afficher un indicateur fournissant une indication de la manière dont un contenu est affiché sur les deux couches.
PCT/US2016/014408 2015-01-22 2016-01-22 Commande d'accès à un contenu WO2016118793A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
GBGB1501079.6A GB201501079D0 (en) 2015-01-22 2015-01-22 Controlling access to content
GB1501079.6 2015-01-22
US14/700,077 US10139983B2 (en) 2015-01-22 2015-04-29 Controlling access to content
US14/700,077 2015-04-29

Publications (1)

Publication Number Publication Date
WO2016118793A1 true WO2016118793A1 (fr) 2016-07-28

Family

ID=55349966

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/014408 WO2016118793A1 (fr) 2015-01-22 2016-01-22 Commande d'accès à un contenu

Country Status (1)

Country Link
WO (1) WO2016118793A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107037949A (zh) * 2017-03-29 2017-08-11 北京小米移动软件有限公司 一种分屏显示方法及装置
CN107229411A (zh) * 2017-05-27 2017-10-03 北京小米移动软件有限公司 控制分屏状态的方法及装置
CN109683760A (zh) * 2018-12-14 2019-04-26 Oppo广东移动通信有限公司 最近内容的显示方法、装置、终端及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005009019A2 (fr) 2003-07-16 2005-01-27 Skype Limited Systeme telephonique poste a poste
US20130159941A1 (en) * 2011-01-06 2013-06-20 Research In Motion Limited Electronic device and method of displaying information in response to a gesture
EP2669786A2 (fr) * 2012-05-29 2013-12-04 Samsung Electronics Co., Ltd Procédé d'affichage d'éléments dans un terminal et terminal utilisant ce procédé

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005009019A2 (fr) 2003-07-16 2005-01-27 Skype Limited Systeme telephonique poste a poste
US20130159941A1 (en) * 2011-01-06 2013-06-20 Research In Motion Limited Electronic device and method of displaying information in response to a gesture
EP2669786A2 (fr) * 2012-05-29 2013-12-04 Samsung Electronics Co., Ltd Procédé d'affichage d'éléments dans un terminal et terminal utilisant ce procédé

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107037949A (zh) * 2017-03-29 2017-08-11 北京小米移动软件有限公司 一种分屏显示方法及装置
CN107037949B (zh) * 2017-03-29 2020-11-27 北京小米移动软件有限公司 一种分屏显示方法及装置
US10976887B2 (en) 2017-03-29 2021-04-13 Beijing Xiaomi Mobile Software Co., Ltd. Method and apparatus for split-window display
CN107229411A (zh) * 2017-05-27 2017-10-03 北京小米移动软件有限公司 控制分屏状态的方法及装置
CN109683760A (zh) * 2018-12-14 2019-04-26 Oppo广东移动通信有限公司 最近内容的显示方法、装置、终端及存储介质

Similar Documents

Publication Publication Date Title
US10863136B2 (en) Switch view functions for teleconference sessions
EP3120231B1 (fr) Arrêt de notifications en réponse à une notification présentée
EP3533180B1 (fr) Interface multitâche intégrée destinée à des sessions de télécommunication
EP3114832B1 (fr) Affichage de données d'appel vidéo
US9608950B2 (en) Systems and methods for sharing videos and images in a texting environment
US9432314B2 (en) Quick navigation of message conversation history
US10516632B2 (en) Switchable modes for messaging
US7966572B2 (en) User interface transition
EP3103225B1 (fr) Messagerie instantanée
CN115509398A (zh) 使用即时消息服务以显示图释的方法及其用户装置
US20050188317A1 (en) Initiate multiple applications
US20050188314A1 (en) User interface start page
US10139983B2 (en) Controlling access to content
WO2017063443A1 (fr) Procédé et appareil d'affichage de message
US20180232920A1 (en) Contextually aware location selections for teleconference monitor views
US20180295158A1 (en) Displaying group expressions for teleconference sessions
CN111263175A (zh) 直播平台的交互控制方法及装置、存储介质及电子设备
WO2016118793A1 (fr) Commande d'accès à un contenu
WO2024037012A1 (fr) Procédé et appareil d'envoi d'émoji animé interactif, support informatique et dispositif électronique
JP2021502661A (ja) インタラクティブキーボード提供方法及びそのシステム
CN117149431A (zh) 资源的管理方法、装置及电子设备
CN115113773A (zh) 信息的处理方法、装置、计算机可读存储介质和电子装置
KR20110022388A (ko) 멀티태스킹 기능을 구비하는 이동 단말기 및 그 동작 제어 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16704104

Country of ref document: EP

Kind code of ref document: A1

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16704104

Country of ref document: EP

Kind code of ref document: A1