WO2021189356A1 - Microapp functionality recommendations with cross-application activity correlation - Google Patents

Microapp functionality recommendations with cross-application activity correlation Download PDF

Info

Publication number
WO2021189356A1
WO2021189356A1 PCT/CN2020/081406 CN2020081406W WO2021189356A1 WO 2021189356 A1 WO2021189356 A1 WO 2021189356A1 CN 2020081406 W CN2020081406 W CN 2020081406W WO 2021189356 A1 WO2021189356 A1 WO 2021189356A1
Authority
WO
WIPO (PCT)
Prior art keywords
correlation
microapp
interactions
trees
sequence
Prior art date
Application number
PCT/CN2020/081406
Other languages
English (en)
French (fr)
Inventor
Xiaolu Chu
Dan Hu
Original Assignee
Citrix Systems, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Citrix Systems, Inc. filed Critical Citrix Systems, Inc.
Priority to BR112021014123-5A priority Critical patent/BR112021014123B1/pt
Priority to AU2020403711A priority patent/AU2020403711A1/en
Priority to CN202080009580.4A priority patent/CN113811854B/zh
Priority to PCT/CN2020/081406 priority patent/WO2021189356A1/en
Priority to CA3123916A priority patent/CA3123916C/en
Priority to EP20913090.5A priority patent/EP3908925A4/en
Priority to US16/862,781 priority patent/US11132179B1/en
Publication of WO2021189356A1 publication Critical patent/WO2021189356A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/20Software design
    • G06F8/22Procedural
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0631Item recommendations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3438Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/70Software maintenance or management
    • G06F8/77Software metrics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/453Help systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation; Time management

Definitions

  • a digital workspace is a software framework designed to deliver and manage a user’s applications, data, and desktops in a consistent and secure manner, regardless of the user’s device or location.
  • Digital workspaces enhance the user experience by streamlining and automating those tasks that a user performs frequently, such as approving expense reports, confirming calendar appointments, submitting helpdesk tickets, and reviewing vacation requests.
  • a digital workspace allows users to access functionality provided by multiple enterprise applications-including “software as a service” (SaaS) applications, web applications, desktop applications, and proprietary applications-through a single interface.
  • SaaS software as a service
  • a digital workspace also extends the capabilities of these applications through the use of microapps.
  • a microapp synchronizes data from complex enterprise applications to streamline functionality, and can therefore be understood as a streamlined use case that users can access from within a digital workspace.
  • a method for generating microapp recommendations comprises receiving observational data that characterizes interactions between a plurality of users and a plurality of applications.
  • the method further comprises defining a set of correlation trees based on the received observational data. Each correlation tree in the set represents a sequence of interactions between one of the users and one or more of the applications.
  • the set includes a first quantity of correlation trees.
  • the method further comprises identifying a subset of similar correlation trees, each of which is included in the set.
  • the subset includes a second quantity of correlation trees that is less than the first quantity.
  • the method further comprises making a determination that the second quantity is greater than a threshold quantity.
  • the method further comprises, in response to making the determination, generating a microapp recommendation based on the sequence of interactions represented by a correlation tree that is representative of the subset.
  • generating the microapp recommendation further comprises generating machine-readable instructions, that when executed, cause the sequence of interactions represented by the representative correlation tree to be invoked.
  • the method of the first example implementation further comprises extracting a plurality of frequent action sets from the set of correlation trees; identifying a causal relationship between a particular one of the frequent action sets and a subsequent frequent action, wherein the subsequent frequent action is associated with a confidence parameter that represents how often the subsequent frequent action follows the particular frequent action set; and in response to determining that the confidence parameter exceeds a threshold confidence, generating a microapp recommendation that includes the subsequent frequent action.
  • the sequence of interactions represented by a particular one of the correlation trees in the set includes a user authentication interaction, a user data entry action, and a logoff interaction.
  • identifying the subset of similar correlation trees further comprises (a) identifying a centroid of the similar correlation trees in the subset; and (b) determining distances between each of the similar correlation trees in the subset and the centroid, wherein each of the distances is less than a threshold distance.
  • the method of the first example implementation further comprises determining distances between a particular one of the similar correlation trees in the subset and each of the other similar correlation trees in the subset, wherein each of the distances is less than a threshold distance.
  • the set of correlation trees includes a single-application correlation tree that represents a sequence of interactions between one of the users and one of the applications; and a cross-application correlation tree that represents a sequence of interactions between one of the users and at least two different applications.
  • the method of the first example implementation further comprises identifying a liaison point that links two of the correlation trees in the set, wherein the two linked correlation trees represent functionality provided by first and second applications, and wherein the liaison point represents data passing from the first application to the second application; generating a cross-application correlation tree that represents a sequence of interactions between one of the users and the first and second applications; and including the cross-application correlation tree in the defined set of correlation trees.
  • the method of the first example implementation further comprises identifying a liaison point that links two of the correlation trees in the set, wherein the two linked correlation trees represent functionality provided by first and second applications, and wherein the liaison point represents a copy operation in the first application and a paste operation in the second application.
  • a system comprises a digital workspace server.
  • the digital workspace server includes a memory and at least one processor coupled to the memory.
  • the digital workspace server is configured to generate microapp recommendations by receiving observational data that characterizes interactions between a plurality of users and a plurality of applications.
  • the digital workspace server is further configured to generate microapp recommendations by defining a set of correlation trees based on the received observational data. Each correlation tree in the set represents a sequence of interactions between one of the users and one or more of the applications.
  • the digital workspace server is further configured to generate microapp recommendations by extracting a plurality of frequent action sets from the set of correlation trees.
  • the digital workspace server is further configured to generate microapp recommendations by identifying a causal relationship between a particular one of the frequent action sets and a subsequent frequent action.
  • the subsequent frequent action is associated with a confidence parameter that represents how often the subsequent frequent action follows the particular frequent action set.
  • the digital workspace server is further configured to generate microapp recommendations by, in response to determining that the confidence parameter exceeds a threshold confidence, generating a microapp recommendation that includes the subsequent frequent action.
  • the digital workspace server is further configured to generate microapp recommendations by linking two of the defined correlation trees; (b) a first one of the linked correlation trees includes a liaison point that represents a first action taken with respect to a data element; and (c) a second one of the linked correlation trees includes a second action taken with respect to the data element.
  • the digital workspace server is further configured to generate microapp recommendations by identifying a subset of similar correlation trees, each of which is included in the set; making a determination that there are more than a threshold quantity of correlation trees in the subset; and in response to making the determination, generating a microapp recommendation based on the sequence of interactions represented by a correlation tree that is representative of the subset.
  • generating the microapp recommendation further comprises displaying, in a user interface, a representation of the subsequent frequent action.
  • each frequent action set is associated with a support parameter that represents a frequency with which the frequent action set is observed.
  • a non-transitory computer readable medium stores processor executable instructions to generate microapp recommendations.
  • the processor executable instructions comprise instructions to receive observational data that characterizes interactions between a plurality of users and a plurality of applications.
  • the processor executable instructions further comprise instructions to define a set of correlation trees based on the received observational data. Each correlation tree in the set represents a sequence of interactions between one of the users and one or more of the applications.
  • the set includes a first quantity of correlation trees.
  • the processor executable instructions further comprise instructions to identify a subset of similar correlation trees, each of which is included in the set.
  • the subset includes a second quantity of correlation trees that is less than the first quantity.
  • the processor executable instructions further comprise instructions to make a determination that the second quantity is greater than a threshold quantity.
  • the processor executable instructions further comprise instructions to, in response to making the determination, generate a microapp recommendation based on the sequence of interactions corresponding to a correlation tree that is representative of the subset.
  • the processor executable instructions further comprise instructions to: identify start and end points of a particular sequence of interactions; and identify a plurality of user actions occurring between the start and end points.
  • the processor executable instructions further comprise instructions to save data representing the set of correlation trees in a tree database.
  • the processor executable instructions further comprise instructions to identify a start point of a particular sequence of interactions; and (b) the start point is selected from a group consisting of a user authentication action and a uniform resource locator submission.
  • the processor executable instructions further comprise instructions to identify an end point of a particular sequence of interactions; and (b) the end point is selected from a group consisting of a user logoff action, a page close action, and a detected activity timeout event.
  • the processor executable instructions further comprise instructions to identify an end point of a first sequence of interactions; identify a start point of a second sequence of interactions; identify a data object that is operated on by both the start and end points; and in response to identifying the data object, designate the end point of the first sequence of interactions as a liaison point between the first and second sequences.
  • Figure 1 is a block diagram schematically illustrating a sequence of workflow operations that are connected by liaison points.
  • Figure 2 is a block diagram schematically illustrating selected components of an example implementation of a microapp recommendation framework that generates microapp functionality recommendations by analyzing user interaction sequences within one or more applications.
  • Figure 3 is a flowchart illustrating an example method for generating microapp functionality recommendations by analyzing user interaction sequences within one or more applications.
  • Figure 4 is a flowchart illustrating an example method for identifying and detecting user interaction sequences within one or more applications.
  • Figure 5 is a flowchart illustrating an example method for building and linking correlation trees that represent user interaction sequences within one or more applications.
  • Figure 6 is a flowchart illustrating an example method for analyzing correlation trees to identify frequently invoked user actions and action sequences within one or more applications.
  • Figure 7 is a single-application correlation tree that represents example user interaction sequences within a Jira application.
  • Figure 8 is a cross-application correlation tree that represents example user interaction sequences within both a Jira application and a Git application.
  • Figure 9 is a block diagram schematically illustrating an example of identifying high frequency user interaction sequences from a plurality of correlation trees.
  • Figure 10 is a block diagram schematically illustrating an example of identifying a critical path that represents a user interaction sequence that can form the basis for recommended microapp functionality.
  • Figure 11 is a block diagram schematically illustrating an example method for generating microapp functionality recommendations by analyzing user interaction sequences within one or more applications.
  • a digital workspace allows users to access functionality provided by multiple applications through a single user interface.
  • Microapps synchronize data from these applications to streamline the user experience within a digital workspace. Microapps therefore allow a user to view information and perform actions without launching the underlying application or toggling to a different interface. From a conceptual standpoint, microapps can thus be understood as unbundling the functionality provided by a user’s applications to provide the user with simplified actions within the digital workspace interface.
  • User actions taken within a microapp serve as the basis for inputs provided to the user’s underlying applications. These user actions are designed to address specific common problems and use cases quickly and easily, thereby increasing user productivity. Examples of such frequently invoked actions include approving expense reports, confirming calendar appointments, submitting helpdesk tickets, and reviewing vacation requests.
  • microapps have not only led to rapid growth in the number of available microapps but has also resulted in the development of tools that make it easy for developers to create custom integrations.
  • development tools streamline the process of extracting frequently invoked actions from a user’s applications to his/her digital workspace.
  • prebuilt microapp action templates can be directly integrated into a user’s digital workspace, while a microapp builder allows administrators to customize and deploy new microapps for legacy, proprietary, or other specialized SaaS applications.
  • Tools such as these allow a list of “available actions” to be curated and presented to a user, thereby allowing the user to interact with an entire suite of diverse applications without ever leaving the digital workspace interface.
  • microapp development tools therefore help administrators to develop and deploy a suite of microapps that is tailored to the needs of a particular workgroup.
  • This development process remains heavily reliant on human knowledge and intuition to identify the workflows that microapps should facilitate.
  • developers should know which applications are frequently used, and more specifically, what application functionality is frequently invoked by specific users. Developers should also know how functionality extends across different enterprise applications, such as occurs when a user makes a travel reservation using a first application and then emails a copy of the reservation confirmation using a second application.
  • microapps In a more general sense, the functionality provided by a microapp and the underlying applications that a microapp leverages are often selected based on the subjective judgment of a developer, administrator, or other software engineer. It is often challenging for software engineers to make judgments with respect to which microapp functionality will most likely yield benefits in terms of improved efficiency and streamlined workflows. More specifically, software engineers charged with developing a digital workspace and the microapp functionality provided therein are often not aware of the application functionality that users in other fields see as most useful. For example, users in the financial services or healthcare industries will likely demand different functionality than software engineers or product managers. In other words, while developers may have great skill in generating and creating microapps, they often lack insight into the particular actions that the microapps should provide. A more analytical approach to evaluating user activity would therefore streamline the microapp development process by making it less reliant on human knowledge and intuition, as well as less reliant on the judgment and/or subjective assumptions of software developers and engineers.
  • a microapp recommendation framework that generates microapp functionality recommendations by analyzing observed user interaction sequences that involve one or more enterprise applications.
  • such a framework provides the ability to analytically identify a frequently invoked sequence of actions actually performed in the course of competing day-to-day tasks in different fields. This identified sequence of actions is sometimes referred to as a “critical path” .
  • the critical path may extend across multiple applications, in which case the microapp recommendation framework identifies one or more “liaison points” that represent actions that link functionality in two different applications. For example, a copy-paste action that is used to move data from one application to another serves as a liaison point between the two applications.
  • the identified sequence of actions can be provided as a recommendation to a microapp developer, or can be provided directly to a microapp builder.
  • liaison points represent actions that can be automated or recommended in a microapp builder.
  • the microapp recommendation framework disclosed herein also optionally enables identification of individual frequently invoked actions, independent of any overarching sequence.
  • the recommended microapp functionality is approved by an administrator or other designated user before being deployed to a user’s digital workspace.
  • Figure 1 is a block diagram schematically illustrating a sequence of workflow step nodes 10 that are connected by liaison points 12.
  • Step nodes 10 represent discrete stages of a workflow from which one or more actions can be taken.
  • Liaison points 12 represent actions that, when invoked, advance the workflow from one step node to the next.
  • the sequence established by liaison points 12 defines a critical path that can form the basis for recommended microapp functionality.
  • additional actions be taken from step nodes 10, including frequently observed actions 14 and infrequently observed actions 16.
  • Frequently observed actions 14 may additionally or alternatively form the basis for other recommended microapp functionality.
  • the workflow illustrated in Figure 1 is presented from a “user-centric” perspective, rather than from the perspective of any one application used in the workflow.
  • a supervisor receives and responds to a vacation request from a subordinate.
  • the actions that the supervisor is observed to take in such a workflow can form the basis for recommended microapp functionality, as derived using the analytical techniques disclosed herein.
  • the supervisor may access a shared calendar, decide to approve or deny the request, and send a decision notification to the requestor.
  • the point at which the supervisor receives the request can be understood as a first step node.
  • the supervisor’s action of accessing the shared calendar can be understood as a first liaison point.
  • this liaison point may represent cross-application functionality, such as when incoming data from a messaging application is provided to a scheduling application.
  • the point at which the supervisor is presented with the shared calendar can be understood as a second step node.
  • the supervisor’s action of sending a notification to the requestor can be understood as a second liaison point, and the point at which the request has been approved or denied can be understood as a third step node.
  • While this example vacation request workflow involves three step nodes linked by two liaison points, additional or fewer step nodes and liaison points may be implicated in other implementations.
  • the analytical techniques disclosed herein can also be used to identify other frequently observed actions that can form the basis for recommended microapp functionality, even when those actions leverage functionality provided by a single application. For example, in some cases it may be observed that the supervisor frequently sends a message to the human resources department after receiving a vacation request. Sending such a message can be understood as a frequently observed action that is taken from any of the step nodes that comprise the vacation request workflow.
  • a wide variety of different types of frequently observed actions can form the basis for making a microapp functionality recommendation, including actions that are automated and actions that require human input.
  • microapp recommendation framework Some implementations of the microapp recommendation framework disclosed herein are able to distinguish between frequently observed actions that should form the basis for recommended microapp functionality and infrequently observed actions that should not form the basis for such recommendation. For example, if the supervisor is observed to have accessed the vacation requestor’s performance reviews on only isolated occasions, the microapp recommendation framework can be configured to disregard such isolated observations when making microapp functionality recommendations.
  • microapp recommendation framework A number of advantages may be derived from the various implementations of the microapp recommendation framework disclosed herein. For example, certain of the techniques disclosed herein rely on collecting and analyzing application use data from a large number of users working in a diverse range of use contexts. Machine learning techniques can be used to analyze this use data and extract patterns that form the basis for identifying frequently invoked actions and action sequences. The resulting microapp functionality recommendations thus rely on identifying and analyzing application usage patterns that could be difficult or even impossible for a human analyst to identify. Certain of the disclosed techniques also enable microapp functionality recommendations to be specifically tailored to a particular role and the application usage patterns associated with that role. Accurately making individually-tailed microapp recommendations may not be feasible for a human analyst, particularly in a large organization. Microapp functionality that is closely tailored to the needs of particular users and particular workgroups ultimately will lead to improved user experience and productivity.
  • microapp refers, in addition to its ordinary meaning, to a lightweight software application configured to provide a user with simplified access to specific functionality and/or data that is provided by one or more underlying applications.
  • microapps allow a user to view information and perform actions without launching or switching context to an underlying application.
  • Microapps can be characterized as being “event driven” or “user initiated” .
  • Event driven microapps are invoked in response to detecting a certain event or condition, and can be configured to generate user notifications when something requires attention.
  • an event driven microapp might display a budget report in response to receiving an expense approval request or display a syllabus in response to the opening of a course registration period.
  • Microapps are invoked in response to a user action, and act as a shortcut to frequently performed actions, such as approving expense reports, confirming calendar appointments, submitting helpdesk tickets, and reviewing vacation requests.
  • Microapps streamline workflows by reducing context switching and eliminating the need to learn how to use complex applications.
  • correlation tree refers, in addition to its ordinary meaning, to data that represents one or more action sequences performed by a software application.
  • a correlation tree represents a set of actions that are performed sequentially, one after another.
  • a correlation tree represents multiple sets of actions, at least one of which is mutually exclusive to another. Such mutual exclusivity may occur where, for example, a user must choose between two mutually exclusive actions (for instance, delete or save a data object) .
  • Mutually exclusive actions can be represented by different branches of a single correlation tree. The actions may be performed by a single application ( “single-application correlation tree” ) or multiple applications ( “cross-application correlation tree” ) .
  • a correlation tree is represented by data that can be stored in any suitable format, including in a machine-readable data structure, or as a human-readable schematic chart where actions are represented by nodes that are linked by edges.
  • Figures 7 and 8 illustrate examples of correlation trees that are represented by human-readable schematic charts.
  • the data used to represent a correlation tree can be saved in, for example, a distributed memory structure, a relational database, or any other suitable data structure.
  • the term “liaison point” refers, in addition to its ordinary meaning, to a user action that forms a link between functionalities provided by one or more underlying applications.
  • the linking functionality can be provided by a microapp.
  • a user may invoke a “copy” command in a notepad application, switch contexts to a web browser, and then invoke a “paste” command in the web browser.
  • the “copy” command can be understood as a liaison point because it is a user action that links functionality provided by the notepad application with functionality provided by the web browser.
  • a microapp can be generated that allows data to be quickly transferred from the notepad application to the web browser.
  • liaison points in a workflow include a logoff action, a page close action, a user input action, a file transfer action, and a hypertext markup language (HTML) action.
  • a liaison point can be understood as linking functionality provided by different applications in a cross-application correlation tree.
  • FIG. 2 is a block diagram schematically illustrating selected components of an example implementation of a microapp recommendation framework 2000 that generates microapp functionality recommendations by analyzing user interaction sequences within one or more applications.
  • Framework 2000 includes a digital workspace server 100 that is capable of analyzing how a user, associated with an endpoint 200, interacts with applications provided by one or more application servers 300.
  • the user’s associated with endpoint 200 may exist by virtue of, for example, the user being logged into or authenticated to the endpoint. While only one endpoint and three example application servers are illustrated in Figure 2 for clarity, it will be appreciated that, in general, framework 2000 is capable of analyzing interactions between an arbitrary number of endpoints and an arbitrary number of application servers.
  • Network 500 may be a public network (such as the Internet) or a private network (such as a corporate intranet or other network with restricted access) .
  • Other embodiments may have fewer or more communication paths, networks, subcomponents, and/or resources depending on the granularity of a particular implementation.
  • at least a portion of the application functionality is provided by one or more applications hosted locally at an endpoint.
  • references to application servers 300 should be understood as encompassing applications that are locally hosted at one or more endpoints. It should therefore be appreciated that the embodiments described and illustrated herein are not intended to be limited to the provision or exclusion of any particular services and/or resources.
  • Digital workspace server 100 is configured to generate microapp functionality recommendations by analyzing interactions between endpoint 200 and application servers 300.
  • Digital workspace server 100 may comprise one or more of a variety of suitable computing devices, such a desktop computer, a laptop computer, a workstation, an enterprise-class server computer, a tablet computer, or any other device capable of supporting the functionalities disclosed herein. A combination of different devices may be used in certain embodiments.
  • digital workspace server 100 includes one or more software modules configured to implement certain of the functionalities disclosed herein as well as hardware capable of enabling such implementation.
  • the implementing hardware may include, but is not limited to, a processor 110, memory 120, and any other suitable components that enable digital workspace server 100 to interact with other components of framework 2000 or human users.
  • suitable components include, but are not limited to, a communication module, a bus and/or interconnect, a display, a textual input device (such as a keyboard) , a pointer-based input device (such as a mouse) , a microphone, and a camera.
  • a communications module can include one or more interfaces to enable digital workspace server 100 to access a computer network such as a local area network, a wide area network, a personal area network, or the Internet through a variety of wired and/or wireless connections, including cellular connections.
  • Processor 110 can be implemented by one or more programmable processors to execute one or more executable instructions, such as a computer program, to perform functions disclosed herein.
  • processor describes circuitry that performs a function, an operation, or a sequence of operations. The function, operation, or sequence of operations can be hard coded into the circuitry or soft coded by way of instructions held in memory 120 and executed by the processor circuitry.
  • Processor 110 can perform the function, operation, or sequence of operations using digital values and/or using analog signals.
  • processor 110 can be embodied in one or more application specific integrated circuits, microprocessors, digital signal processors, graphics processing units, microcontrollers, field programmable gate arrays, programmable logic arrays, multicore processors, or general-purpose computers with associated memory.
  • Processor 110 can be analog, digital, or mixed.
  • Processor 110 can be one or more physical processors, which in some cases may be remotely located from digital workspace server 100.
  • a processor that includes multiple processor cores and/or multiple processors can provide functionality for parallel, simultaneous execution of instructions or for parallel, simultaneous execution of one instruction on more than one piece of data.
  • Memory 120 can be implemented using any suitable type of digital storage, such as one or more of a disk drive, a redundant array of independent disks, a flash memory device, or a random access memory (RAM) device.
  • memory 120 is used to store instructions that, when executed using processor 110, cause operations associated with the various modules described herein to be invoked.
  • Memory 120 may include one or more types of RAM and/or a cache memory that can offer a faster response time than a main memory.
  • the implementing software may include, but is not limited to, a microapp service 140, a microapp analytics service 150, and any other suitable components that enable digital workspace server 100 to perform the functionalities disclosed herein.
  • suitable components include, but are not limited to, a communication module and an operating system.
  • a communication module can include any appropriate network chip or chipset with allows for wired or wireless connection to other components of digital workspace server 100 and/or to network 500.
  • digital workspace server 100 may include any suitable operating system.
  • the techniques provided herein can be implemented without regard to the particular operating system provided in conjunction with digital workspace server 100, and therefore may also be implemented using any suitable existing or subsequently developed platform.
  • microapp service 140 and microapp analytics service 150 are each implemented using a non-transitory computer readable medium (such as memory 120) and one or more processors (such as processor 110) of a computing apparatus.
  • the non-transitory computer readable medium stores program instructions executable by the one or more processors to cause digital workspace server 100 to perform certain aspects of the techniques disclosed herein.
  • Other embodiments may have fewer or more modules depending on the granularity of a particular implementation.
  • microapp service 140 provides the microapps and supporting services that enable a user to access data and functionality provided by one or more application servers 300.
  • this framework allows a user to view information and perform actions without having to launch the underlying application or toggle to a different interface.
  • microapp service 140 includes a plurality of microservices 142 as well as a microapp library 144 that stores the particular microapps.
  • microapp service 140 is a single tenant service that creates, manages, and provides implementing services to support the microapps stored in microapp library 144. This is accomplished through periodic communications with, and data acquisitions from, application servers 300.
  • microapp library 144 is hosted locally at digital workspace server 100, such as in memory 120, although in other implementations microapp library 144 is partially or wholly hosted in a networked storage repository.
  • Microapp service 140 includes one or more microservices 142 that provide implementing functionality to support execution of the microapps stored in microapp library 144.
  • an active data cache microservice is a single tenant service that can store configuration information and microapp data using a per-tenant database encryption key and per-tenant database credentials.
  • a credential wallet microservice can store encrypted service credentials for applications provided by application servers 300, as well as user authentication tokens, such as OAuth2 tokens.
  • a data integration provider microservice can (a) interact with application servers 300 to decrypt user credentials and (b) communicate with application servers 300 under the identity of the user. Such communications use the user’s actual account to ensure that all actions are complaint with applicable data policies.
  • a notification microservice processes notifications created in the course of interacting with application servers 300.
  • Notifications can be stored in a database, served in a notification feed, and/or transmitted as push notifications.
  • a notification microservice optionally includes content controls that are configurable to restrict exposure of sensitive content. It will be appreciated that the microservices described herein represent only a few examples of microservices that support the creation, administration, and execution of the microapps stored in microapp library 144. Additional or alternative microservices may be included in microapp service 140 in other embodiments.
  • microapp analytics service 150 processes observed interactions between endpoint 200 and application servers 300, builds correlation trees based on the observed interactions, and generates microapp functionality recommendations derived from the correlation trees. These recommendations can be provided to an administrator via a user interface, and/or can be used to automatically generate new microapps.
  • microapp analytics service 150 comprises a user activity analyzer 151, a correlation tree builder 152, a correlation tree analyzer 153, and a microapp builder 154. Each of these subcomponents can be implemented using a non-transitory computer readable medium that stores program instructions executable by processor 110 to cause microapp analytics service 150 to perform certain of the functionalities disclosed herein.
  • microapp analytics service 150 also includes storage resources such as an activity database 158 for storing data representing the observed interactions and a tree database 159 for storing data representing the correlation trees.
  • Activity database 158 and tree database 159 can be hosted locally at digital workspace server 100, such as in memory 120, although in other embodiments such databases are partially or wholly hosted in a networked storage repository.
  • user activity analyzer 151 is configured to detect and analyze interactions between a plurality of users (an example one of which is represented by endpoint 200) and a plurality of application servers 300. This can be accomplished, for example, using any suitable existing or subsequently developed software that is capable of monitoring user activity and compiling usage information that reflects the monitored activity.
  • user activity analyzer 151 comprises a browser plugin that is capable of capturing interactions between a user and a web browser.
  • monitored interactions include, but are not limited to, authentication interactions; data entry interactions (including input provided via a pointing device or keyboard) ; data display and/or receipt interactions; application context switching interactions; logoff interactions; browser tab, page, and/or window close interactions; browser tab, page, and/or window open interactions; timeout detection; clipboard interactions (including cut, copy, and paste) ; and hypertext transfer protocol (HTTP) command interactions.
  • data representing the monitored user activity is stored in activity database 158.
  • correlation tree builder 152 is configured to generate, and optionally link, correlation trees based on the observed user activity. This can be accomplished, for example, by recognizing that a given user’s activity corresponds to a sequence of actions that can be represented by a particular branch of a correlation tree. Multiple sequences of actions can be represented by a single correlation tree, for example with mutually exclusive actions being represented by different branches of a single correlation tree.
  • a cross-application correlation tree can be generated by identifying nodes where common data exists in multiple applications, such as where data is copied from a first application and pasted into a second application.
  • data representing one or more correlation trees is saved in tree database 159. The data used to represent a correlation tree can be saved in, for example, a distributed memory structure, a relational database, or any other suitable data structure.
  • correlation tree analyzer 153 is configured to analyze a collection of correlation trees to identify frequently invoked actions and/or action sequences.
  • the identified action sequences may involve a user interacting with one or more applications. Identifying frequently invoked actions can be accomplished, for example, by using association rule learning to extract frequent action sets from tree database 159.
  • a tree similarity process can be used to cluster similar correlation trees and thus identify frequently invoked action sequences.
  • a frequently invoked action sequence provides insight into both the most frequently invoked actions, as well as the critical path that extends across multiple applications when actions in the multiple applications are concatenated.
  • a simple example of such a critical path is a copy action invoked in a first application followed by a corresponding paste action invoked in a second application.
  • the techniques disclosed herein allow such a critical path to be learned from the perspective of the user’s workflow, rather than from the perspective of analyzing the operation of any one application.
  • the identified frequently invoked action sequences can form the basis for recommended microapp functionality. Both the frequently invoked user actions and the frequently invoked action sequences can be passed to microapp builder 154. In certain implementations microapp builder 154 can be configured to provide recommended microapp functionality to an administrator for approval. In other implementations microapp builder 154 can be configured to automatically generate new microapps based on the identified frequently invoked actions or action sequences. Generated microapps are optionally stored in a microapp repository.
  • endpoint 200 is embodied in a computing device that is used by the user.
  • a computing device examples include but are not limited to, a desktop computer, a laptop computer, a tablet computer, and a smartphone.
  • Digital workspace server 100 and its components are configured to interact with a plurality of endpoints.
  • the user interacts with a plurality of workspace applications 212 that are accessible through a digital workspace 210. It is the user’s interactions with workspace applications 212 and/or application servers 300 that are analyzed by user activity analyzer 151 and that ultimately form the basis for recommended microapp functionality.
  • Workspace applications 212 can be provided by application servers 300 and/or can be provided locally at endpoint 200.
  • example workspace applications 212 include a SaaS application 310, a web application 320, and an enterprise application 330, although any other suitable exiting or subsequently developed applications can be used as well, including proprietary applications and desktop applications.
  • Figure 3 is a flowchart illustrating an example method 3000 for generating microapp functionality recommendations by analyzing user interaction sequences within one or more applications.
  • Method 3000 starts with user activity analyzer 151 detecting and analyzing interactions between a plurality of users (for example as represented by endpoint 200) and a plurality of application servers 300. See reference numeral 4000 in Figure 3. Additional details regarding the functionality provided by user activity analyzer 151 are provided in Figure 4.
  • Method 3000 further includes correlation tree builder 152 generating correlation trees based on the observed user interactions. See reference numeral 5000 in Figure 3. Additional details regarding the functionality provided by correlation tree builder 152 are provided in Figure 5.
  • Method 3000 further includes correlation tree analyzer 153 mining patterns from a collection of correlation trees to identify frequently invoked actions and/or action sequences.
  • Method 3000 further includes microapp builder 154 building microapps and/or recommending microapp functionality based on the frequently invoked actions and/or action sequences. See reference numeral 7000 in Figure 3. For example, a sequence of actions that one or more users are observed to have invoked frequently defines a critical path that can form the basis for recommended microapp functionality.
  • FIG 11 is a block diagram schematically illustrating an overview of example method 3000 for generating microapp functionality recommendations.
  • user activity analyzer 151 detects user activity based on an identified action sequence start point 60, action sequence end point 64, and intervening productivity period 62. The detected user activity is stored in activity database 158.
  • activity database 158 At the conclusion of a given action sequence, a determination is made with respect to whether a user switches or liaisons to a second application, as indicated by reference numeral 66. If no such switching occurs, the observed workflow can be understood to have come to a conclusion. If the user does begin using a second application, additional action sequences can be observed and recorded in activity database 158.
  • Correlation tree builder 152 uses the data stored in activity database 158 to build correlation trees that represent the observed action sequences.
  • the generated correlation trees are stored in tree database 159.
  • Correlation tree analyzer 153 analyzes the correlation trees to generate user activity patterns 68 that represent frequently invoked action sequences. These frequently invoked action sequences serve as the basis for generating microapp functionality recommendations. Additional details with respect to the operation of user activity analyzer 151, correlation tree builder 152, and correlation tree analyzer will be provided in turn.
  • Figure 4 is a flowchart illustrating an example user activity analysis operation 4000 that identifies and detects user interaction sequences within one or more applications. Operation 4000 can be implemented, for example, using the system architecture illustrated in Figure 2 and described herein, and in particular, using user activity analyzer 151. However other system architectures can be used in other implementations. To this end, the correlation of the various functionalities shown in Figure 4 to user activity analyzer 151 is not intended to imply any structural or use limitations. Rather, other implementations may include, for example, varying degrees of integration wherein certain functionalities are effectively performed by different systems or modules. For example, in an alternative implementation separate software modules are used to detect user activity and store the detected activity in activity database 158.
  • operation 4000 includes a number of phases and sub-processes, the sequence of which may vary from one implementation to another. However, when considered in the aggregate, these phases and sub-processes are capable of detecting and analyzing interactions between a plurality of users and a plurality of application servers 300.
  • user activity analysis operation 4000 functions as a background process that monitors interactions between users and their applications on an ongoing basis.
  • the monitored interactions can be understood as comprising a plurality of discrete action sequences, each of which begins with a “start point” that is represented by a particular user interacting with a particular application.
  • Each action sequence ends at an “end point” or “liaison point” .
  • An end point refers to a final interaction between the particular user and the particular application, while a liaison point refers to an end point that forms a link to functionality provided by a second application.
  • user activity analyzer 151 can be said to monitor interactions between a plurality of users and a plurality of applications in a general sense, at a finer level analyzer 151 can be understood as detecting and recording discrete action sequences between a particular user and a particular application.
  • a start point can be understood as the point at which a particular user begins a sequence of interactions with a particular application.
  • user activity analyzer 151 detects a start point in response to observing a login interaction, such as a user authentication interaction using password authentication, biologic authentication, and/or peer authentication.
  • the login interaction may use proprietary and/or open standard techniques for exchanging authentication data, one example of which is the Security Assertion Markup Language open standard.
  • Analyzer 151 may detect a start point in response to observing a single sign-on (SSO) interaction.
  • SSO single sign-on
  • the observed SSO interaction may be managed by an identity management provider such as Okta, Inc. (San Francisco, CA) .
  • User activity analyzer 151 can be configured to detect other types of login interactions in other embodiments.
  • a user’s browser activity may additionally or alternatively form the basis for detecting a start point. For instance, in one implementation a user’s action in inputting a target uniform resource locator (URL) is detected as a start point.
  • a URL can be input manually, via a saved bookmark, via redirection from another URL, or via a SaaS application launched from a digital workspace.
  • a discrete action sequence can be understood as beginning with a start point and ending at an end point or liaison point.
  • user activity analyzer 151 detects an end point or liaison point. See reference numeral 4120 in Figure 4.
  • the end point or liaison point can be detected using techniques that are similar to those used to detect the start point.
  • An end point can be detected as having occurred when a user completes a sequence of actions without switching context from a first application.
  • a liaison point can be detected as having occurred when a user completes a sequence of actions using a first application, obtains results or other data from that first application, and then switches context to a second application. After switching context, the user may initiate a second discrete action sequence in the second application using the results or other data obtained from the first application.
  • user activity analyzer 151 detects an end point or liaison point in response to observing a logoff action, browser page close action, submission complete action, or other substantially similar user action.
  • the end point or liaison point can be detected in response to an application page, browser tab, or other focused user interface detecting a “timeout” or other designated period of inactivity.
  • analyzer 151 detects an end point or liaison point in response to observing certain actions associated with a clipboard, such as a string copy command (for example, when a user copies a purchase order identifier or when a user copies a service ticket) , a file copy command (for example, when a user downloads a file or when a user saves a file to a local or cloud-based storage resource) , or a URL copy command.
  • a string copy command for example, when a user copies a purchase order identifier or when a user copies a service ticket
  • a file copy command for example, when a user downloads a file or when a user saves a file to a local or cloud-based storage resource
  • URL copy command for example, when a URL copy command.
  • Analyzer 151 optionally includes a sub-module capable of parsing HTTP grammar and commands as a way to detect an end point or liaison point. For example, an end point or liaison point can be detected in response to observing an HTTP command that returns code, posts data, gets data, or returns a content type identifier.
  • a sub-module is optionally capable of parsing the body of HTTP commands to identify particular strings which are indicative of an end point or liaison point, such as “goodbye” or “task completed” .
  • a browser plugin is additionally or alternatively used to detect user interactions with a web browser.
  • User activity analyzer 151 can be understood as detecting and recording a discrete action sequence that begins with the detected start point and ends with the detected end point or liaison point. Between the start and end of the action sequence is a “productivity period” . User activity analysis operation 4000 further includes identifying user actions during this productivity period. See reference numeral 4140 in Figure 4. Analyzer 151 can be configured to detect and identify any relevant user actions occurring during the productivity period.
  • Examples of such actions include, but are not limited to, page open operations; browser tab open operations; window open operations; user input operations (including, for example, motion input provided via a pointing device and textual input provided via a keyboard) ; refocusing actions that cause a particular window or interface to become active (also referred to as context-switching actions) ; and clipboard actions, such as a paste command associated with a source of the pasted content.
  • page open operations including, for example, motion input provided via a pointing device and textual input provided via a keyboard
  • clipboard actions such as a paste command associated with a source of the pasted content.
  • Figure 4 illustrates a sequence of operations where a start point and end point (or liaison point) are detected before user actions in the productivity period are identified. This can be accomplished by analyzing a recoded log of user activity, where the start point and end point (or liaison point) are identified in an initial operation, and then intervening actions in the productivity period are identified in a subsequent operation.
  • these operations can be invoked in a different sequence in other implementations. For example, in an alternative implementation a start point is identified first, actions in the productivity period are identified, and then an end point (or liaison point) is detected.
  • Figure 4 illustrates a sequence of operations where a start point and end point (or liaison point) are detected before user actions in the productivity period are identified.
  • a wide range of existing instrumentation, telemetry, and business insight generation platforms are capable of capturing most or all browser activities.
  • One example of such a platform is Citrix Insight Services provided by Citrix Systems, Inc. (Ft. Lauderdale, FL) .
  • a wide range of browser plugins are also capable of detecting a user’s browser activity.
  • a sub-module capable of parsing HTTP grammar and commands can be used to detect a start point, an end point (or a liaison point) , and/or other intervening user activity. Any suitable existing or subsequently developed tools such as these can be used to detect a start point, an end point or liaison point, and user actions in an intervening productivity period.
  • a recorded log of user activity may additionally or alternatively be used to detect and identify relevant user actions.
  • a user activity log may be configured to record any of the various actions disclosed herein, as well as other relevant actions, including user shortcut actions.
  • user actions may be derived or abstracted from established business workflows.
  • data that characterizes a detected start point, a detected end point or liaison point, and relevant intervening user actions can be stored in activity database 158. See reference numeral 4150 in Figure 4.
  • This storage operation optionally occurs any time after the relevant data is acquired.
  • data characterizing a start point is stored in activity database 158 immediately after the start point is detected.
  • user activity analysis operation 4000 can be understood as a continuously executing background process that monitors interactions between users and their applications. Thus, after the relevant data is stored, a determination can be made with respect to whether the observed user liaisons to a second application. See reference numeral 4160 in Figure 4.
  • operation 4000 can be understood as ending, at least with respect to one discrete action sequence. In a broader sense, operation 4000 can be understood as terminating with respect to one discrete action sequence, while continuing to monitor and analyze other interactions between a user and an application.
  • Figure 5 is a flowchart illustrating an example correlation tree generation operation 5000 that builds and links correlation trees that represent observed user interaction sequences within one or more applications.
  • Operation 5000 can be implemented, for example, using the system architecture illustrated in Figure 2 and described herein, and in particular, using correlation tree builder 152.
  • correlation tree builder 152 can be used in other implementations.
  • the correlation of the various functionalities shown in Figure 5 to correlation tree builder 152 is not intended to imply any structural or use limitations. Rather, other implementations may include, for example, varying degrees of integration wherein certain functionalities are effectively performed by different systems or modules. For example, in an alternative implementation separate software modules are used to define a correlation tree and identify liaison operations that can link correlation trees.
  • operation 5000 includes a number of phases and sub-processes, the sequence of which may vary from one implementation to another. However, when considered in the aggregate, these phases and sub-processes are capable of detecting and analyzing interactions between a plurality of users and a plurality of application servers 300.
  • correlation tree generation operation 5000 functions as a background process that monitors recorded user activity, such as user activity recorded in activity database 158. In some cases operation 5000 is invoked when new data is recorded in activity database 158, although other triggers may be used in other embodiments. For example, in an alternative implementation operation 5000 is invoked on a periodic basis or is invoked in response to a user command, such as a command invoked by an administrator of digital workspace server 200. Regardless of the triggering event or condition, correlation tree generation operation 5000 begins when related user action sets are identified in activity database 158. See reference numeral 5110 in Figure 5. A set of actions may be related by the fact that, collectively, the actions represent one or more action sequences taken by a particular user interacting with a particular application.
  • a set of related actions is thus understood as being correlated with a particular application.
  • the actions may be related by virtue of at least one action that links multiple action sequences, such as a common starting point (for example, an initial user authentication operation) .
  • the related actions may therefore include multiple sequences of actions, at least some of which are mutually exclusive. Such mutual exclusivity may occur where, for example, a user must choose between two mutually exclusive actions (for instance, delete or save a data object) .
  • a first correlation tree can then be defined based on a set of related actions performed in a first application. See reference numeral 5120 in Figure 5.
  • a second correlation tree can be defined based on a set of related actions performed in a second application. See reference numeral 5140 in Figure 5.
  • a correlation tree can be built by defining a node for each user action in the set of related actions, wherein sequential actions (that is, nodes) are linked by an edge. Examples of actions that can be represented by a node include a mouse click action, a URL selection action, a button selection action, a data entry action, and a data generation action.
  • the observed user actions, as recorded in activity database 158 can be correlated into discrete action sequences.
  • correlation trees can be embodied in a data structure stored in a computer readable medium.
  • a correlation tree need not be, and indeed in many implementations will not be, rendered or displayed in a human-readable format.
  • Figure 7 illustrates a single-application correlation tree that represents example user interaction sequences within a Jira application 20.
  • Jira is a proprietary issue tracking software product developed by Atlassian (Sydney, Australia) .
  • the correlation tree illustrated in Figure 7 includes a plurality of nodes, each of which corresponds to an observed user interaction (that is, action) with Jia application 20.
  • Example actions include “create epic” (represented by node 21) , “change assignees of linking stories” (represented by node 22) , “search stories” (represented by node 23) , “link story to epic” (represented by node 24) , “change story assignee” (represented by node 25) , “send email notification” (represented by node 26) , and “copy epic URL to clipboard” (represented by node 27) .
  • the example correlation tree illustrated in Figure 7 can be generated based on observed interactions between one or more users with Jira application 20, as identified and detected using the user activity analysis techniques disclosed herein. However, it will be appreciated that correlation trees can also be generated from data collected using other data collection and monitoring techniques.
  • the nodes are connected by directional edges, wherein a sequence of connected nodes represents a sequence of actions performed by a user interacting with Jira application 20.
  • action sequences are possible, such as when a user changes the assignee for a story after performing a search (as represented by node 25) or when a user changes the assignee of a linking story after creating the new epic (as represented by node 22) .
  • Yet another possible action sequence occurs when a user inputs description applicable to all linked stories after creating the new epic.
  • the first action in the sequence can be understood as a start point.
  • the last action in each sequence can be understood as an end point or a liaison point.
  • An end point specifically refers to the last action in a workflow that is limited to a single application.
  • “send email notification” can be understood as being an end point that is reached after a new epic is created.
  • one node “copy epic URL to clipboard” ) is identified as a liaison point that serves as a link to functionality provided by a second application, as will be discussed in turn.
  • the correlation tree can be generated by correlating the observed user activities based on the various sequences in which the activities were observed as having occurred.
  • Correlation tree generation operation 5000 continues with identifying liaison points that link the first and second correlation trees. See reference numeral 5150 in Figure 5.
  • a liaison point can be understood as linking functionality provided by a first application (as represented by the first correlation tree) and functionality provided by a second application (as represented by the second correlation tree) .
  • Figure 8 illustrates a cross-application correlation tree that represents example user interaction sequences within both Jira application 20 and a Git application 30.
  • the cross-application correlation tree further includes nodes representing the actions “create Git branch by pasting epic URL” (represented by node 31) , “switch local repository to new branch” (represented by node 32) , and “update readme” (represented by node 33) .
  • Jira application 20 Upon creating the new epic, the user is able to copy a URL and/or ticket identifier for the new epic. The user then opens Git application 30, creates a new branch, and pastes the copied epic URL and/or ticket identifier into the newly created branch. This action in the Git application is represented by node 31 in Figure 8.
  • Jira application 20 provides functionality to copy an epic URL and/or ticket identifier to a clipboard
  • Git application 30 provides functionality to create a Git branch using the epic URL as pasted from the clipboard. This establishes a correlation between user activities in Jira application 20 and Git application 30.
  • these applications are correlated as a result of observing that the user has copied content from Jira application 20 and pasted that content in Git application 30.
  • the copy-paste operation and associated copied content provide the link that establishes the correlation between the two applications and additionally, that establishes node 27 as a liaison point for creating a cross-application correlation tree.
  • Figure 8 illustrates an example cross-application correlation tree based on a user copying an epic URL and/or ticket identifier into a new Git branch
  • this functionality is disclosed as only one example of an essentially unlimited range of functionalities that can link two or more applications.
  • a user accesses a travel reservation using an email application, copies a confirmation number, and pastes the confirmation number into a financial manager to effect payment for the travel reservation.
  • a cross-application correlation tree can be used to represent the functionality provided by such workflow.
  • actions that can serve as liaison points between two applications include, but are not limited to, application input and output (such as a Jira-generated URL for a new epic) , application content (such as a Jira ticket identifier) , and tightly-coupled user actions (such as copy-paste actions and file transfer applications) .
  • node 27 is provided as a liaison point in the example correlation trees illustrated in Figures 7 and 8, in alternative implementations node 27 may not be a liaison point, such as in a workflow where the copied URL is pasted within the same Jira application 20, for example within a subpage within Jira application 20. Thus whether a given action is identified as a liaison point may depend on whether subsequently observed actions are performed within a same or different application.
  • Identifying liaison points serves as the basis for linking functionality between different applications, and thus for generating cross-application correlation trees.
  • this can be understood as resulting in output data, such as file data copied into a clipboard or other data structure.
  • the user then moves to a second application and performs additional actions using the data generated by the first application.
  • An example of this is represented by the copy-paste operations that link Jira application 20 and Git application 30 illustrated in Figure 8.
  • User activity can be correlated across multiple applications when the same data exists in the multiple applications.
  • the resulting cross-application correlation tree can be understood as existing in a workspace that is independent of any one application.
  • Figure 8 illustrates an example cross-application correlation tree linking functionality provided by Jira application 20 and Git application 30, in general any suitable number of applications may be linked in a cross-application correlation tree.
  • no liaison points may be identified, such as where a sequence of actions forms an independent workflow that exists within a single application, and which does not link to functionality provided by other applications. Thus, a determination is made with respect to whether any liaison are identified. See reference numeral 5160 in Figure 5. If a liaison point is identified, the first and second correlation trees can be linked to define a cross-application correlation tree. See reference numeral 5170 in Figure 5. As noted above, Figure 8 illustrates an example of a cross-application correlation tree. It is not necessary to actually render the cross-application correlation tree in a human-readable format. Data representing the cross-application correlation tree can then be saved in tree database 159. See reference numeral 5180 in Figure 5.
  • data representing the first and second correlation trees can be saved in tree database 159. See reference numeral 5190 in Figure 5. In some cases data representing the first and second correlation trees as distinct elements is saved in tree database 159 even in cases were a liaison point is identified, although this is not required.
  • the data used to represent a correlation tree can be saved in, for example, a distributed memory structure, a relational database, or any other suitable data structure.
  • correlation tree generation operation 5000 is modified to define and save a single correlation tree.
  • individual correlation trees can be defined and saved in an initial operational phase, and liaison points linking the defined correlation trees can be identified in a subsequent operational phase. It should therefore be appreciated that the sequence of operations illustrated in Figure 5 can be modified in other implementations.
  • Figure 6 is a flowchart illustrating an example correlation tree analysis operation 6000 that analyzes a collection of correlation trees to identify frequently invoked user actions and action sequences within one or more applications.
  • Operation 6000 can be implemented, for example, using the system architecture illustrated in Figure 2 and described herein, and in particular, using correlation tree analyzer 153.
  • correlation tree analyzer 153 can be used in other implementations.
  • the correlation of the various functionalities shown in Figure 6 to correlation tree analyzer 153 is not intended to imply any structural or use limitations. Rather, other implementations may include, for example, varying degrees of integration wherein certain functionalities are effectively performed by different systems or modules. For example, in an alternative implementation separate software modules are used to extract frequent action sets from tree database 159 and to cluster similar correlation trees.
  • operation 6000 includes a number of phases and sub-processes, the sequence of which may vary from one implementation to another. However, when considered in the aggregate, these phases and subprocess are capable of detecting and analyzing interactions between a plurality of users and a plurality of application servers 300.
  • correlation tree analysis operation 6000 functions as a background process that monitors a data structure having data representing a plurality of correlation trees, such as tree database 159.
  • operation 6000 is invoked when new data is recorded in tree database 159, although other triggers may be used in other implementations.
  • operation 6000 is invoked on a periodic basis or is invoked in response to a user command, such as a command invoked by an administrator of digital workspace server 200.
  • correlation tree analysis operation 6000 begins when frequent action sets are identified and extracted from tree database 159 using association rule learning. See reference numeral 6110 in Figure 6.
  • Frequent action sets 54 may form the basis for recommended microapp functionality, and in particular, may form part of a critical path that extends across multiple applications connected by one or more liaison points.
  • association rule learning refers to a class of machine learning techniques that are capable of discovering relationships between variables in a large dataset, and particularly relevant to this disclosure, for finding the most frequent and/or relevant patterns in such a dataset.
  • association rule learning can be used to infer a causal relationship between individually observed user actions. For example, association rule learning can be used to infer that when a user is observed to have invoked the sequence activity-1 ⁇ activity-2 ⁇ activity-3, then it is likely that the user will next invoke activity-4.
  • association rule learning can be used to infer that when a user is observed to have invoked the sequence activity-1 ⁇ activity-2 ⁇ activity-3, then it is likely that the user will next invoke activity-4.
  • Many different algorithms have been developed for generating association rules, including the frequent pattern growth ( “FP-growth” ) algorithm.
  • the identified frequent action sets form the basis for recommending particular microapp functionality and for enabling microapp builder 154 to implement the recommended functionality.
  • association rule learning can be used not only to generate frequent action sets 54, but also corresponding support values for the same.
  • Support values represent the frequency at which a particular action set is observed to occur, where a high degree of support represents a frequently observed action set.
  • the predicted activity activity-4 in this example
  • the causal relationship has a sufficiently high degree of support, for example that exceeds an established threshold, the predicted activity can be identified as a frequently observed action. See reference numeral 6120 in Figure 6.
  • the identified frequently observed action can be represented as corresponding to frequently observed actions 14 illustrated in Figure 1.
  • the FP-growth algorithm is used to identify frequent action sets 54 and their corresponding support values.
  • the frequently observed actions can be used to generate recommended microapp functionality that is ultimately provided to microapp builder 154. See reference numeral 6170 in Figure 6.
  • Association rule learning including frequent pattern discovery techniques such as the aforementioned FP-growth algorithm, can also be used that derive patterns from frequent action sets 54, as represented by pattern generation 56 illustrated in Figure 9. These patterns represent a critical path that extends across multiple applications when actions in the multiple applications are concatenated. Each identified pattern is optionally associated with the corresponding confidence value.
  • operation 6000 begins when a tree similarity algorithm is used to cluster similar correlation trees. See reference numeral 6140 in Figure 6. This is illustrated schematically in Figure 10, where user activities 50, represented by a plurality of correlation trees 50a stored in tree database 159, are processed using a tree similarity algorithm to generate a plurality of correlation tree groups 58a. Correlation tree groups 58a can be collectively referred to as clustered correlation trees 58.
  • Trees A and B are similar to each other and thus should be clustered together, and (b) Trees C and D are similar to each other and thus should be clustered together.
  • Microapp builder 154 is configured to build microapps and/or recommend microapp functionality based on the frequently invoked actions and/or action sequences. Microapps can be generated automatically and/or recommendations can be made to an administrator who makes a final decision with respect to what microapp functionality will ultimately be deployed, for example via a digital workspace. This allows microapp functionality to be developed from a large number of users working in a diverse range of use contexts, thus allowing application usage patterns to be identified in a way that could be difficult or even impossible for a human analyst. This also allows microapp functionality recommendations to be specifically tailored to a specific role and the application usage patterns associated with that role. Accurately making individually-tailed microapp recommendations may not be feasible for a human analyst, particularly in a large organization. Microapp functionality that is closely tailored to the needs of particular users and particular workgroups ultimately will lead to improved user experience and productivity.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Strategic Management (AREA)
  • Economics (AREA)
  • Finance (AREA)
  • Accounting & Taxation (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Human Resources & Organizations (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Databases & Information Systems (AREA)
  • Development Economics (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Tourism & Hospitality (AREA)
  • Operations Research (AREA)
  • Educational Administration (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Game Theory and Decision Science (AREA)
  • Stored Programmes (AREA)
  • Information Transfer Between Computers (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/CN2020/081406 2020-03-26 2020-03-26 Microapp functionality recommendations with cross-application activity correlation WO2021189356A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
BR112021014123-5A BR112021014123B1 (pt) 2020-03-26 2020-03-26 Método para gerar recomendações de microaplicativo, sistema e mídia legível por computador não transitória
AU2020403711A AU2020403711A1 (en) 2020-03-26 2020-03-26 Microapp functionality recommendations with cross-application activity correlation
CN202080009580.4A CN113811854B (zh) 2020-03-26 2020-03-26 利用跨应用的活动相关性的微应用功能建议
PCT/CN2020/081406 WO2021189356A1 (en) 2020-03-26 2020-03-26 Microapp functionality recommendations with cross-application activity correlation
CA3123916A CA3123916C (en) 2020-03-26 2020-03-26 Microapp functionality recommendations with cross-application activity correlation
EP20913090.5A EP3908925A4 (en) 2020-03-26 2020-03-26 MICROAPP FUNCTIONALITY RECOMMENDATIONS WITH CROSS-APPLICATION ACTIVITY CORRELACTIONS
US16/862,781 US11132179B1 (en) 2020-03-26 2020-04-30 Microapp functionality recommendations with cross-application activity correlation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/081406 WO2021189356A1 (en) 2020-03-26 2020-03-26 Microapp functionality recommendations with cross-application activity correlation

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/862,781 Continuation US11132179B1 (en) 2020-03-26 2020-04-30 Microapp functionality recommendations with cross-application activity correlation

Publications (1)

Publication Number Publication Date
WO2021189356A1 true WO2021189356A1 (en) 2021-09-30

Family

ID=77745900

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/081406 WO2021189356A1 (en) 2020-03-26 2020-03-26 Microapp functionality recommendations with cross-application activity correlation

Country Status (7)

Country Link
US (1) US11132179B1 (US06317118-20011113-M00009.png)
EP (1) EP3908925A4 (US06317118-20011113-M00009.png)
CN (1) CN113811854B (US06317118-20011113-M00009.png)
AU (1) AU2020403711A1 (US06317118-20011113-M00009.png)
BR (1) BR112021014123B1 (US06317118-20011113-M00009.png)
CA (1) CA3123916C (US06317118-20011113-M00009.png)
WO (1) WO2021189356A1 (US06317118-20011113-M00009.png)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11593130B2 (en) * 2021-03-23 2023-02-28 Acronis International Gmbh Systems and methods for customizing a user workspace environment using action sequence analysis
US20220413689A1 (en) * 2021-06-28 2022-12-29 Citrix Systems, Inc. Context-based presentation of available microapp actions
US11797623B2 (en) 2021-12-09 2023-10-24 Citrix Systems, Inc. Microapp recommendations for networked application functionality
US20240112289A1 (en) * 2022-05-23 2024-04-04 The Government of the United States of America, as represented by the Secretary of Homeland Security Augmented reality security screening and dynamic step-by-step guidance and communication
US20240045782A1 (en) * 2022-08-08 2024-02-08 Qualcomm Incorporated Suggesting a New and Easier System Function by Detecting User's Action Sequences
CN115373643A (zh) * 2022-09-15 2022-11-22 贵州电网有限责任公司 基于模块化的云计算系统及方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102054004A (zh) * 2009-11-04 2011-05-11 清华大学 一种网页推荐方法和装置
US9405665B1 (en) * 2015-05-22 2016-08-02 Amazon Technologies, Inc. Application testing based on user input captured during a trial period and priority scheme analysis
CN106201624A (zh) * 2016-07-18 2016-12-07 深圳市金立通信设备有限公司 一种应用程序的推荐方法及终端
CN110069463A (zh) * 2019-03-12 2019-07-30 北京奇艺世纪科技有限公司 用户行为处理方法、装置电子设备及存储介质

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060117059A1 (en) * 2004-11-30 2006-06-01 Tidal Software, Inc. System and method for monitoring and managing performance and availability data from multiple data providers using a plurality of executable decision trees to consolidate, correlate, and diagnose said data
US20140020068A1 (en) 2005-10-06 2014-01-16 C-Sam, Inc. Limiting widget access of wallet, device, client applications, and network resources while providing access to issuer-specific and/or widget-specific issuer security domains in a multi-domain ecosystem for secure personalized transactions
US9110685B2 (en) 2008-03-25 2015-08-18 Qualcomm, Incorporated Apparatus and methods for managing widgets in a wireless communication environment
US8312450B2 (en) 2008-12-18 2012-11-13 Sap Ag Widgetizing a web-based application
FR2964484B1 (fr) 2010-09-02 2015-09-18 Banque Accord Procede de recueil de donnees a caracteres evenementiel de formulaires electroniques
US20120278736A1 (en) * 2011-04-30 2012-11-01 Samsung Electronics Co., Ltd. Collaborative decision-making for deriving micro-recommendations for offsite users
US9008288B2 (en) * 2012-03-26 2015-04-14 Jacada Inc. System and method for supporting self service and associated agent-assisted service call routing
US20130326499A1 (en) 2012-05-31 2013-12-05 Microsoft Corporation Automatically installing and removing recommended applications
US9280252B1 (en) 2013-03-08 2016-03-08 Allstate Insurance Company Configuring an application task list of an application based on previous selections of application tasks
US20140351052A1 (en) 2013-05-24 2014-11-27 Harbhajan S. Khalsa Contextual Product Recommendation Engine
US9405531B2 (en) 2013-07-16 2016-08-02 Software Ag Methods for building application intelligence into event driven applications through usage learning, and systems supporting such applications
US9471624B1 (en) 2013-12-26 2016-10-18 Quixey, Inc. Method for recommending applications for deletion
US20150356495A1 (en) 2014-06-05 2015-12-10 Accenture Global Services Limited Digital workspace
US10028116B2 (en) * 2015-02-10 2018-07-17 Microsoft Technology Licensing, Llc De-siloing applications for personalization and task completion services
US20160321064A1 (en) * 2015-05-01 2016-11-03 Quixey, Inc. Developer Exchange System
US20170212650A1 (en) 2016-01-22 2017-07-27 Microsoft Technology Licensing, Llc Dynamically optimizing user engagement
US10747554B2 (en) 2016-03-24 2020-08-18 Google Llc Contextual task shortcuts
CN106101250A (zh) 2016-06-30 2016-11-09 乐视控股(北京)有限公司 应用功能的定制方法及装置
US9947037B2 (en) * 2016-09-14 2018-04-17 International Business Machines Corporation Software recommendation services for targeted user groups
US10452717B2 (en) * 2016-09-22 2019-10-22 Intel Corporation Technologies for node-degree based clustering of data sets
US10621062B2 (en) 2017-02-21 2020-04-14 International Business Machines Corporation Widget provisioning of user experience analytics and user interface / application management
US10635433B2 (en) 2017-08-24 2020-04-28 General Electric Company Cross application behavior customization
CN108268260A (zh) * 2017-12-21 2018-07-10 博康智能信息技术有限公司 一种基于一体化支撑技术的快速微应用组装方法
CN110007986B (zh) 2018-01-04 2022-11-01 阿里巴巴集团控股有限公司 功能实现方法及装置
US10909024B2 (en) 2018-04-19 2021-02-02 Think Research Corporation System and method for testing electronic visual user interface outputs
CN109117164B (zh) 2018-06-22 2020-08-25 北京大学 基于关键元素差异性分析的微服务更新方法及系统
US20200026502A1 (en) 2018-07-19 2020-01-23 Michael Moore Method and system for determining inefficiencies in a user interface
US10817270B2 (en) 2018-08-02 2020-10-27 Oracle International Corporation AI-generated instant micro apps
US10848500B2 (en) 2018-10-24 2020-11-24 Jamf Software, Llc Systems and methods for group-based mobile device management
CN110806975A (zh) 2019-10-22 2020-02-18 湖南物会网络信息技术有限公司 一种小程序应用管理系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102054004A (zh) * 2009-11-04 2011-05-11 清华大学 一种网页推荐方法和装置
US9405665B1 (en) * 2015-05-22 2016-08-02 Amazon Technologies, Inc. Application testing based on user input captured during a trial period and priority scheme analysis
CN106201624A (zh) * 2016-07-18 2016-12-07 深圳市金立通信设备有限公司 一种应用程序的推荐方法及终端
CN110069463A (zh) * 2019-03-12 2019-07-30 北京奇艺世纪科技有限公司 用户行为处理方法、装置电子设备及存储介质

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
HAN ZHU; XIANG LI; PENGYE ZHANG; GUOZHENG LI; JIE HE; HAN LI; KUN GAI: "Learning Tree-based Deep Model for Recommender Systems", ARXIV.ORG, CORNELL UNIVERSITY LIBRARY, 201 OLIN LIBRARY CORNELL UNIVERSITY ITHACA, NY 14853, 8 January 2018 (2018-01-08), 201 Olin Library Cornell University Ithaca, NY 14853, XP081424352, DOI: 10.1145/3219819.3219826 *
See also references of EP3908925A4
XU: "thesis", 13 August 2015, MASTER OF SCIENCE IN THE DEPARTMENT OF COMPUTER SCIENCE IN THE GRADUATE SCHOOL OF DUKE UNIVERSITY, article "An Algorithm for Comparing Similarity Between Two Trees"

Also Published As

Publication number Publication date
CA3123916C (en) 2023-03-14
AU2020403711A1 (en) 2021-10-14
EP3908925A4 (en) 2022-02-23
CA3123916A1 (en) 2021-09-15
BR112021014123A2 (US06317118-20011113-M00009.png) 2021-12-07
CN113811854B (zh) 2022-06-28
BR112021014123B1 (pt) 2022-10-11
EP3908925A1 (en) 2021-11-17
US11132179B1 (en) 2021-09-28
US20210303269A1 (en) 2021-09-30
CN113811854A (zh) 2021-12-17

Similar Documents

Publication Publication Date Title
US11132179B1 (en) Microapp functionality recommendations with cross-application activity correlation
US10394890B2 (en) Generation of job flow objects in federated areas from data structure
US10331495B2 (en) Generation of directed acyclic graphs from task routines
US10025659B2 (en) System and method for batch monitoring of performance data
US11533330B2 (en) Determining risk metrics for access requests in network environments using multivariate modeling
US20210234930A1 (en) Microservice management system for recommending modifications to optimize operation of microservice-based systems
US10678682B2 (en) Intelligent batch job testing
US11609905B2 (en) Persona based analytics across DevOps
JP2019536185A (ja) コンピュータおよびネットワーク活動を監視および分析するためのシステムおよび方法
US20220291966A1 (en) Systems and methods for process mining using unsupervised learning and for automating orchestration of workflows
Lenka et al. Performance analysis of automated testing tools: JMeter and TestComplete
WO2021024145A1 (en) Systems and methods for process mining using unsupervised learning and for automating orchestration of workflows
WO2021203403A1 (en) Microapp subscription recommendations
US11775473B2 (en) Seamless data movement and metadata management in a hybrid cloud setting using a configurable micro services based architecture
US20230145461A1 (en) Receiving and integrating external data into a graphical user interface of an issue tracking system
CN114846491A (zh) 使用结构化日志事件的辅助和自动工作流
Wu et al. Understanding and Predicting Docker Build Duration: An Empirical Study of Containerized Workflow of OSS Projects
Musabimana et al. Integrating AIaaS into Existing Systems: The Gokind Experience
US11797623B2 (en) Microapp recommendations for networked application functionality
US20230419218A1 (en) Apparatuses, methods, and computer program products for triggering application component workflows based on a distributed ledger
Moreno Advanced Design Frameworks for Modern, Scalable Applications: Strategic Approaches to Building High-Performance, Resilient, and Modular Architectures in Distributed Systems
Ashbourn et al. Biometric Application Design

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2020913090

Country of ref document: EP

Effective date: 20210728

ENP Entry into the national phase

Ref document number: 2020403711

Country of ref document: AU

Date of ref document: 20200326

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112021014123

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112021014123

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20210719

NENP Non-entry into the national phase

Ref country code: DE