US20230254210A1 - Application architecture drift detection system - Google Patents
Application architecture drift detection system Download PDFInfo
- Publication number
- US20230254210A1 US20230254210A1 US17/666,267 US202217666267A US2023254210A1 US 20230254210 A1 US20230254210 A1 US 20230254210A1 US 202217666267 A US202217666267 A US 202217666267A US 2023254210 A1 US2023254210 A1 US 2023254210A1
- Authority
- US
- United States
- Prior art keywords
- application
- instance
- computing system
- data metrics
- server computing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3051—Monitoring arrangements for monitoring the configuration of the computing system or of the computing system component, e.g. monitoring the presence of processing resources, peripherals, I/O links, software programs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0876—Aspects of the degree of configuration automation
- H04L41/0883—Semiautomatic configuration, e.g. proposals from system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/70—Admission control; Resource allocation
- H04L47/76—Admission control; Resource allocation using dynamic resource allocation, e.g. in-call renegotiation requested by the user or requested by the network in response to changing network conditions
- H04L47/762—Admission control; Resource allocation using dynamic resource allocation, e.g. in-call renegotiation requested by the user or requested by the network in response to changing network conditions triggered by the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/70—Admission control; Resource allocation
- H04L47/82—Miscellaneous aspects
- H04L47/822—Collecting or measuring resource availability data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1044—Group management mechanisms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/34—Network arrangements or protocols for supporting network services or applications involving the movement of software or configuration parameters
Definitions
- the present disclosure relates generally to computing systems, and more particularly application architecture drift detection in computing systems.
- Computing devices may host applications such as gaming applications, service applications, media applications, financial application, and/or any other application that are provided to a client device via a network. These applications may be built to utilize various architecture patterns to achieve different goals around application availability, resiliency, and cost. This architecture typically involves utilizing multiple server computing devices and/or datacenters when deploying an application to provide redundancy.
- a formal part of the design phase for an application project is to identify an architecture pattern that serves the needs of the application and its user-base. Given the number of changes throughout an application development lifecycle and over the life of an application, many factors can contribute to implementations that do not adhere to the agreed upon architecture pattern.
- Some aspects include a process including: obtaining, by a computing system via a network, a first set of architecture design metrics associated with a first application; obtaining, by the computing system via the network, a first set of data metrics associated with a first instance of the first application that is installed at a first server computing system; obtaining, by the computing system via the network, a second set of data metrics associated with a second instance of the first application that is installed at a second server computing system; determining, by the computing system and using the first set of data metrics and the second set of data metrics, that at least one of the first instance, the first server computing system, the second instance, or the second server computing system deviates from one or more architecture design metrics from the first set of architecture design metrics associated with the first application; and providing, by the computing system, a deviation notification indicating a deviation from the one or more architecture design metrics.
- Some aspects include a tangible, non-transitory, machine-readable medium storing instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations including the above-mentioned process.
- Some aspects include a system, including: one or more processors; and memory storing instructions that when executed by the processors cause the processors to effectuate operations of the above-mentioned process.
- FIG. 1 is a schematic view illustrating an application architecture drift detection system, in accordance with some embodiments of the present disclosure
- FIG. 2 is a schematic view illustrating a client computing device included in the application architecture drift detection system of FIG. 1 , in accordance with some embodiments of the present disclosure
- FIG. 3 is a schematic view illustrating an application server computing device included in the application architecture drift detection system of FIG. 1 , in accordance with some embodiments of the present disclosure
- FIG. 4 is a schematic view illustrating an architecture management computing device included in the application architecture drift detection system of FIG. 1 , in accordance with some embodiments of the present disclosure
- FIG. 5 is a flow chart illustrating a method, in accordance with some embodiments of the present disclosure.
- FIG. 6 is table illustrating an architecture design metric table used during the method of FIG. 5 , in accordance with some embodiments of the present disclosure
- FIG. 7 is table illustrating a data metric table used during the method of FIG. 5 , in accordance with some embodiments of the present disclosure
- FIG. 8 is a schematic of a computing system, in accordance with some embodiments of the present disclosure.
- the architecture design metric is agreed, approved, and recorded.
- the architecture design metric may be any condition and/or configuration for which an application system is designed to include and operate.
- the architecture design metric may include an architecture status metric, an application version metric, and/or a resource configuration metric.
- the application should be implemented in production according to the approved design pattern and architecture status metrics.
- the architecture design pattern is changed. For example, during the application development lifecycle, the application team changes the architecture pattern due to changes in requirements and the new design is not approved. In another example, during production implementation, the changes are made resulting in the production architecture pattern differing from the approved design. In yet another example, during use of the application, changes are made which result in the effective architecture pattern changing.
- Embodiments of the present disclosure may provide an architecture drift detection controller that is running in real-time and determines that the application is running in production with an architecture pattern different from the approved architecture pattern.
- the architecture drift detection controller may make its determination by obtaining data metrics from an application monitoring application, a version monitoring application, and/or a resource monitoring application. Data metrics may include any data from an application system during its operations, many examples of which are described herein.
- an administrator is notified of the difference or drift.
- the administrator may make changes to the production implementation of the application to synchronize the application with the approved architecture pattern.
- the administrator may update the approved architecture pattern to match that of the actual architecture pattern.
- the systems and methods of the present disclosure reduce application downtime, reduce reputational risk, improve bandwidth for the application, improve user experiences for users that are using the application, and/or other technical benefits that would be apparent to one of skill in the art in possession of the present disclosure.
- the application architecture drift detection system 100 may include a client computing device 102 , one or more datacenters (e.g., a datacenter 104 a , a datacenter 104 b , and/or a datacenter 104 c ) that each include one or more application server computing devices (e.g., an application server computing device 106 a , an application server computing device 106 b , and/or an application server computing device 106 c ), and a load balancer 108 , and an architecture management computing device 110 .
- a client computing device 102 may include a client computing device 102 , one or more datacenters (e.g., a datacenter 104 a , a datacenter 104 b , and/or a datacenter 104 c ) that each include one or more application server computing devices (e.g., an application server computing device 106 a , an application server computing device 106 b , and/or an application server computing device 106 c ), and a
- the client computing device 102 , the application server computing devices 106 a , 106 b , and 106 c , the load balancer 108 , and the architecture management computing device 110 may be in communication with each other over a network 112 . While illustrated as being provided between the network 112 and the application server computing devices 106 a - 106 c , the server computing devices 106 a - 106 c may be coupled to the load balancer 108 via the network 112 .
- the client computing device 102 may be implemented using any appropriate combination of hardware and/or software configured for wired and/or wireless communication over the network 112 .
- the client computing device 102 may be implemented as a wireless telephone (e.g., smart phone), a tablet, a personal digital assistant (PDA), a notebook computer, a personal computer, a connected set-top box (STB) such as provided by cable or satellite content providers, or a video game system console, a head-mounted display (HIVID), a watch, an eyeglass projection screen, an autonomous/semi-autonomous device, a vehicle, an Unmanned Arial Vehicle (UAV), a robotic device, a user badge, and/or other client computing device that would be apparent to one of skill in the art in possession of the present disclosure.
- a wireless telephone e.g., smart phone
- PDA personal digital assistant
- STB connected set-top box
- HVID head-mounted display
- watch an eyeglass projection screen
- the client computing device 102 may include any appropriate combination of hardware and/or software having one or more processors and capable of reading instructions stored on a tangible non-transitory machine-readable medium for execution by the one or more processors. Consistent with some embodiments, the client computing device 102 includes a machine-readable medium, such as a memory (not shown) that includes instructions for execution by one or more processors (not shown) for causing the client computing device 102 to perform specific tasks. In some embodiments, the instructions may be executed by the one or more processors in response to interaction by the user.
- the client computing device 102 may include a communication system having one or more transceivers to enable the client computing device 102 to communicate with other client computing devices, the application server computing devices 106 a - 106 c , and/or the architecture management computing device 110 . Accordingly, and as disclosed in further detail below, the client computing device 102 may be in communication with systems directly or indirectly.
- the phrase “in communication,” including variances thereof, encompasses direct communication and/or indirect communication through one or more intermediary components and does not require direct physical (e.g., wired and/or wireless) communication and/or constant communication, but rather additionally includes selective communication at periodic or aperiodic intervals, as well as one-time events.
- the client computing device 102 in the application architecture drift detection system 100 of FIG. 1 may include first (e.g., relatively long-range) transceiver(s) to permit the client computing device to communicate with the network 112 via a communication channel.
- the network 112 may be implemented as a single network or a combination of multiple networks.
- the network 112 may include the Internet and/or one or more intranets, landline networks, wireless networks, and/or other appropriate types of communication networks.
- the network 112 may comprise a wireless telecommunications network adapted to communicate with other communication networks, such as the Internet.
- the wireless telecommunications network may be implemented by an example mobile cellular network, such as a long-term evolution (LTE) network or other third generation (3G), fourth generation (4G) wireless network, fifth generation (5G) wireless network and/or any subsequent generations.
- LTE long-term evolution
- 4G fourth generation
- 5G fifth generation
- the network 112 may be additionally or alternatively be implemented by one or more other communication networks, such as, but not limited to, a satellite communication network, a microwave radio network, and/or other communication networks.
- the client computing device 102 additionally may include second (e.g., short-range relative to the range of the first transceiver) transceiver(s) to permit the client computing device 102 to communicate with other client computing devices via a direct communication channel.
- second transceivers may be implemented by a type of transceiver supporting short-range (eg., operate at distances that are shorter than the long-range transceivers) wireless networking.
- such second transceivers may be implemented by Wi-Fi transceivers (e.g., via a Wi-Fi Direct protocol), Bluetooth® transceivers, infrared (IR) transceiver, and other transceivers that are configured to allow the client computing device 102 to intercommunicate with other client computing devices via an ad-hoc or other wireless network.
- Wi-Fi transceivers e.g., via a Wi-Fi Direct protocol
- Bluetooth® transceivers e.g., via a Wi-Fi Direct protocol
- IR infrared
- the application architecture drift detection system 100 also includes or may be in communication with the application server computing devices 106 a , 106 b , and/or 106 c .
- the application server computing devices 106 a - 106 c may include one or more server devices, storage systems, cloud computing systems, and/or other computing devices.
- the application server computing devices 106 a - 106 c may also include any appropriate combination of hardware and/or software having one or more processors and capable of reading instructions stored on a tangible non-transitory machine-readable medium for execution by the one or more processors.
- the application server computing devices 106 a - 106 c include a machine-readable medium, such as a memory (not shown) that includes instructions for execution by one or more processors (not shown) for causing the application server computing devices 106 a - 106 c to perform specific tasks.
- the instructions may be executed by the one or more processors in response to interaction by the user.
- the application server computing devices 106 a - 106 c may also be maintained by an entity with which sensitive credentials and information may be exchanged with the client computing device 102 .
- the application server computing devices 106 a - 106 c may further be one or more servers that hosts one or more applications for the client computing device 102 .
- the server computing devices 106 a - 106 c include a redundant application instance of one or more applications.
- the server computing devices 106 a - 106 c may more generally include a web site, an online content manager, a service provider application, and/or other application that provides content and/or services to the user.
- the server computing devices 106 a - 106 c may also be in communication with one or more external databases, that may provide additional information that may be used by the application server computing devices 106 a - 106 c .
- each application server computing device 106 a , 106 b , 106 c is hosted in a respective datacenter 104 a , 104 b , and 104 c .
- the application server computing devices 106 a - 106 c may be included in single datacenter or may be provided as virtual machines running on a single computing system.
- the application architecture drift detection system 100 also includes or may be in communication with the load balancer 108 .
- the load balancer 108 may include one or more front-end server computing devices running a load balancing application.
- the load balancer 108 may include one or more server devices, storage systems, cloud computing systems, and/or other computing devices.
- the load balancer 108 may include one or more networking devices such as a routing device, a switch device, and/or any other networking device that would be apparent to one of skill in the art in possession of the present disclosure that may be running a load balancing application.
- the load balancer 108 may include specialized hardware and/or may include a one or more virtualized instances running on the specialized hardware that is configured to run a load balancing application.
- the load balancing application may provide one or more load balancing algorithms that disperse network traffic to the application server computing devices 106 a - 106 c to ensure that no single server becomes overworked and unreliable, and thus minimizes response time and maximizes throughput.
- the load balancing algorithms may include a round robin algorithm, a least connection algorithm, a least response time algorithm, a least bandwidth algorithm, a hashing algorithm, a custom algorithm, and/or any other load balancing algorithm that would be apparent to one of skill in the art in possession of the present disclosure. While some examples of a load balancer 108 are disclosed, other load balancers may be contemplated and fall under the scope of the present disclosure as well.
- the application architecture drift detection system 100 also includes or may be in communication with the architecture management computing device 110 .
- the architecture management computing device 110 may include one or more server devices, storage systems, cloud computing systems, and/or other computing devices (e.g., desktop computing device(s), laptop/notebook computing device(s), tablet computing device(s), mobile phone(s), etc.
- the architecture management computing device 110 may also include any appropriate combination of hardware and/or software having one or more processors and capable of reading instructions stored on a tangible non-transitory machine-readable medium for execution by the one or more processors.
- the architecture management computing device 110 includes a machine-readable medium, such as a memory (not shown) that includes instructions for execution by one or more processors (not shown) for causing the architecture management computing device 110 to perform specific tasks.
- the instructions may be executed by the one or more processors in response to interaction by the user.
- the architecture management computing device 110 may include management applications used to manage the application architecture drift detection system 100 including functionality of detecting drift in architecture design metrics such as, for example, an architecture pattern of the application server computing devices 106 a - 106 c (eg., application instance status (e.g., passive or active)), an application version for each application instance running on the application server computing devices 106 a - 106 c , and/or a resource configuration of the application server computing devices 106 a - 106 c . While a specific application architecture drift detection system 100 is illustrated in FIG. 1 , one of skill in the art in possession of the present disclosure will recognize that other components and configurations are possible, and thus will fall under the scope of the present disclosure.
- architecture design metrics such as, for example, an architecture pattern of the application server computing devices 106 a - 106 c (eg., application instance status (e.g., passive or active)), an application version for each application instance running on the application server computing devices 106 a - 106 c , and
- the client computing device 200 includes a chassis 202 that houses the components of the client computing device 200 .
- the chassis 202 may house a processing system (not illustrated) and a non-transitory memory system (not illustrated) that includes instructions that, when executed by the processing system, cause the processing system to provide an application engine 204 that is configured to perform the functions of the application engine and/or the client computing devices discussed below.
- the application engine 204 is configured to provide one or more of a web browser application 204 a or a native application 204 b .
- the chassis 202 may further house a communication system 210 that is coupled to the application engine 204 (e.g., via a coupling between the communication system 210 and the processing system).
- the communication system 210 may include software or instructions that are stored on a computer-readable medium and that allow the client computing device 200 to send and receive information through the communication networks discussed above.
- the communication system 210 may include a communication interface to provide for communications through the network 112 as detailed above (e.g., first (e.g., long-range) transceiver(s)).
- the communication interface may include a wireless antenna that is configured to provide communications with IEEE 802.11 protocols (Wi-Fi), cellular communications, satellite communications, other microwave radio communications and/or communications.
- Wi-Fi IEEE 802.11 protocols
- the communication system 210 may also include a communication interface (e.g., the second (e.g., short-range) transceiver(s)) that is configured to provide direct communication with other client computing devices, sensors, storage devices, beacons, and other devices included in the securitization system discussed above with respect to FIG. 1 .
- the communication interface may include a wireless antenna that configured to operate according to wireless protocols such as Bluetooth®, Bluetooth® Low Energy (BLE), near field communication (NFC), infrared data association (IrDA), ANT®, Zigbee®, Z-Wave® IEEE 802.11 protocols (Wi-Fi), and/or other wireless communication protocols that allow for direct communication between devices.
- wireless protocols such as Bluetooth®, Bluetooth® Low Energy (BLE), near field communication (NFC), infrared data association (IrDA), ANT®, Zigbee®, Z-Wave® IEEE 802.11 protocols (Wi-Fi), and/or other wireless communication protocols that allow for direct communication between devices.
- the chassis 202 may house a storage device (not illustrated) that provides a storage system 216 that is coupled to the application engine 204 through the processing system.
- the storage system 216 may be configured to store data, applications, and/or instructions described in further detail below and used to perform the functions described herein.
- the chassis 202 also houses a user Input/Output (I/O) system 218 that is coupled to the application engine 204 (e.g., via a coupling between the processing system and the user I/O system 218 ).
- I/O Input/Output
- the user I/O system 218 may be provided by a keyboard input subsystem, a mouse input subsystem, a track pad input subsystem, a touch input display subsystem, a microphone, an audio system, a haptic feedback system, and/or any other input subsystem.
- the chassis 202 also houses a display system 220 that is coupled to the application engine 204 (e.g., via a coupling between the processing system and the display system 220 ) and may be included in the user I/O system 218 .
- the display system 220 may be provided by a display device that is integrated into the client computing device 200 and that includes a display screen (e.g., a display screen on a laptop/notebook computing device, a tablet computing device, a mobile phone, or wearable device), or by a display device that is coupled directly to the client computing device 200 (e.g., a display device coupled to a desktop computing device by a cabled or wireless connection).
- a display screen e.g., a display screen on a laptop/notebook computing device, a tablet computing device, a mobile phone, or wearable device
- a display device that is coupled directly to the client computing device 200 e.g., a display device coupled to a desktop computing device by a cabled or wireless connection.
- client computing device 200 and several embodiments of its operation are illustrated and described herein, one of skill in the art in possession of the present disclosure will recognize that client computing devices may include a variety of components and component configuration and may operate in a variety of manners that will fall within the scope
- an embodiment of an application server computing device 300 is illustrated that may be any of application server computing devices 106 a - 106 c discussed above with reference to FIG. 1 .
- the application server computing device 300 includes a chassis 302 that houses the components of the application server computing device 300 , only some of which are illustrated in FIG. 3 .
- the chassis 302 may house a processing system (not illustrated) and a non-transitory memory system (not illustrated) that includes instructions that, when executed by the processing system, cause the processing system to provide an application management engine 304 that is configured to perform the functions of the application management engines and/or application server computing devices discussed below.
- the application management engine 304 may include one or more applications instances (e.g.
- the application management engine 304 may include an application metric engine 304 c that is configured to perform the functions of the application metric engines and/or application server computing devices discussed below such as, for example, monitoring the application instances, server computing device resources and/or components, and/or other architecture components and obtain data metrics for those architecture components.
- the chassis 302 may further house a communication system 306 that is coupled to the application management engine 304 (e.g., via a coupling between the communication system 306 and the processing system) and that is configured to provide for communication through the network 112 of FIG. 1 as detailed below.
- the communication system 306 may allow the application server computing device 300 to send and receive information over the network 112 of FIG. 1 .
- the chassis 302 may also house a storage device (not illustrated) that provides a storage system 308 that is coupled to the application management engine 304 through the processing system.
- the storage system 308 may be configured to store data and/or instructions to complete the functionality discussed herein.
- the storage system 308 may be provided on the application server computing device 300 and/or on a database accessible via the communication system 306 .
- application server computing device 300 and several embodiments of its operation are illustrated and described herein, one of skill in the art in possession of the present disclosure will recognize that application server computing devices may include a variety of components and component configuration and may operate in a variety of manners that will fall within the scope of the present disclosure as well.
- an embodiment of an architecture management computing device 400 is illustrated that may be an architecture management computing device 110 discussed above with reference to FIG. 1 .
- the architecture management computing device 400 includes a chassis 402 that houses the components of the architecture management computing device 400 , only some of which are illustrated in FIG. 4 .
- the chassis 402 may house a processing system (not illustrated) and a non-transitory memory system (not illustrated) that includes instructions that, when executed by the processing system, cause the processing system to provide an architecture drift detection controller 404 that is configured to perform the functions of the architecture drift detection controller and/or architecture management computing device discussed below.
- the chassis 402 may further house a communication system 406 that is coupled to the architecture drift detection controller 404 (e.g., via a coupling between the communication system 406 and the processing system) and that is configured to provide for communication through the network 112 of FIG. 1 as detailed below.
- the communication system 406 may allow the architecture management computing device 400 to send and receive information over the network 112 of FIG. 1 .
- the chassis 402 may also house a storage device (not illustrated) that provides a storage system 408 that is coupled to the architecture drift detection controller 404 through the processing system.
- the storage system 408 may be configured to store data and/or instructions to complete the functionality discussed herein.
- the storage system 408 may store architecture design metrics 408 a and data metrics 408 b that are received from the application server computing devices 106 a - 106 c / 300 of FIGS. 1 and 3 and/or the load balancer 108 .
- the storage system 408 may be provided on the architecture management computing device 400 and/or on a database accessible via the communication system 406 .
- an architecture management computing device 400 and several embodiments of its operation are illustrated and described herein, one of skill in the art in possession of the present disclosure will recognize that architecture management computing devices may include a variety of components and component configuration and may operate in a variety of manners that will fall within the scope of the present disclosure as well.
- the method 500 may begin at block 502 where one or more sets of architecture design metrics associated with one or more applications, respectively, are obtained.
- the architecture drift detection controller 404 of the architecture management computing device 110 / 400 may obtain an architecture design metric 408 a for the first application that is associated with the application instance 304 a
- the architecture drift detection controller 404 of the architecture management computing device 110 / 400 may obtain another architecture design metric 408 a for a second application that is associated with the application instance 304 b .
- system administrator may generate and/or load the architecture design metrics 408 a for a first application and/or a second application via a management terminal coupled with the architecture management computing device 110 / 400 .
- the management terminal may include the client computing device 102 / 200 .
- the architecture design metric 408 a may include a desired architecture for a deployed application.
- the architecture design metric 408 a for the first application may include an architecture status metric, an application version metric, and/or a resource configuration metric.
- the architecture status metric may include an application instance status pattern for application instances for an application.
- the application version metric may indicate an application version for an application.
- the resource configuration metric may include a resource configuration for an application server computing device 106a-106b/ 300 hosting the application or other components in the datacenters 104 a - 104 c (e.g., networking resources, storage resources, and/or other resources that would be apparent to one of skill in the art in possession of the present disclosure).
- the resource configuration may indicate the amount of processing resources, bandwidth, memory resources, storages resources, and/or or other resources required to host an application instance of an application that would be apparent to one of skill in the art in possession of the present disclosure.
- an example of an architecture design metric table 600 that includes an architecture design metric 602 a for the application (e.g., “Application 1”) associated with the application instance 304 a for FIG. 3 and an architecture design metric 602 b for the application (e.g., “Application 2”) associated with the application instance 304 b is illustrated.
- the architecture design metrics 602 a and 602 b include architecture status metrics 604 a and 604 b , respectively.
- the architecture status metrics 604 a may include an application instance status pattern 606 a that identifies the desired status for a combination of the application instances 304 a in the application server computing devices 106 a , 106 b , and 106 c and/or datacenters 104 a , 104 b , and 104 c .
- the application instance status pattern 606 a indicates, for “Application 1” that is associated with the application instances 304 a , one of the application server computing devices 106 a - 106 c or one of the datacenters 104 a - 104 c should have an active application instance status, and two of the application server computing devices 106 a - 106 c or two of the datacenters 104 a - 104 c should have a passive application instance status.
- the architecture status metrics 604 a may include a specific application instance status pattern 608 a that identifies the desired status for each of the application instances 304 a in the application server computing devices 106 a , 106 b , and 106 c and/or datacenters 104 a , 104 b , and 104 c .
- the specific application instance status pattern 608 a indicates, for “Application 1” that is associated with the application instances 304 a , the application server computing device 106 a or the datacenter 104 a should have an active application instance status and the application server computing devices 106 b and 106 c or the datacenters 104 b and 104 c should have a passive application instance status.
- the architecture status metrics 604 b may include an application instance status pattern 606 b that identifies the desired status for a combination of the application instances 304 b in the application server computing devices 106 a , 106 b , and 106 c and/or datacenters 104 a , 104 b , and 104 c .
- the illustrated example further illustrates that the application instance status pattern 606 b indicates, for “Application 2” that is associated with the application instances 304 b , two of the application server computing devices 106 a - 106 c or two of the datacenters 104 a - 104 c should have an active application instance status, and one of the application server computing devices 106 a - 106 c or one of the datacenters 104 a - 104 c should have a passive application instance status.
- the architecture status metrics 604 b may include a specific application instance status pattern 608 b that identifies the desired status for each of the application instances 304 a in the application server computing devices 106 a , 106 b , and 106 c and/or datacenters 104 a , 104 b , and 104 c .
- the specific application instance status pattern 608 b indicates, for “Application 2” that is associated with the application instances 304 a , the application server computing devices 106 a and 106 b or the datacenters 104 a and 104 b should have an active application instance status, and the application server computing device 106 c or the datacenter 104 c should have a passive application instance status.
- an active application status may indicate an application instance is deployed and serving application requests.
- a passive application instance status may indicate an application instance is deployed but not serving application requests.
- Other application instance statuses may include a deployed application instance status that indicates that the application instance is deployed but not running, and/or a not deployed application instance status that indicates that the application instance is not deployed at an application server computing device or a datacenter. While several application instance statuses are described other application instance statuses may be contemplated by one of skill in the art in possession of the present disclosure and fall within the scope of the present disclosure.
- the method 500 may proceed to block 504 where a set of data metrics associated with each application instance for an application is obtained.
- the architecture drift detection controller 404 included on the management computing device 400 may obtain, via the network 112 , a set of data metrics from the application server computing device 106 a for the application instance 304 a , a set of data metrics from the application server computing device 106 b for the application instance 304 a , a set of data metrics from the application server computing device 106 c for the application instance 304 a , a set of data metrics from the application server computing device 106 a for the application instance 304 b , a set of data metrics from the application server computing device 106 b for the application instance 304 b , and/or a set of data metrics from the application server computing device 106 c for the application instance 304 b .
- the application metric engine 304 c may generate or detect the various data metrics.
- the data metrics may include application instance identifiers, application server computing device identifiers, and/or datacenter identifiers. For example, application licensing number, serial numbers, Media Access Control (MAC) addresses, and/or any other identifier may be included in the data metrics used to identify the application instance, the application server computing device running the application instance, or the datacenter in which the application server computing device is housed.
- application licensing number, serial numbers, Media Access Control (MAC) addresses, and/or any other identifier may be included in the data metrics used to identify the application instance, the application server computing device running the application instance, or the datacenter in which the application server computing device is housed.
- the data metrics may include a deployment status, a number of calls for a given time period, business metrics (e.g., transactions volume, messages/sec, and the like), performance metrics (e.g., bandwidth, time to complete an application call), an application version, a resource configuration of hardware resources included on the application server computing devices 106 a - 106 c and/or the datacenters 104 a - 104 c , resource usage data, and/or any other data metric that would be apparent to one of skill in the art in possession of the present disclosure.
- the application metric engine 304 c may include any resource monitoring application and/or application monitoring application that would be apparent to one of skill in the art in possession of the present disclosure.
- the application metric engine 304 c may include AppDynamics provided by CISCO® headquartered in San Jose, California, United States.
- the application metric engine 304 may include Prometheus, Cloudprober, and/or Foglight provided by QUEST® headquartered in Aliso Viejo, California, United States.
- the architecture drift detection controller 404 may obtain, via the network 112 , a set of data metrics for any of the application server computing devices 106 a - 106 c for any of the application instances 304 a and/or 304 b from the load balancer 108 that may include an application metric engine that may be similar to the application metric engine 304 c of the application server computing devices 106 a - 106 c .
- the data metrics when obtained by the architecture drift detection controller 404 , may be stored in the storage system 408 as data metrics 408 b .
- the method 500 may then proceed to decision block 506 where it is determined whether the sets of data metrics satisfy or deviate from one or more architecture design metrics included in the set of architecture design metrics.
- the architecture drift detection controller 404 included on the architecture management computing device 110 / 400 may compare the data metrics 408 b to the architecture design metrics 408 a and/or make determinations from the data metrics 408 b that are then compared to the architecture design metrics 408 a .
- the data metrics that include an application version may be compared to an application version included in the architecture design metrics.
- the data metrics that include resource usage e.g., number of CPUs used by an application instance
- the data metrics 408 b may include a deployment metric for an application instance included on each of the application server computing devices 106 a - 106 c that indicates whether an application instance is deployed or not at an application server computing device.
- the deployment metric in combination with other data metrics, may be used in determining whether an application instance includes an active status, a passive status, a deployed status, or a not deployed status.
- an application call metric included in the data metrics 408 b may indicate whether an application is serving requests or not serving requests.
- the application call metric in combination with the deployment metric may be used in determining whether an application instance includes the active status, the passive status, the deployed status, or the not deployed status.
- a determination from both the deployment metric and the application call metric may be used to determine an application instance status.
- the architecture drift detection controller 404 may then use that application instance status derived from the data metrics 408 b to compare to the architecture design metrics 408 a to determine whether the data metrics satisfy or deviate from one or more architecture design metrics.
- the architecture drift detection controller 404 included on the architecture management computing device 110 / 400 may determine whether any of the application instances 304 a and/or 304 b on the application server computing device 106 a - 106 c and/or the application server computing devices 106 a - 106 c themselves satisfy architecture design metrics or deviate from any of the architecture design metrics.
- FIG. 7 an example of a data metric table 700 that includes an actual data metric 702 a for the application (e.g., “Application 1”) associated with the application instance 304 a for FIG. 3 and an actual data metric 702 b for the application (e.g., “Application 2”) associated with the application instance 304 b is illustrated.
- the data metric table 700 may be created using the data metrics received for “Application 1” and “Application 2.”
- the actual data metrics 702 a and 702 b include actual architecture status metrics 704 a and 704 b , respectively
- the architecture status metrics 704 a may include a specific application instance status pattern 708 a that identifies the actual status for each of the application instances 304 a in the application server computing devices 106 a , 106 b , and 106 c and/or the datacenters 104 a , 104 b , and 104 c .
- the actual application instance status pattern 708 a indicates, for “Application 1” that is associated with the application instances 304 a , the application server computing device 106 a or the datacenter 104 a has an active application instance status, the application server computing device 106 b or the datacenter 104 b has an active application instance status, and the application server computing device 106 c or the datacenters 104 c has a passive application instance status.
- the architecture status metrics 704 b may include a specific application instance status pattern 708 b that identifies the actual status for each of the application instances 304 b in the application server computing devices 106 a , 106 b , and 106 c and/or datacenters 104 a , 104 b , and 104 c .
- the actual application instance status pattern 708 b indicates, for “Application 2” that is associated with the application instances 304 b , the application server computing device 106 a or the datacenter 104 a has an active application instance status, the application server computing device 106 b or the datacenter 104 b has an active application instance status, and the application server computing device 106 c or the datacenters 104 c has a passive application instance status.
- the architecture drift detection controller 404 may determine by comparing the data metric table 700 to the architecture design metric table 600 of FIG. 6 that the “Application 1” deviates from the application instance status pattern 606 a (e.g., 1 active and 2 passive) and/or the specific application instance status pattern 608 a (e.g., datacenter 104 a is “active,” datacenter 104 b is “passive,” and datacenter 104 c is “passive.”).
- the application instance status pattern 606 a e.g., 1 active and 2 passive
- the specific application instance status pattern 608 a e.g., datacenter 104 a is “active,” datacenter 104 b is “passive,” and datacenter 104 c is “passive.”.
- the architecture drift detection controller 404 may determine by comparing the data metric table 700 to the architecture design metric table 600 that the “Application 2” satisfies the application instance status pattern 606 b (e.g., 2 active and 1 passive) and/or the specific application status pattern 708 b .
- the application instance status pattern 606 b e.g., 2 active and 1 passive
- whether the data metrics deviates from the architecture design metrics may include a single architecture design metric deviating from a proposed design metric.
- a threshold number of architecture design metrics may be required before the deviation determination is made.
- the deviation determination may be made based on a weight given to various architecture design metrics such that when a combined weight of deviations exceeds a weight threshold, the deviation classification may be justified.
- the design metrics 408 b may be received at various intervals (e.g., once per day, once per hour, once per 5 minutes, once per minute, or any other interval). As such the determination made at block 506 may occur at the same or different intervals.
- the method 500 may return back to block 504 where additional data metrics are obtained.
- the architecture drift detection controller 404 included on the architecture management computing device 110 / 400 may generate and provide a compliance notification to a system administrator indicating the satisfaction of the one or more architecture design metrics by the data metrics
- a system administrator indicating the satisfaction of the one or more architecture design metrics by the data metrics
- an indicator light included at the management 110 / 400 may be activated
- a E-mail may be sent to the system administrator’s email address indicating the satisfaction
- a Graphical User Interface (GUI) may be presented on a display screen of a terminal device coupled to the architecture management computing device 110 / 400
- a log file may be generated and stored in the storage system 408
- an audio indication may be outputted via an audio system coupled to the architecture management computing device 110 / 400
- a data object may be updated, and/or any other compliance notification may be provided as would be apparent to one of skill in the art of the present disclosure.
- the method 500 may proceed to block 508 where a deviation notification indicating the deviation from the one or more architecture design metrics is provided.
- the architecture drift detection controller 404 included on the architecture management computing device 110 / 400 may generate and provide a deviation notification to a system administrator indicating the satisfaction of the one or more architecture design metrics by the data metrics.
- an indicator light included at the management 110 / 400 may be activated that indicates a deviation
- an E-mail may be sent to the system administrator’s email address indicating the deviation
- a Graphical User Interface GUI
- GUI Graphical User Interface
- a log file or other data object may be generated and stored in the storage system 408 that indicates the deviation
- an audio indication may be outputted via an audio system that indicates the deviation
- any other deviation notification may be provided that would be apparent to one of skill in the art of the present disclosure.
- the administrator may update one or more of the application instances 304 a or 304 b , the application server computing devices 106 a - 106 c , and/or any other hardware or software components at the datacenters 104 a - 104 c to correct the architecture pattern drift, the version drift, and/or the resources configuration drift.
- the administrator may determine that the detected drift is acceptable, and the administrator may update the architecture design metrics 408 a such that the architecture design metrics 408 a match metrics what is deployed on the application server computing device 106 a - 106 c .
- FIG. 8 is a diagram that illustrates an exemplary computing system 800 in accordance with embodiments of the present technique.
- Various portions of systems and methods described herein may include or be executed on one or more computing systems similar to computing system 800 . Further, processes and modules described herein may be executed by one or more processing systems similar to that of computing system 800 .
- the client computing device 102 / 200 , the application server computing devices 106 a - 106 c / 300 , the load balancer 108 , and/or the architecture computing device 110 / 400 may be provided by the computing system 800 .
- Computing system 800 may include one or more processors (e.g., processors 810 a - 1010 n ) coupled to system memory 820 , an input/output I/O device interface 830 , and a network interface 840 via an input/output (I/O) interface 850 .
- a processor may include a single processor or a plurality of processors (e.g., distributed processors).
- a processor may be any suitable processor capable of executing or otherwise performing instructions.
- a processor may include a central processing unit (CPU) that carries out program instructions to perform the arithmetical, logical, and input/output operations of computing system 800 .
- CPU central processing unit
- a processor may execute code (e.g., processor firmware, a protocol stack, a database management system, an operating system, or a combination thereof) that creates an execution environment for program instructions.
- a processor may include a programmable processor.
- a processor may include general or special purpose microprocessors.
- a processor may receive instructions and data from a memory (e.g., system memory 820 ).
- Computing system 800 may be a uni-processor system including one processor (e.g., processor 810 a ), or a multi-processor system including any number of suitable processors (e.g., 810 a - 1010 n ). Multiple processors may be employed to provide for parallel or sequential execution of one or more portions of the techniques described herein.
- Processes, such as logic flows, described herein may be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating corresponding output. Processes described herein may be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).
- Computing system 800 may include a plurality of computing devices (e.g., distributed computing systems) to implement various processing functions.
- I/O device interface 830 may provide an interface for connection of one or more I/O devices 860 to computing system 800 .
- I/O devices may include devices that receive input (e.g., from a user) or output information (e.g., to a user).
- I/O devices 860 may include, for example, graphical user interface presented on displays (e.g., a cathode ray tube (CRT) or liquid crystal display (LCD) monitor), pointing devices (e.g., a computer mouse or trackball), keyboards, keypads, touchpads, scanning devices, voice recognition devices, gesture recognition devices, printers, audio speakers, microphones, cameras, or the like.
- I/O devices 860 may be connected to computing system 800 through a wired or wireless connection.
- I/O devices 860 may be connected to computing system 800 from a remote location.
- I/O devices 860 located on remote computing system for example, may be connected to computing system 800 via a network and network interface 840 .
- Network interface 840 may include a network adapter that provides for connection of computing system 800 to a network.
- Network interface 840 may facilitate data exchange between computing system 800 and other devices connected to the network.
- Network interface 840 may support wired or wireless communication.
- the network may include an electronic communication network, such as the Internet, a local area network (LAN), a wide area network (WAN), a cellular communications network, or the like.
- System memory 820 may be configured to store program instructions 801 or data 802 .
- Program instructions 801 may be executable by a processor (e.g., one or more of processors 810 a - 810 n ) to implement one or more embodiments of the present techniques.
- Instructions 801 may include modules of computer program instructions for implementing one or more techniques described herein with regard to various processing modules.
- Program instructions may include a computer program (which in certain forms is known as a program, software, software application, script, or code).
- a computer program may be written in a programming language, including compiled or interpreted languages, or declarative or procedural languages.
- a computer program may include a unit suitable for use in a computing environment, including as a stand-alone program, a module, a component, or a subroutine.
- a computer program may or may not correspond to a file in a file system.
- a program may be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub programs, or portions of code).
- a computer program may be deployed to be executed on one or more computer processors located locally at one site or distributed across multiple remote sites and interconnected by a communication network.
- System memory 820 may include a tangible program carrier having program instructions stored thereon.
- a tangible program carrier may include a non-transitory computer readable storage medium.
- a non-transitory computer readable storage medium may include a machine readable storage device, a machine readable storage substrate, a memory device, or any combination thereof.
- Non-transitory computer readable storage medium may include non-volatile memory (e.g., flash memory, ROM, PROM, EPROM, EEPROM memory), volatile memory (e.g., random access memory (RAM), static random access memory (SRAM), synchronous dynamic RAM (SDRAM)), bulk storage memory (e.g., CD-ROM and/or DVD-ROM, hard-drives), or the like.
- non-volatile memory e.g., flash memory, ROM, PROM, EPROM, EEPROM memory
- volatile memory e.g., random access memory (RAM), static random access memory (SRAM), synchronous dynamic RAM (SDRAM)
- bulk storage memory e.g.
- System memory 820 may include a non-transitory computer readable storage medium that may have program instructions stored thereon that are executable by a computer processor (e.g., one or more of processors 810 a - 810 n ) to cause the subject matter and the functional operations described herein.
- a memory e.g., system memory 820
- Instructions or other program code to provide the functionality described herein may be stored on a tangible, non-transitory computer readable media. In some cases, the entire set of instructions may be stored concurrently on the media, or in some cases, different parts of the instructions may be stored on the same media at different times.
- I/O interface 850 may be configured to coordinate I/O traffic between processors 810 a - 810 n , system memory 820 , network interface 840 , I/O devices 860 , and/or other peripheral devices. I/O interface 850 may perform protocol, timing, or other data transformations to convert data signals from one component (e.g., system memory 820 ) into a format suitable for use by another component (e.g., processors 810 a - 810 n ). I/O interface 850 may include support for devices attached through various types of peripheral buses, such as a variant of the Peripheral Component Interconnect (PCI) bus standard or the Universal Serial Bus (USB) standard.
- PCI Peripheral Component Interconnect
- USB Universal Serial Bus
- Embodiments of the techniques described herein may be implemented using a single instance of computing system 800 or multiple computing systems 800 configured to host different portions or instances of embodiments Multiple computing systems 800 may provide for parallel or sequential processing/execution of one or more portions of the techniques described herein.
- computing system 800 is merely illustrative and is not intended to limit the scope of the techniques described herein.
- Computing system 800 may include any combination of devices or software that may perform or otherwise provide for the performance of the techniques described herein.
- computing system 800 may include or be a combination of a cloud-computing system, a data center, a server rack, a server, a virtual server, a desktop computer, a laptop computer, a tablet computer, a server device, a client device, a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a vehicle-mounted computer, or a Global Positioning System (GPS), or the like.
- PDA personal digital assistant
- GPS Global Positioning System
- Computing system 800 may also be connected to other devices that are not illustrated or may operate as a stand-alone system.
- functionality provided by the illustrated components may in some embodiments be combined in fewer components or distributed in additional components.
- functionality of some of the illustrated components may not be provided or other additional functionality may be available.
- instructions stored on a computer-accessible medium separate from computing system 800 may be transmitted to computing system 800 via transmission media or signals such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as a network or a wireless link.
- Various embodiments may further include receiving, sending, or storing instructions or data implemented in accordance with the foregoing description upon a computer-accessible medium Accordingly, the present techniques may be practiced with other computing system configurations.
- illustrated components are depicted as discrete functional blocks, but embodiments are not limited to systems in which the functionality described herein is organized as illustrated.
- the functionality provided by each of the components may be provided by software or hardware modules that are differently organized than is presently depicted, for example such software or hardware may be intermingled, conjoined, replicated, broken up, distributed (e.g. within a data center or geographically), or otherwise differently organized.
- the functionality described herein may be provided by one or more processors of one or more computers executing code stored on a tangible, non-transitory, machine readable medium.
- third party content delivery networks may host some or all of the information conveyed over networks, in which case, to the extent information (e.g., content) is said to be supplied or otherwise provided, the information may be provided by sending instructions to retrieve that information from a content delivery network.
- the word “may” is used in a permissive sense (i.e., meaning having the potential to), rather than the mandatory sense (i.e., meaning must).
- the words “include”, “including”, and “includes” and the like mean including, but not limited to.
- the singular forms “a,” “an,” and “the” include plural referents unless the content explicitly indicates otherwise.
- Statements in which a plurality of attributes or functions are mapped to a plurality of objects encompasses both all such attributes or functions being mapped to all such objects and subsets of the attributes or functions being mapped to subsets of the attributes or functions (e.g., both all processors each performing steps A-D, and a case in which processor 1 performs step A, processor 2 performs step B and part of step C, and processor 3 performs part of step C and step D), unless otherwise indicated.
- reference to “a computing system” performing step A and “the computing system” performing step B can include the same computing device within the computing system performing both steps or different computing devices within the computing system performing steps A and B.
- statements that one value or action is “based on” another condition or value encompass both instances in which the condition or value is the sole factor and instances in which the condition or value is one factor among a plurality of factors.
- statements that “each” instance of some collection have some property should not be read to exclude cases where some otherwise identical or similar members of a larger collection do not have the property, i.e., each does not necessarily mean each and every Limitations as to sequence of recited steps should not be read into the claims unless explicitly specified, e.g., with explicit language like “after performing X, performing Y,” in contrast to statements that might be improperly argued to imply sequence limitations, like “performing X on items, performing Y on the X′ed items,” used for purposes of making claims more readable rather than specifying sequence.
- data structures and formats described with reference to uses salient to a human need not be presented in a human-intelligible format to constitute the described data structure or format, e.g., text need not be rendered or even encoded in Unicode or ASCII to constitute text; images, maps, and data-visualizations need not be displayed or decoded to constitute images, maps, and data-visualizations, respectively, speech, music, and other audio need not be emitted through a speaker or decoded to constitute speech, music, or other audio, respectively.
- Computer implemented instructions, commands, and the like are not limited to executable code and can be implemented in the form of data that causes functionality to be invoked, e.g., in the form of arguments of a function or API call.
- bespoke noun phrases and other coined terms
- the definition of such phrases may be recited in the claim itself, in which case, the use of such bespoke noun phrases should not be taken as invitation to impart additional limitations by looking to the specification or extrinsic evidence.
- a non-transitory, machine-readable medium storing instructions that, when executed by one or more processors, effectuate operations comprising: obtaining, by a computing system via a network, a first set of architecture design metrics associated with a first application; obtaining, by the computing system via the network, a first set of data metrics associated with a first instance of the first application that is installed at a first server computing system; obtaining, by the computing system via the network, a second set of data metrics associated with a second instance of the first application that is installed at a second server computing system; determining, by the computing system and using the first set of data metrics and the second set of data metrics, that at least one of the first instance, the first server computing system, the second instance, or the second server computing system deviates from one or more architecture design metrics from the first set of architecture design metrics associated with the first application; and providing, by the computing system, a deviation notification indicating a deviation from the one or more architecture design metrics.
- the operations further comprise: obtaining, by the computing system via the network, a second set of architecture design metrics associated with a second application; obtaining, by the computing system via the network, a third set of data metrics associated with a first instance of the second application that is installed at a third server computing system; obtaining, by the computing system via the network, a fourth set of data metrics associated with a second instance of the second application that is installed at a fourth server computing system; determining, by the computing system and using the third set of data metrics and the fourth set of data metrics, that at least one of the first instance of the second application, the third server computing system, the second instance of the second application, or the fourth server computing system satisfies the second set of architecture design metrics associated with the second application; and providing, by the computing system, a compliance notification indicating a satisfaction of the second set of architecture design metrics.
- the first set of architecture design metrics include at least one of an architecture status metric, an application version metric, or a resource configuration metric.
- the first set of architecture design metrics includes at least one architecture status metric indicating an active-passive status for the first instance of the first application and the second instance of the first application
- the first set of data metrics and the second set of data metrics indicates an active-active status or a passive-passive status for the first instance of the first application and the second instance of the first application.
- the first set of architecture design metrics includes an application version metric indicating a first application version for the first application
- the first set of data metrics and the second set of data metrics indicates that at least one of the first instance or the second instance includes a second application version for the first application that is different than the first application version.
- the first set of architecture design metrics includes a resource configuration metric indicating a first resource configuration for a server computing device, and wherein at least one of the first set of data metrics or the second set of data metrics indicates that at least one of the first server computing system or the second server computing system includes a second resource configuration that is different than the first resource configuration
- a tangible, non-transitory, machine-readable medium storing instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations comprising: the operations of any one of embodiments 1-7.
- a system comprising: one or more processors; and memory storing instructions that when executed by the processors cause the processors to effectuate operations comprising: the operations of any one of embodiments 1-7.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Debugging And Monitoring (AREA)
Abstract
Provided is an architecture drift detection system and method including: obtaining a first set of architecture design metrics associated with a first application; obtaining first set of data metrics associated with a first instance of the first application that is installed at a first server computing system; obtaining a second set of data metrics associated with a second instance of the first application that is installed at a second server computing system; determining, using the first set of data metrics and the second set of data metrics, that at least one of the first instance, the first server computing system, the second instance, or the second server computing system deviates from one or more architecture design metrics from the first set of architecture design metrics associated with the first application; and providing a deviation notification indicating a deviation from the one or more architecture design metrics.
Description
- The present disclosure relates generally to computing systems, and more particularly application architecture drift detection in computing systems.
- Computing devices, such as server computing devices, may host applications such as gaming applications, service applications, media applications, financial application, and/or any other application that are provided to a client device via a network. These applications may be built to utilize various architecture patterns to achieve different goals around application availability, resiliency, and cost. This architecture typically involves utilizing multiple server computing devices and/or datacenters when deploying an application to provide redundancy. A formal part of the design phase for an application project is to identify an architecture pattern that serves the needs of the application and its user-base. Given the number of changes throughout an application development lifecycle and over the life of an application, many factors can contribute to implementations that do not adhere to the agreed upon architecture pattern.
- The following is a non-exhaustive listing of some aspects of the present techniques. These and other aspects are described in the following disclosure.
- Some aspects include a process including: obtaining, by a computing system via a network, a first set of architecture design metrics associated with a first application; obtaining, by the computing system via the network, a first set of data metrics associated with a first instance of the first application that is installed at a first server computing system; obtaining, by the computing system via the network, a second set of data metrics associated with a second instance of the first application that is installed at a second server computing system; determining, by the computing system and using the first set of data metrics and the second set of data metrics, that at least one of the first instance, the first server computing system, the second instance, or the second server computing system deviates from one or more architecture design metrics from the first set of architecture design metrics associated with the first application; and providing, by the computing system, a deviation notification indicating a deviation from the one or more architecture design metrics.
- Some aspects include a tangible, non-transitory, machine-readable medium storing instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations including the above-mentioned process.
- Some aspects include a system, including: one or more processors; and memory storing instructions that when executed by the processors cause the processors to effectuate operations of the above-mentioned process.
- The above-mentioned aspects and other aspects of the present techniques will be better understood when the present application is read in view of the following figures in which like numbers indicate similar or identical elements:
-
FIG. 1 is a schematic view illustrating an application architecture drift detection system, in accordance with some embodiments of the present disclosure; -
FIG. 2 is a schematic view illustrating a client computing device included in the application architecture drift detection system ofFIG. 1 , in accordance with some embodiments of the present disclosure; -
FIG. 3 is a schematic view illustrating an application server computing device included in the application architecture drift detection system ofFIG. 1 , in accordance with some embodiments of the present disclosure; -
FIG. 4 is a schematic view illustrating an architecture management computing device included in the application architecture drift detection system ofFIG. 1 , in accordance with some embodiments of the present disclosure; -
FIG. 5 is a flow chart illustrating a method, in accordance with some embodiments of the present disclosure; -
FIG. 6 is table illustrating an architecture design metric table used during the method ofFIG. 5 , in accordance with some embodiments of the present disclosure; -
FIG. 7 is table illustrating a data metric table used during the method ofFIG. 5 , in accordance with some embodiments of the present disclosure; -
FIG. 8 is a schematic of a computing system, in accordance with some embodiments of the present disclosure. - While the present techniques are susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. The drawings may not be to scale. It should be understood, however, that the drawings and detailed description thereto are not intended to limit the present techniques to the particular form disclosed, but to the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present techniques as defined by the appended claims.
- To mitigate the problems described herein, the inventors had to both invent solutions and, in some cases just as importantly, recognize problems overlooked (or not yet foreseen) by others in the field of computing systems Indeed, the inventors wish to emphasize the difficulty of recognizing those problems that are nascent and will become much more apparent in the future should trends in industry continue as the inventors expect. Further, because multiple problems are addressed, it should be understood that some embodiments are problem-specific, and not all embodiments address every problem with traditional systems described herein or provide every benefit described herein. That said, improvements that solve various permutations of these problems are described below.
- As discussed above, a formal part of the design phase for an application project is to identify an architecture pattern that serves the needs of the application and its user-base. Given the number of changes throughout an application development lifecycle and over the life of an application, many factors can contribute to implementations that do not adhere to the agreed upon architecture pattern.
- Many large organizations have a finite set of architecture pattern options for applications and there is a formalized process followed by application teams when designing applications. For example, in a three-datacenter scenario, designers can choose to have an application instance running actively, passively, or not at all in any of the three datacenters to achieve their application needs. When an application is not adhering to the architecture pattern chosen in the design phase, there is an associated risk which could have a technical, a financial, and/or a reputational impact. For example, the application may crash or may not have the proper redundancy if the architecture pattern chosen in the design phase is not implemented. As a result, the application may not be available to the end users, or the end users may have a less desirable experience when using the application. As such, it is contemplated by the present disclosure that a process needs to be in place to identify what architecture pattern was designed and validate if the application is currently implemented according to the chosen pattern. When an application’s production implementation varies from the designed implementation, an architecture drift may be occurring.
- Systems and method of the present disclosure provide for application architecture drift detection. In various embodiments and during an application development lifecycle, the architecture design metric is agreed, approved, and recorded. The architecture design metric may be any condition and/or configuration for which an application system is designed to include and operate. The architecture design metric may include an architecture status metric, an application version metric, and/or a resource configuration metric. At the end of the application development lifecycle, the application should be implemented in production according to the approved design pattern and architecture status metrics. In one of many possible ways for many reasons, the architecture design pattern is changed. For example, during the application development lifecycle, the application team changes the architecture pattern due to changes in requirements and the new design is not approved. In another example, during production implementation, the changes are made resulting in the production architecture pattern differing from the approved design. In yet another example, during use of the application, changes are made which result in the effective architecture pattern changing.
- Embodiments of the present disclosure may provide an architecture drift detection controller that is running in real-time and determines that the application is running in production with an architecture pattern different from the approved architecture pattern. The architecture drift detection controller may make its determination by obtaining data metrics from an application monitoring application, a version monitoring application, and/or a resource monitoring application. Data metrics may include any data from an application system during its operations, many examples of which are described herein. When the actual architecture pattern is different from the approved architecture pattern, an administrator is notified of the difference or drift. In various embodiments, the administrator may make changes to the production implementation of the application to synchronize the application with the approved architecture pattern. However, in other embodiments, the administrator may update the approved architecture pattern to match that of the actual architecture pattern. By detecting a drift in the architecture pattern, an application version, and/or resource configuration of resources running the application, an administrator may correct the drift before an event occurs, which due to the drift, may cause the application to experience undesirable outcomes that would not have occurred if the production architecture pattern followed the approved architecture pattern. Thus, the systems and methods of the present disclosure reduce application downtime, reduce reputational risk, improve bandwidth for the application, improve user experiences for users that are using the application, and/or other technical benefits that would be apparent to one of skill in the art in possession of the present disclosure.
- Referring now to
FIG. 1 , a block diagram of an application architecturedrift detection system 100, consistent with various embodiments, is illustrated. In various embodiments, the application architecturedrift detection system 100 may include aclient computing device 102, one or more datacenters (e.g., adatacenter 104 a, adatacenter 104 b, and/or adatacenter 104 c) that each include one or more application server computing devices (e.g., an application server computing device 106 a, an application server computing device 106 b, and/or an application server computing device 106 c), and aload balancer 108, and an architecturemanagement computing device 110. Theclient computing device 102, the application server computing devices 106 a, 106 b, and 106 c, theload balancer 108, and the architecturemanagement computing device 110 may be in communication with each other over anetwork 112. While illustrated as being provided between thenetwork 112 and the application server computing devices 106 a-106 c, the server computing devices 106 a-106 c may be coupled to theload balancer 108 via thenetwork 112. - In various embodiments, the
client computing device 102 may be implemented using any appropriate combination of hardware and/or software configured for wired and/or wireless communication over thenetwork 112. For example, theclient computing device 102 may be implemented as a wireless telephone (e.g., smart phone), a tablet, a personal digital assistant (PDA), a notebook computer, a personal computer, a connected set-top box (STB) such as provided by cable or satellite content providers, or a video game system console, a head-mounted display (HIVID), a watch, an eyeglass projection screen, an autonomous/semi-autonomous device, a vehicle, an Unmanned Arial Vehicle (UAV), a robotic device, a user badge, and/or other client computing device that would be apparent to one of skill in the art in possession of the present disclosure. In various embodiments, theclient computing device 102 may include any appropriate combination of hardware and/or software having one or more processors and capable of reading instructions stored on a tangible non-transitory machine-readable medium for execution by the one or more processors. Consistent with some embodiments, theclient computing device 102 includes a machine-readable medium, such as a memory (not shown) that includes instructions for execution by one or more processors (not shown) for causing theclient computing device 102 to perform specific tasks. In some embodiments, the instructions may be executed by the one or more processors in response to interaction by the user. - The
client computing device 102 may include a communication system having one or more transceivers to enable theclient computing device 102 to communicate with other client computing devices, the application server computing devices 106 a-106 c, and/or the architecturemanagement computing device 110. Accordingly, and as disclosed in further detail below, theclient computing device 102 may be in communication with systems directly or indirectly. As used herein, the phrase “in communication,” including variances thereof, encompasses direct communication and/or indirect communication through one or more intermediary components and does not require direct physical (e.g., wired and/or wireless) communication and/or constant communication, but rather additionally includes selective communication at periodic or aperiodic intervals, as well as one-time events. - For example, the
client computing device 102 in the application architecturedrift detection system 100 ofFIG. 1 may include first (e.g., relatively long-range) transceiver(s) to permit the client computing device to communicate with thenetwork 112 via a communication channel. In various embodiments, thenetwork 112 may be implemented as a single network or a combination of multiple networks. For example, in various embodiments, thenetwork 112 may include the Internet and/or one or more intranets, landline networks, wireless networks, and/or other appropriate types of communication networks. In another example, thenetwork 112 may comprise a wireless telecommunications network adapted to communicate with other communication networks, such as the Internet. The wireless telecommunications network may be implemented by an example mobile cellular network, such as a long-term evolution (LTE) network or other third generation (3G), fourth generation (4G) wireless network, fifth generation (5G) wireless network and/or any subsequent generations. However, in some examples, thenetwork 112 may be additionally or alternatively be implemented by one or more other communication networks, such as, but not limited to, a satellite communication network, a microwave radio network, and/or other communication networks. - The
client computing device 102 additionally may include second (e.g., short-range relative to the range of the first transceiver) transceiver(s) to permit theclient computing device 102 to communicate with other client computing devices via a direct communication channel. Such second transceivers may be implemented by a type of transceiver supporting short-range (eg., operate at distances that are shorter than the long-range transceivers) wireless networking. For example, such second transceivers may be implemented by Wi-Fi transceivers (e.g., via a Wi-Fi Direct protocol), Bluetooth® transceivers, infrared (IR) transceiver, and other transceivers that are configured to allow theclient computing device 102 to intercommunicate with other client computing devices via an ad-hoc or other wireless network. - The application architecture
drift detection system 100 also includes or may be in communication with the application server computing devices 106 a, 106 b, and/or 106 c. For example, the application server computing devices 106 a-106 c may include one or more server devices, storage systems, cloud computing systems, and/or other computing devices. In various embodiments, the application server computing devices 106 a-106 c may also include any appropriate combination of hardware and/or software having one or more processors and capable of reading instructions stored on a tangible non-transitory machine-readable medium for execution by the one or more processors. Consistent with some embodiments, the application server computing devices 106 a-106 c include a machine-readable medium, such as a memory (not shown) that includes instructions for execution by one or more processors (not shown) for causing the application server computing devices 106 a-106 c to perform specific tasks. In some embodiments, the instructions may be executed by the one or more processors in response to interaction by the user. The application server computing devices 106 a-106 c may also be maintained by an entity with which sensitive credentials and information may be exchanged with theclient computing device 102. The application server computing devices 106 a-106 c may further be one or more servers that hosts one or more applications for theclient computing device 102. In some embodiments, the server computing devices 106 a-106 c include a redundant application instance of one or more applications. The server computing devices 106 a-106 c may more generally include a web site, an online content manager, a service provider application, and/or other application that provides content and/or services to the user. The server computing devices 106 a-106 c may also be in communication with one or more external databases, that may provide additional information that may be used by the application server computing devices 106 a-106 c. In some embodiments, each application server computing device 106 a, 106 b, 106 c is hosted in arespective datacenter - The application architecture
drift detection system 100 also includes or may be in communication with theload balancer 108. Theload balancer 108 may include one or more front-end server computing devices running a load balancing application. For example, theload balancer 108 may include one or more server devices, storage systems, cloud computing systems, and/or other computing devices. In other examples, theload balancer 108 may include one or more networking devices such as a routing device, a switch device, and/or any other networking device that would be apparent to one of skill in the art in possession of the present disclosure that may be running a load balancing application. In yet other examples, theload balancer 108 may include specialized hardware and/or may include a one or more virtualized instances running on the specialized hardware that is configured to run a load balancing application. The load balancing application may provide one or more load balancing algorithms that disperse network traffic to the application server computing devices 106 a-106 c to ensure that no single server becomes overworked and unreliable, and thus minimizes response time and maximizes throughput. The load balancing algorithms may include a round robin algorithm, a least connection algorithm, a least response time algorithm, a least bandwidth algorithm, a hashing algorithm, a custom algorithm, and/or any other load balancing algorithm that would be apparent to one of skill in the art in possession of the present disclosure. While some examples of aload balancer 108 are disclosed, other load balancers may be contemplated and fall under the scope of the present disclosure as well. - The application architecture
drift detection system 100 also includes or may be in communication with the architecturemanagement computing device 110. For example, the architecturemanagement computing device 110 may include one or more server devices, storage systems, cloud computing systems, and/or other computing devices (e.g., desktop computing device(s), laptop/notebook computing device(s), tablet computing device(s), mobile phone(s), etc. In various embodiments, the architecturemanagement computing device 110 may also include any appropriate combination of hardware and/or software having one or more processors and capable of reading instructions stored on a tangible non-transitory machine-readable medium for execution by the one or more processors. Consistent with some embodiments, the architecturemanagement computing device 110 includes a machine-readable medium, such as a memory (not shown) that includes instructions for execution by one or more processors (not shown) for causing the architecturemanagement computing device 110 to perform specific tasks. In some embodiments, the instructions may be executed by the one or more processors in response to interaction by the user. The architecturemanagement computing device 110 may include management applications used to manage the application architecturedrift detection system 100 including functionality of detecting drift in architecture design metrics such as, for example, an architecture pattern of the application server computing devices 106 a-106 c (eg., application instance status (e.g., passive or active)), an application version for each application instance running on the application server computing devices 106 a-106 c, and/or a resource configuration of the application server computing devices 106 a-106 c. While a specific application architecturedrift detection system 100 is illustrated inFIG. 1 , one of skill in the art in possession of the present disclosure will recognize that other components and configurations are possible, and thus will fall under the scope of the present disclosure. - Referring now to
FIG. 2 , an embodiment of aclient computing device 200 is illustrated that may be theclient computing device 102 discussed above with reference toFIG. 1 In the illustrated embodiment, theclient computing device 200 includes achassis 202 that houses the components of theclient computing device 200. Several of these components are illustrated inFIG. 2 . For example, thechassis 202 may house a processing system (not illustrated) and a non-transitory memory system (not illustrated) that includes instructions that, when executed by the processing system, cause the processing system to provide anapplication engine 204 that is configured to perform the functions of the application engine and/or the client computing devices discussed below. In the specific example illustrated inFIG. 2 , theapplication engine 204 is configured to provide one or more of a web browser application 204 a or anative application 204 b. - The
chassis 202 may further house acommunication system 210 that is coupled to the application engine 204 (e.g., via a coupling between thecommunication system 210 and the processing system). Thecommunication system 210 may include software or instructions that are stored on a computer-readable medium and that allow theclient computing device 200 to send and receive information through the communication networks discussed above. For example, thecommunication system 210 may include a communication interface to provide for communications through thenetwork 112 as detailed above (e.g., first (e.g., long-range) transceiver(s)). In an embodiment, the communication interface may include a wireless antenna that is configured to provide communications with IEEE 802.11 protocols (Wi-Fi), cellular communications, satellite communications, other microwave radio communications and/or communications. Thecommunication system 210 may also include a communication interface (e.g., the second (e.g., short-range) transceiver(s)) that is configured to provide direct communication with other client computing devices, sensors, storage devices, beacons, and other devices included in the securitization system discussed above with respect toFIG. 1 . For example, the communication interface may include a wireless antenna that configured to operate according to wireless protocols such as Bluetooth®, Bluetooth® Low Energy (BLE), near field communication (NFC), infrared data association (IrDA), ANT®, Zigbee®, Z-Wave® IEEE 802.11 protocols (Wi-Fi), and/or other wireless communication protocols that allow for direct communication between devices. - The
chassis 202 may house a storage device (not illustrated) that provides astorage system 216 that is coupled to theapplication engine 204 through the processing system. Thestorage system 216 may be configured to store data, applications, and/or instructions described in further detail below and used to perform the functions described herein. In various embodiments, thechassis 202 also houses a user Input/Output (I/O) system 218 that is coupled to the application engine 204 (e.g., via a coupling between the processing system and the user I/O system 218). In an embodiment, the user I/O system 218 may be provided by a keyboard input subsystem, a mouse input subsystem, a track pad input subsystem, a touch input display subsystem, a microphone, an audio system, a haptic feedback system, and/or any other input subsystem. Thechassis 202 also houses adisplay system 220 that is coupled to the application engine 204 (e.g., via a coupling between the processing system and the display system 220) and may be included in the user I/O system 218. In an embodiment, thedisplay system 220 may be provided by a display device that is integrated into theclient computing device 200 and that includes a display screen (e.g., a display screen on a laptop/notebook computing device, a tablet computing device, a mobile phone, or wearable device), or by a display device that is coupled directly to the client computing device 200 (e.g., a display device coupled to a desktop computing device by a cabled or wireless connection). However, while aclient computing device 200 and several embodiments of its operation are illustrated and described herein, one of skill in the art in possession of the present disclosure will recognize that client computing devices may include a variety of components and component configuration and may operate in a variety of manners that will fall within the scope of the present disclosure as well. - Referring now to
FIG. 3 , an embodiment of an applicationserver computing device 300 is illustrated that may be any of application server computing devices 106 a-106 c discussed above with reference toFIG. 1 . In the illustrated embodiment, the applicationserver computing device 300 includes achassis 302 that houses the components of the applicationserver computing device 300, only some of which are illustrated inFIG. 3 . For example, thechassis 302 may house a processing system (not illustrated) and a non-transitory memory system (not illustrated) that includes instructions that, when executed by the processing system, cause the processing system to provide anapplication management engine 304 that is configured to perform the functions of the application management engines and/or application server computing devices discussed below. Theapplication management engine 304 may include one or more applications instances (e.g. anapplication instance 304 a for a first application and anapplication instance 304 b for a second application) that are hosted by applicationserver computing device 300 and provided to theclient computing device 102/200 ofFIGS. 1 and 2 via thenetwork 112 such that theclient computing device 102/200 may access the application instances via the web browser application 204 a or thenative application 204 b. In various embodiments, theapplication management engine 304 may include an applicationmetric engine 304 c that is configured to perform the functions of the application metric engines and/or application server computing devices discussed below such as, for example, monitoring the application instances, server computing device resources and/or components, and/or other architecture components and obtain data metrics for those architecture components. - The
chassis 302 may further house acommunication system 306 that is coupled to the application management engine 304 (e.g., via a coupling between thecommunication system 306 and the processing system) and that is configured to provide for communication through thenetwork 112 ofFIG. 1 as detailed below. Thecommunication system 306 may allow the applicationserver computing device 300 to send and receive information over thenetwork 112 ofFIG. 1 . Thechassis 302 may also house a storage device (not illustrated) that provides astorage system 308 that is coupled to theapplication management engine 304 through the processing system. Thestorage system 308 may be configured to store data and/or instructions to complete the functionality discussed herein. In various embodiments, thestorage system 308 may be provided on the applicationserver computing device 300 and/or on a database accessible via thecommunication system 306. However, while an applicationserver computing device 300 and several embodiments of its operation are illustrated and described herein, one of skill in the art in possession of the present disclosure will recognize that application server computing devices may include a variety of components and component configuration and may operate in a variety of manners that will fall within the scope of the present disclosure as well. - Referring now to
FIG. 4 , an embodiment of an architecturemanagement computing device 400 is illustrated that may be an architecturemanagement computing device 110 discussed above with reference toFIG. 1 . In the illustrated embodiment, the architecturemanagement computing device 400 includes achassis 402 that houses the components of the architecturemanagement computing device 400, only some of which are illustrated inFIG. 4 . For example, thechassis 402 may house a processing system (not illustrated) and a non-transitory memory system (not illustrated) that includes instructions that, when executed by the processing system, cause the processing system to provide an architecturedrift detection controller 404 that is configured to perform the functions of the architecture drift detection controller and/or architecture management computing device discussed below. - The
chassis 402 may further house acommunication system 406 that is coupled to the architecture drift detection controller 404 (e.g., via a coupling between thecommunication system 406 and the processing system) and that is configured to provide for communication through thenetwork 112 ofFIG. 1 as detailed below. Thecommunication system 406 may allow the architecturemanagement computing device 400 to send and receive information over thenetwork 112 ofFIG. 1 . Thechassis 402 may also house a storage device (not illustrated) that provides astorage system 408 that is coupled to the architecturedrift detection controller 404 through the processing system. Thestorage system 408 may be configured to store data and/or instructions to complete the functionality discussed herein. For example, thestorage system 408 may storearchitecture design metrics 408 a anddata metrics 408 b that are received from the application server computing devices 106 a-106 c/300 ofFIGS. 1 and 3 and/or theload balancer 108. In various embodiments, thestorage system 408 may be provided on the architecturemanagement computing device 400 and/or on a database accessible via thecommunication system 406. However, while an architecturemanagement computing device 400 and several embodiments of its operation are illustrated and described herein, one of skill in the art in possession of the present disclosure will recognize that architecture management computing devices may include a variety of components and component configuration and may operate in a variety of manners that will fall within the scope of the present disclosure as well. - Referring now to
FIG. 5 , amethod 500 for providing application architecture drift detection is illustrated. Themethod 500 may begin atblock 502 where one or more sets of architecture design metrics associated with one or more applications, respectively, are obtained. In an embodiment, atblock 502 and with reference toFIGS. 1, 3 and 4 , the architecturedrift detection controller 404 of the architecturemanagement computing device 110/400 may obtain an architecture design metric 408 a for the first application that is associated with theapplication instance 304 a In various embodiments, the architecturedrift detection controller 404 of the architecturemanagement computing device 110/400 may obtain another architecture design metric 408 a for a second application that is associated with theapplication instance 304 b. For example, system administrator may generate and/or load thearchitecture design metrics 408 a for a first application and/or a second application via a management terminal coupled with the architecturemanagement computing device 110/400. In some embodiments, the management terminal may include theclient computing device 102/200. - As discussed above, the architecture design metric 408 a may include a desired architecture for a deployed application. In various embodiments, the architecture design metric 408 a for the first application may include an architecture status metric, an application version metric, and/or a resource configuration metric. For example, the architecture status metric may include an application instance status pattern for application instances for an application. The application version metric may indicate an application version for an application. The resource configuration metric may include a resource configuration for an application server computing device 106a-106b/300 hosting the application or other components in the datacenters 104 a-104 c (e.g., networking resources, storage resources, and/or other resources that would be apparent to one of skill in the art in possession of the present disclosure). For example, the resource configuration may indicate the amount of processing resources, bandwidth, memory resources, storages resources, and/or or other resources required to host an application instance of an application that would be apparent to one of skill in the art in possession of the present disclosure.
- Referring now to
FIG. 6 an example of an architecture design metric table 600 that includes an architecture design metric 602 a for the application (e.g., “Application 1”) associated with theapplication instance 304 a forFIG. 3 and anarchitecture design metric 602 b for the application (e.g., “Application 2”) associated with theapplication instance 304 b is illustrated. In the illustrated example, thearchitecture design metrics architecture status metrics - The
architecture status metrics 604 a may include an applicationinstance status pattern 606 a that identifies the desired status for a combination of theapplication instances 304 a in the application server computing devices 106 a, 106 b, and 106 c and/ordatacenters instance status pattern 606 a indicates, for “Application 1” that is associated with theapplication instances 304 a, one of the application server computing devices 106 a-106 c or one of the datacenters 104 a-104 c should have an active application instance status, and two of the application server computing devices 106 a-106 c or two of the datacenters 104 a-104 c should have a passive application instance status. In some embodiments, thearchitecture status metrics 604 a may include a specific applicationinstance status pattern 608 a that identifies the desired status for each of theapplication instances 304 a in the application server computing devices 106 a, 106 b, and 106 c and/ordatacenters instance status pattern 608 a indicates, for “Application 1” that is associated with theapplication instances 304 a, the application server computing device 106 a or thedatacenter 104 a should have an active application instance status and the application server computing devices 106 b and 106 c or thedatacenters - Similarly, the
architecture status metrics 604 b may include an applicationinstance status pattern 606 b that identifies the desired status for a combination of theapplication instances 304 b in the application server computing devices 106 a, 106 b, and 106 c and/ordatacenters instance status pattern 606 b indicates, for “Application 2” that is associated with theapplication instances 304 b, two of the application server computing devices 106 a-106 c or two of the datacenters 104 a-104 c should have an active application instance status, and one of the application server computing devices 106 a-106 c or one of the datacenters 104 a-104 c should have a passive application instance status. In some embodiments, thearchitecture status metrics 604 b may include a specific applicationinstance status pattern 608 b that identifies the desired status for each of theapplication instances 304 a in the application server computing devices 106 a, 106 b, and 106 c and/ordatacenters instance status pattern 608 b indicates, for “Application 2” that is associated with theapplication instances 304 a, the application server computing devices 106 a and 106 b or thedatacenters datacenter 104 c should have a passive application instance status. - In various embodiments, an active application status may indicate an application instance is deployed and serving application requests. A passive application instance status may indicate an application instance is deployed but not serving application requests. Other application instance statuses may include a deployed application instance status that indicates that the application instance is deployed but not running, and/or a not deployed application instance status that indicates that the application instance is not deployed at an application server computing device or a datacenter. While several application instance statuses are described other application instance statuses may be contemplated by one of skill in the art in possession of the present disclosure and fall within the scope of the present disclosure.
- Referring back to
FIG. 5 , themethod 500 may proceed to block 504 where a set of data metrics associated with each application instance for an application is obtained. In an embodiment, atblock 504, the architecturedrift detection controller 404 included on themanagement computing device 400 may obtain, via thenetwork 112, a set of data metrics from the application server computing device 106 a for theapplication instance 304 a, a set of data metrics from the application server computing device 106 b for theapplication instance 304 a, a set of data metrics from the application server computing device 106 c for theapplication instance 304 a, a set of data metrics from the application server computing device 106 a for theapplication instance 304 b, a set of data metrics from the application server computing device 106 b for theapplication instance 304 b, and/or a set of data metrics from the application server computing device 106 c for theapplication instance 304 b. - In various embodiments, the application
metric engine 304 c may generate or detect the various data metrics. The data metrics may include application instance identifiers, application server computing device identifiers, and/or datacenter identifiers. For example, application licensing number, serial numbers, Media Access Control (MAC) addresses, and/or any other identifier may be included in the data metrics used to identify the application instance, the application server computing device running the application instance, or the datacenter in which the application server computing device is housed. Furthermore, the data metrics may include a deployment status, a number of calls for a given time period, business metrics (e.g., transactions volume, messages/sec, and the like), performance metrics (e.g., bandwidth, time to complete an application call), an application version, a resource configuration of hardware resources included on the application server computing devices 106 a-106 c and/or the datacenters 104 a-104 c, resource usage data, and/or any other data metric that would be apparent to one of skill in the art in possession of the present disclosure. As such, the applicationmetric engine 304 c may include any resource monitoring application and/or application monitoring application that would be apparent to one of skill in the art in possession of the present disclosure. For example, the applicationmetric engine 304 c may include AppDynamics provided by CISCO® headquartered in San Jose, California, United States. In other examples, the applicationmetric engine 304 may include Prometheus, Cloudprober, and/or Foglight provided by QUEST® headquartered in Aliso Viejo, California, United States. - In other embodiments, the architecture
drift detection controller 404 may obtain, via thenetwork 112, a set of data metrics for any of the application server computing devices 106 a-106 c for any of theapplication instances 304 a and/or 304 b from theload balancer 108 that may include an application metric engine that may be similar to the applicationmetric engine 304 c of the application server computing devices 106 a-106 c. The data metrics, when obtained by the architecturedrift detection controller 404, may be stored in thestorage system 408 asdata metrics 408 b. - The
method 500 may then proceed to decision block 506 where it is determined whether the sets of data metrics satisfy or deviate from one or more architecture design metrics included in the set of architecture design metrics. In an embodiment, atdecision block 506, the architecturedrift detection controller 404 included on the architecturemanagement computing device 110/400 may compare thedata metrics 408 b to thearchitecture design metrics 408 a and/or make determinations from thedata metrics 408 b that are then compared to thearchitecture design metrics 408 a. For example, the data metrics that include an application version may be compared to an application version included in the architecture design metrics. In other examples, the data metrics that include resource usage (e.g., number of CPUs used by an application instance) be compared to a resource usage included in the architecture design metrics. In another example, thedata metrics 408 b may include a deployment metric for an application instance included on each of the application server computing devices 106 a-106 c that indicates whether an application instance is deployed or not at an application server computing device. The deployment metric, in combination with other data metrics, may be used in determining whether an application instance includes an active status, a passive status, a deployed status, or a not deployed status. Also, an application call metric included in thedata metrics 408 b may indicate whether an application is serving requests or not serving requests. The application call metric in combination with the deployment metric may be used in determining whether an application instance includes the active status, the passive status, the deployed status, or the not deployed status. As such, a determination from both the deployment metric and the application call metric may be used to determine an application instance status. The architecturedrift detection controller 404 may then use that application instance status derived from thedata metrics 408 b to compare to thearchitecture design metrics 408 a to determine whether the data metrics satisfy or deviate from one or more architecture design metrics. As such, the architecturedrift detection controller 404 included on the architecturemanagement computing device 110/400 may determine whether any of theapplication instances 304 a and/or 304 b on the application server computing device 106 a-106 c and/or the application server computing devices 106 a-106 c themselves satisfy architecture design metrics or deviate from any of the architecture design metrics. - Referring now to
FIG. 7 an example of a data metric table 700 that includes an actual data metric 702 a for the application (e.g., “Application 1”) associated with theapplication instance 304 a forFIG. 3 and an actual data metric 702 b for the application (e.g., “Application 2”) associated with theapplication instance 304 b is illustrated. The data metric table 700 may be created using the data metrics received for “Application 1” and “Application 2.” In the illustrated example, theactual data metrics architecture status metrics - The
architecture status metrics 704 a may include a specific applicationinstance status pattern 708 a that identifies the actual status for each of theapplication instances 304 a in the application server computing devices 106 a, 106 b, and 106 c and/or thedatacenters instance status pattern 708 a indicates, for “Application 1” that is associated with theapplication instances 304 a, the application server computing device 106 a or thedatacenter 104 a has an active application instance status, the application server computing device 106 b or thedatacenter 104 b has an active application instance status, and the application server computing device 106 c or thedatacenters 104 c has a passive application instance status. - Similarly, the
architecture status metrics 704 b may include a specific applicationinstance status pattern 708 b that identifies the actual status for each of theapplication instances 304 b in the application server computing devices 106 a, 106 b, and 106 c and/ordatacenters instance status pattern 708 b indicates, for “Application 2” that is associated with theapplication instances 304 b, the application server computing device 106 a or thedatacenter 104 a has an active application instance status, the application server computing device 106 b or thedatacenter 104 b has an active application instance status, and the application server computing device 106 c or thedatacenters 104 c has a passive application instance status. - As such, in the illustrated example in
FIG. 7 , the architecturedrift detection controller 404 may determine by comparing the data metric table 700 to the architecture design metric table 600 ofFIG. 6 that the “Application 1” deviates from the applicationinstance status pattern 606 a (e.g., 1 active and 2 passive) and/or the specific applicationinstance status pattern 608 a (e.g.,datacenter 104 a is “active,”datacenter 104 b is “passive,” anddatacenter 104 c is “passive.”). Similarly, the architecturedrift detection controller 404 may determine by comparing the data metric table 700 to the architecture design metric table 600 that the “Application 2” satisfies the applicationinstance status pattern 606 b (e.g., 2 active and 1 passive) and/or the specificapplication status pattern 708 b. - In some embodiments at
decision block 506, whether the data metrics deviates from the architecture design metrics may include a single architecture design metric deviating from a proposed design metric. However, in other embodiments, a threshold number of architecture design metrics may be required before the deviation determination is made. In yet other embodiments, the deviation determination may be made based on a weight given to various architecture design metrics such that when a combined weight of deviations exceeds a weight threshold, the deviation classification may be justified. In various embodiments, thedesign metrics 408 b may be received at various intervals (e.g., once per day, once per hour, once per 5 minutes, once per minute, or any other interval). As such the determination made atblock 506 may occur at the same or different intervals. - If at
decision block 506 it is determined that the data metrics satisfy the architecture design metrics, themethod 500 may return back to block 504 where additional data metrics are obtained. However, in some embodiments, the architecturedrift detection controller 404 included on the architecturemanagement computing device 110/400 may generate and provide a compliance notification to a system administrator indicating the satisfaction of the one or more architecture design metrics by the data metrics For example, an indicator light included at themanagement 110/400 may be activated, a E-mail may be sent to the system administrator’s email address indicating the satisfaction, a Graphical User Interface (GUI) may be presented on a display screen of a terminal device coupled to the architecturemanagement computing device 110/400, a log file may be generated and stored in thestorage system 408, an audio indication may be outputted via an audio system coupled to the architecturemanagement computing device 110/400, a data object may be updated, and/or any other compliance notification may be provided as would be apparent to one of skill in the art of the present disclosure. - If at
decision block 506 it is determined that the data metrics deviate or in other words do not satisfy the architecture design metrics, themethod 500 may proceed to block 508 where a deviation notification indicating the deviation from the one or more architecture design metrics is provided. In various embodiments, the architecturedrift detection controller 404 included on the architecturemanagement computing device 110/400 may generate and provide a deviation notification to a system administrator indicating the satisfaction of the one or more architecture design metrics by the data metrics. For example, an indicator light included at themanagement 110/400 may be activated that indicates a deviation, an E-mail may be sent to the system administrator’s email address indicating the deviation, a Graphical User Interface (GUI) may be presented on a display screen of a terminal device coupled to the architecturemanagement computing device 110/400 that displays a deviation warning, a log file or other data object may be generated and stored in thestorage system 408 that indicates the deviation, an audio indication may be outputted via an audio system that indicates the deviation, and/or any other deviation notification may be provided that would be apparent to one of skill in the art of the present disclosure. - With knowledge of the deviation between the
architecture design metrics 408 a and thedata metrics 408 b, the administrator may update one or more of theapplication instances architecture design metrics 408 a such that thearchitecture design metrics 408 a match metrics what is deployed on the application server computing device 106 a-106 c. -
FIG. 8 is a diagram that illustrates anexemplary computing system 800 in accordance with embodiments of the present technique. Various portions of systems and methods described herein, may include or be executed on one or more computing systems similar tocomputing system 800. Further, processes and modules described herein may be executed by one or more processing systems similar to that ofcomputing system 800. In various embodiments, theclient computing device 102/200, the application server computing devices 106 a-106 c/300, theload balancer 108, and/or thearchitecture computing device 110/400 may be provided by thecomputing system 800. -
Computing system 800 may include one or more processors (e.g., processors 810 a-1010 n) coupled tosystem memory 820, an input/output I/O device interface 830, and anetwork interface 840 via an input/output (I/O)interface 850. A processor may include a single processor or a plurality of processors (e.g., distributed processors). A processor may be any suitable processor capable of executing or otherwise performing instructions. A processor may include a central processing unit (CPU) that carries out program instructions to perform the arithmetical, logical, and input/output operations ofcomputing system 800. A processor may execute code (e.g., processor firmware, a protocol stack, a database management system, an operating system, or a combination thereof) that creates an execution environment for program instructions. A processor may include a programmable processor. A processor may include general or special purpose microprocessors. A processor may receive instructions and data from a memory (e.g., system memory 820).Computing system 800 may be a uni-processor system including one processor (e.g.,processor 810 a), or a multi-processor system including any number of suitable processors (e.g., 810 a-1010 n). Multiple processors may be employed to provide for parallel or sequential execution of one or more portions of the techniques described herein. Processes, such as logic flows, described herein may be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating corresponding output. Processes described herein may be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).Computing system 800 may include a plurality of computing devices (e.g., distributed computing systems) to implement various processing functions. - I/
O device interface 830 may provide an interface for connection of one or more I/O devices 860 tocomputing system 800. I/O devices may include devices that receive input (e.g., from a user) or output information (e.g., to a user). I/O devices 860 may include, for example, graphical user interface presented on displays (e.g., a cathode ray tube (CRT) or liquid crystal display (LCD) monitor), pointing devices (e.g., a computer mouse or trackball), keyboards, keypads, touchpads, scanning devices, voice recognition devices, gesture recognition devices, printers, audio speakers, microphones, cameras, or the like. I/O devices 860 may be connected tocomputing system 800 through a wired or wireless connection. I/O devices 860 may be connected tocomputing system 800 from a remote location. I/O devices 860 located on remote computing system, for example, may be connected tocomputing system 800 via a network andnetwork interface 840. -
Network interface 840 may include a network adapter that provides for connection ofcomputing system 800 to a network.Network interface 840 may facilitate data exchange betweencomputing system 800 and other devices connected to the network.Network interface 840 may support wired or wireless communication. The network may include an electronic communication network, such as the Internet, a local area network (LAN), a wide area network (WAN), a cellular communications network, or the like. -
System memory 820 may be configured to storeprogram instructions 801 ordata 802.Program instructions 801 may be executable by a processor (e.g., one or more of processors 810 a-810 n) to implement one or more embodiments of the present techniques.Instructions 801 may include modules of computer program instructions for implementing one or more techniques described herein with regard to various processing modules. Program instructions may include a computer program (which in certain forms is known as a program, software, software application, script, or code). A computer program may be written in a programming language, including compiled or interpreted languages, or declarative or procedural languages. A computer program may include a unit suitable for use in a computing environment, including as a stand-alone program, a module, a component, or a subroutine. A computer program may or may not correspond to a file in a file system. A program may be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub programs, or portions of code). A computer program may be deployed to be executed on one or more computer processors located locally at one site or distributed across multiple remote sites and interconnected by a communication network. -
System memory 820 may include a tangible program carrier having program instructions stored thereon. A tangible program carrier may include a non-transitory computer readable storage medium. A non-transitory computer readable storage medium may include a machine readable storage device, a machine readable storage substrate, a memory device, or any combination thereof. Non-transitory computer readable storage medium may include non-volatile memory (e.g., flash memory, ROM, PROM, EPROM, EEPROM memory), volatile memory (e.g., random access memory (RAM), static random access memory (SRAM), synchronous dynamic RAM (SDRAM)), bulk storage memory (e.g., CD-ROM and/or DVD-ROM, hard-drives), or the like.System memory 820 may include a non-transitory computer readable storage medium that may have program instructions stored thereon that are executable by a computer processor (e.g., one or more of processors 810 a-810 n) to cause the subject matter and the functional operations described herein. A memory (e.g., system memory 820) may include a single memory device and/or a plurality of memory devices (e.g, distributed memory devices). Instructions or other program code to provide the functionality described herein may be stored on a tangible, non-transitory computer readable media. In some cases, the entire set of instructions may be stored concurrently on the media, or in some cases, different parts of the instructions may be stored on the same media at different times. - I/
O interface 850 may be configured to coordinate I/O traffic between processors 810 a-810 n,system memory 820,network interface 840, I/O devices 860, and/or other peripheral devices. I/O interface 850 may perform protocol, timing, or other data transformations to convert data signals from one component (e.g., system memory 820) into a format suitable for use by another component (e.g., processors 810 a-810 n). I/O interface 850 may include support for devices attached through various types of peripheral buses, such as a variant of the Peripheral Component Interconnect (PCI) bus standard or the Universal Serial Bus (USB) standard. - Embodiments of the techniques described herein may be implemented using a single instance of
computing system 800 ormultiple computing systems 800 configured to host different portions or instances of embodimentsMultiple computing systems 800 may provide for parallel or sequential processing/execution of one or more portions of the techniques described herein. - Those skilled in the art will appreciate that
computing system 800 is merely illustrative and is not intended to limit the scope of the techniques described herein.Computing system 800 may include any combination of devices or software that may perform or otherwise provide for the performance of the techniques described herein. For example,computing system 800 may include or be a combination of a cloud-computing system, a data center, a server rack, a server, a virtual server, a desktop computer, a laptop computer, a tablet computer, a server device, a client device, a mobile telephone, a personal digital assistant (PDA), a mobile audio or video player, a game console, a vehicle-mounted computer, or a Global Positioning System (GPS), or the like.Computing system 800 may also be connected to other devices that are not illustrated or may operate as a stand-alone system. In addition, the functionality provided by the illustrated components may in some embodiments be combined in fewer components or distributed in additional components. Similarly, in some embodiments, the functionality of some of the illustrated components may not be provided or other additional functionality may be available. - Those skilled in the art will also appreciate that while various items are illustrated as being stored in memory or on storage while being used, these items or portions of them may be transferred between memory and other storage devices for purposes of memory management and data integrity. Alternatively, in other embodiments some or all of the software components may execute in memory on another device and communicate with the illustrated computing system via inter-computer communication. Some or all of the system components or data structures may also be stored (e.g., as instructions or structured data) on a computer-accessible medium or a portable article to be read by an appropriate drive, various examples of which are described above. In some embodiments, instructions stored on a computer-accessible medium separate from
computing system 800 may be transmitted tocomputing system 800 via transmission media or signals such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as a network or a wireless link. Various embodiments may further include receiving, sending, or storing instructions or data implemented in accordance with the foregoing description upon a computer-accessible medium Accordingly, the present techniques may be practiced with other computing system configurations. - In block diagrams, illustrated components are depicted as discrete functional blocks, but embodiments are not limited to systems in which the functionality described herein is organized as illustrated. The functionality provided by each of the components may be provided by software or hardware modules that are differently organized than is presently depicted, for example such software or hardware may be intermingled, conjoined, replicated, broken up, distributed (e.g. within a data center or geographically), or otherwise differently organized. The functionality described herein may be provided by one or more processors of one or more computers executing code stored on a tangible, non-transitory, machine readable medium. In some cases, notwithstanding use of the singular term “medium,” the instructions may be distributed on different storage devices associated with different computing devices, for instance, with each computing device having a different subset of the instructions, an implementation consistent with usage of the singular term “medium” herein. In some cases, third party content delivery networks may host some or all of the information conveyed over networks, in which case, to the extent information (e.g., content) is said to be supplied or otherwise provided, the information may be provided by sending instructions to retrieve that information from a content delivery network.
- The reader should appreciate that the present application describes several independently useful techniques. Rather than separating those techniques into multiple isolated patent applications, the applicant has grouped these techniques into a single document because their related subject matter lends itself to economies in the application process. But the distinct advantages and aspects of such techniques should not be conflated. In some cases, embodiments address all of the deficiencies noted herein, but it should be understood that the techniques are independently useful, and some embodiments address only a subset of such problems or offer other, unmentioned benefits that will be apparent to those of skill in the art reviewing the present disclosure. Due to costs constraints, some techniques disclosed herein may not be presently claimed and may be claimed in later filings, such as continuation applications or by amending the present claims. Similarly, due to space constraints, neither the Abstract nor the Summary of the Invention sections of the present document should be taken as containing a comprehensive listing of all such techniques or all aspects of such techniques.
- It should be understood that the description and the drawings are not intended to limit the present techniques to the particular form disclosed, but to the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present techniques as defined by the appended claims. Further modifications and alternative embodiments of various aspects of the techniques will be apparent to those skilled in the art in view of this description. Accordingly, this description and the drawings are to be construed as illustrative only and are for the purpose of teaching those skilled in the art the general manner of carrying out the present techniques. It is to be understood that the forms of the present techniques shown and described herein are to be taken as examples of embodiments. Elements and materials may be substituted for those illustrated and described herein, parts and processes may be reversed or omitted, and certain features of the present techniques may be utilized independently, all as would be apparent to one skilled in the art after having the benefit of this description of the present techniques. Changes may be made in the elements described herein without departing from the spirit and scope of the present techniques as described in the following claims. Headings used herein are for organizational purposes only and are not meant to be used to limit the scope of the description.
- As used throughout this application, the word “may” is used in a permissive sense (i.e., meaning having the potential to), rather than the mandatory sense (i.e., meaning must). The words “include”, “including”, and “includes” and the like mean including, but not limited to. As used throughout this application, the singular forms “a,” “an,” and “the” include plural referents unless the content explicitly indicates otherwise. Thus, for example, reference to “an element” or “a element” includes a combination of two or more elements, notwithstanding use of other terms and phrases for one or more elements, such as “one or more.” The term “or” is, unless indicated otherwise, non-exclusive, i.e., encompassing both “and” and “or.” Terms describing conditional relationships, e.g., “in response to X, Y,” “upon X, Y,”, “if X, Y,” “when X, Y,” and the like, encompass causal relationships in which the antecedent is a necessary causal condition, the antecedent is a sufficient causal condition, or the antecedent is a contributory causal condition of the consequent, e.g., “state X occurs upon condition Y obtaining” is generic to “X occurs solely upon Y” and “X occurs upon Y and Z.” Such conditional relationships are not limited to consequences that instantly follow the antecedent obtaining, as some consequences may be delayed, and in conditional statements, antecedents are connected to their consequents, e.g, the antecedent is relevant to the likelihood of the consequent occurring. Statements in which a plurality of attributes or functions are mapped to a plurality of objects (e.g., one or more processors performing steps A, B, C, and D) encompasses both all such attributes or functions being mapped to all such objects and subsets of the attributes or functions being mapped to subsets of the attributes or functions (e.g., both all processors each performing steps A-D, and a case in which
processor 1 performs step A,processor 2 performs step B and part of step C, and processor 3 performs part of step C and step D), unless otherwise indicated. Similarly, reference to “a computing system” performing step A and “the computing system” performing step B can include the same computing device within the computing system performing both steps or different computing devices within the computing system performing steps A and B. Further, unless otherwise indicated, statements that one value or action is “based on” another condition or value encompass both instances in which the condition or value is the sole factor and instances in which the condition or value is one factor among a plurality of factors. Unless otherwise indicated, statements that “each” instance of some collection have some property should not be read to exclude cases where some otherwise identical or similar members of a larger collection do not have the property, i.e., each does not necessarily mean each and every Limitations as to sequence of recited steps should not be read into the claims unless explicitly specified, e.g., with explicit language like “after performing X, performing Y,” in contrast to statements that might be improperly argued to imply sequence limitations, like “performing X on items, performing Y on the X′ed items,” used for purposes of making claims more readable rather than specifying sequence. Statements referring to “at least Z of A, B, and C,” and the like (e.g., “at least Z of A, B, or C”), refer to at least Z of the listed categories (A, B, and C) and do not require at least Z units in each category. Unless specifically stated otherwise, as apparent from the discussion, it is appreciated that throughout this specification discussions utilizing terms such as “processing,” “computing,” “calculating,” “determining” or the like refer to actions or processes of a specific apparatus, such as a special purpose computer or a similar special purpose electronic processing/computing device. Features described with reference to geometric constructs, like “parallel,” “perpendicular/orthogonal,” “square”, “cylindrical,” and the like, should be construed as encompassing items that substantially embody the properties of the geometric construct, e.g., reference to “parallel” surfaces encompasses substantially parallel surfaces. The permitted range of deviation from Platonic ideals of these geometric constructs is to be determined with reference to ranges in the specification, and where such ranges are not stated, with reference to industry norms in the field of use, and where such ranges are not defined, with reference to industry norms in the field of manufacturing of the designated feature, and where such ranges are not defined, features substantially embodying a geometric construct should be construed to include those features within 15% of the defining attributes of that geometric construct. The terms “first”, “second”, “third,” “given” and so on, if used in the claims, are used to distinguish or otherwise identify, and not to show a sequential or numerical limitation. As is the case in ordinary usage in the field, data structures and formats described with reference to uses salient to a human need not be presented in a human-intelligible format to constitute the described data structure or format, e.g., text need not be rendered or even encoded in Unicode or ASCII to constitute text; images, maps, and data-visualizations need not be displayed or decoded to constitute images, maps, and data-visualizations, respectively, speech, music, and other audio need not be emitted through a speaker or decoded to constitute speech, music, or other audio, respectively. Computer implemented instructions, commands, and the like are not limited to executable code and can be implemented in the form of data that causes functionality to be invoked, e.g., in the form of arguments of a function or API call. To the extent bespoke noun phrases (and other coined terms) are used in the claims and lack a self-evident construction, the definition of such phrases may be recited in the claim itself, in which case, the use of such bespoke noun phrases should not be taken as invitation to impart additional limitations by looking to the specification or extrinsic evidence. - In this patent, to the extent any U.S. patents, U.S. patent applications, or other materials (e.g., articles) have been incorporated by reference, the text of such materials is only incorporated by reference to the extent that no conflict exists between such material and the statements and drawings set forth herein. In the event of such conflict, the text of the present document governs, and terms in this document should not be given a narrower reading in virtue of the way in which those terms are used in other materials incorporated by reference.
- The present techniques will be better understood with reference to the following enumerated embodiments:
- 1. A non-transitory, machine-readable medium storing instructions that, when executed by one or more processors, effectuate operations comprising: obtaining, by a computing system via a network, a first set of architecture design metrics associated with a first application; obtaining, by the computing system via the network, a first set of data metrics associated with a first instance of the first application that is installed at a first server computing system; obtaining, by the computing system via the network, a second set of data metrics associated with a second instance of the first application that is installed at a second server computing system; determining, by the computing system and using the first set of data metrics and the second set of data metrics, that at least one of the first instance, the first server computing system, the second instance, or the second server computing system deviates from one or more architecture design metrics from the first set of architecture design metrics associated with the first application; and providing, by the computing system, a deviation notification indicating a deviation from the one or more architecture design metrics.
- 2. The non-transitory, machine-readable medium of
claim 1, wherein the first server computing system is provided at a first datacenter, and the second server computing system is provided at a second datacenter. - 3. The non-transitory, machine-readable medium of
claim 1, wherein the operations further comprise: obtaining, by the computing system via the network, a second set of architecture design metrics associated with a second application; obtaining, by the computing system via the network, a third set of data metrics associated with a first instance of the second application that is installed at a third server computing system; obtaining, by the computing system via the network, a fourth set of data metrics associated with a second instance of the second application that is installed at a fourth server computing system; determining, by the computing system and using the third set of data metrics and the fourth set of data metrics, that at least one of the first instance of the second application, the third server computing system, the second instance of the second application, or the fourth server computing system satisfies the second set of architecture design metrics associated with the second application; and providing, by the computing system, a compliance notification indicating a satisfaction of the second set of architecture design metrics. - 4. The non-transitory, machine-readable medium of
claim 1, wherein the first set of architecture design metrics include at least one of an architecture status metric, an application version metric, or a resource configuration metric. - 5 The non-transitory, machine-readable medium of
claim 1, wherein the first set of architecture design metrics includes at least one architecture status metric indicating an active-passive status for the first instance of the first application and the second instance of the first application, and wherein the first set of data metrics and the second set of data metrics indicates an active-active status or a passive-passive status for the first instance of the first application and the second instance of the first application. - 6 The non-transitory, machine-readable medium of
claim 1, wherein the first set of architecture design metrics includes an application version metric indicating a first application version for the first application, and wherein the first set of data metrics and the second set of data metrics indicates that at least one of the first instance or the second instance includes a second application version for the first application that is different than the first application version. - 7. The non-transitory, machine-readable medium of
claim 1, wherein the first set of architecture design metrics includes a resource configuration metric indicating a first resource configuration for a server computing device, and wherein at least one of the first set of data metrics or the second set of data metrics indicates that at least one of the first server computing system or the second server computing system includes a second resource configuration that is different than the first resource configuration - 8. A tangible, non-transitory, machine-readable medium storing instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations comprising: the operations of any one of embodiments 1-7.
- 9. A system, comprising: one or more processors; and memory storing instructions that when executed by the processors cause the processors to effectuate operations comprising: the operations of any one of embodiments 1-7.
Claims (23)
1. A non-transitory, machine-readable medium storing instructions that, when executed by one or more processors, effectuate operations comprising:
obtaining, by a computing system via a network, an application instance pattern that indicates a first architecture status metric associated with a first instance of a first application and a second architecture status metric associated with a second instance of the first application, wherein the application instance pattern is defined prior to the first instance and the second instance of the first application being deployed;
obtaining, by the computing system via the network, a first set of data metrics associated with the first instance of the first application that is installed at a first server computing system;
obtaining, by the computing system via the network, a second set of data metrics associated with the second instance of the first application that is installed at a second server computing system;
determining, by the computing system and using the first set of data metrics and the second set of data metrics, that at least one of the first instance, the first server computing system, the second instance, or the second server computing system deviates from the application instance pattern, including determining that the first set of data metrics deviates from the first architecture status metric or determining that the second set of data metrics deviates from the second architecture status metric; and
providing, by the computing system, a deviation notification indicating a deviation from the application instance pattern.
2. The non-transitory, machine-readable medium of claim 1 , wherein the first server computing system is provided at a first datacenter, and the second server computing system is provided at a second datacenter.
3. The non-transitory, machine-readable medium of claim 1 , wherein the operations further comprise:
obtaining, by the computing system via the network, a second application instance pattern that indicates a third architecture status metric associated with a first instance of a second application and a fourth architecture status metric associated with a second instance of the second application;
obtaining, by the computing system via the network, a third set of data metrics associated with the first instance of the second application that is installed at a third server computing system;
obtaining, by the computing system via the network, a fourth set of data metrics associated with the second instance of the second application that is installed at a fourth server computing system;
determining, by the computing system and using the third set of data metrics and the fourth set of data metrics, that at least one of the first instance of the second application, the third server computing system, the second instance of the second application, or the fourth server computing system satisfies the second application instance pattern, including determining that the third set of data metrics satisfies the third architecture status metric or determining that the second set of data metrics satisfies from the fourth architecture status metric; and
providing, by the computing system, a compliance notification indicating a satisfaction of the second application instance pattern.
4. The non-transitory, machine-readable medium of claim 1 , wherein the application instance pattern comprises an application version metric or a resource configuration metric.
5. (canceled)
6. The non-transitory, machine-readable medium of claim 1 , wherein the application instance pattern includes an application version metric indicating a first application version for the first application, and wherein the first set of data metrics and the second set of data metrics indicates that at least one of the first instance or the second instance includes a second application version for the first application that is different than the first application version.
7. The non-transitory, machine-readable medium of claim 1 , wherein the application instance pattern includes a resource configuration metric indicating a first resource configuration for a server computing device, and wherein at least one of the first set of data metrics or the second set of data metrics indicates that at least one of the first server computing system or the second server computing system includes a second resource configuration that is different than the first resource configuration.
8. A method, comprising:
obtaining, by a computing system via a network, an application instance pattern that indicates a first architecture status metric associated with a first instance of a first application and a second architecture status metric associated with a second instance of the first application, wherein the application instance pattern is defined prior to the first instance and the second instance of the first application being deployed;
obtaining, by the computing system via the network, a first set of data metrics associated with the first instance of the first application that is installed at a first server computing system;
obtaining, by the computing system via the network, a second set of data metrics associated with the second instance of the first application that is installed at a second server computing system;
determining, by the computing system and using the first set of data metrics and the second set of data metrics, that at least one of the first instance, the first server computing system, the second instance, or the second server computing system deviates from the application instance pattern, including determining that the first set of data metrics deviates from the first architecture status metric or determining that the second set of data metrics deviates from the second architecture status metric; and
providing, by the computing system, a deviation notification indicating a deviation from the application instance pattern.
9. The method of claim 8 , wherein the first server computing system is provided at a first datacenter, and the second server computing system is provided at a second datacenter.
10. The method of claim 8 , further comprising:
obtaining, by the computing system via the network, a second application instance pattern that indicates a third architecture status metric associated with a first instance of a second application and a fourth architecture status metric associated with a second instance of the second application;
obtaining, by the computing system via the network, a third set of data metrics associated with the first instance of the second application that is installed at a third server computing system;
obtaining, by the computing system via the network, a fourth set of data metrics associated with the second instance of the second application that is installed at a fourth server computing system;
determining, by the computing system and using the third set of data metrics and the fourth set of data metrics, that at least one of the first instance of the second application, the third server computing system, the second instance of the second application, or the fourth server computing system satisfies the second application instance pattern, including determining that the third set of data metrics satisfies the third architecture status metric or determining that the second set of data metrics satisfies from the fourth architecture status metric; and
providing, by the computing system, a compliance notification indicating a satisfaction of the second application instance pattern.
11. The method of claim 8 , wherein the application instance pattern comprises an application version metric or a resource configuration metric.
12. (canceled)
13. The method of claim 8 , wherein the application instance pattern includes an application version metric indicating a first application version for the first application, and wherein the first set of data metrics and the second set of data metrics indicates that at least one of the first instance or the second instance includes a second application version for the first application that is different than the first application version.
14. The method of claim 8 , wherein the application instance pattern includes a resource configuration metric indicating a first resource configuration for a server computing device, and wherein at least one of the first set of data metrics or the second set of data metrics indicates that at least one of the first server computing system or the second server computing system includes a second resource configuration that is different than the first resource configuration.
15. A system, comprising: one or more processors; and memory storing instructions that when executed by the one or more processors cause the one or more processors to effectuate operations comprising:
obtaining, by a computing system via a network, an application instance pattern that indicates a first architecture status metric associated with a first instance of a first application and a second architecture status metric associated with a second instance of the first application, wherein the application instance pattern is defined prior to the first instance and the second instance of the first application being deployed;
obtaining, by the computing system via the network, a first set of data metrics associated with the first instance of the first application that is installed at a first server computing system;
obtaining, by the computing system via the network, a second set of data metrics associated with the second instance of the first application that is installed at a second server computing system;
determining, by the computing system and using the first set of data metrics and the second set of data metrics, that at least one of the first instance, the first server computing system, the second instance, or the second server computing system deviates from the application instance pattern, including determining that the first set of data metrics deviates from the first architecture status metric or determining that the second set of data metrics deviates from the second architecture status metric; and
providing, by the computing system, a deviation notification indicating a deviation from the application instance pattern.
16. The system of claim 15 , wherein the operations further comprise:
obtaining, by the computing system via the network, a second application instance pattern that indicates a third architecture status metric associated with a first instance of a second application and a fourth architecture status metric associated with a second instance of the second application;
obtaining, by the computing system via the network, a third set of data metrics associated with the first instance of the second application that is installed at a third server computing system;
obtaining, by the computing system via the network, a fourth set of data metrics associated with the second instance of the second application that is installed at a fourth server computing system;
determining, by the computing system and using the third set of data metrics and the fourth set of data metrics, that at least one of the first instance of the second application, the third server computing system, the second instance of the second application, or the fourth server computing system satisfies the second application instance pattern, including determining that the third set of data metrics satisfies the third architecture status metric or determining that the second set of data metrics satisfies from the fourth architecture status metric; and
providing, by the computing system, a compliance notification indicating a satisfaction of the second application instance pattern.
17. The system of claim 15 , wherein the application instance pattern comprises an application version metric or a resource configuration metric.
18. (canceled)
19. The system of claim 15 , wherein the application instance pattern includes an application version metric indicating a first application version for the first application, and wherein the first set of data metrics and the second set of data metrics indicates that at least one of the first instance or the second instance includes a second application version for the first application that is different than the first application version.
20. The system of claim 15 , wherein the application instance pattern includes a resource configuration metric indicating a first resource configuration for a server computing device, and wherein at least one of the first set of data metrics or the second set of data metrics indicates that at least one of the first server computing system or the second server computing system includes a second resource configuration that is different than the first resource configuration.
21. The non-transitory, machine-readable medium of claim 1 , wherein the first set of data metrics includes data generated by a first server computing device during operation of the first instance of the first application, and the second set of data metrics includes data generated by a second server computing device during operation of the second instance of the first application.
22. The non-transitory, machine-readable medium of claim 1 , wherein:
the first architecture status metric indicates whether the first instance of the first application should have a passive status, an active status, a deployed status, or a not deployed status; and
the second architecture status metric indicates whether the second instance of the first application should have the passive status, the active status, the deployed status, or the not deployed status.
23. The non-transitory, machine-readable medium of claim 1 , wherein the determination of the deviation from the application instance pattern is performed prior to an event occurring on at least one of the first instance, the first server computing system, the second instance, or the second server computing system,
wherein the event causes the first application to experience a first outcome when the first set of data metrics deviates from the first architecture status metric or when the second set of data metrics deviates from the second architecture status metric, and the event causes the first application to experience a second outcome that is different than the first outcome when the first set of data metrics corresponds with the first architecture status metric and when the second set of data metrics corresponds with the second architecture status metric, and
wherein the event is an occurrence on at least one of the first instance, the first server computing system, the second instance, or the second server computing system that results in the first architecture status metric of the first instance or the second architecture status metric of the second instance changing from an initial status.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/666,267 US11729057B1 (en) | 2022-02-07 | 2022-02-07 | Application architecture drift detection system |
PCT/US2023/011033 WO2023150022A1 (en) | 2022-02-07 | 2023-01-18 | Application architecture drift detection system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/666,267 US11729057B1 (en) | 2022-02-07 | 2022-02-07 | Application architecture drift detection system |
Publications (2)
Publication Number | Publication Date |
---|---|
US20230254210A1 true US20230254210A1 (en) | 2023-08-10 |
US11729057B1 US11729057B1 (en) | 2023-08-15 |
Family
ID=85285245
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/666,267 Active US11729057B1 (en) | 2022-02-07 | 2022-02-07 | Application architecture drift detection system |
Country Status (2)
Country | Link |
---|---|
US (1) | US11729057B1 (en) |
WO (1) | WO2023150022A1 (en) |
Citations (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130326038A1 (en) * | 2012-06-05 | 2013-12-05 | Microsoft Corporation | Management of datacenters for fault tolerance and bandwidth |
US20140122666A1 (en) * | 2012-10-29 | 2014-05-01 | Bank Of America Corporation | Automatic Deployment, Configuration, and Lifecycle Management of Applications and Infrastructure Components |
US8990369B2 (en) * | 2010-10-22 | 2015-03-24 | At&T Intellectual Property I, L.P. | Collaborative QoS for service oriented architectures |
US20160043919A1 (en) * | 2014-08-07 | 2016-02-11 | Ca, Inc. | Identifying unauthorized changes to network elements and determining the impact of unauthorized changes to network elements on network services |
US20160127453A1 (en) * | 2014-11-03 | 2016-05-05 | International Business Machines Corporation | Workload deployment density management for a multi-stage computing architecture implemented within a multi-tenant computing environment |
US9342388B1 (en) * | 2015-12-02 | 2016-05-17 | International Business Machines Corporation | Dynamic queue alias |
US20160162339A1 (en) * | 2014-12-04 | 2016-06-09 | International Business Machines Corporation | Concurrent workload deployment to synchronize activity in a design palette |
US20160173487A1 (en) * | 2014-12-13 | 2016-06-16 | International Business Machines Corporation | Controlling a discovery component, within a virtual environment, that sends authenticated data to a discovery engine outside the virtual environment |
US9471294B2 (en) * | 2014-03-31 | 2016-10-18 | International Business Machines Corporation | Extensions for deployment patterns |
US20170046247A1 (en) * | 2015-08-11 | 2017-02-16 | Bank Of America Corporation | Production resiliency testing system |
US20170068524A1 (en) * | 2015-09-08 | 2017-03-09 | International Business Machines Corporation | Domain-specific pattern design |
US20170116013A1 (en) * | 2015-10-26 | 2017-04-27 | International Business Machines Corporation | Deployment of instances amid configuration changes |
US9871706B2 (en) * | 2014-10-08 | 2018-01-16 | International Business Machines Corporation | Intelligently managing pattern contents across multiple racks based on workload and human interaction usage patterns |
US20180063193A1 (en) * | 2016-08-27 | 2018-03-01 | Ganesan Chandrashekhar | Distributed Network Encryption for Logical Network Implemented in Public Cloud |
US20180145871A1 (en) * | 2016-11-21 | 2018-05-24 | Everbridge, Inc. | Systems and methods for providing a notification system architecture |
US9983898B2 (en) * | 2013-06-17 | 2018-05-29 | International Business Machines Corporation | Generating a deployment pattern for reuse in a networked computing environment |
US20180174072A1 (en) * | 2016-12-21 | 2018-06-21 | Ca, Inc. | Method and system for predicting future states of a datacenter |
US20190188022A1 (en) * | 2017-12-20 | 2019-06-20 | At&T Intellectual Property I, L.P. | Virtual Redundancy for Active-Standby Cloud Applications |
US20190205157A1 (en) * | 2017-02-03 | 2019-07-04 | Microsoft Technology Licensing, Llc | Resource management for virtual machines in cloud computing systems |
US20190373007A1 (en) * | 2016-08-04 | 2019-12-05 | Oracle International Corporation | Unsupervised method for baselining and anomaly detection in time-series data for enterprise systems |
US20200092334A1 (en) * | 2018-09-17 | 2020-03-19 | International Business Machines Corporation | Adjusting resiliency policies for cloud services based on a resiliency score |
US10642826B1 (en) * | 2018-08-30 | 2020-05-05 | Gravic, Inc. | Mixed-mode method for combining active/active and validation architectures utilizing a check integrity module |
US20200192772A1 (en) * | 2018-12-17 | 2020-06-18 | Ribbon Communications Operating Company, Inc. | Methods and apparatus for detecting, eliminating and/or mitigating split brain occurrences in high availability systems |
US20200204620A1 (en) * | 2018-12-20 | 2020-06-25 | The Boeing Company | Systems and methods of monitoring software application processes |
US11036556B1 (en) * | 2013-08-23 | 2021-06-15 | Throughputer, Inc. | Concurrent program execution optimization |
US20220021575A1 (en) * | 2020-07-16 | 2022-01-20 | Servicenow, Inc. | Synchronization of a Shared Service Configuration Across Computational Instances |
US20220029880A1 (en) * | 2020-07-22 | 2022-01-27 | Servicenow, Inc. | Discovery of virtualization environments |
US20220327172A1 (en) * | 2021-04-09 | 2022-10-13 | Servicenow, Inc. | Evaluation and Recommendation Engine for a Remote Network Management Platform |
US20220391294A1 (en) * | 2021-06-03 | 2022-12-08 | Avaya Management L.P. | Active-standby pods in a container orchestration environment |
US11601434B1 (en) * | 2019-12-12 | 2023-03-07 | Trace Systems, Inc. | System and method for providing a dynamically reconfigurable integrated virtual environment |
Family Cites Families (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5835911A (en) | 1994-02-08 | 1998-11-10 | Fujitsu Limited | Software distribution and maintenance system and method |
US6279001B1 (en) | 1998-05-29 | 2001-08-21 | Webspective Software, Inc. | Web service |
US6651062B2 (en) | 1998-08-31 | 2003-11-18 | Aprisma Management Technologies | Method and apparatus for managing data for use by data applications |
US6385770B1 (en) | 1999-01-29 | 2002-05-07 | Telefonaktiebolaget Lm Ericsson (Publ) | Software upgrade |
AU1361701A (en) | 1999-11-03 | 2001-05-14 | Accenture Llp | Architectures for netcentric computing systems |
US8782201B2 (en) | 2005-10-28 | 2014-07-15 | Bank Of America Corporation | System and method for managing the configuration of resources in an enterprise |
US20070112652A1 (en) | 2005-11-01 | 2007-05-17 | Ricketts John A | Throughput accounting for professional, scientific and technical services |
US8712973B2 (en) | 2006-04-11 | 2014-04-29 | International Business Machines Corporation | Weighted determination in configuration management systems |
US9043218B2 (en) | 2006-06-12 | 2015-05-26 | International Business Machines Corporation | Rule compliance using a configuration database |
US9053460B2 (en) | 2006-06-12 | 2015-06-09 | International Business Machines Corporation | Rule management using a configuration database |
US20080183690A1 (en) | 2007-01-26 | 2008-07-31 | Ramachandran Puthukode G | Method for providing assistance in making change decisions in a configurable managed environment |
US8302088B2 (en) | 2008-10-15 | 2012-10-30 | International Business Machines Corporation | Analysis of effects of a software maintenance patch on configuration items of a CMDB |
US9442810B2 (en) | 2009-07-31 | 2016-09-13 | Paypal, Inc. | Cloud computing: unified management console for services and resources in a data center |
US8626880B2 (en) | 2011-07-06 | 2014-01-07 | Dell Products, Lp | Embedded configuration variance detector |
US9497136B1 (en) * | 2011-09-28 | 2016-11-15 | Emc Corporation | Method and system for providing usage metrics to manage utilzation of cloud computing resources |
US8856295B2 (en) * | 2012-01-10 | 2014-10-07 | Oracle International Corporation | System and method for providing an enterprise deployment topology with thick client functionality |
US10075329B2 (en) * | 2014-06-25 | 2018-09-11 | A 10 Networks, Incorporated | Customizable high availability switchover control of application delivery controllers |
US10417712B2 (en) * | 2014-10-21 | 2019-09-17 | Hartford Fire Insurance Company | Enterprise application high availability scoring and prioritization system |
US9965632B2 (en) | 2014-12-22 | 2018-05-08 | Capital One Services, Llc | System and methods for secure firmware validation |
US10496061B2 (en) | 2015-03-16 | 2019-12-03 | Rockwell Automation Technologies, Inc. | Modeling of an industrial automation environment in the cloud |
US10938674B1 (en) * | 2016-07-01 | 2021-03-02 | EMC IP Holding Company LLC | Managing utilization of cloud computing resources |
US10810102B2 (en) * | 2016-11-28 | 2020-10-20 | Sap Se | Database monitoring by data virtualization |
US10503705B2 (en) * | 2017-02-28 | 2019-12-10 | Sap Se | Database memory management in a high availability database system using limits |
US20190102158A1 (en) | 2017-09-29 | 2019-04-04 | GM Global Technology Operations LLC | System and method for providing software updates in assembly line and dealership lot environments |
US10466990B1 (en) | 2018-01-29 | 2019-11-05 | Intuit Inc. | Method and system for auto stacking and launching base and extended patterns using an automatic launch and restack engine |
US10713888B2 (en) | 2018-03-01 | 2020-07-14 | Ags Llc | Gaming system having boot locked validation of program installs, data installs and program launches |
US10795913B2 (en) * | 2018-10-11 | 2020-10-06 | Capital One Services, Llc | Synching and reading arrangements for multi-regional active/active databases |
US20210117242A1 (en) * | 2020-10-03 | 2021-04-22 | Intel Corporation | Infrastructure processing unit |
-
2022
- 2022-02-07 US US17/666,267 patent/US11729057B1/en active Active
-
2023
- 2023-01-18 WO PCT/US2023/011033 patent/WO2023150022A1/en unknown
Patent Citations (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8990369B2 (en) * | 2010-10-22 | 2015-03-24 | At&T Intellectual Property I, L.P. | Collaborative QoS for service oriented architectures |
US20130326038A1 (en) * | 2012-06-05 | 2013-12-05 | Microsoft Corporation | Management of datacenters for fault tolerance and bandwidth |
US20140122666A1 (en) * | 2012-10-29 | 2014-05-01 | Bank Of America Corporation | Automatic Deployment, Configuration, and Lifecycle Management of Applications and Infrastructure Components |
US9983898B2 (en) * | 2013-06-17 | 2018-05-29 | International Business Machines Corporation | Generating a deployment pattern for reuse in a networked computing environment |
US11036556B1 (en) * | 2013-08-23 | 2021-06-15 | Throughputer, Inc. | Concurrent program execution optimization |
US9471294B2 (en) * | 2014-03-31 | 2016-10-18 | International Business Machines Corporation | Extensions for deployment patterns |
US20160043919A1 (en) * | 2014-08-07 | 2016-02-11 | Ca, Inc. | Identifying unauthorized changes to network elements and determining the impact of unauthorized changes to network elements on network services |
US9871706B2 (en) * | 2014-10-08 | 2018-01-16 | International Business Machines Corporation | Intelligently managing pattern contents across multiple racks based on workload and human interaction usage patterns |
US20160127453A1 (en) * | 2014-11-03 | 2016-05-05 | International Business Machines Corporation | Workload deployment density management for a multi-stage computing architecture implemented within a multi-tenant computing environment |
US20160162339A1 (en) * | 2014-12-04 | 2016-06-09 | International Business Machines Corporation | Concurrent workload deployment to synchronize activity in a design palette |
US20160173487A1 (en) * | 2014-12-13 | 2016-06-16 | International Business Machines Corporation | Controlling a discovery component, within a virtual environment, that sends authenticated data to a discovery engine outside the virtual environment |
US20170046247A1 (en) * | 2015-08-11 | 2017-02-16 | Bank Of America Corporation | Production resiliency testing system |
US20170068524A1 (en) * | 2015-09-08 | 2017-03-09 | International Business Machines Corporation | Domain-specific pattern design |
US20170116013A1 (en) * | 2015-10-26 | 2017-04-27 | International Business Machines Corporation | Deployment of instances amid configuration changes |
US9342388B1 (en) * | 2015-12-02 | 2016-05-17 | International Business Machines Corporation | Dynamic queue alias |
US20190373007A1 (en) * | 2016-08-04 | 2019-12-05 | Oracle International Corporation | Unsupervised method for baselining and anomaly detection in time-series data for enterprise systems |
US20180063193A1 (en) * | 2016-08-27 | 2018-03-01 | Ganesan Chandrashekhar | Distributed Network Encryption for Logical Network Implemented in Public Cloud |
US20180145871A1 (en) * | 2016-11-21 | 2018-05-24 | Everbridge, Inc. | Systems and methods for providing a notification system architecture |
US20180174072A1 (en) * | 2016-12-21 | 2018-06-21 | Ca, Inc. | Method and system for predicting future states of a datacenter |
US20190205157A1 (en) * | 2017-02-03 | 2019-07-04 | Microsoft Technology Licensing, Llc | Resource management for virtual machines in cloud computing systems |
US20190188022A1 (en) * | 2017-12-20 | 2019-06-20 | At&T Intellectual Property I, L.P. | Virtual Redundancy for Active-Standby Cloud Applications |
US10642826B1 (en) * | 2018-08-30 | 2020-05-05 | Gravic, Inc. | Mixed-mode method for combining active/active and validation architectures utilizing a check integrity module |
US20200092334A1 (en) * | 2018-09-17 | 2020-03-19 | International Business Machines Corporation | Adjusting resiliency policies for cloud services based on a resiliency score |
US20200192772A1 (en) * | 2018-12-17 | 2020-06-18 | Ribbon Communications Operating Company, Inc. | Methods and apparatus for detecting, eliminating and/or mitigating split brain occurrences in high availability systems |
US20200204620A1 (en) * | 2018-12-20 | 2020-06-25 | The Boeing Company | Systems and methods of monitoring software application processes |
US11601434B1 (en) * | 2019-12-12 | 2023-03-07 | Trace Systems, Inc. | System and method for providing a dynamically reconfigurable integrated virtual environment |
US20220021575A1 (en) * | 2020-07-16 | 2022-01-20 | Servicenow, Inc. | Synchronization of a Shared Service Configuration Across Computational Instances |
US20220029880A1 (en) * | 2020-07-22 | 2022-01-27 | Servicenow, Inc. | Discovery of virtualization environments |
US20220327172A1 (en) * | 2021-04-09 | 2022-10-13 | Servicenow, Inc. | Evaluation and Recommendation Engine for a Remote Network Management Platform |
US20220391294A1 (en) * | 2021-06-03 | 2022-12-08 | Avaya Management L.P. | Active-standby pods in a container orchestration environment |
Also Published As
Publication number | Publication date |
---|---|
US11729057B1 (en) | 2023-08-15 |
WO2023150022A1 (en) | 2023-08-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11314574B2 (en) | Techniques for managing and analyzing log data | |
US10129109B2 (en) | Managing change events for devices in an enterprise system | |
US10339034B2 (en) | Dynamically generated device test pool for staged rollouts of software applications | |
US11461679B2 (en) | Message management using machine learning techniques | |
US11283737B2 (en) | Application initiated conversations for chatbots | |
CN112867988A (en) | Implementing compliance settings by a mobile device to follow a configuration scenario | |
US11704680B2 (en) | Detecting fraudulent user accounts using graphs | |
US11789782B2 (en) | Techniques for modifying cluster computing environments | |
US10761920B2 (en) | Individualized channel error detection and resolution | |
WO2018190885A1 (en) | Techniques to automate bot creation for web pages | |
US11711275B2 (en) | Impact predictions based on incident-related data | |
US20200357059A1 (en) | Multi-layer machine learning validation of income values | |
US11119747B2 (en) | System and method for application release orchestration and deployment | |
US11729057B1 (en) | Application architecture drift detection system | |
US20230205657A1 (en) | Techniques for automated service monitoring and remediation in a distributed computing system | |
US10686645B1 (en) | Scalable subscriptions for virtual collaborative workspaces | |
US11762809B2 (en) | Scalable subscriptions for virtual collaborative workspaces | |
KR102180105B1 (en) | Method and apparatus for determining malicious software for software installed on device | |
US11595324B1 (en) | System for automated cross-network monitoring of computing hardware and software resources | |
US20240005200A1 (en) | Generation of inference logic from training-time artifacts for machine learning model deployments | |
US20230196420A1 (en) | Anomaly detection for bill generation | |
US20240211327A1 (en) | Techniques for performing fault tolerance validation for a data center | |
US20240211829A1 (en) | System and method for managing issues using skill matching | |
US20230065616A1 (en) | Techniques for schema drift detection | |
CN117041000A (en) | Task processing method and device, electronic equipment, storage medium and service system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THE BANK OF NEW YORK MELLON, NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MANGALAM, BADRI;SEETHARAMAN, SRIDHAR;THIRUVENGADATHAN, LAKSHMI;SIGNING DATES FROM 20220202 TO 20220204;REEL/FRAME:058914/0157 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |