US20070282778A1 - Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique - Google Patents

Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique Download PDF

Info

Publication number
US20070282778A1
US20070282778A1 US11446761 US44676106A US2007282778A1 US 20070282778 A1 US20070282778 A1 US 20070282778A1 US 11446761 US11446761 US 11446761 US 44676106 A US44676106 A US 44676106A US 2007282778 A1 US2007282778 A1 US 2007282778A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
policy
event
observed
recommended
policies
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US11446761
Inventor
Hoi Y. Chan
David M. Chess
Thomas Y. Kwok
Steve R. White
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00Computer systems utilising knowledge based models
    • G06N5/02Knowledge representation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing packet switching networks
    • H04L43/02Arrangements for monitoring or testing packet switching networks involving a reduction of monitoring data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing packet switching networks
    • H04L43/08Monitoring based on specific metrics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing packet switching networks
    • H04L43/16Arrangements for monitoring or testing packet switching networks using threshold monitoring

Abstract

A statistical approach implementing Singular Value Decomposition (SVD) to a policy-based management system for autonomic and on-demand computing applications. The statistical approach empowers a class of applications that require policies to handle ambiguous conditions and allow the system to “evolve” in response to changing operation and environment conditions. In the system and method providing the statistical approach, observed event-policy associated data, which is represented by an event-policy matrix, is treated as a statistical problem with the assumption that there are some underlying or implicit higher order correlations among events and policies. The SVD approach enables such correlations to be modeled, extracted and modified. From these correlations, recommended policies can be selected or created without exact match of policy conditions. With a feedback mechanism, new knowledge can be acquired as new situations occur and the corresponding policies to manage them are recorded and used to generate new event and policy correlations. Consequently, based on these new correlations, new recommended policies can be derived.

Description

    FIELD OF THE INVENTION
  • The present invention relates generally to on-demand and autonomic computing systems in IT systems and environments generally, including those computing systems that are managed by a policy-based management system. The invention particularly relates to a novel system and method by which policies can be selected or created automatically based on events observed and knowledge learned. This new approach treats the observed event-policy relationship represented by an event-policy matrix as a statistical problem that can be yield results using a Singular Value Decomposition (SVD) technique.
  • DESCRIPTION OF THE PRIOR ART
  • On demand and autonomic computing, such as described in the reference authored by J. O. Kephart and D. M. Chess entitled “The Vision of Autonomic Computing. IEEE Computer Magazine, January 2003, require policy-based management systems to be responsive to changes in environments and adaptive to new operating conditions. In a typical IT environment, there are thousands of events reporting system faults, status and performance information. New events may also appear due to the on-demand operations, and the occurrences of these events are unpredictable. Traditional policy-based management systems and policy authoring, such as relying entirely on static authoring of “if [condition] then [actions]” rules, become insufficient. New approaches to the design and implementation of policy-based systems have emerged, including goal policies such as described in the references entitled “An AI Perspective on Autonomic Computing Policies”, Policies for Distributed Systems, Networks, 2004 by J. O. Kephart and W. E. Walsh, and “A Goal-based Approach to Policy Refinement”, Proceedings 5th IEEE Policy Workshop (Policy 2004) by A. K. Bandara, E. C. Lupu, J. Moffett, A. Russo. Other new approaches to the design and implementation of policy-based systems have emerged, including utility functions, and data mining and reinforcement learning such as described in the reference entitled “Reinforcement Learning: A Survey”, Journal of Artificial Intelligence Research, Volume 4, 1996 by L. P. Kaelbling, M. Littman, A. Moore.
  • However, it is the case that none of these approaches provides a systematic way to enable policy-based management system and its policies to be responsive to new and ambiguous situations.
  • It would be highly desirable to provide a statistical approach to the design and implementation of a policy-based management system by utilizing a mathematical technique called Singular Value Decomposition (SVD).
  • SUMMARY OF THE INVENTION
  • According to the present invention, there is provided a statistical approach to the design and implementation of a policy-based management system by utilizing a mathematical technique called Singular Value Decomposition (SVD). The SVD technique is closely related to a class of mathematical and statistical techniques, such as eigenvector decomposition, spectral analysis and factor analysis.
  • Generally, the invention provides a system and method using a statistical approach implementing Singular Value Decomposition (SVD) to a policy-based management system for autonomic and on-demand computing applications. The statistical approach empowers a class of applications that require policies to handle ambiguous conditions and allow the system to “evolve” in response to changing operation and environment conditions. In the system and method providing the statistical approach, observed event-policy associated data, which is represented by an event-policy matrix, is treated as a statistical problem with the assumption that there are some underlying or implicit higher order correlations among events and policies. The SVD approach according to the invention enables such correlations to be modeled, extracted and modified. From these correlations, recommended policies can be selected or created without exact match of policy conditions. With a feedback mechanism, new knowledge can be acquired as new situations occur and the corresponding policies to manage them are recorded and used to generate new event and policy correlations. Consequently, based on these new correlations, new recommended policies can be derived.
  • Thus, according to one embodiment of the invention, there is provided an adaptive policy-based management system, method and computer program product for computing systems. The adaptive policy-based management system comprises:
  • a means for representing the occurrences of computer system events and action response policies from computing system resources into a first event-policy data structure;
  • a means for constructing a second event-policy data structure from the first event-policy data structure, the second event-policy data structure representing an event-policy vector space comprising associative patterns and correlations in the event-policy data;
  • a means for receiving observed event data set from a computing system resource;
  • a means for recommending a policy for the observed event data set based on existing policy vectors in the constructed event-policy vector space; and,
  • a means enabling updating of the first event-policy data structure and the second event-policy data structure representing the event-policy vector space as new observed event data sets are received, thereby increasing accuracy in generating recommended policies as new event knowledge is input.
  • Further to this embodiment of the invention, the adaptive policy-based management system includes a means for storing received observed data event sets and corresponding action response policies from computing system resources.
  • Moreover, the adaptive policy-based management system further comprises:
  • an interface means is provided for enabling a user to review and modify a recommended policy for the observed event data set; and,
  • a means for executing a recommended policy and determining a policy's effectiveness for managing the observed event data set, wherein the storing means is updated with the received observed data event sets and corresponding modified response policies.
  • Further to this embodiment, the means for recommending a policy for the observed event data set comprises: a means for constructing a pseudo-policy vector for an observed event set from data in the event-policy vector space; and, a means for determining a recommended policy based on proximity of the pseudo-policy vector and existing policy vectors included in the event-policy vector space. The means for determining a recommended policy comprises means for applying a similarity metric between the pseudo-policy vector and one or more policy vectors.
  • Preferably, according to the invention, first event-policy data structure comprises an event-policy matrix, and the means for constructing a second event-policy data structure from the first event-policy data structure comprises means for implementing Singular Value Decomposition (SVD)] function on the event-policy matrix.
  • According to another aspect of the invention, there is provided a method for policy-based management of computing systems, the method comprising:
  • representing the occurrences of computer system events and action response policies from computing system resources into a first event-policy data structure;
  • constructing a second event-policy data structure from the first event-policy data structure, the second event-policy data structure representing an event-policy vector space comprising associative patterns and correlations in the event-policy data;
  • receiving observed event data set from a computing system resource;
  • recommending a policy for the observed event data set based on existing policy vectors in the constructed event-policy vector space;
  • enabling updating of the first event-policy data structure and the second event-policy data structure representing the event-policy vector space as new observed event data sets are received, thereby increasing accuracy in generating recommended policies as new event knowledge is input.
  • Advantageously, the statistical approach implementing Singular Value Decomposition (SVD) to a policy-based management system for autonomic and on-demand computing applications not only is applicable for traditional policy systems where conditions in policy are fixed, but also is applicable for ambiguous and unpredictable situations. Moreover, the use of a SVD based-policy system and its attendant efficiencies may be implemented for specific areas of autonomic and on-demand computing such as a feedback loop, as a symptom recognition mechanism, and as a predictive mechanism.
  • The present invention may also be applied to other applications, such as applications for selecting preferred parties or persons (from a space of people) with low risks and/or charging them for low fees, for example, for insurance (auto, life) coverage, as well as loan granting or lending.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The objects, features and advantages of the present invention will become apparent to one skilled in the art, in view of the following detailed description taken in combination with the attached drawings, in which:
  • FIG. 1 depicts an example design and architecture of the policy-based management system 10 according to the invention;
  • FIG. 2 depicts an example simplified set of security policies 100 that may be illustratively used for demonstrating the policy-based management system of the invention;
  • FIG. 3 depicts an example left singular vector E resulting from Singular Value Decomposition of the event-policy matrix R;
  • FIG. 4 depicts an example right singular vector P′ resulting from Singular Value Decomposition of the event-policy matrix R;
  • FIG. 5 depicts an example matrix S resulting from Singular Value Decomposition of the event-policy matrix R;
  • FIG. 6 depicts an example plot of the resulting row vectors of the reduced matrices (shaded columns of the E matrix 80 in FIG. 3 and P′ matrix 85 in FIG. 4) that are taken as coordinates of points representing events and policies in an example two-dimensional space;
  • FIG. 7 depicts an example flow chart 100 representing the method steps employed for selecting and/or creating a recommended policy based on a set of observed events; and,
  • FIG. 8 depicts a flow diagram illustrating the interaction of an administrator with the system 10 to examine, modify and create recommended policy.
  • DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • FIG. 1 shows the design and architecture of a policy-based management system 10 according to the invention.
  • As shown in FIG. 1, the system 10 includes an event bus device 13 for event subscription, an administrator console (AC) 15 for administrator actions, an event-policy repository (EPR) 20 for storing event sets and policies, and an SVD engine (SVDE) 60 comprising a number of functional modules as will be explained in greater detail herein below. Events from managed resources (MR) 12 a,12 b, . . . ,12 n are communicated to the SVDE 50 to the event bus 13 periodically or on an “as needed” basis for analysis to produce a set of “symptoms”, describing system status, faults or performance. In a typical data center, for example, there are thousands of different events reporting system faults, status, and performance information and their occurrences are unpredictable. Moreover, new events and conditions also appear as operating environment changes. The communication of such event data to the SVDE may be computer network based, e.g., by transmission over wired or wireless communications links 17 to the event bus. For example, a managed resource 12, e.g., a disk drive, communicates a Common Base Event (CBE) structure or object that holds information about a situation. One example situation may be an indication that the disk drive's capacity is at its maximum. This CBE is placed on the event bus so all components which subscribe to that event type can listen.
  • As shown in FIG. 1, the SVD engine (SVDE) 60 comprises three (3) modules: an event-policy matrix generation module 30 that executes functions for transforming event sets and their associated policies from the EPR repository 20 into a matrix; an event-policy space construction module 40 that executes functions for decomposing the event-policy matrix utilizing an SVD technique to construct an n-dimensional event-policy space wherein events and policies that are closely associated are placed near one another. One SVD technique in general that may be used according to the invention is described in the reference entitled “Singular Value Factorization.” §3.2.7 in Numerical Linear Algebra for Applications in Statistics. by Gentle, J. E. Berlin: Springer-Verlag, pp. 102-103, 1998, the whole contents and disclosure of which is incorporated by reference herein; and, a policy selection and/or creation module 50 that executes functions for examining the event-policy space to select or create recommended policies which are closely associated in space with the observed events for remediation.
  • The AC device 15 provides a user interface(not shown) that enables an administrator or like authorized user to select one of two system operation modes: 1) a supervised mode whereby the administrator is enabled to examine or modify the recommended policy; or 2) an automatic mode, whereby a recommended policy is accepted without further examination. Initially, the system operates in the supervised mode, whereby the administrator examines the event set as problems occur and executes the corresponding policy to correct the problems. The system records the administrator's actions as event-policy data. After enough knowledge (or trust) has been established, the system may be left to operate in an automatic mode. However, should the automatically generated policies fail to perform as the administrator has expected, the administrator or like user may intervene via the AC or revert the system to run in supervised mode.
  • For ease of illustration and depicting operation of the invention, a simplified set of security policies P1-P5 is shown in FIG. 2 that govern computer usage events generally as indicated as events E1-E9 and, particularly govern user's IP network connectivity. As shown in FIG. 2, the example set of security events and the policies implemented include:
    • E1=more than 25 failed logins in 5 minutes,
    • E2=more than 25 logins by a single user/IP,
    • E3=excessive logins in the entire system,
    • E4=excessive logins in a domain,
    • E5=excessive logins in an individual server,
    • E6=excessive accounts are blocked by security,
    • E7=excessive FTP connections,
    • E8=connection established to suspicious IP,
    • E9=excessive unknown application terminations, and
    • Action for P1=block IP
    • Action for P2=block network segment
    • Action for P3=block sever access
    • Action for P4=disable account
    • Action for P5=restrict access to entire system.
  • Thus, as shown in the example dataset of FIG. 2, there is depicted an Event-Policy Matrix 75 (alternately referred to herein as a correlation matrix) comprising a dataset having m events (Em) and n policies (Pn), where m=9 and n=5. The m events are entered as rows and the n policies are entered as columns in the m×n correlation matrix R. The entries in the event-policy matrix 75 are simply number of occurrences of events in different policies. That is, the entries in the correlation matrix reflect the number of times the corresponding event or circumstances appears in the corresponding policy. It is further understood that the existing policies comprise, or is extracted from, logs or other records of, previous actions taken in the system being managed or in other similar systems. It is further understood that if any policy includes the negation of a given event or circumstance, the correlation matrix also contains entries reflecting the occurrence of the negation of each event and/or circumstance in each of the plurality of policies. Moreover, if any policy contains a disjunction between two or more events or circumstances, the correlation matrix also contains entries reflecting the occurrence of that disjunction in each of the plurality of policies.
  • According to the invention, the matrix R is decomposed into three matrices by SVD technique as in equation (1) as follows:

  • R=ESP′  (1)
  • where E and P′ are the event-policy matrices of respective left singular vectors (gene coefficient vectors) and right singular vectors (expression level vectors) with an example left singular vector E 80 shown in FIG. 3 and an example right singular vector P′ 85 shown in FIG. 4. As shown in respective FIGS. 3 and 4, left and right singular vectors are both shown having orthogonal columns. FIG. 5 depicts the matrix S 90 which is the diagonal matrix (mode amplitudes) of singular values ordered in decreasing magnitude. According to the invention, these special matrices E, S and P′ are the result of a breakdown of the original event-policy relationships such as shown in the data set of FIG. 2 into linearly independent event and policy components. Consequently, each event or policy is represented by a vector. As shown in FIG. 5, the values for many of these singular values are can be ignored as they become relatively small. Usually, only the first few largest singular values are needed and the rest deleted. Thus, a reduced model which is approximately equal to the original event-policy model with fewer dimensions can be built. This process, in essence, captures the major relationships among events and policies while ignoring the minor ones by treating them as noise.
  • In a two dimensional model where k=2 as shown in the shaded elements 82, 87 and 92 in respective FIGS. 3, 4 and 5, all the event to event, policy to policy, and event to policy similarities are now approximated by the first two largest singular values of matrix S 90 of FIG. 5. As a result, the row vectors of the reduced matrices (shaded columns of the E matrix 80 in FIG. 3 and P′ matrix 85 in FIG. 4) are taken as coordinates of points representing events and policies in a two-dimensional space 95 as shown in FIG. 6 where events are represented as diamonds, e.g., event E6 93, and policies as squares, e.g., policy P5 98. The dot product or cosine between two vectors representing any two components corresponds to their estimated similarity. It is understood that in the example provided, while the number of orthogonal factors “k” used in the example reduced model is chosen to be two to represent a 2-dimensional space, it is understood that the representation of a conceptual space for any large policy collection usually requires a fairly large number of orthogonal factors. For example, with k approximately 0.6, the smaller of m or n, where m and n are the dimensions of event and policy vectors respectively, would give a good representation with estimation.
  • The ability to select and/or create a policy based on a new set of events as enabled by the present invention is now described with respect to FIG. 7. FIG. 7 depicts an example flow chart 100 representing the method steps employed for selecting and/or creating a policy based on a new set of observed events that are received as input via the CBE as indicated at step 105. At step 110, a determination is made as to whether an event of the observed events set is a new event. If it is determined at step 110 that an event of the observed events set does not include a new event, then the process proceeds to step 115 where a determination is made as to whether the observed events set matches one or more existing event sets as held in the repository. If an observed event set matches one or more of the existing event sets, the system simply retrieves its corresponding policy from the event-policy repository 10 (FIG. 1) as indicated at step 120. Returning to step 110, if an event of the observed events set includes a new event, then the process proceeds to step 125 where the policy selection and creation mechanism in the event-policy space is invoked to construct a pseudo-policy based only on the existing events from the event policy space. However, when a new set of events occurs without any individual new event, as result of the determination made at step 115, the policy selection and creation mechanism in the event-policy space is invoked at step 130. Particularly, at steps 125 and 130, functions are executed in the policy selection and/or creation module 50 of FIG. 1 for examining the event-policy space to select or create recommended policies. Thus, at steps 125 or 130, using the new observed event set, a pseudo-policy is first constructed as the weighted sum of its constituent event vectors. With appropriate rescaling of both the event and policy axes, this amounts to placing the pseudo-policy at the centroid of its corresponding event points. Then, this pseudo-policy is compared against all existing policies by calculating the cosine between the pseudo-policy vector and the existing policy vector as a similarity metric. As a result of vector comparison cosine calculations, those policies with the highest cosines (the nearest vectors) to the pseudo-policy are selected as shown at step 140 in FIG. 7. Their policy actions are appropriately merged at step 150 to form the recommended policy. It is understood that the choice of the threshold cosine value plays a significant role in the number and the accuracy of the policies selected. One technique that may be implemented would be to first use a small cosine value to enable a broader search space initially, and reduce the search space gradually as more data is accumulated to maximize accuracy.
  • In an alternate embodiment, referring back to FIG. 7, after a result of vector comparison cosine calculations and selection of those policies with the highest cosines (the nearest vectors) to the pseudo-policy as shown at step 140, those policy actions are appropriately merged at step 160 to form a resultant vector. Then, proceeding from step 160, an administrator or like authorized user may examine and modify the resultant policy to create the recommended policy as indicated at step 170. Thus, referring back to FIG. 6 depicting the 2-dimensional plot 95 of Es and Ps, when an observed event set includes at least one new event, the system only uses the existing events to form the pseudo-policy and selects the recommended policy. However, this recommended policy must be examined by the administrator regardless of what operation mode the system is currently in. The administrator, at his/her discretion, may accept, modify or add new actions to this recommended policy via the administrator console 15 of FIG. 1. The recommended policy, whether modified or not by the Administrator) will be executed to determine its effectiveness for the corresponding event set as indicated at block 70, FIG. 1. Upon successful execution of the recommended policy, the new events and actions are fed back from the Administrator Console 15 via feedback loop 21 to the event-policy repository 20 where it will be recorded. After receiving the new event policy entry at the repository, the SVDE 60 is triggered to re-construct a new event-policy space for subsequent uses. As a result, new knowledge is acquired.
  • FIG. 8 is a flow diagram 200 illustrating the interaction of an administrator with the system to examine, modify and create recommended policy. As shown in FIG. 8, at a first step 205, the system receives a set of observed events. At step 210, a determination is then made as to whether a new event is included in the observed event set. If no new event is present in the observed event set, then the process proceeds to step 215 where the system is placed in an automatic mode. The process then proceeds to step 220 which represents the step of selecting or constructing a recommended policy as described in detail with respect to FIG. 7. The recommended policy is then executed as depicted at step 225. After execution of the recommended policy, a determination is made at step 230 to determine whether the recommended policy was successfully executed. If the policy was successfully executed, then the process terminates. Referring back to step 210, if it has been determined that a new event is included in the observed event set, then the process proceeds to step 250, FIG. 8, where the system is placed in a supervised mode of operation. Thereafter, at step 255, a resultant policy is constructed from the event-policy space as explained herein with respect to FIG. 7. Then, continuing to step 260, the resultant policy is examined and potentially modified by the administrator in order to create a recommended policy. Referring back to step 230, FIG. 8, if it is determined that the recommended policy was not successfully executed, then the system is placed in a supervised mode of operation as indicated at step 270. In this mode, as indicated at step 275, the old recommended policy is examined and potentially modified by the administrator in order to create a new recommended policy.
  • An illustrative example is now provided for generating a recommended policy based on a set of observed events is now provided. Specifically, for the example event-policy matrix 75 depicted in FIG. 2, an example embodiment of the invention is now described. In a first example, with k=2 and a threshold cosine value of 0.7, an example observed event set consists of E2 and E3, a direct match of P2 is found; thus, the system simply applies P2 as the recommended policy. However, according to the invention, relevant policies can be further retrieved depending on their proximity to the pseudo policy formed by E2 and E3, despite the fact that an exact match is found. This is useful in the case that the application needs to cover a broader spectrum of recommended policies.
  • In a further example, an observed event set consists of E4 and E5; a search indicates that there is no matching policy in the current repository. A pseudo-policy Ps is constructed from E4 and E5, represented as point “q” as shown in the two-dimensional event-policy space plot 95 generated as depicted in FIG. 6 which is the centroid of vector E4 97 and E5 99. Policies P2, P3 are selected as they are within the dotted cone 96 with a cosine value of 0.7 from plotted point “q”.
  • In still a further example, an observed event set consists of E6 93, E9 94 and, a new event E10 (excessive external traffic). The system uses E6 and E9 to form the pseudo policy represented as point “f” as shown in FIG. 6. Using a cosine value of 0.7 from plotted point “f”, policy P5 is selected as the recommended policy. As in the example policy matrix described hereinabove with respect to FIG. 2, the action of policy P5 is to restrict system access for only critical missions. An administrator examines P5, and due to the external threat of system attacks indicated by E10, he adds an action A6, e.g., issue a red security alert action, to the recommended policy. Upon successful execution, this new policy, now named P6, with actions A5 and A6, events E6, E9 and E10 are recorded. Subsequently, the SVDE is triggered to re-construct the event-policy space for subsequent uses.
  • Advantageously, the statistical approach implementing Singular Value Decomposition (SVD) to a policy-based management system for autonomic and on-demand computing applications not only is applicable for traditional policy systems where conditions in policy are fixed, but also is applicable for ambiguous and unpredictable situations. Moreover, the use of a SVD based-policy system and its attendant efficiencies may be implemented for specific areas of autonomic and on-demand computing such as a feedback loop, as a symptom recognition mechanism, and as a predictive mechanism.
  • The present invention may be applied to other applications, such as applications for selecting preferred parties or persons (from a space of people) with low risks and/or charging them for low fees, for example, for insurance (auto, life) coverage, as well as loan granting or lending.
  • The present invention has been described with reference to diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each diagram can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified herein.
  • These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the functions specified herein.
  • The computer program instructions may also be loaded onto a computer-readable or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified herein.
  • The invention has been described herein with reference to particular exemplary embodiments. Certain alterations and modifications may be apparent to those skilled in the art, without departing from the scope of the invention. The exemplary embodiments are meant to be illustrative, not limiting of the scope of the invention.

Claims (20)

  1. 1. An adaptive policy-based management system for computing systems comprising:
    a means for representing the occurrences of computer system events and action response policies from computing system resources into a first event-policy data structure;
    a means for constructing a second event-policy data structure from said first event-policy data structure, said second event-policy data structure representing an event-policy vector space comprising associative patterns and correlations in the event-policy data;
    a means for receiving observed event data set from a computing system resource;
    a means for recommending a policy for said observed event data set based on existing policy vectors in said constructed event-policy vector space;
    a means enabling updating of said first event-policy data structure and said second event-policy data structure representing said event-policy vector space as new observed event data sets are received, thereby increasing accuracy in generating recommended policies as new event knowledge is input.
  2. 2. The adaptive policy-based management system as claimed in claim 1, further comprising:
    a means for storing received observed data event sets and corresponding action response policies from computing system resources;
    an interface device for enabling a user to review and modify a recommended policy for said observed event data set;
    a means for executing a recommended policy and determining that policy's effectiveness for managing said observed event data set; and,
    if said executed recommended policy is determined effective, updating said storing means with said received observed data event sets and corresponding modified response policies.
  3. 3. The adaptive policy-based management system as claimed in claim 1, wherein said means for recommending a policy for said observed event data set comprises:
    a means for constructing a pseudo-policy vector for an observed event set from data in said event-policy vector space; and,
    a means for determining a recommended policy based on proximity of said pseudo-policy vector and existing policy vectors included in said event-policy vector space.
  4. 4. The adaptive policy-based management system as claimed in claim 3, wherein said means for determining a recommended policy comprises means for applying a similarity metric between said pseudo-policy vector and one or more policy vectors.
  5. 5. The adaptive policy-based management system as claimed in claim 4, wherein said applied similarity metric includes a dot product function, said recommended policy comprising a policy vector based on a resulting dot product value within a threshold value.
  6. 6. The adaptive policy-based management system as claimed in claim 5, wherein more than one policy vectors provide dot product values below said threshold value, said system further comprising means for merging said one or more policy vectors to form a resultant recommended policy.
  7. 7. The adaptive policy-based management system as claimed in claim 3, wherein said means for constructing a pseudo-policy vector for an observed event data set comprises obtaining a centroid of said event data points in said observed event data set and generating an event vector corresponding to said centroid.
  8. 8. The adaptive policy-based management system as claimed in claim 1, wherein said first event-policy data structure comprises an event-policy matrix, said means for constructing a second event-policy data structure from said first event-policy data structure comprises means for implementing Singular Value Decomposition (SVD)] function on said event-policy matrix.
  9. 9. The adaptive policy-based management system as claimed in claim 1, wherein said observed event data set from a computing system resource comprises one or more of: system faults, system status or performance information of said resources.
  10. 10. The adaptive policy-based management system as claimed in claim 1, wherein said observed event data set includes a new event or new event patterns for which no existing policy matching condition exists.
  11. 11. A method for policy-based management of computing systems, said method comprising:
    representing the occurrences of computer system events and action response policies from computing system resources into a first event-policy data structure;
    constructing a second event-policy data structure from said first event-policy data structure, said second event-policy data structure representing an event-policy vector space comprising associative patterns and correlations in the event-policy data;
    receiving observed event data set from a computing system resource;
    recommending a policy for said observed event data set based on existing policy vectors in said constructed event-policy vector space;
    enabling updating of said first event-policy data structure and said second event-policy data structure representing said event-policy vector space as new observed event data sets are received, thereby increasing accuracy in generating recommended policies as new event knowledge is input.
  12. 12. The method as claimed in claim 11, further comprising:
    storing, in a data storage device, received observed data event sets and corresponding action response policies from computing system resources;
    enabling a user to review and modify a recommended policy for said observed event data set via an interface;
    executing a recommended policy and determining a policy's effectiveness for managing said observed event data set; and,
    if said executed recommended policy is determined effective, updating said storing means with said received observed data event sets and corresponding modified response policies.
  13. 13. The method as claimed in claim 11, wherein said recommending a policy for said observed event data set comprises:
    constructing a pseudo-policy vector for an observed event set from data in said event-policy vector space; and,
    determining a recommended policy based on proximity of said pseudo-policy vector and existing policy vectors included in said event-policy vector space.
  14. 14. The method as claimed in claim 13, wherein said determining a recommended policy comprises: applying a similarity metric between said pseudo-policy vector and one or more policy vectors.
  15. 15. The method as claimed in claim 14, wherein said applied similarity metric includes a dot product function, said recommended policy comprising a policy vector based on a resulting dot product value within a threshold value.
  16. 16. The method as claimed in claim 15, wherein more than one policy vectors provide dot product values below said threshold value, said method further comprising: merging said one or more policy vectors to form a resultant recommended policy.
  17. 17. The method as claimed in claim 11, wherein said first event-policy data structure comprises an event-policy matrix, said constructing a second event-policy data structure from said first event-policy data structure comprises implementing a Singular Value Decomposition (SVD)] function on said event-policy matrix.
  18. 18. A program storage device tangibly embodying software instructions which are adapted to be executed by a computing device to perform a method for policy-based management of computing systems according to claim 13.
  19. 19. A method for creating new policies for automated decision-making, the method comprising:
    creating a correlation matrix having entries reflecting the correlation, in a set of existing policies, between a plurality of events and/or circumstances and a plurality of policies;
    determining existence of a match between an observed set of events and/or circumstances against the entries in the correlation matrix, and,
    if there is no exact match between the observed set of events and/or circumstances and the entries in said correlation matrix, then,
    utilizing a singular-value decomposition (SVD) technique for constructing a new policy responsive to the observed set of events and/or circumstances and the correlation matrix.
  20. 20. The method as in claim 19, further comprising: updating the correlation matrix to include the newly-constructed policy.
US11446761 2006-06-05 2006-06-05 Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique Abandoned US20070282778A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US11446761 US20070282778A1 (en) 2006-06-05 2006-06-05 Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11446761 US20070282778A1 (en) 2006-06-05 2006-06-05 Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique
US12131424 US7996353B2 (en) 2006-06-05 2008-06-02 Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12131424 Continuation US7996353B2 (en) 2006-06-05 2008-06-02 Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique

Publications (1)

Publication Number Publication Date
US20070282778A1 true true US20070282778A1 (en) 2007-12-06

Family

ID=38791540

Family Applications (2)

Application Number Title Priority Date Filing Date
US11446761 Abandoned US20070282778A1 (en) 2006-06-05 2006-06-05 Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique
US12131424 Expired - Fee Related US7996353B2 (en) 2006-06-05 2008-06-02 Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique

Family Applications After (1)

Application Number Title Priority Date Filing Date
US12131424 Expired - Fee Related US7996353B2 (en) 2006-06-05 2008-06-02 Policy-based management system with automatic policy selection and creation capabilities by using singular value decomposition technique

Country Status (1)

Country Link
US (2) US20070282778A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010080367A2 (en) * 2008-12-18 2010-07-15 Motorola, Inc. Method and system for recommending policies
US20100205159A1 (en) * 2009-02-10 2010-08-12 Jun Li System and method for managing data
US20110078759A1 (en) * 2009-09-30 2011-03-31 International Business Machines Corporation Method and System For Automating Security Policy Definition Based On Recorded Transactions
US20110219068A1 (en) * 2010-03-02 2011-09-08 International Busiiness Machines Corporation Flexible Delegation of Management Function For Self-Managing Resources
EP2528024A3 (en) * 2011-05-26 2014-12-03 Monolith Technology Services, Inc. Systems and methods for organic knowledge base runbook automation
CN104798082A (en) * 2012-10-01 2015-07-22 诺基亚技术有限公司 Method and apparatus for providing privacy policy for data stream

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9129253B2 (en) * 2005-09-29 2015-09-08 Rpx Clearinghouse Llc Workflow locked loops to enable adaptive networks to change a policy statement responsive to mission level exceptions and reconfigure the software-controllable network responsive to network level exceptions
US20110208779A1 (en) * 2008-12-23 2011-08-25 Backa Bruce R System and Method for Policy Based Control of NAS Storage Devices
US8201029B2 (en) * 2008-01-31 2012-06-12 International Business Machines Corporation Method and apparatus for operating system event notification mechanism using file system interface
US8549654B2 (en) 2008-02-20 2013-10-01 Bruce Backa System and method for policy based control of NAS storage devices
US8631470B2 (en) 2008-02-20 2014-01-14 Bruce R. Backa System and method for policy based control of NAS storage devices
US8234688B2 (en) * 2009-04-03 2012-07-31 International Business Machines Corporation Managing privacy settings for a social network
US9704203B2 (en) 2009-07-31 2017-07-11 International Business Machines Corporation Providing and managing privacy scores
US8769633B1 (en) 2012-12-12 2014-07-01 Bruce R. Backa System and method for policy based control of NAS storage devices
US20170250868A1 (en) 2014-10-31 2017-08-31 Telefonaktiebolaget Lm Ericsson (Publ) Network management using adaptive policy
US9697045B2 (en) 2015-03-24 2017-07-04 International Business Machines Corporation Selecting resource allocation policies and resolving resource conflicts

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5675819A (en) * 1994-06-16 1997-10-07 Xerox Corporation Document information retrieval using global word co-occurrence patterns
US6560597B1 (en) * 2000-03-21 2003-05-06 International Business Machines Corporation Concept decomposition using clustering
US6611825B1 (en) * 1999-06-09 2003-08-26 The Boeing Company Method and system for text mining using multidimensional subspaces
US6701305B1 (en) * 1999-06-09 2004-03-02 The Boeing Company Methods, apparatus and computer program products for information retrieval and document classification utilizing a multidimensional subspace
US20040059966A1 (en) * 2002-09-20 2004-03-25 International Business Machines Corporation Adaptive problem determination and recovery in a computer system
US6792456B1 (en) * 2000-05-08 2004-09-14 International Business Machines Corporation Systems and methods for authoring and executing operational policies that use event rates
US20040243699A1 (en) * 2003-05-29 2004-12-02 Mike Koclanes Policy based management of storage resources
US20050091356A1 (en) * 2003-10-24 2005-04-28 Matthew Izzo Method and machine-readable medium for using matrices to automatically analyze network events and objects
US20050256947A1 (en) * 2004-05-10 2005-11-17 International Business Machines Corporation Method, apparatus, computer program product and web-enabled service providing dynamically adjustable policies
US20060236061A1 (en) * 2005-04-18 2006-10-19 Creek Path Systems Systems and methods for adaptively deriving storage policy and configuration rules
US20070083509A1 (en) * 2005-10-11 2007-04-12 The Boeing Company Streaming text data mining method & apparatus using multidimensional subspaces

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69725995T2 (en) 1996-08-29 2004-11-11 Cisco Technology, Inc., San Jose Spatio-temporal signal processing for transmission systems
DE60309748D1 (en) 2002-03-13 2006-12-28 Raytheon Canada Ltd System and method for noise reduction in pre-processed radar data
US7480912B2 (en) * 2003-05-29 2009-01-20 International Business Machines Corporation Method for policy-based, autonomically allocated storage
EP1667579A4 (en) 2003-09-12 2008-06-11 Bodymedia Inc Method and apparatus for measuring heart related parameters
CA2504333A1 (en) * 2005-04-15 2006-10-15 Symbium Corporation Programming and development infrastructure for an autonomic element
JP5011545B2 (en) 2005-12-05 2012-08-29 国立大学法人京都大学 Singular value decomposition apparatus, and singular value decomposition method
JP4974641B2 (en) 2006-10-24 2012-07-11 三洋電機株式会社 The wireless device
US8271223B2 (en) 2006-11-22 2012-09-18 Parkervision, Inc. Multi-dimensional error definition, error measurement, error analysis, error function generation, error information optimization, and error correction for communications systems

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5675819A (en) * 1994-06-16 1997-10-07 Xerox Corporation Document information retrieval using global word co-occurrence patterns
US6611825B1 (en) * 1999-06-09 2003-08-26 The Boeing Company Method and system for text mining using multidimensional subspaces
US6701305B1 (en) * 1999-06-09 2004-03-02 The Boeing Company Methods, apparatus and computer program products for information retrieval and document classification utilizing a multidimensional subspace
US6560597B1 (en) * 2000-03-21 2003-05-06 International Business Machines Corporation Concept decomposition using clustering
US6792456B1 (en) * 2000-05-08 2004-09-14 International Business Machines Corporation Systems and methods for authoring and executing operational policies that use event rates
US20040059966A1 (en) * 2002-09-20 2004-03-25 International Business Machines Corporation Adaptive problem determination and recovery in a computer system
US20040243699A1 (en) * 2003-05-29 2004-12-02 Mike Koclanes Policy based management of storage resources
US20050091356A1 (en) * 2003-10-24 2005-04-28 Matthew Izzo Method and machine-readable medium for using matrices to automatically analyze network events and objects
US20050256947A1 (en) * 2004-05-10 2005-11-17 International Business Machines Corporation Method, apparatus, computer program product and web-enabled service providing dynamically adjustable policies
US20060236061A1 (en) * 2005-04-18 2006-10-19 Creek Path Systems Systems and methods for adaptively deriving storage policy and configuration rules
US20070083509A1 (en) * 2005-10-11 2007-04-12 The Boeing Company Streaming text data mining method & apparatus using multidimensional subspaces

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010080367A2 (en) * 2008-12-18 2010-07-15 Motorola, Inc. Method and system for recommending policies
WO2010080367A3 (en) * 2008-12-18 2010-09-23 Motorola, Inc. Method and system for recommending policies
US20100205159A1 (en) * 2009-02-10 2010-08-12 Jun Li System and method for managing data
US20110078759A1 (en) * 2009-09-30 2011-03-31 International Business Machines Corporation Method and System For Automating Security Policy Definition Based On Recorded Transactions
US8640195B2 (en) * 2009-09-30 2014-01-28 International Business Machines Corporation Method and system for automating security policy definition based on recorded transactions
US20110219068A1 (en) * 2010-03-02 2011-09-08 International Busiiness Machines Corporation Flexible Delegation of Management Function For Self-Managing Resources
US8719400B2 (en) 2010-03-02 2014-05-06 International Business Machines Corporation Flexible delegation of management function for self-managing resources
US9479389B2 (en) 2010-03-02 2016-10-25 International Business Machines Corporation Flexible delegation of management function for self-managing resources
EP2528024A3 (en) * 2011-05-26 2014-12-03 Monolith Technology Services, Inc. Systems and methods for organic knowledge base runbook automation
CN104798082A (en) * 2012-10-01 2015-07-22 诺基亚技术有限公司 Method and apparatus for providing privacy policy for data stream

Also Published As

Publication number Publication date Type
US20080235168A1 (en) 2008-09-25 application
US7996353B2 (en) 2011-08-09 grant

Similar Documents

Publication Publication Date Title
Karatzoglou et al. Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering
Banerjee et al. Model-based overlapping clustering
Huebscher et al. A survey of autonomic computing—degrees, models, and applications
Chen et al. From CVaR to uncertainty set: Implications in joint chance-constrained optimization
Huang et al. A comparison of collaborative-filtering recommendation algorithms for e-commerce
Becker et al. Transition-independent decentralized Markov decision processes
Cavallanti et al. Linear algorithms for online multitask classification
US7493294B2 (en) Mutually adaptive systems
US7539652B2 (en) Adaptive self-modifying and recombinant systems
US7721336B1 (en) Systems and methods for dynamic detection and prevention of electronic fraud
Deshpande et al. Selective Markov models for predicting Web page accesses
US20100318999A1 (en) Program partitioning across client and cloud
US7526459B2 (en) Adaptive social and process network systems
US20070203872A1 (en) Affinity Propagation in Adaptive Network-Based Systems
Abadi et al. Deep learning with differential privacy
Wang et al. Combining multiobjective optimization with differential evolution to solve constrained optimization problems
US7606772B2 (en) Adaptive social computing methods
Pan et al. A local-best harmony search algorithm with dynamic sub-harmony memories for lot-streaming flow shop scheduling problem
US7577623B2 (en) Method for controlling risk in a computer security artificial neural network expert system
Tsou Multi-objective inventory planning using MOPSO and TOPSIS
WO2005054982A2 (en) Adaptive recombinant systems
Asnar et al. From trust to dependability through risk analysis
Ludwig et al. Swarm intelligence approaches for grid load balancing
US20110112998A1 (en) Methods and systems for variable group selection and temporal causal modeling
Cao et al. Domain-driven, actionable knowledge discovery

Legal Events

Date Code Title Description
AS Assignment

Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHAN, HOI Y.;CHESS, DAVID N.;KWOK, THOMAS Y.;AND OTHERS;REEL/FRAME:018096/0842

Effective date: 20060530