WO2006094224A2 - Systeme de classement informatise possedant une interface de gestion de donnees hierarchique a variables multiples - Google Patents

Systeme de classement informatise possedant une interface de gestion de donnees hierarchique a variables multiples Download PDF

Info

Publication number
WO2006094224A2
WO2006094224A2 PCT/US2006/007720 US2006007720W WO2006094224A2 WO 2006094224 A2 WO2006094224 A2 WO 2006094224A2 US 2006007720 W US2006007720 W US 2006007720W WO 2006094224 A2 WO2006094224 A2 WO 2006094224A2
Authority
WO
WIPO (PCT)
Prior art keywords
rating
value
interface
computer
data
Prior art date
Application number
PCT/US2006/007720
Other languages
English (en)
Other versions
WO2006094224A3 (fr
Inventor
Peter Ohnemus
Henrik Steffensen
David Leason
Original Assignee
Asset4
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/071,980 external-priority patent/US8977615B2/en
Priority claimed from US11/071,978 external-priority patent/US10417700B2/en
Priority claimed from US11/071,981 external-priority patent/US20060200459A1/en
Application filed by Asset4 filed Critical Asset4
Priority to EP06736959.5A priority Critical patent/EP1872328A4/fr
Publication of WO2006094224A2 publication Critical patent/WO2006094224A2/fr
Publication of WO2006094224A3 publication Critical patent/WO2006094224A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising

Definitions

  • the present invention relates to a computer-based rating system, and, more particularly, to a hosted rating system that is configured to manage transformations and presentations of multivariate, hierarchical data to users at client machines through an interface.
  • a discretized chart such as a bar chart
  • Cartesian graphs are severely limited because only three dimensions can be meaningfully rendered in two dimensions, and even a three-dimensional rendering in two dimensions creates distortions in the user's perception of the data being displayed on a monitor attached to a computer.
  • Other coordinate systems such as spherical or cylindrical coordinates, are inadequate because the average person is not familiar enough with the them to quickly and meaningfully extract the data being presented, particularly when more than three variables are being plotted.
  • a computer-based system provides tiered-access to rating data for users at respective client machines who are connected to a distributed computer network.
  • the system includes a host machine in communication with a database configured to store data that is utilized by software on the host machine to transform the data into a rating.
  • a computer-based system can comprise a rating system for rating companies or companies in relation to a sector, industry or other benchmark(s), and can be publicly accessible by plural client machines through a distributed computer network.
  • a host machine having a processor communicates with a database that is configured to store plural indicators, a first portion of which relate to financial data and a second portion of which relate to non-financial data.
  • the processor of the host machine executes software configured to transform prescribed ones of each of the first and second portions of the indicators from the database into a respective integrated rating of a single value for each of the companies.
  • a first interface component that is accessible to all users at respective client machines through the network and is configured to present at least one company name in association with a respective integrated rating at each respective client machine.
  • a second interface component is also accessible to a subset of users at respective client machines and is configured to enable any one of the subset of users to impart an influence to the software that causes the first interface component at only the client machine of such user to present a modified value for the integrated value of the integrated rating.
  • an integrated rating for a company is computed by applying a formula to plural discrete indicators concerning a particular company.
  • the indicators can be retrieved from a database and among them there is a first portion which relate to financial data and a second portion which relate to non-financial data.
  • Users at their respective client machines are presented with a name of the particular company in association with the computed integrated rating through a first interface component that is accessible through the distributed computer network.
  • a subset of the users is selectively permitted to interact with prescribed indicators from which the integrated rating is derived.
  • a system for rating an entity is publicly accessible by users at respective client machines through respective connections to a distributed computer network. At least part of the rating system executes on a host machine with reference to indicators in a database.
  • the system includes a first interface component, such as a query-result component, which is accessible through the distributed computer network.
  • the first interface component is configured to present to the client machine at least one company name in association with a respective integrated rating.
  • a processor is configured by software to compute each respective integrated rating as a single rating value which is derived by application of a first formula to prescribed ones of plural discrete indicators contained in the database.
  • a first portion of the discrete indicators relates to financial data whereas a second portion of the discrete indicators relates to non- financial data.
  • a second interface component (such as an authentication-interface component) is configured to permit only selected users to interact with the prescribed indicators from which the single rating value is derived.
  • the computer-based rating system can include a software module at the host machine as the second interface component which is configured to test any cookie passed from the client machine upon connection to the host machine.
  • the inventive rating system can include a software module at the host machine configured to process user identification information received from the client machine and to include among the selected users any user whose received identification information satisfies at least one prescribed criterion.
  • the rating system can include a third interface component accessible through the distributed computer network at respective client machines that enables users to query the system for specific information.
  • the third interface component can be configured to provide to the host machine a user-input query and to cause the first interface component to present at least one company name in association with the respective integrated rating as search results in an organized arrangement.
  • software executing on a computer system is configured to construct and output a multivariate geometrical rendering of a plurality of variables. An axis is defined for each of the variables being displayed, and a point is defined on each axis corresponding to the value of the respective variable for that axis. Preferably, the axis are generally equidistant. Interpolated segments are generated between the defined points of each pair of adjacent axes such that each segment is spaced from the origin. Collectively, the segments circumscribe the origin, and do not necessarily form a closed path around the origin.
  • each axis extends from the origin in the same plane.
  • the software is configured to connect the interpolated segments with the plotted points to form a closed path around the origin.
  • the interpolated segments may further comprise segments of a polygon.
  • benchmark data may be superimposed on the display for at least one of the variables defined on each axis.
  • One application of this computer system provides a method for multivariate presentation of variables concerning a company's performance includes defining on a display screen an origin having a first value, extending from the origin at least three axes on the display screen, the axes being generally equidistant from each other and representing a respective variable, plotting on the display screen a value of each variable concerning the company as a point on a respective axis, and using the plotted points to interpolate first segments between the axes on the display screen.
  • the first segments can extend to the axes and connect to one another to define polygonal or curved shapes.
  • benchmark information which is extrinsic to the company can be obtained and plotted on the display screen together with the company's performance for ready visual comparison of the company's performance to the obtained benchmark.
  • a mulitvariate graph of variables concerning a company's performance comprises an origin having a first value, at least three axes extending from the origin, the axes being generally equidistant from each other and representing a respective variable concerning the company, a point plotted on each axis corresponding to a value of the respective variables, and a first segment extending between each axis so as to interpolate the plotted points, wherein the origin, axes, plotted points and the first segments are displayed on a display screen.
  • benchmark information which is extrinsic to the company can be plotted together with the company in way that the benchmark information is distinguishable from the first segments of the company's performance graph.
  • software executing on a computer system is configured to expose the parameters and data that are transformed by a hierarchical ratings system into one or more ratings and to output the rating and exposed hierarchical levels through an interface.
  • the interface thus permits a user to zoom in and out to different levels of detail of the underlying hierarchy.
  • the software is configured to present an interface having a button, and, in response to user interaction with the button, expose a next hierarchical level of parameters included in the integrated rating.
  • this aspect of the invention comprises a computer-based navigation interface to a hierarchical rating system for rating companies or companies in relation to sector, industry, or other benchmark(s).
  • the navigation interface comprises a database of parameters having a hierarchy and data within the database which is associated with at least one of the parameters, and software, executing on the processor of the computer, configured to control the interface.
  • the software is configured to transform the data within the parameter hierarchy into a rating value at a first hierarchical level by applying at least a portion of the parameters to a predetermined formula, output the rating value on the display, respond to user interaction with a first virtual button rendered on the display, in response to interaction between the input device and the first virtual button, expose a second hierarchical level comprising each parameter in the portion of parameters included in the rating value, and output at least one parameter in the portion of parameters included in the rating value on the display.
  • the navigation interface thus allows the user to explore the prescribed indicators from which a rating is derived, present at differing depths in a hierarchy of indicators the multivariate relationships among the variables, and permit interaction with the prescribed indicators as noted above.
  • users can be alerted of any changes in the integrated rating value that is computed using the hierarchical data system or in the value of any underlying parameters and data in the hierarchical data system.
  • Each alert can comprise electronic message sent to a user address, and can be conditioned upon satisfying a threshold- change in value.
  • button refers to a control that can be actuated by a user through the interface such as by a single click of a mouse button, hovering over an active region on the display (which is a “virtual button”), or by pressing a particular key or combination of keys on a keyboard.
  • Fig. 1 illustrates an exemplary home or start page in a user interface constructed in accordance with an embodiment of the invention.
  • Fig. 2 illustrates an exemplary search results page in a user interface constructed in accordance with an embodiment of the invention.
  • Fig. 3 illustrates an exemplary rated-company page in a user interface constructed in accordance with an embodiment of the invention.
  • Fig. 4 illustrates further information that can be included on the page of Fig. 3.
  • Fig. 5 illustrates an exemplary page in a user interface constructed in accordance with an embodiment of the invention showing certain parameters and their respective values that govern a rating that has been calculated for a component of the integrated rating in Fig. 3.
  • Fig. 6 illustrates an exemplary further page in a user interface which shows data further down in a hierarchy that underlies the integrated rating in Fig. 3.
  • Fig. 7 illustrates a page providing a different perspective on a rated-company than that of
  • Fig. 3 which may be provided in an interface constructed in accordance with an embodiment of the invention.
  • Fig. 8 illustrates an exemplary further page in a user interface which shows data further down in a hierarchy that underlies the rating in Fig. 7.
  • Fig. 9 illustrates a personalized page which may be provided in an interface constructed in accordance with an embodiment of the invention.
  • Fig. 10 illustrates a portion of a My Ratings page that permits users to select among existing personalized rating criteria or to create new rating criteria.
  • Fig. 11 illustrates details for editing a particular, existing My Rating.
  • Fig. 12 illustrates a selection of My Alerts presentable in an interface constructed in accordance with an embodiment of the invention to permit users to alter personal alerts.
  • Fig. 13 illustrates details for editing a particular, existing My Alert.
  • Fig. 14 illustrates a raw data underlying a particular integrated rating.
  • Fig. 15 illustrates a hierarchy of variables and their organization in accordance with a preferred embodiment of the invention.
  • Fig. 16 illustrates a hardware and software arrangement that is useful in implementing an embodiment of the invention.
  • the present invention provides a configurable computer based user interface to a ratings system which presents integrated ratings of multiple sources of data regarding entities of interest.
  • the integrated ratings are calculated using data and formulae that the user can inspect.
  • the methodology, framework and interface presents an advance in the art by enabling users to explore complex, multivariate data, optionally in relation to the specific categories or in relation to other benchmark(s).
  • the user can alter or filter the underlying data and formulae to arrive at ratings that take into account the user's preferences, perceptions, or hypotheticals.
  • the illustrated embodiment is described in connection with a ratings system that is hosted by a host machine (e.g., a web server) and publicly accessible to users at respective client machines through a connection to a distributed computer network; however, the invention is not so limited in application.
  • the executables that comprise the rating system can run on a stand-alone system and can be provided in a transportable format for local installation by a user, e.g., as a CD-ROM or in some other high-density storage medium.
  • the database can be maintained locally, and the local copy can include information on any companies, sectors or industries that are of interest to a particular user codified as "indicators" and arranged in a hierarchical structure within the database.
  • At least one processor is configured by software to access the database and compute ratings by applying prescribed ones of plural, discrete indicator values to at least a first ratings formula. This results in at least an integrated rating having a single value.
  • This arrangement is particularly amenable to a pay-as-you go model in which users are charged for each company that they wish to inspect, though that same model can be used in a remote, hosted embodiment.
  • the ratings system regardless of where it resides, preferably is in communication with an update software module that provides or can obtain electronically current information on the companies being watched, and current, pertinent benchmark information, and news alerts, if desired.
  • Figures 1-16 represent one possible application of this invention applied to the financial sector.
  • the example embodiments include the consideration of financial and non- financial data concerning a company, business sector, or industry.
  • a company's economic, environmental, social, and corporate governance performance, as well as statistics relating to one or more of these four "pillars,” can be objectively analyzed.
  • users of an interface constructed in accordance with an embodiment of the invention can be presented with an authentication-interface component on a page 100 which permits the visitor to login can comprise suitable boxes for entering an account identifier 102 and a password 104 and then pressing a submit button 106.
  • the authentication-interface component can include a software module that tests a cookie passed from the client machine upon connection to the host. Cookie technology is well understood in the art and is not described herein.
  • This interface component sets or establishes users as "registered" users once they or their machines have satisfied at least one prescribed criterion.
  • the "registered" status of a user enables the software of the rating system to control access through the interface by permitting only selected users to interact with indicators in the manner described hereinbelow in connection with Figs. 3-14.
  • further buttons can be provided on the page 100 to initiate a new-user registration.
  • a query-interface component can comprise a search-query text box 108 for entering a search query and a search submit button 110.
  • This interface component can be provided on the page 100 that permits visitors to enter searches and receive limited information in response.
  • registered users have access to more information and reports than do visitors because their identification information has been processed by the authentication-interface component software.
  • the page 100 preferably is a home page served from a host server that manages the rating systems to multiple, geographically distributed, compliant client machines used by respective users. More preferably, page 100 is a web page constructed using HTML and/or DHTML, and optionally includes active elements such as ActiveX controls or Applets to provide a rich and dynamic presentation of ratings and relevant information and to include at least a portion of the executable code of the rating system as code resident for execution at the client machine .
  • the page 100 preferably includes links 120 to direct users to further web pages that convey information to the user such as: the analytics and variables utilized in rating companies; information about the host provider (herein, referred to as the "Independent Rating Company" or "IRC"); investor relations information; and pertinent news articles.
  • the remainder of the page can include text and graphics 130 that inform the user of the capabilities or features of the ratings system.
  • search results are provided at the client machine by a Q-results interface component in a search results page 200 as shown in Fig. 2.
  • search queries can be permitted that present integrated ratings for companies that satisfy the search criteria.
  • the search query "office” may result in one-hundred matching companies including, among others, "3M" and "ABB.”
  • the search query is presented in title line 202 and the results including the integrated rating for each company in association with the company name are displayed in an organized arrangement, such as shown in table 204.
  • the company names and ratings can be associated in the same row of the table 204.
  • a preview pane 206 can be provided to provide an abbreviated story or headline on a recent news item.
  • the preview pane can be configured as a pop-up alert or dialog box which the user can select or close, and which can close automatically if not selected within a period of time.
  • Visitors, and more preferably registered users can be permitted to select (e.g., click) the preview pane and be directed to the complete story.
  • only registered users are able to explore the search results in table 204 beyond what is presented in page 200, e.g., to review the four pillars that comprise the integrated rating or the indicators that underlie the pillars.
  • visitors can be presented with an integrated rating expressed as a single rating value in an alphabetic format.
  • registered users can alter coefficient values and/or weightings ascribed to the indicators that are utilized in arriving at the single value rating, and these altered values/weightings are then used by a now different ratings formula to compute customized ratings, including integrated ratings, component ratings in each of the four pillars of economic, environmental, social, and corporate governance, as well as with regard to categories that concern those pillars.
  • the customized ratings result from a formula that differs from the rating system formula in the value or weighting (collectively referred to as "value") of at least one coefficient and this "different" formula can be applied in lieu of the rating system formula that is utilized in computing single rating values for non-registered visitors.
  • Each user can compute a personalized score that expresses his or her own ideology or institutional preference/perspective, and these customizations can be saved under one or more "MyRatings" tabs.
  • a rated-company page 300 can be served to the client machine in a number of ways, including by selecting an entry in the table 204 or by selecting an entry in a My Companies list 910, as described below in connection with Figure 9.
  • a variety of features are available to the registered users that enable various interactions between the user and the indicators from which the single rating value is derived.
  • the interface component software permits interaction based on the status of the user as "registered,” and as such the features described in connection with Figs. 3-14 are responsive to permissions established by the authentication component.
  • the rated-company page 300 provides certain basic information 302 about the company being rated including its name, sector, industry, and base country in which it has its headquarters of operation. (The sector and industry that a particular company belongs to can be determined from the Global Industry Classification Standard ("GICS") code for that company.) This basic information 302 is provided in the first four columns of table 204 to all visitors. There are also links to a corporate web site 304 and to stock information 306 concerning the company.
  • the rating for a company displayed on page 300 (in this case, "3M") is for a specific period, and as can be appreciated, a company's rating can vary depending on the window of time under analysis.
  • a user can select a period for analysis using pull-down list 308, and the ratings for the company are refreshed to coincide with the selected time period.
  • the user has other options available for selection, such as to send the present page to a printer (button 310), to add the company to the My Companies list (button 312), and to set alerts for this company (button 314).
  • the rated-company page also includes a general description 316 of the company and its industry.
  • the rated-company page 300 includes an integrated rating of the company's extra- financial performance, which is expressed and displayed both as a letter grade 320 and also as a numeric grade or scale 322.
  • the integrated rating is computed by the rating system on the basis of inspectable coefficients and weightings that are applied to the underlying data.
  • Integrated ratings based on other settings established by registered users can be presented under the My Ratings tab 324, such as in the My Ratings table 326 which shows a higher performance rating ("A") as compared to that computed by the rating system ("C”), as shown at 320.
  • the integrated rating 320 is preferably computed from individual ratings in four principal areas of corporate endeavor, namely, economic (which includes conventional financial data such as earnings per share, revenue, profit/loss, as well as more long term oriented qualitative information such as brands, consumer complaints, accounting practices, etc.), environmental (which includes emission levels, regulatory compliance, etc.), social (which includes workforce issues such as labor, gender and non-discriminatory corporate practices, etc.), and corporate governance (which includes board composition, written policies, management , etc.).
  • These so-called "pillars” are preferably computed as component ratings and are thereafter combined in a prescribed manner (as described in the aforementioned co-pending application which has been incorporated by reference) to define the integrated rating.
  • the pillars each have a letter grade 330, and any change 332 upward or downward in that component's rating and the date 334 of such change are preferably shown.
  • each pillar can be explained on the rated-company page 300 or on a separate page.
  • Fig. 4 illustrates further, optional information that can be displayed to the user to explain the pillars.
  • the Economic Performance rating concerns a company's capacity to generate high returns on investments.
  • the rating system utilizes indicators that focus on long term revenue growth and margin improvements through tangible and intangible elements that do not systematically appear in financial statements.
  • This pillar includes financial data and no non-financial data whereas the remaining pillars concern non-financial data, optionally in combination with financial data.
  • the Environmental Performance rating concerns a company's impact on living and non-living natural systems, including ecosystems, land, air and water.
  • Certain environmental aspects are associated with a company's competitiveness and financial performance (e.g., level of CO 2 emission) and the rating system utilizes indicators that are relevant to these factors.
  • the Social Performance rating concerns a company's impact on the social systems within which it operates. Social performance can be gauged through an analysis of the company's impact on stakeholders.
  • the main stakeholders addressed in the social pillar are the workforce, the society as a whole and of course the customers, as reflected by the selected indicators used by the rating system.
  • social indicators influence the company's intangible assets, such as its human capital and reputation.
  • the Corporate governance Performance rating examines indicators relating to the systems and processes that a company has in place to ensure that a company's directors and manager act in the interests of a company, its shareholders, and other stakeholders, and to ensure the mechanisms are in place so as to hold managers accountable to investors for the use of assets.
  • Each of the pillars is a variable composed of one or more categories of indicators that can be manipulated through weightings, coefficients or mathematics to influence their impact on the numerical grade 322 of the integrated rating.
  • each of the pillars and most of the variables used in the rating system comprises a calculation that is based upon values or settings of two or more underlying indicators whose values/settings can be inspected by the user.
  • the underlying parameters that are transformed into the rating can be displayed in the computer interface by selecting a button (e.g., a virtual button) associated with the rating.
  • a button e.g., a virtual button
  • the second hierarchical level of parameters used in computing the rating can be displayed.
  • the software can further be configured to present a second virtual button associated with one of the parameters of the second hierarchical level exposed by interacting with the first virtual button. Navigation of the hierarchy in this manner can also expose the underlying data associated with each parameter. Repeated interaction with the interface permits a user to view the integrated rating and meaningfully navigate the hierarchy of parameters and data that is utilized in computing the rating down to the most fundamental data elements that comprise the rating.
  • each pillar can be displayed by selecting a pillar from the page 300.
  • This causes the hierarchy of parameters that comprise the value of each pillar to be displayed with each successive selection until the basic source of data for a given parameter has been displayed.
  • a user can "drill down" and inspect the data underlying a rating, and can alter the value or weighted importance of a given indicator for display as a My Rating.
  • the user can select the Environmental Performance pillar 360 by clicking on that portion of the display and be presented with further details on the data underlying that rating, as discussed in connection with Fig. 5 below.
  • the interface can permit dynamic interaction with a hierarchical data set.
  • the interface preferably allows a user to expand the data corresponding to meta-data or parameters (e.g., a company's environmental pillar rating) utilized in computing the integrated rating.
  • meta-data or parameters e.g., a company's environmental pillar rating
  • Traditional systems have required massive spreadsheets or multiple charts to navigate through underlying information concerning a rating create substantial difficulties in their logistical representation and dilute a user's contextual understanding of how the current level of hierarchical data fits into the overall computation of a rating.
  • An interface in accordance with this aspect of the invention can preserve this context by presenting an easily navigable interface for "drilling down" into the underlying data, through which the user will know the level of the hierarchy being presented and how the user arrived at this level.
  • the user can be provided with the formula used to arrive at the rating and optionally with the ability to change the formula so as to influence the transformation of data and metadata into a rating.
  • software executing on a computer system is configured to construct and output a multivariate geometrical rendering of a plurality of variables.
  • An axis is defined for each of the variables being displayed, and a point is defined on each axis corresponding to the value of the respective variable for that axis.
  • One or more additional axes can be used to represent a transformation of the underlying data into a statistical parameter or another calculated value.
  • the axis are generally equidistant.
  • Interpolated segments are generated between the defined points of each pair of adjacent axes such that each segment is spaced from the origin. Collectively, the segments circumscribe the origin, and do not necessarily form a closed path around the origin.
  • Figure 3 illustrates this aspect of the invention as applied to the financial sector.
  • the integrated rating 320 and the four pillars 330 are displayed together in a multi-axis graph 350.
  • the graph 350 has one axis for each of the four variables that comprise the pillars, and, preferably (as shown), an additional axis for the integrated rating which comprises a statistical parameter.
  • the statistical parameter is derived from each of the pillar-variables.
  • the axes are preferably equidistantly spaced and extend from a common origin having a first value, which value can be defined to be zero if the rating values are on a scale that starts at zero.
  • the numeric grade 322 of the integrated rating is plotted on the axis labeled "Overall," and the numeric grades that correspond to each of the pillars is plotted on a respective axis of the graph.
  • segments are plotted that interpolate between the plotted points on each of the axes.
  • linear segments connect the plotted points, as shown, to present the multiple variables being plotted as a polygon 352 representative of the company's EESG performance.
  • arcuate segments can extend between the plotted points or segments can be plotted on the graph and remain unconnected to the plotted points.
  • an "A" rating under corporate governance results in a point plotted far from the origin and causes an expansion and stretching of the visual polygon image 352.
  • the visual presentation of indicia "adjacent to" the axis so long as the user perceives the value of the variable in relation to the axis.
  • the axis of the multivariate display are rendered in the same plane, so that the information contained therein can be comprehensibly displayed on a two-dimensional computer display.
  • a three-dimensional projection onto the two- dimensional computer screen may be used as well.
  • the axis of the graph which would project out of the plane of the computer display, and the data represented on that axis, would be distorted, thereby detracting from the ease with which the invention conveys multivariate data to the user.
  • the values of more than three variables are rendered by the multivariate graph the difficulty of meaningfully representing more than three axis in a two dimensional plane is compounded.
  • a three-or-more-dimensional display would only increase the distortions of the data.
  • the geometrical rendering of the polygon is somewhat arbitrary. Specifically, because the axes can be defined in any order, clockwise or otherwise, about the origin, the precise shape of the polygon for a particular set of values will depend on the order of the axes.
  • the software can further be configured to order the axes based rules or user preferences.
  • the axes can be arranged in view of the magnitude of the value of each variable to form a generally convex polygon, minimizing the occurrence of segment intersections that have an interior angle greater than 180°.
  • the software can arrange the axes to group categories together or order by time or importance.
  • the software is configured to overlay multiple data on the multivariate graph thereby aiding in the comparison of multiple data sets.
  • the overlaid data may include benchmark data.
  • benchmark information is coordinated with the company rating to provide the user with insight as to the relative performance of the company.
  • the benchmark information can concern a competitive company, a sector or an industry, but in any case the benchmark information is extrinsic to the company meaning that it is information that is not the same in many if not all respects to that which is used to rate the company.
  • the rating system obtains the benchmark information from a database, for the relevant time period set in box 308, and preferably superimposes on the graph 350 the benchmark performance for each of the variables that is plotted for the company.
  • points are plotted for each of the variables (e.g., the overall and E, E, S, and G variables) in the graph 350, and the space between the axes is interpolated or interconnected to form a polygon (or closed-curved object) 354 in a manner that permits the company's performance to be readily distinguished and compared to that of the benchmark data by the user.
  • the variables e.g., the overall and E, E, S, and G variables
  • a legend 356 informs the user which color, tick-mark, lines, or shapes are associated with the company under analysis and which is associated with the benchmark.
  • the benchmark can be compared with the company's performance in other ways, such as by way of bell curves; however, the graph 350 provides a two-dimensional visual representation of the comparative performance in each of the variables that are presently under inspection.
  • the graph 350 shows comparative performance with respect to each of the four pillars and the overall rating, whereas at a lower-level, such as discussed in connection with Fig. 5 below, the comparative performance can visually represent particular variables that underlie the integrated rating.
  • a great number of benchmarking possibilities can be presented to the user for comparing the performance of a company against extrinsic information.
  • a non-limiting set of possibilities includes a comparison to the universe of all or selected companies in the database, to all or select companies from a chosen country, to all companies from a chosen industry (even an industry different than the company's GICS classification), to a specific company or companies, to the best in the class of the company being inspected, to personal benchmark criteria, to other companies being tracked by the user in the user's My Companies list 910 (discussed below), in relation to one or more of the user's personalized My Ratings, and to combinations of these possibilities.
  • Figure 5 illustrates a page 500 which includes further details concerning one of the pillars, including the variables that resulted in the Environmental rating "E.”
  • the page 500 can include other information such as the basic company information 302, etc., but has been abbreviated in order to focus on the additional features added by this page.
  • details of the Environmental Performance are shown, for example, as a result of click-selecting pillar 360 from page 300.
  • the variables being inspected in the hierarchical list 510 are distinguished from higher-level variables, for example, by indenting the variables being displayed on the remainder of the page.
  • the integrated rating 320 is at the top of the hierarchy, followed by the pillars, and then categories and downward to the basic indicators.
  • Environmental Performance 562 is indented in the hierarchical list 510.
  • the Environmental performance of the company is shown as a letter grade 520 in the title line and also as a numeric grade 522.
  • the performance is also illustrated in a table 570 which shows the company's score in each of eight categories of information that is used in the grades 520, 522 (and hence integrated rating grades 320, 322).
  • the table 570 further shows comparative performance of the company to the grades received in its industry and sector.
  • the numerical grades set forth in the table are used as values in a graph 550 which plots the company's performance 552 in correlation with the industry average 554, as described above in connection with graph 350.
  • the graph 550 there are nine axes, one for each category being plotted as a variable, and another for an overall rating which is a statistic derived from the other variables.
  • a registered user can inspect and optionally alter the numerical values for any one or more of the categories/indicators or change their respective influence on the overall Environmental Performance calculation. For instance, if energy, water and transport parameters are not perceived as pertinent to a particular user, then the resulting rating for the company would compare substantially more favorably to the relevant industry in the illustrated example.
  • the user can be permitted to experiment with alterations to the quantified data for a given company to see how such changes affect the ratings, without disrupting the real data in the database used by all users.
  • the user can get a "sandbox" version of a company, e.g. by clicking an icon on a report page. This action causes a copy all the quantified data from the company to the "sandbox," which the user can then play with by changing the data values.
  • a sandbox company is user-specific and can only be seen and modified by the user who created it.
  • Figure 6 illustrates a page 600 showing a lower level in the hierarchy which provides the user with data on certain indicators within the category of biodiversity 662, namely the "EN24" family of indicators 664.
  • the EN24 indicators are a subset of indicators derived from the Global Reporting Initiative ("GRI") framework; thus, reference can be had to the GRI framework of indicators; however, a preferred embodiment utilizes a different set of fewer indicators, as described herein. Which particular indicators are included in a category is decided by the rating system provider, but can be edited by the user through My Ratings. Exemplary categories and indicators are listed in the table below.
  • GRI Global Reporting Initiative
  • the page 600 provides a letter grade 620, a numerical grade 622, a table 670 comparable to grades 520, 522 and table 570, except of course now relating specifically to the EN24 indicator in this illustrated page.
  • the data in the table 670 can be charted.
  • the EN24.1 and EN24.2 values can be charted, as previously described, on separate axes and the overall composite of those parameters can be charted on an additional axis, if desired.
  • a visual presentation of multivariate data is perceived as being more helpful to users when the number of parameters is greater, as in Figs. 3 and 5.
  • a page 700 provides one additional or alternative perspective to the integrated rating page 300 discussed above, and can serve as a home page for a given user who prefers this perspective (e.g., the page presented upon selecting the home key from page 100 or upon selecting a search result from table 204).
  • the value drivers are those aspects of EESG information that are material to the performance of companies which are included in the database.
  • Financial analysts, asset managers, issuers, CFOs and others can use the value driver tools which permit selection of parameters as a complementary overlay to existing financial services that they receive.
  • the EESG information of the company relating to risks, opportunities/EPS (earnings per share) and intangibles can reside in several categories, including: reputation risk, product risk, regulation risk, crisis management systems, non- compliance, stakeholder defection, and resource dependency.
  • the value drivers can be benchmarked to industry, sector, etc., as described above.
  • a hierarchical list 710 of the value drivers of risk, opportunity and intangibles permits a user to select a list member and inspect the parameters that result in that member's rating.
  • the Value Driver Performance rating is expressed, as before, both as a letter grade 720 and as a numerical grade 722.
  • the time period under analysis, 308 and a general description 316 of the company and its industry are preferably provided on this page, as is a multivariate chart 750 of the three principal variables and their overall rating of the company 752 in coordination with, but distinguished from, the industry average 754 (with a suitable legend 756 identifying what has been charted).
  • Fig. 8 the parameters that underlie the Risk variable are provided in a page 800.
  • the Risk variable 860 has been selected (from page 700) and is shown expanded to reveal the Crisis Management Risk category 862 which is computed from nine variables to have a Crisis Management Risk Performance letter grade 820 and a Crisis Management Risk Performance numerical grade 822.
  • a chart 850 has each of these variables as an axis extending from a common origin; however, in contrast to previously described charts, the chart 850 does not include a plot of any statistics apart from the eight variables.
  • a table 870 includes the numeric and letter grades of the company, its industry, and its sector, and the numeric grades provide values for coordinating industry or sector performance with that of the company.
  • the personalized page 900 includes navigation keys 120, search box 108, and further includes three principal features: a My Companies list 910, a My Alerts list 920 and a My Ratings button 930.
  • the My Companies list provides a summary of the integrated ratings for a selected list of companies.
  • a full view button 912 provides further details on the selected companies, for example, in a format similar to that shown in table 204 (Fig. 2).
  • the My Alerts list 920 provides a summary of the user-alerts that have been established for particular companies by the user, and a full view button 922 provides a more detailed view of the general settings of each alert, and can be in the format shown in Fig. 12, for example.
  • the My Ratings button 930 presents a page or frame to the user, as shown in Fig. 10, which allows the user to select from existing personalized ratings criteria or to create new criteria.
  • users may wish to define their own ratings criteria to apply to particular companies, industries, or sectors to suit their preferences, beliefs and perspectives.
  • the user can revise a particular one of his or her My Ratings, and such changes are then available to the user simply by selecting the desired My Rating from table 326 (which appears on a number of pages in the user interface).
  • a web page or frame is presented to the user which is populated with the existing My Rating information for the selected My Rating.
  • the user can then edit that data by changing the existing data in the fields 1110, 1120, 1130 of the data record, or change the formula that governs the rating calculation (see, again, the co-pending application for discussion on formula editing) by clicking on the proceed to formula editor button 1140.
  • the user can delete the data record using the remove button 1150, or cancel the operation using the cancel button 1160.
  • the user can be provided with an alert report page or frame with information such as shown in Fig. 12.
  • the alert report page itemizes by alert name the companies that have user-established alerts associated with them, the basis upon which to generate an alert message (e.g., based on ratings change activity in environmental performance, EN24.2, or any other parameter in the ratings system), and the trigger for the alert (any change, only when there has been an upgrade, only when there has been a downgrade).
  • alert report watch list which can be an animation advising the user whether he or she has an unread alert
  • notes section 1220 Preferably the alert name, company name, report item, alert type, status, and notes are combined into data records that are managed by the ratings system and stored in a database, and, more preferably, a central database.
  • Fig. 13 shows a checklist that can be completed in order to set parameters for a user- established alert, including how and to where the alerts are to be sent.
  • check boxes permit entry of the trigger type and threshold values that must be satisfied, whether as a grade change (namely, a numerical amount, say, a change from 0.0 to 0.1 or from 0.1 to 0.3) or a rating change (namely, an alphabetical grade change, say, from A downgraded to B or from E upgraded to D), and check and text boxes for selecting the format for the alert and providing a destination address (e.g., an email or phone number).
  • a grade change namely, a numerical amount, say, a change from 0.0 to 0.1 or from 0.1 to 0.3
  • a rating change namely, an alphabetical grade change, say, from A downgraded to B or from E upgraded to D
  • check and text boxes for selecting the format for the alert and providing a destination address (e.g., an email or phone number).
  • Fig. 14 shows raw data underlying the integrated rating of a company, which in the illustrated case is "3M."
  • the raw data page identifies for a selected period of time a particular indicator 1410 and an explanation of what it represents, a source 1420 for the value or setting used by the rating system (e.g., a corporate web site), textual data 1430 explaining significance (e.g., whether this indicator bears on one of the value drivers), comments, files, data status and the quality of the information.
  • a source 1420 for the value or setting used by the rating system e.g., a corporate web site
  • textual data 1430 explaining significance (e.g., whether this indicator bears on one of the value drivers)
  • comments e.g., whether this indicator bears on one of the value drivers
  • comments e.g., comments, files, data status and the quality of the information.
  • Raw data for a company can be established in the rating system database using a raw data tool which provides a structure for the data and content of the information of concern.
  • the information structure can be a data record organized as shown follows: Number: LA91
  • Indicator type Core Indie, desc: Average hours of training per year per employee by category of employee
  • the raw data concerning a particular company (Roche) that comprises the content for such a record might read as follows:
  • the indicator data consists of raw and quantified data.
  • Raw data consists of textual information about the indicators such as shown in the above excerpted statement in the example of a Roche accounting report.
  • Quantified data comprise numeric or yes/no values, which can be manually derived from the raw data or from its status if the data is incomplete.
  • a rating can have a predefined value or a calculated value from related indicators. For example, one indicator question might be "Does the company publish information about CO2 emission?,” and if the answer to this is "yes" some other indicators about CO2 will count in the rating; otherwise, the rating is accorded the predefined value .
  • Fig. 15 shows a hierarchical relationship among the parameters that are combined into an integrated rating. At the top of the hierarchy is the integrated rating 320, 322. The integrated rating is calculated using a formula provided by the rating system, as may be optionally modified by the user. The four pillars provide the principal variable values which are combined by the formula into the integrated rating. For simplicity, Fig. 15 shows one of the pillars. Each pillar receives parameters from one or more categories, though only one category is shown, again for simplicity. In the preferred embodiment, there are four pillars and eighteen categories, under each of which are prescribed indicators, as shown in the table below.
  • the categories are an amalgam of variables, some of which are "outcome” parameters which have values associated with them, and others are “driver” parameters which have a yes/no state setting associated with them.
  • Outcome and driver parameters receive their values from indicators.
  • Driver indicators (always yes/no) are about the policies, management systems and tools employed by the company's management with the intent to improve an issue (which is codified in the rating system as a "category").
  • Driver indicators measure the company's real intentions and commitments.
  • Outcome indicators (Value or yes/no) measure if the company has successfully achieved an improvement on a particular issue.
  • Outcome indicators measure observable results which provide indications on the company's standing in respect to a specific issue (again, which is included as a "category" in the rating system).
  • the rating system uses a set of indicators to arrive at the integrated ratings described herein.
  • the type of indicators that have been selected for use in a preferred embodiment of the present rating system are described within their respective categories as follows:
  • Product Indicators show: general commitment towards Innovation environmental products/services innovation; environmental efficient products (eco-design, life cycle assessment-LCA, dematerialization, extended durability, emission reduction by product use, etc).
  • Workforce/ Indicators show: general commitment towards training and Training and development (education); developing skills and Development competencies (occupational, human or social relations and communication), encompassing programs to support the career development and continued employability of employees and to manage career endings.
  • Workforce/ Indicators show: general commitment towards diversity and Diversity and opportunity: promoting an effective balance between Opportunity personal (family-friendly policies, vacations, part-time, flex- time, career breaks, maternity leave, sabbatical etc.) and professional development (career planning); promotion of diversity and opportunity (equal treatment between women and men) and tackling other forms of discrimination or harassment as in the case of unfair treatment of people with disabilities, or because of age, ethnicity, 'race', nationality, religion, or sexual orientation.
  • Each category starts off with the same 4 driver-indicators: Policy, Implementation, Monitoring, Improvements).
  • the rest of the indicators in a category are outcome indicators and can be yes/no questions or double questions or amounts, ratios, etc.
  • An outcome indicator's value can be Not Available (“NA”) or Not Relevant (“NR").
  • NA means that there is no answer to the value for the question.
  • NR means there is a value but it is not relevant (e.g. CO2 emission by a banking entity which is not particularly relevant since this is not a manufacturing entity, but still is reported by some banking entities).
  • the rating system calculates the performance, the transparency, the changes over time (“delta”), and the exposure due to particularly lagging performances ("relative standing”) of the data in the indicator.
  • the underlying data that is sought from a company to populate a given indicator will either be relevant or not relevant. If relevant, the question remains whether there is information or not to populate that indicator. If there is relevant information, then the performance value will go up or down depending on the data itself, and the transparency value will go up because there is public reporting of a relevant datum. If the relevant information is not available, there is no change to the performance value as there is no data upon which to base a change, but the transparency value will go down because there is no public reporting of a relevant datum. On the other hand, even if the information is not relevant, the content of the data itself can impact the performance value, and the transparency value goes up because the data, though not relevant to this company or sector or industry, is reported.
  • the outcome calculation can include the delta and relative standing parameters or these can be calculated separately.
  • “Delta” is the measurement of changes (improvements or deterioration) of the performance of that indicator over time. If a company has increased its performance over the past year then it gets a bonus in terms of an improved score for doing so. Conversely the company is penalized if its performance has deteriorated.
  • the "relative standing" component of the algorithm preferably operates to penalize companies that show particularly bad performance in individual indicators as compared to a benchmark.
  • the high exposure that a company can face due to having the worst performance in individual indicators is also taken in account in the outcome grade of a category because if a company is in, say, the lowest 1-5% quartile for a certain indicator, that is indicative of potentially higher risk exposure.
  • Fig. 16 shows a hardware and software arrangement that can be used to implement a hosted rating system as described herein.
  • a portal 1610 which preferably includes the interface pages described above and is therefore web-browser compliant, and, more preferably, compatible with Microsoft's Internet Explorer 6.0, and the Firefox LINUX Web browser.
  • Communications proceed through a secure socket connection from remotely distributed client machines at the portal through a firewall 1620 to a Web server 1630.
  • the web server communicates with an application server 1640 (e.g., a Tomcat server that supports JSP/Services) through standard protocols, and preferably exchanging rich text using XML structures.
  • the server 1640 communicates with a central database 1650, e.g., a Sequel database, through JDBC.
  • a central database 1650 e.g., a Sequel database
  • users access the portal 1610 through a standard client machine such as a personal computer, personal digital assistant, or other device compliant with the web server 1630.
  • a standard client machine such as a personal computer, personal digital assistant, or other device compliant with the web server 1630.
  • User authentication and validation services can take place after which the user is permitted to inspect data underlying ratings for one or more companies, create use and store alerts and rating criteria and export data to their local machine.
  • Ratings can be presented numerically, alphabetically, or alpha-numerically.
  • the system can be configured so that visiting, non-registered users, are presented only top-level integrated ratings , if even that.
  • the system can also be configured to allow such a subset of users or a different subset of users to impart an influence to the software that results in a modified value for the single value of the integrated rating to be presented to that user. For example, a user that is a member of the prescribed subset can be permitted to impart a change to one of the indicators (or to a coefficient value in a formula that operates upon such indicator in computing the rating), and only that user will be presented with the resulting integrated rating.
  • the system can accept and utilize a user- selected formula to transform the indicators into the single value integrated rating.
  • Selected users can further provide the system with or simply select/establish at least one benchmark criterion.
  • the system can be configured so as to present, for at least one of the companies presented to the client machine, a respective integrated rating in coordination with the benchmark criterion.
  • requests received through the portal are transferred over to the server 1640 at which calculations of ratings are performed for the requested/prevailing time period, for the company or companies that are in the scope of the user's request (e.g., the companies in any search results or the companies in a My Companies list).
  • the server 1640 retrieves stored criteria from the database 1650 and applies that criteria to stored data for the company or companies that are in the scope of the user's request.
  • the server 1640 also manages any other personalization (including any alerts) that the user may have set, so that messages can be sent (or be attempted to be sent) to the user regardless of whether the user is presently logged onto the rating system.
  • the charts and rating calculations can be performed at the client machine through an Applet, ActiveX component, or by executing a stand-alone application or XML within the client's local machine environment.
  • Such distributed computation will reduce the load on the host machine, thus allowing the system to service a greater number of users and larger quantities of data.
  • these activities are performed by the server 1640 and forwarded through the web server 1630 to the client machine for presentation through the user interface.
  • a "My Key Numbers” button or selection list can be included on one or more pages of the interface.
  • "My key numbers” can be a pull-down list provided on the home rating page of each company accessed by the user.
  • the user can define certain indicators, categories, or ratings for inclusion in this list or for that particular company.
  • the user could select CO2 emissions, the Social pillar, and the category "human rights" for GM Corporation while the same or different selections can be stored as the key numbers for other companies.
  • all textual data is stored in Unicode, a text format that provides a unique number for every character across platforms, programs and languages.
  • all time data is stored in the UTC time format
  • all pixel-based graphical data is stored in PNG
  • all image (photographic) data is stored in JPEG.
  • all data creation, modification and deletion in the system is logged with timestamp, user, original data, etc. to enable tracking of any activity in the rating system. This information can also be used for user-access control and billing.
  • the rating system can provide reports to the user which concern a single company or a group of companies - e.g., within an industry, country, etc.
  • the time frame for a given report can be for a current year or other time windows of longer scope depending on values entered into the period box 306.
  • Reports and charts can be exported for use in other applications such as Microsoft Excel or Adobe Acrobat (i.e., in pdf format).
  • the report can include either detailed or summary information, archival data including historical ratings, and possibly also some or all of the raw data.
  • 1650 can be exported, including raw and quantified data and calculated values.

Abstract

L'invention concerne un système de classement informatisé configuré pour gérer des données hiérarchiques à variables multiples via une interface. L'interface présente des transformations des données hiérarchiques qui peuvent être effectuées sur la machine hôte et être transformées en des données entièrement nouvelles ainsi que des formes de présentation qui peuvent permettre aux utilisateurs sur des machines clientes d'effectuer une ou plusieurs interrogations différentes, y compris l'inspection de la base de calcul pour les transformations, l'exposition des informations hiérarchiques sous-jacentes à une valeur de classement déterminée, et l'interaction avec un ou plusieurs de ces paramètres visant à influencer la valeur de classement déterminée présentée à un utilisateur donné. Dans des aspects plus particuliers, le système de classement peut comprendre des commandes pour limiter le cercle des utilisateurs qui peuvent influencer le calcul des valeurs de classement. L'interface du système de classement peut être configurée pour fournir aux utilisateurs des rendus géométriques à variables multiples, éventuellement avec des informations statistiques ou de référence qui seront également rendues, au moyen des données hiérarchiques et des transformations de données décrites ici.
PCT/US2006/007720 2005-03-03 2006-03-03 Systeme de classement informatise possedant une interface de gestion de donnees hierarchique a variables multiples WO2006094224A2 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP06736959.5A EP1872328A4 (fr) 2005-03-03 2006-03-03 Systeme de classement informatise possedant une interface de gestion de donnees hierarchique a variables multiples

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US11/071,980 US8977615B2 (en) 2005-03-03 2005-03-03 Zoom interface component for integrated rating system
US11/071,981 2005-03-03
US11/071,980 2005-03-03
US11/071,978 US10417700B2 (en) 2005-03-03 2005-03-03 System and method for graphical display of multivariate data
US11/071,978 2005-03-03
US11/071,981 US20060200459A1 (en) 2005-03-03 2005-03-03 Tiered access to integrated rating system

Publications (2)

Publication Number Publication Date
WO2006094224A2 true WO2006094224A2 (fr) 2006-09-08
WO2006094224A3 WO2006094224A3 (fr) 2009-04-02

Family

ID=36941876

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2006/007720 WO2006094224A2 (fr) 2005-03-03 2006-03-03 Systeme de classement informatise possedant une interface de gestion de donnees hierarchique a variables multiples

Country Status (2)

Country Link
EP (1) EP1872328A4 (fr)
WO (1) WO2006094224A2 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2112626A1 (fr) 2008-04-23 2009-10-28 Asset4 Système d'estimation informatique et procédé doté d'un filtre quartile-médian

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5675746A (en) * 1992-09-30 1997-10-07 Marshall; Paul S. Virtual reality generator for use with financial information
US20040249697A1 (en) * 2004-03-03 2004-12-09 Peter Ohnemus Sustainability ratings and benchmarking for legal entities

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5675746A (en) * 1992-09-30 1997-10-07 Marshall; Paul S. Virtual reality generator for use with financial information
US20040249697A1 (en) * 2004-03-03 2004-12-09 Peter Ohnemus Sustainability ratings and benchmarking for legal entities

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2112626A1 (fr) 2008-04-23 2009-10-28 Asset4 Système d'estimation informatique et procédé doté d'un filtre quartile-médian
US8560377B2 (en) 2008-04-23 2013-10-15 Asset4 Computer-based rating system and method having mid-quartile filter

Also Published As

Publication number Publication date
EP1872328A4 (fr) 2017-08-09
WO2006094224A3 (fr) 2009-04-02
EP1872328A2 (fr) 2008-01-02

Similar Documents

Publication Publication Date Title
US11727480B2 (en) System and method for graphical display of multivariate data
US8977615B2 (en) Zoom interface component for integrated rating system
US20060200459A1 (en) Tiered access to integrated rating system
Malik Enterprise dashboards: design and best practices for IT
US6647390B2 (en) System and methods for standardizing data for design review comparisons
Gotzamani Results of an empirical investigation on the anticipated improvement areas of the ISO 9001: 2000 standard
US8346569B2 (en) System and method for creating a dynamic customized employment profile and subsequent use thereof
US7747572B2 (en) Method and system for supply chain product and process development collaboration
US7168045B2 (en) Modeling business objects
US7840896B2 (en) Definition and instantiation of metric based business logic reports
US20080183564A1 (en) Untethered Interaction With Aggregated Metrics
US7519539B1 (en) Assisted profiling of skills in an enterprise management system
Lane Democratizing our data: A manifesto
US20080172348A1 (en) Statistical Determination of Multi-Dimensional Targets
CN101517603A (zh) 内容分发系统及其方法
US10592472B1 (en) Database system for dynamic and automated access and storage of data items from multiple data sources
Dawes et al. The value and limits of government information resources for policy informatics
Ducq* et al. Definition and aggregation of a performance measurement system in three aeronautical workshops using the ECOGRAI method
US20220058552A1 (en) Project management system, method of operating project management system, and non-transitory computer-readable medium
Musenze et al. Development and validation of a total quality management model for Uganda’s local governments
Amariles et al. Legal indicators in transnational law practice: a methodological assessment
Collier et al. The evaluation and audit of management information systems
WO2006094224A2 (fr) Systeme de classement informatise possedant une interface de gestion de donnees hierarchique a variables multiples
Umemiya et al. National GHG inventory capacity in developing countries–a global assessment of progress
AZHAR et al. FINTECH ADOPTION IN ACCOUNTING: A STUDY OF MILLENNIALS’AND GEN-ZS’READINESS IN MALAYSIA

Legal Events

Date Code Title Description
NENP Non-entry into the national phase in:

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2006736959

Country of ref document: EP

NENP Non-entry into the national phase in:

Ref country code: RU