WO2015137970A1 - Qualitative and quantitative modeling of enterprise risk management and risk registers - Google Patents
Qualitative and quantitative modeling of enterprise risk management and risk registers Download PDFInfo
- Publication number
- WO2015137970A1 WO2015137970A1 PCT/US2014/028160 US2014028160W WO2015137970A1 WO 2015137970 A1 WO2015137970 A1 WO 2015137970A1 US 2014028160 W US2014028160 W US 2014028160W WO 2015137970 A1 WO2015137970 A1 WO 2015137970A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- risk
- user
- analysis
- users
- distribution
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
Definitions
- the present invention is in the field of corporate finance, corporate capital investments, economics, math, risk analysis, simulation, decision analysis, and business statistics, and relates to the modeling and valuation of investment decisions under uncertainty and risk within all companies, allowing these firms to properly identify, assess, quantify, value, diversify, and hedge their corporate capital investment decisions and their associated risks.
- the present invention looks at starting from a comprehensive qualitative risk register and moving the analysis into the realms of quantitative risk modeling, simulation, and optimization.
- PEAT Project Economics Analysis Tool
- a computer-implemented system for qualitative and quantitative modeling of risk management comprising: a processor, and a enterprise risk management (ERM) risk register module comprising computer-executable instructions stored in non-volatile memory, wherein the processor and the ERM risk register module are operably connected and configured to: provide a user interface to a user, wherein the user interface is a risk register that allows the user to organize and manage one or more risk elements, receive risk element input from the user, wherein the risk element input is comprised of the one or more risk elements entered by the user, analyze the risk element input, wherein a risk analysis is performed on each of the one or more risk elements, create risk analysis charts, wherein one or more graphs are generated based on the risk analysis of each of the one or more risk elements, and analyze risk level trends of the one or more risk elements, wherein in patterns of change in risk level for the one or more risk elements can be plotted over time, forecast changes in the risk level of the one or more risk elements, wherein the ERP risk management (ERM) risk register module comprising
- the computer-implemented system is further comprised of a communications means operably connected to the processor and the ERM risk module.
- the one or more risk elements can be segmented and managed according to one or more of i) by company, ii) by division, iii) by geography, operations, product line, activity, and department, and iv) by risk categories.
- the user interface is further configured to allow the user to manage and designate authorized users and risk managers.
- the one or more graphs are selected from the group of graphs comprising bar graphs, heat map matrixes, pareto charts, scenario tables, tornado charts, and pie charts.
- each of the heat map matrixes is a key risk indicator heat map that is color coded to detail a plurality of risk levels.
- the key risk indicator heat map is organized by risk classification categories based on the plurality or risk levels.
- the ERM module and the processor are further configured to send an alert when the risk level of the one or more risk elements exceeds a stipulated risk level limit.
- the ERM module is a network based module for basic inputs by end users.
- the ERM module is a local module for administrative use.
- a computer-implemented method for qualitative and quantitative modeling of risk management comprising the steps of: providing a user interface to a user, wherein the user interface is a risk register that allows the user to organize and manage one or more risk elements, receiving risk element input from the user, wherein the risk element input is comprised of the one or more risk elements entered by the user, analyzing the risk element input, wherein a risk analysis is performed on each of the one or more risk elements, creating risk analysis charts, wherein one or more graphs are generated based on the risk analysis of each of the one or more risk elements, analyzing risk level trends of the one or more risk elements, wherein in patterns of change in risk level for the one or more risk elements can be plotted over time, forecasting changes in the risk level of the one or more risk elements, wherein the risk level trends are evaluated to provide a predictive analysis of future risk level change of the one or more risk elements, and recommending one or more risk mitigation programs based on the risk level trends and the predictive analysis of
- the one or more risk elements can be segmented and managed according to one or more of i) by company, ii) by division, iii) by geography, operations, product line, activity, and department, and iv) by risk categories.
- the user interface is further configured to allow the user to manage and designate authorized users and risk managers.
- the one or more graphs are selected from the group of graphs comprising bar graphs, heat map matrixes, pareto charts, scenario tables, tornado charts, and pie charts.
- each of the heat map matrixes is a key risk indicator heat map that is color coded to detail a plurality of risk levels.
- the key risk indicator heat map is organized by risk classification categories based on the plurality or risk levels.
- the computer-implemented method further comprises the step of sending an alert when the risk level of the one or more risk elements exceeds a stipulated risk level limit.
- FIG. 1 illustrates a schematic overview of a computing device.
- FIG. 2 illustrates a network schematic of a system.
- FIG. 3 illustrates the Project Economics Analysis Tool (PEAT) utility's starting screen.
- PEAT Project Economics Analysis Tool
- FIG. 4 illustrates the main PEAT utility.
- FIG. 5 illustrates the Full Screen grid pop-up.
- FIG. 6 illustrates the Cash Flow Ratios calculation.
- FIG. 7 illustrates the Economic Results of each option.
- FIG. 8 illustrates the Information and Details tab.
- FIG. 9 illustrates the Portfolio Analysis of multiple Options.
- FIG. 10 illustrates the Customs Calculation tab.
- FIG. 11 illustrates the Global Settings section.
- FIG. 12 illustrates the Weighted Average Cost of Capital or WACC calculations.
- FIG. 13 illustrates the Beta calculations.
- FIG. 14 illustrates the Input Assumptions for an oil and gas model.
- FIG. 15 illustrates the Portfolio Analysis calculations for the oil and gas module.
- FIG. 16 illustrates the Applied Analytics section for running Tornado Analysis.
- FIG. 17 illustrates the Scenario Analysis input settings.
- FIG. 18 illustrates the Scenario Analysis output tables and results.
- FIG. 19 illustrates the Risk Simulation tab for setting up Monte Carlo risk simulations.
- FIG. 20 illustrates the Risk Simulation results.
- FIG. 21 illustrates the Custom Text properties.
- FIG. 22 illustrates the Overlay Results.
- FIG. 23 illustrates the Analysis of Alternatives.
- FIG. 24 illustrates the Dynamic Sensitivity Analysis computations.
- FIG. 25 illustrates the Options Strategies tab.
- FIG. 26 illustrates the Options Valuation tab's inputs and settings.
- FIG. 27 illustrates the Options Valuation tab's Sensitivity analysis subtab.
- FIG. 28 illustrates the Options Valuation tab's Tornado analysis subtab.
- FIG. 29 illustrates the Options Valuation tab's Scenario analysis subtab.
- FIG. 30 illustrates the Forecast Prediction's Main Dataset and Statistics tabs.
- FIG. 31 illustrates the Forecast Prediction's Visualize and Charts subtabs.
- FIG. 32 illustrates the Forecast Prediction's Command Console.
- FIG. 33 illustrates the Portfolio Optimization's Optimization Settings tab.
- FIG. 34 illustrates the Optimization Results tab.
- FIG. 35 illustrates the Advanced Custom Optimization's Optimization Method routines.
- FIG. 36 illustrates the Advanced Custom Optimization's Decision Variables setup.
- FIG. 37 illustrates the Advanced Custom Optimization's Constraints setup.
- FIG. 38 illustrates the Advanced Custom Optimization's Objective.
- FIG. 39 illustrates the Knowledge Center's Step-by-Step Procedures.
- FIG. 40 illustrates the Knowledge Center's Basic Project Economics Lessons.
- FIG. 41 illustrates the Knowledge Center's Getting Started Videos.
- FIG. 42 illustrates the Report Settings setup.
- FIG. 43 illustrates the Risk Register's levels and categories schema.
- FIG. 44 illustrates the online Web-based login for the online Risk Register Webpage.
- FIG. 45 illustrates the Global Administrator view to Manage Client Companies Webpage.
- FIG. 46 illustrates the Manage Users Webpage.
- FIG. 47 illustrates the Manage Divisions Webpage.
- FIG. 48 illustrates the Manage G.O.P.A.D. Webpage.
- FIG. 49 illustrates the Manage Risk Categories Webpage.
- FIG. 50 illustrates the Manage Risk Mapping and Connections Webpage.
- FIG. 51 illustrates the Manage Risk Contacts Webpage.
- FIG. 52 illustrates the Manage Risk Register Webpage.
- FIG. 53 illustrates the desktop software's Global Settings.
- FIG. 54 illustrates the desktop software's Key Risk Indicator customization and setup.
- FIG. 55 illustrates the desktop software's Risk Groups setup.
- FIG. 56 illustrates the desktop software's Risk Mapping settings.
- FIG. 57 illustrates the desktop software's Risk Register entry and management screen.
- FIG. 58 illustrates the desktop software's Dashboard on Risk Elements.
- FIG. 59 illustrates the desktop software's Dashboard on Risk Mapping (KRI).
- FIG. 60 illustrates the desktop software's Dashboard on Risk Groups.
- FIG. 61 illustrates the desktop software's Dashboard on Risk Exposure.
- FIG. 62 illustrates the desktop software's Dashboard on Risk Taxonomy.
- FIG. 63 illustrates the desktop software's Dashboard on Risk Data results.
- FIG. 64 illustrates the desktop software's Risk Engagement's Pre-Engagement page.
- FIG. 65 illustrates the desktop software's Risk Engagement's Engagement Assessment.
- FIG. 66 illustrates the desktop software's Risk Engagement's Lessons Learned page.
- FIG. 67 illustrates the desktop software's Risk Controls page.
- FIG. 68 illustrates the desktop software's Risk Forecasts page.
- FIG. 69 illustrates the desktop software's Risk Diagrams page.
- FIG. 70 illustrates the desktop software's Risk Mitigation analysis page.
- the present invention is applicable in the fields of corporate finance, corporate capital investments, economics, math, risk analysis, simulation, decision analysis, and business statistics, and relates to the modeling and valuation of investment decisions under uncertainty and risk within all companies, allowing these firms to properly identify, assess, quantify, value, diversify, and hedge their corporate capital investment decisions and their associated risks.
- the computer-implemented system and methods herein described may comprise one or more separate and individually executable applications.
- a computing device 001 appropriate for use with embodiments of the present application may generally comprise one or more central processing units (CPU) 002, random access memory (RAM) 003, and a storage medium (e.g., hard disk drive, solid state drive, flash memory, cloud storage) 004.
- CPU central processing units
- RAM random access memory
- storage medium e.g., hard disk drive, solid state drive, flash memory, cloud storage
- Examples of computing devices usable with embodiments of the present invention include, but are not limited to, personal computers, smartphones, laptops, mobile computing devices, tablet PCs, and servers.
- computing device may also describe two or more computing devices communicatively linked in a manner as to distribute and share one or more resources, such as clustered computing devices and server banks/farms.
- resources such as clustered computing devices and server banks/farms.
- data may be provided to the system, stored by the system, and provided by the system to users of the system across local area networks (LANs, e.g., office networks, home networks) or wide area networks (WANs, e.g., the Internet).
- LANs local area networks
- WANs wide area networks
- the system may comprise numerous servers communicatively connected across one or more LANs and/or WANs.
- the system and methods provided herein may be consumed by a user of a computing device whether connected to a network or not.
- some of the applications of the present invention may not be accessible when not connected to a network; however, a user may be able to compose data offline that will be consumed by the system when the user is later connected to a network.
- FIG. 2 a schematic overview of a system in accordance with an embodiment of the present invention is shown.
- the system consists of one or more application servers 007 for electronically storing information used by the system.
- Applications in the application server 007 may retrieve and manipulate information in storage devices and exchange information through a WAN 005 (e.g., the Internet).
- Applications in a server 007 may also be used to manipulate information stored remotely and to process and analyze data stored remotely across a WAN 005 (e.g., the Internet).
- exchange of information through the WAN 005 or other network may occur through one or more high-speed connections.
- high-speed connections may be over-the-air (OTA), passed through networked systems, directly connected to one or more WANs 005, or directed through one or more routers 006.
- Router(s) 006 are completely optional, and other embodiments in accordance with the present invention may or may not utilize one or more routers 006.
- server 007 may connect to a WAN 005 for the exchange of information
- embodiments of the present invention are contemplated for use with any method for connecting to networks for the purpose of exchanging information.
- this application refers to high-speed connections
- embodiments of the present invention may be utilized with connections of any speed.
- components of the system may connect to a server 007 via a WAN 005 or other network in numerous ways.
- a component may connect to the system (i) through a computing device 008, 009, 010 directly connected to the WAN 005; (ii) through a computing device 007 connected to the WAN 005 through a routing device 006; (iii) through a computing device 012, 013, 014 connected to a wireless access point 011; or (iv) through a computing device 011 via a wireless connection (e.g., CDMA, GMS, 3G, 4G) to the WAN 005.
- a wireless connection e.g., CDMA, GMS, 3G, 4G
- a component may connect to a server 007 via a WAN 005 or other network, and embodiments of the present invention are contemplated for use with any method for connecting to a server 007 via a WAN 005 or other network.
- a server 007 could be a personal computing device, such as a smartphone, tablet PC, or laptop or desktop computer, acting as a host for other computing devices to connect to.
- FIG. 3 illustrates the Project Economics Analysis Tool (PEAT) software utility 015 and 016.
- PEAT Project Economics Analysis Tool
- this utility is designed to apply Integrated Risk Management methodologies (Monte Carlo risk simulation, strategic real options, stochastic and predictive forecasting, business analytics, business statistics, business intelligence, decision analysis, and portfolio optimization) to project and portfolio economics and financial analysis 017.
- the PEAT utility can house multiple industry-specific or application-specific modules 018 such as oil and gas industry models (industry specific) or discounted cash flow model (application specific).
- the utility can house multiple additional types of models (industry or application specific) as required.
- the user can choose the model desired and create a new model from scratch, open a previously saved model, load a predefined example, or exit the utility 019.
- additional industry-specific, solution-specific, or generic models can be added as new modules to the system.
- One such new module is the Enterprise Risk Management's Risk Register module to be discussed later in this disclosure.
- FIG. 4 illustrates the main PEAT utility 020 where its menu items 021 are fairly straightforward (e.g., File
- the software is also arranged in a tabular format. There are three tab levels 022, 023, 024 in the software, and a user would proceed from top to bottom and left to right when running analyses in the utility. Referring to FIG. 4, for instance, a user would start with the Discounted Cash Flow (Level 1) tab 022, select Custom Calculations or Option 1 in (Level 2) 023, and begin entering inputs in the 1. Discounted Cash Flow (Level 3) subtab 024.
- Level 3 subtab 024 The user would then proceed to the 2. Cash Flow Ratios (Level 3) subtab 024, and then on to the 3. Economic Results (Level 3) subtab 024, and so forth.
- Level 3 subtab 024 When the lowest level subtabs are completed, the user would proceed up one level and continue with Option 2 (Level 2), Option 3 (Level 2), Portfolio Analysis (Level 2) 023, and so forth.
- these tabs at Level 2 are completed, the user would continue up a level to the Applied Analytics (Level 1) tab 022, and proceed in the same fashion. All Level 1 tabs are identical regardless of the Module (e.g., Discounted Cash Flow [DCF] Model or Oil and Gas [O&G] Model) chosen 018 as illustrated in FIG. 3, except for the first tab (Discounted Cash Flow) 022.
- DCF Discounted Cash Flow
- O&G Oil and Gas
- FIG. 4's Discounted Cash Flow section is at the heart of the analysis' input assumptions.
- a user would enter his or her input assumptions, such as starting and ending years of the analysis, the discount rate to use, and the marginal tax rate 025, and set up the project economics model (adding or deleting rows in each subcategory of the financial model 026).
- Additional time-series inputs are entered in the data grid 027 as required, while some elements of this grid are intermediate computed values.
- the entire grid can be copied and pasted into another software application such as Microsoft Excel, Microsoft Word, or other third-party software applications, or can be viewed in its entirety as a full screen pop-up 028.
- the user can also identify and create the various Options 023, and compute the economic and financial results such as Net Present Value (NPV), Internal Rate of Return (IRR), Modified Internal Rate of Return (MIRR), Profitability Index (PI), Return on Investment (ROI), Payback Period (PP), and Discounted Payback (DPP).
- NDV Net Present Value
- IRR Internal Rate of Return
- MIRR Modified Internal Rate of Return
- PI Profitability Index
- ROI Return on Investment
- PP Payback Period
- DPP Discounted Payback
- the Options menu 021 when the user is in any of the Options tabs, the Options menu 021 will become available, ready for users to add, delete, duplicate, or rename an option or rearrange the order of the Option tabs by first clicking on any Option 023 tab and then selecting Options 021 and selecting Add, Delete, Duplicate, Rearrange, or Rename Option from the menu.
- all of the required functionalities such as input assumptions, adding or reducing the number of rows, selecting discount rate type, or copying the grid are available within each Option tab.
- the input assumptions entered in these individual Option tabs 023 are localized and used only within each tab, whereas input assumptions entered in the Global Settings (to be discussed later in FIG. 11) tab apply to all Option tabs simultaneously.
- the user will need to enter all the required inputs, and if certain cells are irrelevant, users will have to enter zero. Users can also increase or decrease the number of rows for each category as required.
- the DCF Starting Year input is the discounting base year, where all cash flows will be present valued to this year.
- the main categories are in boldface, and the input boxes under the categories are for entering in the line item name/label 027. Users can click on Copy Grid 028 to copy the results into the Microsoft Windows clipboard in order to paste into another software application such as Microsoft Excel or Microsoft Word.
- FIG. 5 illustrates the Full Screen grid pop-up 029. This is to facilitate the viewing of the model in its entirety without the need to scroll to the left/right or up/down.
- the grid will be maximized to full view and also facilitates the taking of screenshots.
- FIG. 6 illustrates the Cash Flow Ratios calculation 030.
- this tab is where additional balance sheet data can be entered 031 (e.g., current asset, shares outstanding, common equity, total debt, etc.) and the relevant financial ratios will be computed 032 (EBIT, Net Income, Net Cash Flow, Operating Cash Flow, Economic Value Added, Return on Invested Capital, Net Profit Margin, etc.). Computed results or intermediate calculations are shown as data grids. Data grid rows are color coded by alternate rows for easy viewing. As usual, Copy Grid 033 can be clicked to copy the computations to the Microsoft Windows clipboard from which the computations can then be pasted into another third-party software application such as Microsoft Excel.
- users can enter the input assumptions as best they can, or they can guess at some of these figures to get started.
- the inputs entered in this Cash Flow Ratios subtab will be used only in this subtab's balance sheet ratios.
- the results grid shows the time series of cash flow analysis for the Option for multiple years. These are the cash flows used to compute the NPV, IRR, MIRR, and so forth.
- users can Copy Grid or View Full Grid 033 of the results.
- FIG. 7 illustrates the Economic Results of each option 034.
- This Economic Results (Level 3) subtab shows the results from the chosen Option and returns the Net Present Value (NPV), Internal Rate of Return (IRR), Modified Internal Rate of Return (MIRR), Profitability Index (PI), Return on Investment (ROI), Payback Period (PP), and Discounted Payback Period (DPP) 039.
- NDV Net Present Value
- IRR Internal Rate of Return
- MIRR Modified Internal Rate of Return
- PI Profitability Index
- ROI Return on Investment
- PP Payback Period
- DPP Discounted Payback Period
- An NPV Profile table 038 and chart 043 are also provided, where different discount rates and their respective NPV results are shown and charted. Users can change the range of the discount rates to show/compute 040 by entering the "From/To" percent and clicking on Update, copy the results 044, and copy the NPV Profile chart, as well as use any of the chart icons 042 to manipulate the chart's look and feel (e.g., change the chart's line/background color, chart type, or chart view, or add/remove gridlines, show/hide labels, and show/hide legend). Users can also change the variable to display in the chart 041.
- users can change the chart from displaying the NPV Profile to the time-series charts of net cash flows, taxable income, operating cash flows, cumulative final cash flows, present value of the final cash flows, and so forth. Users can then click on the Copy Results or Copy Chart buttons 044 to take a screenshot of the modified chart that can then be pasted into another software application such as Microsoft Excel or Microsoft PowerPoint.
- FIG. 8 illustrates the Information and Details 045 tab. Users would apply this tab for entering justifications for the input assumptions used as well as any notes on each of the Options. For numerical calculations and notes, use the Custom Calculations tab (FIG. 10) instead. Users can also change the labels and Categories 047 of the Information and Details tab by clicking on Categories and editing the default labels. The formatting of entered text can be performed in the Description 046 box by clicking on the various text formatting icons.
- FIG. 9 illustrates the Portfolio Analysis 048 of multiple Options.
- This Portfolio Analysis tab returns the computed economic and financial indicators such as NPV, IRR, MIRR, PI, ROI, PP, and DPP 051 for all the Options combined into a portfolio view (these results can be stand-alone with no base case or computed as incremental 049 values above and beyond the chosen base case 050).
- the Economic Results (Level 3) subtabs show the individual Option's economic and financial indicators, whereas this Level 2 Portfolio Analysis 048 view shows the results of all Options' indicators and compares them side by side. There are also two charts 052 available for comparing these individual Options' results.
- the Portfolio Analysis tab is used to obtain a side- by- side comparison of all the main economic and financial indicators of all the Options at once. For instance, users can compare all the NPVs from each Option in a single results grid.
- the bubble chart on the left provides a visual representation of up to three chosen variables 053 at once (e.g., the y-axis shows the IRR, the x-axis represents the NPV, and the size of the bubble may represent the capital investment; in such a situation, one would prefer a smaller bubble that is in the top right quadrant of the chart).
- These charts have associated icons 055 that can be used to modify their settings (chart type, color, legend, and so forth). As usual, chart icons, Copy Grid, and Copy Chart 054 are available for use in this tab.
- FIG. 10 illustrates the Customs Calculation tab 056 also available for making the user's own custom calculations 057 just as users would in a Microsoft Excel spreadsheet.
- Clicking on the Function F(x) button 058 will provide users with a list of the supported functions 059 that can be used in this tab.
- a manual Update Calculations 060 can be clicked to update the worksheet's calculations.
- users use this optional Custom Calculations tab and wish to link some cells to the input tabs (e.g., Option 1), they can select the cells in the Custom Calculations tab, right-click, and select Link To. Then they would proceed to the location in the Option tabs and highlight the location of the input cells they wish to link to, right-click, and select Link From. Any subsequent changes users make in the Custom Calculations tab will be updated in the linked input assumption cells.
- the preset functions can be seen by clicking on the F(x) the button.
- a user may enter the following: 1, 2, 3, into cells Al, Bl, CI, respectively. Then, select these three cells, right-click, and select Link To. Proceed to any one of the Option tabs, and in the Discounted Cash Flow or Input Assumptions subtabs, select three cells across (e.g., on the Revenue line item), right-click, and select Link From.
- the values of cells Al, Bl, CI in the Custom Calculations tab will be linked to this location. Users can go back to the Custom Calculations tab and change the values in the original three cells and they will see the linked cells in the Discounted Cash Flow or Input Assumptions subtabs change and update to reflect the new values.
- FIG. 11 illustrates the Global Settings 062 section within the Project Economics module 061, which is only available in the Oil and Gas module and which comprises three subtabs.
- the Global Assumptions 063 subtab requires users to enter the global inputs that apply across all Options to be analyzed later, including, but not limited to, the various discount rates 064, discounting convention 065, depreciation rates 066, precision decimal settings 067, simulation settings 068, 069, 070, and model notes 071.
- FIG. 12 illustrates the Global Settings 072 tab where the Weighted Average Cost of Capital or WACC 073 calculations are housed.
- this is an optional set of analytics whereby users can compute the firm's WACC to use as a discount rate. Users start by selecting either the Simple WACC or Detailed WACC Cost Elements 074. Then, they can either enter the required inputs or click on the Load Example 075 button to load a sample set of inputs that can then be used as a guide to entering their own set of assumptions 076 and additional settings 077.
- FIG. 13 illustrates the Beta calculations 079 within the Global Settings 078 tab.
- This is another optional subtab used for computing the Beta risk coefficient by pasting in historical stock prices or stock returns to compute the Beta 081, and a time-series chart 086 provides a visual for the data entered.
- the resulting Beta is used in the Capital Asset Pricing Model (CAPM), one of the main inputs into the WACC model. Users start by selecting whether they have historical Stock Prices or Stock Returns 083, then enter the number of Rows (periods) 080 of historical data they have, Paste the data into the relevant columns, and click Compute 084. Users can also click on Load Example 082 to open a sample dataset.
- the Beta coefficient result 085 will update and users can use this Beta as an input into the WACC model.
- the WACC and BETA calculations are available under the Discount Rate subtab of the main DCF tab.
- FIG. 14 illustrates the input assumptions 088 for an oil and gas module.
- the module can contain multiple Options 087 where each Option is considered to either be a stand-alone capital investment strategy or related to other Options.
- Project or Option Name 089 starting and ending years for the cash flow model 090, project notes 091, discount rate selection 092, number of line items in each subcategory of capital investments, revenues, and expenses 093 are first entered or selected. The user would then enter the required inputs, such as revenues, expenses, and capital investments 096, not forgetting the special Depreciation % and Escalation % columns. The user will have to scroll to the right to continue entering input assumptions in the out-years.
- the Discount Rate drop-down list defaults to the Corporate Rate 092 entered in the Global Settings tab, but users can change the rate to use here for this Option.
- Each Option can have a different discount rate (e.g., if the Options have different risk structures, their respective discount rates should be allowed to differ, with the exception that when all Options are considered at par in terms of risk or a global corporate weighted average cost of capital is used).
- the user can select the Auto-Fill checkboxes 094 if required.
- the auto-fill function allows users to enter a single value on a line item and all subsequent years on the same line item will be automatically filled with the same value.
- the data grid can be copied or viewed full screen 097.
- FIG. 15 illustrates the Portfolio Analysis 098 calculations for the oil and gas module.
- this Portfolio Analysis tab returns the computed economic and financial indicators such as NPV, IPvR, MIRR, PI, ROI, PP, and DPP for all the Options 101 combined into a portfolio view (these results can be stand-alone with no base case or computed as incremental 099 values above and beyond the chosen base case 100).
- the Economic Results (Level 3) subtabs show the individual Option's economic and financial indicators, whereas this Level 2 Portfolio Analysis view shows the results of all Options' indicators and compares them side by side. There are also two charts available for comparing these individual Options' results.
- the Portfolio Analysis tab is used to obtain a side-by-side comparison of all the main economic and financial indicators of all the Options at once. For instance, users can compare all the NPVs from each Option in a single results grid.
- the bubble chart on the left 102 provides a visual representation of up to three selected variables 103 at once (e.g., the y-axis shows the IRR, the x-axis represents the NPV, and the size of the bubble may represent the capital investment; in such a situation, one would prefer a smaller bubble that is in the top right quadrant of the chart).
- chart icons 104, Copy Grid, and Copy Chart 103 are available for use in this tab.
- FIG. 16 illustrates the Applied Analytics 105 section, which allows users to run Tornado Analysis and Scenario Analysis 106 on any one of the Options previously modeled— this analytics tab is on Level 1, which means it covers all of the various Options on Level 2. Users can, therefore, run Tornado or Scenario on any one of the Options.
- Tornado Analysis 108 is a static sensitivity analysis of the selected model's output to each input assumption, performed one at a time, and ranked from most impactful to the least. Users start the analysis by first choosing the output variable to test from the drop-down list 107.
- the user can change the default sensitivity settings 109 of each input assumption to test and decide how many input assumption variables to chart 109 (large models with many inputs may generate unsightly and less useful charts, whereas showing just the top variables reveals more information through a more elegant chart). Users can also choose to run the input assumptions as unique inputs, group them as a line item (all individual inputs on a single line item are assumed to be one variable), or run as variable groups (e.g., all line items under Revenue will be assumed to be a single variable) 110. Users will need to remember to click Compute 111 to update the analysis if they make any changes to any of the settings.
- the sensitivity results are also shown as a table grid 112 at the bottom of the screen (e.g., the initial base value of the chosen output variable, the input assumption changes, and the resulting output variable's sensitivity results).
- users can Copy Chart or Copy Grid 111 results into the Microsoft Windows clipboard for pasting into another software application.
- the following illustrates the Tornado chart characteristics 108:
- Each horizontal bar 108 indicates a unique input assumption that constitutes a precedent to the selected output variable 112.
- the x-axis represents the values of the selected output variable. The wider the bar chart 108, the greater the impact/swing the input assumption has on the output 112.
- a green bar on the right indicates that the input assumption has a positive effect on the selected output (conversely, a red bar indicates a negative effect).
- FIG. 17 illustrates the Scenario Analysis 113, which can be easily performed through a two-step process: identify the model input settings 114 and run the model to obtain scenario output tables 114.
- Scenario Input Settings 114 subtab users start by selecting the output variable 1 15 they wish to test from the drop-down list. Then, based on the selection, the precedents of the output 116 will be listed under two categories (Line Item, which will change all input assumptions in the entire line item in the model simultaneously, and Single Item, which will change individual input assumption items).
- Users select one or two checkboxes 1 16 at a time and the inputs they wish to run scenarios on, and enter the plus/minus percentage to test and the number of steps between these two values to test. Users can also add color coding of sweetspots or hotspots 1 17 in the scenario analysis (values falling within different ranges have unique colors). Users can create multiple scenarios 120 and Save As 1 19 each one (enter a Name and model notes 1 18 for each saved scenario 120).
- FIG. 18 illustrates the Scenario Output Tables 122 to run the saved Scenario Analysis 121 models. Users click on the drop-down list 123 to select the previously saved scenarios to Update 123 and run. The selected scenario table complete with sweetspot/hotspot color coding 125 will be generated. Decimals 124 can be increased or decreased as required, and users can Copy Grid or View Full Grid 127 as needed. To facilitate review of the scenario tables, a Note provides the information of which input variable is set as the rows versus columns 126. The following are some notes on using the Scenario Analysis methodology:
- the scenario settings can be saved for retrieval in the future, which means users can modify any input assumptions in the Options models and come back to rerun the saved scenarios.
- Line Items can be changed using ⁇ X% where all inputs in the line are changed multiple times within this specific range all at once. Individual Items can be changed ⁇ 7units where each input is changed multiple times within this specific range.
- Sweetspots and hotspots refer to specific combinations of two input variables that will drive the output up or down. For instance, suppose investments are below a certain threshold and revenues are above a certain barrier. The NPV will then be in excess of the expected budget (the sweetspots, perhaps highlighted in green). Or if investments are above a certain value, NPV will turn negative if revenues fall below a certain threshold (the hotspots, perhaps highlighted in red).
- FIG. 19 illustrates the Risk Simulation 128 section, where Monte Carlo risk simulations can be set up and run.
- users can set up probability distribution assumptions on any combinations of inputs, run a risk simulation tens to hundreds of thousands of trials, and retrieve the simulated forecast outputs as charts, statistics, probabilities, and confidence intervals in order to develop comprehensive risk profiles of the Options.
- the Set Input Assumptions 129 subtab users start the simulation analysis by first setting simulation distributional inputs here (assumptions can be set to individual input assumptions in the model or as an entire line item 131). Users click on and choose one Option 130 at a time to list the available input assumptions.
- the software supports up to 50 probability distributions
- the most commonly used and applied distributions include Triangular, Normal, and Uniform 133.
- the user if the user has historical data available, he or she can use the Forecast Prediction (FIGS. 30-32) tab to perform a Distributional Fitting to determine the best-fitting distribution to use as well as to estimate the selected distribution's input parameters. Multiple simulation settings can be saved such that they can be retrieved, edited, and modified as required in the future. Users can select either Simulate All Options at Once or Simulate Selected Option Only, depending on whether they wish to run a risk simulation on all the Options that have predefined simulation assumptions or to run a simulation only on the current Option that is selected.
- FIGS. 30-32 Forecast Prediction
- FIG. 20 illustrates the Risk Simulation Results 141.
- the utility will automatically take the user to the Simulation Results tab.
- the user first selects the output variable 142 to display using the drop-down list.
- the simulation forecast chart 143 is shown on the left, while percentiles 144 and simulation statistics 145 are presented on the right.
- Users can change and update the chart type (e.g., PDF, CDF) 146, enter Percentiles (in %) or Certainty Values (in output units) 147 on the bottom left of the screen (remembering to click Update 146 when done) to show their vertical lines on the chart, or compute/show the Percentiles/Confidence levels 148 on the bottom right of the screen (selecting the type, Two Tail, Left Tail, Right Tail 146, then either entering the percentile values 148 to auto compute the confidence interval or entering the confidence 148 desired to obtain the relevant percentiles).
- the chart type e.g., PDF, CDF
- enter Percentiles in % or Certainty Values (in output units) 147 on the bottom left of the screen (remembering to click Update 146 when done) to show their vertical lines on the chart, or compute/show the Percentiles/Confidence levels 148 on the bottom right of the screen (selecting the type, Two Tail, Left Tail, Right Tail 146,
- the simulation forecast chart is highly flexible in the sense that users can modify its look and feel (e.g., color, chart type, background, gridlines, rotation, chart view, data labels, etc.) using the chart icons. Users can also Extract Simulation Data 149 when the risk simulation run is complete, and the extracted data can be used for additional analysis as required.
- FIG. 21 illustrates the Custom Text Properties.
- users entered either a Percentile or Certainty Value at the bottom left of the screen and clicked Update (FIG. 20), they can then click on Custom Text Properties in the chart icon (FIG. 20), select the Vertical Line 151, type in some custom texts 150, click on the Properties 152 button to change the font size/color/type, or use the icons to move the custom text's location. Users can also enter in custom percentile or numerical values 153 to show in the chart.
- this Simulation Results forecast chart shows one output variable at a time, whereas the Overlay Results compares multiple simulated output forecasts at once.
- FIG. 22 illustrates the Overlay Results 154.
- Multiple simulation output variables 155 can be compared at once using the Overlay Results tab. Users simply check/uncheck the simulated outputs 155 they wish to compare and select the chart type to show (e.g., S-Curves, CDF, PDF) 156. Users can also add Percentile or Certainty lines 159 by first selecting the output chart 156, entering the relevant values 158, and clicking the Update 160 button.
- the generated charts are highly flexible in that users can modify the charts 157 using the included chart icons (as well as whether to show or hide gridlines 161) and the chart can be copied 161 into the Microsoft Windows clipboard for pasting into another software application.
- S-curves of CDF curves 156 are used in overlay analysis when comparing the risk profile of multiple simulated forecast results.
- FIG. 23 illustrates the Analysis of Alternatives 162.
- the Overlay Results show the simulated results as charts (PDF/CDF), and the Analysis of Alternatives tab shows the results of the simulation statistics in a table format 167 as well as a chart 168 of the statistics such that one Option can be compared against another.
- PDF/CDF charts
- the default is to run an Analysis of Alternatives to compare one Option versus another 163, but users can also choose the Incremental Analysis 163 option (remembering to choose the desired economic metric 164 to show, its precision in terms of decimals 166, the Base Case option 165 to compare the results to, and the chart display type 169).
- FIG. 24 illustrates the Dynamic Sensitivity Analysis 170 computations. Tornado analysis and Scenario analysis are both static calculations. Dynamic Sensitivity, in contrast, is a dynamic analysis, which can only be performed after a simulation is run. Users start by selecting the desired Option's economic output 171. Red bars on the Rank Correlation 172 chart indicate negative correlations and green bars indicate positive correlations for the left chart. The correlations' absolute values are used to rank the variables with the highest relationship to the lowest, for all simulation input assumptions. The Contribution to Variance computations and chart 173 indicate the percentage fluctuation in the output variable that can be statistically explained by the fluctuations in each of the input variables. As usual, these charts can be copied and pasted into another software application 174.
- FIG. 25 illustrates the Options Strategies 175 tab.
- Options Strategies is where users can draw their own custom strategic maps 177 and each map can have multiple strategic real options paths 180. This section allows users to draw and visualize these strategic pathways and does not perform any computations. (The next section, Options Valuation, actually performs the computations.) Users can explore this section's capabilities, but viewing the Video on Options Strategies to quickly get started on using this very powerful tool is recommended. Users can also explore some preset options strategies by clicking on the first icon and selecting any one of the Examples 176.
- Node colors can be changed locally to a node or globally.
- Branch Event Name Text can be placed on the branch leading to the node to indicate the event leading to this node.
- a specific real option type can be assigned to the current node. Assigning real options to nodes allows the tool to generate a list of required input variables.
- Shadow Colors and whether to apply a shadow or not.
- Capturing the Screen or printing the existing model can be done through the first icon menu. The captured screen can then be pasted into other software applications.
- FIG. 26 illustrates the Options Valuation 181 tab and the Strategy View 185.
- This Options Valuation section performs the calculations of Real Options Valuation models. Users must understand the basic concepts of real options before proceeding.
- the user starts by choosing the option execution type 182 (e.g., American, Bermudan, or European), selecting an option to model 183 (e.g., single phased and single asset or multiple phased sequential options), and, based on the option types 184 selected, entering the required inputs 188 and clicking Compute to obtain the results 189. Users can also click on the Load Example 187 to load preset input assumptions based on the selected option type 183 and option model 184.
- the option execution type 182 e.g., American, Bermudan, or European
- an option to model 183 e.g., single phased and single asset or multiple phased sequential options
- Compute e.g., single phased and single asset or multiple phased sequential options
- a Tornado analysis and Scenario analysis 185 can be performed on the option model and users can Save As (as well as Delete or Edit existing saved models) 191 the options models for future retrieval from the list of saved models 190.
- FIG. 27 illustrates the Options Valuation tab and its Sensitivity analysis 192 subtab.
- this tab runs a static sensitivity table 194 of the real options model based on updated user inputs and settings 193.
- FIG. 28 illustrates the Options Valuation tab and its Tornado 195 analysis subtab.
- this tab develops the Tornado chart 196 of the real options model. The interpretation of this Tornado chart is identical to those previously described.
- FIG.29 illustrates the Options Valuation tab and its Scenario 197 analysis subtab.
- this tab runs a scenario table 200 of the real options model based on updated 199 user settings (input variables to analyze as well as the range and amount to perturb 198).
- FIG. 30 illustrates the Forecast Prediction 201 module.
- This section on Forecast Prediction is a sophisticated Business Analytics and Business Statistics module with over 150 functionalities.
- the user starts by entering the data in Step l 's data grid 203 (user can copy and paste from Microsoft Excel or other ODBC-compliant data source, manually type in data 204, or click on the Example 202 button to load a sample dataset complete with previously saved models).
- the user then chooses the analysis to perform in Step 2 205, 206 and, using the variables list provided 207, enters the desired variables to model 208 given the chosen analysis (if users previously clicked Example, users can double-click to use and run the saved models in Step 4 to see how variables are entered in Step 2, and use that as an example for their analysis).
- the user clicks Run 209 in Step 3 when ready to obtain the Results, Charts, and Statistics 211 of the analysis 212 that can be copied 213 and pasted to another software application.
- Users can alternatively Save or Edit/Delete 215 their models in Step 4 by giving them a name 214 for future retrieval from a list of saved models 216, which can be sorted or rearranged accordingly 217.
- Forecast Prediction module Users may also explore the power of this Forecast Prediction module by loading the preset Example, or they can watch the Getting Started Videos (FIG. 41) to quickly get started using the module and review the user manual for more details on the 150 analytical methods.
- the following steps are illustrative of the Forecast Prediction procedures:
- Example 202 Users start at the Forecast Prediction 201 tab and click on Example 202 to load a sample data and model profile or type in their data or copy/paste from another software application such as Microsoft Excel or Microsoft Word/text file into the data grid 204 in Step 1. Users can add their own notes or variable names in the first Notes row.
- Existing models 216 can be edited or deleted and rearranged in order of appearance, and all the changes can be saved.
- the data grid size can be set in the Grid Configure button 202, where the grid can accommodate up to 1,000 variable columns with 1 million rows of data per variable.
- the pop-up menu also allows users to change the language and decimal settings for their data.
- Users can click on the data grid's column header(s) to select the entire column(s) or variable(s), and, once selected, users can right-click on the header to Auto Fit the column, or to Cut, Copy, Delete, or Paste data. Users can also click on and select multiple column headers to select multiple variables and right-click and select Visualize to chart the data.
- Users can use the up, down, left, and right keys to move around the grid, or use the Home and End keys on the keyboard to move to the far left and far right of a row. Users can also use combination keys such as Ctrl+Home to jump to the top left cell, Ctrl+End to the bottom right cell, Shift+Up/Down to select a specific area, and so forth.
- the Copy 213 button is used to copy the Results, Charts, and Statistics 211 tabs in
- Step 3 after a model is run. If no models are run, then the Copy function will only copy a blank page.
- the Report 213 button will only run if there are saved models in Step 4 or if there are data in the grid; otherwise the report generated will be empty. Users will also need Microsoft Excel to be installed to run the data extraction and results reports, and have Microsoft PowerPoint available to run the chart reports.
- Example 202 profile When in doubt about how to run a specific model or statistical method, the user should start the Example 202 profile and review how the data are set up in Step 1 or how the input parameters are entered in Step 2. Users can use these examples as getting started guides and templates for their own data and models.
- Example 202 button Users can click the Example 202 button to load a sample set of previously saved data and models. Then double-click on one of the Saved Models 216 in Step 4. Users can see the saved model that is selected and the input variables 208 used in Step 2. The results will be computed and shown in the Step 3 results 211 area, and users can view the Results, Charts, or Statistics 212 depending on what is available based on the model users chose and ran.
- the Grid Configure 202 button allows users to change the number of rows or columns of the data grid in Step 1.
- Users can select a variable in the data grid by clicking on the header(s). For instance, users can click on VAR1 and it will select the entire variable.
- FIG. 31 illustrates the Forecast Prediction's Visualize 218 and Charts 219 subtabs.
- the results will return a chart (e.g., a stochastic process forecast was created and the results are presented both in the Results subtab and the Charts 219 subtab).
- the charts subtab has multiple chart icons users can use to change the appearance of the chart (e.g., modify the chart type, chart line colors, chart view, etc.).
- users can click on the Visualize button or right-click and select Visualize 218, and the data will be collapsed into a time-series chart.
- FIG. 32 illustrates the Forecast Prediction's Command Console 220. Users can also quickly run multiple models using direct commands in the Command Console. It is recommended that new users set up the models using the user interface, starting from Step 1 through to Step 4.
- users create the models they need, then click on the Command subtab, copy/edit/replicate the command syntax (e.g., users can replicate a model multiple times and change some of its input parameters very quickly using the command approach), and, when ready, click on the Run Command button.
- models can also be entered using a Command console. To see how this works, users can double-click to run a model and go to the Command console. Users can replicate the model or create their own and click Run Command when ready.
- Each line in the console represents a model and its relevant parameters.
- the figure also shows a sample set of results in the Statistics 221 subtab.
- FIG. 33 illustrates the Portfolio Optimization's 222 Optimization Settings 223 tab.
- the individual Options can be modeled as a portfolio and optimized to determine the best combination of projects for the portfolio.
- decisions include allocating financial resources, building or expanding facilities, managing inventories, and determining product-mix strategies. Such decisions might involve thousands or millions of potential alternatives. Considering and evaluating each of them would be impractical or even impossible.
- a model can provide valuable assistance in incorporating relevant variables when analyzing decisions and in finding the best solutions for making decisions. Models capture the most important features of a problem and present them in a form that is easy to interpret. Models often provide insights that intuition alone cannot.
- An optimization model has three major elements: decision variables, constraints, and an objective.
- the optimization methodology finds the best combination or permutation of decision variables (e.g., which products to sell or which projects to execute) in every conceivable way such that the objective is maximized (e.g., revenues and net income) or minimized (e.g., risk and costs) while still satisfying the constraints (e.g., budget and resources).
- the Options can be modeled as a portfolio and optimized to determine the best combination of projects for the portfolio in the Optimization Settings tab.
- users start by selecting the optimization method (Static or Dynamic Optimization) 224.
- the user selects the decision variable type 225 of Discrete Binary (choose which Options to execute with a Go/No-Go Binary 1/0 decision) or Continuous Budget Allocation (returns % of budget to allocate to each Option as long as the total portfolio is 100%); select the Objective 226 (e.g., Max NPV, Min Risk, etc.); set up any Constraints 227 (e.g., budget restrictions, number of projects restrictions, or create customized restrictions); select the Options to optimize/allocate/choose 229 (default selection is all Options); and, when completed, click Run Optimization 228.
- the software will then take users to the Optimization Results 223 tab.
- FIG. 34 illustrates the Optimization Results 230 tab, which returns the results from the portfolio optimization analysis.
- the main results are provided in the data grid 233, showing the final Objective Function results, final Optimized Constraints, and the allocation, selection, or optimization across all individual Options within this optimized portfolio.
- the top left portion of the screen shows the textual details and results 231 of the optimization algorithms applied, and the chart 232 illustrates the final objective function (the chart will only show a single point for regular optimizations, whereas it will return an investment efficient frontier curve if the optional Efficient Frontier settings are set [min, max, step size] in the Optimization Settings tab).
- FIG. 34 illustrates the Optimization Results 230 tab, which returns the results from the portfolio optimization analysis.
- the main results are provided in the data grid 233, showing the final Objective Function results, final Optimized Constraints, and the allocation, selection, or optimization across all individual Options within this optimized portfolio.
- the top left portion of the screen shows the textual details and results 231 of the optimization algorithms applied, and the chart 232
- 35 illustrates the Advanced Custom Optimization 234 tab's Optimization Method 235 routines, where users can create and solve their own optimization models. Knowledge of optimization modeling is required to set up models, but users can click on Load Example 241 and select a sample model to run. Users can use these sample models to learn how the Optimization routines can be set up. Users click Run when done to execute the optimization routines and algorithms. The calculated results and charts will be presented upon completion. When users set up their own optimization model, it is recommended that they go from one tab to another, starting with the Method 235 (Static 236, Dynamic 237, or Stochastic Optimization 239) and based on the selected method, input the simulation seeds 238 or simulation trials 238, 240 or the number of stochastic optimization iterations 240 to perform.
- Method 235 Static 236, Dynamic 237, or Stochastic Optimization 239
- the Optimized Results 242 will be shown after the model is Run 241, where the resulting optimized decision variables 243 are presented as a data grid. Perhaps the best way to get started for a new user is to load an existing set of example models 241 to run. The user's own custom model can be checked using the Verify 241 process to determine if the model is set up correctly.
- FIG. 36 illustrates the Advanced Custom Optimization's Decision Variables 244 setup, where decision variables are those quantities over which users have control; for example, the amount of a product to make, the number of dollars to allocate among different investments, or which projects to select from among a limited set.
- decision variables are those quantities over which users have control; for example, the amount of a product to make, the number of dollars to allocate among different investments, or which projects to select from among a limited set.
- portfolio optimization analysis includes a go or no-go decision on particular projects.
- the dollar or percentage budget allocation across multiple projects also can be structured as decision variables. Users can click Add 245 to add a new Decision Variable. Users can also Change, Delete, or Duplicate 245 an existing decision variable.
- the Decision Variables can be set as Continuous (with lower and upper bounds), Integers (with lower and upper bounds), Binary (0 or 1), or a Discrete Range 244.
- the list of available variables is shown in the data grid, complete with their assumptions (rules, types, and starting values) 244. Users can also view the Detailed Analysis 246 of the optimization results 247.
- FIG. 37 illustrates the Advanced Custom Optimization's Constraints 248 setup, which describes relationships among decision variables that restrict the values of the decision variables.
- a constraint might ensure that the total amount of money allocated among various investments cannot exceed a specified amount or, at most, one project from a certain group can be selected; budget constraints; timing restrictions; minimum returns; or risk tolerance levels.
- Users can click Add to add a new Constraint. Users can also Change or Delete an existing constraint. When adding a new constraint, the list of available Variables will be shown. Users can simply double-click on a desired variable and its variable syntax will be added to the Expression window. For example, double-clicking on a variable named "Returnl" will create a syntax variable "$(Returnl)$" in the window. Users can enter their own constraint equation(s).
- FIG. 38 illustrates the Advanced Custom Optimization's Objective 253, which gives a mathematical representation of the model's desired outcome, such as maximizing profit or minimizing cost, in terms of the decision variables.
- the objective may be to maximize returns while minimizing risks 254 (maximizing the Sharpe's ratio or returns-to-risk ratio).
- Users can enter their own customized Objective 255 in the function window.
- the list of available variables 256 is shown in the Variables window on the right. This list includes predefined decision variables and simulation assumptions.
- An example of an objective function equation looks something like 255:
- the Advanced Custom Optimization's Statistics 253 subtab will be populated only if there are simulation assumptions set up.
- the Statistics window will only be populated if users have previously defined simulation assumptions available. If there are simulation assumptions set up, users can run Dynamic Optimization or Stochastic Optimization (FIG. 35); otherwise users are restricted to running only Static Optimizations. In the window, users can click on the statistics individually to obtain a drop-down list. Here users can select the statistic to apply in the optimization process. The default is to return the Mean from the Monte Carlo Risk Simulation and replace the variable with the chosen statistic (in this case the average value), and Optimization will then be executed based on this statistic.
- FIG. 39 illustrates the Knowledge Center's 257 Step-by-Step Procedures 258, where users will find quick getting started guides and sample procedures that are straight to the point to assist them in quickly getting up to speed in using the software.
- These sessions are meant to provide a quick overview to help users get started with using PEAT and do not substitute for years of experience or the technical knowledge required in the Certified in Risk Management (CRM) programs.
- the Step-by-Step Procedures 258 section highlights some quick getting started steps in a self-paced learning environment that is incorporated within the PEAT software. There are short descriptions 260 above each slide 261, and key elements of the slide are highlighted in the figures for quick identification.
- FIG. 40 illustrates the Knowledge Center's Basic Project Economics Lessons 262, which provides an overview tour 263, 264 of some common concepts involved with cash flow analysis and project economic analysis such as the computations of NPV, IRR, MIRR, PI, ROI, PP, DPP, and so forth.
- FIG. 41 illustrates the Knowledge Center's Getting Started Videos 265, where users can watch a short description and hands-on examples of how to run one of the sections within this PEAT software.
- the first quick getting started video is preinstalled with the software while the rest of the videos may be downloaded at first viewing. Before downloading any materials, users should ensure they have a good Internet connection to view the online videos 266. In alternate embodiments, the videos may be entirely preinstalled or entirely downloadable.
- the Knowledge Center has additional functionalities that users can customize.
- the Knowledge Center files may be available in the installation path's three subfolders: Lessons, Videos, and Procedures. Users can access the raw files directly or modify/update these files and the updated files will show in the software tool's Knowledge Center the next time the software utility tool is started. Users can utilize the existing files (e.g., file type such as *.BMP or *.WMV as well as pixel size of figures) as a guide to the relevant file specifications they can use when replacing any of these original Knowledge Center files.
- file type such as *.BMP or *.WMV as well as pixel size of figures
- the *.WMV Microsoft Windows Media Video file format is preferred as all Microsoft Windows-based computers can run the video without any additional need for Video Codec installations. This file format is small in size and, hence, more portable when implementing it in the PEAT software tool installation build, such that users can still e- mail the installation build without the need for uploading to an FTP site. There are no minimum or maximum size limitations to this file format.
- FIG. 42 illustrates the Report Settings capability in the utility. Users can select or deselect 267 the relevant analyses to run, or select all analyses at once 268, and when Run Report 269 is clicked, the selected models will run and their results (data grids, models, charts, and results) are pasted into Microsoft Excel and Microsoft PowerPoint. [0156] Enterprise Risk Management and Risk Register Module
- FIG. 43 shows one such schema of a new module, specifically that of the Enterprise Risk Management's (ERM) Risk Register module.
- ERP Enterprise Risk Management's
- the ERM Risk Register module allows segmentation of the Corporation, Division, G.O.P.A.D. (Geographic, Operations, Product Line, Activity or Process, Department), Risk Category, and Risk Register levels.
- the ERM Risk Register module allows for the creation of Key Risk Indicator (KRI) Heat Maps with relevant customizable risk-based color codes.
- KRI Key Risk Indicator
- the ERM Risk Register module allows for the creation of standard 5 x 5 as well as 10 x 10 risk matrixes with different risk levels. In alternate preferred embodiments, additional or unique matrix sizes can also be created in the system.
- the ERM Risk Register module may include risk classification categories.
- multiple levels e.g., 5-level and 10-level
- risk classifications on Risk Likelihood and Risk Impacts can be set up.
- the ERM Risk Register module allows the ability for the user to view risk values from different points of view.
- those different points of view are searchable within the Risk Register database for specific segments (e.g., a certain geographic location, division, department, risk category, activity, process, operation, and any combination thereof).
- the ERM Risk Register module allows for G.O.P.A.D. risk elements to be mapped to various risk groups, mitigation responses, percent completion, and active versus inactive risk status.
- the ERM Risk Register module also allows the option to add Current Dollar Risk Level, Residual Dollar Risk Level, and Mitigation Dollar Cost ranges.
- the ERM Risk Register module allows for the creation of Pareto charts, Scenario tables, Tornado charts, and Risk Profiles by Division and G.O.P.A.D.
- the ERM Risk Register module allows for the creation of Control Charts and KRI Risk Trends over time. Additionally, statistical process controls can be applied to determine if a certain risk element is in- or out-of-control.
- the ERM Risk Register module allows for the creation of Risk Tracking, Time-Series Risk Forecasts, PDF/CDF Likelihood of Occurrence, and Snapshots per period and over time.
- the ERM Risk Register module allows for the valuation and statistical computation of the effectiveness of risk mitigation programs through various hypothesis testing methods.
- the ERM Risk Register module allows for the creation of Risk Simulations of the user's risk register element input assumptions via ranges (e.g., minimum, most likely, maximum, average, standard deviation, location, scale, range, percentiles, and so forth) and returns probabilistic distributions of the individual risk elements or rolled-up risks by categories (output metrics include risk element count, KRI sum, sum and count of risk register elements within a risk category, total risk dollars, total risk mitigation cost, and so forth).
- ranges e.g., minimum, most likely, maximum, average, standard deviation, location, scale, range, percentiles, and so forth
- output metrics include risk element count, KRI sum, sum and count of risk register elements within a risk category, total risk dollars, total risk mitigation cost, and so forth.
- the ERM Risk Register module allows for the creation of Root Cause Analysis, Flow Diagrams, Risk Diagrams, Mind Maps, Bowtie Diagrams, and any other diagram or picture that the user would like to create to better illustrate the risk process, risk mitigation, risk cause and effect, and risk impact of the Risk Register.
- the ERM Risk Register module allows for the selection of the best risk mitigation response programs for maximizing statistically significant risk mitigation effects by looking at budgetary, resource, time, management, physical, geographical, logistics, legal, political, and other constraints.
- the ERM Risk Register module allows for the automatic creation and sending of e-mail alerts based on risk appetite levels and time remaining based on due date to complete any risk mitigation measures.
- the ERM Risk Register module allows for the creation of both a Web module for data entry by regular end users and a Desktop module within PEAT for risk managers to run advanced analytics and modeling. In preferred embodiment, this separation allows for the added risk mitigation of outside malicious hackers and corporate espionage where critical corporate risk elements and details are exposed to unauthorized third parties.
- the Web module only allows for data entry and basic reporting, and each end user login is only limited to access his or her data inputs. Since Web portals are more easily hacked, the information retrieved from such malicious individuals will be minimal at best.
- the preferred embodiment of the Web module has three levels of login: Global Administrator, Local Administrator, and End Users.
- the preferred embodiment of the Desktop module is housed on a few individuals' personal computers at the client's company and should be equipped with updated antivirus and anti-intrusion software as well as a corporate firewall. Further, the data can be encrypted as explained previously for an additional added level of security. Hacking into the corporate setting and attacking specific computers out of hundreds or thousands of computers and subsequently obtaining the relevant files and decrypting them would take a tremendous amount of time and resources. Therefore, the Desktop module significantly reduces the risks of intrusion.
- the ERM Risk Register module allows for the Risk Monitoring of project management, tasks, completion, assignments, and also provides for Risk governance; provides a Risk Effectiveness Summary, Risk Audit Trail, and Compliance; and complies with ISO Standards.
- the ERM Risk Register module could be configured with additional or fewer functionalities, and embodiments of the present invention are contemplated for use with any such functionalities.
- the Risk Register module has multiple segmentation layers or categories and FIG. 43 illustrates a sample 5 -layered segmentation structure.
- the Risk Register 270 level consists of individual risk elements or risk items that end users of the system can enter.
- ABSC Bank African Bank
- there are a myriad of risks such as bank tellers making mistakes entering a customer's deposit, intentional fraud, insufficiently trained staff, and so forth.
- Risk Register items or elements can then be linked to one or multiple Risk Categories 271 such as operational risk, human resource risk, or reputational risk, and so forth, and each category maps to one or multiple Geography, Operations, Product Line, Activity or Process, and Department (henceforth known as G.O.P.A.D. or GOPAD).
- G.O.P.A.D. G.O.P.A.D.
- these G.O.P.A.D. s map to one or multiple Divisions 273 or business units, and all the Divisions ultimately map to the single Corporation 274.
- Multiple corporation accounts can be created in the system such that the Risk Register process can be replicated either over time or as separate analyses but of the same company.
- the end user determines all the categories, names of each element or category, and category type.
- FIG. 44 shows an illustrative example of the Web-based module's main login page.
- the Risk Register's main logo or client's logo 275 is displayed to verify that the end user is at the correct Website, whereby the user would then log in 276.
- FIG. 45 shows an illustrative example of the Global Administrator's (GA) Webpage (bearing the GA's company's logo 277) where the GA can create, add, edit, or manage 279 existing Client Companies 278 that would be listed in the data grid 280.
- FIG. 46 shows an illustrative example of the GA and Local Administrator's (LA) Webpage to manage Users 281, and, as usual, new users can be added or existing users can be modified and edited or deleted 282.
- GA Global Administrator's
- LA Local Administrator's
- GA and LA can select the Add Mode to manually add users one at a time or perform a file upload of multiple users at once, and each user will have a User Type (LA or End User), Status (Active or Inactive), First and Last Names, and E-mail ID (new users will be sent an e-mail with their automatically generated login and password credentials).
- LA or End User User Type
- Status Active or Inactive
- First and Last Names First and Last Names
- E-mail ID new users will be sent an e-mail with their automatically generated login and password credentials.
- all users' information will be listed in the data grid 283.
- FIG. 47 shows an illustrative example of the Manage Divisions 284 Webpage where new divisions can be added or existing ones modified 285, and updates are all listed in the data grid 286.
- FIG. 48 shows an illustrative example of the Manage Risk G.O.P.A.D. 287 Webpage where the user selects the relevant subcategory (Geography or Location, Operations, Product line, Activity or process, and Department) and enters the information as shown 288, and all GOPADs will be listed in the data grid 289.
- relevant subcategory Geography or Location, Operations, Product line, Activity or process, and Department
- FIG. 49 shows an illustrative example of the Manage Risk Categories 290 Webpage where new categories can be added or existing categories can be edited and modified as required by updating the relevant information 291, and all risk categories are displayed in the data grid 292.
- FIG. 50 shows an illustrative example of the Risk Mappings 293 Webpage where previously created Risk Categories can be mapped to one or more G.O.P.A.D. s, which can then be mapped to one or more Divisions 294. These mappings can be set as new connections, or as modifications and deletions of existing connections 295. All finalized connections are listed in the data grid 296.
- FIG. 51 shows an illustrative example of the Manage Risk Contacts 297 Webpage where new contact individuals responsible for certain risk elements (aptly named Risk Managers), can be added or existing ones modified 298, and their updated information is presented in the data grid 299.
- FIG. 52 shows an illustrative example of the Manage Risk Register 300 Webpage where the information of a new risk register element is entered or an existing risk register element is updated 301 and the specific Risk Category 302 is assigned, while the creation date and date of the last update are automatically generated 303 by the system.
- the end user then enters the Likelihood (L) of occurrence 304; possible financial, economic, or noneconomic Impact (I) 305; and percentage of risk mitigation strategies and plans that are currently completed 306.
- L Likelihood
- I possible financial, economic, or noneconomic Impact
- these three required inputs will have input validation error checks to make sure data entered are correct and relevant (e.g., 1-5 or 1-10 integers for the L and I, or 0% to 100% for percent completion).
- the sliders can also be used in lieu of manually entering these inputs.
- FIG. 53 shows an illustrative example of the PEAT desktop software tool with the ERM Risk Register module opened.
- the main tab of ERM is activated and the default location of Risk Settings
- Global Settings 309 is shown first. Users can then change the date format desired 310, choose the range for L & I as required 311, select either the 5- or 3-color schema for risk categories 312, and see the default risk color schemes 313 or customize the colors and risk category names 314.
- auto-generated e-mail alerts 315 can also be set here and triggered when certain Key Risk Indicators (KRI) are exceeded 316; e-mails will be sent to the Risk Managers assigned to be in charge of the relevant risk register elements and the same e-mail can be copied to additional recipients 317 as desired.
- KRI Key Risk Indicators
- the data entered and captured by the Web-based module can also be imported directly into the Desktop module 318 at the click of a button.
- the system will then retrieve the dataset from the Web- based module at a specified universal resource locator (URL) Web address and will then parse and upload the data into the relevant locations within this Desktop PEAT environment.
- URL universal resource locator
- FIG. 54 shows the default color coding and default names for various risk levels 319, which can be updated or modified as required by clicking on the colors and choosing an alternate color or changing the label's text and saving/updating 321 the schema, and the updated colors will be shown 320.
- users can also revert to the system's default color and labels 321.
- the numerical values in the data grid 320 help the users to quickly visualize the KRI scores (Risk Likelihood score arranged by columns multiplied by the Risk Impact arranged by rows) and how the colors are coded based on these KRI levels.
- FIG. 55 shows an illustrative example of the management screen of Risk Groups where the user of the system would select the risk level to add or modify (Division, G.O.P.A.D., Risk Category, or Risk Manager) 322, where the new or updated information can be inputted 323 and updated in the system and visible in the data grid 324.
- the risk level to add or modify (Division, G.O.P.A.D., Risk Category, or Risk Manager) 322, where the new or updated information can be inputted 323 and updated in the system and visible in the data grid 324.
- FIG. 56 shows an illustrative example of the Risk Mapping where one Risk Category can be mapped to one or more G.O.P.A.D.s, which in turn can be mapped to one or more Divisions 325.
- these new connections can be added or existing connections can be edited or deleted as required 326, and the finalized connections are updated in the data grid 327.
- FIG. 57 shows an illustrative example of the Risk Register tab in PEAT where the relevant information applicable to new risk register elements or existing elements can be modified and edited 328 (information such as the risk element's name, a shorter name or acronym, causes of this risk, consequences of this risk, and mitigation response or plan) and assigned to a Risk Category 329.
- the risk element's L and I as well as percent mitigation plans completed 330 can be manually entered or entered using a slider (input validity checks are performed as previously described and short Definitions are also provided on what each L and I number and category represents). Additional optional numerical dollar assumptions and their ranges 331 can be entered, and, finally, the dates created, edited and due are also updated as required 332.
- these risk elements can be saved, edited, or deleted 333, and additional functionalities such as viewing the final data grid 335 of all risk elements in the risk register can be viewed full screen, copied into temporary memory for pasting into another software application such as Microsoft Excel, printing of the screen, or generating an Excel report 334 can be applied.
- additional functionalities such as viewing the final data grid 335 of all risk elements in the risk register can be viewed full screen, copied into temporary memory for pasting into another software application such as Microsoft Excel, printing of the screen, or generating an Excel report 334 can be applied.
- FIG. 58 shows an illustrative example of the Risk Dashboard where the user of the system can select which categories 336 to show, the periodicity to show 337, and what point of view to analyze 338.
- This illustrative example shows the Risk Elements 338 view where each of the risk elements in the risk register is listed in graphical format 339 and color coded according to the user's previous global settings.
- These risk elements can be listed in in the manner in which they were entered or viewed as a Pareto chart 340 (i.e., the highest KRI items are listed first, all the way to the lowest KRI risk element).
- FIG. 59 shows an illustrative example of the Risk Map or KRI Heat Map 341 where the data grid or matrix 342 shows the Risk Impact and Risk Likelihood of each risk category and shows the count of the number of risk elements in the selected risk category.
- the number 5 in the top left quadrant of the matrix shows that there are 5 risk elements that have a Risk Likelihood score of 1 (first column, starting from the bottom left corner) and a Risk Impact of 5 (row number 5, starting from the bottom left corner).
- this cell has a KRI score of 1 x 5 or 5, which will have a specific color code depending on the user's global settings.
- FIG. 60 shows an illustrative example where the Risk Groups 343 where bar charts 344 show the number (count) or sum of all KRIs 345 that fall under each risk category (e.g., 1-5 or high, medium, low risks) as vertical bars in the chart, grouped by the user-selected risk categories.
- each risk category e.g., 1-5 or high, medium, low risks
- FIG. 61 shows an illustrative example where the Risk Exposure 346 of the selected risk category, the corporation as a whole, and the percentage of the risk category to the corporation as risk dials and pie charts 347.
- FIG. 62 shows another view of the risk categories via a Risk Taxonomy 348 relational chart 349 both from a top-down versus bottom-up approach 350.
- the top-down approach shows the risk segmentation levels starting from the Corporation and the Division splits, down onto the G.O.P.A.D. links and connections, through the Risk Category, and finally to each of the Risk Elements. Users of the system can zoom in, collapse, or expand any of the nodes for a better view.
- the bottom-up approach 350 requires the user to select a specific Risk Register element to see how this risk element can permeate throughout the entire organization via the risk categories, and how these categories affect the relevant G.O.P.AD.s, up to the Division and Corporation levels.
- FIG. 63 shows an illustrative example of the Risk Data 351 where all the relevant data from the Risk Register grid is listed again in a slightly different view 352, and the data shows the results based on the user-selected categories.
- FIG. 64 shows an illustrative example of the Risk Engagement 353 portion of the system where Pre -Engagement 354 (e.g., risk evaluations during pre-bids or pre-execution of a project) risks can be listed.
- Pre -Engagement 354 e.g., risk evaluations during pre-bids or pre-execution of a project
- the project's name and identification number 355 can be entered, the data grid's information can be printed or copied, and additional rows and the last edit date 356 can be shown in the grid 357.
- the grid's column headers can be modified 355 by the system's user as required.
- FIG. 65 shows an illustrative example where the Engagement Assessment 358 (e.g., risk evaluations during the execution phase of a project or risk evaluation of what risks may exist in the future when the project is executed) risks can be listed and entered by the user into the grid 359.
- the Engagement Assessment 358 e.g., risk evaluations during the execution phase of a project or risk evaluation of what risks may exist in the future when the project is executed
- FIG. 66 shows an illustrative example of the Lessons Learned 360 from the engagement of the project, and, as usual, risks can be listed and entered by the user into the grid 361.
- FIG. 67 shows an illustrative example of the Risk Controls 362 segment of the current system.
- the risk elements can be viewed and analyzed according to each individual Risk Register element or selected by G.O.P.A.D. 363 and the date range 364 can also be specified.
- users of the system can select one or multiple risk elements 365 or G.O.P.A.D.s 366 and update the analysis and chart, copy 367 the chart 368 generated, or modify the chart's look and feel using the chart's settings icon toolbar 369.
- FIG. 68 shows an illustrative example of the Risk Forecasts 370 segment where the same settings such as selecting the required risk registers or G.O.P.A.D.s and date range, and selecting the required forecast method and entering the relevant forecast parameters 371 as discussed previously.
- the analysis is then run 372 and results can be seen as predictive statistics, forecast charts, or forecast data 373 374.
- FIG. 69 shows an illustrative example of the Risk Diagrams 375 where users of the system can change the type of risk diagram to draw or access various standard and freehand drawing tools in the icon ribbon 376 and add multiple risk diagram subtabs 377 and in each subtab, one or multiple risk diagrams can be drawn in the canvas area 378 where different predefined standard shapes and freehand drawings, text, color, and pictures can be added in the drawing canvas as required.
- Each of the drawing elements properties can be changed as required (e.g., size, color, font, background, pictures, etc.)
- FIG. 70 shows an illustrative example of the Risk Mitigation 379 segment of the current system, where users can manually enter or copy and paste existing data into the grid 380, select the analysis 381 to run 382, review the statistical results 383 or copy 384 the results for pasting into another software application, save the existing model by providing it a name and adding some optional notes 385, or rerun a previously saved model 386 as well as edit or delete an existing saved model 387.
- this appendix demonstrates the mathematical models and computations used in creating the Monte Carlo simulations.
- users want to look at the distribution of nonexempt wages within one department of a large company.
- users gather raw data— in this case, the wages of each nonexempt employee in the department.
- users organize the data into a meaningful format and plot the data as a frequency distribution on a chart.
- users divide the wages into group intervals and list these intervals on the chart's horizontal axis. Then users list the number or frequency of employees in each interval on the chart's vertical axis.
- a probability distribution shows the number of employees in each interval as a fraction of the total number of employees.
- users divide the number of employees in each interval by the total number of employees and list the results on the chart's vertical axis.
- Probability distributions are either discrete or continuous. Discrete probability distributions describe distinct values, usually integers, with no intermediate values and are shown as a series of vertical bars. A discrete distribution, for example, might describe the number of heads in four flips of a coin as 0, 1, 2, 3, or 4. Continuous probability distributions are actually mathematical abstractions because they assume the existence of every possible intermediate value between two numbers; that is, a continuous distribution assumes there are an infinite number of values between any two points in the distribution. However, in many situations, users can effectively use a continuous distribution to approximate a discrete distribution even though the continuous model does not necessarily describe the situation exactly.
- PDF probability density function
- a probability mass function gives the probability that a discrete random variable is exactly equal to some value.
- the PMF differs from the PDF in that the values of the latter, defined only for continuous random variables, are not probabilities; rather, its integral over a set of possible values of the random variable is a probability.
- a random variable is discrete if its probability distribution is discrete and can be characterized by a PMF.
- the Bernoulli distribution is a discrete distribution with two outcomes (e.g., head or tails, success or failure, 0 or 1).
- the Bernoulli distribution is the binomial distribution with one trial and can be used to simulate Yes/No or Success/Failure conditions. This distribution is the fundamental building block of other more complex distributions. For instance:
- Binomial distribution Bernoulli distribution with higher number of n total trials and computes the probability of x successes within this total number of trials.
- Geometric distribution Bernoulli distribution with higher number of trials and computes the number of failures required before the first success occurs.
- Negative binomial distribution Bernoulli distribution with higher number of trials and computes the number of failures before the xth success occurs.
- the probability of success (p) is the only distributional parameter. Also, it is important to note that there is only one trial in the Bernoulli distribution, and the resulting simulated value is either 0 or 1.
- the input requirements are such that:
- the binomial distribution describes the number of times a particular event occurs in a fixed number of trials, such as the number of heads in 10 flips of a coin or the number of defective items out of 50 items chosen.
- the probability of success (p) and the integer number of total trials (n) are the distributional parameters.
- the number of successful trials is denoted x. It is important to note that probability of success (p) of 0 or 1 are trivial conditions and do not require any simulations, and, hence, are not allowed in the software.
- the input requirements are such that Probability of Success > 0 and ⁇ 1 (i.e., 0.0001 ⁇ p ⁇ 0.9999) , the Number of Trials > 1 or positive integers and ⁇ 1 ,000 (for larger trials, use the normal distribution with the relevant computed binomial mean and standard deviation as the normal distribution's parameters).
- the discrete uniform distribution is also known as the equally likely outcomes distribution, where the distribution has a set of N elements, and each element has the same probability. This distribution is related to the uniform distribution but its elements are discrete and not continuous.
- the mathematical constructs for the discrete uniform distribution are as follows:
- the geometric distribution describes the number of trials until the first successful occurrence, such as the number of times one would need to spin a roulette wheel before winning.
- the probability of success (p) is the only distributional parameter.
- the number of successful trials simulated is denoted x, which can only take on positive integers.
- the input requirements are such that Probability of success > 0 and ⁇ 1 (i.e., 0.0001 ⁇ p ⁇ 0.9999). It is important to note that probability of success (p) of 0 or 1 are trivial conditions and do not require any simulations, and, hence, are not allowed in the software.
- the hypergeometric distribution is similar to the binomial distribution in that both describe the number of times a particular event occurs in a fixed number of trials. The difference is that binomial distribution trials are independent, whereas hypergeometric distribution trials change the probability for each subsequent trial and are called trials without replacement.
- binomial distribution trials are independent, whereas hypergeometric distribution trials change the probability for each subsequent trial and are called trials without replacement.
- hypergeometric distribution trials change the probability for each subsequent trial and are called trials without replacement.
- the total number of items or elements is a fixed number, a finite population.
- the population size must be less than or equal to 1 ,750.
- the sample size (the number of trials) represents a portion of the population.
- the number of items in the population (TV), trials sampled (n), and number of items in the population that have the successful trait (N x ) are the distributional parameters.
- the number of successful trials is denoted x.
- the input requirements are such that Population > 2 and integer, Trials > 0 and integer, Successes > 0 and integer, Population > Successes Trials ⁇ Population and Population ⁇ 1750.
- the negative binomial distribution is useful for modeling the distribution of the number of trials until the rth successful occurrence, such as the number of sales calls that need to be made to close a total of 10 orders. It is essentially a superdistribution of the geometric distribution. This distribution shows the probabilities of each number of trials in excess of r to produce the required success r.
- Probability of success (p) and required successes (r) are the distributional parameters. Where the input requirements are such that Successes required must be positive integers > 0 and ⁇ 8000, and Probability of success > 0 and ⁇ 1 (i.e., 0.0001 ⁇ p ⁇ 0.9999). It is important to note that probability of success (p) of 0 or 1 are trivial conditions and do not require any simulations, and, hence, are not allowed in the software.
- the Poisson distribution describes the number of times an event occurs in a given interval, such as the number of telephone calls per minute or the number of errors per page in a document.
- the occurrences are independent. The number of occurrences in one interval does not affect the number of occurrences in other intervals.
- Rate ( ⁇ ) is the only distributional parameter, and the input requirements are such that Rate > 0 and ⁇ 1,000 (i.e., 0.0001 ⁇ rate ⁇ 1,000).
- the beta distribution is very flexible and is commonly used to represent variability over a fixed range.
- One of the more important applications of the beta distribution is its use as a conjugate distribution for the parameter of a Bernoulli distribution.
- the beta distribution is used to represent the uncertainty in the probability of occurrence of an event. It is also used to describe empirical data and predict the random behavior of percentages and fractions, as the range of outcomes is typically between 0 and 1.
- the value of the beta distribution lies in the wide variety of shapes it can assume when users vary the two parameters, alpha and beta. If the parameters are equal, the distribution is symmetrical. If either parameter is 1 and the other parameter is greater than 1 , the distribution is J shaped.
- beta beta skewed ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ ⁇
- Alpha (a) and beta ( ⁇ ) are the two distributional shape parameters, and ⁇ is the gamma function.
- the two conditions underlying the beta distribution are as follows:
- the uncertain variable is a random value between 0 and a positive value.
- the Cauchy distribution also called the Lorentzian distribution or Breit-Wigner distribution, is a continuous distribution describing resonance behavior. It also describes the distribution of horizontal distances at which a line segment tilted at a random angle cuts the x- axis.
- the Cauchy distribution is a special case where it does not have any theoretical moments (mean, standard deviation, skewness, and kurtosis) as they are all undefined.
- Mode location (m) and scale ( ⁇ ) are the only two parameters in this distribution.
- the location parameter specifies the peak or mode of the distribution while the scale parameter specifies the half-width at half- maximum of the distribution.
- the mean and variance of a Cauchy or Lorentzian distribution are undefined.
- the Cauchy distribution is the Student's t distribution with only 1 degree of freedom. This distribution is also constructed by taking the ratio of two standard normal distributions (normal distributions with a mean of zero and a variance of one) that are independent of one another.
- the input requirements are such that Location can be any value, whereas Scale > 0 and can be any positive value.
- the chi-square distribution is a probability distribution used predominantly in hypothesis testing and is related to the gamma distribution and the standard normal distribution. For instance, the sums of independent normal distributions are distributed as a chi-square ( ⁇ 2 ) with k degrees of freedom:
- ⁇ is the gamma function.
- Degrees of freedom k is the only distributional parameter.
- the chi-square distribution can also be modeled using a gamma distribution by setting the k_
- the exponential distribution is widely used to describe events recurring at random points in time, such as the time between failures of electronic equipment or the time between arrivals at a service booth. It is related to the Poisson distribution, which describes the number of occurrences of an event in a given interval of time.
- An important characteristic of the exponential distribution is the "memoryless" property, which means that the future lifetime of a given object has the same distribution, regardless of the time it existed. In other words, time has no effect on future outcomes.
- Success rate ( ⁇ ) is the only distributional parameter.
- the number of successful trials is x.
- the extreme value distribution (Type 1) is commonly used to describe the largest value of a response over a period of time, for example, in flood flows, rainfall, and earthquakes. Other applications include the breaking strengths of materials, construction design, and aircraft loads and tolerances.
- the extreme value distribution is also known as the Gumbel distribution.
- Mode (m) and scale ( ⁇ ) are the distributional parameters. There are two standard parameters for the extreme value distribution: mode and scale.
- the mode parameter is the most likely value for the variable (the highest point on the probability distribution).
- the scale parameter is a number greater than 0. The larger the scale parameter, the greater the variance. The input requirements are such that Mode can be any value and Scale > 0.
- the F distribution also known as the Fisher-Snedecor distribution, is another continuous distribution used most frequently for hypothesis testing. Specifically, it is used to test the statistical difference between two variances in analysis of variance tests and likelihood ratio tests.
- the F distribution with the numerator degree of freedom n and denominator degree of freedom m is related to the chi-square distribution in that:
- numerator degree of freedom n and denominator degree of freedom m are the only distributional parameters.
- the input requirements are such that degrees of freedom numerator and degrees of freedom denominator are both > 0 integers.
- Gamma Distribution (Erlang Distribution) [0234]
- the gamma distribution applies to a wide range of physical quantities and is related to other distributions: lognormal, exponential, Pascal, Erlang, Poisson, and chi-square. It is used in meteorological processes to represent pollutant concentrations and precipitation quantities.
- the gamma distribution is also used to measure the time between the occurrences of events when the event process is not completely random. Other applications of the gamma distribution include inventory control, economic theory, and insurance risk theory.
- the gamma distribution is most often used as the distribution of the amount of time until the rth occurrence of an event in a Poisson process.
- the three conditions underlying the gamma distribution are as follows:
- Shape parameter alpha (a) and scale parameter beta ( ⁇ ) are the distributional parameters, and ⁇ is the gamma function.
- the alpha parameter is a positive integer
- the gamma distribution is called the Erlang distribution, used to predict waiting times in queuing systems, where the Erlang distribution is the sum of independent and identically distributed random variables each having a memoryless exponential distribution.
- n the number of these random variables, the mathematical construct of the Erlang distribution is:
- Location can be any value.
- the logistic distribution is commonly used to describe growth, that is, the size of a population expressed as a function of a time variable. It also can be used to describe chemical reactions and the course of growth for a population or individual.
- Mean ( ⁇ ) and scale ( ) are the distributional parameters. There are two standard parameters for the logistic distribution: mean and scale.
- the mean parameter is the average value, which for this distribution is the same as the mode because this distribution is symmetrical.
- the scale parameter is a number greater than 0. The larger the scale parameter, the greater the variance.
- Mean ( ⁇ ) and standard deviation ( ⁇ x) are the distributional parameters.
- the input requirements are such that Mean and Standard deviation are both > 0 and can be any positive value.
- the lognormal distribution uses the arithmetic mean and standard deviation. For applications for which historical data are available, it is more appropriate to use either the logarithmic mean and standard deviation, or the geometric mean and standard deviation.
- the normal distribution is the most important distribution in probability theory because it describes many natural phenomena, such as people's IQs or heights. Decision makers can use the normal distribution to describe uncertain variables such as the inflation rate or the future price of gasoline.
- Mean ( ⁇ ) and standard deviation ( ⁇ ) are the distributional parameters.
- the input requirements are such that Standard deviation > 0 and can be any positive value and Mean can be any value.
- Pareto Distribution is widely used for the investigation of distributions associated with such empirical phenomena as city population sizes, the occurrence of natural resources, the size of companies, personal incomes, stock price fluctuations, and error clustering in communication circuits.
- the location parameter is the lower bound for the variable. After users select the location parameter, they can estimate the shape parameter.
- the shape parameter is a number greater than 0, usually greater than 1. The larger the shape parameter, the smaller the variance and the thicker the right tail of the distribution.
- the input requirements are such that Location > 0 and can be any positive value while Shape > 0.05.
- the Student's t distribution is the most widely used distribution in hypothesis testing. This distribution is used to estimate the mean of a normally distributed population when the sample size is small, and is used to test the statistical significance of the difference between two sample means or confidence intervals for small sample sizes.
- Degree of freedom r is the only distributional parameter.
- the t distribution is related to the F distribution as follows: the square of a value of t with r degrees of freedom is distributed as F with 1 and r degrees of freedom.
- the overall shape of the probability density function of the t distribution also resembles the bell shape of a normally distributed variable with mean 0 and variance 1 , except that it is a bit lower and wider or is leptokurtic (fat tails at the ends and peaked center).
- the t distribution approaches the normal distribution with mean 0 and variance 1.
- the input requirements are such that Degrees of freedom > 1 and must be an integer.
- the triangular distribution describes a situation where users know the minimum, maximum, and most likely values to occur. For example, users could describe the number of cars sold per week when past sales show the minimum, maximum, and usual number of cars sold.
- Min Minimum (Min), most likely (Likely), and maximum (Max) are the distributional parameters and the input requirements are such that Min ⁇ Most Likely ⁇ Max and can take any value, and Min ⁇ Max and can take any value.
- Maximum value (Max) and minimum value (Min) are the distributional parameters.
- the input requirements are such that Min ⁇ Max and can take any value.
- the Weibull distribution describes data resulting from life and fatigue tests. It is commonly used to describe failure time in reliability studies as well as the breaking strengths of materials in reliability and quality control tests. Weibull distributions are also used to represent various physical quantities, such as wind speed.
- the Weibull distribution is a family of distributions that can assume the properties of several other distributions. For example, depending on the shape parameter users define, the Weibull distribution can be used to model the exponential and Rayleigh distributions, among others.
- the Weibull distribution is very flexible. When the Weibull shape parameter is equal to 1.0, the Weibull distribution is identical to the exponential distribution.
- the Weibull location parameter lets users set up an exponential distribution to start at a location other than 0.0. When the shape parameter is less than 1.0, the Weibull distribution becomes a steeply declining curve. A manufacturer might find this effect useful in describing part failures during a burn-in period.
- Location (L), shape ( ⁇ ), and scale ( ⁇ ) are the distributional parameters, and ⁇ is the Gamma function.
- the input requirements are such that Scale > 0 and can be any positive value, Shape > 0.05 and Location can take on any value.
- This appendix demonstrates the mathematical models and computations used in creating the results for real options, financial options, and employee stock options.
- the following discussion provides an intuitive look into the binomial lattice methodology. Although knowledge of some stochastic mathematics and Martingale processes is required to fully understand the complexities involved even in a simple binomial lattice, the more important aspect is to understand how a lattice works, intuitively, without the need for complicated math.
- the stochastic term ( ⁇ ⁇ ⁇ ) has a volatility component ( ⁇ ), a time component (St), and a simulated component ( ⁇ ).
- ⁇ volatility component
- St time component
- ⁇ simulated component
- the up and down step sizes have to be symmetrical in magnitude.
- the up step size as e a ⁇
- stochastic process simulation is a mathematically defined equation that can create a series of outcomes over time, outcomes that are not deterministic in nature. That is, an equation or process that does not follow any simple discernible rule such as price will increase X percent every year or revenues will increase by this factor of X plus Y percent.
- a stochastic process is by definition nondeterministic, and one can plug numbers into a stochastic process equation and obtain different results every time. For instance, the path of a stock price is stochastic in nature, and one cannot reliably predict the stock price path with any certainty. However, the price evolution over time is enveloped in a process that generates these prices. The process is fixed and predetermined, but the outcomes are not.
- stochastic simulation we create multiple pathways of prices, obtain a statistical sampling of these simulations, and make inferences on the potential pathways that the actual price may undertake given the nature and parameters of the stochastic process used to generate the time series.
- V[X(t)] X ⁇ e 2 "' (e a ' - ⁇ ) .
- the expected value then becomes E - rt dt X 0 e - r-a ⁇ t dt
- V[X f - X] ⁇ — .
- Volatility This is the annualized volatility (a measure of risk and uncertainty, denoted as a value in percent) of the underlying asset.
- Maturity This is the maturity of the option, denoted in years (e.g., a two and a half year option life can be entered as 2.5).
- Risk-free Rate This is the interest rate yield on a risk-free government bond with maturity commensurate to that of the option.
- Dividend Rate The annualized opportunity cost of not executing the option, as a percentage of the underlying asset.
- Lattice Steps The number of binomial or multinomial lattice steps to run in the model. The typical number we recommend is between 100 and 1,000, and you can check for convergence of the results. The larger the number of lattice steps, the higher the level of convergence and granularity (i.e., the number of decimal precision).
- Cost to Implement Phases are the costs to execute each of the subsequent phases in a sequential compound option, and they can be set to zero or a positive value.
- Expansion Factor The relative ratio increase in the underlying asset when the option to expand is executed (typically this is greater than 1).
- Contraction Factor The relative ratio reduction in the underlying asset when the option to contract is executed (typically this is less than 1).
- Salvage The net sales amount after expenses of abandoning an asset. • Barrier. The upper or lower barrier of an option whereupon if the underlying asset breaches this barrier, the option becomes either live or worthless, depending on the option type modeled.
- An example of a bivariate regression where there is only a single Y and a single X variable is seen as simply inserting the best-fitting line through a set of data points in a two-dimensional plane.
- a multivariate regression can be performed, where there are multiple or k number of independent X variables or regressors where in this case the best-fitting line will be within a k + 1 dimensional plane.
- Fitting a line through a set of data points in a multidimensional scatter plot may result in numerous possible lines.
- the best-fitting line is defined as the single unique line that minimizes the total vertical errors, that is, the sum of the absolute distances between the actual data points
- ARIMA(p,d,q) models are the extension of the AR model that uses three components for modeling the serial correlation in the time-series data.
- the first component is the autoregressive (AR) term.
- the AR(p) model uses the p lags of the time series in the equation.
- the second component is the integration (d) order term. Each integration order corresponds to differencing the time series. 1(1) means differencing the data once. 1(d) means differencing the data d times.
- the third component is the moving average (MA) term.
- the MA(q) model uses the q lags of the forecast errors to improve the forecast.
- the R-squared (R 2 ), or coefficient of determination, is an error measurement that looks at the percent variation of the dependent variable that can be explained by the variation in the independent variable for a regression analysis.
- the coefficient of determination can be calculated by:
- the coefficient of determination is one less the ratio of the sums of squares of the errors (SSE) to the total sums of squares (TSS).
- SSE sums of squares of the errors
- TSS total sums of squares
- the estimated regression line is characterized by a series of predicted values ( Y ); the average value of the dependent variable's data points is denoted Y ; and the individual data points are characterized by Yi Therefore, the total sum of squares, that is, the total variation in the data or the total variation about the average dependent value, is the total of the difference between the individual dependent values and its average (the total squared distance of Y i - Y ).
- the explained sum of squares is the total of the difference between the regression's predicted value and the average dependent variable's dataset (seen as the total squared distance of Y - Y ).
- the difference between the total variation (TSS) and the explained variation (ESS) is the unexplained sums of squares, also known as the sums of squares of the errors (SSE).
- the adjusted R-squared should be used instead of the regular R-squared in multivariate regressions because every time an independent variable is added into the regression analysis, the R-squared will increase, indicating that the percent variation explained has increased. This increase occurs even when nonsensical regressors are added.
- the adjusted R-squared takes the added regressors into account and penalizes the regression accordingly, providing a much better estimate of a regression model's goodness-of-fit.
- Other goodness-of-fit statistics include the t-statistic and the F-statistic.
- the former is used to test if each of the estimated slope and intercept(s) is statistically significant, that is, if it is statistically significantly different from zero (therefore making sure that the intercept and slope estimates are statistically valid).
- the latter applies the same concepts but simultaneously for the entire regression equation including the intercept and slopes. Using the previous example, the following illustrates how the t-statistic and F-statistic can be used in a regression analysis.
- test statistic is then based on the auxiliary regression of the errors ( ⁇ ):
- nR 2 statistic is the White's test statistic, computed as the number of observations (n) times the centered R-squared from the test regression.
- White's test statistic is asymptotically distributed as a / with degrees of freedom equal to the number of independent variables (excluding the constant) in the test regression.
- the White's test is also a general test for model misspecification, because the null hypothesis underlying the test assumes that the errors are both homoskedastic and independent of the regressors, and that the linear specification of the model is correct. Failure of any one of these conditions could lead to a significant test statistic. Conversely, a nonsignificant test statistic implies that none of the three conditions is violated. For instance, the resulting F-statistic is an omitted variable test for the joint significance of all cross products, excluding the constant.
- WLS weighted least squares
- ⁇ ⁇ 0 + ⁇ ⁇ ⁇ ⁇ + ⁇ 2 ⁇ 2 + ⁇ 3 ⁇ 3 + ⁇
- the model can be redefined as the following WLS regression:
- the Park's test can be applied to test for heteroskedasticity and to fix it.
- the Park's test model is based on the original regression equation, uses its errors, and creates an auxiliar re ression that takes the form of:
- VIF variance inflation factor
- a high VIF value indicates a high R-squared near unity.
- a VIF value greater than 10 is usually indicative of destructive multicollinearity.
- the Autoeconometrics method computes for multicollinearity and corrects the data before running the next iteration when enumerating through the entire set of possible combinations and permutations of models.
- One simple approach to test for autocorrelation is to graph the time series of a regression equation's residuals. If these residuals exhibit some cyclically, then autocorrelation exists.
- Another more robust approach to detect autocorrelation is the use of the Durbin- Watson statistic, which estimates the potential for a first-order autocorrelation.
- the Durbin- Watson test also identifies model misspecification, that is, if a particular time-series variable is correlated to itself one period prior. Many time-series data tend to be autocorrelated to their historical occurrences. This relationship can be due to multiple reasons, including the variables' spatial relationships (similar time and space), prolonged economic shocks and events, psychological inertia, smoothing, seasonal adjustments of the data, and so forth.
- the Durbin-Watson statistic is estimated by the ratio of sum of the squares of the regression errors for one eriod prior to the sum of the current period's errors:
- Fixing autocorrelation requires the application of advanced econometric models including the applications of ARIMA (as described above) or ECM (Error Correction Models).
- ARIMA as described above
- ECM Error Correction Models
- AIC Akaike Information Criterion
- SC Schwarz Criterion
- AIC and SC are used to determine if a particular model with a specific set of p, d, and q parameters is a good statistical fit. SC imposes a greater penalty for additional coefficients than the AIC but, generally, the model with the lowest AIC and SC values should be chosen.
- AC autocorrelation
- PAC partial autocorrelation
- autocorrelation AC(1) is nonzero, it means that the series is first-order serially correlated. If AC dies off more or less geometrically with increasing lags, it implies that the series follows a low-order autoregressive process. If AC drops to zero after a small number of lags, it implies that the series follows a low-order moving-average process.
- PAC measures the correlation of values that are k periods apart after removing the correlation from the intervening lags. If the pattern of autocorrelation can be captured by an autoregression of order less than k, then the partial autocorrelation at lag k will be close to zero.
- the Ljung-Box Q-statistics and their p-values at lag k are also provided, where the null hypothesis being tested is such that there is no autocorrelation up to order k.
- the dotted lines in the plots of the autocorrelations are the approximate two standard error bounds. If the autocorrelation is within these bounds, it is not significantly different from zero at approximately the 5% significance level.
- Finding the right ARIMA model takes practice and experience. These AC, PAC, SC, and AIC are highly useful diagnostic tools to help identify the correct model specification.
- the ARIMA parameter results are obtained using sophisticated optimization and iterative algorithms, which means that although the functional forms look like those of a multivariate regression, they are not the same. ARIMA is a much more computationally intensive and advanced econometric approach.
- the first moment describes the location of a distribution (i.e., mean, median, and mode) and is interpreted as the expected value, expected returns, or the average value of occurrences.
- the second moment measures a distribution's spread, or width, and is frequently described using measures such as Standard Deviations, Variances, Quartiles, and Inter-Quartile Ranges.
- Standard deviation is a popular measure indicating the average deviation of all data points from their mean. It is a popular measure as it is frequently associated with risk (higher standard deviations meaning a wider distribution, higher risk, or wider dispersion of data points around the mean value) and its units are identical to the units in the original dataset.
- Skewness is the third moment in a distribution. Skewness characterizes the degree of asymmetry of a distribution around its mean. Positive skewness indicates a distribution with an asymmetric tail extending toward more positive values. Negative skewness indicates a distribution with an asymmetric tail extending toward more negative values.
- Kurtosis characterizes the relative peakedness or flatness of a distribution compared to the normal distribution. It is the fourth moment in a distribution. A positive kurtosis value indicates a relatively peaked distribution. A negative kurtosis indicates a relatively flat distribution. The kurtosis measured here has been centered to zero (certain other kurtosis measures are centered on 3.0). While both are equally valid, centering across zero makes the interpretation simpler. A high positive kurtosis indicates a peaked distribution around its center and leptokurtic or fat tails. This indicates a higher probability of extreme events (e.g., catastrophic events, terrorist attacks, stock market crashes) than is predicted in a normal distribution.
- extreme events e.g., catastrophic events, terrorist attacks, stock market crashes
- the Correlation module lists the Pearson's product moment correlations (commonly referred to as the Pearson's R) between variable pairs.
- the correlation coefficient ranges between -1.0 and +1.0 inclusive.
- the sign indicates the direction of association between the variables, while the coefficient indicates the magnitude or strength of association.
- the Pearson's R only measures a linear relationship and is less effective in measuring nonlinear relationships.
- a hypothesis t-test is performed on the Pearson's R and the p-values are reported. If the calculated p-value is less than or equal to the significance level used in the test, then reject the null hypothesis and conclude that there is a significant correlation between the two variables in question. Otherwise, the correlation is not statistically significant.
- the Spearman's R first ranks the raw data then performs the correlation calculation, which allows it to better capture nonlinear relationships.
- the Pearson's R is a parametric test and the underlying data is assumed to be normally distributed, hence, the t-test can be applied.
- the Spearman's R is a nonparametric test, where no underlying distributions are assumed, and, hence, the t-test cannot be applied.
- the Covariance measures the average of the products of deviations for each data point pair. Use covariance to determine the relationship between two variables.
- the covariance is related to the correlation in that the correlation is the covariance divided by the product of the two variables' standard deviation, standardizing the correlation measurement to be unitless and between -1 and + 1.
- Covariance is used when the units of the variables are similar, allowing for easy comparison of the magnitude of variability about their respective means.
- the covariance of the same variable is also known as the variance.
- the variance of a variable is the square of its standard deviation. This is why standardizing the variance through dividing it by the variable's standard deviation (twice) yields a correlation of 1.0, indicating that a variable is perfectly correlated to itself.
- Absolute Values Computes the absolute value of a number where it is the number without its sign.
- Average Computes the average or arithmetic mean of the rows of data for the selected variable.
- Count Computes how many numbers there are in the rows of data for the selected variable.
- Difference Computes the difference of the current period from the previous period.
- Lag Returns the value lagged some number of periods (the entire chronological dataset is shifted down the number of lagged periods specified).
- Lead Returns the value leading by some number of periods (the entire chronological dataset is shifted up the number of lead periods specified).
- Max Computes the maximum of the rows of data for the selected variable.
- Median Computes the median of the rows of data for the selected variable.
- Min Computes the minimum of the rows of data for the selected variable.
- Mode Computes the mode, or most frequently occurring, of data points for the selected variable.
- Power Computes the result of a number raised to a specified power.
- Rank Ascending Ranks the rows of data for the selected variable in ascending order.
- Rank Descending Ranks the rows of data for the selected variable in descending order.
- Relative LN Returns Computes the natural logarithm of the relative returns from one period to another, where the relative return is computed as the current value divided by its previous value.
- Relative Returns Computes the relative return where the current value is divided by its previous value.
- Standard Deviation Computes the standard deviation of the rows of data for the selected variable.
- Variance Computes the variance of the rows of data for the selected variable.
- T-Test One- Variable Testing for Means
- This one-variable t-test of means is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal (the t-test is used when the sample size is less than 30).
- This t-test can be applied to three types of hypothesis tests to be examined— a two-tailed test, a right-tailed test, and a left-tailed test— based on the sample dataset if the population mean is equal to, less than, or greater than the hypothesized mean.
- the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population mean is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized mean based on the sample tested. Otherwise, the true population mean is statistically similar to the hypothesized mean.
- the one-variable Z-test is appropriate when the population standard deviation is known and the sampling distribution is assumed to be approximately normal (this applies when the number of data points exceeds 30).
- This Z-test can be applied to three types of hypothesis tests to be examined— a two-tailed test, a right-tailed test, and a left-tailed test— based on the sample dataset if the population mean is equal to, less than, or greater than the hypothesized mean.
- the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population mean is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized mean based on the sample tested. Otherwise, the true population mean is statistically similar to the hypothesized mean.
- the one-variable Z-test for proportions is appropriate when the sampling distribution is assumed to be approximately normal (this applies when the number of data points exceeds 30, and when the number of data points, N, multiplied by the hypothesized population proportion mean, P, is greater than or equal to five, or NP ⁇ 5 ).
- the data used in the analysis have to be proportions and be between 0 and 1.
- This Z-test can be applied to three types of hypothesis tests to be examined— a two-tailed test, a right-tailed test, and a left-tailed test— based on the sample dataset if the population mean is equal to, less than, or greater than the hypothesized mean.
- the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population mean is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized mean based on the sample tested. Otherwise, the true population mean is statistically similar to the hypothesized mean.
- the two-variable dependent t-test is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal (the t-test is used when the sample size is less than 30).
- this test is specifically formulated for testing the same or similar samples before and after an event (e.g., measurements taken before a medical treatment are compared against those measurements taken after the treatment to see if there is a difference).
- This t-test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test.
- the two-tailed null hypothesis tests that the true population's mean of the difference between the two variables is zero, versus the alternate hypothesis that the difference is statistically different from zero.
- the right-tailed null hypothesis test is such that the difference in the population means (first mean less second mean) is statistically less than or equal to zero (which is identical to saying that mean of the first sample is less than or equal to the mean of the second sample).
- the alternative hypothesis is that the real populations' mean difference is statistically greater than zero when tested using the sample dataset (which is identical to saying that the mean of the first sample is greater than the mean of the second sample).
- the left-tailed null hypothesis test is such that the difference in the population means (first mean less second mean) is statistically greater than or equal to zero (which is identical to saying that the mean of the first sample is greater than or equal to the mean of the second sample).
- the alternative hypothesis is that the real populations' mean difference is statistically less than zero when tested using the sample dataset (which is identical to saying that the mean of the first sample is less than the mean of the second sample).
- the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population difference of the population means is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) zero based on the sample tested. Otherwise, the true population mean is statistically similar to the hypothesized mean.
- the two-variable t-test with equal variances is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal (the t-test is used when the sample size is less than 30). In addition, the two independent samples are assumed to have similar variances.
- This t-test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test.
- a two-tailed hypothesis tests the null hypothesis, H 0 , such that the populations' mean difference between the two variables is statistically identical to the hypothesized mean differences (HMD). If HMD is set to zero, this is the same as saying that the first mean equals the second mean.
- HMD hypothesized mean differences
- Ha is that the difference between the real population means is statistically different from the hypothesized mean differences when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean does not equal the second mean.
- a right-tailed hypothesis tests the null hypothesis, H 0 , such that the population mean differences between the two variables is statistically less than or equal to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean is less than or equals the second mean.
- the alternative hypothesis, Ha is that the real difference between population means is statistically greater than the hypothesized mean differences when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean is greater than the second mean.
- a left-tailed hypothesis tests the null hypothesis, H 0 , such that the differences between the population means of the two variables is statistically greater than or equal to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean is greater than or equals the second mean.
- the alternative hypothesis, Ha is that the real difference between population means is statistically less than the hypothesized mean difference when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean is less than the second mean.
- the two-variable t-test with unequal variances (the population variance of sample 1 is expected to be different from the population variance of sample 2) is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal (the t-test is used when the sample size is less than 30). In addition, the two independent samples are assumed to have similar variances.
- This t-test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test.
- a two-tailed hypothesis tests the null hypothesis, H 0 , such that the population mean differences between the two variables are statistically identical to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean equals the second mean.
- the alternative hypothesis, Ha is that the real difference between the population means is statistically different from the hypothesized mean differences when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean does not equal the second mean.
- a right-tailed hypothesis tests the null hypothesis, H 0 , such that the difference between the two variables' population means is statistically less than or equal to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean is less than or equals the second mean.
- the alternative hypothesis, Ha is that the real populations' mean difference is statistically greater than the hypothesized mean differences when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean is greater than the second mean.
- a left-tailed hypothesis tests the null hypothesis, H 0 , such that the difference between the two variables' population means is statistically greater than or equal to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean is greater than or equals the second mean.
- the alternative hypothesis, Ha is that the real difference between population means is statistically less than the hypothesized mean difference when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean is less than the second mean.
- the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population difference of the population means is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized mean based on the sample tested. Otherwise, the true difference of the population means is statistically similar to the hypothesized mean.
- the two-variable Z-test is appropriate when the population standard deviations are known for the two samples, and the sampling distribution of each variable is assumed to be approximately normal (this applies when the number of data points of each variable exceeds 30).
- This Z-test can be applied to three types of hypothesis tests: a two-tailed test, a right- tailed test, and a left-tailed test.
- a two-tailed hypothesis tests the null hypothesis, H 0 , such that the difference between the two population means is statistically identical to the hypothesized mean.
- the alternative hypothesis, Ha is that the real difference between the two population means is statistically different from the hypothesized mean when tested using the sample dataset.
- a right-tailed hypothesis tests the null hypothesis, H 0 , such that the difference between the two population means is statistically less than or equal to the hypothesized mean.
- the alternative hypothesis, Ha is that the real difference between the two population means is statistically greater than the hypothesized mean when tested using the sample dataset.
- a left-tailed hypothesis tests the null hypothesis, H 0 , such that the difference between the two population means is statistically greater than or equal to the hypothesized mean.
- the alternative hypothesis, Ha is that the real difference between the two population means is statistically less than the hypothesized mean when tested using the sample dataset.
- a two-tailed hypothesis tests the null hypothesis, H 0 , that the difference in the population proportion is statistically identical to the hypothesized difference (if the hypothesized difference is set to zero, the null hypothesis tests if the population proportions of the two samples are identical).
- the alternative hypothesis, Ha is that the real difference in population proportions is statistically different from the hypothesized difference when tested using the sample dataset.
- a right-tailed hypothesis tests the null hypothesis, H 0 , that the difference in the population proportion is statistically less than or equal to the hypothesized difference (if the hypothesized difference is set to zero, the null hypothesis tests if population proportion of sample 1 is equal to or less than the population proportion of sample 2).
- the alternative hypothesis, Ha is that the real difference in population proportions is statistically greater than the hypothesized difference when tested using the sample dataset.
- a left-tailed hypothesis tests the null hypothesis, H 0 , that the difference in the population proportion is statistically greater than or equal to the hypothesized difference (if the hypothesized difference is set to zero, the null hypothesis tests if population proportion of sample 1 is equal to or greater than the population proportion of sample 2).
- the alternative hypothesis, Ha is that the real difference in population proportions is statistically less than the hypothesized difference when tested using the sample dataset.
- the two-variable F-test analyzes the variances from two samples (the population variance of sample 1 is tested with the population variance of sample 2 to see if they are equal) and is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal.
- the measurement of variation is a key issue in Six Sigma and quality control applications. In this illustration, suppose that the variation or variance around the units produced in a manufacturing process is compared to another process to determine which process is more variable and, hence, less predictable in quality.
- This F-test can typically be applied to a single hypothesis test: a two-tailed test.
- a two- tailed hypothesis tests the null hypothesis, H 0 , such that the population variance of the two variables is statistically identical.
- the alternative hypothesis, Ha is that the population variances are statistically different from one another when tested using the sample dataset.
- Nonparametric techniques make no assumptions about the specific shape or distribution from which the sample is drawn. This lack of assumptions makes it different from the other hypotheses tests such as ANOVA or t-tests (parametric tests) where the sample is assumed to be drawn from a population that is normally or approximately normally distributed. If normality is assumed, the power of the test is higher due to this normality restriction. However, if flexibility on distributional requirements is needed, then nonparametric techniques are superior. In general, nonparametric methodologies provide the following advantages over other parametric tests:
- nonparametric tests should be used when the data are nominal or ordinal, or when the data are interval or ratio but the normality assumption is not met. The following covers each of the nonparametric tests available for use in the software.
- the Chi-Square test for goodness of fit is used to determine whether a sample dataset could have been drawn from a population having a specified probability distribution.
- the probability distribution tested here is the normal distribution.
- the null hypothesis (Ho) tested is such that the sample is randomly drawn from the normal distribution, versus the alternate hypothesis (Ha) that the sample is not from a normal distribution. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
- the Chi-Square test for independence examines two variables to see if there is some statistical relationship between them. This test is not used to find the exact nature of the relationship between the two variables, but to simply test if the variables could be independent of each other.
- the null hypothesis (Ho) tested is such that the variables are independent of each other, versus the alternate hypothesis (Ha) that the variables are not independent of each other.
- the Chi-Square test looks at a table of observed frequencies and a table of expected frequencies. The amount of disparity between these two tables is calculated and compared with the Chi-Square test statistic. The observed frequencies reflect the cross-classification for members of a single sample, and the table of expected frequencies is constructed under the assumption that the null hypothesis is true.
- the Chi-Square test for population variance is used for hypothesis testing and confidence interval estimation for a population variance.
- the population variance of a sample is typically unknown, and, hence, the need for quantifying this confidence interval.
- the population is assumed to be normally distributed.
- the Friedman test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This method is an extension of the Wilcoxon Signed-Rank test for paired samples.
- the corresponding parametric test is the Randomized Block Multiple Treatment ANOVA, but unlike the ANOVA, the Friedman test does not require that the dataset be randomly sampled from normally distributed populations with equal variances.
- the Friedman test uses a two-tailed hypothesis test where the null hypothesis (H 0 ) is such that the population medians of each treatment are statistically identical to the rest of the group. That is, there is no effect among the different treatment groups.
- the alternative hypothesis (Ha) is such that the real population medians are statistically different from one another when tested using the sample dataset. That is, the medians are statistically different, which means that there is a statistically significant effect among the different treatment groups. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
- the Kruskal-Wallis test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This method is an extension of the Wilcoxon Signed-Rank test by comparing more than two independent samples.
- the corresponding parametric test is the One- Way ANOVA, but unlike the ANOVA, the Kruskal-Wallis does not require that the dataset be randomly sampled from normally distributed populations with equal variances.
- the Kruskal- Wallis test is a two-tailed hypothesis test where the null hypothesis (H 0 ) is such that the population medians of each treatment are statistically identical to the rest of the group. That is, there is no effect among the different treatment groups.
- the alternative hypothesis (Ha) is such that the real population medians are statistically different from one another when tested using the sample dataset. That is, the medians are statistically different, which means that there is a statistically significant effect among the different treatment groups. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
- the Lilliefors test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed.
- This test evaluates the null hypothesis (H 0 ) of whether the data sample was drawn from a normally distributed population, versus an alternate hypothesis (Ha) that the data sample is not normally distributed. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
- This test relies on two cumulative frequencies: one derived from the sample dataset and one from a theoretical distribution based on the mean and standard deviation of the sample data. An alternative to this test is the Chi-Square test for normality. The Chi-Square test requires more data points to run compared to the Lilliefors test.
- the runs test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This test evaluates the randomness of a series of observations by analyzing the number of runs it contains. A run is a consecutive appearance of one or more observations that are similar.
- the null hypothesis (H 0 ) tested is whether the data sequence is random, versus the alternate hypothesis (Ha) that the data sequence is not random. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
- the single variable Wilcoxon Signed-Rank test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This method looks at whether a sample dataset could have been randomly drawn from a particular population whose median is being hypothesized.
- the corresponding parametric test is the one-sample t-test, which should be used if the underlying population is assumed to be normal, providing a higher power on the test.
- the Wilcoxon Signed-Rank test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test.
- the calculated Wilcoxon statistic is outside the critical limits for the specific significance level in the test, reject the null hypothesis and conclude that the true population median is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized median based on the sample tested. Otherwise, the true population median is statistically similar to the hypothesized median.
- the Wilcoxon Signed-Rank test for paired variables is a form of nonparametric test, which makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This method looks at whether the median of the differences between the two paired variables are equal. This test is specifically formulated for testing the same or similar samples before and after an event (e.g., measurements taken before a medical treatment are compared against those measurements taken after the treatment to see if there is a difference).
- the corresponding parametric test is the two-sample t- test with dependent means, which should be used if the underlying population is assumed to be normal, providing a higher power on the test.
- the Wilcoxon Signed-Rank test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test.
- a two-tailed test For illustrative purposes, suppose that a new engine design is tested against an existing engine design to see if there is a statistically significant difference between the two.
- the paired variable Wilcoxon Signed-Rank test can be applied. If the calculated Wilcoxon statistic is outside the critical limits for the specific significance level in the test, reject the null hypothesis and conclude that the difference between the true population medians is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized median difference based on the sample tested. Otherwise, the true population median is statistically similar to the hypothesized median.
- the one-way ANOVA for single factor with multiple treatments test is an extension of the two-variable t-test, looking at multiple variables simultaneously.
- the ANOVA is appropriate when the sampling distribution is assumed to be approximately normal.
- ANOVA can be applied to only the two-tailed hypothesis test.
- a two-tailed hypothesis tests the null hypothesis (H 0 ) such that the population means of each treatment is statistically identical to the rest of the group, which means that there is no effect among the different treatment groups.
- the alternative hypothesis (Ha) is such that the real population means are statistically different from one another when tested using the sample dataset.
- the one-way randomized block ANOVA is appropriate when the sampling distribution is assumed to be approximately normal and when there is a block variable for which ANOVA will control (block the effects of this variable by controlling it in the experiment).
- ANOVA can be applied to only the two-tailed hypothesis test. This analysis can test for the effects of both the treatments as well as the effectiveness of the control, or block, variable.
- the two-way ANOVA is an extension of the single factor and randomized block ANOVA by simultaneously examining the effects of two factors on the dependent variable, along with the effects of interactions between the different levels of these two factors. Unlike the randomized block design, this model examines the interactions between different levels of the factors, or independent variables. In a two-factor experiment, interaction exists when the effect of a level for one factor depends on which level of the other factor is present.
- the first test is on the first independent variable, where the null hypothesis is that no level of the first factor has an effect on the dependent variable.
- the alternate hypothesis is that there is at least one level of the first factor having an effect on the dependent variable. If the calculated p- value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
- the second test is on the second independent variable, where the null hypothesis is that no level of the second factor has an effect on the dependent variable.
- the alternate hypothesis is that there is at least one level of the second factor having an effect on the dependent variable. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
- the third test is on the interaction of both the first and second independent variables, where the null hypothesis is that there are no interacting effects between levels of the first and second factors.
- the alternate hypothesis is that there is at least one combination of levels of the first and second factors having an effect on the dependent variable. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
- the Two- Way ANOVA module creates tables such as the one below, and select the data in the blue area (804 to 835). Users can extend the data by adding rows of factors and columns of treatments. Note that the number of replications in the table above is 2 (i.e., two rows of observations per Factor A type). Of course, users can increase the number of replications as required. The number of replications has to be consistent if users wish to extend the dataset.
- Forecasting, Multiple Regression, and Econometrics [0438] ARIMA (Autoregressive Integrated Moving Average)
- ARIMA forecasting assembles three separate tools into a comprehensive model.
- the first tool segment is the autoregressive or "AR" term, which corresponds to the number of lagged value of the residual in the unconditional forecast model.
- AR autoregressive
- the second tool segment is the integration order or the "I" term. This integration term corresponds to the number of differencing the time series to be forecasted goes through. This element accounts for any nonlinear growth rates existing in the data.
- the third tool segment is the moving average or "MA" term, which is essentially the moving average of lagged forecast errors.
- MA moving average
- ARIMA is an advanced modeling technique used to model and forecast time-series data (data that have a time component to them, e.g., interest rates, inflation, sales revenues, gross domestic product).
- the ARIMA Auto Model selection will analyze all combinations of ARIMA (p,d,q) for the most common values of 0, 1, and 2, and reports the relevant Akaike Information Criterion (AIC) and Schwarz Criterion (SC). The lowest AIC and SC model is then chosen and run. Users can also add in exogenous variables into the model selection.
- AIC Akaike Information Criterion
- SC Schwarz Criterion
- ARIMA(p,d,q) models are the extension of the AR model that uses three components for modeling the serial correlation in the time-series data.
- the first component is the autoregressive (AR) term.
- the AR(p) model uses the p lags of the time series in the equation.
- the second component is the integration (d) order term. Each integration order corresponds to differencing the time series. 1(1) means differencing the data once; 1(d) means differencing the data d times.
- the third component is the moving average (MA) term.
- the MA(q) model uses the q lags of the forecast errors to improve the forecast.
- Econometrics refers to a branch of business analytics, modeling, and forecasting techniques for modeling the behavior or forecasting certain business, financial, economic, physical science, and other variables. Running the Basic Econometrics models is similar to regular regression analysis except that the dependent and independent variables are allowed to be modified before a regression is run. The report generated is the same as shown in the Multiple Regression section previously and the interpretations are identical to those described previously
- fuzzy logic is derived from fuzzy set theory to deal with reasoning that is approximate rather than accurate.
- fuzzy logic variables may have a truth value that ranges between 0 and 1 and is not constrained to the two truth values of classic propositional logic.
- This fuzzy weighting schema is used together with a combinatorial method to yield time-series forecast results. Note that neither neural networks nor fuzzy logic techniques have yet been established as valid and reliable methods in the business forecasting domain, on either a strategic, tactical, or operational level. Much research is still required in these advanced forecasting fields. Nonetheless, PEAT's Forecast Statistics module provides the fundamentals of these two techniques for the purposes of running time-series forecasts.
- the Generalized Autoregressive Conditional Heteroskedasticity (GARCH) Model is used to model historical and forecast future volatility levels of a marketable security (e.g., stock prices, commodity prices, oil prices, etc.).
- the dataset has to be a time series of raw price levels.
- GARCH will first convert the prices into relative returns and then run an internal optimization to fit the historical data to a mean-reverting volatility term structure, while assuming that the volatility is heteroskedastic in nature (changes over time according to some econometric characteristics).
- GARCH models available in PEAT's Forecast Statistics module, including EGARCH, EGARCH-T, GARCH-M, GJR-GARCH, GJR- GARCH-T, IGARCH, and T-GARCH.
- GARCH models are used mainly in analyzing financial time-series data to ascertain their conditional variances and volatilities. These volatilities are then used to value the options as usual, but the amount of historical data necessary for a good volatility estimate remains significant. Usually, several dozen— and even up to hundreds— of data points are required to obtain good GARCH estimates.
- GARCH is a term that incorporates a family of models that can take on a variety of forms, known as GARCH(p,q), where p and q are positive integers that define the resulting GARCH model and its forecasts.
- a GARCH(1,1) is sufficient and is most generally used.
- the first equation's dependent variable (y t ) is a function of exogenous variables (x t ) with an error term (s t ).
- the second equation estimates the variance (squared volatility a t 2 ) at time t, which depends on a historical mean (co); on news about volatility from the previous period, measured as a lag of the squared residual from the mean equation (SM 2 ); and on volatility from the previous period ( ⁇ ( . ⁇ 2 ).
- ⁇ . ⁇ 2
- J-Curve and S-Curve Forecasts [0458]
- the J curve, or exponential growth curve, is one where the growth of the next period depends on the current period's level and the increase is exponential. This phenomenon means that over time, the values will increase significantly, from one period to another. This model is typically used in forecasting biological growth and chemical reactions over time.
- the S curve or logistic growth curve, starts off like a J curve, with exponential growth rates. Over time, the environment becomes saturated (e.g., market saturation, competition, overcrowding), the growth slows, and the forecast value eventually ends up at a saturation or maximum level.
- the S-curve model is typically used in forecasting market share or sales growth of a new product from market introduction until maturity and decline, population dynamics, growth of bacterial cultures, and other naturally occurring variables.
- a Markov chain exists when the probability of a future state depends on a previous state and when linked together forms a chain that reverts to a long-run steady state level. This Markov approach is typically used to forecast the market share of two competitors.
- the required inputs are the starting probability of a customer in the first store (the first state) returning to the same store in the next period versus the probability of switching to a competitor's store in the next state.
- Neural Network is often used to refer to a network or circuit of biological neurons, while modern usage of the term often refers to artificial neural networks comprising artificial neurons, or nodes, recreated in a software environment. Such networks attempt to mimic the neurons in the human brain in ways of thinking and identifying patterns and, in our situation, identifying patterns for the purposes of forecasting time-series data.
- the number of hidden layers in the network is an input parameter and will need to be calibrated with user data. Typically, the more complicated the data pattern, the higher the number of hidden layers users would need and the longer it would take to compute. It is recommended that users start at 3 layers.
- the testing period is simply the number of data points used in the final calibration of the Neural Network model, and it is recommended that at least the same number of periods users wish to forecast as the testing period be used.
- Extrapolation involves making statistical forecasts by using historical trends that are projected for a specified period of time into the future. It is only used for time-series forecasts. For cross-sectional or mixed panel data (time-series with cross-sectional data), multivariate regression is more appropriate. This methodology is useful when major changes are not expected; that is, causal factors are expected to remain constant or when the causal factors of a situation are not clearly understood. It also helps discourage the introduction of personal biases into the process. Extrapolation is fairly reliable, relatively simple, and inexpensive.
- This methodology estimates the /( c) function for any arbitrary x value, by interpolating a smooth nonlinear curve through all the x values and, using this smooth curve, extrapolates future x values beyond the historical dataset.
- the methodology employs either the polynomial functional form or the rational functional form (a ratio of two polynomials).
- a polynomial functional form is sufficient for well-behaved data; however, rational functional forms are sometimes more accurate (especially with polar functions, i.e., functions with denominators approaching zero).
- Principal Components Analysis is a way of identifying patterns in data and recasting the data in such a way as to highlight their similarities and differences. Patterns of data are very difficult to find in high dimensions when multiple variables exist, and higher dimensional graphs are very difficult to represent and interpret. Once the patterns in the data are found, they can be compressed, resulting in a reduction of the number of dimensions. This reduction of data dimensions does not mean much loss of information. Instead, similar levels of information can now be obtained by fewer variables.
- the analysis provides the Eigenvalues and Eigenvectors of the dataset.
- the Eigenvector with the highest Eigenvalue is the principle component of the dataset. Ranking the Eigenvalues from highest to lowest provides the components in order of statistical significance. If the Eigenvalues are small, users do not lose much information. It is up to users to decide how many components to ignore based on their Eigenvalues. The proportions and cumulative proportions tell users how much of the variation in the dataset can be explained by incorporating that component. Finally, the data is then transformed to account for only the number of components users decide to keep.
- Spline curves can be used to interpolate the missing years' interest rate values based on the data that exist. Spline curves can also be used to forecast or extrapolate values of future time periods beyond the time period of available data.
- the data can be linear or nonlinear.
- the Known X values represent the values on the x-axis of a chart (as an example, this is Years of the known interest rates, and, usually, the x-axis are the values that are known in advance such as time or years) and the Known Y values represent the values on the y-axis (in our case, the known Interest Rates).
- the y-axis variable is typically the variable users wish to interpolate missing values from or extrapolate the values into the future.
- Stepwise Regression One powerful automated approach to regression analysis is Stepwise Regression. Based on its namesake, the regression process proceeds in multiple steps. There are several ways to set up these stepwise algorithms, including the correlation approach, forward method, backward method, and the forward and backward method.
- the dependent variable (Y) is correlated to all the independent variables (X), and a regression is run, starting with the X variable with the highest absolute correlation value. Then subsequent X variables are added until the p-values indicate that the new X variable is no longer statistically significant.
- This approach is quick and simple but does not account for interactions among variables, and an X variable, when added, will statistically overshadow other variables.
- the forward method is applied to obtain three X variables, and then the backward approach is applied to see if one of them needs to be eliminated because it is statistically insignificant. The forward method is repeated, and then the backward method until all remaining variables are considered.
- the Stepwise Regression is an automatic search process iterating through all the independent variables, and it models the variables that are statistically significant in explaining the variations in the dependent variable.
- Stepwise Regression is powerful when there are many independent variables and a large combination of models can be built.
- sales revenue is the dependent variable Y
- the independent variables X ⁇ to X5 are the size of the advertisement, cost of the ad, number of readers, day of the week, and how frequently it appears a week.
- Stepwise Regression will automatically iterate through these X variables to find those that are statistically significant in the regression model.
- Interpreting the regression analysis is more complex (this may include hypothesis t-tests, F-tests, ANOVA, correlations, autocorrelations, etc.).
- Forecasting is the act of predicting the future whether it is based on historical data or speculation about the future when no history exists.
- a quantitative or statistical approach is best, but if no historical data exist, then a qualitative or judgmental approach is usually the only recourse.
- the best-fitting test for the moving average forecast uses the Root Mean Squared Errors (RMSE).
- RMSE calculates the square root of the average squared deviations of the fitted values versus the actual data points.
- Mean Squared Error is an absolute error measure that squares the errors (the difference between the actual historical data and the forecast-fitted data predicted by the model) to keep the positive and negative errors from canceling each other out. This measure also tends to exaggerate large errors by weighting the large errors more heavily than smaller errors by squaring them, which can help when comparing different time-series models.
- Root Mean Square Error is the square root of MSE and is the most popular error measure, also known as the quadratic loss function. RMSE can be defined as the average of the absolute values of the forecast errors and is highly appropriate when the cost of the forecast errors is proportional to the absolute size of the forecast error.
- Mean Absolute Deviation is an error statistic that averages the distance (absolute value of the difference between the actual historical data and the forecast- fitted data predicted by the model) between each pair of actual and fitted forecast data points and is most appropriate when the cost of forecast errors is proportional to the absolute size of the forecast errors.
- Mean Absolute Percentage Error is a relative error statistic measured as an average percent error of the historical data points and is most appropriate when the cost of the forecast error is more closely related to the percentage error than the numerical size of the error.
- an associated measure is the Theil's U statistic, which measures the naivety of the model's forecast. That is, if the Theil's U statistic is less than 1.0, then the forecast method used provides an estimate that is statistically better than guessing.
- the single moving average is applicable when time-series data with no trend and seasonality exist. This model is not appropriate when used to predict cross-sectional data.
- the single moving average simply uses an average of the actual historical data to project future outcomes. This average is applied consistently moving forward, hence the term moving average.
- the value of the moving average for a specific length is simply the summation of actual historical data arranged and indexed in a time sequence. The software finds the optimal moving average lag automatically through an optimization process that minimizes the forecast errors.
- the double moving average method will smooth out past data by performing a moving average on a subset of data that represents a moving average of an original set of data. That is, a second moving average is performed on the first moving average.
- the second moving average application captures the trending effect of the data.
- the results are then weighted and forecasts are created.
- the software finds the optimal moving average lag automatically through an optimization process that minimizes the forecast errors.
- Double exponential smoothing is used when the data exhibit a trend but no seasonality. This model is not appropriate when used to predict cross-sectional data. Double exponential smoothing applies single exponential smoothing twice, once to the original data and then to the resulting single exponential smoothing data.
- An alpha weighting parameter is used on the first or single exponential smoothing (SES), while a beta weighting parameter is used on the second or double exponential smoothing (DES). This approach is useful when the historical data series is not stationary.
- the software finds the optimal alpha and beta parameters automatically through an optimization process that minimizes the forecast errors.
- the additive seasonality model breaks the historical data into a level (L), or base-case, component as measured by the alpha parameter, and a seasonality (S) component measured by the gamma parameter.
- L level
- S seasonality
- the resulting forecast value is simply the addition of this base-case level to the seasonality value.
- the software finds the optimal alpha and gamma parameters automatically through an optimization process that minimizes the forecast errors.
- the multiplicative seasonality model breaks the historical data into a level (L), or base-case, component as measured by the alpha parameter, and a seasonality (S) component measured by the gamma parameter.
- L level
- S seasonality
- the resulting forecast value is simply the multiplication of this base-case level by the seasonality value.
- the software finds the optimal alpha and gamma parameters automatically through an optimization process that minimizes the forecast errors.
- Trendlines can be used to determine if a set of time-series data follows any appreciable trend.
- Trends can be linear or nonlinear (such as exponential, logarithmic, moving average, polynomial, or power).
- the process usually includes removing the effects of accumulating datasets from seasonality and trend to show only the absolute changes in values and to allow potential cyclical patterns to be identified after removing the general drift, tendency, twists, bends, and effects of seasonal cycles of a set of time-series data.
- a detrended dataset may be necessary to see a more accurate account of a company's sales in a given year by shifting the entire dataset from a slope to a flat surface to better expose the underlying cycles and fluctuations.
- the Bliss interpolation model is used for generating the term structure of interest rates and yield curve estimation. Econometric modeling techniques are required to calibrate the values of several input parameters in this model.
- the Bliss approach modifies the Nelson-Siegel method by adding an additional generalized parameter. Virtually any yield curve shape can be interpolated using these two models, which are widely used at banks around the world.
- the Nelson-Siegel model is run with four curve estimation parameters. If properly modeled, it can be made to fit almost any yield curve shape. Calibrating the inputs in these models requires facility with econometric modeling and error optimization techniques. Typically, if some interest rates exist, a better approach is to use a spline interpolation method such as cubic spline and so forth.
- a stochastic process is nothing but a mathematically defined equation that can create a series of outcomes over time, outcomes that are not deterministic in nature. That is, it does not follow any simple discernible rule such as price will increase X percent every year or revenues will increase by this factor of X plus Y percent.
- a stochastic process is, by definition, nondeterministic, and one can plug numbers into a stochastic process equation and obtain different results every time. For instance, the path of a stock price is stochastic in nature, and one cannot reliably predict the stock price path with any certainty. However, the price evolution over time is enveloped in a process that generates these prices. The process is fixed and predetermined, but the outcomes are not. Hence, by stochastic simulation, we create multiple pathways of prices, obtain a statistical sampling of these simulations, and make inferences on the potential pathways that the actual price may undertake given the nature and parameters of the stochastic process used to generate the time series.
- Autocorrelation can be defined as the correlation of a dataset to itself in the past. It is the correlation between observations of a time series separated by specified time units. Certain time- series data follow an autocorrelated series as future outcomes rely heavily on past outcomes (e.g., revenues or sales that follow a weekly, monthly, quarterly, or annual seasonal cycle; inflation and interest rates that follow some economic or business cycle, etc.).
- the term autocorrelation describes a relationship or correlation between values of the same data series at different time periods.
- lag defines the offset when comparing a data series with itself. For autocorrelation, lag refers to the offset of data that users choose when correlating a data series with itself.
- the autocorrelation function is calculated, together with the Q-statistic and relevant p-values. If the p-values are below the tested significance level, then the null hypothesis (H 0 ) of no autocorrelation is rejected, and it is concluded that there is autocorrelation with that particular lag.
- control limits are not set; instead, statistical control limits are computed based on the actual data collected (e.g., the number of defects in a manufacturing line).
- the upper control limit (UCL) and lower control limit (LCL) are computed, as are the central line (CL) and other sigma levels.
- the resulting chart is called a control chart, and if the process is out of control, the actual defect line will be outside of the UCL and LCL lines.
- the LCL is a negative value, we set the floor as zero.
- ⁇ 1 and 2 sigma lines we can divide the control charts into several areas or zones. The following are rules of thumb that typically apply to control charts to determine if the process is out of control:
- a potential structural shift can be detected if any one of the following occurs:
- An X-Bar Chart is used when the variable has raw data values and there are multiple measurements in a sample experiment, multiple experiments are run, and the average of the collected data is of interest.
- An R-Bar Chart is used when the variable has raw data values and there are multiple measurements in a sample experiment, multiple experiments are run, and the range of the collected data is of interest.
- An XMR Chart is used when the variable has raw data values and is a single measurement taken in each sample experiment, multiple experiments are run, and the actual value of the collected data is of interest.
- a P Chart is used when the variable of interest is an attribute (e.g., defective or nondefective) and the data collected are in proportions of defects (or number of defects in a specific sample), there are multiple measurements in a sample experiment, multiple experiments are run with differing numbers of samples collected in each, and the average proportion of defects of the collected data is of interest.
- an attribute e.g., defective or nondefective
- An NP Chart is used when the variable of interest is an attribute (e.g., defective or nondefective) and the data collected are in proportions of defects (or number of defects in a specific sample), there are multiple measurements in a sample experiment, multiple experiments are run with a constant number of samples in each, and the average proportion of defects of the collected data is of interest.
- an attribute e.g., defective or nondefective
- a C Chart is used when the variable of interest is an attribute (e.g., defective or nondefective) and the data collected are in total number of defects (actual count in units), there are multiple measurements in a sample experiment, multiple experiments are run with the same number of samples collected in each, and the average number of defects of the collected data is of interest.
- an attribute e.g., defective or nondefective
- the data collected are in total number of defects (actual count in units)
- a U Chart is used when the variable of interest is an attribute (e.g., defective or nondefective) and the data collected are in total number of defects (actual count in units), there are multiple measurements in a sample experiment, multiple experiments are run with differing numbers of samples collected in each, and the average number of defects of the collected data is of interest.
- an attribute e.g., defective or nondefective
- the data collected are in total number of defects (actual count in units)
- the data deseasonalization method removes any seasonal components in the original data.
- the process usually includes removing the effects of accumulating datasets from seasonality and trend to show only the absolute changes in values and to allow potential cyclical patterns to be identified after removing the general drift, tendency, twists, bends, and effects of seasonal cycles of a set of time-series data.
- Many time-series data exhibit seasonality where certain events repeat themselves after some time period or seasonality period (e.g., ski resorts' revenues are higher in winter than in summer, and this predictable cycle will repeat itself every winter).
- Seasonality periods represent how many periods would have to pass before the cycle repeats itself (e.g., 24 hours in a day, 12 months in a year, 4 quarters in a year, 60 minutes in an hour, etc.).
- a seasonal index greater than 1 indicates a high period or peak within the seasonal cycle, and a value below 1 indicates a dip in the cycle.
- Another powerful simulation tool is distributional fitting or determining which distribution to use for a particular input variable in a model and what the relevant distributional parameters are. If no historical data exist, then the analyst must make assumptions about the variables in question.
- One approach is to use the Delphi method where a group of experts is tasked with estimating the behavior of each variable. For instance, a group of mechanical engineers can be tasked with evaluating the extreme possibilities of a spring coil's diameter through rigorous experimentation or guesstimates. These values can be used as the variable's input parameters (e.g., uniform distribution with extreme values between 0.5 and 1.2).
- Heteroskedasticity is defined as the variance of the forecast errors increasing over time. If pictured graphically, the width of the vertical data fluctuations increases or fans out over time. As an example, the data points have been changed to exaggerate the effect. However, in most time-series analysis, checking for heteroskedasticity is a much more difficult task. The coefficient of determination, or R-squared, in a multiple regression analysis drops significantly when heteroskedasticity exists. As is, the current regression model is insufficient and incomplete. [0533] If the variance of the dependent variable is not constant, then the error's variance will not be constant. The most common form of such heteroskedasticity in the dependent variable is that the variance of the dependent variable may increase as the mean of the dependent variable increases for data with positive independent and dependent variables.
- Heteroskedasticity of the dependent variable is usually detected informally by examining the X-Y scatter plot of the data before performing the regression. If both nonlinearity and unequal variances are present, employing a transformation of the dependent variable may have the effect of simultaneously improving the linearity and promoting equality of the variances. Otherwise, a weighted least-squares linear regression may be the preferred method of dealing with nonconstant variance of the dependent variable.
- Limited Dependent Variables describe the situation where the dependent variable contains data that are limited in scope and range, such as binary responses (0 or 1) and truncated, ordered, or censored data. For instance, given a set of independent variables (e.g., age, income, education level of credit card debt, or mortgage loan holders), we can model the probability of default using maximum likelihood estimation (MLE).
- MLE maximum likelihood estimation
- the response or dependent variable Y is binary, that is, it can have only two possible outcomes that we denote as 1 and 0 (e.g., 7 may represent presence/absence of a certain condition, defaulted/not defaulted on previous loans, success/failure of some device, answer yes/no on a survey, etc.), and we also have a vector of independent variable regressors X, which are assumed to influence the outcome Y.
- a typical ordinary least squares regression approach is invalid because the regression errors are heteroskedastic and non-normal, and the resulting estimated probability estimates will return nonsensical values of above 1 or below 0.
- MLE analysis handles these problems using an iterative optimization routine to maximize a log likelihood function when the dependent variables are limited.
- a Logit or Logistic regression is used for predicting the probability of occurrence of an event by fitting data to a logistic curve. It is a generalized linear model used for binomial regression, and like many forms of regression analysis, it makes use of several predictor variables that may be either numerical or categorical. MLE applied in a binary multivariate logistic analysis is used to model dependent variables to determine the expected probability of success of belonging to a certain group. The estimated coefficients for the Logit model are the logarithmic odds ratios and cannot be interpreted directly as probabilities. A quick computation is first required and the approach is simple.
- the Standard Error measures how accurate the predicted Coefficients are, and the t-Statistics are the ratios of each predicted Coefficient to its Standard Error and are used in the typical regression hypothesis test of the significance of each estimated parameter.
- a Probit model (sometimes also known as a Normit model) is a popular alternative specification for a binary response model, which employs a Probit function estimated using maximum likelihood estimation and called Probit regression.
- the Probit and Logistic regression models tend to produce very similar predictions where the parameter estimates in a logistic regression tend to be 1.6 to 1.8 times higher than they are in a corresponding Probit model.
- the Tobit model (Censored Tobit) is an econometric and biometric modeling method used to describe the relationship between a non-negative dependent variable Y t and one or more independent variables Xi.
- a Tobit model is the dependent variable is censored; that is, the dependent variable is censored because values below zero are not observed.
- the Tobit model assumes that there is a latent unobservable variable Y*. This variable is linearly dependent on the Xi variables via a vector of ⁇ ⁇ coefficients that determine their interrelationships.
- U normally distributed error term
- sigma an ancillary statistic
- Multicollinearity exists when there is a linear relationship between the independent variables in a regression analysis. When this occurs, the regression equation cannot be estimated at all. In near-collinearity situations, the estimated regression equation will be biased and provide inaccurate results. This situation is especially true when a stepwise regression approach is used, where the statistically significant independent variables will be thrown out of the regression mix earlier than expected, resulting in a regression equation that is neither efficient nor accurate.
- Autocorrelation can be defined as the correlation of a dataset to itself in the past. It is the correlation between observations of a time series separated by specified time units. Certain time- series data follow an autocorrelated series as future outcomes rely heavily on past outcomes (e.g., revenues or sales that follow a weekly, monthly, quarterly, or annual seasonal cycle; inflation and interest rates that follow some economic or business cycle, etc.).
- Partial Autocorrelations (PAC) in contrast, are used to measure the degree of association between each data point at a particular time Y t and a time lag Y t -k when the cumulative effects of all other time lags (1 , 2, 3, k-X) have been removed. The term lag defines the offset when comparing a data series with itself.
- the Partial Autocorrelation function is calculated, together with the Q-statistic and relevant p-values. If the p-values are below the tested significance level, then the null hypothesis (H 0 ) of no autocorrelation is rejected and it is concluded that there is autocorrelation that that particular lag.
- Segmentation Clustering takes the original dataset and runs some internal algorithms (a combination or k-means hierarchical clustering and other method of moments in order to find the best-fitting groups or natural statistical clusters) to statistically divide, or segment, the original dataset into multiple groups. This technique is valuable in a variety of settings including marketing (such as market segmentation of customers into various customer relationship management groups), physical sciences, engineering, and others.
- time-series data exhibit seasonality where certain events repeat themselves after some time period or seasonality period (e.g., ski resorts' revenues are higher in winter than in summer, and this predictable cycle will repeat itself every winter).
- Seasonality periods represent how many periods would have to pass before the cycle repeats itself (e.g., 24 hours in a day, 12 months in a year, 4 quarters in a year, 60 minutes in an hour, etc.).
- a seasonal index greater than 1 indicates a high period or peak within the seasonal cycle, and a value below 1 indicates a dip in the cycle.
- Period 1 implies no seasonality in the data. Users can review the report generated for more details on the methodology, application, and resulting charts and seasonality test results. The best seasonality periodicity is listed first (ranked by the lowest RMSE error measure), and all the relevant error measurements are included for comparison: root mean squared error (RMSE), mean squared error (MSE), mean absolute deviation (MAD), and mean absolute percentage error (MAPE).
- RMSE root mean squared error
- MSE mean squared error
- MAD mean absolute deviation
- MAE mean absolute percentage error
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Strategic Management (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Educational Administration (AREA)
- Game Theory and Decision Science (AREA)
- Development Economics (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)
Abstract
The present invention is applicable in the field of corporate finance, corporate capital investments, economics, math, business risk analysis, simulation, decision analysis, qualitative risk analysis, risk management, quantitative risk analysis, and business statistics, and relates to the modeling and valuation of investment decisions under uncertainty and risk within all companies, allowing these firms to properly identify, assess, quantify, value, diversify, and hedge their corporate capital investment decisions and their associated risks. Specifically, the present invention looks at starting from a comprehensive qualitative risk register and moving the analysis into the realms of quantitative risk modeling, simulation, and optimization.
Description
QUALITATIVE AND QUANTITATIVE MODELING OF ENTERPRISE RISK
MANAGEMENT AND RISK REGISTERS
FIELD OF THE INVENTION
[0001] The present invention is in the field of corporate finance, corporate capital investments, economics, math, risk analysis, simulation, decision analysis, and business statistics, and relates to the modeling and valuation of investment decisions under uncertainty and risk within all companies, allowing these firms to properly identify, assess, quantify, value, diversify, and hedge their corporate capital investment decisions and their associated risks. Specifically, the present invention looks at starting from a comprehensive qualitative risk register and moving the analysis into the realms of quantitative risk modeling, simulation, and optimization.
CROSS REFERENCE TO RELATED APPLICATIONS
[0002] The application is a continuation-in-part of U.S. Non-Provisional Utility Patent Application No. 13/719,203, filed December 18, 2012, which is a is a continuation-in-part of U.S. Non-Provisional Utility Patent Application Nos. 12/378,168, 12/378,169, 12/378,170, 12/378,171, 12/378,174, each of which was filed February 11, 2009. The entire disclosure of each of the previously mentioned patents is incorporated herein by reference.
COPYRIGHT AND TRADEMARK NOTICE
[0003] A portion of the disclosure of this patent document contains materials subject to copyright and trademark protection. The copyright and trademark owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure as it appears in the U.S. Patent and Trademark Office patent files or records, but otherwise reserves all copyrights whatsoever.
BACKGROUND OF INVENTION
[0004] In today's competitive global economy, companies are faced with many difficult decisions. These decisions include allocating financial resources, building or expanding facilities, managing inventories, and determining product-mix strategies. Such decisions might
involve thousands or millions of potential alternatives. Considering and evaluating each of them would be impractical or even impossible. A model can provide valuable assistance in incorporating relevant variables when analyzing decisions and in finding the best solutions for making decisions. Models capture the most important features of a problem and present them in a form that is easy to interpret. Additionally, models can often provide insights that intuition alone cannot.
[0005] Currently available methods require the user to understand advanced statistics, financial modeling, and mathematics in order to know what analysis to run on some existing data or to have the ability to interpret the raw numerical results. Furthermore, currently available methods do not automatically run the relevant analyses in an integrated fashion nor do they provide detailed descriptions in their reports coupled with the numerical results and charts for easy interpretation.
[0006] Therefore, there is need in the art for a system and method that can automatically run an intelligent set of statistical and analytical tests and compile those tests into an easily interpreted set of reports and charts. These and other features and advantages of the present invention will be explained and will become obvious to one skilled in the art through the summary of the invention that follows.
SUMMARY OF THE INVENTION
[0007] Accordingly, it is an aspect of the present invention to provide a system and method encapsulated within Project Economics Analysis Tool (PEAT) software that incorporates advanced analytical techniques and algorithms (Monte Carlo risk simulation, stochastic and predictive forecasting, business statistics, business intelligence, decision analysis, optimization, flexibility analysis, and strategic real options techniques, providing a novel way to analyze a user's existing set of input assumptions to extract valuable and important information) and compiles them in a unique and novel way to facilitate business risk analysis through an intelligent set of statistical and analytical tests of a user's existing set of input assumptions to analyze and extract valuable information that otherwise cannot be obtained manually.
[0008] According to an embodiment of the present invention, a computer-implemented system for qualitative and quantitative modeling of risk management comprising: a processor, and a enterprise risk management (ERM) risk register module comprising computer-executable instructions stored in non-volatile memory, wherein the processor and the ERM risk register module are operably connected and configured to: provide a user interface to a user, wherein the user interface is a risk register that allows the user to organize and manage one or more risk elements, receive risk element input from the user, wherein the risk element input is comprised of the one or more risk elements entered by the user, analyze the risk element input, wherein a risk analysis is performed on each of the one or more risk elements, create risk analysis charts, wherein one or more graphs are generated based on the risk analysis of each of the one or more risk elements, and analyze risk level trends of the one or more risk elements, wherein in patterns of change in risk level for the one or more risk elements can be plotted over time, forecast changes in the risk level of the one or more risk elements, wherein the risk level trends are evaluated to provide a predictive analysis of future risk level change of the one or more risk elements, and recommend one or more risk mitigation programs based on the risk level trends and the predictive analysis of future risk level change, wherein each of one or more risk mitigation programs are evaluated for effectiveness.
[0009] According to an embodiment of the present invention, the computer-implemented system is further comprised of a communications means operably connected to the processor and the ERM risk module.
[0010] According to an embodiment of the present invention, the one or more risk elements can be segmented and managed according to one or more of i) by company, ii) by division, iii) by geography, operations, product line, activity, and department, and iv) by risk categories.
[0011] According to an embodiment of the present invention, the user interface is further configured to allow the user to manage and designate authorized users and risk managers.
[0012] According to an embodiment of the present invention, the one or more graphs are selected from the group of graphs comprising bar graphs, heat map matrixes, pareto charts, scenario tables, tornado charts, and pie charts.
[0013] According to an embodiment of the present invention, each of the heat map matrixes is a key risk indicator heat map that is color coded to detail a plurality of risk levels.
[0014] According to an embodiment of the present invention, the key risk indicator heat map is organized by risk classification categories based on the plurality or risk levels.
[0015] According to an embodiment of the present invention, the ERM module and the processor are further configured to send an alert when the risk level of the one or more risk elements exceeds a stipulated risk level limit.
[0016] According to an embodiment of the present invention, the ERM module is a network based module for basic inputs by end users.
[0017] According to an embodiment of the present invention, the ERM module is a local module for administrative use.
[0018] According to an embodiment of the present invention, a computer-implemented method for qualitative and quantitative modeling of risk management, the method comprising the steps of: providing a user interface to a user, wherein the user interface is a risk register that allows the user to organize and manage one or more risk elements, receiving risk element input from the user, wherein the risk element input is comprised of the one or more risk elements entered by the user, analyzing the risk element input, wherein a risk analysis is performed on each of the one or more risk elements, creating risk analysis charts, wherein one or more graphs are generated based on the risk analysis of each of the one or more risk elements, analyzing risk level trends of the one or more risk elements, wherein in patterns of change in risk level for the one or more risk elements can be plotted over time, forecasting changes in the risk level of the one or more risk elements, wherein the risk level trends are evaluated to provide a predictive analysis of future
risk level change of the one or more risk elements, and recommending one or more risk mitigation programs based on the risk level trends and the predictive analysis of future risk level change, wherein each of one or more risk mitigation programs are evaluated for effectiveness.
[0019] According to an embodiment of the present invention, the one or more risk elements can be segmented and managed according to one or more of i) by company, ii) by division, iii) by geography, operations, product line, activity, and department, and iv) by risk categories.
[0020] According to an embodiment of the present invention, the user interface is further configured to allow the user to manage and designate authorized users and risk managers.
[0021] According to an embodiment of the present invention, the one or more graphs are selected from the group of graphs comprising bar graphs, heat map matrixes, pareto charts, scenario tables, tornado charts, and pie charts.
[0022] According to an embodiment of the present invention, each of the heat map matrixes is a key risk indicator heat map that is color coded to detail a plurality of risk levels.
[0023] According to an embodiment of the present invention, the key risk indicator heat map is organized by risk classification categories based on the plurality or risk levels.
[0024] According to an embodiment of the present invention, the computer-implemented method further comprises the step of sending an alert when the risk level of the one or more risk elements exceeds a stipulated risk level limit.
[0025] The foregoing summary of the present invention with the preferred embodiments should not be construed to limit the scope of the invention. It should be understood and obvious to one skilled in the art that the embodiments of the invention thus described may be further modified without departing from the spirit and scope of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
[0026] FIG. 1 illustrates a schematic overview of a computing device.
[0027] FIG. 2 illustrates a network schematic of a system.
[0028] FIG. 3 illustrates the Project Economics Analysis Tool (PEAT) utility's starting screen.
[0029] FIG. 4 illustrates the main PEAT utility.
[0030] FIG. 5 illustrates the Full Screen grid pop-up.
[0031] FIG. 6 illustrates the Cash Flow Ratios calculation.
[0032] FIG. 7 illustrates the Economic Results of each option.
[0033] FIG. 8 illustrates the Information and Details tab.
[0034] FIG. 9 illustrates the Portfolio Analysis of multiple Options.
[0035] FIG. 10 illustrates the Customs Calculation tab.
[0036] FIG. 11 illustrates the Global Settings section.
[0037] FIG. 12 illustrates the Weighted Average Cost of Capital or WACC calculations.
[0038] FIG. 13 illustrates the Beta calculations.
[0039] FIG. 14 illustrates the Input Assumptions for an oil and gas model.
[0040] FIG. 15 illustrates the Portfolio Analysis calculations for the oil and gas module.
[0041] FIG. 16 illustrates the Applied Analytics section for running Tornado Analysis.
[0042] FIG. 17 illustrates the Scenario Analysis input settings.
[0043] FIG. 18 illustrates the Scenario Analysis output tables and results.
[0044] FIG. 19 illustrates the Risk Simulation tab for setting up Monte Carlo risk simulations.
[0045] FIG. 20 illustrates the Risk Simulation results.
[0046] FIG. 21 illustrates the Custom Text properties.
[0047] FIG. 22 illustrates the Overlay Results.
[0048] FIG. 23 illustrates the Analysis of Alternatives.
[0049] FIG. 24 illustrates the Dynamic Sensitivity Analysis computations.
[0050] FIG. 25 illustrates the Options Strategies tab.
[0051] FIG. 26 illustrates the Options Valuation tab's inputs and settings.
[0052] FIG. 27 illustrates the Options Valuation tab's Sensitivity analysis subtab.
[0053] FIG. 28 illustrates the Options Valuation tab's Tornado analysis subtab.
[0054] FIG. 29 illustrates the Options Valuation tab's Scenario analysis subtab.
[0055] FIG. 30 illustrates the Forecast Prediction's Main Dataset and Statistics tabs.
[0056] FIG. 31 illustrates the Forecast Prediction's Visualize and Charts subtabs.
[0057] FIG. 32 illustrates the Forecast Prediction's Command Console.
[0058] FIG. 33 illustrates the Portfolio Optimization's Optimization Settings tab.
[0059] FIG. 34 illustrates the Optimization Results tab.
[0060] FIG. 35 illustrates the Advanced Custom Optimization's Optimization Method routines.
[0061] FIG. 36 illustrates the Advanced Custom Optimization's Decision Variables setup.
[0062] FIG. 37 illustrates the Advanced Custom Optimization's Constraints setup.
[0063] FIG. 38 illustrates the Advanced Custom Optimization's Objective.
[0064] FIG. 39 illustrates the Knowledge Center's Step-by-Step Procedures.
[0065] FIG. 40 illustrates the Knowledge Center's Basic Project Economics Lessons.
[0066] FIG. 41 illustrates the Knowledge Center's Getting Started Videos.
[0067] FIG. 42 illustrates the Report Settings setup.
[0068] FIG. 43 illustrates the Risk Register's levels and categories schema.
[0069] FIG. 44 illustrates the online Web-based login for the online Risk Register Webpage.
[0070] FIG. 45 illustrates the Global Administrator view to Manage Client Companies Webpage.
[0071] FIG. 46 illustrates the Manage Users Webpage.
[0072] FIG. 47 illustrates the Manage Divisions Webpage.
[0073] FIG. 48 illustrates the Manage G.O.P.A.D. Webpage.
[0074] FIG. 49 illustrates the Manage Risk Categories Webpage.
[0075] FIG. 50 illustrates the Manage Risk Mapping and Connections Webpage.
[0076] FIG. 51 illustrates the Manage Risk Contacts Webpage.
[0077] FIG. 52 illustrates the Manage Risk Register Webpage.
[0078] FIG. 53 illustrates the desktop software's Global Settings.
[0079] FIG. 54 illustrates the desktop software's Key Risk Indicator customization and setup.
[0080] FIG. 55 illustrates the desktop software's Risk Groups setup.
[0081] FIG. 56 illustrates the desktop software's Risk Mapping settings.
[0082] FIG. 57 illustrates the desktop software's Risk Register entry and management screen.
[0083] FIG. 58 illustrates the desktop software's Dashboard on Risk Elements.
[0084] FIG. 59 illustrates the desktop software's Dashboard on Risk Mapping (KRI).
[0085] FIG. 60 illustrates the desktop software's Dashboard on Risk Groups.
[0086] FIG. 61 illustrates the desktop software's Dashboard on Risk Exposure.
[0087] FIG. 62 illustrates the desktop software's Dashboard on Risk Taxonomy.
[0088] FIG. 63 illustrates the desktop software's Dashboard on Risk Data results.
[0089] FIG. 64 illustrates the desktop software's Risk Engagement's Pre-Engagement page.
[0090] FIG. 65 illustrates the desktop software's Risk Engagement's Engagement Assessment.
[0091] FIG. 66 illustrates the desktop software's Risk Engagement's Lessons Learned page.
[0092] FIG. 67 illustrates the desktop software's Risk Controls page.
[0093] FIG. 68 illustrates the desktop software's Risk Forecasts page.
[0094] FIG. 69 illustrates the desktop software's Risk Diagrams page.
[0095] FIG. 70 illustrates the desktop software's Risk Mitigation analysis page.
DETAILED DESCRIPTION OF THE INVENTION
[0096] The present invention is applicable in the fields of corporate finance, corporate capital investments, economics, math, risk analysis, simulation, decision analysis, and business statistics, and relates to the modeling and valuation of investment decisions under uncertainty and risk within all companies, allowing these firms to properly identify, assess, quantify, value, diversify, and hedge their corporate capital investment decisions and their associated risks.
[0097] According to an embodiment of the present invention, the computer-implemented system and methods herein described may comprise one or more separate and individually executable applications.
[0098] According to an embodiment of the present invention, the system and method are accomplished through the use of one or more computing devices. As shown in FIG. 1, one of ordinary skill in the art would appreciate that a computing device 001 appropriate for use with embodiments of the present application may generally comprise one or more central processing
units (CPU) 002, random access memory (RAM) 003, and a storage medium (e.g., hard disk drive, solid state drive, flash memory, cloud storage) 004. Examples of computing devices usable with embodiments of the present invention include, but are not limited to, personal computers, smartphones, laptops, mobile computing devices, tablet PCs, and servers. The term "computing device" may also describe two or more computing devices communicatively linked in a manner as to distribute and share one or more resources, such as clustered computing devices and server banks/farms. One of ordinary skill in the art would understand that any number of computing devices could be used, and embodiments of the present invention are contemplated for use with any computing device.
[0099] In an exemplary embodiment according to the present invention, data may be provided to the system, stored by the system, and provided by the system to users of the system across local area networks (LANs, e.g., office networks, home networks) or wide area networks (WANs, e.g., the Internet). In accordance with the previous embodiment, the system may comprise numerous servers communicatively connected across one or more LANs and/or WANs. One of ordinary skill in the art would appreciate that there are numerous manners in which the system could be configured, and embodiments of the present invention are contemplated for use with any configuration.
[0100] In general, the system and methods provided herein may be consumed by a user of a computing device whether connected to a network or not. According to an embodiment of the present invention, some of the applications of the present invention may not be accessible when not connected to a network; however, a user may be able to compose data offline that will be consumed by the system when the user is later connected to a network.
[0101] Referring to FIG. 2, a schematic overview of a system in accordance with an embodiment of the present invention is shown. The system consists of one or more application servers 007 for electronically storing information used by the system. Applications in the application server 007 may retrieve and manipulate information in storage devices and exchange information through a WAN 005 (e.g., the Internet). Applications in a server 007 may also be used to manipulate
information stored remotely and to process and analyze data stored remotely across a WAN 005 (e.g., the Internet).
[0102] According to an exemplary embodiment of the present invention, as shown in FIG. 2, exchange of information through the WAN 005 or other network may occur through one or more high-speed connections. In some cases, high-speed connections may be over-the-air (OTA), passed through networked systems, directly connected to one or more WANs 005, or directed through one or more routers 006. Router(s) 006 are completely optional, and other embodiments in accordance with the present invention may or may not utilize one or more routers 006. One of ordinary skill in the art would appreciate that there are numerous ways a server 007 may connect to a WAN 005 for the exchange of information, and embodiments of the present invention are contemplated for use with any method for connecting to networks for the purpose of exchanging information. Further, while this application refers to high-speed connections, embodiments of the present invention may be utilized with connections of any speed.
[0103] According to an embodiment of the present invention, components of the system may connect to a server 007 via a WAN 005 or other network in numerous ways. For instance, a component may connect to the system (i) through a computing device 008, 009, 010 directly connected to the WAN 005; (ii) through a computing device 007 connected to the WAN 005 through a routing device 006; (iii) through a computing device 012, 013, 014 connected to a wireless access point 011; or (iv) through a computing device 011 via a wireless connection (e.g., CDMA, GMS, 3G, 4G) to the WAN 005. One of ordinary skill in the art would appreciate that there are numerous ways that a component may connect to a server 007 via a WAN 005 or other network, and embodiments of the present invention are contemplated for use with any method for connecting to a server 007 via a WAN 005 or other network. Furthermore, a server 007 could be a personal computing device, such as a smartphone, tablet PC, or laptop or desktop computer, acting as a host for other computing devices to connect to.
[0104] According to an embodiment of the present invention, FIG. 3 illustrates the Project Economics Analysis Tool (PEAT) software utility 015 and 016. In a preferred embodiment, this utility is designed to apply Integrated Risk Management methodologies (Monte Carlo risk
simulation, strategic real options, stochastic and predictive forecasting, business analytics, business statistics, business intelligence, decision analysis, and portfolio optimization) to project and portfolio economics and financial analysis 017. The PEAT utility can house multiple industry-specific or application-specific modules 018 such as oil and gas industry models (industry specific) or discounted cash flow model (application specific). The utility can house multiple additional types of models (industry or application specific) as required. The user can choose the model desired and create a new model from scratch, open a previously saved model, load a predefined example, or exit the utility 019. As mentioned, additional industry-specific, solution-specific, or generic models can be added as new modules to the system. One such new module is the Enterprise Risk Management's Risk Register module to be discussed later in this disclosure.
[0105] In an exemplary embodiment according to the present invention, FIG. 4 illustrates the main PEAT utility 020 where its menu items 021 are fairly straightforward (e.g., File | New or File I Save items where one of ordinary skill in the art would understand that these are common knowledge and common in most desktop software applications). The software is also arranged in a tabular format. There are three tab levels 022, 023, 024 in the software, and a user would proceed from top to bottom and left to right when running analyses in the utility. Referring to FIG. 4, for instance, a user would start with the Discounted Cash Flow (Level 1) tab 022, select Custom Calculations or Option 1 in (Level 2) 023, and begin entering inputs in the 1. Discounted Cash Flow (Level 3) subtab 024. The user would then proceed to the 2. Cash Flow Ratios (Level 3) subtab 024, and then on to the 3. Economic Results (Level 3) subtab 024, and so forth. When the lowest level subtabs are completed, the user would proceed up one level and continue with Option 2 (Level 2), Option 3 (Level 2), Portfolio Analysis (Level 2) 023, and so forth. When these tabs at Level 2 are completed, the user would continue up a level to the Applied Analytics (Level 1) tab 022, and proceed in the same fashion. All Level 1 tabs are identical regardless of the Module (e.g., Discounted Cash Flow [DCF] Model or Oil and Gas [O&G] Model) chosen 018 as illustrated in FIG. 3, except for the first tab (Discounted Cash Flow) 022.
[0106] According to an embodiment of the present invention, FIG. 4's Discounted Cash Flow section is at the heart of the analysis' input assumptions. In a preferred embodiment, a user
would enter his or her input assumptions, such as starting and ending years of the analysis, the discount rate to use, and the marginal tax rate 025, and set up the project economics model (adding or deleting rows in each subcategory of the financial model 026). Additional time-series inputs are entered in the data grid 027 as required, while some elements of this grid are intermediate computed values. The entire grid can be copied and pasted into another software application such as Microsoft Excel, Microsoft Word, or other third-party software applications, or can be viewed in its entirety as a full screen pop-up 028.
[0107] According to an embodiment of the present invention, the user can also identify and create the various Options 023, and compute the economic and financial results such as Net Present Value (NPV), Internal Rate of Return (IRR), Modified Internal Rate of Return (MIRR), Profitability Index (PI), Return on Investment (ROI), Payback Period (PP), and Discounted Payback (DPP). In a preferred embodiment, this section will also auto generate various charts, cash flow ratios, and models 024, intermediate calculations 024, and comparisons of the user's Options within a portfolio view 023 as will be illustrated in the next few figures.
[0108] According to an embodiment of the present invention, when the user is in any of the Options tabs, the Options menu 021 will become available, ready for users to add, delete, duplicate, or rename an option or rearrange the order of the Option tabs by first clicking on any Option 023 tab and then selecting Options 021 and selecting Add, Delete, Duplicate, Rearrange, or Rename Option from the menu. In a preferred embodiment, all of the required functionalities such as input assumptions, adding or reducing the number of rows, selecting discount rate type, or copying the grid are available within each Option tab. The input assumptions entered in these individual Option tabs 023 are localized and used only within each tab, whereas input assumptions entered in the Global Settings (to be discussed later in FIG. 11) tab apply to all Option tabs simultaneously. Typically, the user will need to enter all the required inputs, and if certain cells are irrelevant, users will have to enter zero. Users can also increase or decrease the number of rows for each category as required. The DCF Starting Year input is the discounting base year, where all cash flows will be present valued to this year. The main categories are in boldface, and the input boxes under the categories are for entering in the line item name/label
027. Users can click on Copy Grid 028 to copy the results into the Microsoft Windows clipboard in order to paste into another software application such as Microsoft Excel or Microsoft Word.
[0109] In an exemplary embodiment according to the present invention, FIG. 5 illustrates the Full Screen grid pop-up 029. This is to facilitate the viewing of the model in its entirety without the need to scroll to the left/right or up/down. The grid will be maximized to full view and also facilitates the taking of screenshots.
[0110] In an exemplary embodiment according to the present invention, FIG. 6 illustrates the Cash Flow Ratios calculation 030. In a preferred embodiment, this tab is where additional balance sheet data can be entered 031 (e.g., current asset, shares outstanding, common equity, total debt, etc.) and the relevant financial ratios will be computed 032 (EBIT, Net Income, Net Cash Flow, Operating Cash Flow, Economic Value Added, Return on Invested Capital, Net Profit Margin, etc.). Computed results or intermediate calculations are shown as data grids. Data grid rows are color coded by alternate rows for easy viewing. As usual, Copy Grid 033 can be clicked to copy the computations to the Microsoft Windows clipboard from which the computations can then be pasted into another third-party software application such as Microsoft Excel.
[0111] According to an embodiment of the present invention, users can enter the input assumptions as best they can, or they can guess at some of these figures to get started. In a preferred embodiment, the inputs entered in this Cash Flow Ratios subtab will be used only in this subtab's balance sheet ratios. The results grid shows the time series of cash flow analysis for the Option for multiple years. These are the cash flows used to compute the NPV, IRR, MIRR, and so forth. As usual, users can Copy Grid or View Full Grid 033 of the results.
[0112] In an exemplary embodiment according to the present invention, FIG. 7 illustrates the Economic Results of each option 034. This Economic Results (Level 3) subtab shows the results from the chosen Option and returns the Net Present Value (NPV), Internal Rate of Return (IRR), Modified Internal Rate of Return (MIRR), Profitability Index (PI), Return on Investment (ROI), Payback Period (PP), and Discounted Payback Period (DPP) 039. These computed results are
based on the user's selection of the discounting convention 035, if there is a constant terminal growth rate 036, and the cash flow 037 to use (e.g., net cash flow versus net income or operating cash flow). An NPV Profile table 038 and chart 043 are also provided, where different discount rates and their respective NPV results are shown and charted. Users can change the range of the discount rates to show/compute 040 by entering the "From/To" percent and clicking on Update, copy the results 044, and copy the NPV Profile chart, as well as use any of the chart icons 042 to manipulate the chart's look and feel (e.g., change the chart's line/background color, chart type, or chart view, or add/remove gridlines, show/hide labels, and show/hide legend). Users can also change the variable to display in the chart 041. For instance, users can change the chart from displaying the NPV Profile to the time-series charts of net cash flows, taxable income, operating cash flows, cumulative final cash flows, present value of the final cash flows, and so forth. Users can then click on the Copy Results or Copy Chart buttons 044 to take a screenshot of the modified chart that can then be pasted into another software application such as Microsoft Excel or Microsoft PowerPoint.
[0113] Economic Results are for each individual Option, whereas the Portfolio Analysis tab (FIG. 9) compares the economic results of all Options at once. The Terminal Value Annualized Growth Rate 036 is applied to the last year's cash flow to account for a perpetual constant growth rate cash flow model, and these future cash flows, depending on which cash flow type is chosen 037, are discounted back to the base year and added to the NPV to arrive at the NPV with Terminal Value result 039. Users can change the Show NPV percentages and click Update 040 to change the NPV Profile results grid and chart (assuming the user had previously selected the NPV Profile chart). As usual, there are chart icons users have access to in order to modify the chart (bar chart color, chart type, chart view, background color, rotation, show/hide labels and legends, show/hide gridlines and data labels, etc.). Also available are the Copy Results and Copy Chart functionalities 044. In the Oil and Gas module, there are multiple discount rates, and these rates and their respective NPV results are highlighted in the data grid, as well as the discount rate equivalent to the IRR (i.e., the discount rate where NPV equals zero) 038.
[0114] In an exemplary embodiment according to the present invention, FIG. 8 illustrates the Information and Details 045 tab. Users would apply this tab for entering justifications for the
input assumptions used as well as any notes on each of the Options. For numerical calculations and notes, use the Custom Calculations tab (FIG. 10) instead. Users can also change the labels and Categories 047 of the Information and Details tab by clicking on Categories and editing the default labels. The formatting of entered text can be performed in the Description 046 box by clicking on the various text formatting icons.
[0115] In an exemplary embodiment according to the present invention, FIG. 9 illustrates the Portfolio Analysis 048 of multiple Options. This Portfolio Analysis tab returns the computed economic and financial indicators such as NPV, IRR, MIRR, PI, ROI, PP, and DPP 051 for all the Options combined into a portfolio view (these results can be stand-alone with no base case or computed as incremental 049 values above and beyond the chosen base case 050). The Economic Results (Level 3) subtabs show the individual Option's economic and financial indicators, whereas this Level 2 Portfolio Analysis 048 view shows the results of all Options' indicators and compares them side by side. There are also two charts 052 available for comparing these individual Options' results. The Portfolio Analysis tab is used to obtain a side- by- side comparison of all the main economic and financial indicators of all the Options at once. For instance, users can compare all the NPVs from each Option in a single results grid. The bubble chart on the left provides a visual representation of up to three chosen variables 053 at once (e.g., the y-axis shows the IRR, the x-axis represents the NPV, and the size of the bubble may represent the capital investment; in such a situation, one would prefer a smaller bubble that is in the top right quadrant of the chart). These charts have associated icons 055 that can be used to modify their settings (chart type, color, legend, and so forth). As usual, chart icons, Copy Grid, and Copy Chart 054 are available for use in this tab.
[0116] In an exemplary embodiment according to the present invention, FIG. 10 illustrates the Customs Calculation tab 056 also available for making the user's own custom calculations 057 just as users would in a Microsoft Excel spreadsheet. Clicking on the Function F(x) button 058 will provide users with a list of the supported functions 059 that can be used in this tab. A manual Update Calculations 060 can be clicked to update the worksheet's calculations. Other basic mathematical functions are also supported, such as =, +, -, /, *, A. If users use this optional Custom Calculations tab and wish to link some cells to the input tabs (e.g., Option 1), they can
select the cells in the Custom Calculations tab, right-click, and select Link To. Then they would proceed to the location in the Option tabs and highlight the location of the input cells they wish to link to, right-click, and select Link From. Any subsequent changes users make in the Custom Calculations tab will be updated in the linked input assumption cells.
[0117] As an illustrative example, in the Custom Calculations tab, a user may enter the following: 1, 2, 3, into cells Al, Bl, CI, respectively. Then in cell Dl, enter =A1+B1+C1 and click on any other cell and it will update the cell and return the value 6. Similarly, users type in =SUM(A1 :C1) to obtain the same results. The preset functions can be seen by clicking on the F(x) the button.
[0118] As an illustrative example, in the Custom Calculations tab, a user may enter the following: 1, 2, 3, into cells Al, Bl, CI, respectively. Then, select these three cells, right-click, and select Link To. Proceed to any one of the Option tabs, and in the Discounted Cash Flow or Input Assumptions subtabs, select three cells across (e.g., on the Revenue line item), right-click, and select Link From. The values of cells Al, Bl, CI in the Custom Calculations tab will be linked to this location. Users can go back to the Custom Calculations tab and change the values in the original three cells and they will see the linked cells in the Discounted Cash Flow or Input Assumptions subtabs change and update to reflect the new values.
[0119] In an exemplary embodiment according to the present invention, FIG. 11 illustrates the Global Settings 062 section within the Project Economics module 061, which is only available in the Oil and Gas module and which comprises three subtabs. In preferred embodiment, the Global Assumptions 063 subtab requires users to enter the global inputs that apply across all Options to be analyzed later, including, but not limited to, the various discount rates 064, discounting convention 065, depreciation rates 066, precision decimal settings 067, simulation settings 068, 069, 070, and model notes 071.
[0120] In an exemplary embodiment according to the present invention, FIG. 12 illustrates the Global Settings 072 tab where the Weighted Average Cost of Capital or WACC 073 calculations are housed. In a preferred embodiment, this is an optional set of analytics whereby users can
compute the firm's WACC to use as a discount rate. Users start by selecting either the Simple WACC or Detailed WACC Cost Elements 074. Then, they can either enter the required inputs or click on the Load Example 075 button to load a sample set of inputs that can then be used as a guide to entering their own set of assumptions 076 and additional settings 077.
[0121] In an exemplary embodiment according to the present invention, FIG. 13 illustrates the Beta calculations 079 within the Global Settings 078 tab. This is another optional subtab used for computing the Beta risk coefficient by pasting in historical stock prices or stock returns to compute the Beta 081, and a time-series chart 086 provides a visual for the data entered. The resulting Beta is used in the Capital Asset Pricing Model (CAPM), one of the main inputs into the WACC model. Users start by selecting whether they have historical Stock Prices or Stock Returns 083, then enter the number of Rows (periods) 080 of historical data they have, Paste the data into the relevant columns, and click Compute 084. Users can also click on Load Example 082 to open a sample dataset. The Beta coefficient result 085 will update and users can use this Beta as an input into the WACC model. In the Discounted Cash Flow module, the WACC and BETA calculations are available under the Discount Rate subtab of the main DCF tab.
[0122] In an exemplary embodiment according to the present invention, FIG. 14 illustrates the input assumptions 088 for an oil and gas module. The module can contain multiple Options 087 where each Option is considered to either be a stand-alone capital investment strategy or related to other Options. Project or Option Name 089, starting and ending years for the cash flow model 090, project notes 091, discount rate selection 092, number of line items in each subcategory of capital investments, revenues, and expenses 093 are first entered or selected. The user would then enter the required inputs, such as revenues, expenses, and capital investments 096, not forgetting the special Depreciation % and Escalation % columns. The user will have to scroll to the right to continue entering input assumptions in the out-years. The Discount Rate drop-down list defaults to the Corporate Rate 092 entered in the Global Settings tab, but users can change the rate to use here for this Option. Each Option can have a different discount rate (e.g., if the Options have different risk structures, their respective discount rates should be allowed to differ, with the exception that when all Options are considered at par in terms of risk or a global corporate weighted average cost of capital is used). The user can select the Auto-Fill checkboxes
094 if required. The auto-fill function allows users to enter a single value on a line item and all subsequent years on the same line item will be automatically filled with the same value. As usual, the data grid can be copied or viewed full screen 097.
[0123] In an exemplary embodiment according to the present invention, FIG. 15 illustrates the Portfolio Analysis 098 calculations for the oil and gas module. In a preferred embodiment, this Portfolio Analysis tab returns the computed economic and financial indicators such as NPV, IPvR, MIRR, PI, ROI, PP, and DPP for all the Options 101 combined into a portfolio view (these results can be stand-alone with no base case or computed as incremental 099 values above and beyond the chosen base case 100). The Economic Results (Level 3) subtabs show the individual Option's economic and financial indicators, whereas this Level 2 Portfolio Analysis view shows the results of all Options' indicators and compares them side by side. There are also two charts available for comparing these individual Options' results. The Portfolio Analysis tab is used to obtain a side-by-side comparison of all the main economic and financial indicators of all the Options at once. For instance, users can compare all the NPVs from each Option in a single results grid. The bubble chart on the left 102 provides a visual representation of up to three selected variables 103 at once (e.g., the y-axis shows the IRR, the x-axis represents the NPV, and the size of the bubble may represent the capital investment; in such a situation, one would prefer a smaller bubble that is in the top right quadrant of the chart). As usual, chart icons 104, Copy Grid, and Copy Chart 103 are available for use in this tab.
[0124] In an exemplary embodiment according to the present invention, FIG. 16 illustrates the Applied Analytics 105 section, which allows users to run Tornado Analysis and Scenario Analysis 106 on any one of the Options previously modeled— this analytics tab is on Level 1, which means it covers all of the various Options on Level 2. Users can, therefore, run Tornado or Scenario on any one of the Options. Tornado Analysis 108 is a static sensitivity analysis of the selected model's output to each input assumption, performed one at a time, and ranked from most impactful to the least. Users start the analysis by first choosing the output variable to test from the drop-down list 107.
[0125] According to an embodiment of the present invention, the user can change the default sensitivity settings 109 of each input assumption to test and decide how many input assumption variables to chart 109 (large models with many inputs may generate unsightly and less useful charts, whereas showing just the top variables reveals more information through a more elegant chart). Users can also choose to run the input assumptions as unique inputs, group them as a line item (all individual inputs on a single line item are assumed to be one variable), or run as variable groups (e.g., all line items under Revenue will be assumed to be a single variable) 110. Users will need to remember to click Compute 111 to update the analysis if they make any changes to any of the settings. The sensitivity results are also shown as a table grid 112 at the bottom of the screen (e.g., the initial base value of the chosen output variable, the input assumption changes, and the resulting output variable's sensitivity results). As usual, users can Copy Chart or Copy Grid 111 results into the Microsoft Windows clipboard for pasting into another software application. The following illustrates the Tornado chart characteristics 108:
• Each horizontal bar 108 indicates a unique input assumption that constitutes a precedent to the selected output variable 112.
• The x-axis represents the values of the selected output variable. The wider the bar chart 108, the greater the impact/swing the input assumption has on the output 112.
• A green bar on the right indicates that the input assumption has a positive effect on the selected output (conversely, a red bar indicates a negative effect).
• Each of the precedent or input assumptions that directly affect the NPV with Terminal Value is tested ±10% by default (this setting can be changed); the top 10 variables are shown on the chart by default (this setting can be changed), with a 2 decimal precision setting 109; and each unique input is tested individually.
[0126] In an exemplary embodiment according to the present invention, FIG. 17 illustrates the Scenario Analysis 113, which can be easily performed through a two-step process: identify the model input settings 114 and run the model to obtain scenario output tables 114. In the Scenario Input Settings 114 subtab, users start by selecting the output variable 1 15 they wish to test from the drop-down list. Then, based on the selection, the precedents of the output 116 will be listed under two categories (Line Item, which will change all input assumptions in the entire line item in the model simultaneously, and Single Item, which will change individual input assumption
items). Users select one or two checkboxes 1 16 at a time and the inputs they wish to run scenarios on, and enter the plus/minus percentage to test and the number of steps between these two values to test. Users can also add color coding of sweetspots or hotspots 1 17 in the scenario analysis (values falling within different ranges have unique colors). Users can create multiple scenarios 120 and Save As 1 19 each one (enter a Name and model notes 1 18 for each saved scenario 120).
[0127] In an exemplary embodiment according to the present invention, FIG. 18 illustrates the Scenario Output Tables 122 to run the saved Scenario Analysis 121 models. Users click on the drop-down list 123 to select the previously saved scenarios to Update 123 and run. The selected scenario table complete with sweetspot/hotspot color coding 125 will be generated. Decimals 124 can be increased or decreased as required, and users can Copy Grid or View Full Grid 127 as needed. To facilitate review of the scenario tables, a Note provides the information of which input variable is set as the rows versus columns 126. The following are some notes on using the Scenario Analysis methodology:
• Users can create and run Scenario Analysis on either one or two input variables at once.
• The scenario settings can be saved for retrieval in the future, which means users can modify any input assumptions in the Options models and come back to rerun the saved scenarios.
• Users can also increase/decrease decimals in the scenario results tables, as well as change colors in the tables for easier visual interpretation (especially when trying to identify scenario combinations, or so-called sweetspots and hotspots).
• Additional input variables are available by scrolling down the form.
• Line Items can be changed using ±X% where all inputs in the line are changed multiple times within this specific range all at once. Individual Items can be changed ±7units where each input is changed multiple times within this specific range.
Sweetspots and hotspots refer to specific combinations of two input variables that will drive the output up or down. For instance, suppose investments are below a certain threshold and revenues are above a certain barrier. The NPV will then be in excess of the expected budget (the sweetspots, perhaps highlighted in green). Or if investments
are above a certain value, NPV will turn negative if revenues fall below a certain threshold (the hotspots, perhaps highlighted in red).
[0128] In an exemplary embodiment according to the present invention, FIG. 19 illustrates the Risk Simulation 128 section, where Monte Carlo risk simulations can be set up and run. In a preferred embodiment, users can set up probability distribution assumptions on any combinations of inputs, run a risk simulation tens to hundreds of thousands of trials, and retrieve the simulated forecast outputs as charts, statistics, probabilities, and confidence intervals in order to develop comprehensive risk profiles of the Options. In the Set Input Assumptions 129 subtab, users start the simulation analysis by first setting simulation distributional inputs here (assumptions can be set to individual input assumptions in the model or as an entire line item 131). Users click on and choose one Option 130 at a time to list the available input assumptions. Users then click on the probability distribution icon under the Settings header for the relevant input assumption row 132, select the probability distribution 133 to use, and enter the relevant input parameters 134. Users continue setting as many simulation inputs as required (users can check/uncheck the inputs to simulate) 132. Users then enter the simulation trials to run (it is suggested to start with 1,000 as initial test runs and use 10,000 for the final run as a rule of thumb for most models) 136. Users can also Save As 139 the model (remembering to provide it a Name 138). Then they click on Run Simulation 137. Finally, in this tab, users can set simulation assumptions across multiple Options and Simulate All Options at Once 135, apply a Seed Value to replicate the exact simulation results each time it is run, apply pairwise Correlations 137 between simulation inputs, and Edit or Delete 139 a previously saved simulation model 140.
[0129] According to an embodiment of the present invention, although the software supports up to 50 probability distributions, in general, the most commonly used and applied distributions include Triangular, Normal, and Uniform 133. In a preferred embodiment, if the user has historical data available, he or she can use the Forecast Prediction (FIGS. 30-32) tab to perform a Distributional Fitting to determine the best-fitting distribution to use as well as to estimate the selected distribution's input parameters. Multiple simulation settings can be saved such that they can be retrieved, edited, and modified as required in the future. Users can select either Simulate All Options at Once or Simulate Selected Option Only, depending on whether they wish to run a
risk simulation on all the Options that have predefined simulation assumptions or to run a simulation only on the current Option that is selected.
[0130] In an exemplary embodiment according to the present invention, FIG. 20 illustrates the Risk Simulation Results 141. After the simulation completes its run, the utility will automatically take the user to the Simulation Results tab. In a preferred embodiment, the user first selects the output variable 142 to display using the drop-down list. The simulation forecast chart 143 is shown on the left, while percentiles 144 and simulation statistics 145 are presented on the right. Users can change and update the chart type (e.g., PDF, CDF) 146, enter Percentiles (in %) or Certainty Values (in output units) 147 on the bottom left of the screen (remembering to click Update 146 when done) to show their vertical lines on the chart, or compute/show the Percentiles/Confidence levels 148 on the bottom right of the screen (selecting the type, Two Tail, Left Tail, Right Tail 146, then either entering the percentile values 148 to auto compute the confidence interval or entering the confidence 148 desired to obtain the relevant percentiles). Users can also Save 149 the simulated results and Open them at a later session, Copy Chart or Copy Results 149 to the clipboard for pasting into another software application, Extract Simulation Data to paste into Microsoft Excel for additional analysis, modify the chart using the chart icons, and so forth. The simulation forecast chart is highly flexible in the sense that users can modify its look and feel (e.g., color, chart type, background, gridlines, rotation, chart view, data labels, etc.) using the chart icons. Users can also Extract Simulation Data 149 when the risk simulation run is complete, and the extracted data can be used for additional analysis as required.
[0131] In an exemplary embodiment according to the present invention, FIG. 21 illustrates the Custom Text Properties. To illustrate its functionality, if users entered either a Percentile or Certainty Value at the bottom left of the screen and clicked Update (FIG. 20), they can then click on Custom Text Properties in the chart icon (FIG. 20), select the Vertical Line 151, type in some custom texts 150, click on the Properties 152 button to change the font size/color/type, or use the icons to move the custom text's location. Users can also enter in custom percentile or numerical values 153 to show in the chart. As a side note, this Simulation Results forecast chart shows one output variable at a time, whereas the Overlay Results compares multiple simulated output forecasts at once.
[0132] In an exemplary embodiment according to the present invention, FIG. 22 illustrates the Overlay Results 154. Multiple simulation output variables 155 can be compared at once using the Overlay Results tab. Users simply check/uncheck the simulated outputs 155 they wish to compare and select the chart type to show (e.g., S-Curves, CDF, PDF) 156. Users can also add Percentile or Certainty lines 159 by first selecting the output chart 156, entering the relevant values 158, and clicking the Update 160 button. As usual, the generated charts are highly flexible in that users can modify the charts 157 using the included chart icons (as well as whether to show or hide gridlines 161) and the chart can be copied 161 into the Microsoft Windows clipboard for pasting into another software application. Typically, S-curves of CDF curves 156 are used in overlay analysis when comparing the risk profile of multiple simulated forecast results.
[0133] In an exemplary embodiment according to the present invention, FIG. 23 illustrates the Analysis of Alternatives 162. In a preferred embodiment, the Overlay Results show the simulated results as charts (PDF/CDF), and the Analysis of Alternatives tab shows the results of the simulation statistics in a table format 167 as well as a chart 168 of the statistics such that one Option can be compared against another. The default is to run an Analysis of Alternatives to compare one Option versus another 163, but users can also choose the Incremental Analysis 163 option (remembering to choose the desired economic metric 164 to show, its precision in terms of decimals 166, the Base Case option 165 to compare the results to, and the chart display type 169).
[0134] In an exemplary embodiment according to the present invention, FIG. 24 illustrates the Dynamic Sensitivity Analysis 170 computations. Tornado analysis and Scenario analysis are both static calculations. Dynamic Sensitivity, in contrast, is a dynamic analysis, which can only be performed after a simulation is run. Users start by selecting the desired Option's economic output 171. Red bars on the Rank Correlation 172 chart indicate negative correlations and green bars indicate positive correlations for the left chart. The correlations' absolute values are used to rank the variables with the highest relationship to the lowest, for all simulation input assumptions. The Contribution to Variance computations and chart 173 indicate the percentage fluctuation in the output variable that can be statistically explained by the fluctuations in each of
the input variables. As usual, these charts can be copied and pasted into another software application 174.
[0135] In an exemplary embodiment according to the present invention, FIG. 25 illustrates the Options Strategies 175 tab. In a preferred embodiment, Options Strategies is where users can draw their own custom strategic maps 177 and each map can have multiple strategic real options paths 180. This section allows users to draw and visualize these strategic pathways and does not perform any computations. (The next section, Options Valuation, actually performs the computations.) Users can explore this section's capabilities, but viewing the Video on Options Strategies to quickly get started on using this very powerful tool is recommended. Users can also explore some preset options strategies by clicking on the first icon and selecting any one of the Examples 176.
Below are details on this Options Strategies tab:
• Users can Insert Option nodes or Insert Terminal nodes by first selecting any existing node and then clicking on the option node icon (square) or terminal node icon (triangle) 180.
• Users can modify individual Option Node or Terminal Node properties by double- clicking on a node. Sometimes when users click on a node, all subsequent child nodes are also selected (this allows users to move the entire tree starting from that selected node). If users wish to select only that node, they may have to click on the empty background and click back on that node to select it individually. Also, users can move individual nodes or the entire tree started from the selected node depending on the current setting (right-click, or in the Edit menu, select Move Nodes Individually or Move Nodes Together).
• The following are some quick descriptions of the things that can be customized and configured in the node properties user interface. It is simplest for the user to try different settings for each of the following to see its effects in the Strategy Tree:
• Name. Name shown above the node.
• Value. Value shown below the node.
• Excel Link. Links the value from an Excel spreadsheet's cell.
• Notes. Notes can be inserted above or below a node.
• Show in Model. Show any combinations of Name, Value, and Notes.
• Local Color versus Global Color. Node colors can be changed locally to a node or globally.
• Label Inside Shape. Text can be placed inside the node (users may need to make the node wider to accommodate longer text).
• Branch Event Name. Text can be placed on the branch leading to the node to indicate the event leading to this node.
• Select Real Options. A specific real option type can be assigned to the current node. Assigning real options to nodes allows the tool to generate a list of required input variables.
• Global Elements are all customizable, including elements of the Strategy Tree's Background, Connection Lines, Option Nodes, Terminal Nodes, and Text Boxes. For instance, the following settings can be changed for each of the elements:
• Font settings on Name, Value, Notes, Label, Event names.
• Node Size (minimum and maximum height and width).
• Borders (line styles, width, and color).
• Shadow (colors and whether to apply a shadow or not).
• Global Color.
• Global Shape.
• Example Files are available in the first icon menu to help users get started on building Strategy Trees.
• Protect File from the first icon menu allows the Strategy Tree and the entire PEAT model to be encrypted with up to a 256-bit password encryption. Care must be taken when a file is being encrypted because if the password is lost, the file can no longer be opened.
• Capturing the Screen or printing the existing model can be done through the first icon menu. The captured screen can then be pasted into other software applications.
• Add, Duplicate, Rename, and Delete a Strategy Tree can be performed through right- clicking the Strategy Tree tab or the Edit menu 176, 177.
• Users can also Insert File Link and Insert Comment on any option or terminal node, or Insert Text 179 or Insert Picture anywhere in the background or canvas area 178.
• Users can Change Existing Styles or Manage and Create Custom Styles of their Strategy Tree (this includes size, shape, color schemes, and font size/color specifications of the entire Strategy Tree).
[0136] In an exemplary embodiment according to the present invention, FIG. 26 illustrates the Options Valuation 181 tab and the Strategy View 185. This Options Valuation section performs the calculations of Real Options Valuation models. Users must understand the basic concepts of real options before proceeding. In a preferred embodiment, the user starts by choosing the option execution type 182 (e.g., American, Bermudan, or European), selecting an option to model 183 (e.g., single phased and single asset or multiple phased sequential options), and, based on the option types 184 selected, entering the required inputs 188 and clicking Compute to obtain the results 189. Users can also click on the Load Example 187 to load preset input assumptions based on the selected option type 183 and option model 184. Some basic information and a sample strategic path are shown on the right under Strategy View 186. Also, a Tornado analysis and Scenario analysis 185 can be performed on the option model and users can Save As (as well as Delete or Edit existing saved models) 191 the options models for future retrieval from the list of saved models 190.
[0137] In an exemplary embodiment according to the present invention, FIG. 27 illustrates the Options Valuation tab and its Sensitivity analysis 192 subtab. In a preferred embodiment, this tab runs a static sensitivity table 194 of the real options model based on updated user inputs and settings 193.
[0138] In an exemplary embodiment according to the present invention, FIG. 28 illustrates the Options Valuation tab and its Tornado 195 analysis subtab. In a preferred embodiment, this tab develops the Tornado chart 196 of the real options model. The interpretation of this Tornado chart is identical to those previously described.
[0139] In an exemplary embodiment according to the present invention, FIG.29 illustrates the Options Valuation tab and its Scenario 197 analysis subtab. In a preferred embodiment, this tab
runs a scenario table 200 of the real options model based on updated 199 user settings (input variables to analyze as well as the range and amount to perturb 198).
[0140] In an exemplary embodiment according to the present invention, FIG. 30 illustrates the Forecast Prediction 201 module. This section on Forecast Prediction is a sophisticated Business Analytics and Business Statistics module with over 150 functionalities. In a preferred embodiment, the user starts by entering the data in Step l 's data grid 203 (user can copy and paste from Microsoft Excel or other ODBC-compliant data source, manually type in data 204, or click on the Example 202 button to load a sample dataset complete with previously saved models). The user then chooses the analysis to perform in Step 2 205, 206 and, using the variables list provided 207, enters the desired variables to model 208 given the chosen analysis (if users previously clicked Example, users can double-click to use and run the saved models in Step 4 to see how variables are entered in Step 2, and use that as an example for their analysis). The user then clicks Run 209 in Step 3 when ready to obtain the Results, Charts, and Statistics 211 of the analysis 212 that can be copied 213 and pasted to another software application. Users can alternatively Save or Edit/Delete 215 their models in Step 4 by giving them a name 214 for future retrieval from a list of saved models 216, which can be sorted or rearranged accordingly 217. Users may also explore the power of this Forecast Prediction module by loading the preset Example, or they can watch the Getting Started Videos (FIG. 41) to quickly get started using the module and review the user manual for more details on the 150 analytical methods. The following steps are illustrative of the Forecast Prediction procedures:
• Users start at the Forecast Prediction 201 tab and click on Example 202 to load a sample data and model profile or type in their data or copy/paste from another software application such as Microsoft Excel or Microsoft Word/text file into the data grid 204 in Step 1. Users can add their own notes or variable names in the first Notes row.
• Users then select the relevant model to run in Step 2 and using the example data input settings 207, enter in the relevant variables 208. Users must separate variables for the same parameter using semicolons and use a new line (hit Enter to create a new line) for different parameters.
• Clicking Run 209 will compute the results. Users can view any relevant analytical results, charts, or statistics from the various tabs in Step 3.
• If required, users can provide a model name 214 to save 215 into the profile in Step 4.
Multiple models can be saved in the same profile. Existing models 216 can be edited or deleted and rearranged in order of appearance, and all the changes can be saved.
• The data grid size can be set in the Grid Configure button 202, where the grid can accommodate up to 1,000 variable columns with 1 million rows of data per variable. The pop-up menu also allows users to change the language and decimal settings for their data.
• In getting started, it is always a good idea to load the example 202 file that comes complete with some data and precreated models. Users can double-click on any of these models to run them, and the results are shown in the report area, which sometimes can be a chart or model statistics. Using this example file, users can now see how the input parameters are entered 208 based on the model description, and users can proceed to create their own custom models.
• Users can click on the variable headers to select one or multiple variables at once, and then right-click to add, delete, copy, paste, or visualize the variables selected.
• Users can click on the data grid's column header(s) to select the entire column(s) or variable(s), and, once selected, users can right-click on the header to Auto Fit the column, or to Cut, Copy, Delete, or Paste data. Users can also click on and select multiple column headers to select multiple variables and right-click and select Visualize to chart the data.
• If a cell has a large value that is not completely displayed, the user can click on and hover the mouse over that cell to see a pop-up comment showing the entire value, or simply resize the variable column (drag the column to make it wider, double-click on the column's edge to auto fit the column, or right-click on the column header and select Auto Fit).
• Users can use the up, down, left, and right keys to move around the grid, or use the Home and End keys on the keyboard to move to the far left and far right of a row. Users can also use combination keys such as Ctrl+Home to jump to the top left cell,
Ctrl+End to the bottom right cell, Shift+Up/Down to select a specific area, and so forth.
Users can enter short, simple notes for each variable on the Notes row.
Users can try out the various chart icons on the Visualize 203 tab to change the look and feel of the charts (e.g., rotate, shift, zoom, change colors, add legend, etc.).
The Copy 213 button is used to copy the Results, Charts, and Statistics 211 tabs in
Step 3 after a model is run. If no models are run, then the Copy function will only copy a blank page.
The Report 213 button will only run if there are saved models in Step 4 or if there are data in the grid; otherwise the report generated will be empty. Users will also need Microsoft Excel to be installed to run the data extraction and results reports, and have Microsoft PowerPoint available to run the chart reports.
When in doubt about how to run a specific model or statistical method, the user should start the Example 202 profile and review how the data are set up in Step 1 or how the input parameters are entered in Step 2. Users can use these examples as getting started guides and templates for their own data and models.
Users can click the Example 202 button to load a sample set of previously saved data and models. Then double-click on one of the Saved Models 216 in Step 4. Users can see the saved model that is selected and the input variables 208 used in Step 2. The results will be computed and shown in the Step 3 results 211 area, and users can view the Results, Charts, or Statistics 212 depending on what is available based on the model users chose and ran.
The Grid Configure 202 button allows users to change the number of rows or columns of the data grid in Step 1.
Users must click Report 213 only if they truly mean it! That is, this function will run all of the saved models in Step 4 and extract the results to Microsoft Excel, Word, and PowerPoint.
Users can select a variable in the data grid by clicking on the header(s). For instance, users can click on VAR1 and it will select the entire variable.
Users can edit this XML file directly, save it, and when it opens in the Forecast Prediction module, the changes users made would be available.
[0141] In an exemplary embodiment according to the present invention, FIG. 31 illustrates the Forecast Prediction's Visualize 218 and Charts 219 subtabs. Depending on the model run, sometimes the results will return a chart (e.g., a stochastic process forecast was created and the results are presented both in the Results subtab and the Charts 219 subtab). In a preferred embodiment, the charts subtab has multiple chart icons users can use to change the appearance of the chart (e.g., modify the chart type, chart line colors, chart view, etc.). Also, when a variable is selected, users can click on the Visualize button or right-click and select Visualize 218, and the data will be collapsed into a time-series chart.
[0142] In an exemplary embodiment according to the present invention, FIG. 32 illustrates the Forecast Prediction's Command Console 220. Users can also quickly run multiple models using direct commands in the Command Console. It is recommended that new users set up the models using the user interface, starting from Step 1 through to Step 4. In a preferred embodiment, to start using the console, users create the models they need, then click on the Command subtab, copy/edit/replicate the command syntax (e.g., users can replicate a model multiple times and change some of its input parameters very quickly using the command approach), and, when ready, click on the Run Command button. Alternatively, models can also be entered using a Command console. To see how this works, users can double-click to run a model and go to the Command console. Users can replicate the model or create their own and click Run Command when ready. Each line in the console represents a model and its relevant parameters. The figure also shows a sample set of results in the Statistics 221 subtab.
[0143] In an exemplary embodiment according to the present invention, FIG. 33 illustrates the Portfolio Optimization's 222 Optimization Settings 223 tab. In the Portfolio Optimization section, the individual Options can be modeled as a portfolio and optimized to determine the best combination of projects for the portfolio. In today's competitive global economy, companies are faced with many difficult decisions. These decisions include allocating financial resources, building or expanding facilities, managing inventories, and determining product-mix strategies. Such decisions might involve thousands or millions of potential alternatives. Considering and evaluating each of them would be impractical or even impossible. A model can provide valuable
assistance in incorporating relevant variables when analyzing decisions and in finding the best solutions for making decisions. Models capture the most important features of a problem and present them in a form that is easy to interpret. Models often provide insights that intuition alone cannot. An optimization model has three major elements: decision variables, constraints, and an objective. In short, the optimization methodology finds the best combination or permutation of decision variables (e.g., which products to sell or which projects to execute) in every conceivable way such that the objective is maximized (e.g., revenues and net income) or minimized (e.g., risk and costs) while still satisfying the constraints (e.g., budget and resources).
[0144] According to an embodiment of the present invention, the Options can be modeled as a portfolio and optimized to determine the best combination of projects for the portfolio in the Optimization Settings tab. In a preferred embodiment, users start by selecting the optimization method (Static or Dynamic Optimization) 224. Then the user selects the decision variable type 225 of Discrete Binary (choose which Options to execute with a Go/No-Go Binary 1/0 decision) or Continuous Budget Allocation (returns % of budget to allocate to each Option as long as the total portfolio is 100%); select the Objective 226 (e.g., Max NPV, Min Risk, etc.); set up any Constraints 227 (e.g., budget restrictions, number of projects restrictions, or create customized restrictions); select the Options to optimize/allocate/choose 229 (default selection is all Options); and, when completed, click Run Optimization 228. The software will then take users to the Optimization Results 223 tab.
[0145] In an exemplary embodiment according to the present invention, FIG. 34 illustrates the Optimization Results 230 tab, which returns the results from the portfolio optimization analysis. In a preferred embodiment, the main results are provided in the data grid 233, showing the final Objective Function results, final Optimized Constraints, and the allocation, selection, or optimization across all individual Options within this optimized portfolio. The top left portion of the screen shows the textual details and results 231 of the optimization algorithms applied, and the chart 232 illustrates the final objective function (the chart will only show a single point for regular optimizations, whereas it will return an investment efficient frontier curve if the optional Efficient Frontier settings are set [min, max, step size] in the Optimization Settings tab).
[0146] In an exemplary embodiment according to the present invention, FIG. 35 illustrates the Advanced Custom Optimization 234 tab's Optimization Method 235 routines, where users can create and solve their own optimization models. Knowledge of optimization modeling is required to set up models, but users can click on Load Example 241 and select a sample model to run. Users can use these sample models to learn how the Optimization routines can be set up. Users click Run when done to execute the optimization routines and algorithms. The calculated results and charts will be presented upon completion. When users set up their own optimization model, it is recommended that they go from one tab to another, starting with the Method 235 (Static 236, Dynamic 237, or Stochastic Optimization 239) and based on the selected method, input the simulation seeds 238 or simulation trials 238, 240 or the number of stochastic optimization iterations 240 to perform. The Optimized Results 242 will be shown after the model is Run 241, where the resulting optimized decision variables 243 are presented as a data grid. Perhaps the best way to get started for a new user is to load an existing set of example models 241 to run. The user's own custom model can be checked using the Verify 241 process to determine if the model is set up correctly.
[0147] In an exemplary embodiment according to the present invention, FIG. 36 illustrates the Advanced Custom Optimization's Decision Variables 244 setup, where decision variables are those quantities over which users have control; for example, the amount of a product to make, the number of dollars to allocate among different investments, or which projects to select from among a limited set. As an illustrative example, portfolio optimization analysis includes a go or no-go decision on particular projects. In addition, the dollar or percentage budget allocation across multiple projects also can be structured as decision variables. Users can click Add 245 to add a new Decision Variable. Users can also Change, Delete, or Duplicate 245 an existing decision variable. The Decision Variables can be set as Continuous (with lower and upper bounds), Integers (with lower and upper bounds), Binary (0 or 1), or a Discrete Range 244. The list of available variables is shown in the data grid, complete with their assumptions (rules, types, and starting values) 244. Users can also view the Detailed Analysis 246 of the optimization results 247.
[0148] In an exemplary embodiment according to the present invention, FIG. 37 illustrates the Advanced Custom Optimization's Constraints 248 setup, which describes relationships among decision variables that restrict the values of the decision variables. For example, a constraint might ensure that the total amount of money allocated among various investments cannot exceed a specified amount or, at most, one project from a certain group can be selected; budget constraints; timing restrictions; minimum returns; or risk tolerance levels. Users can click Add to add a new Constraint. Users can also Change or Delete an existing constraint. When adding a new constraint, the list of available Variables will be shown. Users can simply double-click on a desired variable and its variable syntax will be added to the Expression window. For example, double-clicking on a variable named "Returnl" will create a syntax variable "$(Returnl)$" in the window. Users can enter their own constraint equation(s). For example, the following is a constraint 249, 250: $(Assetl)$+$(Asset2)$+$(Asset3)$+$(Asset4)$=l, where the sum of all four decision variables must add up to 1. Users can keep adding as many constraints as needed without any upper limit 249. The optimization results on occasion will also return a chart 251, for example, when an investment efficient frontier (Modern Portfolio Theory) is modeled in the optimization routines. Additional chart functionalities 252 are available in the Chart 251 tab.
[0149] In an exemplary embodiment according to the present invention, FIG. 38 illustrates the Advanced Custom Optimization's Objective 253, which gives a mathematical representation of the model's desired outcome, such as maximizing profit or minimizing cost, in terms of the decision variables. In financial analysis, for example, the objective may be to maximize returns while minimizing risks 254 (maximizing the Sharpe's ratio or returns-to-risk ratio). Users can enter their own customized Objective 255 in the function window. The list of available variables 256 is shown in the Variables window on the right. This list includes predefined decision variables and simulation assumptions. An example of an objective function equation looks something like 255:
($(Α886ί1)$*$(Α8_Κ6ίυπι1)$+$(Α886ί2)$*$(Α8_Κ6ίυπι2)$+$(Α886ί3)$*$(Α8_Κ6ίυπι3)$+$ (Asset4)$ (AS_Retum4)$)/sqrt($(AS_Riskl)$**2*$(Assetl)$!i: !i:2+$(AS_Risk2)$!i: !i:2!i:$(As set2)$* *2+$(AS_Risk3)$* *2*$(Asset3)$* *2+$(AS_Risk4)$* *2*$(Asset4)$* *2)
Users can use some of the most common math operators such as +, -, *, /, **, where the latter is the function for "raised to the power of."
[0150] According to an embodiment of the present invention, the Advanced Custom Optimization's Statistics 253 subtab will be populated only if there are simulation assumptions set up. In a preferred embodiment, the Statistics window will only be populated if users have previously defined simulation assumptions available. If there are simulation assumptions set up, users can run Dynamic Optimization or Stochastic Optimization (FIG. 35); otherwise users are restricted to running only Static Optimizations. In the window, users can click on the statistics individually to obtain a drop-down list. Here users can select the statistic to apply in the optimization process. The default is to return the Mean from the Monte Carlo Risk Simulation and replace the variable with the chosen statistic (in this case the average value), and Optimization will then be executed based on this statistic.
[0151] In an exemplary embodiment according to the present invention, FIG. 39 illustrates the Knowledge Center's 257 Step-by-Step Procedures 258, where users will find quick getting started guides and sample procedures that are straight to the point to assist them in quickly getting up to speed in using the software. In a preferred embodiment, the user clicks on the Previous and Next 259 buttons to navigate from slide to slide or to view the Getting Started Videos. These sessions are meant to provide a quick overview to help users get started with using PEAT and do not substitute for years of experience or the technical knowledge required in the Certified in Risk Management (CRM) programs. The Step-by-Step Procedures 258 section highlights some quick getting started steps in a self-paced learning environment that is incorporated within the PEAT software. There are short descriptions 260 above each slide 261, and key elements of the slide are highlighted in the figures for quick identification.
[0152] In an exemplary embodiment according to the present invention, FIG. 40 illustrates the Knowledge Center's Basic Project Economics Lessons 262, which provides an overview tour 263, 264 of some common concepts involved with cash flow analysis and project economic analysis such as the computations of NPV, IRR, MIRR, PI, ROI, PP, DPP, and so forth.
[0153] In an exemplary embodiment according to the present invention, FIG. 41 illustrates the Knowledge Center's Getting Started Videos 265, where users can watch a short description and
hands-on examples of how to run one of the sections within this PEAT software. In a preferred embodiment, the first quick getting started video is preinstalled with the software while the rest of the videos may be downloaded at first viewing. Before downloading any materials, users should ensure they have a good Internet connection to view the online videos 266. In alternate embodiments, the videos may be entirely preinstalled or entirely downloadable.
[0154] According to an embodiment of the present invention, the Knowledge Center has additional functionalities that users can customize. In a preferred embodiment, the Knowledge Center files (videos, slides, and figures) may be available in the installation path's three subfolders: Lessons, Videos, and Procedures. Users can access the raw files directly or modify/update these files and the updated files will show in the software tool's Knowledge Center the next time the software utility tool is started. Users can utilize the existing files (e.g., file type such as *.BMP or *.WMV as well as pixel size of figures) as a guide to the relevant file specifications they can use when replacing any of these original Knowledge Center files. If users wish to edit the text shown in the Knowledge Center, they can edit the *.XML files in the three subfolders, and the next time the software tool is started, the updated text will be shown. If users wish to have any files updated/edited and be set as the default when they install the software tool, they are free to send the updated files to admin@realoptionsvaluation.com so that an updated build can be created for them. The *.WMV (Microsoft Windows Media Video) file format is preferred as all Microsoft Windows-based computers can run the video without any additional need for Video Codec installations. This file format is small in size and, hence, more portable when implementing it in the PEAT software tool installation build, such that users can still e- mail the installation build without the need for uploading to an FTP site. There are no minimum or maximum size limitations to this file format.
[0155] In an exemplary embodiment according to the present invention, FIG. 42 illustrates the Report Settings capability in the utility. Users can select or deselect 267 the relevant analyses to run, or select all analyses at once 268, and when Run Report 269 is clicked, the selected models will run and their results (data grids, models, charts, and results) are pasted into Microsoft Excel and Microsoft PowerPoint.
[0156] Enterprise Risk Management and Risk Register Module
[0157] According to an embodiment of the present invention, additional analytical modules, solutions, industry-specific vertical models and applications, generic models and applications can be added to the PEAT system (see FIG. 3). FIG. 43 shows one such schema of a new module, specifically that of the Enterprise Risk Management's (ERM) Risk Register module. The following provides a list of the main functionalities and key features of this module:
• Risk Taxonomy. According to an embodiment of the present invention, the ERM Risk Register module allows segmentation of the Corporation, Division, G.O.P.A.D. (Geographic, Operations, Product Line, Activity or Process, Department), Risk Category, and Risk Register levels.
• Risk Indicators. According to an embodiment of the present invention, the ERM Risk Register module allows for the creation of Key Risk Indicator (KRI) Heat Maps with relevant customizable risk-based color codes.
• Risk Matrix. According to an embodiment of the present invention, the ERM Risk Register module allows for the creation of standard 5 x 5 as well as 10 x 10 risk matrixes with different risk levels. In alternate preferred embodiments, additional or unique matrix sizes can also be created in the system.
• Risk Classifications. According to an embodiment of the present invention, the ERM Risk Register module may include risk classification categories. In a preferred embodiment, multiple levels (e.g., 5-level and 10-level) of risk classifications on Risk Likelihood and Risk Impacts can be set up.
• Risk Mapping. According to an embodiment of the present invention, the ERM Risk Register module allows the ability for the user to view risk values from different points of view. In a preferred embodiment, those different points of view are searchable within the Risk Register database for specific segments (e.g., a certain geographic location, division, department, risk category, activity, process, operation, and any combination thereof).
• Risk Register. According to an embodiment of the present invention, the ERM Risk Register module allows for G.O.P.A.D. risk elements to be mapped to various risk groups, mitigation responses, percent completion, and active versus inactive risk status.
In some embodiments, the ERM Risk Register module also allows the option to add Current Dollar Risk Level, Residual Dollar Risk Level, and Mitigation Dollar Cost ranges.
Risk Dashboard. According to an embodiment of the present invention, the ERM Risk Register module allows for the creation of Pareto charts, Scenario tables, Tornado charts, and Risk Profiles by Division and G.O.P.A.D.
Risk Controls. According to an embodiment of the present invention, the ERM Risk Register module allows for the creation of Control Charts and KRI Risk Trends over time. Additionally, statistical process controls can be applied to determine if a certain risk element is in- or out-of-control.
Risk Forecasts. According to an embodiment of the present invention, the ERM Risk Register module allows for the creation of Risk Tracking, Time-Series Risk Forecasts, PDF/CDF Likelihood of Occurrence, and Snapshots per period and over time.
Risk Mitigation. According to an embodiment of the present invention, the ERM Risk Register module allows for the valuation and statistical computation of the effectiveness of risk mitigation programs through various hypothesis testing methods.
Risk Simulation. According to an embodiment of the present invention, the ERM Risk Register module allows for the creation of Risk Simulations of the user's risk register element input assumptions via ranges (e.g., minimum, most likely, maximum, average, standard deviation, location, scale, range, percentiles, and so forth) and returns probabilistic distributions of the individual risk elements or rolled-up risks by categories (output metrics include risk element count, KRI sum, sum and count of risk register elements within a risk category, total risk dollars, total risk mitigation cost, and so forth). Risk Diagrams. According to an embodiment of the present invention, the ERM Risk Register module allows for the creation of Root Cause Analysis, Flow Diagrams, Risk Diagrams, Mind Maps, Bowtie Diagrams, and any other diagram or picture that the user would like to create to better illustrate the risk process, risk mitigation, risk cause and effect, and risk impact of the Risk Register.
Risk Optimization. According to an embodiment of the present invention, the ERM Risk Register module allows for the selection of the best risk mitigation response programs for maximizing statistically significant risk mitigation effects by looking at budgetary,
resource, time, management, physical, geographical, logistics, legal, political, and other constraints.
• Risk Notifications. According to an embodiment of the present invention, the ERM Risk Register module allows for the automatic creation and sending of e-mail alerts based on risk appetite levels and time remaining based on due date to complete any risk mitigation measures.
• Risk Firewall. According to an embodiment of the present invention, the ERM Risk Register module allows for the creation of both a Web module for data entry by regular end users and a Desktop module within PEAT for risk managers to run advanced analytics and modeling. In preferred embodiment, this separation allows for the added risk mitigation of outside malicious hackers and corporate espionage where critical corporate risk elements and details are exposed to unauthorized third parties. In the preferred embodiment, the Web module only allows for data entry and basic reporting, and each end user login is only limited to access his or her data inputs. Since Web portals are more easily hacked, the information retrieved from such malicious individuals will be minimal at best. In addition, the preferred embodiment of the Web module has three levels of login: Global Administrator, Local Administrator, and End Users. On the other hand, the preferred embodiment of the Desktop module is housed on a few individuals' personal computers at the client's company and should be equipped with updated antivirus and anti-intrusion software as well as a corporate firewall. Further, the data can be encrypted as explained previously for an additional added level of security. Hacking into the corporate setting and attacking specific computers out of hundreds or thousands of computers and subsequently obtaining the relevant files and decrypting them would take a tremendous amount of time and resources. Therefore, the Desktop module significantly reduces the risks of intrusion.
• Risk Audit. According to an embodiment of the present invention, the ERM Risk Register module allows for the Risk Monitoring of project management, tasks, completion, assignments, and also provides for Risk Governance; provides a Risk Effectiveness Summary, Risk Audit Trail, and Compliance; and complies with ISO Standards.
One of ordinary skill in the art would appreciate that the ERM Risk Register module could be configured with additional or fewer functionalities, and embodiments of the present invention are contemplated for use with any such functionalities.
[0158] According to an embodiment of the present invention, the Risk Register module has multiple segmentation layers or categories and FIG. 43 illustrates a sample 5 -layered segmentation structure. In the preferred embodiment, the Risk Register 270 level consists of individual risk elements or risk items that end users of the system can enter. As an example, in a multinational bank (ABC Bank) 274, there are a myriad of risks such as bank tellers making mistakes entering a customer's deposit, intentional fraud, insufficiently trained staff, and so forth. These individual risk elements, also known as Risk Register items or elements, and collectively known as the Risk Register 270, can then be linked to one or multiple Risk Categories 271 such as operational risk, human resource risk, or reputational risk, and so forth, and each category maps to one or multiple Geography, Operations, Product Line, Activity or Process, and Department (henceforth known as G.O.P.A.D. or GOPAD). In the preferred embodiment, these G.O.P.A.D. s map to one or multiple Divisions 273 or business units, and all the Divisions ultimately map to the single Corporation 274. Multiple corporation accounts can be created in the system such that the Risk Register process can be replicated either over time or as separate analyses but of the same company. In the preferred embodiment, the end user determines all the categories, names of each element or category, and category type.
[0159] According to an embodiment of the present invention, FIG. 44 shows an illustrative example of the Web-based module's main login page. The Risk Register's main logo or client's logo 275 is displayed to verify that the end user is at the correct Website, whereby the user would then log in 276.
[0160] According to an embodiment of the present invention, FIG. 45 shows an illustrative example of the Global Administrator's (GA) Webpage (bearing the GA's company's logo 277) where the GA can create, add, edit, or manage 279 existing Client Companies 278 that would be listed in the data grid 280.
[0161] According to an embodiment of the present invention, FIG. 46 shows an illustrative example of the GA and Local Administrator's (LA) Webpage to manage Users 281, and, as usual, new users can be added or existing users can be modified and edited or deleted 282. In a preferred embodiment, GA and LA can select the Add Mode to manually add users one at a time or perform a file upload of multiple users at once, and each user will have a User Type (LA or End User), Status (Active or Inactive), First and Last Names, and E-mail ID (new users will be sent an e-mail with their automatically generated login and password credentials). In the preferred embodiment, all users' information will be listed in the data grid 283.
[0162] According to an embodiment of the present invention, FIG. 47 shows an illustrative example of the Manage Divisions 284 Webpage where new divisions can be added or existing ones modified 285, and updates are all listed in the data grid 286.
[0163] According to an embodiment of the present invention, FIG. 48 shows an illustrative example of the Manage Risk G.O.P.A.D. 287 Webpage where the user selects the relevant subcategory (Geography or Location, Operations, Product line, Activity or process, and Department) and enters the information as shown 288, and all GOPADs will be listed in the data grid 289.
[0164] According to an embodiment of the present invention, FIG. 49 shows an illustrative example of the Manage Risk Categories 290 Webpage where new categories can be added or existing categories can be edited and modified as required by updating the relevant information 291, and all risk categories are displayed in the data grid 292.
[0165] According to an embodiment of the present invention, FIG. 50 shows an illustrative example of the Risk Mappings 293 Webpage where previously created Risk Categories can be mapped to one or more G.O.P.A.D. s, which can then be mapped to one or more Divisions 294. These mappings can be set as new connections, or as modifications and deletions of existing connections 295. All finalized connections are listed in the data grid 296.
[0166] According to an embodiment of the present invention, FIG. 51 shows an illustrative example of the Manage Risk Contacts 297 Webpage where new contact individuals responsible for certain risk elements (aptly named Risk Managers), can be added or existing ones modified 298, and their updated information is presented in the data grid 299.
[0167] According to an embodiment of the present invention, FIG. 52 shows an illustrative example of the Manage Risk Register 300 Webpage where the information of a new risk register element is entered or an existing risk register element is updated 301 and the specific Risk Category 302 is assigned, while the creation date and date of the last update are automatically generated 303 by the system. In a preferred embodiment, the end user then enters the Likelihood (L) of occurrence 304; possible financial, economic, or noneconomic Impact (I) 305; and percentage of risk mitigation strategies and plans that are currently completed 306. In the preferred embodiment, these three required inputs will have input validation error checks to make sure data entered are correct and relevant (e.g., 1-5 or 1-10 integers for the L and I, or 0% to 100% for percent completion). The sliders can also be used in lieu of manually entering these inputs. Once a new risk register element is created or updated 307, the data grid 308 shows the relevant information at a glance.
[0168] According to an embodiment of the present invention, FIG. 53 shows an illustrative example of the PEAT desktop software tool with the ERM Risk Register module opened. In a preferred embodiment of the present invention, the main tab of ERM is activated and the default location of Risk Settings | Global Settings 309 is shown first. Users can then change the date format desired 310, choose the range for L & I as required 311, select either the 5- or 3-color schema for risk categories 312, and see the default risk color schemes 313 or customize the colors and risk category names 314. In the preferred embodiment, auto-generated e-mail alerts 315 can also be set here and triggered when certain Key Risk Indicators (KRI) are exceeded 316; e-mails will be sent to the Risk Managers assigned to be in charge of the relevant risk register elements and the same e-mail can be copied to additional recipients 317 as desired. As the system has both a Web-based module and a Desktop module, the data entered and captured by the Web-based module can also be imported directly into the Desktop module 318 at the click of a button. In the preferred embodiment, the system will then retrieve the dataset from the Web-
based module at a specified universal resource locator (URL) Web address and will then parse and upload the data into the relevant locations within this Desktop PEAT environment.
[0169] According to an embodiment of the present invention, FIG. 54 shows the default color coding and default names for various risk levels 319, which can be updated or modified as required by clicking on the colors and choosing an alternate color or changing the label's text and saving/updating 321 the schema, and the updated colors will be shown 320. In a preferred embodiment of the present invention, users can also revert to the system's default color and labels 321. The numerical values in the data grid 320 help the users to quickly visualize the KRI scores (Risk Likelihood score arranged by columns multiplied by the Risk Impact arranged by rows) and how the colors are coded based on these KRI levels.
[0170] According to an embodiment of the present invention, FIG. 55 shows an illustrative example of the management screen of Risk Groups where the user of the system would select the risk level to add or modify (Division, G.O.P.A.D., Risk Category, or Risk Manager) 322, where the new or updated information can be inputted 323 and updated in the system and visible in the data grid 324.
[0171] According to an embodiment of the present invention, FIG. 56 shows an illustrative example of the Risk Mapping where one Risk Category can be mapped to one or more G.O.P.A.D.s, which in turn can be mapped to one or more Divisions 325. In a preferred embodiment of the present invention, these new connections can be added or existing connections can be edited or deleted as required 326, and the finalized connections are updated in the data grid 327.
[0172] According to an embodiment of the present invention, FIG. 57 shows an illustrative example of the Risk Register tab in PEAT where the relevant information applicable to new risk register elements or existing elements can be modified and edited 328 (information such as the risk element's name, a shorter name or acronym, causes of this risk, consequences of this risk, and mitigation response or plan) and assigned to a Risk Category 329. In a preferred embodiment, the risk element's L and I as well as percent mitigation plans completed 330 can be
manually entered or entered using a slider (input validity checks are performed as previously described and short Definitions are also provided on what each L and I number and category represents). Additional optional numerical dollar assumptions and their ranges 331 can be entered, and, finally, the dates created, edited and due are also updated as required 332. In the preferred embodiment, these risk elements can be saved, edited, or deleted 333, and additional functionalities such as viewing the final data grid 335 of all risk elements in the risk register can be viewed full screen, copied into temporary memory for pasting into another software application such as Microsoft Excel, printing of the screen, or generating an Excel report 334 can be applied.
[0173] According to an embodiment of the present invention, FIG. 58 shows an illustrative example of the Risk Dashboard where the user of the system can select which categories 336 to show, the periodicity to show 337, and what point of view to analyze 338. This illustrative example shows the Risk Elements 338 view where each of the risk elements in the risk register is listed in graphical format 339 and color coded according to the user's previous global settings. These risk elements can be listed in in the manner in which they were entered or viewed as a Pareto chart 340 (i.e., the highest KRI items are listed first, all the way to the lowest KRI risk element).
[0174] According to an embodiment of the present invention, FIG. 59 shows an illustrative example of the Risk Map or KRI Heat Map 341 where the data grid or matrix 342 shows the Risk Impact and Risk Likelihood of each risk category and shows the count of the number of risk elements in the selected risk category. As an example, the number 5 in the top left quadrant of the matrix shows that there are 5 risk elements that have a Risk Likelihood score of 1 (first column, starting from the bottom left corner) and a Risk Impact of 5 (row number 5, starting from the bottom left corner). In addition, this cell has a KRI score of 1 x 5 or 5, which will have a specific color code depending on the user's global settings. The number 21 at the right most corner of the matrix is the sum of the entire row, indicative of 21 risk elements that have a Risk Impact score of 5. Similarly, the number 20 at the bottom left shows the sum of the entire column, indicating there are 20 risk elements that fall into the Risk Likelihood score of 1. In the preferred embodiment, all other numerical values are computed in a similar fashion.
[0175] According to an embodiment of the present invention, FIG. 60 shows an illustrative example where the Risk Groups 343 where bar charts 344 show the number (count) or sum of all KRIs 345 that fall under each risk category (e.g., 1-5 or high, medium, low risks) as vertical bars in the chart, grouped by the user-selected risk categories.
[0176] According to an embodiment of the present invention, FIG. 61 shows an illustrative example where the Risk Exposure 346 of the selected risk category, the corporation as a whole, and the percentage of the risk category to the corporation as risk dials and pie charts 347.
[0177] According to an embodiment of the present invention, FIG. 62 shows another view of the risk categories via a Risk Taxonomy 348 relational chart 349 both from a top-down versus bottom-up approach 350. In a preferred embodiment, the top-down approach shows the risk segmentation levels starting from the Corporation and the Division splits, down onto the G.O.P.A.D. links and connections, through the Risk Category, and finally to each of the Risk Elements. Users of the system can zoom in, collapse, or expand any of the nodes for a better view. In the preferred embodiment, the bottom-up approach 350 requires the user to select a specific Risk Register element to see how this risk element can permeate throughout the entire organization via the risk categories, and how these categories affect the relevant G.O.P.AD.s, up to the Division and Corporation levels.
[0178] According to an embodiment of the present invention, FIG. 63 shows an illustrative example of the Risk Data 351 where all the relevant data from the Risk Register grid is listed again in a slightly different view 352, and the data shows the results based on the user-selected categories.
[0179] According to an embodiment of the present invention, FIG. 64 shows an illustrative example of the Risk Engagement 353 portion of the system where Pre -Engagement 354 (e.g., risk evaluations during pre-bids or pre-execution of a project) risks can be listed. In a preferred embodiment, the project's name and identification number 355 can be entered, the data grid's information can be printed or copied, and additional rows and the last edit date 356 can be shown
in the grid 357. In the preferred embodiment, the grid's column headers can be modified 355 by the system's user as required.
[0180] According to an embodiment of the present invention, FIG. 65 shows an illustrative example where the Engagement Assessment 358 (e.g., risk evaluations during the execution phase of a project or risk evaluation of what risks may exist in the future when the project is executed) risks can be listed and entered by the user into the grid 359.
[0181] According to an embodiment of the present invention, FIG. 66 shows an illustrative example of the Lessons Learned 360 from the engagement of the project, and, as usual, risks can be listed and entered by the user into the grid 361.
[0182] According to an embodiment of the present invention, FIG. 67 shows an illustrative example of the Risk Controls 362 segment of the current system. In a preferred embodiment, the risk elements can be viewed and analyzed according to each individual Risk Register element or selected by G.O.P.A.D. 363 and the date range 364 can also be specified. In the preferred embodiment, users of the system can select one or multiple risk elements 365 or G.O.P.A.D.s 366 and update the analysis and chart, copy 367 the chart 368 generated, or modify the chart's look and feel using the chart's settings icon toolbar 369.
[0183] According to an embodiment of the present invention, FIG. 68 shows an illustrative example of the Risk Forecasts 370 segment where the same settings such as selecting the required risk registers or G.O.P.A.D.s and date range, and selecting the required forecast method and entering the relevant forecast parameters 371 as discussed previously. The analysis is then run 372 and results can be seen as predictive statistics, forecast charts, or forecast data 373 374.
[0184] According to an embodiment of the present invention, FIG. 69 shows an illustrative example of the Risk Diagrams 375 where users of the system can change the type of risk diagram to draw or access various standard and freehand drawing tools in the icon ribbon 376 and add multiple risk diagram subtabs 377 and in each subtab, one or multiple risk diagrams can be drawn in the canvas area 378 where different predefined standard shapes and freehand
drawings, text, color, and pictures can be added in the drawing canvas as required. Each of the drawing elements properties can be changed as required (e.g., size, color, font, background, pictures, etc.)
[0185] According to an embodiment of the present invention, FIG. 70 shows an illustrative example of the Risk Mitigation 379 segment of the current system, where users can manually enter or copy and paste existing data into the grid 380, select the analysis 381 to run 382, review the statistical results 383 or copy 384 the results for pasting into another software application, save the existing model by providing it a name and adding some optional notes 385, or rerun a previously saved model 386 as well as edit or delete an existing saved model 387.
[0186] Appendix: Risk Simulation Mathematics
[0187] According to an embodiment of the present invention, this appendix demonstrates the mathematical models and computations used in creating the Monte Carlo simulations. In order to get started with simulation, one first needs to understand the concept of probability distributions. To begin to understand probability, consider this illustrative example: Users want to look at the distribution of nonexempt wages within one department of a large company. First, users gather raw data— in this case, the wages of each nonexempt employee in the department. Second, users organize the data into a meaningful format and plot the data as a frequency distribution on a chart. To create a frequency distribution, users divide the wages into group intervals and list these intervals on the chart's horizontal axis. Then users list the number or frequency of employees in each interval on the chart's vertical axis. Now users can easily see the distribution of nonexempt wages within the department. Users can chart this data as a probability distribution. A probability distribution shows the number of employees in each interval as a fraction of the total number of employees. To create a probability distribution, users divide the number of employees in each interval by the total number of employees and list the results on the chart's vertical axis.
[0188] Probability distributions are either discrete or continuous. Discrete probability distributions describe distinct values, usually integers, with no intermediate values and are shown
as a series of vertical bars. A discrete distribution, for example, might describe the number of heads in four flips of a coin as 0, 1, 2, 3, or 4. Continuous probability distributions are actually mathematical abstractions because they assume the existence of every possible intermediate value between two numbers; that is, a continuous distribution assumes there are an infinite number of values between any two points in the distribution. However, in many situations, users can effectively use a continuous distribution to approximate a discrete distribution even though the continuous model does not necessarily describe the situation exactly.
[0189] Probability Density Functions, Cumulative Distribution Functions, and Probability Mass Functions
[0190] In mathematics and Monte Carlo simulation, a probability density function (PDF) represents a continuous probability distribution in terms of integrals. If a probability distribution has a density off(x), then intuitively the infinitesimal interval of [x, x + dx] has a probability of f(x) dx. The PDF therefore can be seen as a smoothed version of a probability histogram; that is, by providing an empirically large sample of a continuous random variable repeatedly, the histogram using very narrow ranges will resemble the random variable's PDF. The probability of the interval between [a, b] is given by jf(x)dx , which means that the total integral of the function/ must be 1.0. It is a common mistake to think off(a) as the probability of a. This is incorrect. In fact, f(a) can sometimes be larger than 1— consider a uniform distribution between 0.0 and 0.5. The random variable x within this distribution will have f(x) greater than 1. The probability in reality is the function f(x)dx discussed previously, where dx is an infinitesimal amount.
[0191] The cumulative distribution function (CDF) is denoted as F(x) = P(X < x), indicating the probability of X taking on a less than or equal value to x. Every CDF is monotonically increasing, is continuous from the right, and, at the limits, has the following properties: lim F(x) = 0 and Km F(x) = 1 · Further, the CDF is related to the PDF by
F(fy - p(a) = p(a < x < b) = J f(x)dx■> where the PDF function / is the derivative of the CDF function F.
[0192] In probability theory, a probability mass function (PMF) gives the probability that a discrete random variable is exactly equal to some value. The PMF differs from the PDF in that the values of the latter, defined only for continuous random variables, are not probabilities; rather, its integral over a set of possible values of the random variable is a probability. A random variable is discrete if its probability distribution is discrete and can be characterized by a PMF.
Therefore, is a discrete random variable if ^ ρ(χ = u) = \ as w runs through all possible values of the random variable X. [0193] Discrete Distributions
[0194] Following is a detailed listing of the different types of probability distributions that can be used in Monte Carlo simulation.
[0195] Bernoulli or Yes/No Distribution
[0196] The Bernoulli distribution is a discrete distribution with two outcomes (e.g., head or tails, success or failure, 0 or 1). The Bernoulli distribution is the binomial distribution with one trial and can be used to simulate Yes/No or Success/Failure conditions. This distribution is the fundamental building block of other more complex distributions. For instance:
• Binomial distribution: Bernoulli distribution with higher number of n total trials and computes the probability of x successes within this total number of trials.
• Geometric distribution: Bernoulli distribution with higher number of trials and computes the number of failures required before the first success occurs.
• Negative binomial distribution: Bernoulli distribution with higher number of trials and computes the number of failures before the xth success occurs.
The mathematical constructs for the Bernoulli distribution are as follows:
1 - p for x = 0
P(x)
p for x = 1
or
J>(x) = />*(! - />)
mean = />
standard deviation
l - 2p
skewness l
6p2 - 6p + \
excess kurtosis = P^
[0197] The probability of success (p) is the only distributional parameter. Also, it is important to note that there is only one trial in the Bernoulli distribution, and the resulting simulated value is either 0 or 1. The input requirements are such that:
Probability of Success > 0 and < 1 (i.e., 0.0001 <p < 0.9999).
[0198] Binomial Distribution
[0199] The binomial distribution describes the number of times a particular event occurs in a fixed number of trials, such as the number of heads in 10 flips of a coin or the number of defective items out of 50 items chosen.
The three conditions underlying the binomial distribution are:
• For each trial, only two outcomes are possible that are mutually exclusive.
• The trials are independent— what happens in the first trial does not affect the next trial.
• The probability of an event occurring remains the same from trial to trial.
mean = np
standard deviation = ^np{\ - p)
l - 2p
skewness = ^nP^ ~P~)
(,ρ2 - (,p + l
excess kurtosis = nPQ- ~ P)
[0200] The probability of success (p) and the integer number of total trials (n) are the distributional parameters. The number of successful trials is denoted x. It is important to note that probability of success (p) of 0 or 1 are trivial conditions and do not require any simulations, and, hence, are not allowed in the software. The input requirements are such that Probability of Success > 0 and < 1 (i.e., 0.0001 < p < 0.9999) , the Number of Trials > 1 or positive integers and < 1 ,000 (for larger trials, use the normal distribution with the relevant computed binomial mean and standard deviation as the normal distribution's parameters).
[0201] Discrete Uniform
[0202] The discrete uniform distribution is also known as the equally likely outcomes distribution, where the distribution has a set of N elements, and each element has the same probability. This distribution is related to the uniform distribution but its elements are discrete and not continuous. The mathematical constructs for the discrete uniform distribution are as follows:
P(x) =—
N
N + l
standard deviation = » 12 ranked value
skewness = 0 (i.e., the distribution is perfectly symmetrical)
- 6(N2 + 1)
excess kurtosis = ~ + ^ ranked value
[0203] The input requirements are such that Minimum < Maximum and both must be integers (negative integers and zero are allowed).
[0204] Geometric Distribution
[0205] The geometric distribution describes the number of trials until the first successful occurrence, such as the number of times one would need to spin a roulette wheel before winning.
The three conditions underlying the geometric distribution are:
• The number of trials is not fixed.
• The trials continue until the first success.
• The probability of success is the same from trial to trial.
The mathematical constructs for the geometric distribution are as follows:
P(x) = p(i - ργ-1 for 0 < p < 1 and x = 1, 2, n mean = 1
P
_ \ - p_
standard deviation =
P2
_2
skewness : excess kurtosis
[0206] The probability of success (p) is the only distributional parameter. The number of successful trials simulated is denoted x, which can only take on positive integers. The input requirements are such that Probability of success > 0 and < 1 (i.e., 0.0001 < p < 0.9999). It is important to note that probability of success (p) of 0 or 1 are trivial conditions and do not require any simulations, and, hence, are not allowed in the software.
[0207] Hypergeometric Distribution
[0208] The hypergeometric distribution is similar to the binomial distribution in that both describe the number of times a particular event occurs in a fixed number of trials. The difference
is that binomial distribution trials are independent, whereas hypergeometric distribution trials change the probability for each subsequent trial and are called trials without replacement. As an illustrative example, suppose a box of manufactured parts is known to contain some defective parts. Users choose a part from the box, find it is defective, and remove the part from the box. If users choose another part from the box, the probability that it is defective is somewhat lower than for the first part because users have removed a defective part. If users had replaced the defective part, the probabilities would have remained the same, and the process would have satisfied the conditions for a binomial distribution.
The three conditions underlying the hypergeometric distribution are as follows:
• The total number of items or elements (the population size) is a fixed number, a finite population. The population size must be less than or equal to 1 ,750.
• The sample size (the number of trials) represents a portion of the population.
• The known initial probability of success in the population changes after each trial. The mathematical constructs for the hypergeometric distribution are as follows:
n\(N - n)\
Max(n - (N - Nx ),0), Min(n, Nx )
Nxn
mean = N
V(N, Nx , n)
kurtosis = Nxn(-3 + N)(-2 + N)(-N + n) where
V(N, Nx, n) = (N - NXY - (N - Nx)5 + 3(N - NX)2NX - 6(N - NX†NX
+ (N - NX)4NX + 3(N - Nx) NX 2 - 12(N - NX)2NX 2 + S(N - Νχ Νχ 2 + Nx'
- 6(N - Nx) Nl + S(N - Nx)2N + (N - NX) Nx - Nx - 6(N - NX†NX
+ 6(N - N Χ)Λ Nx + 1 S(N - N x f Nxii - 6(N - N x f Nxii + 1 S(N - N x) Nx 2ii
- 24(N - Nx†Nx 2n - 6(N - Nxf n - 6(N - Nx) N n + 6Nxn + 6(N - Nxf n2
- 6(N - Nxf n2 - 2A(N - NX) Nxti2 + \2(N - Nxf Nxti2 + 6Nx 2ti2
[0209] The number of items in the population (TV), trials sampled (n), and number of items in the population that have the successful trait (Nx) are the distributional parameters. The number of successful trials is denoted x. The input requirements are such that Population > 2 and integer, Trials > 0 and integer, Successes > 0 and integer, Population > Successes Trials < Population and Population < 1750.
[0210] Negative Binomial Distribution
[021 1] The negative binomial distribution is useful for modeling the distribution of the number of trials until the rth successful occurrence, such as the number of sales calls that need to be made to close a total of 10 orders. It is essentially a superdistribution of the geometric distribution. This distribution shows the probabilities of each number of trials in excess of r to produce the required success r.
The three conditions underlying the negative binomial distribution are as follows:
• The number of trials is not fixed.
• The trials continue until the rth success.
• The probability of success is the same from trial to trial.
The mathematical constructs for the negative binomial distribution are as follows:
(x + r - 1)!
P(x) = - 77Γ-ΓΡ (l ~ P)
(r - l)!x!
for x = r, r + 1, ...; and O < p < 1
r(\ - p)
mean = — standard deviation = 2
P
2 - p
skewness
p2 - 6p + 6
excess kurtosis = rr{"l - pP)>
[0212] Probability of success (p) and required successes (r) are the distributional parameters. Where the input requirements are such that Successes required must be positive integers > 0 and < 8000, and Probability of success > 0 and < 1 (i.e., 0.0001 < p < 0.9999). It is important to note that probability of success (p) of 0 or 1 are trivial conditions and do not require any simulations, and, hence, are not allowed in the software.
[0213] Poisson Distribution
[0214] The Poisson distribution describes the number of times an event occurs in a given interval, such as the number of telephone calls per minute or the number of errors per page in a document.
The three conditions underlying the Poisson distribution are as follows:
• The number of possible occurrences in any interval is unlimited.
• The occurrences are independent. The number of occurrences in one interval does not affect the number of occurrences in other intervals.
• The average number of occurrences must remain the same from interval to interval. The mathematical constructs for the Poisson are as follows:
e A
P(x) for x and λ > 0
xl
mean = λ
standard deviation skewness = ^
1
excess kurtosis = ^
[0215] Rate (λ) is the only distributional parameter, and the input requirements are such that Rate > 0 and < 1,000 (i.e., 0.0001 < rate < 1,000).
[0216] Continuous Distributions
[0217] Beta Distribution
[0218] The beta distribution is very flexible and is commonly used to represent variability over a fixed range. One of the more important applications of the beta distribution is its use as a conjugate distribution for the parameter of a Bernoulli distribution. In this application, the beta distribution is used to represent the uncertainty in the probability of occurrence of an event. It is also used to describe empirical data and predict the random behavior of percentages and fractions, as the range of outcomes is typically between 0 and 1. The value of the beta distribution lies in the wide variety of shapes it can assume when users vary the two parameters, alpha and beta. If the parameters are equal, the distribution is symmetrical. If either parameter is 1 and the other parameter is greater than 1 , the distribution is J shaped. If alpha is less than beta, the distribution is said to be positively skewed (most of the values are near the minimum value). If alpha is greater than beta, the distribution is negatively skewed (most of the values are near the maximum value). The mathematical constructs for the beta distribution are as follows:
,(/?-!)
= (*Γ"(ι -*) for a > 0; β > 0; x > 0
r(g)rpg)
T(a + β)
a
mean =
a + β standard de
3(g + β + \)[αβ(α + β - 6) + 2(α + β)2 ]
3
excess kurtosis αβ(α + β + 2)(α + β + 3)
[0219] Alpha (a) and beta (β) are the two distributional shape parameters, and Γ is the gamma function. The two conditions underlying the beta distribution are as follows:
• The uncertain variable is a random value between 0 and a positive value.
• The shape of the distribution can be specified using two positive values.
Input requirements:
Alpha and beta > 0 and can be any positive value.
[0220] Cauchy Distribution or Lorentzian Distribution or Breit-Wigner Distribution
[0221] The Cauchy distribution, also called the Lorentzian distribution or Breit-Wigner distribution, is a continuous distribution describing resonance behavior. It also describes the distribution of horizontal distances at which a line segment tilted at a random angle cuts the x- axis.
The mathematical constructs for the Cauchy or Lorentzian distribution are as follows: π (x - m) + γ / 4
[0222] The Cauchy distribution is a special case where it does not have any theoretical moments (mean, standard deviation, skewness, and kurtosis) as they are all undefined. Mode location (m) and scale (γ) are the only two parameters in this distribution. The location parameter specifies the peak or mode of the distribution while the scale parameter specifies the half-width at half- maximum of the distribution. In addition, the mean and variance of a Cauchy or Lorentzian distribution are undefined. In addition, the Cauchy distribution is the Student's t distribution with only 1 degree of freedom. This distribution is also constructed by taking the ratio of two standard normal distributions (normal distributions with a mean of zero and a variance of one) that are independent of one another. The input requirements are such that Location can be any value, whereas Scale > 0 and can be any positive value.
[0223] Chi-Square Distribution
[0224] The chi-square distribution is a probability distribution used predominantly in hypothesis testing and is related to the gamma distribution and the standard normal distribution. For instance, the sums of independent normal distributions are distributed as a chi-square (χ2) with k degrees of freedom:
z2 +z2 2 +... + z2 -zk 2
12
excess kurtosis = k
Γ is the gamma function. Degrees of freedom k is the only distributional parameter.
The chi-square distribution can also be modeled using a gamma distribution by setting the k_
shape parameter = 2 and scale = 2S2 where S is the scale. The input requirements are such that Degrees of freedom > 1 and must be an integer < 1,000.
[0225] Exponential Distribution
[0226] The exponential distribution is widely used to describe events recurring at random points in time, such as the time between failures of electronic equipment or the time between arrivals at a service booth. It is related to the Poisson distribution, which describes the number of occurrences of an event in a given interval of time. An important characteristic of the exponential distribution is the "memoryless" property, which means that the future lifetime of a given object has the same distribution, regardless of the time it existed. In other words, time has no effect on future outcomes. The mathematical constructs for the exponential distribution are as follows: f(x) = Ae-*" for x≥0; A > 0
mean = λ standard deviation = λ
skewness = 2 (this value applies to all success rate λ inputs)
excess kurtosis = 6 (this value applies to all success rate λ inputs)
Success rate (λ) is the only distributional parameter. The number of successful trials is x.
The condition underlying the exponential distribution is
• The exponential distribution describes the amount of time between occurrences. Input requirements: Rate > 0 and < 300.
[0227] Extreme Value Distribution or Gumbel Distribution
[0228] The extreme value distribution (Type 1) is commonly used to describe the largest value of a response over a period of time, for example, in flood flows, rainfall, and earthquakes. Other applications include the breaking strengths of materials, construction design, and aircraft loads and tolerances. The extreme value distribution is also known as the Gumbel distribution.
mean = m + 0.577215/? standard de skewness 1.13955 (this applies for all values of mode and scale)
excess kurtosis = 5.4 (this applies for all values of mode and scale)
[0229] Mode (m) and scale (β) are the distributional parameters. There are two standard parameters for the extreme value distribution: mode and scale. The mode parameter is the most likely value for the variable (the highest point on the probability distribution). The scale
parameter is a number greater than 0. The larger the scale parameter, the greater the variance. The input requirements are such that Mode can be any value and Scale > 0.
[0230] F Distribution or Fisher-Snedecor Distribution
[0231] The F distribution, also known as the Fisher-Snedecor distribution, is another continuous distribution used most frequently for hypothesis testing. Specifically, it is used to test the statistical difference between two variances in analysis of variance tests and likelihood ratio tests. The F distribution with the numerator degree of freedom n and denominator degree of freedom m is related to the chi-square distribution in that:
m
mean - 2
2m2 (m + n— 2)
standard deviation = n(m 2 (m 4 for all m > 4
2(m + 2« - 2) I 2(m - 4)
skewness = m n(m + n - 2)
excess kurtosis
12(-16 + 20m - 8»i2 + m3 + 44n - 32mn + 5m2n - 22η1 + 5mn2
n(m - 6){m - 8)(« + m - 2)
[0232] The numerator degree of freedom n and denominator degree of freedom m are the only distributional parameters. The input requirements are such that degrees of freedom numerator and degrees of freedom denominator are both > 0 integers.
[0233] Gamma Distribution (Erlang Distribution)
[0234] The gamma distribution applies to a wide range of physical quantities and is related to other distributions: lognormal, exponential, Pascal, Erlang, Poisson, and chi-square. It is used in meteorological processes to represent pollutant concentrations and precipitation quantities. The gamma distribution is also used to measure the time between the occurrences of events when the event process is not completely random. Other applications of the gamma distribution include inventory control, economic theory, and insurance risk theory.
[0235] The gamma distribution is most often used as the distribution of the amount of time until the rth occurrence of an event in a Poisson process. When used in this fashion, the three conditions underlying the gamma distribution are as follows:
• The number of possible occurrences in any unit of measurement is not limited to a fixed number.
• The occurrences are independent. The number of occurrences in one unit of measurement does not affect the number of occurrences in other units.
• The average number of occurrences must remain the same from unit to unit.
The mathematical constructs for the gamma distribution are as follows:
ί r Y'1 -- - β β
f (x) = -— with any value of a > 0 and β > 0
Τ(α)β
mean = αβ standard deviation =
2
skewness = "^
_6_
excess kurtosis = a
[0236] Shape parameter alpha (a) and scale parameter beta (β) are the distributional parameters, and Γ is the gamma function. When the alpha parameter is a positive integer, the gamma distribution is called the Erlang distribution, used to predict waiting times in queuing systems, where the Erlang distribution is the sum of independent and identically distributed random
variables each having a memoryless exponential distribution. With Setting n as the number of these random variables, the mathematical construct of the Erlang distribution is:
n-\ -x
X Q
f (x) = for all x > 0 and all positive integers of n, where the input requirements are
{n - \)\
such that Scale Beta > 0 and can be any positive value, Shape Alpha > 0.05 and can be any positive value, and Location can be any value.
[0237] Logistic Distribution
[0238] The logistic distribution is commonly used to describe growth, that is, the size of a population expressed as a function of a time variable. It also can be used to describe chemical reactions and the course of growth for a population or individual.
The mathematical constructs for the logistic distribution are as follows:
mean = μ
! l
standard deviation = , /— π 2 a 2
V 3
skewness = 0 (this applies to all mean and scale inputs)
excess kurtosis = 1.2 (this applies to all mean and scale inputs)
[0239] Mean (μ) and scale ( ) are the distributional parameters. There are two standard parameters for the logistic distribution: mean and scale. The mean parameter is the average value, which for this distribution is the same as the mode because this distribution is symmetrical. The scale parameter is a number greater than 0. The larger the scale parameter, the greater the variance.
Input requirements:
Scale > 0 and can be any positive value.
Mean can be any value.
[0240] Lognormal Distribution
[0241] The lognormal distribution is widely used in situations where values are positively skewed, for example, in financial analysis for security valuation or in real estate for property valuation, and where values cannot fall below zero. Stock prices are usually positively skewed rather than normally (symmetrically) distributed. Stock prices exhibit this trend because they cannot fall below the lower limit of zero but might increase to any price without limit. Similarly, real estate prices illustrate positive skewness and are lognormally distributed as property values cannot become negative.
The three conditions underlying the lognormal distribution are as follows:
• The uncertain variable can increase without limits but cannot fall below zero.
• The uncertain variable is positively skewed, with most of the values near the lower limit.
• The natural logarithm of the uncertain variable yields a normal distribution.
[0242] Generally, if the coefficient of variability is greater than 30%, use a lognormal distribution. Otherwise, use the normal distribution.
The mathematical constructs for the lognormal distribution are as follows:
2[M^)]2
for x > 0; μ > 0 and σ > 0 mean = exp
-^exp^2 )- ! (2 + εχρ(σ2))
skewness excess kurtosis εχρ(4σ2 )+ 2 εχρ(3σ2 )+ 3 εχρ(2σ2 )- 6
[0243] Mean (μ) and standard deviation (<x) are the distributional parameters. The input requirements are such that Mean and Standard deviation are both > 0 and can be any positive
value. By default, the lognormal distribution uses the arithmetic mean and standard deviation. For applications for which historical data are available, it is more appropriate to use either the logarithmic mean and standard deviation, or the geometric mean and standard deviation.
[0244] Normal Distribution
[0245] The normal distribution is the most important distribution in probability theory because it describes many natural phenomena, such as people's IQs or heights. Decision makers can use the normal distribution to describe uncertain variables such as the inflation rate or the future price of gasoline.
The three conditions underlying the normal distribution are as follows:
• Some value of the uncertain variable is the most likely (the mean of the distribution).
• The uncertain variable could as likely be above the mean as it could be below the mean (symmetrical about the mean).
• The uncertain variable is more likely to be in the vicinity of the mean than further away.
The mathematical constructs for the normal distribution are as follows:
/(*) = for all values of x
while c > 0
mean = μ
standard deviation = σ
skewness = 0 (this applies to all inputs of mean and standard deviation)
excess kurtosis = 0 (this applies to all inputs of mean and standard deviation)
[0246] Mean (μ) and standard deviation (σ) are the distributional parameters. The input requirements are such that Standard deviation > 0 and can be any positive value and Mean can be any value.
[0247] Pareto Distribution
[0248] The Pareto distribution is widely used for the investigation of distributions associated with such empirical phenomena as city population sizes, the occurrence of natural resources, the size of companies, personal incomes, stock price fluctuations, and error clustering in communication circuits.
The mathematical constructs for the Pareto are as follows:
Blf
fix) for x > L βΐ
mean =
β -\
standard deviation = P 2
1 (β - 1)2 (β - 2)
β - 2 205 + 1)
skewness β L β -ι
6(β3 + β2 - 6β - 2)
excess kurtosis = β^β ^
[0249] Location (L) and shape (β) are the distributional parameters.
[0250] There are two standard parameters for the Pareto distribution: location and shape. The location parameter is the lower bound for the variable. After users select the location parameter, they can estimate the shape parameter. The shape parameter is a number greater than 0, usually greater than 1. The larger the shape parameter, the smaller the variance and the thicker the right tail of the distribution. The input requirements are such that Location > 0 and can be any positive value while Shape > 0.05.
[0251] Student's t Distribution
[0252] The Student's t distribution is the most widely used distribution in hypothesis testing. This distribution is used to estimate the mean of a normally distributed population when the sample size is small, and is used to test the statistical significance of the difference between two sample means or confidence intervals for small sample sizes.
The mathematical constructs for the t-distribution are as follows:
f(t) = + t2 /ry(r+1)l2
mean = 0 (this applies to all degrees of freedom r except if the distribution is shifted to another nonzero central location)
standard deviation r skewness = 0 for all r > 4
excess kurtosis t
where s and Γ is the gamma function.
[0253] Degree of freedom r is the only distributional parameter. The t distribution is related to the F distribution as follows: the square of a value of t with r degrees of freedom is distributed as F with 1 and r degrees of freedom. The overall shape of the probability density function of the t distribution also resembles the bell shape of a normally distributed variable with mean 0 and variance 1 , except that it is a bit lower and wider or is leptokurtic (fat tails at the ends and peaked center). As the number of degrees of freedom grows (say, above 30), the t distribution approaches the normal distribution with mean 0 and variance 1. The input requirements are such that Degrees of freedom > 1 and must be an integer.
[0254] Triangular Distribution
[0255] The triangular distribution describes a situation where users know the minimum, maximum, and most likely values to occur. For example, users could describe the number of cars sold per week when past sales show the minimum, maximum, and usual number of cars sold.
The three conditions underlying the triangular distribution are as follows:
• The minimum number of items is fixed.
• The maximum number of items is fixed.
• The most likely number of items falls between the minimum and maximum values, forming a triangular-shaped distribution, which shows that values near the minimum and maximum are less likely to occur than those near the most-likely value. The mathematical constructs for the triangular distribution are as follows:
2(x - Miri)
for Min < x < Likely
(Max - Min)(Likely
fix)
2(Max - x)
for Likely < x < Max
(Max - Min)(Max - Likely)
- (Min + Likely + Max)
mean = 3
J— (Min1 + Likety2 +Max2 - Min Max - Min Likely— Max Likely)
standard deviation = » 18
-j2(Min + Max - 2Likely)(2Min - Max - Likely)(Min - 2Max + Likely)
skewneSS = 5(M «2 + Max1 + Likely1 - MinMax - MinLikely - MaxLikely)3,11
excess kurtosis = -0.6
[0256] Minimum (Min), most likely (Likely), and maximum (Max) are the distributional parameters and the input requirements are such that Min < Most Likely < Max and can take any value, and Min < Max and can take any value.
[0257] Uniform Distribution
[0258] With the uniform distribution, all values fall between the minimum and maximum and occur with equal likelihood.
The three conditions underlying the uniform distribution are as follows:
• The minimum value is fixed.
• The maximum value is fixed.
• All values between the minimum and maximum occur with equal likelihood.
The mathematical constructs for the uniform distribution are as follows: f(x) =
Max - Min
for all values such that Min < Max
Min + Max
mean =
2
{Max - Min)2
standard deviation =
12
skewness = 0
excess kurtosis = -1.2 (this applies to all inputs of Min and Max)
[0259] Maximum value (Max) and minimum value (Min) are the distributional parameters. The input requirements are such that Min < Max and can take any value.
[0260] Weibull Distribution (Rayleigh Distribution)
[0261] The Weibull distribution describes data resulting from life and fatigue tests. It is commonly used to describe failure time in reliability studies as well as the breaking strengths of materials in reliability and quality control tests. Weibull distributions are also used to represent various physical quantities, such as wind speed. The Weibull distribution is a family of distributions that can assume the properties of several other distributions. For example, depending on the shape parameter users define, the Weibull distribution can be used to model the exponential and Rayleigh distributions, among others. The Weibull distribution is very flexible. When the Weibull shape parameter is equal to 1.0, the Weibull distribution is identical to the exponential distribution. The Weibull location parameter lets users set up an exponential distribution to start at a location other than 0.0. When the shape parameter is less than 1.0, the Weibull distribution becomes a steeply declining curve. A manufacturer might find this effect useful in describing part failures during a burn-in period.
mean = ?Γ(1 + a )
standard deviation = 2 [r(l + 2a~l ) - Γ2 (1 + cT1 )]
6Γ4 (1 + β 1 ) + 12Γ2 (1 + β 1 )Γ(1 + 2/Γ1 ) - 3Γ2 (1 + 2 Γ1 ) - 4Γ(1 + β 1 )Γ(1 + 3/Γ1 ) + Γ(1 + 4/Γ1 )
[Γ(1 + 2^-1) - Γ2 (1 + ^-1 )]2
[0262] Location (L), shape (α), and scale (β) are the distributional parameters, and Γ is the Gamma function. The input requirements are such that Scale > 0 and can be any positive value, Shape > 0.05 and Location can take on any value.
[0263] APPENDIX: STRATEGIC REAL OPTIONS MODELS AND EQUATIONS
[0264] This appendix demonstrates the mathematical models and computations used in creating the results for real options, financial options, and employee stock options. The following discussion provides an intuitive look into the binomial lattice methodology. Although knowledge of some stochastic mathematics and Martingale processes is required to fully understand the complexities involved even in a simple binomial lattice, the more important aspect is to understand how a lattice works, intuitively, without the need for complicated math.
[0265] There are two sets of key equations to consider when calculating a binomial lattice. These equations consist of an up/down equation (which is simply the discrete simulation's step size in a binomial lattice used in creating a lattice of the underlying asset) and a risk-neutral probability equation (used in valuing a lattice through backward induction). These two sets of equations are consistently applied to all options-based binomial modeling regardless of its complexity. The up step size (u) is shown as u ~ e , and the down step size (d) is shown as " - e , where σ is the volatility of logarithmic cash flow returns and ^ is the time-step in a lattice. The risk- neutral probability (p) is shown as
where rf is the risk- free rate in percent and b is the continuous dividend payout in percent.
[0266] In a stochastic case when uncertainty exists and is built into the model, several methods can be applied, including simulating a Brownian Motion. Starting with an Exponential Brownian
Motion where = e , we can segregate the process into a deterministic and a
S stochastic part, where we have = β μ{δ')εσε^' . The deterministic part of the model (βμ(Ά ) accounts for the slope or growth rate of the Brownian process. The underlying asset variable (usually denoted S in options modeling) is the sum of the present values of future free cash flows, which means that the growth rates or slope in cash flows from one period to the next have already been intuitively accounted for in the discounted cash flow analysis. Hence, we only have to account for the stochastic term ( βσε^ ), which has a highly variable simulated term (ε).
[0267] The stochastic term ( βσε^ ) has a volatility component (σ), a time component (St), and a simulated component (ε). Again, recall that the binomial lattice approach is a discrete simulation model; we no longer need to resimulate at every time period, and the simulated variable (ε) drops out. The remaining stochastic term is simply ea^ .
[0268] Finally, in order to obtain a recombining binomial lattice, the up and down step sizes have to be symmetrical in magnitude. Hence, if we set the up step size as ea^ , we can set the down step size as its reciprocal, or e~a^ .
[0269] Other methods can also be created using similar approaches, such as trinomial, quadranomial, and pentanomial lattices. Building and solving a trinomial lattice is similar to building and solving a binomial lattice, complete with the up/down jumps and risk-neutral probabilities. However, the following recombining trinomial lattice is more complicated to build. The results stemming from a trinomial lattice are the same as those from a binomial lattice at the limit, but the lattice-building complexity is much higher for trinomials or multinomial lattices. Hence, the examples thus far have been focusing on the binomial lattice, due to its simplicity and applicability. It is difficult enough to create a three-time-step trinomial tree manually. Imagine having to keep track of the number of nodes, bifurcations, and which branch recombines with which in a very large lattice. Therefore, computer algorithms are required. The trinomial lattice's equations are specified below:
u = e and d = e
1 St σ
r - q
[0270] Another approach that is used in the computation of options is the use of stochastic process simulation, which is a mathematically defined equation that can create a series of outcomes over time, outcomes that are not deterministic in nature. That is, an equation or process that does not follow any simple discernible rule such as price will increase X percent every year or revenues will increase by this factor of X plus Y percent. A stochastic process is by definition nondeterministic, and one can plug numbers into a stochastic process equation and obtain different results every time. For instance, the path of a stock price is stochastic in nature, and one cannot reliably predict the stock price path with any certainty. However, the price evolution over time is enveloped in a process that generates these prices. The process is fixed and predetermined, but the outcomes are not. Hence, by stochastic simulation, we create multiple pathways of prices, obtain a statistical sampling of these simulations, and make inferences on the potential pathways that the actual price may undertake given the nature and parameters of the stochastic process used to generate the time series.
[0271] Four basic stochastic processes are discussed herein, including the Geometric Brownian Motion, which is the most common and prevalently used process due to its simplicity and wide- ranging applications. The mean-reversion process, barrier long-run process, and jump-diffusion process are also briefly discussed.
[0272] Summary of Mathematical Characteristics of Geometric Brownian Motions
[0273] Assume a process X , where X = [Xt : t > 0] if and only if Xt is continuous, where the starting point is X0 = 0 , where X is normally distributed with mean zero and variance one or X e N(0, 1) , and where each increment in time is independent of each other previous increment
and is itself normally distributed with mean zero and variance t, such that Xt+a - Xt e N(0, t) . Then, the process dX = a Xdt + σΧ dZ follows a Geometric Brownian Motion, where a is a dX
drift parameter, σ the volatility measure, dZ = st [Kdt such that In e Ν(μ, σ) , or X and
X
dX are lognormally distributed. If at time zero, X(0) = 0, then the expected value of the process X at any time t is such that E[ ( )] = X^e , and the variance of the process X at time t is
V[X(t)] = X^e2"' (ea ' - \) . In the continuous case where there is a drift parameter a, the expected value then becomes E -rtdt X0e - r-a }tdt
[0274] Summary of Mathematical Characteristics of Mean-Reversion Processes
[0275] If a stochastic process has a long-run attractor such as a long-run production cost or long- run steady state inflationary price level, then a mean-reversion process is more likely. The process reverts to a long-run average such that the expected value is E[Xt ] = X + (X0 - X)e~v'
— σ2
and the variance is V[Xf - X] = τ— . The special circumstance that becomes useful is that in the limiting case when the time change becomes instantaneous or when dt— » 0 , we have the condition where Xt - X,_x = Χ(1 - β~η) + X^^e^ - \) + st , which is the first order autoregressive process, and η can be tested econometrically in a unit root context.
[0276] Summary of Mathematical Characteristics of Barrier Long-Run Processes
[0277] This process is used when there are natural barriers to prices— for example, floors or caps— or when there are physical constraints like the maximum capacity of a manufacturing plant. If barriers exist in the process, where we define X as the upper barrier and X_ as the
2aX
2a e °"2
lower barrier, we have a process where X(t) - σ 2 2a X 2aX
[0278] Summary of Mathematical Characteristics of Jump-Diffusion Processes
[0279] Start-up ventures and research and development initiatives usually follow a jump- diffusion process. Business operations may be status quo for a few months or years, and then a product or initiative becomes highly successful and takes off. An initial public offering of equities, oil price jumps, and price of electricity are textbook examples of this circumstance. Assuming that the probability of the jumps follows a Poisson distribution, we have a process άχ = f (X> t)dt + g{X, t)dq wnere me functions / and g are known and where the probability
[0280] The other approach applied in the present invention is the Black-Scholes-Merton model. The model is detailed below, where we have the following definitions of variables:
S present value of future cash flows ($)
X implementation cost ($)
r risk-free rate (%)
T time to expiration (years)
σ volatility (%)
Φ cumulative standard-normal distribution
[0281] Options Execution Types
• American Options can be executed at any time up to and including the maturity date.
• European Options can be executed only at one point in time, the maturity date.
• Bermudan Options can be executed at certain times and can be considered a hybrid of American and European Options. There is typically a blackout or vesting period when the option cannot be executed, but starting from the end of the blackout vesting date to the option's maturity, the option can be executed.
[0282] Option to Wait and Execute
[0283] Buy additional time to wait for new information by pre-negotiating pricing and other contractual terms to obtain the option but not the obligation to purchase or execute something in the future should conditions warrant it (wait and see before executing).
• Run a Proof of Concept first to better determine the costs and schedule risks of a project versus jumping in right now and taking the risk.
• Build, Buy, or Lease. Developing internally or using commercially available technology or products.
• Multiple Contracts in place that may or not be executed.
• Market Research to obtain valuable information before deciding.
• Venture Capital small seed investment with right of first refusal before executing large- scale financing.
• Relative values of Strategic Analysis of Alternatives or Courses of Action while considering risk and the Value of Information.
• Contract Negotiations with vendors, acquisition strategy with industrial-based ramifications (competitive sustainment and strategic capability and availability).
• Project Evaluation and Capability ROI modeling.
• Capitalizing on other opportunities while reducing large-scale implementation risks, and determining the value of Research & Development (parallel implementation of alternatives while waiting on technical success of the main project, and no need to delay the project because of one bad component in the project).
• Low Rate Initial Production, Prototyping, Advanced Concept Technology Demonstration before full-scale implementation.
• Right of First Refusal contracts.
• Value of Information by forecasting cost inputs, capability, schedule, and other metrics.
• Hedging and Call- and Put-like options to execute something in the future with agreed upon terms now, OTC Derivatives (Price, Demand, Forex, Interest Rate forwards, futures, options, swaptions for hedging).
[0284] Option to Abandonment
[0285] Hedge downside risks and losses by being able to salvage some value of a failed project or asset that is out-of-the-money (sell intellectual property and assets, abandon and walk away from a project, buyback/sellback provisions).
• Exit and Salvage assets and intellectual property to reduce losses.
• Divestiture and Spin-off.
• Buyback Provisions in a contract.
• Stop and Abandon before executing the next phase.
• Termination for Convenience.
• Early Exit and Stop Loss Provisions in a contract.
[0286] Option to Expand
[0287] Take advantage of upside opportunities by having existing platform, structure, or technology that can be readily expanded (utility peaking plants, larger oil platforms, early/leapfrog technology development, larger capacity or technology-in-place for future expansion).
• Platform Technologies.
• Mergers and Acquisitions.
• Built-in Expansion Capabilities.
• Geographical, Technological, and Market Expansion.
• Foreign Military Sales.
• Reusability and Scalability.
[0288] Option to Contract
[0289] Reduce downside risk but still participate in reduced benefits (counterparty takes over or joins in some activities to share profits; at the same time reduce the firm's risk of failure or severe losses in a risky but potentially profitable venture).
• Outsourcing, Alliances, Contractors, Leasing.
• Joint Venture.
• Foreign Partnerships.
• Co-Development and Co-Marketing.
[0290] Portfolio Options
[0291] Combinations of options and strategic flexibility within a portfolio of nested options (path dependencies, mutually exclusive/inclusive, nested options).
• Determining the portfolio of projects' capabilities to develop and field within Budget and Time Constraints, and what new Product Configurations to develop or acquire to field certain capabilities.
• Allows for different Flexible Pathways: Mutually Exclusive (PI or P2 but not both), Platform/Prerequisite Technology (P3 requires P2, but P2 can be stand-alone; expensive and worth less if considered by itself without accounting for flexibility downstream options it provides for in the next phase), expansion options, abandonment options, or parallel development or simultaneous compound options.
• Determining the Optimal Portfolios given budget scenarios that provide the maximum capability, flexibility, and cost effectiveness with minimal risks.
• Determining testing required in Modular Systems, mean-time-to-failure estimates, and Replacement and Redundancy requirements.
• Relative value of strategic Flexibility Options (options to Abandon, Choose, Contract, Expand, Switch, and Sequential Compound Options, Barrier Options, and many other types of Exotic Options).
• Maintaining Capability and Readiness Levels.
• Product Mix, Inventory Mix, Production Mix.
• Capability Selection and Sourcing.
[0292] Sequential Options
[0293] Significant value exists if you can phase out investments over time, thereby reducing the risk of a one-time up-front investment (pharmaceutical and high technology development and manufacturing usually comes in phases or stages).
• Stage-gate implementation of high-risk project development, prototyping, low-rate initial production, technical feasibility tests, technology demonstration competitions.
• Government contracts with multiple stages with the option to abandon at any time and valuing Termination for Convenience, and built-in flexibility to execute different courses of action at specific stages of development.
• P3I, Milestones, R&D, and Phased Options.
• Platform technology.
[0294] Options to Switch
[0295] Ability to choose among several options, thereby improving strategic flexibility to maneuver within the realm of uncertainty (maintain a foot in one door while exploring another to decide if it makes sense to switch or stay put).
• Ability to Switch among various raw input materials to use when prices of each raw material fluctuates significantly.
• Readiness and capability risk mitigation by switching vendors in an Open Architecture through Multiple Vendors and Modular Design.
[0296] Other Types of Real Options
[0297] Barrier Options, Custom Options, Simultaneous Compound Option, Employee Stock Options, Exotic Options, Options Embedded Contracts, Options with Blackout/Vesting Provisions, Options with Market and Change of Control Provisions, and many others!
[0298] Options Input Assumptions
Asset Value. This is the underlying asset value before implementation costs. You can compute it by taking the NPV and adding back the sum of the present values of capital investments.
Implementation Cost. This is the cost to execute the option (typically this is the cost to execute an option to wait or an option to expand).
Volatility. This is the annualized volatility (a measure of risk and uncertainty, denoted as a value in percent) of the underlying asset.
Maturity. This is the maturity of the option, denoted in years (e.g., a two and a half year option life can be entered as 2.5).
Risk-free Rate. This is the interest rate yield on a risk-free government bond with maturity commensurate to that of the option.
Dividend Rate. The annualized opportunity cost of not executing the option, as a percentage of the underlying asset.
Lattice Steps. The number of binomial or multinomial lattice steps to run in the model. The typical number we recommend is between 100 and 1,000, and you can check for convergence of the results. The larger the number of lattice steps, the higher the level of convergence and granularity (i.e., the number of decimal precision).
•Blackout Year. The vesting period entered in years, during which the option cannot be executed (European), but the option converts to an American on the date of this vesting period through to its maturity.
Maturity of Phases. These are the number of years to the end of each phase in a sequential compound option model.
Cost to Implement Phases. These are the costs to execute each of the subsequent phases in a sequential compound option, and they can be set to zero or a positive value.
Expansion Factor. The relative ratio increase in the underlying asset when the option to expand is executed (typically this is greater than 1).
Contraction Factor. The relative ratio reduction in the underlying asset when the option to contract is executed (typically this is less than 1).
Savings. The net savings received by contracting operations.
Salvage. The net sales amount after expenses of abandoning an asset.
• Barrier. The upper or lower barrier of an option whereupon if the underlying asset breaches this barrier, the option becomes either live or worthless, depending on the option type modeled.
[0299] APPENDIX: FORECASTING AND ECONOMETRIC MODELING
[0300] This appendix demonstrates the mathematical models and computations used in creating the general regression equations, which take the form of Y = β0 + βιΧι + β2Χ2 + ... + βηΧη + ε where ¾ is the intercept, ¾ are the slope coefficients, and ε is the error term. The Y term is the dependent variable and the X terms are the independent variables, where these X variables are also known as the regressors. The dependent variable is named as such as it depends on the independent variable; for example, sales revenue depends on the amount of marketing costs expended on a product's advertising and promotion, making the dependent variable sales and the independent variable marketing costs. An example of a bivariate regression where there is only a single Y and a single X variable is seen as simply inserting the best-fitting line through a set of data points in a two-dimensional plane. In other cases, a multivariate regression can be performed, where there are multiple or k number of independent X variables or regressors where in this case the best-fitting line will be within a k + 1 dimensional plane.
[0301] Fitting a line through a set of data points in a multidimensional scatter plot may result in numerous possible lines. The best-fitting line is defined as the single unique line that minimizes the total vertical errors, that is, the sum of the absolute distances between the actual data points
(Yi) and the estimated line ( Y ). To find the best-fitting unique line that minimizes the errors, a more sophisticated approach is applied, using multivariate regression analysis. Regression analysis therefore finds the unique best-fitting line by requiring that the total errors be minimized, or by calculating:
[0302] Only one unique line will minimize this sum of squared errors as shown in the equation above. The errors (vertical distances between the actual data and the predicted line) are squared
to avoid the negative errors from canceling out the positive errors. Solving this minimization problem with respect to the slope and intercept requires calculating first derivatives and setting them equal to zero:
which yields the simple bivariate regression's set of least squares equations:
ρ0 =γ-ρχ
[0303] For multivariate regression, the analogy is expanded to account for multiple independent variables, where Yi = βι + β2Χ2 ί + βι^ι i + ει > and the estimated slopes can be calculated by:
This set of results can be summarized using matrix notations: ^ ^ ^ ^ .
[0304] In running multivariate regressions, great care must be taken to set up and interpret the results. For instance, a good understanding of econometric modeling is required (e.g., identifying regression pitfalls such as structural breaks, multicollinearity, heteroskedasticity, autocorrelation, specification tests, nonlinearities, etc.) before a proper model can be constructed. Therefore the present invention includes some advanced econometrics approaches that are based on the principles of multiple regression outlined above.
[0305] One approach used is that of an Auto-ARIMA, which is based on the fundamental concepts of ARIMA theory or Autoregressive Integrated Moving Average models. ARIMA(p,d,q) models are the extension of the AR model that uses three components for modeling the serial correlation in the time-series data. The first component is the autoregressive (AR) term. The AR(p) model uses the p lags of the time series in the equation. An AR(p) model has the form: y(t) = a(l) y(t-l) + ... + a(p) y(t-p) + e(t). The second component is the integration (d) order term. Each integration order corresponds to differencing the time series. 1(1) means differencing the data once. 1(d) means differencing the data d times. The third component is the moving average (MA) term. The MA(q) model uses the q lags of the forecast errors to improve the forecast. An MA(q) model has the form: y(t) = e(t) + b(l) e(t-l) + ... + b(q) e(t-q). Finally, an ARMA(p,q) model has the combined form: y(t) = a(l) y(t-l) + ... + a(p) y(t-p) + e(t) + b(l) e(t-l) + ... + b(q) e(t-q).... Using this ARIMA concept, various combinations of p, d, q integers are tested in an automated and systematic fashion to determine the best-fitting model for the user's data.
[0306] In order to determine the best fitting model, we apply several goodness-of-fit statistics to provide a glimpse into the accuracy and reliability of the estimated regression model. They usually take the form of a t-statistic, F-statistic, R-squared statistic, adjusted R-squared statistic, Durbin- Watson statistic, Akaike Criterion, Schwarz Criterion, and their respective probabilities.
[0307] The R-squared (R2), or coefficient of determination, is an error measurement that looks at the percent variation of the dependent variable that can be explained by the variation in the independent variable for a regression analysis. The coefficient of determination can be calculated by:
where the coefficient of determination is one less the ratio of the sums of squares of the errors (SSE) to the total sums of squares (TSS). In other words, the ratio of SSE to TSS is the
unexplained portion of the analysis; thus, one less the ratio of SSE to TSS is the explained portion of the regression analysis.
[0308] The estimated regression line is characterized by a series of predicted values ( Y ); the average value of the dependent variable's data points is denoted Y ; and the individual data points are characterized by Yi Therefore, the total sum of squares, that is, the total variation in the data or the total variation about the average dependent value, is the total of the difference between the individual dependent values and its average (the total squared distance of Yi - Y ).
The explained sum of squares, the portion that is captured by the regression analysis, is the total of the difference between the regression's predicted value and the average dependent variable's dataset (seen as the total squared distance of Y - Y ). The difference between the total variation (TSS) and the explained variation (ESS) is the unexplained sums of squares, also known as the sums of squares of the errors (SSE).
[0309] Another related statistic, the adjusted coefficient of determination, or the adjusted R- squared ( R 2 ), corrects for the number of independent variables (k) in a multivariate regression through a de rees of freedom correction to provide a more conservative estimate:
¾ - F)2 i (k - \) Tss i (k - i)
1
[0310] The adjusted R-squared should be used instead of the regular R-squared in multivariate regressions because every time an independent variable is added into the regression analysis, the R-squared will increase, indicating that the percent variation explained has increased. This increase occurs even when nonsensical regressors are added. The adjusted R-squared takes the added regressors into account and penalizes the regression accordingly, providing a much better estimate of a regression model's goodness-of-fit.
[0311] Other goodness-of-fit statistics include the t-statistic and the F-statistic. The former is used to test if each of the estimated slope and intercept(s) is statistically significant, that is, if it is statistically significantly different from zero (therefore making sure that the intercept and slope
estimates are statistically valid). The latter applies the same concepts but simultaneously for the entire regression equation including the intercept and slopes. Using the previous example, the following illustrates how the t-statistic and F-statistic can be used in a regression analysis.
[0312] When running the Autoeconometrics methodology, multiple regression issues and errors are first tested for. These include items such as heteroskedasticity, multicollinearity, micronumerosity, lags, leads, autocorrelation, and others. For instance, several tests exist to test for the presence of heteroskedasticity. These tests also are applicable for testing misspecifications and nonlinearities. The simplest approach is to graphically represent each independent variable against the dependent variable as illustrated earlier. Another approach is to apply one of the most widely used models, the White's test, where the test is based on the null hypothesis of no heteroskedasticity against an alternate hypothesis of heteroskedasticity of some unknown general form. The test statistic is computed by an auxiliary or secondary regression, where the squared residuals or errors from the first regression are regressed on all possible (and nonredundant) cross products of the regressors. For example, suppose the following regression is estimated:
Υ = β0 + βιΧ + β2Ζ + ει
The test statistic is then based on the auxiliary regression of the errors (ε):
ε( 2 = a0 + axX + a2Z + a3X2 + a4Z2 + a5XZ + vt
[0313] The nR2 statistic is the White's test statistic, computed as the number of observations (n) times the centered R-squared from the test regression. White's test statistic is asymptotically distributed as a / with degrees of freedom equal to the number of independent variables (excluding the constant) in the test regression.
[0314] The White's test is also a general test for model misspecification, because the null hypothesis underlying the test assumes that the errors are both homoskedastic and independent of the regressors, and that the linear specification of the model is correct. Failure of any one of these conditions could lead to a significant test statistic. Conversely, a nonsignificant test statistic implies that none of the three conditions is violated. For instance, the resulting F-statistic is an omitted variable test for the joint significance of all cross products, excluding the constant.
[0315] One method to fix heteroskedasticity is to make it homoskedastic by using a weighted least squares (WLS) approach. For instance, suppose the following is the original regression equation:
Υ = β0 + βιΧι + β2Χ2 + β3Χ3 + ε
Further suppose that 2 is heteroskedastic. Then transform the data used in the regression into:
2 Λ 2 Λ 2 Λ 2
[0316] Alternatively, the Park's test can be applied to test for heteroskedasticity and to fix it. The Park's test model is based on the original regression equation, uses its errors, and creates an auxiliar re ression that takes the form of:
[0317] Suppose β2 is found to be statistically significant based on a t-test, then heteroskedasticity is found to be present in the variable Xt . The remedy, therefore, is to use the following regression specification:
[0318] Multicollinearity exists when there is a linear relationship between the independent variables. When this occurs, the regression equation cannot be estimated at all. In near collinearity situations, the estimated regression equation will be biased and provide inaccurate results. This situation is especially true when a stepwise regression approach is used, where the statistically significant independent variables will be thrown out of the regression mix earlier than expected, resulting in a regression equation that is neither efficient nor accurate.
[0319] As an example, suppose the following multiple regression analysis exists, where
YT = β1 + 2Χ2 + 3Χ3 + εί
The estimated slopes can be calculated through:
[0320] Now suppose that there is perfect multicollinearity, that is, there exists a perfect linear relationship between X2 and X3, such that X3 i = λΧ2 - for all positive values of X. Substituting this linear relationship into the slope calculations for ¾, the result is indeterminate. In other words, we have:
[0321] The same calculation and results apply to ¾, which means that the multiple regression analysis breaks down and cannot be estimated given a perfect collinearity condition.
[0322] One quick test of the presence of multicollinearity in a multiple regression equation is that the R-squared value is relatively high while the t-statistics are relatively low. Another quick test is to create a correlation matrix between the independent variables. A high cross correlation indicates a potential for multicollinearity. The rule of thumb is that a correlation with an absolute value greater than 0.75 is indicative of severe multicollinearity.
[0323] Another test for multicollinearity is the use of the variance inflation factor (VIF), obtained by regressing each independent variable to all the other independent variables, obtaining the R-squared value and calculating the VIF of that variable by estimating:
[0324] A high VIF value indicates a high R-squared near unity. As a rule of thumb, a VIF value greater than 10 is usually indicative of destructive multicollinearity. The Autoeconometrics
method computes for multicollinearity and corrects the data before running the next iteration when enumerating through the entire set of possible combinations and permutations of models.
[0325] One simple approach to test for autocorrelation is to graph the time series of a regression equation's residuals. If these residuals exhibit some cyclically, then autocorrelation exists. Another more robust approach to detect autocorrelation is the use of the Durbin- Watson statistic, which estimates the potential for a first-order autocorrelation. The Durbin- Watson test also identifies model misspecification, that is, if a particular time-series variable is correlated to itself one period prior. Many time-series data tend to be autocorrelated to their historical occurrences. This relationship can be due to multiple reasons, including the variables' spatial relationships (similar time and space), prolonged economic shocks and events, psychological inertia, smoothing, seasonal adjustments of the data, and so forth.
[0326] The Durbin-Watson statistic is estimated by the ratio of sum of the squares of the regression errors for one eriod prior to the sum of the current period's errors:
[0327] There is a Durbin-Watson critical statistic table at the end of the book that provides a guide as to whether a statistic implies any autocorrelation.
[0328] Another test for autocorrelation is the Breusch-Godfrey test, where for a regression function in the form of:
Y = f{Xl , X2 ,..., Xk )
[0329] Estimate this regression equation and obtain its errors t. Then, run the secondary regression function in the form of:
[0330] Obtain the R-squared value and test it against a null hypothesis of no autocorrelation versus an alternate hypothesis of autocorrelation, where the test statistic follows a Chi-Square distribution of p degrees of freedom:
[0331] Fixing autocorrelation requires the application of advanced econometric models including the applications of ARIMA (as described above) or ECM (Error Correction Models). However, one simple fix is to take the lags of the dependent variable for the appropriate periods, add them into t their significance. For instance:
[0332] In interpreting the results of an Autoeconometrics model, most of the specifications are identical to the multivariate regression analysis. However, there are several additional sets of results specific to the econometric analysis. The first is the addition of Akaike Information Criterion (AIC) and Schwarz Criterion (SC), which are often used in ARIMA model selection and identification. That is, AIC and SC are used to determine if a particular model with a specific set of p, d, and q parameters is a good statistical fit. SC imposes a greater penalty for additional coefficients than the AIC but, generally, the model with the lowest AIC and SC values should be chosen. Finally, an additional set of results called the autocorrelation (AC) and partial autocorrelation (PAC) statistics are provided in the ARIMA report.
[0333] As an illustrative example, if autocorrelation AC(1) is nonzero, it means that the series is first-order serially correlated. If AC dies off more or less geometrically with increasing lags, it implies that the series follows a low-order autoregressive process. If AC drops to zero after a small number of lags, it implies that the series follows a low-order moving-average process. In contrast, PAC measures the correlation of values that are k periods apart after removing the correlation from the intervening lags. If the pattern of autocorrelation can be captured by an autoregression of order less than k, then the partial autocorrelation at lag k will be close to zero. The Ljung-Box Q-statistics and their p-values at lag k are also provided, where the null hypothesis being tested is such that there is no autocorrelation up to order k. The dotted lines in the plots of the autocorrelations are the approximate two standard error bounds. If the
autocorrelation is within these bounds, it is not significantly different from zero at approximately the 5% significance level. Finding the right ARIMA model takes practice and experience. These AC, PAC, SC, and AIC are highly useful diagnostic tools to help identify the correct model specification. Finally, the ARIMA parameter results are obtained using sophisticated optimization and iterative algorithms, which means that although the functional forms look like those of a multivariate regression, they are not the same. ARIMA is a much more computationally intensive and advanced econometric approach.
[0334] Descriptive Statistics
[0335] Most distributions can be described within four moments (some distributions require one moment, while others require two moments, etc.). Descriptive statistics quantitatively captures these moments. The first moment describes the location of a distribution (i.e., mean, median, and mode) and is interpreted as the expected value, expected returns, or the average value of occurrences.
[0336] The second moment measures a distribution's spread, or width, and is frequently described using measures such as Standard Deviations, Variances, Quartiles, and Inter-Quartile Ranges. Standard deviation is a popular measure indicating the average deviation of all data points from their mean. It is a popular measure as it is frequently associated with risk (higher standard deviations meaning a wider distribution, higher risk, or wider dispersion of data points around the mean value) and its units are identical to the units in the original dataset.
[0337] Skewness is the third moment in a distribution. Skewness characterizes the degree of asymmetry of a distribution around its mean. Positive skewness indicates a distribution with an asymmetric tail extending toward more positive values. Negative skewness indicates a distribution with an asymmetric tail extending toward more negative values.
[0338] Kurtosis characterizes the relative peakedness or flatness of a distribution compared to the normal distribution. It is the fourth moment in a distribution. A positive kurtosis value indicates a relatively peaked distribution. A negative kurtosis indicates a relatively flat distribution. The kurtosis measured here has been centered to zero (certain other kurtosis
measures are centered on 3.0). While both are equally valid, centering across zero makes the interpretation simpler. A high positive kurtosis indicates a peaked distribution around its center and leptokurtic or fat tails. This indicates a higher probability of extreme events (e.g., catastrophic events, terrorist attacks, stock market crashes) than is predicted in a normal distribution.
[0339] Correlation Matrix
[0340] According to an embodiment of the present invention, the Correlation module lists the Pearson's product moment correlations (commonly referred to as the Pearson's R) between variable pairs. The correlation coefficient ranges between -1.0 and +1.0 inclusive. The sign indicates the direction of association between the variables, while the coefficient indicates the magnitude or strength of association. The Pearson's R only measures a linear relationship and is less effective in measuring nonlinear relationships.
[0341] A hypothesis t-test is performed on the Pearson's R and the p-values are reported. If the calculated p-value is less than or equal to the significance level used in the test, then reject the null hypothesis and conclude that there is a significant correlation between the two variables in question. Otherwise, the correlation is not statistically significant.
[0342] Finally, a Spearman Rank-Based Correlation is also included. The Spearman's R first ranks the raw data then performs the correlation calculation, which allows it to better capture nonlinear relationships. The Pearson's R is a parametric test and the underlying data is assumed to be normally distributed, hence, the t-test can be applied. However, the Spearman's R is a nonparametric test, where no underlying distributions are assumed, and, hence, the t-test cannot be applied.
[0343] Variance-Covariance Matrix
[0344] The Covariance measures the average of the products of deviations for each data point pair. Use covariance to determine the relationship between two variables. The covariance is
related to the correlation in that the correlation is the covariance divided by the product of the two variables' standard deviation, standardizing the correlation measurement to be unitless and between -1 and + 1.
[0345] Covariance is used when the units of the variables are similar, allowing for easy comparison of the magnitude of variability about their respective means. The covariance of the same variable is also known as the variance. The variance of a variable is the square of its standard deviation. This is why standardizing the variance through dividing it by the variable's standard deviation (twice) yields a correlation of 1.0, indicating that a variable is perfectly correlated to itself.
[0346] It must be stressed that a high covariance does not imply causation. Associations between variables in no way imply that the change of one variable causes another variable to change. Two variables that are moving independently of each other but in a related path may have a high covariance but their relationship might be spurious. In order to capture this relationship, use regression analysis instead.
[0347] Basic Statistics
[0348] According to an embodiment of the present invention, the following basic statistical functions are also included in PEAT's Forecast Statistics module and their short definitions are listed below:
Absolute Values: Computes the absolute value of a number where it is the number without its sign.
Average: Computes the average or arithmetic mean of the rows of data for the selected variable.
Count: Computes how many numbers there are in the rows of data for the selected variable. Difference: Computes the difference of the current period from the previous period.
Lag: Returns the value lagged some number of periods (the entire chronological dataset is shifted down the number of lagged periods specified).
Lead: Returns the value leading by some number of periods (the entire chronological dataset is shifted up the number of lead periods specified).
LN: Computes the natural logarithm.
Log: Computes the logarithmic value of some specified base.
Max: Computes the maximum of the rows of data for the selected variable.
Median: Computes the median of the rows of data for the selected variable.
Min: Computes the minimum of the rows of data for the selected variable.
Mode: Computes the mode, or most frequently occurring, of data points for the selected variable.
Power: Computes the result of a number raised to a specified power.
Rank Ascending: Ranks the rows of data for the selected variable in ascending order.
Rank Descending: Ranks the rows of data for the selected variable in descending order.
Relative LN Returns: Computes the natural logarithm of the relative returns from one period to another, where the relative return is computed as the current value divided by its previous value.
Relative Returns: Computes the relative return where the current value is divided by its previous value.
Semi-Standard Deviation (Lower): Computes the sample standard deviation of data points below a specified value.
Semi-Standard Deviation (Upper): Computes the sample standard deviation of data points above a specified value.
Standard Deviation: Computes the standard deviation of the rows of data for the selected variable.
Variance: Computes the variance of the rows of data for the selected variable.
One of ordinary skill the art would appreciated that more or less basic statistical functions are could be included in PEAT's Forecast Statistics module, and embodiments of the present invention are contemplated for use with such basic statistical function.
[0349] Hypothesis Tests: Parametric Models
[0350] One- Variable Testing for Means (T-Test)
[0351] This one-variable t-test of means is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal (the t-test is used when the sample size is less than 30). This t-test can be applied to three types of hypothesis tests to be examined— a two-tailed test, a right-tailed test, and a left-tailed test— based on the sample dataset if the population mean is equal to, less than, or greater than the hypothesized mean.
[0352] If the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population mean is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized mean based on the sample tested. Otherwise, the true population mean is statistically similar to the hypothesized mean.
[0353] One- Variable Testing for Means (Z-Test)
[0354] The one-variable Z-test is appropriate when the population standard deviation is known and the sampling distribution is assumed to be approximately normal (this applies when the number of data points exceeds 30). This Z-test can be applied to three types of hypothesis tests to be examined— a two-tailed test, a right-tailed test, and a left-tailed test— based on the sample dataset if the population mean is equal to, less than, or greater than the hypothesized mean.
[0355] If the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population mean is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized mean based on the sample tested. Otherwise, the true population mean is statistically similar to the hypothesized mean.
[0356] One- Variable Testing for Proportions (Z-Test)
[0357] The one-variable Z-test for proportions is appropriate when the sampling distribution is assumed to be approximately normal (this applies when the number of data points exceeds 30,
and when the number of data points, N, multiplied by the hypothesized population proportion mean, P, is greater than or equal to five, or NP≥ 5 ). The data used in the analysis have to be proportions and be between 0 and 1. This Z-test can be applied to three types of hypothesis tests to be examined— a two-tailed test, a right-tailed test, and a left-tailed test— based on the sample dataset if the population mean is equal to, less than, or greater than the hypothesized mean.
[0358] If the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population mean is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized mean based on the sample tested. Otherwise, the true population mean is statistically similar to the hypothesized mean.
[0359] Two Variables with Dependent Means (T-Test)
[0360] The two-variable dependent t-test is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal (the t-test is used when the sample size is less than 30). In addition, this test is specifically formulated for testing the same or similar samples before and after an event (e.g., measurements taken before a medical treatment are compared against those measurements taken after the treatment to see if there is a difference). This t-test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test.
[0361] As an illustrative example, suppose that a new heart medication was administered to 100 patients (N = 100) and the heart rates before and after the medication was administered were measured. The two dependent variables t-test can be applied to determine if the new medication is effective by testing to see if there are statistically different "before and after" averages. The dependent variables test is used here because there is only a single sample collected (the same patients' heartbeats were measured before and after the new drug administration).
[0362] The two-tailed null hypothesis tests that the true population's mean of the difference between the two variables is zero, versus the alternate hypothesis that the difference is
statistically different from zero. The right-tailed null hypothesis test is such that the difference in the population means (first mean less second mean) is statistically less than or equal to zero (which is identical to saying that mean of the first sample is less than or equal to the mean of the second sample). The alternative hypothesis is that the real populations' mean difference is statistically greater than zero when tested using the sample dataset (which is identical to saying that the mean of the first sample is greater than the mean of the second sample). The left-tailed null hypothesis test is such that the difference in the population means (first mean less second mean) is statistically greater than or equal to zero (which is identical to saying that the mean of the first sample is greater than or equal to the mean of the second sample). The alternative hypothesis is that the real populations' mean difference is statistically less than zero when tested using the sample dataset (which is identical to saying that the mean of the first sample is less than the mean of the second sample).
[0363] If the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population difference of the population means is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) zero based on the sample tested. Otherwise, the true population mean is statistically similar to the hypothesized mean.
[0364] Two (Independent) Variables with Equal Variances (T-Test)
[0365] The two-variable t-test with equal variances is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal (the t-test is used when the sample size is less than 30). In addition, the two independent samples are assumed to have similar variances.
[0366] For illustrative purposes, suppose that a new engine design is tested against an existing engine design to see if there is a statistically significant difference between the two. The t-test on two (independent) variables with equal variances can be applied. This test is used because there are two distinctly different samples collected here (new engine and existing engine) but the
variances of both samples are assumed to be similar (the means may or may not be similar, but the fluctuations around the mean are assumed to be similar).
[0367] This t-test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test. A two-tailed hypothesis tests the null hypothesis, H0, such that the populations' mean difference between the two variables is statistically identical to the hypothesized mean differences (HMD). If HMD is set to zero, this is the same as saying that the first mean equals the second mean. The alternative hypothesis, Ha, is that the difference between the real population means is statistically different from the hypothesized mean differences when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean does not equal the second mean.
[0368] A right-tailed hypothesis tests the null hypothesis, H0, such that the population mean differences between the two variables is statistically less than or equal to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean is less than or equals the second mean. The alternative hypothesis, Ha, is that the real difference between population means is statistically greater than the hypothesized mean differences when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean is greater than the second mean.
[0369] A left-tailed hypothesis tests the null hypothesis, H0, such that the differences between the population means of the two variables is statistically greater than or equal to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean is greater than or equals the second mean. The alternative hypothesis, Ha, is that the real difference between population means is statistically less than the hypothesized mean difference when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean is less than the second mean.
[0370] If the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population difference of the population means is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test)
HMD based on the sample tested. Otherwise, the true difference of the population means is statistically similar to the HMD. For data requirements, see the preceding section, Two Variables with Dependent Means (T-Test).
[0371] Two (Independent) Variables with Unequal Variances (T-Test)
[0372] The two-variable t-test with unequal variances (the population variance of sample 1 is expected to be different from the population variance of sample 2) is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal (the t-test is used when the sample size is less than 30). In addition, the two independent samples are assumed to have similar variances.
[0373] For illustrative purposes, suppose that a new customer relationship management (CRM) process is being evaluated for its effectiveness, and the customer satisfaction rankings between two hotels (one with and the other without CRM implemented) are collected. The t-test on two (independent) variables with unequal variances can be applied. This test is used here because there are two distinctly different samples collected (customer survey results of two different hotels) and the variances of both samples are assumed to be dissimilar (due to the difference in geographical location, plus the demographics and psychographics of the customers are different on both properties).
[0374] This t-test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test. A two-tailed hypothesis tests the null hypothesis, H0, such that the population mean differences between the two variables are statistically identical to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean equals the second mean. The alternative hypothesis, Ha, is that the real difference between the population means is statistically different from the hypothesized mean differences when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean does not equal the second mean.
[0375] A right-tailed hypothesis tests the null hypothesis, H0, such that the difference between the two variables' population means is statistically less than or equal to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean is less than or equals the second mean. The alternative hypothesis, Ha, is that the real populations' mean difference is statistically greater than the hypothesized mean differences when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean is greater than the second mean.
[0376] A left-tailed hypothesis tests the null hypothesis, H0, such that the difference between the two variables' population means is statistically greater than or equal to the hypothesized mean differences. If HMD is set to zero, this is the same as saying that the first mean is greater than or equals the second mean. The alternative hypothesis, Ha, is that the real difference between population means is statistically less than the hypothesized mean difference when tested using the sample dataset. If HMD is set to zero, this is the same as saying that the first mean is less than the second mean.
[0377] If the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population difference of the population means is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized mean based on the sample tested. Otherwise, the true difference of the population means is statistically similar to the hypothesized mean.
[0378] Two (Independent) Variables Testing for Means (Z-Test)
[0379] The two-variable Z-test is appropriate when the population standard deviations are known for the two samples, and the sampling distribution of each variable is assumed to be approximately normal (this applies when the number of data points of each variable exceeds 30).
[0380] To illustrate, suppose that a market survey was conducted on two different markets, the sample collected is large (N must exceed 30 for both variables), and the researcher is interested in testing whether there is a statistically significant difference between the two markets. Further suppose that such a market survey has been performed many times in the past and the population
standard deviations are known. A two-independent variable Z-test can be applied because the sample size exceeds 30 on each market and the population standard deviations are known.
[0381] This Z-test can be applied to three types of hypothesis tests: a two-tailed test, a right- tailed test, and a left-tailed test. A two-tailed hypothesis tests the null hypothesis, H0, such that the difference between the two population means is statistically identical to the hypothesized mean. The alternative hypothesis, Ha, is that the real difference between the two population means is statistically different from the hypothesized mean when tested using the sample dataset.
[0382] A right-tailed hypothesis tests the null hypothesis, H0, such that the difference between the two population means is statistically less than or equal to the hypothesized mean. The alternative hypothesis, Ha, is that the real difference between the two population means is statistically greater than the hypothesized mean when tested using the sample dataset.
[0383] A left-tailed hypothesis tests the null hypothesis, H0, such that the difference between the two population means is statistically greater than or equal to the hypothesized mean. The alternative hypothesis, Ha, is that the real difference between the two population means is statistically less than the hypothesized mean when tested using the sample dataset.
[0384] Two (Independent) Variables Testing for Proportions (Z-Test)
[0385] The two-variable Z-test on proportions is appropriate when the sampling distribution is assumed to be approximately normal (this applies when the number of data points of both samples exceeds 30). Further, the data should all be proportions and be between 0 and 1.
[0386] For illustrative purposes, suppose that a brand research was conducted on two different headache pills, the sample collected is large (N must exceed 30 for both variables), and the researcher is interested in testing whether there is a statistically significant difference between the proportion of headache sufferers of both samples using the different headache medication. A two-independent variable Z-test for proportions can be applied because the sample size exceeds 30 on each market and the data collected are proportions.
[0387] This Z-test can be applied to three types of hypothesis tests: a two-tailed test, a right- tailed test, and a left-tailed test. A two-tailed hypothesis tests the null hypothesis, H0, that the difference in the population proportion is statistically identical to the hypothesized difference (if the hypothesized difference is set to zero, the null hypothesis tests if the population proportions of the two samples are identical). The alternative hypothesis, Ha, is that the real difference in population proportions is statistically different from the hypothesized difference when tested using the sample dataset.
[0388] A right-tailed hypothesis tests the null hypothesis, H0, that the difference in the population proportion is statistically less than or equal to the hypothesized difference (if the hypothesized difference is set to zero, the null hypothesis tests if population proportion of sample 1 is equal to or less than the population proportion of sample 2). The alternative hypothesis, Ha, is that the real difference in population proportions is statistically greater than the hypothesized difference when tested using the sample dataset.
[0389] A left-tailed hypothesis tests the null hypothesis, H0, that the difference in the population proportion is statistically greater than or equal to the hypothesized difference (if the hypothesized difference is set to zero, the null hypothesis tests if population proportion of sample 1 is equal to or greater than the population proportion of sample 2). The alternative hypothesis, Ha, is that the real difference in population proportions is statistically less than the hypothesized difference when tested using the sample dataset.
[0390] Two (Independent) Variables Testing for Variances (F-Test)
[0391] The two-variable F-test analyzes the variances from two samples (the population variance of sample 1 is tested with the population variance of sample 2 to see if they are equal) and is appropriate when the population standard deviation is not known but the sampling distribution is assumed to be approximately normal. The measurement of variation is a key issue in Six Sigma and quality control applications. In this illustration, suppose that the variation or variance around
the units produced in a manufacturing process is compared to another process to determine which process is more variable and, hence, less predictable in quality.
[0392] This F-test can typically be applied to a single hypothesis test: a two-tailed test. A two- tailed hypothesis tests the null hypothesis, H0, such that the population variance of the two variables is statistically identical. The alternative hypothesis, Ha, is that the population variances are statistically different from one another when tested using the sample dataset.
[0393] If the calculated p-value is less than or equal to the significance level in the test, then reject the null hypothesis and conclude that the true population variances of the two variables are not statistically equal to one another. Otherwise, the true population variances are statistically similar to each other.
[0394] Nonparametric Analysis
[0395] Nonparametric techniques make no assumptions about the specific shape or distribution from which the sample is drawn. This lack of assumptions makes it different from the other hypotheses tests such as ANOVA or t-tests (parametric tests) where the sample is assumed to be drawn from a population that is normally or approximately normally distributed. If normality is assumed, the power of the test is higher due to this normality restriction. However, if flexibility on distributional requirements is needed, then nonparametric techniques are superior. In general, nonparametric methodologies provide the following advantages over other parametric tests:
• Normality or approximate normality does not have to be assumed.
• Fewer assumptions about the population are required; that is, nonparametric tests do not require that the population assume any specific distribution.
• Smaller sample sizes can be analyzed.
• Samples with nominal and ordinal scales of measurement can be tested.
• Sample variances do not have to be equal, whereas equality is required in parametric tests.
However, several caveats are worthy of mention:
• Compared to parametric tests, nonparametric tests use data less efficiently.
• The power of the test is lower than that of the parametric tests.
Therefore, if all the required assumptions are satisfied, it is better to use parametric tests.
[0396] In reality, however, it may be difficult to justify these distributional assumptions, or small sample sizes may exist, requiring the need for nonparametric tests. Thus, nonparametric tests should be used when the data are nominal or ordinal, or when the data are interval or ratio but the normality assumption is not met. The following covers each of the nonparametric tests available for use in the software.
[0397] Chi-Square Goodness-of-Fit Test
The Chi-Square test for goodness of fit is used to determine whether a sample dataset could have been drawn from a population having a specified probability distribution. The probability distribution tested here is the normal distribution. The null hypothesis (Ho) tested is such that the sample is randomly drawn from the normal distribution, versus the alternate hypothesis (Ha) that the sample is not from a normal distribution. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
[0398] For the Chi-Square goodness-of-fit test, create data tables such as the one below, and select the data in the blue area (e.g., select the data from D6 to E13, or data points 800 to 4). To extend the dataset, just add more observations (rows).
[0399] Chi-Square Test of Independence
[0400] The Chi-Square test for independence examines two variables to see if there is some statistical relationship between them. This test is not used to find the exact nature of the relationship between the two variables, but to simply test if the variables could be independent of each other. The null hypothesis (Ho) tested is such that the variables are independent of each other, versus the alternate hypothesis (Ha) that the variables are not independent of each other.
[0401] The Chi-Square test looks at a table of observed frequencies and a table of expected frequencies. The amount of disparity between these two tables is calculated and compared with the Chi-Square test statistic. The observed frequencies reflect the cross-classification for members of a single sample, and the table of expected frequencies is constructed under the assumption that the null hypothesis is true.
[0402] Chi-Square Population Variance Test
[0403] The Chi-Square test for population variance is used for hypothesis testing and confidence interval estimation for a population variance. The population variance of a sample is typically unknown, and, hence, the need for quantifying this confidence interval. The population is assumed to be normally distributed.
[0404] Friedman Test
[0405] The Friedman test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This method is an extension of the Wilcoxon Signed-Rank test for paired samples. The corresponding parametric test is the Randomized Block Multiple Treatment ANOVA, but unlike the ANOVA, the Friedman test does not require that the dataset be randomly sampled from normally distributed populations with equal variances.
[0406] The Friedman test uses a two-tailed hypothesis test where the null hypothesis (H0) is such that the population medians of each treatment are statistically identical to the rest of the group. That is, there is no effect among the different treatment groups. The alternative hypothesis (Ha) is such that the real population medians are statistically different from one another when tested using the sample dataset. That is, the medians are statistically different, which means that there is a statistically significant effect among the different treatment groups. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the
alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
[0407] For the Friedman test, create data tables such as the one below, and select the data in the blue area (e.g., select the data from C22 to F32, or data points Treatment 1 to 80).
[0408] Kruskal-Wallis Test
[0409] The Kruskal-Wallis test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This method is an extension of the Wilcoxon Signed-Rank test by comparing more than two independent samples. The corresponding parametric test is the One- Way ANOVA, but unlike the ANOVA, the Kruskal-Wallis does not require that the dataset be randomly sampled from normally distributed populations with equal variances. The Kruskal- Wallis test is a two-tailed hypothesis test where the null hypothesis (H0) is such that the population medians of each treatment are statistically identical to the rest of the group. That is, there is no effect among the different treatment groups. The alternative hypothesis (Ha) is such that the real population medians are statistically different from one another when tested using the sample dataset. That is, the medians are statistically different, which means that there is a statistically significant effect among the different treatment groups. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
[0410] The benefit of the Kruskal-Wallis test is that it can be applied to ordinal, interval, and ratio data while ANOVA is only applicable for interval and ratio data. Also, the Friedman test can be run with fewer data points.
[041 1] For illustrative purposes, suppose that three different drug indications (T = 3) were developed and tested on 100 patients each (N = 100). The Kruskal-Wallis test can be applied to test if these three drugs are all equally effective statistically. If the calculated p-value is less than
or equal to the significance level used in the test, then reject the null hypothesis and conclude that there is a significant difference among the different treatments. Otherwise, the treatments are all equally effective.
[0412] For the Kruskal-Wallis test, create data tables such as the one below, and select the data in the blue area (e.g., select the data from C40 to F50, or data points Treatment 1 to 80). To extend the dataset, just add more observations (rows) or more treatment variables to compare (columns).
[0413] Lilliefors Test
[0414] The Lilliefors test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This test evaluates the null hypothesis (H0) of whether the data sample was drawn from a normally distributed population, versus an alternate hypothesis (Ha) that the data sample is not normally distributed. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis. This test relies on two cumulative frequencies: one derived from the sample dataset and one from a theoretical distribution based on the mean and standard deviation of the sample data. An alternative to this test is the Chi-Square test for normality. The Chi-Square test requires more data points to run compared to the Lilliefors test.
[0415] Runs Test
[0416] The runs test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This test evaluates the randomness of a series of observations by analyzing the number of runs it contains. A run is a consecutive appearance of one or more observations that are similar. The null hypothesis (H0) tested is whether the data sequence is random, versus the alternate hypothesis (Ha) that the data sequence is not random. If the calculated p-value is less
than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
[0417] Wilcoxon Signed-Rank Test (One Variable)
[0418] The single variable Wilcoxon Signed-Rank test is a form of nonparametric test that makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This method looks at whether a sample dataset could have been randomly drawn from a particular population whose median is being hypothesized. The corresponding parametric test is the one-sample t-test, which should be used if the underlying population is assumed to be normal, providing a higher power on the test. The Wilcoxon Signed-Rank test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test. If the calculated Wilcoxon statistic is outside the critical limits for the specific significance level in the test, reject the null hypothesis and conclude that the true population median is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized median based on the sample tested. Otherwise, the true population median is statistically similar to the hypothesized median.
[0419] Wilcoxon Signed-Rank Test (Two Variables)
[0420] The Wilcoxon Signed-Rank test for paired variables is a form of nonparametric test, which makes no assumptions about the specific shape of the population from which the sample is drawn, allowing for smaller sample datasets to be analyzed. This method looks at whether the median of the differences between the two paired variables are equal. This test is specifically formulated for testing the same or similar samples before and after an event (e.g., measurements taken before a medical treatment are compared against those measurements taken after the treatment to see if there is a difference). The corresponding parametric test is the two-sample t- test with dependent means, which should be used if the underlying population is assumed to be normal, providing a higher power on the test. The Wilcoxon Signed-Rank test can be applied to three types of hypothesis tests: a two-tailed test, a right-tailed test, and a left-tailed test.
[0421] For illustrative purposes, suppose that a new engine design is tested against an existing engine design to see if there is a statistically significant difference between the two. The paired variable Wilcoxon Signed-Rank test can be applied. If the calculated Wilcoxon statistic is outside the critical limits for the specific significance level in the test, reject the null hypothesis and conclude that the difference between the true population medians is not equal to (two-tailed test), less than (left-tailed test), or greater than (right-tailed test) the hypothesized median difference based on the sample tested. Otherwise, the true population median is statistically similar to the hypothesized median.
[0422] ANOVA (Multivariate Hypothesis Tests)
[0423] Single Factor Multiple Treatments ANOVA
[0424] The one-way ANOVA for single factor with multiple treatments test is an extension of the two-variable t-test, looking at multiple variables simultaneously. The ANOVA is appropriate when the sampling distribution is assumed to be approximately normal. ANOVA can be applied to only the two-tailed hypothesis test. A two-tailed hypothesis tests the null hypothesis (H0) such that the population means of each treatment is statistically identical to the rest of the group, which means that there is no effect among the different treatment groups. The alternative hypothesis (Ha) is such that the real population means are statistically different from one another when tested using the sample dataset.
[0425] For illustrative purposes, suppose that three different drug indications (T = 3) were developed and tested on 100 patients each (N = 100). The one-way ANOVA can be applied to test if these three drugs are all equally effective statistically. If the calculated p-value is less than or equal to the significance level used in the test, then reject the null hypothesis and conclude that there is a significant difference among the different treatments. Otherwise, the treatments are all equally effective.
[0426] Randomized Block Multiple Treatments ANOVA
[0427] The one-way randomized block ANOVA is appropriate when the sampling distribution is assumed to be approximately normal and when there is a block variable for which ANOVA will control (block the effects of this variable by controlling it in the experiment). ANOVA can be applied to only the two-tailed hypothesis test. This analysis can test for the effects of both the treatments as well as the effectiveness of the control, or block, variable.
[0428] If the calculated p-value for the treatment is less than or equal to the significance level used in the test, then reject the null hypothesis and conclude that there is a significant difference among the different treatments. If the calculated p-value for the block variable is less than or equal to the significance level used in the test, then reject the null hypothesis and conclude that there is a significant difference among the different block variables.
[0429] For illustrative purposes, suppose that three different headlamp designs (T = 3) were developed and tested on four groups of volunteer drivers grouped by their age (B = 4). The oneway randomized block ANOVA can be applied to test if these three headlamps are all equally effective statistically when tested using the volunteers' driving test grades. Otherwise, the treatments are all equally effective. This test can determine if the differences occur because of the treatment (that the type of headlamp will determine differences in driving test scores) or from the block, or controlled, variable (that age may yield different driving abilities).
[0430] Two-Way ANOVA
[0431] The two-way ANOVA is an extension of the single factor and randomized block ANOVA by simultaneously examining the effects of two factors on the dependent variable, along with the effects of interactions between the different levels of these two factors. Unlike the randomized block design, this model examines the interactions between different levels of the factors, or independent variables. In a two-factor experiment, interaction exists when the effect of a level for one factor depends on which level of the other factor is present.
[0432] There are three sets of null (Ho) and alternate (Ha) hypotheses to be tested in the two-way analysis of variance.
[0433] The first test is on the first independent variable, where the null hypothesis is that no level of the first factor has an effect on the dependent variable. The alternate hypothesis is that there is at least one level of the first factor having an effect on the dependent variable. If the calculated p- value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
[0434] The second test is on the second independent variable, where the null hypothesis is that no level of the second factor has an effect on the dependent variable. The alternate hypothesis is that there is at least one level of the second factor having an effect on the dependent variable. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
[0435] The third test is on the interaction of both the first and second independent variables, where the null hypothesis is that there are no interacting effects between levels of the first and second factors. The alternate hypothesis is that there is at least one combination of levels of the first and second factors having an effect on the dependent variable. If the calculated p-value is less than or equal to the alpha significance value, then reject the null hypothesis and accept the alternate hypothesis. Otherwise, if the p-value is higher than the alpha significance value, do not reject the null hypothesis.
[0436] According to an embodiment of the present invention the Two- Way ANOVA module, creates tables such as the one below, and select the data in the blue area (804 to 835). Users can extend the data by adding rows of factors and columns of treatments. Note that the number of replications in the table above is 2 (i.e., two rows of observations per Factor A type). Of course, users can increase the number of replications as required. The number of replications has to be consistent if users wish to extend the dataset.
[0437] Forecasting, Multiple Regression, and Econometrics [0438] ARIMA (Autoregressive Integrated Moving Average)
[0439] One powerful advanced times-series forecasting tool is the ARIMA or Auto Regressive Integrated Moving Average approach. ARIMA forecasting assembles three separate tools into a comprehensive model. The first tool segment is the autoregressive or "AR" term, which corresponds to the number of lagged value of the residual in the unconditional forecast model. In essence, the model captures the historical variation of actual data to a forecasting model and uses this variation, or residual, to create a better predicting model. The second tool segment is the integration order or the "I" term. This integration term corresponds to the number of differencing the time series to be forecasted goes through. This element accounts for any nonlinear growth rates existing in the data. The third tool segment is the moving average or "MA" term, which is essentially the moving average of lagged forecast errors. By incorporating this average of lagged forecast errors, the model, in essence, learns from its forecast errors or mistakes and corrects for them through a moving-average calculation.
[0440] Auto ARIMA (Automatic Autoregressive Integrated Moving Average)
[0441] ARIMA is an advanced modeling technique used to model and forecast time-series data (data that have a time component to them, e.g., interest rates, inflation, sales revenues, gross domestic product).
[0442] The ARIMA Auto Model selection will analyze all combinations of ARIMA (p,d,q) for the most common values of 0, 1, and 2, and reports the relevant Akaike Information Criterion (AIC) and Schwarz Criterion (SC). The lowest AIC and SC model is then chosen and run. Users can also add in exogenous variables into the model selection.
[0443] In addition, in order to forecast ARIMA models with exogenous variables, it is necessary that the exogenous variables have enough data points to cover the additional number of periods
to forecast. Finally, due to the complexity of the models, this module may take several minutes to run.
[0444] Autoregressive Integrated Moving Average, or ARIMA(p,d,q), models are the extension of the AR model that uses three components for modeling the serial correlation in the time-series data. The first component is the autoregressive (AR) term. The AR(p) model uses the p lags of the time series in the equation. An AR(p) model has the form: y(t) = a(l) y(t-l) + ... + a(p) y(t- p) + e(t). The second component is the integration (d) order term. Each integration order corresponds to differencing the time series. 1(1) means differencing the data once; 1(d) means differencing the data d times. The third component is the moving average (MA) term. The MA(q) model uses the q lags of the forecast errors to improve the forecast. An MA(q) model has the form: y(t) = e(t) + b(l) e(t-l) + ... + b(q) e(t-q). Finally, an ARMA(p,q) model has the combined form: y(t) = a(l) y(t-l) + ... + a(p) y(t-p) + e(t) + b(l) e(t-l) + ... + b(q) e(t-q).
[0445] Basic Multiple Regression
[0446] It is assumed that the user is familiar with regression analysis. Multiple Regression analysis is used to find a statistical and mathematical relationship between a single dependent variable and multiple independent variables. Regression is useful for determining the relationship as well as for forecasting.
[0447] For illustrative purposes, suppose users want to determine if sales of a product can be attributed to an advertisement in a local paper. In this case, sales revenue is the dependent variable, Y (it is dependent on size of the advertisement and how frequently is appears a week), while advertisement size and frequency are the independent variables XX and XI (they are independent of sales). Interpreting the regression analysis is more complex (this may include hypothesis t-tests, F-tests, ANOVA, correlations, autocorrelations, etc.).
[0448] Basic Econometrics and Autoeconometrics
[0449] Econometrics refers to a branch of business analytics, modeling, and forecasting techniques for modeling the behavior or forecasting certain business, financial, economic, physical science, and other variables. Running the Basic Econometrics models is similar to regular regression analysis except that the dependent and independent variables are allowed to be modified before a regression is run. The report generated is the same as shown in the Multiple Regression section previously and the interpretations are identical to those described previously
[0450] Combinatorial Fuzzy Logic
[0451] In contrast, the term fuzzy logic is derived from fuzzy set theory to deal with reasoning that is approximate rather than accurate. As opposed to crisp logic, where binary sets have binary logic, fuzzy logic variables may have a truth value that ranges between 0 and 1 and is not constrained to the two truth values of classic propositional logic. This fuzzy weighting schema is used together with a combinatorial method to yield time-series forecast results. Note that neither neural networks nor fuzzy logic techniques have yet been established as valid and reliable methods in the business forecasting domain, on either a strategic, tactical, or operational level. Much research is still required in these advanced forecasting fields. Nonetheless, PEAT's Forecast Statistics module provides the fundamentals of these two techniques for the purposes of running time-series forecasts.
[0452] GARCH Volatility Forecasts
[0453] The Generalized Autoregressive Conditional Heteroskedasticity (GARCH) Model is used to model historical and forecast future volatility levels of a marketable security (e.g., stock prices, commodity prices, oil prices, etc.). The dataset has to be a time series of raw price levels. GARCH will first convert the prices into relative returns and then run an internal optimization to fit the historical data to a mean-reverting volatility term structure, while assuming that the volatility is heteroskedastic in nature (changes over time according to some econometric characteristics).
[0454] The typical volatility forecast situation requires P = 1, Q = 1 ; Periodicity = number of periods per year (12 for monthly data, 52 for weekly data, 252 or 365 for daily data); Base = minimum of 1 and up to the periodicity value; and Forecast Periods = number of annualized volatility forecasts users wish to obtain. There are several GARCH models available in PEAT's Forecast Statistics module, including EGARCH, EGARCH-T, GARCH-M, GJR-GARCH, GJR- GARCH-T, IGARCH, and T-GARCH.
[0455] GARCH models are used mainly in analyzing financial time-series data to ascertain their conditional variances and volatilities. These volatilities are then used to value the options as usual, but the amount of historical data necessary for a good volatility estimate remains significant. Usually, several dozen— and even up to hundreds— of data points are required to obtain good GARCH estimates.
[0456] GARCH is a term that incorporates a family of models that can take on a variety of forms, known as GARCH(p,q), where p and q are positive integers that define the resulting GARCH model and its forecasts. In most cases for financial instruments, a GARCH(1,1) is sufficient and is most generally used. For instance, a GARCH (1,1) model takes the form of: yt = x + £ t
where the first equation's dependent variable (yt) is a function of exogenous variables (xt) with an error term (st). The second equation estimates the variance (squared volatility at 2) at time t, which depends on a historical mean (co); on news about volatility from the previous period, measured as a lag of the squared residual from the mean equation (SM2); and on volatility from the previous period (σ(.ι2). Suffice it to say that detailed knowledge of econometric modeling (model specification tests, structural breaks, and error estimation) is required to run a GARCH model, making it less accessible to the general analyst. Another problem with GARCH models is that the model usually does not provide a good statistical fit. That is, it is impossible to predict the stock market and, of course, equally if not harder to predict a stock's volatility over time.
[0457] J-Curve and S-Curve Forecasts
[0458] The J curve, or exponential growth curve, is one where the growth of the next period depends on the current period's level and the increase is exponential. This phenomenon means that over time, the values will increase significantly, from one period to another. This model is typically used in forecasting biological growth and chemical reactions over time.
[0459] The S curve, or logistic growth curve, starts off like a J curve, with exponential growth rates. Over time, the environment becomes saturated (e.g., market saturation, competition, overcrowding), the growth slows, and the forecast value eventually ends up at a saturation or maximum level. The S-curve model is typically used in forecasting market share or sales growth of a new product from market introduction until maturity and decline, population dynamics, growth of bacterial cultures, and other naturally occurring variables.
[0460] Markov Chains
[0461] A Markov chain exists when the probability of a future state depends on a previous state and when linked together forms a chain that reverts to a long-run steady state level. This Markov approach is typically used to forecast the market share of two competitors. The required inputs are the starting probability of a customer in the first store (the first state) returning to the same store in the next period versus the probability of switching to a competitor's store in the next state.
[0462] Neural Network Forecasting
[0463] The term Neural Network is often used to refer to a network or circuit of biological neurons, while modern usage of the term often refers to artificial neural networks comprising artificial neurons, or nodes, recreated in a software environment. Such networks attempt to mimic the neurons in the human brain in ways of thinking and identifying patterns and, in our situation, identifying patterns for the purposes of forecasting time-series data. Note that the number of hidden layers in the network is an input parameter and will need to be calibrated with user data. Typically, the more complicated the data pattern, the higher the number of hidden layers users would need and the longer it would take to compute. It is recommended that users
start at 3 layers. The testing period is simply the number of data points used in the final calibration of the Neural Network model, and it is recommended that at least the same number of periods users wish to forecast as the testing period be used.
[0464] Nonlinear Extrapolation
[0465] Extrapolation involves making statistical forecasts by using historical trends that are projected for a specified period of time into the future. It is only used for time-series forecasts. For cross-sectional or mixed panel data (time-series with cross-sectional data), multivariate regression is more appropriate. This methodology is useful when major changes are not expected; that is, causal factors are expected to remain constant or when the causal factors of a situation are not clearly understood. It also helps discourage the introduction of personal biases into the process. Extrapolation is fairly reliable, relatively simple, and inexpensive. However, extrapolation, which assumes that recent and historical trends will continue, produces large forecast errors if discontinuities occur within the projected time period; that is, pure extrapolation of time series assumes that all we need to know is contained in the historical values of the series being forecasted. If we assume that past behavior is a good predictor of future behavior, extrapolation is appealing. This makes it a useful approach when all that is needed are many short-term forecasts.
[0466] This methodology estimates the /( c) function for any arbitrary x value, by interpolating a smooth nonlinear curve through all the x values and, using this smooth curve, extrapolates future x values beyond the historical dataset. The methodology employs either the polynomial functional form or the rational functional form (a ratio of two polynomials). Typically, a polynomial functional form is sufficient for well-behaved data; however, rational functional forms are sometimes more accurate (especially with polar functions, i.e., functions with denominators approaching zero).
[0467] Principal Components Analysis
[0468] Principal Components Analysis is a way of identifying patterns in data and recasting the data in such a way as to highlight their similarities and differences. Patterns of data are very difficult to find in high dimensions when multiple variables exist, and higher dimensional graphs are very difficult to represent and interpret. Once the patterns in the data are found, they can be compressed, resulting in a reduction of the number of dimensions. This reduction of data dimensions does not mean much loss of information. Instead, similar levels of information can now be obtained by fewer variables.
[0469] The analysis provides the Eigenvalues and Eigenvectors of the dataset. The Eigenvector with the highest Eigenvalue is the principle component of the dataset. Ranking the Eigenvalues from highest to lowest provides the components in order of statistical significance. If the Eigenvalues are small, users do not lose much information. It is up to users to decide how many components to ignore based on their Eigenvalues. The proportions and cumulative proportions tell users how much of the variation in the dataset can be explained by incorporating that component. Finally, the data is then transformed to account for only the number of components users decide to keep.
[0470] Spline (Cubic Spline Interpolation and Extrapolation)
[0471] Sometimes there are missing values in a time-series dataset. As an example, interest rates for years 1 to 3 may exist, followed by years 5 to 8, and then year 10. Spline curves can be used to interpolate the missing years' interest rate values based on the data that exist. Spline curves can also be used to forecast or extrapolate values of future time periods beyond the time period of available data. The data can be linear or nonlinear. The Known X values represent the values on the x-axis of a chart (as an example, this is Years of the known interest rates, and, usually, the x-axis are the values that are known in advance such as time or years) and the Known Y values represent the values on the y-axis (in our case, the known Interest Rates). The y-axis variable is typically the variable users wish to interpolate missing values from or extrapolate the values into the future.
[0472] Stepwise Regression
[0473] One powerful automated approach to regression analysis is Stepwise Regression. Based on its namesake, the regression process proceeds in multiple steps. There are several ways to set up these stepwise algorithms, including the correlation approach, forward method, backward method, and the forward and backward method.
[0474] In the correlation method, the dependent variable (Y) is correlated to all the independent variables (X), and a regression is run, starting with the X variable with the highest absolute correlation value. Then subsequent X variables are added until the p-values indicate that the new X variable is no longer statistically significant. This approach is quick and simple but does not account for interactions among variables, and an X variable, when added, will statistically overshadow other variables.
[0475] In the forward method, first 7 is correlated with all X variables, a regression for 7 is run on the highest absolute value correlation of X, and the fitting errors are obtained. Then, these errors are correlated with the remaining X variables and the highest absolute value correlation among this remaining set is chosen and another regression is run. The process is repeated until the p-value for the latest X variable coefficient is no longer statistically significant then the process is stopped.
[0476] In the backward method, a regression with Y is run on all X variables and, reviewing each variable's p-value, the variable with the largest p-value is systematically eliminated. Then a regression is run again, repeating each time until all p-values are statistically significant.
[0477] In the forward and backward method, the forward method is applied to obtain three X variables, and then the backward approach is applied to see if one of them needs to be eliminated because it is statistically insignificant. The forward method is repeated, and then the backward method until all remaining variables are considered.
[0478] The Stepwise Regression is an automatic search process iterating through all the independent variables, and it models the variables that are statistically significant in explaining
the variations in the dependent variable. Stepwise Regression is powerful when there are many independent variables and a large combination of models can be built. To illustrate, suppose users want to determine if sales of a product can be attributed to an advertisement in a local paper. In this case, sales revenue is the dependent variable Y, while the independent variables X\ to X5 are the size of the advertisement, cost of the ad, number of readers, day of the week, and how frequently it appears a week. Stepwise Regression will automatically iterate through these X variables to find those that are statistically significant in the regression model. Interpreting the regression analysis is more complex (this may include hypothesis t-tests, F-tests, ANOVA, correlations, autocorrelations, etc.).
[0479] Forecasting with Time-Series Decomposition
[0480] Forecasting is the act of predicting the future whether it is based on historical data or speculation about the future when no history exists. When historical data exists, a quantitative or statistical approach is best, but if no historical data exist, then a qualitative or judgmental approach is usually the only recourse. There are eight common time-series models, segregated by seasonality and trend. For instance, if the data variable has no trend or seasonality, then a single moving-average model or a single exponential-smoothing model would suffice. However, if seasonality exists but no discernible trend is present, either a seasonal additive or seasonal multiplicative model would be better, and so forth.
[0481] The best-fitting test for the moving average forecast uses the Root Mean Squared Errors (RMSE). The RMSE calculates the square root of the average squared deviations of the fitted values versus the actual data points.
[0482] Mean Squared Error (MSE) is an absolute error measure that squares the errors (the difference between the actual historical data and the forecast-fitted data predicted by the model) to keep the positive and negative errors from canceling each other out. This measure also tends to exaggerate large errors by weighting the large errors more heavily than smaller errors by squaring them, which can help when comparing different time-series models. Root Mean Square Error (RMSE) is the square root of MSE and is the most popular error measure, also known as
the quadratic loss function. RMSE can be defined as the average of the absolute values of the forecast errors and is highly appropriate when the cost of the forecast errors is proportional to the absolute size of the forecast error. The RMSE is used as the selection criteria for the best-fitting time-series model. Mean Absolute Deviation (MAD) is an error statistic that averages the distance (absolute value of the difference between the actual historical data and the forecast- fitted data predicted by the model) between each pair of actual and fitted forecast data points and is most appropriate when the cost of forecast errors is proportional to the absolute size of the forecast errors.
[0483] Mean Absolute Percentage Error (MAPE) is a relative error statistic measured as an average percent error of the historical data points and is most appropriate when the cost of the forecast error is more closely related to the percentage error than the numerical size of the error.
[0484] Finally, an associated measure is the Theil's U statistic, which measures the naivety of the model's forecast. That is, if the Theil's U statistic is less than 1.0, then the forecast method used provides an estimate that is statistically better than guessing.
[0485] Single Moving Average
[0486] The single moving average is applicable when time-series data with no trend and seasonality exist. This model is not appropriate when used to predict cross-sectional data. The single moving average simply uses an average of the actual historical data to project future outcomes. This average is applied consistently moving forward, hence the term moving average. The value of the moving average for a specific length is simply the summation of actual historical data arranged and indexed in a time sequence. The software finds the optimal moving average lag automatically through an optimization process that minimizes the forecast errors.
[0487] Single Exponential Smoothing
[0488] The single exponential smoothing approach is used when no discernible trend or seasonality exists in the time-series data. This model is not appropriate when used to predict cross-sectional data. This method weights past data with exponentially decreasing weights going
into the past; that is, the more recent the data value, the greater its weight. This weighting largely overcomes the limitations of moving averages or percentage-change models. The weight used is termed the alpha measure. The software finds the optimal alpha parameter automatically through an optimization process that minimizes the forecast errors.
[0489] Double Moving Average
[0490] The double moving average method will smooth out past data by performing a moving average on a subset of data that represents a moving average of an original set of data. That is, a second moving average is performed on the first moving average. The second moving average application captures the trending effect of the data. The results are then weighted and forecasts are created. The software finds the optimal moving average lag automatically through an optimization process that minimizes the forecast errors.
[0491] Double Exponential Smoothing
[0492] The double exponential smoothing method is used when the data exhibit a trend but no seasonality. This model is not appropriate when used to predict cross-sectional data. Double exponential smoothing applies single exponential smoothing twice, once to the original data and then to the resulting single exponential smoothing data. An alpha weighting parameter is used on the first or single exponential smoothing (SES), while a beta weighting parameter is used on the second or double exponential smoothing (DES). This approach is useful when the historical data series is not stationary. The software finds the optimal alpha and beta parameters automatically through an optimization process that minimizes the forecast errors.
[0493] Seasonal Additive
[0494] If the time-series data has no appreciable trend but exhibits seasonality, then the additive seasonality and multiplicative seasonality methods apply. The additive seasonality model breaks the historical data into a level (L), or base-case, component as measured by the alpha parameter, and a seasonality (S) component measured by the gamma parameter. The resulting forecast value
is simply the addition of this base-case level to the seasonality value. The software finds the optimal alpha and gamma parameters automatically through an optimization process that minimizes the forecast errors.
[0495] Seasonal Multiplicative
[0496] If the time-series data has no appreciable trend but exhibits seasonality, then the additive seasonality and multiplicative seasonality methods apply. The multiplicative seasonality model breaks the historical data into a level (L), or base-case, component as measured by the alpha parameter, and a seasonality (S) component measured by the gamma parameter. The resulting forecast value is simply the multiplication of this base-case level by the seasonality value. The software finds the optimal alpha and gamma parameters automatically through an optimization process that minimizes the forecast errors.
[0497] Holt-Winter's Seasonal Additive
[0498] When both seasonality and trend exist, more advanced models are required to decompose the data into their base elements: a base-case level (L) weighted by the alpha parameter; a trend component (b) weighted by the beta parameter; and a seasonality component (S) weighted by the gamma parameter. Several methods exist, but the two most common are the Holt-Winter's additive seasonality and Holt-Winter's multiplicative seasonality methods. In the Holt-Winter's additive model, the base-case level, seasonality, and trend are added together to obtain the forecast fit.
[0499] Holt-Winter's Seasonal Multiplicative
[0500] When both seasonality and trend exist, more advanced models are required to decompose the data into their base elements: a base-case level ( ) weighted by the alpha parameter; a trend component (b) weighted by the beta parameter; and a seasonality component (S) weighted by the gamma parameter. Several methods exist, but the two most common are the Holt-Winter's additive seasonality and Holt-Winter's multiplicative seasonality methods. In the Holt-Winter's
multiplicative model, the base-case level and trend are added together and multiplied by the seasonality factor to obtain the forecast fit.
[0501] Trendlines
[0502] Trendlines can be used to determine if a set of time-series data follows any appreciable trend. Trends can be linear or nonlinear (such as exponential, logarithmic, moving average, polynomial, or power). In forecasting models, the process usually includes removing the effects of accumulating datasets from seasonality and trend to show only the absolute changes in values and to allow potential cyclical patterns to be identified after removing the general drift, tendency, twists, bends, and effects of seasonal cycles of a set of time-series data. For example, a detrended dataset may be necessary to see a more accurate account of a company's sales in a given year by shifting the entire dataset from a slope to a flat surface to better expose the underlying cycles and fluctuations.
[0503] Volatility: Log Returns Approach
[0504] There are several ways to estimate the volatility used in forecasting and option valuation models. The most common approach is the Logarithmic Returns Approach. This method is used mainly for computing the volatility on liquid and tradable assets, such as stocks in financial options. However, sometimes it is used for other traded assets, such as the price of oil or electricity. This method cannot be used when negative cash flows or prices occur, which means it is used only on positive data, making it most appropriate for computing the volatility of traded assets. The approach is simply to take the annualized standard deviation of the logarithmic relative returns of the time-series data as the proxy for volatility.
[0505] Yield Curves: Bliss and Nelson-Siegel Methods
[0506] The Bliss interpolation model is used for generating the term structure of interest rates and yield curve estimation. Econometric modeling techniques are required to calibrate the values of several input parameters in this model. The Bliss approach modifies the Nelson-Siegel method
by adding an additional generalized parameter. Virtually any yield curve shape can be interpolated using these two models, which are widely used at banks around the world. In contrast, the Nelson-Siegel model is run with four curve estimation parameters. If properly modeled, it can be made to fit almost any yield curve shape. Calibrating the inputs in these models requires facility with econometric modeling and error optimization techniques. Typically, if some interest rates exist, a better approach is to use a spline interpolation method such as cubic spline and so forth.
[0507] Forecasting with Stochastic Processes
[0508] The Basics of Forecasting with Stochastic Processes
[0509] A stochastic process is nothing but a mathematically defined equation that can create a series of outcomes over time, outcomes that are not deterministic in nature. That is, it does not follow any simple discernible rule such as price will increase X percent every year or revenues will increase by this factor of X plus Y percent. A stochastic process is, by definition, nondeterministic, and one can plug numbers into a stochastic process equation and obtain different results every time. For instance, the path of a stock price is stochastic in nature, and one cannot reliably predict the stock price path with any certainty. However, the price evolution over time is enveloped in a process that generates these prices. The process is fixed and predetermined, but the outcomes are not. Hence, by stochastic simulation, we create multiple pathways of prices, obtain a statistical sampling of these simulations, and make inferences on the potential pathways that the actual price may undertake given the nature and parameters of the stochastic process used to generate the time series.
[0510] Analytical Models
[0511] Autocorrelation
[0512] Autocorrelation can be defined as the correlation of a dataset to itself in the past. It is the correlation between observations of a time series separated by specified time units. Certain time-
series data follow an autocorrelated series as future outcomes rely heavily on past outcomes (e.g., revenues or sales that follow a weekly, monthly, quarterly, or annual seasonal cycle; inflation and interest rates that follow some economic or business cycle, etc.). The term autocorrelation describes a relationship or correlation between values of the same data series at different time periods. The term lag defines the offset when comparing a data series with itself. For autocorrelation, lag refers to the offset of data that users choose when correlating a data series with itself. In PEAT's Forecast Statistics module, the autocorrelation function is calculated, together with the Q-statistic and relevant p-values. If the p-values are below the tested significance level, then the null hypothesis (H0) of no autocorrelation is rejected, and it is concluded that there is autocorrelation with that particular lag.
[0513] Control Charts
[0514] Sometimes the specification limits are not set; instead, statistical control limits are computed based on the actual data collected (e.g., the number of defects in a manufacturing line). The upper control limit (UCL) and lower control limit (LCL) are computed, as are the central line (CL) and other sigma levels. The resulting chart is called a control chart, and if the process is out of control, the actual defect line will be outside of the UCL and LCL lines. Typically, when the LCL is a negative value, we set the floor as zero. In the interpretation of a control chart, by adding in the ±1 and 2 sigma lines, we can divide the control charts into several areas or zones. The following are rules of thumb that typically apply to control charts to determine if the process is out of control:
• If one point is beyond Area A
• If two out of three consecutive points are in Area A or beyond
• If four out of five consecutive points are in Area B or beyond
• If eight consecutive points are in Area C or beyond
Additionally, a potential structural shift can be detected if any one of the following occurs:
• At least 10 out of 11 sequential points are on one side of the CL
• At least 12 out of 14 sequential points are on one side of the CL
• At least 14 out of 17 sequential points are on one side of the CL
• At least 16 out of 20 sequential points are on one side of the CL
[0515] X-Bar Chart
[0516] An X-Bar Chart is used when the variable has raw data values and there are multiple measurements in a sample experiment, multiple experiments are run, and the average of the collected data is of interest.
[0517] R-Bar Chart
[0518] An R-Bar Chart is used when the variable has raw data values and there are multiple measurements in a sample experiment, multiple experiments are run, and the range of the collected data is of interest.
[0519] XMR Chart
An XMR Chart is used when the variable has raw data values and is a single measurement taken in each sample experiment, multiple experiments are run, and the actual value of the collected data is of interest.
[0520] P Chart
[0521] A P Chart is used when the variable of interest is an attribute (e.g., defective or nondefective) and the data collected are in proportions of defects (or number of defects in a specific sample), there are multiple measurements in a sample experiment, multiple experiments are run with differing numbers of samples collected in each, and the average proportion of defects of the collected data is of interest.
[0522] NP Chart
An NP Chart is used when the variable of interest is an attribute (e.g., defective or nondefective) and the data collected are in proportions of defects (or number of defects in a specific sample),
there are multiple measurements in a sample experiment, multiple experiments are run with a constant number of samples in each, and the average proportion of defects of the collected data is of interest.
[0523] C Chart
[0524] A C Chart is used when the variable of interest is an attribute (e.g., defective or nondefective) and the data collected are in total number of defects (actual count in units), there are multiple measurements in a sample experiment, multiple experiments are run with the same number of samples collected in each, and the average number of defects of the collected data is of interest.
[0525] U Chart
[0526] A U Chart is used when the variable of interest is an attribute (e.g., defective or nondefective) and the data collected are in total number of defects (actual count in units), there are multiple measurements in a sample experiment, multiple experiments are run with differing numbers of samples collected in each, and the average number of defects of the collected data is of interest.
[0527] Deseasonalization
[0528] The data deseasonalization method removes any seasonal components in the original data. In forecasting models, the process usually includes removing the effects of accumulating datasets from seasonality and trend to show only the absolute changes in values and to allow potential cyclical patterns to be identified after removing the general drift, tendency, twists, bends, and effects of seasonal cycles of a set of time-series data. Many time-series data exhibit seasonality where certain events repeat themselves after some time period or seasonality period (e.g., ski resorts' revenues are higher in winter than in summer, and this predictable cycle will repeat itself every winter). Seasonality periods represent how many periods would have to pass before the cycle repeats itself (e.g., 24 hours in a day, 12 months in a year, 4 quarters in a year,
60 minutes in an hour, etc.). For deseasonalized and detrended data, a seasonal index greater than 1 indicates a high period or peak within the seasonal cycle, and a value below 1 indicates a dip in the cycle.
[0529] Distributional Fitting
[0530] Another powerful simulation tool is distributional fitting or determining which distribution to use for a particular input variable in a model and what the relevant distributional parameters are. If no historical data exist, then the analyst must make assumptions about the variables in question. One approach is to use the Delphi method where a group of experts is tasked with estimating the behavior of each variable. For instance, a group of mechanical engineers can be tasked with evaluating the extreme possibilities of a spring coil's diameter through rigorous experimentation or guesstimates. These values can be used as the variable's input parameters (e.g., uniform distribution with extreme values between 0.5 and 1.2). When testing is not possible (e.g., market share and revenue growth rate), management can still make estimates of potential outcomes and provide the best-case, most-likely case, and worst-case scenarios. However, if reliable historical data are available, distributional fitting can be accomplished. Assuming that historical patterns hold and that history tends to repeat itself, then historical data can be used to find the best-fitting distribution with their relevant parameters to better define the variables to be simulated.
[0531] Heteroskedasticity
[0532] A common violation in regression, econometric modeling, and some time-series forecast methods is heteroskedasticity. Heteroskedasticity is defined as the variance of the forecast errors increasing over time. If pictured graphically, the width of the vertical data fluctuations increases or fans out over time. As an example, the data points have been changed to exaggerate the effect. However, in most time-series analysis, checking for heteroskedasticity is a much more difficult task. The coefficient of determination, or R-squared, in a multiple regression analysis drops significantly when heteroskedasticity exists. As is, the current regression model is insufficient and incomplete.
[0533] If the variance of the dependent variable is not constant, then the error's variance will not be constant. The most common form of such heteroskedasticity in the dependent variable is that the variance of the dependent variable may increase as the mean of the dependent variable increases for data with positive independent and dependent variables.
[0534] Unless the heteroskedasticity of the dependent variable is pronounced, its effect will not be severe: the least-squares estimates will still be unbiased, and the estimates of the slope and intercept will either be normally distributed if the errors are normally distributed, or at least normally distributed asymptotically (as the number of data points becomes large) if the errors are not normally distributed. The estimate for the variance of the slope and overall variance will be inaccurate, but the inaccuracy is not likely to be substantial if the independent- variable values are symmetric about their mean.
[0535] Heteroskedasticity of the dependent variable is usually detected informally by examining the X-Y scatter plot of the data before performing the regression. If both nonlinearity and unequal variances are present, employing a transformation of the dependent variable may have the effect of simultaneously improving the linearity and promoting equality of the variances. Otherwise, a weighted least-squares linear regression may be the preferred method of dealing with nonconstant variance of the dependent variable.
[0536] Maximum Likelihood Models on Logit, Probit, and Tobit
[0537] Limited Dependent Variables describe the situation where the dependent variable contains data that are limited in scope and range, such as binary responses (0 or 1) and truncated, ordered, or censored data. For instance, given a set of independent variables (e.g., age, income, education level of credit card debt, or mortgage loan holders), we can model the probability of default using maximum likelihood estimation (MLE). The response or dependent variable Y is binary, that is, it can have only two possible outcomes that we denote as 1 and 0 (e.g., 7 may represent presence/absence of a certain condition, defaulted/not defaulted on previous loans, success/failure of some device, answer yes/no on a survey, etc.), and we also have a vector of
independent variable regressors X, which are assumed to influence the outcome Y. A typical ordinary least squares regression approach is invalid because the regression errors are heteroskedastic and non-normal, and the resulting estimated probability estimates will return nonsensical values of above 1 or below 0. MLE analysis handles these problems using an iterative optimization routine to maximize a log likelihood function when the dependent variables are limited.
[0538] A Logit or Logistic regression is used for predicting the probability of occurrence of an event by fitting data to a logistic curve. It is a generalized linear model used for binomial regression, and like many forms of regression analysis, it makes use of several predictor variables that may be either numerical or categorical. MLE applied in a binary multivariate logistic analysis is used to model dependent variables to determine the expected probability of success of belonging to a certain group. The estimated coefficients for the Logit model are the logarithmic odds ratios and cannot be interpreted directly as probabilities. A quick computation is first required and the approach is simple.
[0539] Specifically, the Logit model is specified as Estimated Y = LN[iV(l-i¾] or, conversely, Pi = EXP(Estimated Y)/(l+EXP(Estimated Y)), and the coefficients β, are the log odds ratios. So, taking the antilog, or ΕΧΡ(βζ), we obtain the odds ratio of (1-Ρζ). This means that with an increase in a unit of βζ, the log odds ratio increases by this amount. Finally, the rate of change in the probability is dPIdX = iPl{l-Pl). The Standard Error measures how accurate the predicted Coefficients are, and the t-Statistics are the ratios of each predicted Coefficient to its Standard Error and are used in the typical regression hypothesis test of the significance of each estimated parameter. To estimate the probability of success of belonging to a certain group (e.g., predicting if a smoker will develop chest complications given the amount smoked per year), simply compute the Estimated Y value using the MLE coefficients. For example, if the model is Y = 1.1 + 0.005 (Cigarettes), then someone smoking 100 packs per year has an Estimated Y of 1.1 + 0.005(100) = 1.6. Next, compute the inverse antilog of the odds ratio: EXP(Estimated Y)/[l + EXP(Estimated Y)] = EXP(1.6)/(1+ EXP(1.6)) = 0.8320. So, such a person has an 83.20% chance of developing some chest complications in his or her lifetime.
[0540] A Probit model (sometimes also known as a Normit model) is a popular alternative specification for a binary response model, which employs a Probit function estimated using maximum likelihood estimation and called Probit regression. The Probit and Logistic regression models tend to produce very similar predictions where the parameter estimates in a logistic regression tend to be 1.6 to 1.8 times higher than they are in a corresponding Probit model. The choice of using a Probit or Logit is entirely up to convenience, and the main distinction is that the logistic distribution has a higher kurtosis (fatter tails) to account for extreme values. For example, suppose that house ownership is the decision to be modeled, and this response variable is binary (home purchase or no home purchase) and depends on a series of independent variables Xi such as income, age, and so forth, such that It = β0 + βι ; +...+ β„ „, where the larger the value of Ii, the higher the probability of home ownership. For each family, a critical I* threshold exists, where if exceeded, the house is purchased— otherwise, no home is purchased— and the outcome probability (P) is assumed to be normally distributed such that Pj = CDF(7) using a standard normal cumulative distribution function (CDF). Therefore, use the estimated coefficients exactly like those of a regression model and using the Estimated Y value, apply a standard normal distribution (users can use Microsoft Excel' s NORMSDIST function or PEAT's Distributional Analysis tool by selecting Normal distribution and setting the mean to be 0 and standard deviation to be 1). Finally, to obtain a Probit or probability unit measure, set It + 5 (this is because whenever the probability Pt < 0.5, the estimated It is negative, due to the fact that the normal distribution is symmetrical around a mean of zero).
[0541] The Tobit model (Censored Tobit) is an econometric and biometric modeling method used to describe the relationship between a non-negative dependent variable Yt and one or more independent variables Xi. In a Tobit model, is the dependent variable is censored; that is, the dependent variable is censored because values below zero are not observed. The Tobit model assumes that there is a latent unobservable variable Y*. This variable is linearly dependent on the Xi variables via a vector of βζ coefficients that determine their interrelationships. In addition, there is a normally distributed error term, U,, to capture random influences on this relationship. The observable variable Yi is defined to be equal to the latent variables whenever the latent variables are above zero, and Yi is assumed to be zero otherwise. That is, Yi = Y* if Y* > 0 and Yi = 0 if Y* = 0. If the relationship parameter βζ is estimated by using ordinary least squares
regression of the observed Yj on X the resulting regression estimators are inconsistent and yield downward-biased slope coefficients and an upward-biased intercept. Only MLE would be consistent for a Tobit model. In the Tobit model, there is an ancillary statistic called sigma, which is equivalent to the standard error of estimate in a standard ordinary least squares regression, and the estimated coefficients are used the same way as in a regression analysis.
[0542] Multicollinearity
[0543] Multicollinearity exists when there is a linear relationship between the independent variables in a regression analysis. When this occurs, the regression equation cannot be estimated at all. In near-collinearity situations, the estimated regression equation will be biased and provide inaccurate results. This situation is especially true when a stepwise regression approach is used, where the statistically significant independent variables will be thrown out of the regression mix earlier than expected, resulting in a regression equation that is neither efficient nor accurate.
[0544] Partial Autocorrelation
[0545] Autocorrelation can be defined as the correlation of a dataset to itself in the past. It is the correlation between observations of a time series separated by specified time units. Certain time- series data follow an autocorrelated series as future outcomes rely heavily on past outcomes (e.g., revenues or sales that follow a weekly, monthly, quarterly, or annual seasonal cycle; inflation and interest rates that follow some economic or business cycle, etc.). Partial Autocorrelations (PAC), in contrast, are used to measure the degree of association between each data point at a particular time Yt and a time lag Yt-k when the cumulative effects of all other time lags (1 , 2, 3, k-X) have been removed. The term lag defines the offset when comparing a data series with itself. In this module, the Partial Autocorrelation function is calculated, together with the Q-statistic and relevant p-values. If the p-values are below the tested significance level, then the null hypothesis (H0) of no autocorrelation is rejected and it is concluded that there is autocorrelation that that particular lag.
[0546] Segmentation Clustering
[0547] Segmentation clustering takes the original dataset and runs some internal algorithms (a combination or k-means hierarchical clustering and other method of moments in order to find the best-fitting groups or natural statistical clusters) to statistically divide, or segment, the original dataset into multiple groups. This technique is valuable in a variety of settings including marketing (such as market segmentation of customers into various customer relationship management groups), physical sciences, engineering, and others.
[0548] Seasonality Test
[0549] Many time-series data exhibit seasonality where certain events repeat themselves after some time period or seasonality period (e.g., ski resorts' revenues are higher in winter than in summer, and this predictable cycle will repeat itself every winter). Seasonality periods represent how many periods would have to pass before the cycle repeats itself (e.g., 24 hours in a day, 12 months in a year, 4 quarters in a year, 60 minutes in an hour, etc.). For deseasonalized and detrended data, a seasonal index greater than 1 indicates a high period or peak within the seasonal cycle, and a value below 1 indicates a dip in the cycle. Users enter in the maximum seasonality period to test. That is, if users enter 6, the tool will test the following seasonality periods: 1, 2, 3, 4, 5, and 6. Period 1, of course, implies no seasonality in the data. Users can review the report generated for more details on the methodology, application, and resulting charts and seasonality test results. The best seasonality periodicity is listed first (ranked by the lowest RMSE error measure), and all the relevant error measurements are included for comparison: root mean squared error (RMSE), mean squared error (MSE), mean absolute deviation (MAD), and mean absolute percentage error (MAPE).
[0550] Structural Break
[0551] Structural break analysis tests whether the coefficients in different datasets are equal, and this test is most commonly used in time-series analysis to test for the presence of a structural break. A time-series dataset can be divided into two subsets. Structural break analysis is used to test each subset individually and on one another and on the entire dataset to statistically
determine if, indeed, there is a break starting at a particular time period. The structural break test is often used to determine whether the independent variables have different impacts on different subgroups of the population, such as to test if a new marketing campaign, activity, major event, acquisition, divestiture, and so forth have an impact on the time-series data. Suppose, for example, a dataset has 100 time-series data points. Users can set various breakpoints to test, for instance, data points 10, 30, and 51. (This means that three structural break tests will be performed: data points 1-9 compared with 10-100; data points 1-29 compared with 30-100; and 1-50 compared with 51-100 to see if there is a break in the underlying structure at the start of data points 10, 30, and 51.). A one-tailed hypothesis test is performed on the null hypothesis (H0) such that the two data subsets are statistically similar to one another, that is, there is no statistically significant structural break. The alternative hypothesis (Ha) is that the two data subsets are statistically different from one another, indicating a possible structural break. If the calculated p-values are less than or equal to 0.01, 0.05, or 0.10, then the hypothesis is rejected, which implies that the two data subsets are statistically significantly different at the 1%, 5%, and 10% significance levels. High p-values indicate that there is no statistically significant structural break.
[0552] APPENDIX: PORTFOLIO OPTIMIZATION
[0553] According to an embodiment of present invention, in the Portfolio Optimization section, the individual Options can be modeled as a portfolio and optimized to determine the best combination of projects for the portfolio. In today's competitive global economy, companies are faced with many difficult decisions. These decisions include allocating financial resources, building or expanding facilities, managing inventories, and determining product-mix strategies. Such decisions might involve thousands or millions of potential alternatives. Considering and evaluating each of them would be impractical or even impossible. A model can provide valuable assistance in incorporating relevant variables when analyzing decisions and in finding the best solutions for making decisions. Models capture the most important features of a problem and present them in a form that is easy to interpret. Models often provide insights that intuition alone cannot. An optimization model has three major elements: decision variables, constraints, and an objective. In short, the optimization methodology finds the best combination or permutation of
decision variables (e.g., which products to sell and which projects to execute) in every conceivable way such that the objective is maximized (e.g., revenues and net income) or minimized (e.g., risk and costs) while still satisfying the constraints (e.g., budget and resources).
[0554] Optimization Settings
[0555] According to an embodiment of the present invention, the Options can be modeled as a portfolio and optimized to determine the best combination of projects for the portfolio in the Optimization Settings tab. Users select the decision variable type of Discrete Binary (chooses which Options to execute with a Go/No-Go binary 1/0 decision) or Continuous Budget Allocation (returns % of budget to allocate to each Option as long as the total portfolio is 100%); select the Objective (e.g., Max NPV, Min Risk, etc.); set up any Constraints (e.g., budget restrictions, number of projects restrictions, or create customized restrictions); select the Options to optimize/allocate/choose (default selection is all Options); and when completed, click Run Optimization. The software will then take users to the Optimization Results (FIG. 34).
[0556] Decision Variables
[0557] Decision variables are quantities over which users have control; for example, the amount of a product to make, the number of dollars to allocate among different investments, or which projects to select from among a limited set. As an example, portfolio optimization analysis includes a go or no-go decision on particular projects. In addition, the dollar or percentage budget allocation across multiple projects also can be structured as decision variables.
[0558] Constraints
[0559] Constraints describe relationships among decision variables that restrict the values of the decision variables. For example, a constraint might ensure that the total amount of money allocated among various investments cannot exceed a specified amount or, at most, one project from a certain group can be selected; budget constraints; timing restrictions; minimum returns; or risk tolerance levels.
[0560] Objective
[0561] According to an embodiment of the present invention, Objectives give a mathematical representation of the model's desired outcome, such as maximizing profit or minimizing cost, in terms of the decision variables. In financial analysis, for example, the objective may be to maximize returns while minimizing risks (maximizing the Sharpe's ratio or returns-to-risk ratio).
[0562] Optimization Results
[0563] According to an embodiment of the present invention, the Optimization Results tab returns the results from the portfolio optimization analysis. The main results are provided in the data grid (lower left corner), showing the final Objective function result, final Constraints, and the allocation, selection, or optimization across all individual Options within this optimized portfolio. The top left portion of the screen (FIG. 34) shows the textual details of the optimization algorithms applied, and the chart illustrates the final objective function (the chart will only show a single point for regular optimizations, whereas it will return an investment efficient frontier curve if the optional Efficient Frontier settings are set [min, max, step size] in the Optimization Settings tab).
[0564] Advanced Custom Optimization
[0565] According to an embodiment of the present invention, in the Advanced Custom Optimization tab (FIG. 35-38), users can create and solve their own optimization models. Knowledge of optimization modeling is required to set up models but users can click on Load Example and select a sample model to run. Users can use these sample models to learn how the Optimization routines can be set up. Clicking Run when done will execute the optimization routines and algorithms. The calculated results and charts will be presented on completion.
[0566] According to an embodiment of the present invention, when setting up an optimization model, it is recommended that the user go from one tab to another, starting with the Method
(static, dynamic, or stochastic optimization); setting up the Decision Variables, Constraints, and Statistics (applicable only if simulation inputs have first been set up, and if dynamic or stochastic optimization is run); and setting the Objective function.
[0567] Method: Static Optimization
[0568] According to an embodiment of the present invention, in regard to the optimization, PEAT's Advanced Custom Optimization can be used to run a Static Optimization, that is, an optimization that is run on a static model, where no simulations are run. In other words, all the inputs in the model are static and unchanging. This optimization type is applicable when the model is assumed to be known and no uncertainties exist. Also, a discrete optimization can be first run to determine the optimal portfolio and its corresponding optimal allocation of decision variables before more advanced optimization procedures are applied. For instance, before running a stochastic optimization problem, a discrete optimization is first run to determine if there exist solutions to the optimization problem before a more protracted analysis is performed.
[0569] Method: Dynamic Optimization
[0570] According to an embodiment of the present invention, Dynamic Optimization is applied when Monte Carlo simulation is used together with optimization. Another name for such a procedure is Simulation-Optimization. That is, a simulation is first run, then the results of the simulation are applied back into the model, and then an optimization is applied to the simulated values. In other words, a simulation is run for N trials, and then an optimization process is run for M iterations until the optimal results are obtained or an infeasible set is found. Thus, using PEAT's optimization module, users can choose which forecast and assumption statistics to use and replace in the model after the simulation is run. Then, these forecast statistics can be applied in the optimization process. This approach is useful when users have a large model with many interacting assumptions and forecasts, and when some of the forecast statistics are required in the optimization. For example, if the standard deviation of an assumption or forecast is required in the optimization model (e.g., computing the Sharpe ratio in asset allocation and optimization
problems where the mean is divided by standard deviation of the portfolio), then this approach should be used.
[0571] Method: Stochastic Optimization
[0572] The Stochastic Optimization process, in contrast, is similar to the dynamic optimization procedure with the exception that the entire dynamic optimization process is repeated T times. That is, a simulation with N trials is run, and then an optimization is run with M iterations to obtain the optimal results. Then the process is replicated T times. The results will be a forecast chart of each decision variable with rvalues. In other words, a simulation is run and the forecast or assumption statistics are used in the optimization model to find the optimal allocation of decision variables. Then, another simulation is run, generating different forecast statistics, and these new updated values are then optimized, and so forth. Hence, the final decision variables will each have their own forecast chart, indicating the range of the optimal decision variables. For instance, instead of obtaining single-point estimates in the dynamic optimization procedure, users can now obtain a distribution of the decision variables and, hence, a range of optimal values for each decision variable, also known as a stochastic optimization. Users should always run a Static Optimization prior to running any of the more advanced methods to test if the setup of the model is correct.
[0573] The Dynamic Optimization and Stochastic Optimization must first have simulation assumptions set. That is, both approaches require Monte Carlo Risk Simulation to be run prior to starting the optimization routines.
[0574] Decision Variables
[0575] Decision variables are quantities over which users have control; for example, the amount of a product to make, the number of dollars to allocate among different investments, or which projects to select from among a limited set. As an example, portfolio optimization analysis includes a go or no-go decision on particular projects. In addition, the dollar or percentage budget allocation across multiple projects also can be structured as decision variables.
[0576] According to an embodiment of the present invention, Users click Add to add a new Decision Variable. Users can also Change, Delete, or Duplicate an existing decision variable. Decision Variables can be set as Continuous (with lower and upper bounds), Integers (with lower and upper bounds), Binary (0 or 1), or a Discrete Range. The list of available variables is shown in the data grid, complete with their assumptions.
[0577] Constraints
[0578] Constraints describe relationships among decision variables that restrict the values of the decision variables. For example, a constraint might ensure that the total amount of money allocated among various investments cannot exceed a specified amount or, at most, one project from a certain group can be selected; budget constraints; timing restrictions; minimum returns; or risk tolerance levels.
[0579] According to an embodiment of present invention, Users click Add to add a new Constraint. Users can also Change or Delete an existing constraint.
[0580] According to an embodiment of the present invention, when users add a new constraint, the list of available Variables will be shown. By simply double-clicking on a desired variable, its variable syntax will be added to the Expression window. For example, double-clicking on a variable named "Returnl" will create a syntax variable "$(Returnl)$" in the window.
[0581] According to an embodiment of the present invention, users can enter their own constraint equations. For example, the following is a constraint: $(Assetl)$+$(Asset2)$+$(Asset3)$+$(Asset4)$=l, where the sum of all four decision variables must add up to 1. Users can keep adding as many constraints as needed, but they need to be aware that the higher the number of constraints, the longer the optimization will take, and the higher the probability of making an error or creating nonbinding constraints, or having constraints that violate another existing constraint (thereby introducing an error in the model).
[0582] Statistics
[0583] According to an embodiment of present invention, the Statistics subtab will be populated only if there are simulation assumptions set up. The Statistics window will only be populated if users have previously defined simulation assumptions available. If there are simulation assumptions set up, users can run Dynamic Optimization or Stochastic Optimization; otherwise users are restricted to running only Static Optimizations. In the window, users can click on the statistics individually to obtain a drop-down list. Here users can select the statistic to apply in the optimization process. The default is to return the Mean from the Monte Carlo Risk Simulation and replace the variable with the chosen statistic (in this case the average value), and Optimization will then be executed based on this statistic.
[0584] Objective
[0585] Objectives give a mathematical representation of the model's desired outcome, such as maximizing profit or minimizing cost, in terms of the decision variables. In financial analysis, for example, the objective may be to maximize returns while minimizing risks (maximizing the Sharpe's ratio or returns-to-risk ratio).
[0586] According to an embodiment of the present invention, Users can enter a customized Objective in the function window. The list of available variables is shown in the Variables window on the right. This list includes predefined decision variables and simulation assumptions. An example of an objective function equation looks something like: ($(Assetl)$*$(AS_Returnl)$+$(Asset2)$*$(AS_Return2)$+$(Asset3)$:i:$(AS_Return3)$+$(As set4)$n(AS_Retum4)$)/sqrt($(AS_Riskl)$**2n(Assetl)$**2+$(AS_Risk2)$*:i:2n(Asset2)$:i: *2+$(AS_Risk3)$*:i:2:i:$(Asset3)$:i: :i:2+$(AS_Risk4)$:i: :i:2:i:$(Asset4)$:i: :i:2). Users can use some of the most common math operators such as +, -, *, /, **, where the latter is the function for "raised to the power of."
[0587] APPENDIX: ECONOMIC RESULTS
[0588] Net Present Value
[0589] The net present value (NPV) method is simple and powerful: All future cash flows are discounted at the project's cost of capital and then summed. Complications include differing life spans and different rankings using IRR. The general rule is if NPV > 0, accept the project; if NPV < 0, reject the project; if NPV = 0, you are indifferent (other qualitative variables need to be considered). The NPV is the sum of cash flows (CF) from time zero (t = 0) to the final cash flow period (N) discounted as some discount rate (k), which is typically the weighted average cost of capital (WACC). Be aware that CFO is usually a negative number as this may be an initial capital investment in the project.
CF1 CF2 CF, N
NPV = CFn + J+ ...+ N
(\ + ky (\ + k) (l N
+ k) ∑ (l + k)'
NPV = CF + ?' + + + <*» = f - CF>
{i+wAccy (i+wAccy (i+wAcc i ^+wAcc
[0590] NPV has a direct relationship between economic value added (EVA) and market value added (MVA). It is equal to the present value of the project's future EVA, and, hence, a positive NPV usually implies a positive EVA and MVA.
[0591] Internal Rate of Return
[0592] Internal rate of return (IRR) is the discount rate that equates the project's cost to the sum of the present cash flow of the project. That is, setting NPV = 0 and solving for k in the NPV equation, where k is now called IRR. In other words, where:
[0593] Note that there may exist multiple IRRs when the cash flow stream is erratic. Also, the IRR and NPV rankings may be dissimilar. The general rule is that when IRR > required rate of return or hurdle rate or cost of capital, accept the project. That is, if the IRR exceeds the cost of capital required to finance and pay for the project, a surplus remains after paying for the project, which is passed on to the shareholders. The NPV and IRR methods make the same accept/reject decisions for independent projects, but if projects are mutually exclusive, ranking conflicts can arise. If conflicts arise, the NPV method should be used. The NPV and IRR methods are both superior to the payback method, but NPV is superior to IRR. Conflicts may arise when the cash flow timing (most of the cash flows come in during the early years compared to later years in another project) and amounts (the cost of one project is significantly larger than another) are vastly different from one project to another. Finally, there sometimes can arise multiple IRR solutions in erratic cash flow streams such as large cash outflows occurring during or at the end of a project's life. In such situations, the NPV provides a more robust and accurate assessment of the project's value.
[0594] Modified Internal Rate of Return
[0595] The NPV method assumes that the project cash flows are reinvested at the cost of capital, whereas the IRR method assumes project cash flows are reinvested at the project's own IRR. The reinvestment rate at the cost of capital is the more correct approach in that this is the firm's opportunity cost of money (if funds were not available, then capital is raised at this cost).
[0596] The modified internal rate of return (MIRR) method is intended to overcome two IRR shortcomings by setting the cash flows to be reinvested at the cost of capital and not its own IRR, as well as preventing the occurrence of multiple IRRs, because only a single MIRR will exist for all cash flow scenarios. Also, NPV and MIRR will usually result in the same project selection when projects are of equal size (significant scale differences might still result in a conflict between MIRR and NPV ranking).
[0597] The MIR is the discount rate that forces the present value of costs of cash outflows (COF) to be equal to the present value of the terminal value (the future value of cash inflows, or CIF, compounded at the project's cost of capital, k).
^ COFt CIFt (1 + WACCY
t il + WACC o (I + MIRR)'
Terminal Value
PV Costs
(l + MIRR)
[0598] Profitability Index and Return on Investment
[0599] The profitability index (PI) is the ratio of the sum of the present value of cash flows to the initial cost of the project, which measures its relative profitability. A project is acceptable if PI > 1 , and the higher the PI, the higher the project ranks. PI is mathematically very similar to return on investment (ROI), but it is a relative measure whereas ROI is an absolute measure. In addition, PI returns a ratio (the ratio is an absolute value, ignoring the negative investment cost) while ROI is usually described as a percentage.
∑ (l + k)' Benefit PV Cash Flows
PI =
[0600] Mathematically, NPV, IRR, MIRR, and PI should provide similar rankings although conflicts may sometimes arise, and all methods should be considered as each provides a different set of relevant information.
[0601] Payback Period
[0602] Simple but ineffective by itself, the payback period method calculates the time necessary to pay back the initial cost (i.e., a breakeven analysis). It does not take into account time valuation of money and it does not consider different life spans after the initial payback
breakpoint and ignores the cost of capital. The payback period approach helps identify the project's liquidity in determining how long funds will be tied up in the project.
Payback = Year before full recovery + [unrecovered cost ÷ Cash Flow time t] [0603] Discounted Payback Period
[0604] The discounted payback period method is similar to the payback period method but the cash flows used are in present values. This specification solves the issue of cost of capital, but the disadvantage of ignoring cash flows beyond the payback period still remains.
Discounted Payback = Year before full recovery + [unrecovered cost ÷ PV Cash Flow time t]
[0605] Throughout this disclosure and elsewhere, block diagrams and flowchart illustrations depict methods, apparatuses (i.e., systems), and computer program products. Each element of the block diagrams and flowchart illustrations, as well as each respective combination of elements in the block diagrams and flowchart illustrations, illustrates a function of the methods, apparatuses, and computer program products. Any and all such functions ("depicted functions") can be implemented by computer program instructions; by special-purpose, hardware-based computer systems; by combinations of special purpose hardware and computer instructions; by combinations of general purpose hardware and computer instructions; and so on - any and all of which may be generally referred to herein as a "circuit," "module," or "system."
[0606] While the foregoing drawings and description set forth functional aspects of the disclosed systems, no particular arrangement of software for implementing these functional aspects should be inferred from these descriptions unless explicitly stated or otherwise clear from the context.
[0607] Each element in flowchart illustrations may depict a step, or group of steps, of a computer-implemented method. Further, each step may contain one or more sub-steps. For the purpose of illustration, these steps (as well as any and all other steps identified and described above) are presented in order. It will be understood that an embodiment can contain an alternate order of the steps adapted to a particular application of a technique disclosed herein. All such variations and modifications are intended to fall within the scope of this disclosure. The
depiction and description of steps in any particular order is not intended to exclude embodiments having the steps in a different order, unless required by a particular application, explicitly stated, or otherwise clear from the context.
[0608] Traditionally, a computer program consists of a finite sequence of computational instructions or program instructions. It will be appreciated that a programmable apparatus (i.e., computing device) can receive such a computer program and, by processing the computational instructions thereof, produce a further technical effect.
[0609] A programmable apparatus includes one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors, programmable devices, programmable gate arrays, programmable array logic, memory devices, application specific integrated circuits, or the like, which can be suitably employed or configured to process computer program instructions, execute computer logic, store computer data, and so on. Throughout this disclosure and elsewhere a computer can include any and all suitable combinations of at least one general purpose computer, special-purpose computer, programmable data processing apparatus, processor, processor architecture, and so on.
[0610] It will be understood that a computer can include a computer-readable storage medium and that this medium may be internal or external, removable and replaceable, or fixed. It will also be understood that a computer can include a Basic Input/Output System (BIOS), firmware, an operating system, a database, or the like that can include, interface with, or support the software and hardware described herein.
[0611] Embodiments of the system as described herein are not limited to applications involving conventional computer programs or programmable apparatuses that run them. It is contemplated, for example, that embodiments of the invention as claimed herein could include an optical computer, quantum computer, analog computer, or the like.
[0612] Regardless of the type of computer program or computer involved, a computer program can be loaded onto a computer to produce a particular machine that can perform any and all of
the depicted functions. This particular machine provides a means for carrying out any and all of the depicted functions.
[0613] Any combination of one or more computer readable medium(s) may be utilized. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non- exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable readonly memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
[0614] Computer program instructions can be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner. The instructions stored in the computer-readable memory constitute an article of manufacture including computer-readable instructions for implementing any and all of the depicted functions.
[0615] A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
[0616] Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
[0617] The elements depicted in flowchart illustrations and block diagrams throughout the figures imply logical boundaries between the elements. However, according to software or hardware engineering practices, the depicted elements and the functions thereof may be implemented as parts of a monolithic software structure, as standalone software modules, or as modules that employ external routines, code, services, and so forth, or any combination of these. All such implementations are within the scope of the present disclosure.
[0618] In view of the foregoing, it will now be appreciated that elements of the block diagrams and flowchart illustrations support combinations of means for performing the specified functions, combinations of steps for performing the specified functions, program instruction means for performing the specified functions, and so on.
[0619] It will be appreciated that computer program instructions may include computer executable code. A variety of languages for expressing computer program instructions are possible, including without limitation C, C++, C# .NET, Visual Basic, Java, JavaScript, assembly language, Lisp, HTML, and so on. Such languages may include assembly languages, hardware description languages, database programming languages, functional programming languages, imperative programming languages, and so on. In some embodiments, computer program instructions can be stored, compiled, or interpreted to run on a computer, a programmable data processing apparatus, a heterogeneous combination of processors or processor architectures, and so on. Without limitation, embodiments of the system as described herein can take the form of Web-based computer software, which includes client/server software, software-as-a-service, peer-to-peer software, or the like.
[0620] In some embodiments, a computer enables execution of computer program instructions including multiple programs or threads. The multiple programs or threads may be processed more or less simultaneously to enhance utilization of the processor and to facilitate substantially
simultaneous functions. By way of implementation, any and all methods, program codes, program instructions, and the like described herein may be implemented in one or more thread. The thread can spawn other threads, which can themselves have assigned priorities associated with them. In some embodiments, a computer can process these threads based on priority or any other order based on instructions provided in the program code.
[0621] Unless explicitly stated or otherwise clear from the context, the verbs "execute" and "process" are used interchangeably to indicate execute, process, interpret, compile, assemble, link, load, any and all combinations of the foregoing, or the like. Therefore, embodiments that execute or process computer program instructions, computer-executable code, or the like can suitably act upon the instructions or code in any and all of the ways just described.
[0622] The functions and operations presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose systems may also be used with programs in accordance with the teachings herein, or it may prove convenient to construct more specialized apparatus to perform the required method steps. The required structure for a variety of these systems will be apparent to those of skill in the art, along with equivalent variations. In addition, embodiments of the invention are not described with reference to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the present teachings as described herein, and any references to specific languages are provided for disclosure of enablement and best mode of embodiments of the invention. Embodiments of the invention are well suited to a wide variety of computer network systems over numerous topologies. Within this field, the configuration and management of large networks include storage devices and computers that are communicatively coupled to dissimilar computers and storage devices over a network, such as the Internet.
[0623] While multiple embodiments are disclosed, still other embodiments of the present invention will become apparent to those skilled in the art from this detailed description. The invention is capable of myriad modifications in various obvious aspects, all without departing from the spirit and scope of the present invention. Accordingly, the drawings and descriptions are to be regarded as illustrative in nature and not restrictive.
Claims
1. A computer-implemented system for qualitative and quantitative modeling of risk management comprising: a processor; and a enterprise risk management (ERM) risk register module comprising computer- executable instructions stored in non- volatile memory, wherein said processor and said ERM risk register module are operably connected and configured to: provide a user interface to a user, wherein said user interface is a risk register that allows said user to organize and manage one or more risk elements; receive risk element input from said user, wherein said risk element input is comprised of said one or more risk elements entered by said user; analyze said risk element input, wherein a risk analysis is performed on each of said one or more risk elements; create risk analysis charts, wherein one or more graphs are generated based on said risk analysis of each of said one or more risk elements; and analyze risk level trends of said one or more risk elements, wherein in patterns of change in risk level for said one or more risk elements can be plotted over time; forecast changes in said risk level of said one or more risk elements, wherein said risk level trends are evaluated to provide a predictive analysis of future risk level change of said one or more risk elements; and recommend one or more risk mitigation programs based on said risk level trends and said predictive analysis of future risk level change, wherein each of one or more risk mitigation programs are evaluated for effectiveness.
2. The computer implemented system of claim 1, further comprising a communications means operably connected to said processor and said ERM risk module.
3. The computer implemented system of claim 1, wherein said one or more risk elements can be segmented and managed according to one or more of i) by company, ii) by division, iii) by geography, operations, product line, activity, and department, and iv) by risk categories.
4. The computer implemented system of claim 1, wherein said user interface is further configured to allow said user to manage and designate authorized users and risk managers.
5. The computer implemented system of claim 1, wherein said one or more graphs are selected from the group of graphs comprising bar graphs, heat map matrixes, Pareto charts, scenario tables, tornado charts, and pie charts.
6. The computer implemented system of claim 5, wherein each of said heat map matrixes is a key risk indicator heat map that is color coded to detail a plurality of risk levels.
7. The computer implemented system of claim 6, wherein said key risk indicator heat map is organized by risk classification categories based on said plurality or risk levels.
8. The computer implemented system of claim 1, wherein said ERM module and said processor are further configured to send an alert when said risk level of said one or more risk elements exceeds a stipulated risk level limit.
9. The computer implemented system of claim 1, wherein said ERM module and said processor are further configured to perform risk mapping to reveal how each of said one or more risk elements effect each segment of an organization.
10. The computer implemented system of claim 1 , wherein said ERM module is a network based module for basic inputs by end users.
11. The computer implemented system of claim 1 , wherein said ERM module is a local module for administrative use.
12. A computer- implemented method for qualitative and quantitative modeling of risk management, said method comprising the steps of: providing a user interface to a user, wherein said user interface is a risk register that allows said user to organize and manage one or more risk elements;
receiving risk element input from said user, wherein said risk element input is comprised of said one or more risk elements entered by said user; analyzing said risk element input, wherein a risk analysis is performed on each of said one or more risk elements; creating risk analysis charts, wherein one or more graphs are generated based on said risk analysis of each of said one or more risk elements; analyzing risk level trends of said one or more risk elements, wherein in patterns of change in risk level for said one or more risk elements can be plotted over time; forecasting changes in said risk level of said one or more risk elements, wherein said risk level trends are evaluated to provide a predictive analysis of future risk level change of said one or more risk elements; and recommending one or more risk mitigation programs based on said risk level trends and said predictive analysis of future risk level change, wherein each of one or more risk mitigation programs are evaluated for effectiveness.
13. The computer implemented method of claim 12, wherein said one or more risk elements can be segmented and managed according to one or more of i) by company, ii) by division, iii) by geography, operations, product line, activity, and department, and iv) by risk categories.
14. The computer implemented method of claim 12, wherein said user interface is further configured to allow said user to manage and designate authorized users and risk managers.
15. The computer implemented method of claim 12, wherein said one or more graphs are selected from the group of graphs comprising bar graphs, heat map matrixes, Pareto charts, scenario tables, tornado charts, and pie charts.
16. The computer implemented method of claim 15, wherein each of said heat map matrixes is a key risk indicator heat map that is color coded to detail a plurality of risk levels.
17. The computer implemented method of claim 16, wherein said key risk indicator heat map is organized by risk classification categories based on said plurality or risk levels.
18. The computer implemented method of claim 12, further comprising the step of sending an alert when said risk level of said one or more risk elements exceeds a stipulated risk level limit.
19. The computer implemented method of claim 12, further comprising the step of performing risk mapping to reveal how each of said one or more risk elements effect each segment of an organization.
20. A computer- implemented system comprising: a project economics analysis tool (PEAT) module comprising physical memory storing instructions that cause the PEAT module to: provide a user, via said PEAT module, a user interface for integrated risk management integration; present said user with one or more integrated risk management methodologies from a group of risk management methodologies comprising Monte Carlo risk simulation, strategic real options, stochastic and predictive forecasting, business analytics, business statistics, business intelligence, decision analysis, and portfolio optimization, wherein said one or more integrated risk management methodologies project and portfolio economics and financial analysis; receive user input from said user, wherein said user input comprises one or more entries to one or more open fields of said one or more integrated risk management methodologies; process said user input from said user, wherein said user input is analyzed using said one or more integrated risk management methodologies, wherein said PEAT module automatically causes said user input to be analyzed by said one or more integrated risk management methodologies consecutively, wherein the outputs from a first integrated risk management methodology become inputs to a second integrated risk management methodology, and so forth;
generate a result, wherein said result is determined after being processed by a final integrated risk management methodology of said group of risk management methodologies; and create a report, wherein said report allows said user to numerically and graphically interpret said result.
21. The computer- implemented system of claim 20, wherein said user interface of said PEAT module is organized in a tri-level tabular format.
22. The computer-implemented system of claim 20, wherein said PEAT module further comprise an industry-specific module
23. The industry-specific module of claim 22, wherein said industry-specific module is programmed for oil and gas project economics.
24. The computer- implemented system of claim 20, wherein said PEAT module further comprises an application-specific module.
25. The application-specific module of claim 24, wherein said application-specific module is programmed for discounted cash flow modeling.
26. The computer-implemented system of claim 20, wherein said report can be extracted to a word processor program.
27. The computer-implemented system of claim 20, wherein said report can be extracted to a spread-sheet application.
28. The computer- implemented system of claim 20, wherein said report can be extracted to a presentation program.
29. A computer- implemented method for providing integrated risk management integration via a project economics analysis tool (PEAT) module, the method comprising the steps of: providing a user, via said PEAT module, a user interface for integrated risk management integration;
presenting said user with one or more integrated risk management methodologies from a group of risk management methodologies comprising Monte Carlo risk simulation, strategic real options, stochastic and predictive forecasting, business analytics, business statistics, business intelligence, decision analysis, and portfolio optimization, wherein said one or more integrated risk management methodologies project and portfolio economics and financial analysis; receiving user input from said user, wherein said user input comprises one or more entries to one or more open fields of said one or more integrated risk management methodologies; processing said user input from said user, wherein said user input is analyzed using said one or more integrated risk management methodologies, wherein said PEAT module automatically causes said user input to be analyzed by said one or more integrated risk management methodologies consecutively, wherein in output from a first integrated risk management methodology becomes input to a second integrated risk management methodology; generating a result, wherein said result is determined after being processed by a final integrated risk management methodology of said group of risk management methodologies; and creating a report, wherein said report allows said user to numerically and graphically interpret said result.
30. The computer-implemented method of 31, further comprising the step of extracting said report to a word processor program.
31. The computer-implemented method of 31 , further comprising the step of extracting said report to a spread-sheet application.
32. The computer-implemented method of 31, further comprising the step of extracting said report to a presentation program.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2014/028160 WO2015137970A1 (en) | 2014-03-14 | 2014-03-14 | Qualitative and quantitative modeling of enterprise risk management and risk registers |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/US2014/028160 WO2015137970A1 (en) | 2014-03-14 | 2014-03-14 | Qualitative and quantitative modeling of enterprise risk management and risk registers |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015137970A1 true WO2015137970A1 (en) | 2015-09-17 |
Family
ID=54072230
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2014/028160 WO2015137970A1 (en) | 2014-03-14 | 2014-03-14 | Qualitative and quantitative modeling of enterprise risk management and risk registers |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2015137970A1 (en) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109492856A (en) * | 2018-09-18 | 2019-03-19 | 中国平安人寿保险股份有限公司 | Service request processing method, device, computer equipment and storage medium |
CN109816221A (en) * | 2019-01-07 | 2019-05-28 | 平安科技(深圳)有限公司 | Decision of Project Risk method, apparatus, computer equipment and storage medium |
CN110428137A (en) * | 2019-07-04 | 2019-11-08 | 阿里巴巴集团控股有限公司 | A kind of update method and device of risk prevention system strategy |
US20200134363A1 (en) * | 2018-10-31 | 2020-04-30 | Salesforce.Com, Inc. | Automatic feature selection and model generation for linear models |
NO20190116A1 (en) * | 2019-01-30 | 2020-07-31 | Inbario As | Method and system for normalization and aggregation of risks |
CN112200488A (en) * | 2020-10-28 | 2021-01-08 | 支付宝(杭州)信息技术有限公司 | Risk identification model training method and device for business object |
CN113538134A (en) * | 2021-07-27 | 2021-10-22 | 天元大数据信用管理有限公司 | Method, equipment and medium for monitoring regional risk spread |
CN115062452A (en) * | 2021-07-29 | 2022-09-16 | 华风气象传媒集团有限责任公司 | Method for manufacturing squall line gale risk map of power transmission line |
CN115170166A (en) * | 2022-09-06 | 2022-10-11 | 山东省市场监管监测中心 | Big data sensing method and system for judging monopoly behavior |
CN117670378A (en) * | 2024-02-02 | 2024-03-08 | 烟台市食品药品检验检测中心(烟台市药品不良反应监测中心、烟台市粮油质量检测中心) | Food safety monitoring method and system based on big data |
CN117892701A (en) * | 2024-03-18 | 2024-04-16 | 工业云制造(四川)创新中心有限公司 | Cloud manufacturing business cooperation system |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040015376A1 (en) * | 2002-07-03 | 2004-01-22 | Conoco Inc. | Method and system to value projects taking into account political risks |
US20070208600A1 (en) * | 2006-03-01 | 2007-09-06 | Babus Steven A | Method and apparatus for pre-emptive operational risk management and risk discovery |
US20090006270A1 (en) * | 2007-06-29 | 2009-01-01 | Risked Revenue Energy Associates | Performance risk management system |
CN202331551U (en) * | 2011-10-10 | 2012-07-11 | 广东汇安恒达管理顾问有限公司 | Risk management and review system for safety in production |
-
2014
- 2014-03-14 WO PCT/US2014/028160 patent/WO2015137970A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040015376A1 (en) * | 2002-07-03 | 2004-01-22 | Conoco Inc. | Method and system to value projects taking into account political risks |
US20070208600A1 (en) * | 2006-03-01 | 2007-09-06 | Babus Steven A | Method and apparatus for pre-emptive operational risk management and risk discovery |
US20090006270A1 (en) * | 2007-06-29 | 2009-01-01 | Risked Revenue Energy Associates | Performance risk management system |
CN202331551U (en) * | 2011-10-10 | 2012-07-11 | 广东汇安恒达管理顾问有限公司 | Risk management and review system for safety in production |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109492856A (en) * | 2018-09-18 | 2019-03-19 | 中国平安人寿保险股份有限公司 | Service request processing method, device, computer equipment and storage medium |
CN109492856B (en) * | 2018-09-18 | 2023-11-07 | 中国平安人寿保险股份有限公司 | Service request processing method, device, computer equipment and storage medium |
US11699094B2 (en) * | 2018-10-31 | 2023-07-11 | Salesforce, Inc. | Automatic feature selection and model generation for linear models |
US20200134363A1 (en) * | 2018-10-31 | 2020-04-30 | Salesforce.Com, Inc. | Automatic feature selection and model generation for linear models |
CN109816221A (en) * | 2019-01-07 | 2019-05-28 | 平安科技(深圳)有限公司 | Decision of Project Risk method, apparatus, computer equipment and storage medium |
CN109816221B (en) * | 2019-01-07 | 2024-01-02 | 平安科技(深圳)有限公司 | Project risk decision method, apparatus, computer device and storage medium |
NO20190116A1 (en) * | 2019-01-30 | 2020-07-31 | Inbario As | Method and system for normalization and aggregation of risks |
NO345649B1 (en) * | 2019-01-30 | 2021-05-31 | Inbario As | Method and system for normalization and aggregation of risks |
CN110428137A (en) * | 2019-07-04 | 2019-11-08 | 阿里巴巴集团控股有限公司 | A kind of update method and device of risk prevention system strategy |
CN112200488B (en) * | 2020-10-28 | 2023-07-25 | 支付宝(杭州)信息技术有限公司 | Risk identification model training method and device for business object |
CN112200488A (en) * | 2020-10-28 | 2021-01-08 | 支付宝(杭州)信息技术有限公司 | Risk identification model training method and device for business object |
CN113538134A (en) * | 2021-07-27 | 2021-10-22 | 天元大数据信用管理有限公司 | Method, equipment and medium for monitoring regional risk spread |
CN113538134B (en) * | 2021-07-27 | 2024-04-16 | 天元大数据信用管理有限公司 | Method, equipment and medium for monitoring regional risk spread |
CN115062452A (en) * | 2021-07-29 | 2022-09-16 | 华风气象传媒集团有限责任公司 | Method for manufacturing squall line gale risk map of power transmission line |
CN115170166A (en) * | 2022-09-06 | 2022-10-11 | 山东省市场监管监测中心 | Big data sensing method and system for judging monopoly behavior |
CN117670378A (en) * | 2024-02-02 | 2024-03-08 | 烟台市食品药品检验检测中心(烟台市药品不良反应监测中心、烟台市粮油质量检测中心) | Food safety monitoring method and system based on big data |
CN117670378B (en) * | 2024-02-02 | 2024-04-30 | 烟台市食品药品检验检测中心(烟台市药品不良反应监测中心、烟台市粮油质量检测中心) | Food safety monitoring method and system based on big data |
CN117892701A (en) * | 2024-03-18 | 2024-04-16 | 工业云制造(四川)创新中心有限公司 | Cloud manufacturing business cooperation system |
CN117892701B (en) * | 2024-03-18 | 2024-05-17 | 工业云制造(四川)创新中心有限公司 | Cloud manufacturing business cooperation system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9811794B2 (en) | Qualitative and quantitative modeling of enterprise risk management and risk registers | |
US9881339B2 (en) | Project economics analysis tool | |
US8892409B2 (en) | Project economics analysis tool | |
US20140324521A1 (en) | Qualitative and quantitative analytical modeling of sales performance and sales goals | |
US10453142B2 (en) | System and method for modeling and quantifying regulatory capital, key risk indicators, probability of default, exposure at default, loss given default, liquidity ratios, and value at risk, within the areas of asset liability management, credit risk, market risk, operational risk, and liquidity risk for banks | |
WO2015094545A1 (en) | System and method for modeling and quantifying regulatory capital, key risk indicators, probability of default, exposure at default, loss given default, liquidity ratios, and value at risk, within the areas of asset liability management, credit risk, market risk, operational risk, and liquidity risk for banks | |
WO2015137970A1 (en) | Qualitative and quantitative modeling of enterprise risk management and risk registers | |
Badakhshan et al. | Applying digital twins for inventory and cash management in supply chains under physical and financial disruptions | |
Mun | Modeling risk: Applying Monte Carlo risk simulation, strategic real options, stochastic forecasting, and portfolio optimization | |
Hassani et al. | Scenario analysis in risk management | |
French et al. | Supporting ALARP decision making by cost benefit analysis and multiattribute utility theory | |
US20190294633A1 (en) | Systems and methods for scenario simulation | |
Ramesh et al. | Back propagation neural network based big data analytics for a stock market challenge | |
Gan et al. | Efficient greek calculation of variable annuity portfolios for dynamic hedging: A two-level metamodeling approach | |
Barucke Marcondes et al. | Using mean-Gini and stochastic dominance to choose project portfolios with parameter uncertainty | |
Black et al. | Model risk: illuminating the black box | |
Marti | From data to trade: A machine learning approach to quantitative trading | |
Lehman et al. | Practical Spreadsheet Modeling Using@ Risk | |
Mun et al. | A Primer on Quantitative Risk Analysis | |
Yan et al. | Inferring fundamental value and crash nonlinearity from bubble calibration | |
Georgios | Machine learning applications in supply chain management | |
Nabavi et al. | Introduction to business analytics | |
Mun et al. | Risk Simulator | |
Kavitha et al. | Stock Closing Price Prediction Using Deep Learning, TensorFlow, and Keras | |
Mun | Real options |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14885318 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14885318 Country of ref document: EP Kind code of ref document: A1 |