March 2010 - Worldwide Training Schedule
North America
- March 1-2, 2010, Houston, TX
Monte Carlo Simulation for the Oil and Gas Industry using @RISK - 3-4 March 2010, Dayton/Versailles, OH
Decision-Making and Quantitative Risk Analysis using @RISK - 10-11 March 2010, Jersey City, NJ
Decision-Making and Quantitative Risk Analysis using @RISK - 23-24 March 2010, Denver, CO
Decision-Making and Quantitative Risk Analysis using @RISK - 23-25 March 2010, Denver, CO
Decision-Making & Quantitative Risk Analysis using the DecisionTools Suite
Brazil
- 3-5 de março 2010,Rio de Janeiro
Seminário de Avaliação de Riscos na Indústria Petrolífera e de Gás (3 Días) - 17-19 de março 2010, São Paulo, Brasil
Avaliação do Risco para Usuários Iniciantes/Intermediários (em português)
Latin-America
- 8 al 10 de marzo del 2010,Medellín, Colombia
Risk in Supply Chain (en español) - 15 al 17 de marzo del 2010,Lima, Peru
Evaluación de Riesgo para Usuarios Principiantes/Intermedios (en español) - 18 al 19 de marzo del 2010,Lima, Peru
Administración de Riesgos en Proyectos con @RISK para Project (en español)
Asia-Pacific
- 10-11 March 2010, Melbourne
Decision-Making and Quantitative Risk Analysis using @RISK
The State of Six Sigma and Process Improvement
projects evolve. The IQPC did an excellent job keeping the quality of the conference at an A+ level despite wrangling with the effects of a down market and near zero travel budgets for many companies. This conference has earned it place as one of the premier Six Sigma events of the year. With attendance numbers on par with last year (which are only slightly down from a few years ago), the major difference that I noticed was the attendees' passion. As the economy has worsened and media’s perception of Six Sigma waned, practitioners and champions are more passionate and committed now than ever. Perhaps it’s because they still have jobs and their companies understand the value of cost reduction in both their processes and product/ process development programs. They - and the companies who employ them - have every right to be excited and passionate because they are making positive changes to their organizations that will hopefully lead them to recovery and stability faster than others.
Many companies, large and small, represented practically every industry. Farmers Insurance and Capital One were two representatives from the insurance and banking industries. Technology and pharmaceuticals were well represented by Seagate, Motorola, Merck and Johnson & Johnson. In addition, the energy sector was well represented, as were the military, aerospace and services sectors. (If you want a complet list of companies attending, it may be available at www.sixsigmaiq.com)
The overriding message heard over and over again, was, “We need to make your Six Sigma deployments stick.” Initially, I found this to be an interesting message since it came from a group of many highly intelligent and motivated individuals who were obviously very successful in doing just that: “Making it Stick”. This message serves as a clarion call for all of us. We need to look for new tools, philosophies and approaches to make our improvement initiative better and “stickier” so that they can pass the test of time.
The highlight of every year is the awards ceremony. There were many great projects honored this year, and congratulations to the winners and everyone who submitted their projects! At the awards ceremony I had the pleasure to meet a great group from the Bahamas Telecommunications Company. They are the pioneers for Lean Six Sigma for their company. (I tried to get them to need an onsite training session in some of the Palisade tools, but have been thus far unsuccessful!) Good luck on your Six Sigma Journey, I hope to see you accepting an award next year!
Goldilocks Had It Easy
Thanks, Ed, for giving this some thought!
Free Webcast this Thursday: "Simulating the U.S. Economy: Where will we be in 100 years?"
In this free webcast, Dr. William Strauss models the next 100 years, based on the last century's data. The experiment in this webcast is about the future. If the model can very closely replicate the last 100 years, what does it have to say about the next 100 years? The experiment uses @RISK’s risk analysis and Monte Carlo techniques to generate new combinations of parameters for each of tens of thousands of runs of the simulation. Changes in the parameters represent potential exogenous policy choices.
The “doing what you did gets you what you got” scenario leads to a surprising and unsettling outcome. The experiments using Evolver (genetic algorithm optimization software) do find a path that works. Obviously if it is not “business-as-usual” that leads to a stable outcome, it is some other way. The policy choices that lead to a stable outcome suggest that the future of capitalism is not going to be what we expect it to be.
Palisade is pleased to host this presentation from Dr. William Strauss.
William Strauss is the President and founder of FutureMetrics. He brings more than thirty years of strategic planning, project management, data analysis, and modeling experience into the company’s stock of knowledge capital. Bill’s professional history includes executive positions as director, president, and senior vice president, as well as positions as senior analyst and field coordinator. He has an MBA (specializing in Finance) and a PhD (Economics). Read more of Dr. Strauss' bio here.
» Complete abstract of "Simulating the U.S. Economy: Where will we be in 100 years?"» Register now (FREE)
» View archived webcasts
Data Issues Part 3
Auditing and calibration of the model at both the micro and macro level. It’s as important as any other element of risk or statistical analysis, or indeed the model building itself. At the distribution level historical data helps to both parameterise the distributions and in fact select them in the first place. As a minimum a few data points will help you to understand possible central tendencies and variability for your risks, and also generate a list of feasible distributions to choose from. With a reasonable number of observations @RISK for Excel can be used to fit distributions to the data taking care of both distribution selection and parameterisation simultaneously. Only five data points are technically needed, but a reasonable fit will require either more than that or other holistic information to achieve validity.
At the macro level total project cost estimates are often ignored from the portfolio perspective. Commonly high percentiles are reported from such models to use in a ‘contingency’ calculation, such as the P90 or P95. Whilst a high percentile, the P90 (say) should still be exceeded 10% of the time! If your projects never go over this percentile then either there are some major mitigating factors not included in the model or the volatility is being consistently overstated. Likewise, the P10 for total cost (these ‘good’ percentiles are rarely if ever reported or considered in project cost estimation work) should be bettered in roughly 10% of projects. If this is not the case then the upside risk has been overstated. This may be due to misconceptions about the positive skewing present in most cost/delay risks or mistakes made in the parameterisation of the risks where the estimate (“most likely” etc.) is actually the “best case” or close to it, rather than a central tendency of the process over time. There could also be other possibilities.
No matter how you look at it, the collection and intelligent use of historical data is integral to effective and useful risk analysis and management, and critical to achieving valid Monte Carlo simulation results. If you aren’t currently recording everything you can get your hands on start right now!
Rishi Prabhakar
Trainer/Consultant
Free Live Webcast this Thursday: Simulating the U.S. Economy: Where will we be in 100 years?
There is an assumption that drives all of our expectations for how our economy will be in the future. That assumption is one of endless economic growth. Clearly endless exponential growth is impossible. Yet that is what we base all of our expectations upon. We all agree that zero or negative economic growth is bad (just look around now at the effects of the Great Recession). But we also know logically that 2% or 4% annual growth every year leads to an exponential growth outcome that is unsustainable.
To see where this growth imperative will take us we first have to see how we go to where we are today. This free live webcast first models the 20th century. The model is both complex and simple. The basic schematic of the model’s relationships is easy to understand. Furthermore, the core of the model is a simple production function that combines capital, labor, and the useful work derived from energy to generate the output of the economy. Complexity is contained in the solutions to the internal workings of the model. What is unique is that there are no exogenous economic variables. Once the equations’ parameters are calibrated, setting the key outputs to “one” in 1900 results in their time paths very closely predicting the U.S. GDP and its key components from 1900 to 2006.
The experiment in this webcast is about the future. If the model can very closely replicate the last 100 years, what does it have to say about the next 100 years? From 1900 to 2006 there are periods in which there was parameter switching. (The optimal parameters and the years for the switching were found using a constrained optimization technique.) That suggests that in the future there will also be changes. The experiment uses @RISK’s features (risk analysis software using Monte Carlo techniques) to generate new combinations of parameters for each of tens of thousands of runs of the simulation. Changes in the parameters represent potential exogenous policy choices.
The “doing what you did gets you what you got” scenario leads to a surprising and unsettling outcome. The experiments using Evolver (genetic algorithm optimization using Monte Carlo simulation) do find a path that works. Obviously if it is not “business-as-usual” that leads to a stable outcome, it is some other way. The policy choices that lead to a stable outcome suggest that the future of capitalism is not going to be what we expect it to be.
----
William Strauss is the President and founder of FutureMetrics. He brings more than thirty years of strategic planning, project management, data analysis, and modeling experience into the company’s stock of knowledge capital. Bill’s professional history includes executive positions as director, president, and senior vice president, as well as positions as senior analyst and field coordinator. He has an MBA (specializing in Finance) and a PhD (Economics).
» Register now for this FREE live webcast
» View archived webcasts
Data Issues Part 2
Data, that is. Historical data from completed projects, sometimes billion-dollar projects, is simply not collected especially in resources and infrastructure cost estimation. Instead every risk is re-estimated from scratch in every new project based entirely upon an estimator’s recollections or guesses. This is not a suggestion that estimators don’t know what they’re talking about, rather that the benefits of adding historical data to the analysis far outweigh the cost of gathering the information in the first place.
I first worked in the banking sector, hence my surprise to learn of this lack of data storage in certain areas of risk analysis. Project cost estimation, especially in resources and infrastructure – I’m talking to you. In financial circles there are literally millions of data points collected daily across the entire organisation. Gathering data (and then analysing it for some benefit) is simply ‘what we do’, and this process isn’t challenged. Some of the data is quite ‘small’, such as the number of seconds a particular caller was kept on hold before being answered, and others are quite ‘big’, such as multi-million dollar losses due to fraudulent activities. Regardless, it’s all kept in the knowledge that information is power – in this case the power to make intelligent decisions in the future.
How can you judge the efficacy of an estimation process (workshops etc.) if you don’t track the final observed outcomes specifically to make such a judgment? Well, you can’t. And that leaves your company’s risk and decision assessment process in limbo. Without measurement there can be no process improvement or corporate learning. Are you ‘passing’ or ‘failing’ with your use of Monte Carlo simulation via risk analysis software?
Generally the observed outcomes for risks in models will be near the estimated value, and this is to be expected. However the main role of risk analysis is to adjudge exposure to the unexpected. Far too many cost estimation models have very little volatility in their line items. I am very curious to know just how often the realised value of a given line item is outside the range of “possible values” as defined in the model. And what about the total project costs overall? This hints at and leads to the big question which is what could/should be done with such data if it were to be recorded?
I shall address these questions in the next blog. I know you’re excited to find out!
Rishi Prabhakar
Trainer/Consultant
Cost-Benefit Feedback Loop
Well, there's staff time or your own time (which is worth something), Monte Carlo software, some portion of your computing costs,data acquisition, and on and on. Many variables. But the kind of costs I'm thinking of are the kind you rack up while you're analyzing, say, option valuation, and not doing something else. These are opportunity costs. They are what really limit how thoroughgoing your risk analysis becomes, which layer you drill down to--and they are very difficult to quantify.
How do you calculate whether the time you're spending in risk assessment is cost-effective? It's a problem of operations risk. So I suppose you could enumerate all the other activities that would consume the same amount of time and model their paybacks. But that would cost you more time in statistical analysis. . . . and you would be left in a positive feedback loop.
In the days ahead I'll be talking to risk management and operations research folks to find out how they decide how much analysis is just the right amount--not too much, and not too little. I'll be surprised if I turn up any computational approaches--but who knows?
Predicting Customer Will
Data Issues Part 1
Commonly @RISK for Excel is used to fit distributions to historical data for use in risk modelling, and it sure beats wildly guessing obscure parameters. However there are (naturally) a litany of woe-inducing problems with all historical data sets: non-stationary data series, extreme values/outliers, data recording errors, seasonality and heteroskedasticity to name a few. Excessive ‘cleansing’ of the data set is commonly prescribed, but the statistician in me cringes to even type those words! Quality control and transforming the data will help to eliminate most of those problems, but what about outliers?
In the early Naughties I was working for a large Australian bank, forecasting their daily call centre volumes for the purpose of planning staff levels and predicting service levels. A particular call centre averaged 30,000 calls per weekday. Yet on September 12th, 2001, calls dropped to less than 10,000. Along with the rest of the world, Australians were watching the terrorist attacks on television and the internet rather than calling to fix spelling mistakes in their contact details or transfer small sums of money between accounts. But what to do with that data point? Presuming the forecasting model is not intended to include such extreme events as terrorist attacks then the point could simply be filtered out of the data set and not thought of again.
But now consider a process that should include rarer events, such as flood damage or operational risk, as one of the risks in a model. If you have 10 years of good data (say), but the set includes an event that should only occur every 100 years. This level of impact is thus drastically overrepresented in the data and any fitted distribution will be biased toward such extremes. Yet the data point can not be completely ignored as such values can occur and the simulation models must have the capacity to sample such values (though with a reasonable likelihood). In this case the artistry that is fitting distributions to data comes to the fore. The data point could be removed from the set but not from our decision making process.
From the range of distributions that can be selected, the optimal choice should not only represent the remaining data well but also have a tail that samples events in the vicinity of those that have been excluded from the analysis with reasonable probability. No, that’s not always easy to do. But as with many elements of probabilistic modelling it simply must be done in order to provide useful information to decision makers.
Thus the context of the modelling can go a long way to determine the most appropriate steps to take with your data set. If that sounds like a subjective guideline then you read it correctly. Not enough people realise just how important experience and intuition can be in the seemingly prescriptive fields of mathematics and statistics. Fitting distributions to data is no different.
And yet that isn’t the unusual fact I was reminded of in the workshop! But I’ll leave that for Part 2 of my Data Issues blog.
Rishi Prabhakar
Trainer/Consultant
February 2010 - Worldwide Training Schedule
North America
- 9-11 February 2010, Ottawa, ON
Decision-Making & Quantitative Risk Analysis using the DecisionTools Suite - 16-17 February 2010, Cleveland, OH
Decision-Making and Quantitative Risk Analysis using @RISK - 23-24 February 2010, Orlando, FL
Decision-Making and Quantitative Risk Analysis using @RISK
Europe
- 8-10 Feb 2010, London (Central)
@RISK and the DecisionTools Suite: An Intensive 2.5 Day Course
Latin-America
- 10 al 12 de febrero del 2010,Santa Cruz, Bolivia
Evaluación de Riesgo para Usuarios Principiantes/Intermedios (en español) - 24 al 26 de febrero del 2010,Distrito Federal, México
Evaluación de Riesgo para Usuarios Principiantes/Intermedios (en español)
A Downturn for the Better
So the good news is not about improvements in human nature. It's about improving the defenses of this booming sector of the economy.
The role of software in risk management
Risk management essentially involves three stages – identification, quantification, and the on-going management of risks. In reality, these stages are not completely distinct from each other, with each stage influencing and informing the others. For example, an initial quantification of risks may lead to the conclusion that some of the identified risks are in fact not serious enough to warrant further consideration, or that the original description of the risk was not sufficiently precise for meaningful risk management measures to be put in place.
Each of these stages can benefit from the use of supporting risk modeling software. For instance, Microsoft Excel can be used to create a risk register, i.e. a database that records the risks identified, the assessment of the likelihood and impact of each of these risks, the mitigating actions that have been planned, and the assignment of responsibilities for these actions. However, there are many other software tools available, each designed for a specific purpose and focus. To illustrate, enterprise-wide risk management software focuses on the creation of integrated and holistic risk management systems, whereas Monte Carlo simulation and decision tree software place their emphasis on enhancing the quantitative analysis of risks.
The selection of the appropriate risk analysis software should involve very careful thought. The right decision can lead to a very effective implementation, whereas the wrong decision may result in a large amount of wasted investment.
There are some key considerations to bear in mind when selecting the risk modeling software. Choosing software based on how many staff will genuinely be required for the day-to-day risk management process is crucial. It is easy to select software based on the ideal situation that there will be a wide staff involvement in the risk management process. In reality, this may not be possible, potentially resulting in a cumbersome and inflexible solution being chosen over a more stand-alone and flexible application.
Similarly, knowing the level of risk quantification required is important. In fact, best practice risk management now involves the use of quantitative techniques, often using Monte Carlo simulation. When correctly conducted, the process of quantifying risks is rigorous and structured, can expose hidden or biased assumptions, as well as provide a more solid rationale upon which to base the major decisions.
Finally, determining the extent of on-going risk management needed for your business can assist with software selection.
Needless to say, any software application will be most successful when used by appropriately trained and motivated staff, and when used as a supporting tool within an overall risk management process. Software is not a replacement for process.
Craig Ferri
EMEA Managing Director of Risk & Decision Analysis
Free Webcast This Thursday: “Lean Six Sigma: History, Trends and Predictions”
Lean and Six Sigma have been buzzwords for more than a decade. Some companies have thoroughly embraced the concepts and toolsets, others have dabbled, and the rest sit on the sidelines wondering, to borrow a phrase from a television ad from the ‘80’s, “Where’s the beef?”
In this interactive webcast, we will briefly review what these strategies entail, who is using them and how, and then we’ll put on our prognosticator’s hat take a look at what the future may hold in store. We will review some of the latest “buzz” on the topic as well as recent research aimed at how well these methodologies are moving off the shop floor into wider application.
Ed welcomes any questions regarding Lean, Six Sigma, or the “new and improved” Lean Six Sigma. Although we will be focusing on the implementation side of the equation, (including the use of Palisade software), the discussion can be as free-ranging as the participants require.
Edward Biernat is the president of Consulting With Impact, Ltd., a training, coaching, and consultancy located in Canandaigua, NY that he founded in 1998. CWI’s client list includes companies ranging from the Fortune 100 to post-startups in the medical device, food and food packaging, steel, automotive, healthcare, and service sectors. He is a graduate of Clarkson University with bachelor degrees in Mechanical and Electrical Engineering, and has held positions in engineering, quality, and management at several New York companies. He is the author of numerous training programs and articles, and has presented at national and international events including the Institute of Industrial Engineers’ Annual Conference and the European Organization for Quality in Brussels, Belgium. Ed also developed part of the curriculum for and presents at the Lean Six Sigma Black Belt certification course at a local college.
» Register now (FREE)
» View archived webcasts
Using Risk Analysis to measure the impact of climate change
Recent events in Cumbria in the UK suggest climate change really should be at the top of the agenda, and this new bill will certainly go some way to managing the risk associated with it.
Risk analysis has its place in determining the risk associated with climate change, and Palisade's risk modeling software has helped numerous organizations develop reports on likely outcomes. Cambridge University’s Judge Business School recently used @RISK to provide key input to the Stern Review on the Economics of Climate Change. Released in 2006, this report undertaken by the British government by Lord Stern discusses the effect of climate change and global warming on the world economy and is the largest and most widely referenced report of its kind.
They researched issues such as the impacts of the sea level rising and increases in temperature making land infertile or unfarmable, and balanced these against the costs of various options available to tackle global warming.
At one end of the scale, doing nothing costs nothing, but the environmental consequences will be high. However, activity that reduces the severity of the impacts may itself be very expensive. The aim of the @RISK model was to enable people to make informed decisions on the optimum way to deal with climate change (ie how much to cut back on damaging activity and what methods to use).
@RISK risk simulation software also helped researchers tackle a key problem associated with investigating climate change, namely that the different effects of the various factors which influence it are themselves, undetermined. For example, the historical evidence does not pin down exactly how much global temperatures will increase if CO2 emissions double. @RISK enabled researchers to quantify this uncertainty in order that they have a measurement of the accuracy of their findings.
Risk analysis models should go some way to determining outcomes, and potentially help us prepare for the tragic events that have unfolded in recent days in the UK.
Craig Ferri
EMEA Managing Director of Risk & Decision Analysis
Free Webcast This Thursday: “Lean Six Sigma: History, Trends and Predictions”
In this interactive webcast, we will briefly review what these strategies entail, who is using them and how, and then we’ll put on our prognosticator’s hat take a look at what the future may hold in store. We will review some of the latest “buzz” on the topic as well as recent research aimed at how well these methodologies are moving off the shop floor into wider application.
In the course of the webcast, Ed would like to address participant questions regarding Lean, Six Sigma, or the “new and improved” Lean Six Sigma. After signing up for the webcast, forward any questions to: jromeo-hall@palisade.com. Questions can also be submitted real-time via the webcast chat feature.
Palisade is please to host this presentation from Edward Biernat. Ed is the president of Consulting With Impact, Ltd., a training, coaching, and consultancy located in Canandaigua, NY that he founded in 1998. CWI’s client list includes companies ranging from the Fortune 100 to post-startups in the medical device, food and food packaging, steel, automotive, healthcare, and service sectors. He is a graduate of Clarkson University with bachelor degrees in Mechanical and Electrical Engineering, and has held positions in engineering, quality, and management at several New York companies. He is the author of numerous training programs and articles, and has presented at national and international events including the Institute of Industrial Engineers’ Annual Conference and the European Organization for Quality in Brussels, Belgium. Ed also developed part of the curriculum for and presents at the Lean Six Sigma Black Belt certification course at a local college.
» Register now (FREE)
» View archived webcasts
2010: A Model Year for Risk Analysis
• Take time for statistical analysis of past experience.
• Make better decisions by the numbers.
Adopting a healthy approach to risk
Having talked in previous posts as to why it’s important, and today how accessible it is for any size of organisation to adopt a healthy approach to risk, I’ll now take you through my top ten tips on how you can maximize your risk management programme:1. Get buy-in
Risk management is not an optional extra. It is a business critical tool that is an asset and an integral part of the project. The company culture must be developed to embrace QRM (quantitative risk management) and DMU (decision making under uncertainty) in order that everyone understands their benefits and therefore accepts the need for them.
2. Get budget
Business tools cost money, but managing risk is an investment - not an overhead – and must be regarded as such. Allocating resource and making it a formal business process should be seen as an insurance policy. Not only will it help organisations make better decisions that will save them money in the long term but, by identifying potential risks and adverse events, it can protect them against unexpected costs in the future.
3. Get words
As with any organisational change, it is essential that everyone is clear on the new processes. Therefore a common risk language – or 'glossary' – needs to be developed to avoid misunderstanding and to ensure a consistent approach to QRM and DMU.
4. Get numbers
Qualitative assessment is essential, but numbers are more powerful – for example the percentage chance of meeting a deadline or budget. Monte Carlo simulation random sampling provides the margin of error for a venture and is a good way to illustrate the consequences of different courses of action. Risk management experts must ensure everyone understands these figures, and accepts them.
5. Get structure
Managing risk in order to make better-informed decisions requires an appropriate organisational structure. Individuals and groups need clearly defined roles, and must then each take responsibility for their own area of expertise.
6. Get lateral
Every organisation has risks that it deals with on a daily basis and which must therefore be factored in to the decision-making model. However, no enterprise operates in isolation, so other external variables must be included. For example, even a small rise in fuel costs could have a major effect on revenues if raw materials need transporting long distances.
7. Get perspective
Political, cultural and social risk factors can be explored by involving all stakeholders. Investing time and money in consultation and research ensures that businesses have a clear idea of the complete environment in which they operate, and therefore minimise the chances of products and services failing.
8. Get reporting
Risks, and the management of them, must be reviewed regularly – and the programme amended if necessary. This requires a regular reporting process, in which risks are clearly identified and prioritised.
9. Get with it
Being risk aware does not mean being risk averse. Businesses should guard against rigidly adhering to 'the way we've always done it' approach, instead keeping up-to-date, learning new tricks and not being afraid to be bold. Although risky on the surface, these tactics prevent being left behind – much of the potentially uncertainty can also be removed with QRM and DMU.
And finally…
10. Get it documented
Back up the commitment to a thorough QRM and DMU programme with documentation. This validates the budget and buy-in requested at the start. And it’s good for business – organisations this thorough are guaranteed a competitive edge.
Craig Ferri
EMEA Managing Director of Risk & Decision Analysis
The CDO Is Back in the Spotlight
The so-called "Collateralized Debt Obligations" were commonly blamed for sending an already shaky finance sector into exponential decline.
Subscribe to the Palisade
Become a fan of the Palisade