All insights

Risk Quantification

The Last Mile of Risk Quantification

Running a Monte Carlo simulation is the easy part. Getting executives to act on the results is where most risk programs quietly fail.

Jason Walker

.6 min read

I ran a beautiful analysis once. Probability distributions calibrated carefully. Loss event frequencies estimated from real incident data. A Monte Carlo output that told a clear story about expected annual loss exposure. The numbers were solid.

The executive read it, nodded, and asked me what he should do.

I realized in that moment I had answered a question nobody asked me.

This is the last mile problem in cyber risk quantification, and it breaks more programs than bad data ever does. The technical work of building a FAIR model, estimating threat event frequencies, running simulations, getting the math right, that part is learnable. There are courses, certifications, communities, tools. The hard part is the twenty minutes in a conference room after you close your laptop, when a CFO or a board member looks at you and needs to understand what your output means for a decision they have to make by Friday.

Most analysts are not ready for that conversation. Most programs are not built for it.


Here is what I see consistently in enterprise security work: the analysis-to-decision gap is treated as a communication problem. It is not. It is a framing problem.

Communication problems get solved by making charts clearer, simplifying terminology, using plain language instead of jargon. Those things help, but they are symptoms-level fixes. The framing problem runs deeper. It is that most quantitative risk outputs are built to answer the analyst's question, not the executive's question.

The analyst's question is: how bad could this get?

The executive's question is almost always one of four things. Should we spend money on this? Are we within our risk tolerance? How does this compare to the other thing we could spend money on? How much insurance do we actually need?

Those are not the same question. And if you produce an output designed to answer the first question and then try to translate it into an answer for one of the four, you are doing extra work in the room under pressure. That is where people reach for "the average expected loss is X" when what they should say is "your current exposure puts you outside your stated risk appetite in two of the three scenarios the board cares about."

The mean matters for some decisions. The mode matters for others. The tail of the loss exceedance curve is what your insurance underwriter needs. Analysts who learn to lead with the decision rather than the output close the last mile. Analysts who lead with the output and then try to connect it to the decision leave the executive doing cognitive work that the analyst should have done in preparation.


Aviation safety culture builds this into its checklist design. A good checklist does not describe the aircraft's state. It sequences actions toward a known outcome. The discipline is not "here is what the gauges say," it is "here is what you do next, and here is why it matters." The distinction sounds small. In a cockpit under pressure, it is everything.

Risk communication works the same way. When I am briefing a decision-maker on a quantification result, my job is not to describe the output. My job is to sequence them toward a decision with enough clarity that they can act with confidence. That means I have done the work before I walk in. I know which statistic is relevant to the specific decision on the table. I know the threshold, whether it is a risk appetite statement, a materiality threshold, an insurance limit, whatever is actually operative for them. I know the comparison case if there is one.

The loss exceedance curve is one of the most useful tools in the FAIR practitioner's kit precisely because it is decision-native. It does not just say "average loss is two million dollars." It says "there is a fifteen percent chance your loss exceeds five million in any given year." You can draw a line at your risk appetite. You can draw a line at your insurance limit. You can show what the curve looks like before and after a proposed control investment. That is a conversation a CFO can have. That is a number that connects to something they already manage.


The objection I hear most often when I push analysts toward this framing is that executives are not ready for probabilistic thinking. My experience is the opposite. Executives manage uncertainty every quarter. Revenue forecasts are probabilistic. Capital allocation decisions are probabilistic. The assumption that a C-suite audience cannot handle a confidence interval is usually a projection of the analyst's discomfort explaining one, not a real limitation of the audience.

What executives cannot tolerate is uncertainty presented without a recommendation. If I hand you a loss exceedance curve and then shrug, I have given you information dressed up as insight. Insight has a direction. It tells you something about what to do.

This is where the translation layer matters. Not translating "frequency" into "how often" or "magnitude" into "how much," though that helps. Translating the entire framing of the output from "here is what I found" to "here is what I recommend and here is the analysis that supports it." The recommendation comes first. The methodology defends it. Not the other way around.


I have watched quantitative risk programs stall inside organizations not because the models were wrong but because the outputs never made it into a decision. The analysis existed. The numbers were credible. But nobody in an executive role ever felt the pull to act because the output was never connected to an action.

The programs that work are built backwards from the decision. The analyst asks before the model is even built: what decision does this analysis need to support? Who makes it? What would move them? What are the specific thresholds that are operative for them right now? Then the model gets built to answer that question, and the output gets structured to hand the decision-maker a clear recommendation backed by the quantification.

That sequence sounds obvious. Almost nobody does it that way the first time.

The Monte Carlo simulation is not the hard part. It never was. The hard part is the conversation you have to be ready for when the numbers are done, and whether you walk into that room having already done the executive's reasoning for them, or whether you walk in expecting them to do it themselves.

Most of the time, they will not. And the analysis will sit in a folder, technically correct, operationally inert.

Do not let your best work die in a folder.

Keep reading

Weekly writing from inside the work.

Practitioner-researcher essays four times a week. No spam, unsubscribe in one click.

Subscribe

Weekly writing from inside the work.

Field observations and framework critiques from a practitioner-researcher running cybersecurity at scale. AI in operations, FAIR risk research, and the leadership patterns that hold both together. No spam. Unsubscribe in one click.