Deal selection · Method note

The pile you never open

The deals you passed on are the largest dataset your firm owns. Nobody has ever modeled them. Here is what they are worth and how to use them.

200Deals seen
3Deals tracked
48%Performance left on the table
50Funds before skill is legible
01 — The asset

You document what you buy. You forget what you decline.

Every deal you closed is documented to the decimal. Revenue, EBITDA, multiple, board decks, exit. Years of it.

The ones you passed on have no file. Nobody checked which got bought, at what price, or which quietly died. The record simply stops at the moment you said no.

That pile is fifty times larger than your portfolio, and it is the only dataset in the building with enough rows in it to learn anything from.

Deal flow — one yearn = 200
3  Closed — tracked forever
197  Passed — no file
?  Passed, and went on to win

Winner count shown illustratively. The real number is unknown, which is the argument.


02 — Why not the closed deals

Your track record is too small to learn from. Everyone's is.

The obvious idea is to take every deal you did, attach the outcome, and train a model to spot the next winner. It does not work, and the reason is not effort.

Private equity returns are extraordinarily noisy. Research separating skill from luck found that after observing five funds, only about 37 to 51 percent of top-quartile venture performers actually had top-quartile skill. After fifty funds — more than any firm has ever fully liquidated — it was still only 53 to 61 percent.

That is fifty funds, each holding many deals. A single firm's closed-deal history is a rounding error against that. A model trained on it will produce confident numbers, and those numbers will be noise wearing a lab coat.

The trap

With fifteen rows and forty variables you can fit anything. The backtest will look extraordinary. That is the symptom, not the achievement.


03 — The missing half

Lenders solved this in the 1950s and gave it a name.

A bank only sees repayment behaviour on the loans it approved. The declined applications have no outcome — nobody ever finds out whether they would have paid. Train on approvals alone and the model learns the shape of your own past approvals rather than the shape of creditworthiness. The bias compounds with every retrain.

The discipline built to patch this is called reject inference, and the credit bureaus have worked on it for seventy years. Your deal pipeline is the same problem in a different suit.

Worth knowing before you reach for it: recent work found the standard statistical fixes mostly produce what the authors call an illusion of improvement. Your metrics get better while your actual decisions do not. So do not infer the counterfactual. Go and get it.

What it is worth

Researchers studied venture selection using French tax records, which cover every company whether it raised money or not. Had those investors dropped the bottom half of their own portfolio by model prediction, average performance would have risen 48 percent. The model found more winners. The humans kept backing founders who fit the picture.

There is a business precedent too. Capital One was built on this exact insight. Fairbank and Morris were turned down by bank after bank pitching the idea that incumbents modeled only the customers they already had and treated everyone else as one undifferentiated risk bucket. The declined pile held the alpha. Nobody was looking, because nobody had outcome data on it.


04 — What to build

Two models. Build them in this order.

Build first

The fit model

Question: does this deal look like the ones we pursue?

Why it works: it needs no outcome data at all. The label is your own past decision, which you already have for every deal you ever saw. Hundreds of rows instead of fifteen.

What it buys: triage. Two hundred deals arrive, the model ranks them, a partner seriously reads the top twenty. It also never gets tired on a Friday afternoon or falls for a founder who looks the part.

Be honest about the limit: it predicts fit with your revealed preferences, not returns. If those preferences are wrong, it reproduces them faithfully — which is precisely why the second model has to follow.

Build second

The outcome model

Question: across the deals we did and the passed deals we can now track, what actually predicted a good result?

Blocked on: roughly a hundred labelled rows. You reach that by working the passed pile, not by waiting for more exits.

Define the target before the model: "did well" is not a column. Pick one measure and adjust it for vintage, because a 3× in 2019 and a 3× in 2024 are not the same achievement — one of them is mostly the market.

At small sample sizes a binary target, top half against bottom half of the vintage, is more honest than predicting a continuous multiple.


05 — The factors

Write the schema once, by hand. Then stop changing it.

The proprietary part of this is not the algorithm. It is that every deal you ever saw arrived with a memo, a CIM, or a set of notes, and nobody else has yours.

The instinct to have a model read those documents and generate factors is right. Run naively it fails: ask for a free description of each deal and you get two hundred one-off columns, where one deal is tagged "founder seems tired" and another "owner nearing retirement." Those are the same factor wearing different words. It is not a table and you cannot train on it.

  1. Write the schema once. Feed a model twenty or thirty deal documents and have it propose thirty to sixty factors, each with a name, a plain definition, and allowed values. Then edit that list by hand. This is the highest-value hour in the entire project.

  2. Extract against the fixed schema. Every document runs through the same columns. Missing values are fine and modern methods handle them natively.

  3. Verify thirty rows by hand. Extraction errors are silent and they poison everything downstream.

The factors worth having are the ones a data vendor cannot sell your competitor: owner situation, management depth below the CEO, quality of the financial records, systems maturity, whether the business has ever successfully raised price, whether the seller already has a number in mind, and how the deal reached you. Those live only in the documents.


06 — The failure mode

Leakage is what will quietly ruin this.

If any factor is drawn from a document that did not exist on the decision date, the model learns the answer instead of the signal. The backtest looks brilliant. Production is worthless.

Rule of thumb

If the model scores above roughly 85 percent on a first pass, assume contamination before you assume genius. That is almost always what it is.


07 — Why now

Small data stopped being a disqualification.

Large language models work because they read the internet before you ever typed a word. They arrive already knowing language.

Someone has now built the same thing for spreadsheets. It is called a tabular foundation model — "tabular" just meaning rows and columns. It was pre-trained on millions of synthetic tables, so it arrives already knowing what patterns in a spreadsheet look like. You hand it your deal history and it answers. No training run, no tuning, no data science hire.

The part that matters for a firm your size: it is built for small data. A few hundred rows is enough, and the published results have it outperforming carefully tuned gradient boosting in a single pass.

You do not have a million deals. You have a few hundred. Two years ago that ruled you out. It does not anymore.


08 — Explaining it

Show the comparable deals, not the bar chart.

These models return a probability, not a reason. Getting to "why" takes a second step, and there are two options.

The standard answer splits each prediction into per-factor contributions and draws the bar chart everyone expects. It works, but at small sample sizes the attributions are unstable — change two rows and the ranking shifts.

The better answer for this audience is to show the five most similar deals from history and what happened to them. This looks like these five you have seen. Two worked, three did not, and all three that failed had the same customer concentration problem.

An investor will trust that, because it is how they already think — by analogy to deals they remember. It is also more honest at low sample size, since you are showing the evidence rather than a statistic that implies more precision than you have.


09 — Sequence

What the first ninety days look like.

  1. Schema and target — about a week. Write the factor list by hand from a document sample. Define what "did well" means and adjust it for vintage. Set the leakage rules before anyone touches data.

  2. The fit model — about two weeks. Extract factors for every deal you ever saw. The label is your own past decision, so no outcome data is required. Split by time. Ship it with the comparable-deals explainer.

  3. Work the passed pile — ongoing. Attach real outcomes to the deals you declined. This is the slow, unglamorous, valuable part, and it is the reason nobody else has done this.

  4. The outcome model — once the rows exist. Only after the passed pile has produced enough labelled history. Binary target first. Continuous later, if ever.

The 197 know exactly what you are systematically wrong about.

I am building this on my own deal history from my years as an independent sponsor. If you want to talk through what it would look like on yours, I am happy to walk through the business case and the working demo.

rmiller@zavient.com