Chapter 2 — Threat intelligence and OSINT: research frontier
Lesson map
Lesson 02 published. Map, example, EX008.
flowchart TD
N0["Learning outcomes"]
N1["2.1 Three models, three claims"]
N2["2.2 Open problems"]
N3["2.3 OSINT method frontier"]
N4["2.4 Writing the gap"]
N5["Synthesis"]
N0 --> N1 --> N2 --> N3 --> N4 --> N5
N5 --> EX["Worked example"]
EX --> Q["Exercise EX008"]
Logical drawing
flowchart LR
N0["Learning outcomes"]
N1["2.1 Three models, three claims"]
N2["2.2 Open problems"]
N3["2.3 OSINT method frontier"]
N4["2.4 Writing the gap"]
N5["Synthesis"]
N0 --> N1 --> N2 --> N3 --> N4 --> N5 --> Q["EX008"]
[Learning outcomes]
|
v
[2.1 Three models, three claims]
|
v
[2.2 Open problems]
|
v
[2.3 OSINT method frontier]
|
v
[2.4 Writing the gap]
|
v
[Synthesis]
|
v
[Worked example] --> [Exercise EX008]
Learning outcomes
You will (1) map the main open problems in CTI method; (2) distinguish models (kill chain, Diamond, ATT&CK) by what they claim; (3) identify where evidence in the literature is thin; (4) write a gap statement that a reviewer cannot dismiss as a literature summary.
2.1 Three models, three claims
Hutchins, Cloppert and Amin (2011) proposed the intrusion kill chain — reconnaissance, weaponization, delivery, exploitation, installation, command and control, actions on objectives — and argued that defenders win by breaking any link and by analysing campaigns rather than single incidents. Caltagirone, Pendergast and Betz (2013) proposed the Diamond Model: every event has adversary, capability, infrastructure and victim, and analysts pivot along the edges. MITRE ATT&CK is a curated knowledge base of observed tactics, techniques and groups. The first is a defensive strategy, the second an analytic ontology, the third an empirical catalogue. Research that treats them as interchangeable will confuse its own claims.
2.2 Open problems
Several questions remain weakly evidenced: how well confidence language in reports predicts later confirmation; how much indicator sharing actually reduces harm (NIST SP 800-150 describes how to share, not how much benefit results); how reproducible attribution is between independent teams; and how to measure the value of strategic intelligence for decision-makers. Each is researchable with careful design and synthetic or consented data.
Tomas's thesis takes the first question. The others suit different designs: harm reduction from sharing would need outcome data from organisations, and reproducibility of attribution would need independent teams working on the same artefacts, which is why they appear as follow-on work rather than in his proposal.
2.3 OSINT method frontier
Open-source investigation has grown faster than its validation. Questions include geolocation error rates, the reliability of archived web captures, and the privacy costs of aggregating individually harmless public facts. Doctoral work here must weigh research value against the harm of building aggregation tools.
Tomas's corpus deliberately avoids this frontier: it uses reports, not people, and the forum corpus was dropped. A thesis that geolocated images or linked public profiles would need a far heavier ethics file, because each step of aggregation can create a profile of a person that no single public fact revealed.
2.4 Writing the gap
A good gap statement has three parts: what is known (with citations), what is not known (stated precisely), and why it matters to a decision. "Little research exists on CTI" is not a gap; "no published study measures calibration of estimative language in vendor CTI reports against later confirmation" is.
Tomas's own statement follows the three parts: the norm is known, since ICD 203 requires expressing uncertainty and Kent proposed an estimative vocabulary; no measurement of calibration in commercial CTI appeared among the 40 papers and reports he reviewed; and it matters because SOC teams decide whether to block on the strength of those phrases.
Worked example
Tomas reviews 40 papers and reports. He finds many descriptions of ICD 203's requirement to express uncertainty and of Kent's estimative-probability vocabulary, but no measurement of calibration in commercial CTI. His gap statement names that absence, cites Kent and ICD 203 for the norm, and links it to SOC decision-making about blocking.
Synthetic case. Tomas's review count and gap statement are invented.
Errors and limits
Vendor blogs are evidence of practice, not peer-reviewed findings; label them. Frontier enthusiasm does not justify building surveillance tooling.
Exercises
- EX008 — Model claims. In one line each, state what kind of thing the kill chain, the Diamond Model and ATT&CK are. Rubric: 3 = strategy/phase model; event ontology; empirical knowledge base; 2 = two right; 1 = one; 0 = none.
- EX009 — Weak gap. Rewrite "there is not much research on threat sharing" as a precise gap. Rubric: 3 = specific unknown + population + measure; 2 = more specific but unmeasurable; 1 = unchanged; 0 = none.
- EX010 — Diamond pivot. Name the four core features and one pivot an analyst could make. Rubric: 3 = adversary, capability, infrastructure, victim + valid pivot (e.g. infrastructure→other victims); 2 = features only; 1 = partial; 0 = none.
- EX011 — Aggregation harm. Why can combining harmless public facts about a person create an ethical problem for OSINT research? Rubric: 3 = aggregation enables identification/profiling/harm; data-protection duties; 2 = privacy mention; 1 = no problem; 0 = none.
- EX012 — Source grading. How should Tomas cite a vendor blog in his literature review? Rubric: 3 = cite but label as grey literature/practice evidence, not peer-reviewed; 2 = cite with caution; 1 = treat as peer-reviewed; 0 = none.
- EX013 — SP 800-150 scope. What does NIST SP 800-150 provide, and what does it not measure? Rubric: 3 = guidance on sharing relationships/practices; not empirical benefit measurement; 2 = one half; 1 = wrong; 0 = none.
- EX014 — Kill-chain thesis. State the central defensive argument of Hutchins et al. in one sentence. Rubric: 3 = break any phase + campaign analysis/intelligence-driven defence; 2 = break the chain only; 1 = unrelated; 0 = none.
Synthesis
Know what each model claims, find gaps that are precise and decision-linked, and weigh OSINT research value against aggregation harm.
Continue studying — chapter 02 of 08
← Chapter 01 (draft) · Course chapter index · Chapter 03 (draft) →