OpenCyber Academy
Postgraduate · Chapter 10 · English
Course code: OCA-157Chapter 10: OCA-157-C010

Chapter 10 — Research reading and critique

Open, free learning for anyone who wants to protect people and technology. No account is required to read this text or its worked answers.

Lesson map

Lesson 10 published. Map, example, EX046.

flowchart TD
  N0["Learning outcomes"]
  N1["10.1 Reading purpose"]
  N2["10.2 Abstract checklist"]
  N3["10.3 Citation theatre"]
  N4["10.4 Transfer"]
  N5["10.6 Seminar"]
  N6["10.7 Narrative"]
  N7["10.8 Silent-thirty metric"]
  N0 --> N1 --> N2 --> N3 --> N4 --> N5 --> N6 --> N7
  N7 --> EX["Worked example"]
  EX --> Q["Exercise EX046"]

Logical drawing

flowchart LR
  N0["Learning outcomes"]
  N1["10.1 Reading purpose"]
  N2["10.2 Abstract checklist"]
  N3["10.3 Citation theatre"]
  N4["10.4 Transfer"]
  N5["10.6 Seminar"]
  N6["10.7 Narrative"]
  N7["10.8 Silent-thirty metric"]
  N0 --> N1 --> N2 --> N3 --> N4 --> N5 --> N6 --> N7 --> Q["EX046"]

[Learning outcomes]
    |
    v
[10.1 Reading purpose]
    |
    v
[10.2 Abstract checklist]
    |
    v
[10.3 Citation theatre]
    |
    v
[10.4 Transfer]
    |
    v
[10.6 Seminar]
    |
    v
[10.7 Narrative]
    |
    v
[10.8 Silent-thirty metric]
    |
    v
[Worked example] --> [Exercise EX046]

Learning outcomes

You will (1) critique abstracts on purple-team and threat-led methods; (2) demand n and limits; (3) connect papers to MCH decisions; (4) reject citation theatre.

10.1 Reading purpose

Amira reads to improve MCH decisions, not to decorate reports with names, and she opens the sources she cites.

"""Lab 10: checklist score for a synthetic paper abstract on purple-team methods."""
abs_ = {"question":True,"method":True,"n":False,"limits":True,"ethics":True}
for k,v in abs_.items():
    print(f"{k:8} {'ok' if v else 'MISSING'}")
print("pass" if all(abs_.values()) else "revise")

Run with python3 lab_critique.py. Verified output:

question ok
method   ok
n        MISSING
limits   ok
ethics   ok
revise

lab_critique scores a synthetic abstract on question, method, n, limits and ethics; the missing n prints MISSING and the verdict revise. Without n, nobody can tell whether the abstract's purple-team claim rests on three exercises or thirty, so the paper cannot yet inform a decision at Meridian Clearing House. The abstract goes back to its authors with that single question.

10.2 Abstract checklist

The abstract checklist asks whether question, method, n, limits and ethics are present, and lab_critique marks each field ok or MISSING. Each field marked MISSING becomes a question the presenter must answer before the paper can inform a DEC record. Presenters are scored against that same checklist, so the lab and the seminar reward identical habits. Limits that a presenter omits are added to the feedback sheet in writing, and kindness about nerves does not extend to missing limits.

10.3 Citation theatre

Footnotes to unread papers are unethical in assurance contexts, because unread footnotes become unread confidence in board language. Every citation in a board pack links to a source someone on the team has actually opened and summarised, and anyone who quotes the TIBER-EU or CBEST guides to executives is expected to have read the relevant guide in full. A paper club culture that bluffs citations will eventually bluff assurance language to the board, so Amira opens sources and expects juniors to do the same.

10.4 Transfer

A paper without operationalisable actions gets a "watch" tag, not a programme change. Transfer into Meridian Clearing House work needs a clear action, an owner and a fit to the catalogue. Amira will not rewrite DEC-14 because a paper sounded exciting. A watch-tagged paper is revisited at the next twice-yearly catalogue review to see whether an action has emerged; if one has, it enters the catalogue through a decision object like any other change, with options, evidence and an owner.

10.5 Limits empathy

Generous reading still requires a limits section, and missing limits fail the checklist even when the abstract is otherwise strong. In the synthetic abstract the limits field is present, which is why only the missing n keeps it from passing. Amira is kind about nerves and unkind about missing limits, because empathy without standards produces soft assurance that examiners will not accept. A presenter who reads a paper sympathetically is still expected to say what it cannot show. A paper whose authors state their limits plainly earns more trust in the club, not less.

10.6 Seminar

The monthly paper club runs with the critique checklist on the wall: a printed lab_critique output, taped beside the club schedule, showing question, method, limits and ethics marked ok and ending with revise. The single MISSING line for n stands out across the room. When someone skips n, Amira points at MISSING without speaking, which keeps the correction about the checklist rather than the presenter's competence. Operators now verify n before they offer to present, which raised pre-check rates without naming individuals.

10.7 Narrative

Paper club fails any presenter who cannot state n from memory after reading. The rule applies to Amira too when she presents, which stops it reading as a test that only juniors face. Transfer of critique skill includes letting a junior chair the club while she stays silent for the first thirty minutes. During those thirty minutes the junior chair, not Amira, decides whether a presenter who missed n may continue. She notes the minute she first speaks, which is the number the silent-thirty metric tracks.

10.8 Silent-thirty metric

The silent-thirty metric tracks how long Amira stays quiet at paper club; the goal is a longer figure each quarter as juniors lead. Each quarter's figure goes into the club log beside the name of the junior who chaired. A rising number is evidence that juniors run debriefs without waiting for her, and she celebrates it in the same tone she uses for clean catalogues. Succession of critique skill matters as much as succession of DEC-14, and this number is the evidence that it is happening.

10.9 Pre-check rates

Since the checklist poster went up, presenters arrive with n written on their first slide. Amira measures pre-check rates each term — the share of presenters who verified n before volunteering — and publishes them without naming people, so the habit spreads without a blame list. A falling rate prompts a reminder at the next club, not a conversation with any individual. The rates also show newcomers that checking n is the club's ordinary standard rather than a rule invented for them.

10.10 Cohort posters

Pre-check rate posters use cohort letters, never names, so teams can compare rates without singling out any individual operator and a low rate leads to coaching rather than blame. Cohort A and cohort B appear side by side, each rate printed with the number of presentations behind it. Amira has rejected a draft poster that used initials. The rule matches amnesty slide discipline: counts and patterns, never initials on a public poster. Raw per-person figures stay with the club chair for coaching only.

Worked example (synthetic MCH)

lab_critique returns revise because n is MISSING; Amira sends the abstract back to the authoring team.

Synthetic case — Meridian Clearing House (MCH). The clearing organisation, Amira Hassan and all figures are invented for teaching.

Errors and limits

Threat-led and clearing-system tests require specialised legal authorization. This book uses synthetic scenarios only and never supplies exploit code or live targeting advice for market infrastructures.

Exercises

Synthesis

Critique demands n, limits and ethics; unread citations are theatre.

Continue studying — chapter 10 of 12

← Chapter 09 (draft) · Course chapter index · Chapter 11 (draft) →

Worked answers

EX046. n

EX047. revise

EX048. It misleads readers about the evidence basis of claims.

EX049. When it offers no operationalisable action for MCH.

EX050. Question, method, n, limits and ethics.