Chapter 6 — Peer critique and revision
Lesson map
Lesson 06 published. Map, example, EX033.
flowchart TD
N0["Learning outcomes"]
N1["6.1 Receiving critique"]
N2["6.2 Sorting objections"]
N3["6.3 Revising analyses"]
N4["6.4 Learning from critique"]
N5["Synthesis"]
N0 --> N1 --> N2 --> N3 --> N4 --> N5
N5 --> EX["Worked example"]
EX --> Q["Exercise EX033"]
Logical drawing
flowchart LR
N0["Learning outcomes"]
N1["6.1 Receiving critique"]
N2["6.2 Sorting objections"]
N3["6.3 Revising analyses"]
N4["6.4 Learning from critique"]
N5["Synthesis"]
N0 --> N1 --> N2 --> N3 --> N4 --> N5 --> Q["EX033"]
[Learning outcomes]
|
v
[6.1 Receiving critique]
|
v
[6.2 Sorting objections]
|
v
[6.3 Revising analyses]
|
v
[6.4 Learning from critique]
|
v
[Synthesis]
|
v
[Worked example] --> [Exercise EX033]
Learning outcomes
You will (1) respond to expert critique of a quantitative risk study; (2) separate methodological from philosophical objections; (3) revise claims and analyses.
6.1 Receiving critique
Amara presents her results at a doctoral workshop and submits a paper draft. Reviewers raise four points. A risk manager argues that boards understand matrices and may disengage from probability ranges. A statistician notes that thirty events are too few for confident calibration claims. An auditor asks how quantitative estimates would be evidenced for ISO/IEC 27001:2022 certification. A philosopher of science questions whether loss magnitudes for rare cyber events can ever be estimated meaningfully. Amara records each point and its source before responding.
6.2 Sorting objections
Amara sorts the critique. The statistician's point is methodological and can be addressed with more data or more cautious claims. The auditor's point is practical: ISO/IEC 27001:2022 requires a documented and repeatable risk assessment process, which a quantitative method can satisfy if its inputs and reasoning are recorded. The board engagement point is an empirical question she can partly test. The philosophical objection about rare events cannot be resolved by her data, so she acknowledges it as a limit of all risk assessment, matrix or quantitative.
6.3 Revising analyses
Amara revises. She adds a bootstrap interval for the Brier difference, which includes zero, and changes her wording from improves calibration to shows a small, uncertain improvement. She adds a short study with Corvane's board, presenting the same risks both ways, and records which presentation board members found more useful for decisions. Most preferred loss exceedance charts once explained, though two preferred the matrix. She adds an appendix describing how quantitative records map to the documented process expected by ISO/IEC 27001:2022.
6.4 Learning from critique
Prof. Delgado notes that good critique sharpens a thesis by forcing precise claims. Amara reflects that her early enthusiasm for quantification led her to underweight the social role of matrices in communication and governance. She now frames her contribution as evidence about trade-offs rather than a verdict that one method is superior. This change makes her work more useful to practitioners, who must balance accuracy, cost, explainability and audit expectations, and more defensible before examiners. She thanks each reviewer and lists every change in a response table for transparency.
Worked example
Amara sorts four critiques, adds a bootstrap interval that includes zero, tests board presentation and reframes her contribution as evidence about trade-offs.
Synthetic case. Critiques and results are synthetic; ISO/IEC 27001:2022 is real.
Errors and limits
Board studies are small. Reframing can weaken claims too much.
Exercises
- EX033 — Statistician point. What did the statistician object to? Rubric: 3 = thirty events are too few;; 2 = sample size;; 1 = vague;; 0 = none.
- EX034 — Auditor answer. How can quantitative methods meet ISO/IEC 27001:2022 expectations? Rubric: 3 = by recording inputs and reasoning in a repeatable process;; 2 = documentation;; 1 = vague;; 0 = none.
- EX035 — Unresolvable objection. Which objection cannot be resolved by Amara's data? Rubric: 3 = whether rare-event losses can be meaningfully estimated;; 2 = philosophical;; 1 = vague;; 0 = none.
- EX036 — Bootstrap result. What did the bootstrap interval for the Brier difference show? Rubric: 3 = it includes zero;; 2 = uncertain;; 1 = significant;; 0 = none.
- EX037 — Board preference. Which presentation did most board members prefer? Rubric: 3 = loss exceedance charts once explained;; 2 = exceedance;; 1 = matrix;; 0 = none.
- EX038 — Reframed contribution. How did Amara reframe her contribution? Rubric: 3 = evidence about trade-offs, not a verdict;; 2 = trade-offs;; 1 = superiority;; 0 = none.
Synthesis
Critique sorted by type leads to more precise claims and a more useful contribution.
Continue studying — chapter 06 of 08
← Chapter 05 (draft) · Course chapter index · Chapter 07 (draft) →