Chapter 10 — Research reading and critique
Lesson map
Lesson 10 published. Map, example, EX046.
flowchart TD
N0["Learning outcomes"]
N1["10.1 Reading strategy"]
N2["10.2 Assessing methods"]
N3["10.3 Relating to practice"]
N4["Synthesis"]
N0 --> N1 --> N2 --> N3 --> N4
N4 --> EX["Worked example"]
EX --> Q["Exercise EX046"]
Logical drawing
flowchart LR
N0["Learning outcomes"]
N1["10.1 Reading strategy"]
N2["10.2 Assessing methods"]
N3["10.3 Relating to practice"]
N4["Synthesis"]
N0 --> N1 --> N2 --> N3 --> N4 --> Q["EX046"]
[Learning outcomes]
|
v
[10.1 Reading strategy]
|
v
[10.2 Assessing methods]
|
v
[10.3 Relating to practice]
|
v
[Synthesis]
|
v
[Worked example] --> [Exercise EX046]
Learning outcomes
You will (1) read GRC research critically; (2) assess methods and claims; (3) relate findings to practice.
10.1 Reading strategy
Daniel reads four sources: Gordon and Loeb (2002) on security investment economics, Cox (2008) on risk matrices, Spears and Barki (2010) on user participation in security risk management and Hubbard and Seiersen (2016) on measurement. For each he records the question, method, data, main claim and limits. He learns that reading research for practice means asking not only whether a claim is true but whether it applies to his organisation's setting. Recording the same five fields for each source makes it easier to compare the analytical, survey and practice-based work that follows.
10.2 Assessing methods
Gordon and Loeb offer an analytical model with assumptions about vulnerability and loss functions; its insight that optimal investment is bounded is robust, but exact numbers depend on assumptions. Cox analyses mathematical properties of matrices; his conclusions are logical rather than empirical. Spears and Barki use survey data and interviews with managers; findings depend on context. Hubbard and Seiersen synthesise practice and research to argue for quantification. Daniel notes the different kinds of evidence each provides. A logical argument like Cox's can show that matrices mislead in principle, but it cannot say how often they misled Halbrook's own committee.
10.3 Relating to practice
Daniel relates each source to Halbrook. Gordon and Loeb support comparing investments with expected loss reduction. Cox supports moving away from matrices for board reporting. Spears and Barki support involving business owners in supplier risk decisions, which tiering did. Hubbard and Seiersen support calibration training for estimators. He writes a critique noting that none studied an insurer's supplier oversight directly, so his own evaluation adds local evidence. His tiering evaluation of twenty reviews is the local evidence that the published sources could not supply.
Worked example
Daniel reads four sources, records method and limits, distinguishes analytical from empirical evidence and links each to Halbrook's practice.
Synthetic case. The critique is synthetic; all four sources are real.
Errors and limits
Summaries simplify sources. Settings differ from Halbrook's.
Exercises
- EX046 — Reading fields. What does Daniel record for each source? Rubric: 3 = question, method, data, main claim, limits;; 2 = five;; 1 = vague;; 0 = none.
- EX047 — Cox evidence. What kind of evidence does Cox (2008) provide? Rubric: 3 = logical analysis of matrix properties;; 2 = analytical;; 1 = empirical;; 0 = none.
- EX048 — Spears method. What method do Spears and Barki (2010) use? Rubric: 3 = survey data and interviews with managers;; 2 = survey;; 1 = vague;; 0 = none.
- EX049 — Gordon-Loeb practice. How does Gordon and Loeb's work apply at Halbrook? Rubric: 3 = comparing investments with expected loss reduction;; 2 = investment;; 1 = vague;; 0 = none.
- EX050 — Research gap. What gap does Daniel's evaluation fill? Rubric: 3 = none studied insurer supplier oversight directly;; 2 = local evidence;; 1 = vague;; 0 = none.
Synthesis
Critical reading separates kinds of evidence and checks whether findings fit the setting.
Continue studying — chapter 10 of 12
← Chapter 09 (draft) · Course chapter index · Chapter 11 (draft) →