Chapter 8 — Independent review and defense
Lesson map
Lesson 08 published. Map, example, EX045.
flowchart TD
N0["Learning outcomes"]
N1["8.1 Independent review"]
N2["8.2 The defense"]
N3["8.3 Handing over"]
N4["8.4 Reflection"]
N0 --> N1 --> N2 --> N3 --> N4
N4 --> EX["Worked example"]
EX --> Q["Exercise EX045"]
Logical drawing
flowchart LR
N0["Learning outcomes"]
N1["8.1 Independent review"]
N2["8.2 The defense"]
N3["8.3 Handing over"]
N4["8.4 Reflection"]
N0 --> N1 --> N2 --> N3 --> N4 --> Q["EX045"]
[Learning outcomes]
|
v
[8.1 Independent review]
|
v
[8.2 The defense]
|
v
[8.3 Handing over]
|
v
[8.4 Reflection]
|
v
[Worked example] --> [Exercise EX045]
Learning outcomes
You will (1) obtain independent review of analysis; (2) defend a dissertation under questioning; (3) hand findings to an organisation responsibly.
8.1 Independent review
Before submission, a statistician from another department reruns Priya's scripts on the synthetic data and obtains the same figures. She suggests checking whether a few departments drive the result. Priya repeats the estimate leaving out each feedback department in turn; the direction holds each time, though one omission widens the interval to nearly touch zero. Priya reports this exploratory check, noting that with only three treated departments the result depends noticeably on each one. The statistician's report is included as an appendix with her permission.
8.2 The defense
At the defense, examiners ask why Harrowgate should trust a result from three departments. Priya answers that it should treat the result as encouraging but provisional, supporting a staged rollout with continued measurement rather than a full switch. Another examiner asks whether feedback is ethical if it shows staff their mistakes. She explains the department-level reporting, the absence of discipline and the rise in reports, which suggests staff did not experience feedback as punitive in this setting. The examiners record her answers.
8.3 Handing over
Priya presents the findings to Harrowgate's security committee, using the two-page summary. The committee agrees to extend feedback to two further departments and keep one comparison department for another two quarters. It also asks the platform supplier to include scanner addresses in exports, so future measurement can match addresses instead of timing. Priya archives her scripts, synthetic data and analysis plan in the university repository, so the committee or another student can repeat the study. The committee thanks the staff who took part in the study.
8.4 Reflection
Priya reflects that the most useful part of her work may be the scanner-click correction, which changes how the organisation reads every future simulation. The main estimate is promising but uncertain. She notes that the next course in this area, data governance, examines who decides how data such as simulation logs are defined and used, which matters because her outcome depended on such a definition. Dr. Bello agrees and recommends the scanner finding for a short practitioner paper. Priya begins drafting the paper.
Worked example
Priya passes independent review with a leave-one-out check, defends the result as provisional, hands over findings leading to a staged rollout and archives her materials.
Synthetic case. The review and defense are synthetic.
Errors and limits
Presenting a three-department result as definitive overstates certainty.
Exercises
- EX045 — Leave-one-out. What does leaving out each department show? Rubric: 3 = direction holds, one omission nearly touches zero;; 2 = partly correct;; 1 = vague;; 0 = none.
- EX046 — Trust answer. How should Harrowgate treat the result? Rubric: 3 = encouraging but provisional;; 2 = partly correct;; 1 = definitive;; 0 = none.
- EX047 — Ethics answer. What suggests feedback was not punitive? Rubric: 3 = reports rose;; 2 = partly correct;; 1 = vague;; 0 = none.
- EX048 — Committee decision. What does the committee decide? Rubric: 3 = extend to two departments, keep one comparison;; 2 = partly correct;; 1 = vague;; 0 = none.
- EX049 — Supplier request. What does the committee ask the supplier for? Rubric: 3 = scanner addresses in exports;; 2 = partly correct;; 1 = vague;; 0 = none.
- EX050 — Practitioner paper. What does Dr. Bello recommend for a practitioner paper? Rubric: 3 = the scanner finding;; 2 = partly correct;; 1 = other;; 0 = none.
Continue studying — lesson 08 (chapter 08 of 08)
← Chapter 07 · Course chapter index · Next course via chapter index →
The chapter index leads to the next course in the study path.