◇ OpenCyber Academy
Bachelor's · Chapter 37 · English

Chapter 37 — Evidence review seminar

Open, free learning for anyone who wants to protect people and technology. No account is required to read this text or its worked answers.

Chapter 37 — Evidence review seminar

Lesson map

Lesson 37 published. Map, example, EX109.

flowchart TD
  N0["Learning outcomes"]
  N1["37.1 The question"]
  N2["37.2 Strength of evidence"]
  N3["37.3 Balanced presentation"]
  N4["37.4 Using the review"]
  N5["Synthesis"]
  N0 --> N1 --> N2 --> N3 --> N4 --> N5
  N5 --> EX["Worked example"]
  EX --> Q["Exercise EX109"]

Logical drawing

flowchart LR
  N0["Learning outcomes"]
  N1["37.1 The question"]
  N2["37.2 Strength of evidence"]
  N3["37.3 Balanced presentation"]
  N4["37.4 Using the review"]
  N5["Synthesis"]
  N0 --> N1 --> N2 --> N3 --> N4 --> N5 --> Q["EX109"]

[Learning outcomes]
    |
    v
[37.1 The question]
    |
    v
[37.2 Strength of evidence]
    |
    v
[37.3 Balanced presentation]
    |
    v
[37.4 Using the review]
    |
    v
[Synthesis]
    |
    v
[Worked example] --> [Exercise EX109]

Learning outcomes

You will (1) review evidence for privacy interventions; (2) judge strength of evidence; (3) present a balanced review.

37.1 The question

In the evidence review seminar Elena asks: what evidence supports privacy training for staff in reducing incidents? She searches for studies and finds that many evaluate knowledge after training, fewer measure behaviour and very few measure incidents. She categorises studies by outcome measured. She learns that the outcome that matters most, fewer incidents, is the hardest to measure and the least studied. Most studies measure knowledge only. Few studies measured incidents directly, and those that did often lacked comparison groups. Measurement is hard.

37.2 Strength of evidence

Elena judges studies by design, sample size and outcome. A randomised study with incident outcomes would be strong; a survey of satisfaction with training is weak. Most of what she finds is in between. She applies the judgement to her trust's data: training completion rose while misdirected emails fell after technical changes, so training alone cannot be credited. She writes that the evidence supports training as part of a set of measures, not alone. Evidence remains weak. Confounders abound. Context matters greatly.

37.3 Balanced presentation

Elena presents her review to the seminar, giving the strongest evidence first and stating uncertainties clearly. A classmate argues that training is legally expected under accountability regardless of evidence. Elena agrees that it may be expected but says evidence should shape how training is designed. The discussion shows the difference between justifying an activity and designing it well. She presents what the studies show, what they cannot show and what the trust should therefore measure itself. Training remains worthwhile. Design matters most.

37.4 Using the review

Elena recommends that the trust measure incidents before and after future training changes and combine training with technical measures. She also suggests sharing anonymised results with other trusts to build evidence. Dr. Asante notes that practitioners can contribute evidence by measuring carefully, and that the field needs more such contributions to move beyond assumptions. She recommends that the trust records incidents before and after each training change, so that in two years it has evidence of its own rather than borrowed assumptions.

Worked example

Elena finds little evidence linking training to fewer incidents, judges studies by design and outcome, notes that her trust's email reduction followed technical changes and recommends measuring future changes.

Synthetic case. The review is synthetic.

Errors and limits

A short review may miss studies; record search methods.

Exercises

Synthesis

Chapter 37 reviews evidence. Chapter 38 implements the capstone.

Continue studying — chapter 37 of 40

← Chapter 36 (draft) · Course chapter index · Chapter 38 (draft) →