◇ OpenCyber Academy
Master's · Chapter 8 · English

Chapter 8 — Independent review and defense

Open, free learning for anyone who wants to protect people and technology. No account is required to read this text or its worked answers.

Chapter 8 — Independent review and defense

Lesson map

Lesson 08 published. Map, example, EX045.

flowchart TD
  N0["Learning outcomes"]
  N1["8.1 External examination"]
  N2["8.2 Answering the intermediate question"]
  N3["8.3 Questions about the cryptography"]
  N4["8.4 Dissemination to practitioners"]
  N5["8.5 Closing the study"]
  N6["Synthesis"]
  N0 --> N1 --> N2 --> N3 --> N4 --> N5 --> N6
  N6 --> EX["Worked example"]
  EX --> Q["Exercise EX045"]

Logical drawing

flowchart LR
  N0["Learning outcomes"]
  N1["8.1 External examination"]
  N2["8.2 Answering the intermediate question"]
  N3["8.3 Questions about the cryptography"]
  N4["8.4 Dissemination to practitioners"]
  N5["8.5 Closing the study"]
  N6["Synthesis"]
  N0 --> N1 --> N2 --> N3 --> N4 --> N5 --> N6 --> Q["EX045"]

[Learning outcomes]
    |
    v
[8.1 External examination]
    |
    v
[8.2 Answering the intermediate question]
    |
    v
[8.3 Questions about the cryptography]
    |
    v
[8.4 Dissemination to practitioners]
    |
    v
[8.5 Closing the study]
    |
    v
[Synthesis]
    |
    v
[Worked example] --> [Exercise EX045]

Learning outcomes

You will (1) prepare for independent examination of a cryptography operations study; (2) answer challenges with evidence from the package; (3) plan dissemination to practitioners.

8.1 External examination

Coldwater appoints an external examiner who works on public-key infrastructure at another university. She receives the dissertation, the pseudonymised dataset and the reproducibility package, and reruns the analysis before the defense. Her pre-defense report agrees with the rate ratio and interval but questions two choices: coding expired intermediates as expiry incidents, and the decision to report unknown renewal modes separately. Felipe prepares a short response to each, pointing to the pilot log, the RFC 5280 path-validation rule and the sensitivity check, rather than restating his conclusions.

8.2 Answering the intermediate question

The examiner argues that an expired intermediate is the issuing authority's fault, not Briarwood's. Felipe answers that clients experienced the same failure either way, that Briarwood chose to serve that chain and was responsible for updating it, and that RFC 5280 path validation rejects any expired certificate in the path. He then shows the sensitivity result: removing the two intermediate cases changes the overall rate ratio from 5.48 to about 5.2, so the conclusion does not depend on the choice. Showing the alternative calmly answers the objection better than defending the original rule.

8.3 Questions about the cryptography

A committee member asks whether moving to post-quantum certificates would change the findings. Felipe answers that ML-DSA from FIPS 204 and SLH-DSA from FIPS 205 bring larger keys and signatures, and possibly hybrid chains during transition, but renewal remains an operational process. If anything, migration adds risk: new client versions, new certificate profiles and more changes, each a chance for the change collisions his study observed. He suggests that the ownership and monitoring recommendations become more, not less, important during migration. He declines to predict incident rates for migration, since his data contain none.

8.4 Dissemination to practitioners

After the defense Felipe writes a four-page practitioner summary for Briarwood and similar hospitals. It gives the rates and interval in plain language, a checklist of three actions (automate where possible, name an owner for every certificate, alert on renewal failures), and the clarification box on what the study does not imply. Briarwood's infrastructure lead reviews it to ensure no internal hostnames or architecture appear. Felipe also offers the anonymised codebook and linking rules for reuse, so other organisations can measure their own expiry rates in the same units.

8.5 Closing the study

Felipe closes the study formally. The ethics committee receives a final report, and Briarwood destroys the HMAC pseudonymisation key according to its own key-destruction procedure, consistent with SP 800-57 Part 1's lifecycle phases, so that even Felipe's dataset can no longer be linked back to hostnames. The reproducibility package stays available with a note that re-linking is impossible by design. Dr. Solberg reminds him that destroying the key is part of the study's ethics, not an inconvenience: a pseudonym is only as strong as the protection of its key.

Worked example

Felipe answers the examiner's intermediate-certificate objection with a sensitivity result (5.48 to about 5.2), relates post-quantum migration to change-collision risk, and closes the study by having Briarwood destroy the pseudonymisation key.

Synthetic note. The examiner, committee and figures are invented; FIPS 204, FIPS 205 and SP 800-57 are real.

Errors and limits

Defensive answers that repeat conclusions convince no one; show alternatives and their effect. Never retain a pseudonymisation key past the study's need.

Exercises

Synthesis

Independent rerun, calm sensitivity answers, practitioner dissemination and a deliberate key destruction complete a master's study that others can verify and use.

Continue studying — chapter 08 of 08

← Chapter 07 (draft) · Course chapter index · Worked results ↓ · Next course via chapter index →