◇ OpenCyber Academy
Engineering · Chapter 46 · English

Chapter 46 — Engineering capstone II

Open, free learning for anyone who wants to protect people and technology. No account is required to read this text or its worked answers.

Chapter 46 — Engineering capstone II

Lesson map

Lesson 46 published. Map, example, EX080.

flowchart TD
  N0["Learning outcomes and connection"]
  N1["46.1 Finishing the build"]
  N2["46.2 Executing verification"]
  N3["46.3 Critical design review"]
  N4["46.5 Practical activity"]
  N5["Chapter synthesis"]
  N0 --> N1 --> N2 --> N3 --> N4 --> N5
  N5 --> EX["Worked example"]
  EX --> Q["Exercise EX080"]

Logical drawing

flowchart LR
  N0["Learning outcomes and connection"]
  N1["46.1 Finishing the build"]
  N2["46.2 Executing verification"]
  N3["46.3 Critical design review"]
  N4["46.5 Practical activity"]
  N5["Chapter synthesis"]
  N0 --> N1 --> N2 --> N3 --> N4 --> N5 --> Q["EX080"]
[Learning outcomes and connection]
    |
    v
[46.1 Finishing the build]
    |
    v
[46.2 Executing verification]
    |
    v
[46.3 Critical design review]
    |
    v
[46.5 Practical activity]
    |
    v
[Chapter synthesis]
    |
    v
[Worked example] --> [Exercise EX080]

Learning outcomes and connection

After this chapter you can (1) complete implementation of the capstone artefact; (2) execute the full verification plan and record results; (3) close review findings; and (4) pass a critical design review with evidence. It continues Chapter 44 after the independent review and prepares the failure and recovery trial (Chapter 47).

46.1 Finishing the build

Freeze scope: new features now threaten verification. Close the review findings that require design changes first. Keep the main branch always passing its tests; tag the version that enters final verification.

For the TMRP capstone, scope was frozen after the independent review. F2's stale-station alarm was the design change made before the tagged version entered final verification; every later idea went to a list for future work. The restart fix came later, as a correction found by verification itself, which is the only kind of change allowed after a freeze. The main branch stayed green.

46.2 Executing verification

Run the full verification plan against the tagged version: unit, integration, property-based and fault-injection tests (Chapters 30 and 40). Record each result with version, seed and environment. For any failure: record, analyse, fix, re-run, record again. Do not overwrite earlier results; history is evidence.

For the TMRP capstone, the receiver's failure to reject replays after a restart was recorded, fixed by persisting the last counter per station, and re-tested, with both results kept. The tagged version was the one tested. Its seed was recorded.

46.3 Critical design review

At the critical design review the panel checks: requirements met with evidence; review findings closed or dispositioned; residual risks stated and owned; operations and maintenance prepared; and readiness for the trial. Bring the traceability matrix, verification results, finding log and assurance case.

For TMRP, the panel saw the verification summary below. It includes the restart failure and its fix, the stale-station alarm added after F2 and the key rotation demonstration. With F1 to F3 closed or dispositioned and R6 reported honestly, the panel could make an explicit readiness decision for the trial instead of an assumption.

46.4 Worked example: capstone verification summary (synthetic)

Requirement Tests Result Notes
R1 T1, T2, campaign (corrupt class) Pass 0 silent failures in 10,000 messages
R2 T2, restart tests (both sides), campaign (replay, reorder, restart) Pass after fix Receiver restart initially accepted replays; fixed by persisting last counter per station; re-tested
R7 T5, stale-station alarm test Pass after fix Drop detection added after F2
Key rotation Demonstration Pass Overlap window of 10 min with both keys accepted, then old key revoked

The restart failure was found by the extended fault model of EX080 — a direct return on the verification laboratory's investment.

46.5 Practical activity

Run your full verification plan and produce the summary table with links to raw results.

For each requirement, give the tests, the result and any fix, as in the TMRP summary. Keep the failed results with their dates and the fixes that followed, and link each line to the raw result files with their seeds and versions. If a test was not run, say so in the table rather than leaving it blank. The table should let a reviewer trace any claim to a file in one step.

46.6 Common errors and limits

The TMRP capstone avoided these by freezing scope after review, keeping the restart failure in the record beside its later pass, and closing F1 to F3 before the critical design review. Failed results stayed in the record with the fixes that followed, so reviewers could see how each pass was earned. No feature was added during verification. Open findings were closed first.

Exercises — chapter 46

EX091 — Rotation design. Objective: design key rotation without loss. Inputs: §46.4. Steps: describe the rotation protocol step by step, including how the receiver knows which key to try, the overlap window, failure handling and revocation. Expected evidence: procedure. Rubric: 3 = key ID in authenticated header, receiver accepts both keys during window, counters continue, rollback if new key fails, old key revoked and destroyed; 2 = no key ID; 1 = "change the key"; 0 = none.

EX092 — Readiness decision. Objective: judge readiness. Inputs: all requirements pass except a minor finding on documentation and an open major finding that the stale-station alarm threshold (60 s) produces two false alarms a day during LTE congestion. Steps: recommend go / go with conditions / no-go for the trial, with reasoning. Expected evidence: recommendation. Rubric: 3 = go with conditions (threshold tuning study during trial, operators briefed), reasoning about consequence of false alarms vs missed loss of data; 2 = no conditions; 1 = unreasoned; 0 = none.

Chapter synthesis

Freeze scope, close findings, verify the tagged version completely and keep failure history as evidence. Enter the critical design review with traceability, results, findings and the assurance case, and leave it with an explicit readiness decision.

Continue studying — chapter 46 of 50

← Chapter 45 · Course chapter index · Chapter 47 →

Continue to the next authored lesson.