In Progress

2025-11-07

Conformance Testing of Consensus

Weekly Report: 2025-11-07

  • Finished design document
    • Aligned on the conformance/system testing approach, treating nodes as black boxes and validating correct chain selection.
    • Reviewed and validated the test file general structure, where tests reference predefined properties, chain generators, and shrinkers resolved by the test runner.
    • Identified timing behavior as an open question and reviewed discrete-time versus wall-clock approaches.
    • Reached agreement that wall-clock execution with configurable timeouts is the simplest and most practical starting point.
    • Clarified that the test runner should generate a topology file for the node under test to connect to the simulated peers, with node restarts handled externally.
    • Confirmed that most existing Genesis consensus tests can be reused with minimal changes.
    • Included brief background context on property based testing non-Haskell audiences.
    • Created workflow diagrams.
  • Reorganization of project milestone and deliverables (with same end goal) for engineering considerations.