Nightly system tests pipelines

These Cardano node system tests are run on a nightly basis. The tests are run on multiple instances of a local cluster. The tests are run on the master branch of the cardano-node repository.

Several pipelines run the nightly system tests. In each pipeline, different sets of tests are run.

Test statuses

  • failed - tests that failed assertion or that were aborted because of unhandled exception

  • broken - tests that are affected by a real known issue; these are marked as xfailed (expected failure) until the issue is fixed

  • skipped - tests that are not meant to run in the given pipeline

Nightly results

Results on Github Actions

  • nightly: nightly-badge
    • network in Babbage era

    • Babbage transaction era

    • default (legacy) network topology

    • cluster starts directly in Babbage era

  • nightly-dbsync: nightly-dbsync-badge
    • network in Babbage era

    • Babbage transaction era

    • default (legacy) network topology

    • DB Sync testing enabled

  • nightly-p2p: nightly-p2p-badge
    • network in Babbage era

    • Babbage transaction era

    • P2P network topology

  • nightly-mixed: nightly-mixed-badge
    • network in Babbage era

    • default transaction era

    • mixed network topology (two stake pools P2P, two stake pools default topology)

  • nightly-alonzo-tx: nightly-alonzo-tx-badge
    • network in Babbage era

    • Alonzo transaction era

    • default (legacy) network topology

    • skip long-running tests

    • cluster starts directly in Babbage era

  • nightly-conway-cc: nightly-conway-cc-badge
    • network in Conway era

    • P2P network topology

    • Constitutional Commitee has 3 members

    • cluster starts directly in Conway era

  • nightly-conway-no-cc: nightly-conway-nocc-badge
    • network in Conway era

    • P2P network topology

    • Constitutional Commitee has 0 members

    • cluster starts directly in Conway era

Nightly upgrade testing

  • Step 1: nightly-upgrade-step1-badge
    • use the latest cardano-node release for Mainnet

    • network in Babbage era

    • Babbage transaction era

    • default (legacy) network topology

    • smoke tests

  • Step 2: nightly-upgrade-step2-badge
    • upgrade all nodes except one to latest cardano-node master

    • network in Babbage era

    • Babbage transaction era

    • mixed network topology (half nodes P2P, half nodes legacy topology)

    • smoke tests

  • Step 3: nightly-upgrade-step3-badge
    • upgrade the last remaining node to latest cardano-node master

    • network in Babbage era

    • Babbage transaction era

    • P2P network topology

    • smoke tests