Nightly system tests pipelines

These Cardano node system tests are run on a nightly basis. The tests are run on multiple instances of a local cluster. The tests are run on the master branch of the cardano-node repository.

Several pipelines run the nightly system tests. In each pipeline, different sets of tests are run.

Test statuses

• failed - tests that failed assertion or that were aborted because of unhandled exception

• broken - tests that are affected by a real known issue; these are marked as xfailed (expected failure) until the issue is fixed

• skipped - tests that are not meant to run in the given pipeline

Nightly results

Results on Github Actions

• nightly:

  • network in Conway era

  • protocol version 9 (bootstrap phase)

  • mixed network topology (two stake pools P2P, two stake pools default topology)

  • Constitutional Commitee has 5 members

  • cluster starts directly in Conway era

• nightly-dbsync:

  • network in Conway era

  • protocol version 9 (bootstrap phase)

  • default (legacy) network topology

  • Constitutional Commitee has 5 members

  • cluster starts directly in Conway era

  • DB Sync testing enabled

• nightly-pv10:

  • network in Conway era

  • protocol version 10

  • P2P network topology

  • Constitutional Commitee has 5 members

  • cluster starts directly in Conway era

• nightly-dbsync-pv10:

  • network in Conway era

  • protocol version 10

  • P2P network topology

  • Constitutional Commitee has 5 members

  • cluster starts directly in Conway era

  • DB Sync testing enabled

• nightly-cli:

  • latest cardano-cli master

  • network in Conway era

  • protocol version 10

  • P2P network topology

  • Constitutional Commitee has 5 members

  • cluster starts directly in Conway era

Nightly upgrade testing

• Step 1:

  • use the latest cardano-node release for Mainnet

  • network in Conway era

  • protocol version 9 (bootstrap phase)

  • Constitutional Commitee has 5 members

  • default (legacy) network topology

  • smoke tests

  • governance info action test

• Step 2:

  • upgrade all nodes except one to the latest cardano-node master

  • mixed network topology (half nodes P2P, half nodes legacy topology)

  • update PlutusV3 cost models

  • smoke tests

• Step 3:

  • upgrade the last remaining node to latest cardano-node master

  • P2P network topology

  • hard fork to Conway protocol version 10

  • smoke tests

  • governance treasury withdrawal action test