Cardano Updates

Co-authored-by: Agustin Mista <[email protected]>
Co-authored-by: Alexander Esgen <[email protected]>
Co-authored-by: Georgy Lukyanov <[email protected]>
Co-authored-by: Thomas BAGREL <[email protected]>
Co-authored-by: Nicolas BACQUEY <[email protected]>
Co-authored-by: Nicolas "Niols" Jeannerod <[email protected]>

* mithril-cardano-node-internal-database from `0.1.10` to `0.1.11`
* mithril-test-lab/mithril-devnet/VERSION from `0.4.29` to `0.4.30`

The structure of the ledger state snapshot has changed with Cardano node '10.7'.

- Remove redundant StrictTVar comment
- Extract replayNodeChain as a reusable function
- Rename BFT test string to clarify purpose

Verify that EB transactions from certified EBs are actually applied to
the ledger by independently replaying the chain with EB resolution and
comparing the resulting state with the ThreadNet's final ledger state.

  Move SQLite event writes off the hot path using a bounded TBQueue
  (capacity 1000) and a single background writer thread. Events are
  JSON-encoded eagerly and enqueued; the writer drains the queue and
  batch-inserts via executeMany in a single transaction.

  Key changes:
  - EventSink gains a putEvents field for batch writes; mkEventSink
    provides a default sequential fallback
  - putEventsToSinks switches from event-major to sink-major loop order
  - SQLiteBased uses BLOB storage instead of TEXT, WAL mode with
    synchronous=NORMAL, and 64 MB page cache
  - Flush marker pattern (TMVar) lets rotate and tests block until all
    queued writes hit disk
  - Migration bypasses the async queue and writes directly via executeMany
  - Node replay collects events into a list then calls putEventsToSinks
    once instead of per-event mapM_
  - Rotation module delegates to underlying putEvents for batch support

  Delete `Hydra.Events.FileBased`, `Hydra.Persistence`, and
  `Hydra.PersistenceLog` which are no longer needed now that
  `Hydra.Events.SQLiteBased` is the sole persistence backend.

  Migration logic in `migrateFromFileBased` now reads the legacy
  newline-delimited JSON file directly, removing the dependency on
  `PersistenceIncremental`. The `Persistence` log constructor is removed
  from `HydraLog` along with it. Drop `resourcet` and `unliftio` from
  the library build-depends as they were only pulled in by the deleted
  modules.

mkSQLiteEventStore called sqlite3_open without first creating the
persistence directory. Fixed by adding createDirectoryIfMissing before
open, matching the behaviour of the old createPersistenceIncremental.

  Add `static-sqlite` to the static-libs overlay (built with
  `--disable-shared`) and point the `direct-sqlite` pkgconfig at it.
  This embeds libsqlite3 directly into the binary for both native and
  musl64 builds, so Docker images do not need libsqlite3.so at runtime —
  fixing the container crash-loop seen in the network-test CI workflow.

  Events are now persisted in a SQLite database (hydra.db) instead of a
  plain append-only JSON file (state). On first startup after upgrade,
  existing state files are automatically migrated into the database and
  renamed to state.migrated.

  Key changes:
  - Add Hydra.Events.SQLiteBased with mkSQLiteEventStore and
    migrateFromFileBased
  - WAL mode, synchronous=NORMAL, 64MB page cache for fast reads/writes
  - rotate uses a single transaction (atomic delete + checkpoint insert)
  - Migration batches all inserts in one transaction
  - Update Run.hs to wire up the SQLite store
  - Update docs to reflect SQLite backend and hydra.db filename
  - Add Hydra.Events.SQLiteBasedSpec mirroring FileBasedSpec

Signed-off-by: Sasha Bogicevic <[email protected]>

Co-authored-by: Agustin Mista <[email protected]>
Co-authored-by: Alexander Esgen <[email protected]>
Co-authored-by: Georgy Lukyanov <[email protected]>
Co-authored-by: Thomas BAGREL <[email protected]>
Co-authored-by: Nicolas BACQUEY <[email protected]>
Co-authored-by: Nicolas "Niols" Jeannerod <[email protected]>

Co-authored-by: Agustin Mista <[email protected]>
Co-authored-by: Alexander Esgen <[email protected]>
Co-authored-by: Georgy Lukyanov <[email protected]>
Co-authored-by: Thomas BAGREL <[email protected]>
Co-authored-by: Nicolas BACQUEY <[email protected]>
Co-authored-by: Nicolas "Niols" Jeannerod <[email protected]>

Co-authored-by: Agustin Mista <[email protected]>
Co-authored-by: Alexander Esgen <[email protected]>
Co-authored-by: Georgy Lukyanov <[email protected]>
Co-authored-by: Thomas BAGREL <[email protected]>
Co-authored-by: Nicolas BACQUEY <[email protected]>
Co-authored-by: Nicolas "Niols" Jeannerod <[email protected]>

Co-authored-by: Agustin Mista <[email protected]>
Co-authored-by: Alexander Esgen <[email protected]>
Co-authored-by: Georgy Lukyanov <[email protected]>
Co-authored-by: Thomas BAGREL <[email protected]>
Co-authored-by: Nicolas BACQUEY <[email protected]>
Co-authored-by: Nicolas "Niols" Jeannerod <[email protected]>

Co-authored-by: Agustin Mista <[email protected]>
Co-authored-by: Alexander Esgen <[email protected]>
Co-authored-by: Georgy Lukyanov <[email protected]>
Co-authored-by: Thomas BAGREL <[email protected]>
Co-authored-by: Nicolas BACQUEY <[email protected]>
Co-authored-by: Nicolas "Niols" Jeannerod <[email protected]>

Co-authored-by: Agustin Mista <[email protected]>
Co-authored-by: Alexander Esgen <[email protected]>
Co-authored-by: Georgy Lukyanov <[email protected]>
Co-authored-by: Thomas BAGREL <[email protected]>
Co-authored-by: Nicolas BACQUEY <[email protected]>
Co-authored-by: Nicolas "Niols" Jeannerod <[email protected]>

fix #2539 

  Remove redundant fields from three StateChanged constructors:

- SnapshotRequested: drop requestedTxIds (derivable from map txId
snapshot.confirmed)
- SnapshotConfirmed: change snapshot to Maybe (Nothing on normal AckSn
path where the snapshot is already tracked in seenSnapshot; Just only on
side-load path)
- DecommitRecorded: drop utxoToDecommit (derivable from utxoFromTx
decommitTx)
- PartySignedSnapshot: replace snapshot :: Snapshot tx with
snapshotNumber :: SnapshotNumber

The API server reconstructs SnapshotConfirmed outputs by threading the
seenSnapshot through a stateful mapAccum conduit for history replay and
reading nodeStateP before updating for live events.

<!-- Describe your change here -->

---

<!-- Consider each and tick it off one way or the other -->
* [x] CHANGELOG updated or not needed
* [x] Documentation updated or not needed
* [x] Haddocks updated or not needed
* [x] No new TODOs introduced or explained herafter

---------

Signed-off-by: Sasha Bogicevic <[email protected]>

From https://github.com/IntersectMBO/ouroboros-consensus at 5c351f45160e2576782ac25919e3fdca21beaca9