Projects

Four projects, in the order I intend to build them. Only one is underway. Nothing here links to a repository yet, because there is nothing finished to link to.

1. 01

   Inter-annotator agreement toolkit

   in progress

   Python CLI that reads annotation CSVs and reports Cohen's kappa, Fleiss' kappa, and confusion matrices.

   Python · pandas · pytest

   Being written now, as of August 2026. Nothing to link yet.

2. 02

   Playwright test suite in CI

   next

   End-to-end suite with a page-object structure, running on GitHub Actions on a schedule.

   Python · Playwright · GitHub Actions

   Not started. Queued after the toolkit.

3. 03

   Annotation audit pipeline

   planned

   pandas pipeline that flags SOP violations in labeled data and tracks annotator accuracy over time.

   Python · pandas

   Not started.

4. 04

   Labeling quality dashboard

   planned

   Visualises agreement trends and error taxonomies from the audit pipeline output.

   Python · Streamlit or Plotly

   Not started. Depends on the audit pipeline.

Status last checked 2026-08-13.