Skip to content

Kafka Financial Event Platform

An enterprise-style stock-exchange event platform on Kubernetes, built from scratch one reasoned decision at a time. The technical goal is to process one billion events end to end with finance-grade governance, operability and resilience. The learning goal is to show why each decision is made: the alternatives, the trade-offs and the failure modes.

Start the learning track View the code on GitHub

A learning project

This is a local reference setup with a synthetic market. It is not a production exchange, and it is not certified against any regulation.

Where to start

  • Learning track

    Concept notes that explain the ideas behind each phase, and a retrospective per phase.

    Learning

  • Architecture

    Layers, topology and the order-to-trade pipeline.

    Architecture

  • Decisions

    Every architecture decision, with the options that were rejected and why.

    Decision records

  • Operations

    Task-focused runbooks, maintenance and upgrades, HA and disaster recovery.

    Runbooks

  • Governance

    A control matrix mapped to MiFID II/MiFIR, MAR, DORA, GDPR and ISO 27001, with evidence.

    Compliance

Roadmap

# Phase Scope Status
0 Foundation Repo hygiene, docs skeleton, ADRs, control matrix, CI ✅ complete
1 Cluster Layered OpenTofu, kind, Argo CD bootstrap, profiles ✅ complete
2 Platform Monitoring, logging and retention, Kyverno, Envoy Gateway, cert-manager, secrets ⚪ planned
3 Kafka Strimzi KRaft, TLS + SCRAM, ACLs, topics as code, Apicurio, Kafbat UI ⚪ planned
4 Apps trader-sim, order entry, matching engine (EOS), market data, surveillance, post-trade, ClickHouse, Valkey ⚪ planned
5 Tests Unit/integration, manifest/policy, load, chaos ⚪ planned
6 Billion run Tuning, 1B run, benchmark report, dashboards ⚪ planned
7 Resilience HA scenarios, backup/restore, DR drills with measured RPO/RTO ⚪ planned
8 Lifecycle Upgrade scenarios, maintenance plans, rollback ⚪ planned
+ CI Lint and secret scan ✅; tests, manifest and policy validation per phase 🟡 ongoing
+ Governance Control matrix updated every phase 🟡 ongoing

Pages on this site are generated from the platform repository, which remains the source of truth. Use the edit button on any page to propose a change there.