Shadow Sentinel

Shipping a new model is risky because you cannot tell how it behaves on real traffic until it is already serving users. Shadow Sentinel removes that risk: a challenger model runs on live requests in parallel with production, affecting no one, while the system measures agreement and decides automatically whether the new model is safe to promote.

• 01On every push, GitHub Actions runs unit tests, code quality checks, and model validation on accuracy and latency, then builds and pushes a Docker image. A failing gate blocks the deploy and notifies the developer.
• 02A FastAPI gateway routes all requests to Model A in production, which serves the user response, while Model B, the challenger, runs silently in parallel on the same traffic.
• 03A comparison layer logs the agreement rate between the two models across requests, plus a confidence gap and high confidence conflicts.
• 04After 200+ requests, the system decides automatically: 80% agreement or higher promotes Model B to production, anything lower triggers an automatic rollback, fires an alert, and keeps Model A. A Streamlit dashboard shows it all live.

This is the project that thinks most like production. Shadow mode plus automated promotion and rollback is exactly the reliability work that separates a model that demos well from one a team can actually trust on live traffic.