GlassAlpha

Open-source ML audit infrastructure for deterministic, audit-ready model reports.

GlassAlpha is an open-source toolkit for deterministic audit reports for tabular ML models, with fairness, explainability, calibration, robustness, and reproducibility metadata in one local workflow.

Open sourceApache 2.0Beta

Operational shape

How the project supports decisions, context, and execution.

GlassAlpha logo
Primary use
ML model audit and compliance
AI role
Model validation and reporting
Best fit
Tabular binary classification workflows

What it is

GlassAlpha is an open-source toolkit for deterministic, audit-ready reports for tabular ML models.

The workflow is intentionally operational: run a CLI or Python API against a model and dataset, produce reproducible HTML/PDF audit artifacts, and keep the evidence needed to explain model behavior later.

The project focuses on the parts of ML validation that are easy to underbuild: lineage, repeatability, fairness checks, calibration, robustness, preprocessing verification, and deployment gates.

What it demonstrates

The technical value is in making model validation repeatable enough to inspect, rerun, and gate.

  • Deterministic audit workflows for ML systems
  • Reproducible HTML/PDF reports for model validation
  • Fairness, calibration, robustness, and explainability in one pipeline
  • Offline and local execution so data does not need to leave the operator environment
  • CI/CD-oriented deployment gates for model degradation checks
  • Complete audit trails with seeds, versions, Git SHA, hashes, and configuration lineage

System architecture

The architecture is deliberately boring: model and data go in, a deterministic audit pipeline runs, and evidence comes out in a form that can support review.

GlassAlpha turns model validation into reproducible audit artifacts, evidence packs, and optional deployment gates.

Technical proof points

The project is strongest where reviewers look for execution discipline: deterministic outputs, lineage, gates, and honest limits.

Determinism

Byte-stable HTML reports on the same platform, Python version, and configuration where supported.

Lineage

Git SHA, config hash, data hash, seeds, and package versions are captured in the audit trail.

Fairness

Demographic parity, equal opportunity, predictive parity, and intersectional fairness checks.

Explainability

Feature importance and SHAP-based individual explanations for supported model classes.

Robustness

Adversarial perturbation checks and demographic shift simulation.

Calibration

ECE, Brier score, calibration curves, and confidence-aware calibration analysis.

Deployment gates

Fail-on-degradation checks for CI/CD workflows.

Local execution

Runs offline without an external service dependency.

Source and repository

Public code, docs, architecture notes, examples, and project status are linked directly when they can be shared responsibly.

Working repository

The repository contains the Python package, CLI, docs, examples, tests, and workflow evidence needed to evaluate the project as software rather than a demo.

Open sourceApache 2.0Python CLI / APIBeta
  • Documentation and tutorials
  • Example audit configurations
  • Tests
  • Jupyter examples
  • CI workflows and determinism checks
  • Security posture through OpenSSF Scorecard workflow

How it's used

These are the practical workflows and constraints the project is built around.

Audit-ready validation

Packages performance, fairness, explainability, calibration, robustness, and reproducibility metadata into one inspectable workflow.

Review without data exfiltration

Runs locally so teams can generate evidence without sending model data through an external service.

Release discipline

Supports degradation checks and standardized exit behavior so model quality can become part of deployment review.

Why this matters for operational AI

GlassAlpha is useful evidence of applied AI systems work because it focuses on reproducibility, audit trails, deterministic outputs, validation gates, and documented model behavior. Those primitives show up wherever oversight and repeatability matter more than demos.

Limitations

The constraints are explicit, which makes the project easier to evaluate and safer to adapt.

  • Beta software with APIs that may change before v1.0
  • Focused on tabular binary classification
  • Not designed for text, image, or time-series models yet
  • Some PDF reproducibility details depend on platform and font rendering

More public projects

Different surfaces, same focus on context, coordination, review, and execution. This is a selected public view, not a complete project history.

Back to portfolio
AlignTrue logo

AlignTrue

AlignTrue is an open-source reference architecture for supervised AI systems that need durable receipts, replayable state, governed actions, and fenced side effects.

Maintenance Control logo

Maintenance Control

A private MVP build for approved-publication retrieval, voice query, and source-cited maintenance guidance on phone, web, and wearable surfaces.

Ready to build something real?

Main Character helps turn complex product, workflow, and architecture problems into systems that work under real constraints.

Talk to us