
Training AstraGPT-7B on 2× RTX 4090: the actual recipe
The full configuration behind the 7B model: architecture, LoRA settings, batch math, hardware and what we would change next time.
Training recipes, inference plumbing, dataset design, weight forensics and open-source tooling. Written from the work, not around it.

The full configuration behind the 7B model: architecture, LoRA settings, batch math, hardware and what we would change next time.

Why a gateway sits between applications and model providers, and the specific mechanics — channels, fallbacks, streaming, connection pooling — that make it useful.

AstraGPT Reasoning Dataset v1 treats chain-of-thought as the primary artifact. Here is what that changes for training, verification and uncertainty.

A public 7.7 TB checkpoint claimed a mythos-class training run. A deterministic hash of tensor names rebuilt 633 tensors bit-for-bit. Here is the method and what it does not prove.

Vision-LLM moderation with 15 categories, tenant keys, webhooks and Prometheus — plus the benchmark numbers and the latency trick that matters most.