Engineering lifecycle

How the model was built and how a request is served

Two separate sequences. The development lifecycle is work that already happened; the runtime path is what a single request traverses. A request does not pass through training.

Model development lifecycle · historical

  1. 01
    Dolly 15K
    Instruction-tuning corpus
  2. 02
    Mixtral-8x7B-v0.1
    Base checkpoint
  3. 03
    4-bit NF4
    Memory reduction for training
  4. 04
    QLoRA Fine-Tuning
    Low-rank adapter training
  5. 05
    Model Artifact
    Packaged deployable
  6. 06
    SageMaker Deployment
    Hosted inference

This sequence is static. It records completed work and is never driven by request state.

Runtime request path · per request

Next.js
Route Handler
API Gateway
HTTPS
Lambda
Invoke
SageMaker
Endpoint
Mixtral
8x7B + adapter
Response
Normalized

Stage detail